Novinky v MS SQL Serveru 2005 Mgr. Michal Neuwirth ISV Technical Readiness Microsoft Czech Republic michalne@microsoft.com

Obsah Enterprise Data Management Vývoj Business Intelligence

Cross-release objectives SQL Server Historie 1st Generation 2nd Generation 3rd Generation SQL Server 6.0/6.5 SQL Server 7.0 SQL Server 2000 SQL Server 2005 Differentiation from Sybase SQL Server Windows integration First to include Replication Re-architecture of relational server Extensive auto resource management First to include OLAP & ETL Performance, scalability focus XML support First to include Notification First to include Data Mining & Reporting Availability focus Security Developer productivity Native XML First to include Enterprise ETL & Deep Data Mining Cross-release objectives Reliability & Security Integrated Business Intelligence Lowest TCO Automatic Tuning

Minimální HW Hardware 32-bitový SQL Server 2005 Hardware Intel či kompatibilní Pentium 600 MHz + Paměť (RAM) Alespoň 256 MB; doporučené 512 MB + Prostor na disku SQL Server komponenty: od 95 do 300 MB, „typical“ 250 MB Analysis Services: min. 50 MB, standardně 130 MB Reporting Services: min. 50 MB pro Report Server, 30 MB pro Report Designer Hardware 64 Bit SQL Server 2005 Server Intel Itanium 2, AMD Opteron, Intel Xeon EM64T Paměť (RAM) min.1 GB

Edice SQL 2005 (32 Bit) Standard Edition Enterprise Edition bez clustering-u, bez indexed views atd. do 16 instancí (každá vyžaduje licenci) Enterprise Edition všechny vlastnosti, pro velké podnikové databáze do 50 instancí (žádné přídavné licence) Developer Edition Jako EE určené vývojářům, licencované pro vývoj a testování Express Edition bezplatná klientská databáze nebo malá databáze na serveru Mobile Edition pro Smart Devices, replikace s primární databází

Edice SQL 2005 (64 Bit) SQL Server 2005 Enterprise Edition (64-bit) všechny funkce SQL Server 2005 Developer Edition (64-bit) Jako EE pro vývojáře licencované pro vývoj a testování

.NET Framework Common Language Runtime Integration User-defined Aggregates User-defined Data Types User-defined Functions SQL Server In-Proc Data Provider Extended Triggers Data Types File Stream Storage Attribute Managed SQL Types New XML Datatype SQL Server Engine New Message Service Broker HTTP Support (Native HTTP) Database Tuning Advisor Enhanced Read ahead & scan Extended Indexes Multiple Active Result Sets Persisted Computed Columns Queuing Support Snapshot Isolation Level Scale Up Partitioning VIA support NUMA support Database Failure and Redundancy Fail-over Clustering (up to 8 node) Enhanced Multi-instance Support Database Mirroring Database Viewpoints XML XQUERY Support (Server & Mid Tier) XML Data Manipulation Language FOR XML Enhancements XML Schema (XSD) Support MSXML 6.0 (Native) XQuery Designer Database Maintenance Backup and Restore Enhancements Checksum Integrity Checks Dedicated Administrator Connection Dynamic AWE Fast Recovery Highly-available Upgrade Online Index Operations Online Restore Parallel DBCC Parallel Index Operations Mirroring Management Tools MDX Query Editor MDX Intellisense T-SQL Intellisense Version Control Support XML/A SQLCMD Command Line Tool SQL Workbench BI Workbench Performance Tuning Profiler Enhancements Profiling Analysis Services Exportable Showplan Exportable Deadlock Traces Full-text Search Indexing of XML Datatype MDAC Side by Side installation Microsoft Installer base setup Support for Active Directory Deployment SQL Client .NET Data Provider Server Cursor Support Asynch Security All Permissions Grantable Fine Grain Administration Rights Separation of Users and Schema Replication Auto-tuning Replication Agents Oracle Publication Improved Blob Change Tracking OLAP and Data Mining Analysis Management Objects Windows Integrated Backup and Restore Web Services/XML for Analysis DTS and DM Integration Eight new DM algorithms Auto Packaging and Deployment Data Transformation Services New Architecture (DTR + DTP) Complex Control Flows Control Flow Debugging For Each Enumerations Property Mappings Full Data Flow Designer Full DTS Control Flow Designer Graphical Presentation of Pkg Execution Immediate Mode and Project Mode Package (Advanced) Deployment Tools Custom Tasks and Transformations Reporting Services Multiple Output Formats Parameters (Static, Dynamic, Hierarchical) Bulk Delivery of Personalized Content Support Multiple Data Sources Sharepoint Support Visual Design Tool Charting, Sorting, Filtering, Drill-Through Scheduling, Caching Complete Scripting Engine Scale Out architecture XML Report Definition Notification Services SQL Server Service Broker

Vysoká dostupnos Database Server Failure Database Maintenance Failover Clustering Database Mirroring Database Maintenance Online Index Operations Fast Recovery Data Access Concurrency Snapshot Isolation Chyby uživatelů, aplikací Database snapshots

Online Index operace Online index údržba Plně paralelní Create, Rebuild, Reorganize, Drop, Add or drop constraint Plně paralelní Online/offline obojí podporováno

On-Line operace On-Line Page and File restore Databáze zůstává online – pouze data, která se obnovují nejsou přístupná Dedikované spojení pro Admin Specielní spojení pro Admina pokud se nelze připojit jinak Rychlá obnova Databáze je přístupná v době Undo fáze Redo Undo Available

Rozšíření replikací Nativní podpora pro Oracle jako publisher pro transakční replikace Merge replikace přes HTTPS Podpora pro nové datové typy MS SQL 205

Management Studio Integrovaná správa Performance DB, Analysis Services, Reporting Services, Notification Services, SQL Server CE… Více SQL Serverů v jedom rozhraní Performance Operace: Profiler, Query Analyzer

Tuning Database Tuning Advisor What-If Analysis XML Show Plan

Diagnóza Dynamické pohledy pro správu SQL Trace SQL Profiler “sys.memory_clerks” – kolik paměti zabírá každá komponenta? “sys.schedulers” – jak dobře funguje scheduler? SQL Trace SQL Profiler Deadlock a ShowPlan

Partitioning Rozdělení objektu do více částí Partitioning je transparentní pro aplikaci Lze aplikovat na Tabulky Indexy Indexované pohledy Partitioning se provádí na úrovní řádků Všechny části jsou v jedné databázi

SQL Server Mobile Podpora pro běh na: Integrace: Next release Windows Mobile Smartphone TabletPC Next generation Windows Mobile zařízení Integrace: Integrace s SQL Server Management Studiem Import dat do SQL Mobile z libovolného DTS zdroje Integrace s Visual Studiem 2005 Support for future release of Windows Mobile Smartphone Support for TabletPC One solution - Smart Phone to TabletPC Same data access and sync Support for next generation Windows Mobile devices Integration with Management Studio Create / Modify SQL Mobile schema On desktop or device New SQL Mobile subscription wizard View SQL Mobile graphical execution plans Query SQL Mobile data On desktop of device Integration with BI Import data to SQL Mobile from any DTS data source Integration with Visual Studio 2005 Data designers Drag and drop data Schema modification and querying New storage engine Auto-shrink capability True ACID transactions Multi-user support Background sync Multiple apps against same database Enhanced Query Processor Utilize SE histograms Produces XML execution plans Allows for query hints New SQLCEResult managed cursor Fully updateable and scrollable managed cursor Significant performance improvement over dataset Synchronization Column level tracking Significantly reduces data over wire Progress notifications Allows developers to provide progress Multiple subscription in one database Programmatic control of compression and timeout Tight integration into new merge replication features Partitioned Groups BCP snapshot consumption Article download and upload options

Agenda Enterprise Data Management Vývoj Business Intelligence

.NET a Visual Studio Integrace Volba programovacího modelu T-SQL pro práci s daty .NET pro operace náročnějsí na CPU Integrované ladění cross-language debugging – TSQL a .NET Možnost nastavení breakpointů kdekoliv .NET programování Users defined functions, procedury, triggery User defined types a agregace Internal tests show some scenarios have a 40x performance increase with one-fifth the code for things that T-SQL doesn’t do so well but C#/VB/.NET Framework do great – string manipulation, complex math, etc.) Visual Studio supports a new SQL Server 2005 Project system Easy to develop, debug and deploy .NET code for SQL Server 2005 Integrated debugging experience across mid-tier and database tier Seamlessly step cross-language – TSQL and .NET Set breakpoints anywhere, inspect anything Customer benefit : Increased Productivity CLR Integration benefits: Rich Languages, APIs in the Database + Tools  Developer Productivity In-Proc Data Access via ADO.NET  Allows portability of code from/to middle-tier Managed Functions - Mixture of data access & business logic Demand Forecasting application being developed as a scenario Managed Procedures - XP replacement Robust alternative to access external resources (file/registry) UDTs - Small, scalar types to augment SQL’s native typespace E.g. Date, time

The Developer Experience VB,C#,C++ Build Assembly: “TaxLib.dll” VS .NET Project SQL Data Definition: create assembly … create function … create procedure … create trigger … create type … Runtime hosted by SQL (in-proc) SQL Server SQL Queries: select sum(tax(sal,state)) from Emp where county = ‘King’

XML - Usage Scenarios XML Datatype, Schema, Indexes – Storage and management of semi-structured data and hierarchical data XQuery and DML Extracting stored XML Node level update (instead of full XML) Customer usage, benefit : New scenarios (e.g. Document Management)

Native XML Store Native XML Datatype XML Schema (optional) XML Indexes Columns, Variables, Parameters XML Schema (optional) Schema Collections XML Indexes XML Data access, updates XQuery DML Extensions Integrates with Relational processing Complements SQLXML

SQL Web Services HTTP.SYS Native SOAP access Standards based access to SQL Server No client dependency Improved Interoperability New “HTTP ENDPOINT” object Configure connection info Configure authentication Expose Functions & SPs Expose TSQL Batches Leverages kernel-mode listener http://myserver/sql Port: 80 Integrated Auth WebMethod = myDb.dbo.mySP HTTP Endpoint

T-SQL Enhancements Varchar(max), Varbinary(max) Exception Handling Alternative to Text, Image Uniform Programming model Exception Handling Try/Catch Recursive Queries MARS Asynchronní dotazy Other Pivot, UnPivot Top (expression) Customer usage, benefit : Better database applications, addresses existing pain points.

Service Broker Fully integrated into the database engine Programming Model - DDL and DML Integrated Management and Deployment Dependent features – Events, Query Notifications, SQLiMail Customer Usage, benefits: Enables new scenarios - async SPs, Scalable distributed multi-db applications

Service Broker SQL Engine SQL Engine APP 1 APP 2 Framework for building Reliable, asynchronous, distributed applications Communication infrastructure Two-way “Dialogs” Reliable delivery to local, remote queues Exactly-once, In-order semantics Large Message Fragmentation

Query Notifications Execute query and get notified when the results have changed Subscription Query ID, Service Broker Service, TimeOut Notification SQL Server begins DIALOG with Service Notification is delivered to the Service Client APIs – ADO.Net, OLEDB Customer Usage, benefit : Caching Použito při cachováni v ASP.NET 2.0

Agenda Enterprise Data Management Developer Productivity Business Intelligence

A Complete Enterprise Data Management and BI Solution SQL Server 2005 A Complete Enterprise Data Management and BI Solution Development Tools Reporting Services Management Tools Analysis Services OLAP & Data Mining Integration Services ETL SQL Server Relational Engine

Integration Services (DTS v SQL 2000) Breakthrough ETL capabilities Enterprise ETL platform High performance High scale Trustworthy and reliable Best in class usability Rich development environment Source control Visual debugging of control flow and data Great range of transforms out-of-the-box Highly extensible Custom tasks Custom enumerations Custom transformations Custom data sources Enterprise ETL platform High performance – competitive with the best in the industry High scale – distribute transformations across processors Trustworthy and reliable – built-in data cleansing, error data handling and restartability Best in class usability Full developer IDE Source control Visual debugging of control flow and data Configuration and deployment for develop, test and release. Great range of transforms out-of-the-box: little or no scripting required! Highly extensible – with native or managed code Custom tasks Custom enumerations Custom transformations Custom data sources

BI Development Studio A complete, integrated tool for the development of BI applications One tool, multiple technologies: Relational, OLAP, DM, DTS, Reporting, Code, Web pages… Enterprise software development environment: Integrated into Visual Studio.NET Team development, source control, versioning, developer isolation, resource independent coding Development cycle lifetime support Develop, Test, Deploy, Modify, Test… Breakthrough ease of use

Reporting Services Introduced with SQL Server 2000 Open, extensible enterprise reporting solution Report authoring, management, delivery Office System integration VS.NET development environment SQL Server 2005 enhancements Integration with AS, DTS, management tools Developer enhancements Improved report interactivity Rich end-user reporting

Analysis Services Unified Dimensional Model Pro-active caching Integrating relational and OLAP views Pro-active caching Bringing the best of MOLAP to ROLAP Advanced Business Intelligence KPIs, MDX scripts, translations, currency… Web services Native XML/A

Data Mining Focus Complete set of analytics Embedded data mining Most popular data mining algorithms (5 new) Enhanced creating, editing, and viewing environment Embedded data mining Embed data mining in LOB applications Complete SQL language based API Native XML/A support Integrated solution Tight integration with Relational, OLAP, DTS, Reporting technologies Comprehensive SQL Server BI platform Alliance with ISVs Focus on broadening the market Agreed on finalizing DM industry standard based on OLE DB for DM and XML/A Microsoft's goal for the data mining functionality in SQL Server 2005 is to build tools that: Are easy to use Provide a complete set of features Are easily embedded in production applications Integrate closely with the other SQL Server BI technologies, and Extend the market for data mining applications. To date, the development of such applications has been focused on the biggest problems at the biggest companies – those who can afford scarce analytical talent and high development costs that have traditionally been required to build a data mining application. Just as Microsoft's OLAP technologies have helped the OLAP market to grow, we are looking to extend data mining technologies to enterprises and corporate departments that have not been able to develop such applications in the past. Use the SQL Server 2005 Data Mining tools to explore a set of data for patterns, and then optionally perform prediction on those patterns. That's all data mining is: exploration, pattern discovery, and pattern prediction.

Complete Set of Algorithms Decision Trees Clustering Time Series Introduced in SQL Server 2000 Sequence Clustering Association Naïve Bayes All data mining tools, including Microsoft SQL Server 2005 Analysis Services, use multiple algorithms. Analysis Services, of course, is extensible; third party ISVs can develop algorithms that snap in seamlessly to the Analysis Services data mining framework. Depending on the data and the goals, different algorithms are preferred, and each algorithm can be used for multiple problems. Analytical problem Examples Microsoft algorithms Classification: Assign cases to predefined Decision Trees Naďve Bayes Nueral Nets classes such as "Good" vs "Bad“ Credit risk analysis Churn analysis Customer retention Neural Net

SQL Server The Comprehensive, Integrated Data Platform Talking points: SQL Server is a comprehensive, integrated end to end data platform including: Core database engine: secure, reliable, highly available data store Data transformation and replication services (DTS, Replication) facilitate enterprise wide data integration, data warehouse creation, data replication for distributed or mobile data processing applications, and systems availability Deriving additional value from your data: Notification Services, Data Analysis, Data Mining, Reporting Management tools – SQL specific management suite as well as tight integration with tools such as MOM, SMS Development tools – BI specific development toolset as well as tight integration with Visual Studio Flexible, extensible: Every major subsystem in SQL Server ships with it’s own Object Model and set of APIs to you to extend the data system in any direction that is unique to your business Interoperable: Standard data access protocols drastically reduce the time it takes to integrate data in SQL Server with existing systems. In addition, native web service support is built into SQL Server to ensure interoperability with other applications and platforms SQL Server is the only database to include all of this functionality out of the box. Competitive offerings rely on third part applications to address key functionality and/or charge for incremental functionality (such as BI) Also provide entry level SKUs for lightweight data needs (Express, Workgroup) Scales to your needs: support for databases from the mobile device to the datacenter SQL Server Mobile, 32 bit, 64 bit Hardware platform range of SQL Server includes: Single Pocket PC CPU systems, Throughout mobile and desktop class PCs, Through Multi-CPU server systems All the way up to 64-processor Enterprise Data Center systems

© 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.