Robert Havránek Microsoft

Prezentace na téma: "Robert Havránek Microsoft"— Transkript prezentace:

1 Robert Havránek Microsoft
Co přináší práce s velkými daty nejen velkým organizacím Jak s nimi pracovat a jaké má řešení Microsoft Robert Havránek Microsoft

2 Agenda Příklady využití velkých dat nejen pro velké organizace
Microsoft řešení Známé nástroje Business Intelligence

3 Příklady využití velkých dat nejen pro velké organizace

4 KOMPLEXNOST DAT: OBJEM A RŮZNORODOST
Co jsou velká data? Terabytes Gigabytes Megabytes Petabytes KOMPLEXNOST DAT: OBJEM A RŮZNORODOST ERP / CRM WEB 2.0 Mobile Advertising Web Logs eCommerce Recommendations Collaboration Digital Marketing Search Marketing BIG DATA Social Sentiment Sensors / RFID / Devices Audio/Video Log Files Spatial & GPS Coordinates Data Market Feeds eGov Feeds Weather Text/Image Wikis/Blogs Click Stream Payables Payroll Inventory Contacts Deal Tracking Sales Pipeline

5

6 Příklady využití až o 30% 1.5 TB/day 50,317 100 TB/rok 7.8% $1,600/rok
vyšší cenu akceptují Mac uživatelé za cest. Služby od Orbitz 1.5 TB/day Internal IT Traffic at Chevron 50,317 nehod v Los Angeles v roce 2002 100 TB/rok dat z nových sensorů TVA 7.8% ztráta tržeb kvůli opravám v provozu $1,600/rok US průměrné pojištění auta

7 Analýza sociálních médií
MGXFY13 4/5/2017 Analýza sociálních médií © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8 MGXFY13 4/5/2017 © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9 MGXFY13 4/5/2017 © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

10 Microsoft řešení

11 Microsoft řešení pro velká data
SQL Server EE Sensory Zařízení Stream Roboti ERP CRM LOB APPs Windows Azure HDInsight Service Microsoft HDInsight Server Konektory Nestrukturovaná a strukturovaná data Analýza a reporting S S RS

12 Hardware + Software zařízení
SQL Server 2012 Parallel Data Warehouse v2 Předkonfigurovaný Hardware Předinstalovaný Software Nastavený Node Failover Plug & Play Zužitkované zkušenosti Úspora času

13 SQL Server 2012 Parallel Data Warehouse v2
MGXFY13 4/5/2017 SQL Server 2012 Parallel Data Warehouse v2 Business Intelligence, BIG DATA Nová generace škálovatelného výkonu Skvělý poměr cena/výkon Introducing SQL Server 2012 Parallel Data Warehouse –the next version of Microsoft’s scale-out Massively Parallel Processing (MPP) data warehouse appliance (PDW) by evolving the platform to fully embrace this new world of data. SQL Server 2012 Parallel Data Warehouse was built to handle the highest data requirements, unstructured data in Hadoop and deliver in-memory performance with a TCO that fundamentally redefines what a tier one appliance should cost. Built for Insights On Big Data: SQL Server 2012 Parallel Data Warehouse is powered by a fundamental breakthrough on the data processing engine, PolyBase which enables integrated query across Hadoop and relational data. Without manual intervention, PolyBase Query Processor can accept a standard SQL query and join tables from a relational source with tables from a Hadoop source to return a combined result seamlessly to the user. Going a step further, native Microsoft BI integration allows users to join structured and unstructured data together in familiar tools like Excel to answer questions and make key business decisions quickly. Next-generation Performance At Scale: By changing the primary storage engine to a new updateable version of xVelocity columnstore and with the ability to start from small terabyte requirements that linearly scale out to petabytes of data, users can gain in-memory performance (up to 50x faster) on datasets of any scale. This scale is achievable with PDW’s MPP engine which distributes and parallelizes multiple instances of SQL Server with dedicated CPU, memory and storage to linearly scale out from small all the way up to 5 Petabytes of structured data. Optimal Architecture: More than just an engineered system, SQL Server 2012 PDW has reshaped the very hardware specifications required of an appliance through innovations from the software. Through features delivered in Windows Server 2012, PDW now has built-in performance, reliability, and scale for storage affording it to replace the SAN with a more economical high density disk option. Further, HyperV in Windows Server virtualizes and streamlines an entire server rack of control functions down to a few nodes. Finally, xVelocity columnstore provides both compression and the potential to eliminate the entire rowstore copy to reduce storage usage up to 70%. As a result of these innovations in software that has transformed the hardware, SQL Server 2012 PDW has a price/terabyte that is the lowest in the market. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

14 Business Intelligence, BIG DATA
MGXFY13 4/5/2017 Big Data s Polybase Business Intelligence, BIG DATA Database HDFS (Hadoop) SQL Server 2012 PDW Powered by PolyBase SQL Jednotné dotazy; strukturovaná a nestrukturovaná data Odpadá mezikrok nalití dat z Hadoop do DW Standardní SQL jazyk a dovednosti (není potřeba učit se MapReduce) © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

15 Business Intelligence, BIG DATA
MGXFY13 4/5/2017 Business Intelligence nástroje Business Intelligence, BIG DATA Hadoop Data Strukturovaná Data Nativní integrace BI nástrojů Rozšířené a známé nástroje (ne)strukturovaná data v jednom sešitu © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

16 Extrémní výkon a škálovatelnost
MGXFY13 4/5/2017 Extrémní výkon a škálovatelnost Nová generace škálovatelného výkonu 0TB 7 PB Add Capacity Customer Sales Country Supplier Products Columnstore = extrémní nárůst výkonu Massively Parallel Processing (MPP) architektura Až 15x komprese dat Zpracování v paměti Scale out technologie – od malého řešení s několika TB až do 7 Petabytes (žádný downtime) © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

17 Skvělý poměr cena/výkon
MGXFY13 4/5/2017 Skvělý poměr cena/výkon Skvělý poměr cena/výkon Appliance s přednastaveným HW a SW za prémiové ceny Bez appliance si musíte vybudovat vlastní HW a nakonfigurovat SW © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

18 Cena/TB předních vendorů
Optimální hodnota Cena/TB předních vendorů Nejnižší cena Terabyte na trhu Výrazně nižší cena než konkurence 2.5x nižší cena za Terabyte než předchozí verze (Hardware + Software list price ) (Compression X Performance Disk Capacity) $/TB =

19 Microsoft řešení pro velká data
SQL Server EE Sensory Zařízení Stream Roboti ERP CRM LOB APPs Windows Azure HDInsight Service Microsoft HDInsight Server Konektory Nestrukturovaná a strukturovaná data Analýza a reporting S S RS

20 Známé nástroje Business Intelligence pro analýzu velkých dat

21 Microsoft Business Intelligence
Teams Individuals Power View for SharePoint Self-Service IT Managed PowerPivot for Excel

22 #1 Business Intelligence poskytovatel
Lídr v magickém kvadrantu Nejrychleji rostoucí Nejvíce používaná platforma Zdroj: Top analytical comp., Magic Quadrant for Business Intelligence Platforms, Gartner Research, February 6, 2012. Zdroj: Top analytical comp., Business Intelligence market revenue growth rates Zdroj: InformationWeek Analytics 2010 BI and Information Management Survey

23