Upload
truongdiep
View
216
Download
2
Embed Size (px)
Citation preview
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 1
PER STRICKER, THOMAS KALB
07.02.2017, HEART OF TEXAS DB2 USER GROUP, AUSTIN
08.02.2017, DB2 FORUM USER GROUP, DALLAS
DATABASE TRENDS AND HYPES
ITGAIN
120 Employees
Locations Hannover, Hamburg, Atlanta
Consulting
Database Technologies
Datamanagement and analysis
Mainframe Migration
Speedgain monitor products
Mainframe migration products
J2U, CM-Tool, IMS Toolset, TRX-Engine, Sort
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 2
SPEEDGAIN MONITOR SOLUTIONS
Speedgain for DB2 LUW
Copyright © 2016 ITGAIN GmbH 3
Speedgain for DB2 LUW
Copyright © 2016 ITGAIN GmbH 4
SQLREPAYER - NEW
AGENDA
Database Trends (Database Evolution)
Multi Model Database
NewSQL
CQL
GPU powered Databases
Open Source Databases
Database Hype (Database Revolution)
Cognitive Systems (Databases)
Blockchain
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 5
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 6
WHAT DRIVES IT TODAY?
Copyright © 2016 ITGAIN GmbH 7
GSE Deutsche Jahrestagung München
IT – The next 5 Years?!
“Where is Database Tech headed?“
2010
Thomas Kalb
ITGAIN GmbH
Copyright © 2010 ITGAIN GmbH Mai 2010 7
TRENDS AND HYPES
Database Trends and Hypes
Cloud Databases
Copyright © 2016 ITGAIN GmbH 8
TRENDS AND HYPES
Database Trends and Hypes
Cloud Database
Copyright © 2016 ITGAIN GmbH 9
IT TRENDS 2017 – GARTNER
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 10
Trend No. 1: Artificial Intelligence and Advanced Machine Learning (Cognitive Computing)
Trend No. 2: Intelligent Apps
Trend No. 3: Intelligent Things
Trend No. 4: Virtual Reality and Augmented Reality
Trend No. 5: Digital Twins
Trend No. 6: Blockchains and Distributed Ledgers
Trend No. 7: Conversational Systems
Trend No. 8: Mesh App and Service Architecture
Trend No. 9: Digital Technology Platforms
Trend No. 10: Adaptive Security Architecture
http://www.gartner.com/doc/3471559?srcId=1-6595640685#-363727574
AGENDA
Database Trends (Database Evolution)
Multi Model Databases
NewSQL
CQL
GPU powered Databases
Open Source Databases
Database Hype (Database Revolution)
Cognitive Systems (Databases)
Blockchain
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 11
NOSQL DATABASES
Types of NoSQL Databases
Key-Values Stores
Column Family
Document Stores
Graph Databases
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 12
NOSQL APPLICATION INTEGRATION
POLYGLOT PERSISTENCE
Application System
Session Data
Logs Product docu- menta-
tion
CRM Analysis XA Data
Key- Value Columnar Document Graph Hadoop RDBMS
DB2 LUW GSE 2016 – Database Trends und Hypes
nd HypCopyright © 2016 ITGAIN GmbH 13
MULTI MODEL DATABASE
SINGLE MODEL NOSQL DATABASE
https://www.htwdresden.de/fileadmin/userfiles/info_math/Dokumente/Veranstaltungen/DBST/20141029_192_Hackstein.pdf
DB2 LUW GSE 2016 – Database Trends und Hypes
nd HypCopyright © 2016 ITGAIN GmbH 14
NOSQL DATABASES: SCALABILITY VERSUS COMPLEXITY
Scalability
Key-Values Store
Column - Family
Document - Stores
Graph - Databases
Database Trends and Hypes
Internal Complexity
Copyright © 2016 ITGAIN GmbH 15
k v
MULTI MODEL DATABASES
Integration of diverse NoSQL Technologies
Ability to store data in diverse data formats
Key-Value-Pair
Documents
Graphs
Query possibilities in each format
Different types of queries can be combined
Alternative to Polyglot Persistence Integration
Databases: OrientDB, ArangoDB, DB2 with Document Interface (MongoDB Emulation) or BLU
http://www.slideshare.net/lvca/polyglot-persistence-vs-multimodel-databases
Database Trends and Hypes
nd HypCeospyright © 2016 ITGAIN GmbH 16
AGENDA
Database Trends (Database Evolution)
Multi Model Databases
NewSQL
CQL
Open Source Databases
Database Hype (Database Revolution)
Cognitive Systems (Databases)
Blockchain
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 17
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 18
NEWSQL
SQL + NoSQL => NewSQL
Merge von NoSQL und SQL
Scalability of NoSQL + ACID* Guarantee of RDBMS
Schema free
Polyglot API
*Atomicity, Consistency, Isolation, Durability
http://www.dbta.com/BigDataQuarterly/Articles/The-Database-Technologies-of-the-Future-109659.aspx
CQL
Cypher Query Language
Developed for Neo4j
Designed for Graph Databases but could also be used by RDBMS
No expensive JOINs or Indexes
Cypher: MATCH (p:Person)<- [:EMPLOYEE]-(d:Department) WHERE d.name = "IT Department" RETURN p.name
SQL: SELECT p.name FROM Person p, JOIN Department d ON d.id = p.departmentID WHERE d.name = “IT Department”
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 19
AGENDA
Database Trends (Database Evolution)
Multi Model Databases
NewSQL
CQL
GPU powered Databases
Open Source Databases
Databases Hype (Databases Revolution)
Cognitive Systems (Databases)
Blockchain
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 20
GPU POWERED DATABASES
Graphics Processor (Graphics Processing Unit)
GPUs are significantly better than CPUs at parallel processing
Specialized and optimized processor for massive parallel tasks
In contrast to the GPU the CPU is much better at universal tasks
GPUs are well suited for scientific, graphic or data intensive applications
Share the database operational load across many shoulders
GPU powered Databases are column based databases
Ultra-fast reading without indexes
http://diginomica.com/2016/11/16/mongodb-ceo-claims-won-developers-hearts-oracle/ Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 21
ALENKA – A GPU POWERED DATABASE
http://tech.marksblogg.com/alenka-open-source-gpu-database.html
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 22
DB2 BLU – WITH GPUS
https://openpowerfoundation.org/blogs/db2-blu-wgpu-demo-concurrent-execution-of-an-analytical- workload-on-a-power8-server-with-k40-gpus/
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 23
DB2 BLU – WITH GPUS
http://on-demand.gputechconf.com/gtc/2015/presentation/S5229-Sina-Meraji.pdf
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 24
DB2 BLU – WITH GPUS
http://on-demand.gputechconf.com/gtc/2015/presentation/S5229-Sina-Meraji.pdf
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 25
DB2 BLU – WITH GPUS
http://on-demand.gputechconf.com/gtc/2015/presentation/S5229-Sina-Meraji.pdf
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 26
AGENDA
Database Trends (Database Evolution)
Multi Model Databases
NewSQL
CQL
GPU powered Databases
Open Source Databases
Database Hype (Database Revolution)
Cognitive System (Databases)
Blockchain
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 27
OPEN SOURCE DATABASES
http://www.splendiddata.com/ Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 28
Gardner says:
By 2017 not only will 70% of all new business internal applications run on Open Source Databases but 50% of all existing RDBMS are converting to Open Source Licensing models.
OPEN SOURCE DATABASES
http://imagesrv.gartner.com/media-products/pdf/EnterpriseDB/EnterpriseDB-1-2E4E9TA.pdf Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 29
OPEN SOURCE DATABASES
http://db-engines.com/en/ranking Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 30
OPEN SOURCE DATABASES
Commercial DBMS
No growth except for Hana
No decline either
http://db-engines.com/en/ranking
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 31
OPEN SOURCE DATABASES
Open Source DBMS
On the rise but growth is slowing down
http://db-engines.com/en/ranking
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 32
OPEN SOURCE DATABASES
Open Source vs Commercial
http://db-engines.com/en/ranking_osvsc
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 33
Commercial Systems still more popular then Open Source Systems.
They will still play a very significant role in the future!
AGENDA
Database Trends (Database Evolution)
Multi Model Databases
NewSQL
CQL
Open Source Databases
Database Hype (Database Revolution)
Cognitive System (Databases)
Blockchain
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 34
AGENDA
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 35
Database Trends (Database Evolution)
Multi Model Databases
NewSQL
CQL
Open Source Databases
Database Hype (Database Revolution)
Cognitive System (Databases)
Blockchain
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 36
COGNITIVE COMPUTING
The term cognitive refers to those human functions that are related to perception, learning, memory and thinking. In other words the relationship between human perception and information processing.
Quelle: http://lexikon.stangl.eu/16169/kognitiv/ © Online Lexikon für Psychologie und Pädagogik
COGNITIVE COMPUTING
THE START OF THE COGNITIVE ERA – 2011
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 37
COGNITIVE COMPUTING
WORLD OF WATSON – LAS VEGAS 2016
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 38
COGNITIVE COMPUTING
A SIGNIFICANT PORTION OF THE DIGITAL REVOLUTION (INDUSTRY 4.0, BIGDATA)
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 39
COGNITIVE COMPUTING
WHAT ELSE IS THERE BESIDES WATSON?
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 40
Google Deepmind, Google Now, Google TensorFlow
OpenAI (Tesla, Sam Altman, Amazon, …)
Microsoft Cortana
COGNITIVE COMPUTING
WHO OR WHAT IS WATSON?
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 41
DeepQA is a machine learning library with natural language capabilities.
Thomas J Watson, IBM Founder
IBM DeepQA
Apache UIMA Apache Hadoop
Suse Enterprise Linux
2,808 Cores 15 Terabytes RAM
COGNITIVE COMPUTING
WATSON COMPONENTS
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 42
Watson Explorer
Watson Analytics
Watson Conversation (Email, chat, voice,….)
…..
COGNITIVE COMPUTING
WATSON EXPLORER
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 43
Can be installed locally
Processes structured and unstructured data
Real time data analysis
With the Watson Explorer application builder, it is possible to integrate it into an existing application
Universal connectors (RDBMs, WEB, Email, etc.)
A search engine is one of the major components
COGNITIVE COMPUTING
COGNITIVE SECURITY MONITORING (SECURITY 24 X 7) WITH WATSON EXPLORER
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 44
COGNITIVE COMPUTING
SPEEDGAIN AND WATSON EXPLORER
•Alerting
Instance A
Alert Mgmt.
Performance Data
Threshold overview
Configuration Data
Instance B
PDB Database
Speedgain Collector
Instance C
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 45
COGNITIVE COMPUTING
WATSON ANALYTICS
Guided Data Exploration (Sensible Starting Points)
Starting Point and display of further analysis paths (New Perspectives)
Natural Language interface
Understand Outcomes (Interpretation)
Pattern Recognition
Correlation discovery
What are the driving factors? Root cause discovery.
Less dependency on expert knowledge
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 46
COGNITIVE COMPUTING
SPEEDGAIN AND WATSON ANALYTICS
Performance Data
Threshold overview
Configuration Data
PDB Database
Speedgain Collector
Instance C
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 47
Instance A
Instance B
COGNITIVE COMPUTING
SPEEDGAIN WATSON ANALYTICS - ROOT CAUSE I/O
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 48
COGNITIVE COMPUTING
SPEEDGAIN WATSON ANALYTICS: CAUSE/CONSEQUENCE?
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 49
COGNITIVE COMPUTING
SPEEDGAIN WATSON ANALYTICS: PAGE-CLEANING-OPTIMIZATION?
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 50
AGENDA
Database Trends (Database Evolution)
Multi Model Databases
NewSQL
CQL
Open Source Databases
Database Hype (Database Revolution)
Cognitive System (Databases)
Blockchain
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 51
BLOCKCHAIN
WHO CAN YOU TRUST ?
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 52
Up to now we had an internet of information
The blockchain technology can change this to an internet of values
BLOCKCHAIN
THE IDEA
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 53
http://www.capco.com/uploads/articlefiles/737/file_0_1473424097.pdf
BLOCKCHAIN
NODES AND MINERS
Nodes store copies of the blockchain
Miners create new blocks and calculate hash codes (proof o f work)
Majority decides in case of conflict (e.g. manipulation attempt)
Peer to peer network
https://www.linkedin.com/pulse/can-we-reach-consensus-blockchain-robert-eriksson/
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 54
BLOCKCHAIN
ADITIONAL FEATURES
Inserts Only (INSERT-Database)
Data cannot be changed
Scalable
99,9999% availability
Worldwide accessible (P2P)
Smart Contracts
Digital contract
Automated clearing
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 55
BLOCKCHAIN
http://www.onalytica.com/blog/posts/blockchain-top-100-influencers-brands/
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 56
THE INTERNET DATABASE
BLOCKCHAIN
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 57
ABSOLUTELY SECURE AND TRUSTABLE?
Secure by technology
Not need to trust people or organisations
BUT
51% attack
http://www.warranteer.com/the-bitcoin- blockchain-the-next-step-in-cloud-based-ewarranty
Someone how controls more than 50% of the nodes can decide what is wrong and what is right
Quantum computers
May have so much computing power that they could be able to manipulate blockchains
BLOCKCHAIN
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 58
TYPES
Public Blockchain (Bitcoin, Ethereum, Ripple, etc)
Private Blockchain (IBM-Bluemix, Supply-Change-Mgmt)
Private blockchains could make sense for B2B transactions, but
you need many independent nodes/businesses involved and
none should control more than 50% of the nodes
BLOCKCHAIN
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 59
APPLICATIONS
Trust
http://www.pwc.com/us/en/financial-services/fintech/assets/blockchain-infographic.png
No manipulation
BLOCKCHAIN
DB DB
Synchronous transactions
Asynchronous transactions
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 60
Company Internal Network
Internet
Internet (Blockchain +
Smart Contracts )
Company Internal Network
APPLICATION: CAR SHARING
Local
Application
Backend Application
Local
Application
Backend Application
BLOCKCHAIN
BITCOIN
Larges blockchain
Created 2008 by Satoshi Nakamoto, who's real identity is unknown
Virtual currency
Independent from banks and states
A different development is the “utility settlement coin” (UBS, Deutsche Bank, Santander and BNY Mellon, as well as the broker ICAP)*
real currencies in the blockchain Only used for post-trade settlements between financial institutions (clearing)
*Read more: http://www.nasdaq.com/article/major-banks-developing-utility-settlement-coin-an-industry-standard-for-digital-central-bank-cash- cm670203#ixzz4XtzOSuFm
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 61
BLOCKCHAIN
BITCOIN LIVE HTTP://BLOCKCHAIN.INFO
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 62
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 63
BLOCKCHAIN
BITGCOIN NOTES HTTP://COIN.DANCE
BLOCKCHAIN (ETH) HTTPS://ETHEREUM.ORG
Blockchain with embedded applications
No Code manipulation
Java like language
Ethereum Browser required
Currency: Ether
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 64
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 65
BLOCKCHAIN
IOT (INTERNET OF THINGS DATABASE)
Prevent manipulation of things
Execute services from a blockchain
Smart Contract / pay per use
https://news.bitcoin.com/redbear-duo-brings-blockchain-internet-of-things/
BLOCKCHAIN (ETH - NODES) HTTP://ETHERNODES.ORG/NETWORK/1
Developed in Europe
many nodes in Europe
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 66
BLOCKCHAIN (ETH - APPLICATIONS) HTTP://DAPPS.ETHERCASTS.COM/
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 67
BLOCKCHAIN (ETHEREUM FOUNDER AND DESIGNER) Vitalik Buterin
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 68
Hamburg +49 40 284 175 50 Köln +49 221 650 78 299 Frankfurt +49 69 710 456 477 München +49 89 20802 7229 T 1-800 618 1686 F (404) 586-6820
Database Trends and Hypes
Copyright © 2016 ITGAIN GmbH 69
YOUR BUSINESS
IS OUR
CHALLENGE
ITGAIN GmbH Essener Str.1
D-30173 Hannover
Telefon: +49 511 51 51 3700 Fax: +49 511 51 51 3800
ITGAIN Inc. 1170 Howell Mill Road,
Suite 300, Atlanta, GA 30318