View
633
Download
3
Category
Preview:
DESCRIPTION
Companies across all industries and sizes are investing in strategic custom applications to enhance their competitive advantages. Developing these applications requires continuous improvement, based on insights gleaned from collecting and analyzing the data that they generate. Big Data for high-performing, scalable and reliable applications requires a new set of tools and technologies. Pivotal GemFire is a distributed in-memory NoSQL data management solution for creating high-scale custom applications. Pivotal GemFire XD supports structured data as part the industry’s first Hadoop-based platform for creating closed loop analytics solutions – enabling businesses to continuously optimize real-time automation in their applications.
Citation preview
2 © 2014 Pivotal Software, Inc. All rights reserved. 2 © 2014 Pivotal Software, Inc. All rights reserved.
Pivotal GemFire 8 & Pivotal GemFire XD 1.3 What’s New in Pivotal Big Data Suite for Application Developers
November 2014
3 © 2014 Pivotal Software, Inc. All rights reserved.
Agenda
� What’s New with GemFire and GemFire XD?
� How are GemFire and GemFire XD commonly used?
� Demo: GemFire in Action
� Q&A
4 © 2014 Pivotal Software, Inc. All rights reserved.
Agenda
� What’s New with GemFire and GemFire XD? � How are GemFire and GemFire XD commonly used?
� Demo: GemFire in Action
� Q&A
5 © 2014 Pivotal Software, Inc. All rights reserved.
Big Data Apps at Scale Have Unique Needs
Pivotal GemFire and GemFire XD are the distributed, in-memory NoSQL aand SQL databases for big data apps for that need: 1. Scale-out performance
2. Consistent database operations across globally distributed nodes
3. High availability, resilience, and global scale
4. Powerful & Standards-based developer features
5. Easy administration of distributed nodes
6 © 2014 Pivotal Software, Inc. All rights reserved.
A New Release for Real-Time Data Apps in Pivotal Big Data Suite
Pivotal Big Data Suite
GemFire XD
Greenplum Database
Unlimited Pivotal HD
GemFire
HAWQ
REAL-TIME
INTERACTIVE
BATCH
REAL-TIME
INTERACTIVE
BATCH
7 © 2014 Pivotal Software, Inc. All rights reserved.
What’s New With GemFire & GemFire XD
Pivotal GemFire 8 Launched September 2014
� More data per node
� Higher resilience
� More programming languages supported
Pivotal GemFire XD 1.3 Launched October 2014
� Combines SQLFire and GemFire XD into one product
� Performance, Resilience enhancments
� Improved .NET support.
8 © 2014 Pivotal Software, Inc. All rights reserved.
Agenda
� What’s New with GemFire and GemFire XD?
� How are GemFire and GemFire XD commonly used? � Demo: GemFire in Action
� Q&A
9 © 2014 Pivotal Software, Inc. All rights reserved.
Example Use Case: Scale-Out Performance China Railway Corporation
“The system is operating with solid performance and uptime. Now, we have a reliable, economically sound production system that supports record volumes and has room to grow”
Dr. Jiansheng Zhu, Vice Director of China
Academy of Railway Sciences • 4.5 million ticket purchases & 20 million
users per day. • Spikes of 15,000 tickets sold per minute,
40,000 visits per second.
In-Memory Storage
Optimized data distribution
Elastic, linear scalability Nodes
Ops
/ S
ec
10 © 2014 Pivotal Software, Inc. All rights reserved.
Example Use Case: Consistent Database Operations Across Globally Distributed Nodes
Indexing, triggers, event notification
Performance-optimized persistence
Configurable consistency Partitioned Replicated Disabled
Distributed queries & regional functions
“Our global deployment of Pivotal GemFire’s distributed cache gives me a single version of the trade – resolving hard-to-test-for synchronization issues that exist within any globally distributed business application architecture” Michael Benillouche, Global Head of Data Management
11 © 2014 Pivotal Software, Inc. All rights reserved.
Example Use Case: High Availability, Resilience, and Global Scale
“We can track and collect money at our 4,000+ kiosks and branches – even without a reliable Internet connection. GemFire provides the core data grid and a significant amount of related functionality to help us handle this unreliable network problem” Gustavo Valdez, Chief of Architecture and Development • 19 million payment transactions per month • 4000+ points of sale with intermittent
Internet connectivity
Cluster to cluster WAN connectivity W
AN
Cluster resilience & failover
12 © 2014 Pivotal Software, Inc. All rights reserved.
Geo-distributed
Deployment Flexibility for In-Memory Apps (Pivotal GemFire)
Embedded Embedded, Clustered Tiered, Clustered Distributed, Clustered
WEB SERVER
WEB SERVER
WEB SERVER
WEB SERVER
GEM CLIENT
WEB SERVER
GEM CLIENT
WEB SERVER
GEM CLIENT
GEM SERVER
GEM SERVER
GEM SERVER
ü Flexibility ü Flexibility ü Scale
ü Flexibility ü Scale ü Performance
ü Flexibility ü Scale ü Performance ü Availability
ü Flexibility ü Scale ü Performance ü Availability ü Localization
WEB SERVER
WEB SERVER
WEB SERVER
WEB SERVER
WEB SERVER
WEB SERVER
GEM PEER
GEM PEER
GEM PEER
WEB SERVER
WEB SERVER
GEM CACHE
13 © 2014 Pivotal Software, Inc. All rights reserved.
Geo-distributed
Deployment Flexibility for In-Memory Apps (Pivotal GemFire XD)
Embedded Peer to Peer Tiered, Clustered Distributed, Clustered
WEB SERVER
WEB SERVER
WEB SERVER
APP SERVER
SQL App
APP SERVER
SQL App
APP SERVER
SQL App
GEM SERVER
GEM SERVER
GEM SERVER
ü Flexibility ü Scale
ü Flexibility ü Scale ü Performance
ü Flexibility ü Scale ü Performance ü Availability
ü Flexibility ü Scale ü Performance ü Availability ü Localization
WEB SERVER
WEB SERVER
WEB SERVER
APP SERVER
APP SERVER
APP SERVER
GEM PEER
GEM PEER
GEM PEER
Local Disk / HDFS
Local Disk / HDFS
Distributed, Clustered
GEM SERVER
GEM SERVER
GEM SERVER
Local Disk / HDFS
Distributed, Clustered
GEM SERVER
GEM SERVER
GEM SERVER
Local Disk / HDFS
Distributed, Clustered
GEM SERVER
GEM SERVER
GEM SERVER
Local Disk / HDFS
Distributed, Clustered
GEM SERVER
GEM SERVER
GEM SERVER
Local Disk / HDFS
Distributed, Clustered
GEM SERVER
GEM SERVER
GEM SERVER
Local Disk / HDFS
Distributed, Clustered
GEM SERVER
GEM SERVER
GEM SERVER
Local Disk / HDFS
14 © 2014 Pivotal Software, Inc. All rights reserved.
Gem XD HAWQ
HDFS
PXF
Model Refresh
Map-Reduce
I/P & O/P Formatter
Native Persistence
Shared Data
Re-evaluate Model
Re-evaluate Model
Model Refresh
Online Apps Analytic Apps Sensor Data / Feeds SQL
Objects JSON
Pivotal GemFire XD in Hadoop Context
15 © 2014 Pivotal Software, Inc. All rights reserved.
Agenda
� What’s New with GemFire and GemFire XD?
� How are GemFire and GemFire XD commonly used?
� Demo: GemFire in Action � Q&A
16 © 2014 Pivotal Software, Inc. All rights reserved. 16 © 2014 Pivotal Software, Inc. All rights reserved.
Demo
17 © 2014 Pivotal Software, Inc. All rights reserved.
Agenda
� What’s New with GemFire and GemFire XD?
� How are GemFire and GemFire XD commonly used?
� Demo: GemFire in Action
� Q&A
18 © 2014 Pivotal Software, Inc. All rights reserved. 18 © 2014 Pivotal Software, Inc. All rights reserved.
Q&A
19 © 2014 Pivotal Software, Inc. All rights reserved.
Get Pivotal GemFire & GemFire XD today! Pivotal GemFire
� Product Information – http://www.pivotal.io/big-data/pivotal-gemfire
� Product Download, Support, and Resources – https://network.pivotal.io/products/pivotal-GemFire
Pivotal GemFire XD
� Product Information – http://www.pivotal.io/big-data/pivotal-gemfire-XD
� Product Download, Support, and Resources – https://network.pivotal.io/products/gemfirexd
Recommended