Upload
mongodb
View
1.539
Download
0
Embed Size (px)
DESCRIPTION
With the advent of new database engines and constant data growth, the traditional way of database management has reached the next evolutionary/revolutionary phase. Every disruption in a continuum can lead to disorganized progress in any big organization. This session talks about how Verizon IT is assimilating this new disruptive model and leveraging its abilities to sustain organized progress and transform the way IT acts as a business enabler. We will discuss some of our early use cases -- such as VZ Web, our online employee portal -- and what it was like to bring in and embrace MongoDB at a Fortune 15 company.
Citation preview
1 Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement.
How Verizon Uses Disruptive Developments for Organized Progress Matt Bullard Shivinder Singh
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 2
Agenda
• Introducing Change at Verizon
• Implementing Change at the Ground Level
• Experience working with MongoDB
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 3
103.3 million
$81 billion
retail connections
annual revenue in 2013
72,500 employees
Get to Know Verizon Wireless
Verizon 4G LTE Covers 97% of Americans
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 4
Organized Approach to Embracing New Technologies
• Driving Forces – Data monetization – Changing landscape of data
• Expected Output – Enhanced data analytics – Time to market solutions – Customer experience improvement
• Embracing emerging technology in a fortune 16th company – Well established processes – Culture of delivering solutions
through collaboration
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 5
RDBMS
NoSQL
Cloud
Big Data
Creating a Unique IT Ecosystem
• Big Data – Customer actions – Transactional Logs
• RDBMS – Transactions – Account Information
• NoSQL – Echat – Social Feeds
• Cloud – Time to Market – Asset Utilization
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 6
Embracing New Technologies
• End Goals – Single View of Customer across all
business lines – Improving Asset Utilization – Shorten time to market
• Potential End State – All members of the ecosystem add
value to the enterprise – New application for OLTP – Hadoop for larger datasets
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 7
Organizational Challenges
• Challenges – Status quo – Preparing change warriors – New models for calculating ROI – Change introduces risk and disruption – Procedures for recovering from crisis
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 8
Business / Technology Challenges
• Convincing Upper Management – Scalability Issues
• Needs to meet Verizon standards • Criteria for HA & over the WAN clustering • Lower MTTR
– RDBMS Constraints • Expensive scalability solutions • Changes to the data model are costly • Length time to market
9 Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement.
Big Data An Insiders View Shivinder Singh
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 10
Exploring Disruptive Technologies
• Primary Objective of IT: – Keep the lights on – Focus on SLA – Multi Site Applications – Lean MTTR – Business Enabler
• Initial Reaction: Avoid Disruptive Technologies Like the Plague – We have no expertise in the new technology – Headcount will not increase to support this – Untested at the enterprise level – Where do we get support if it does not work? – How do we train?
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 11
Conventional Approach
Structured • Logical • Analytical
§ Transactional
§ Internal
§ OLTP
§ ERP
Data Warehouse
Traditional Data Sources
New Approach
Creative • Holistic • Intuitive
§ Web Logs
§ Text / Social Data
§ Sensory
§ RFID
New Data Sources
Hadoop Streams
The Evolution of Data
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 12
Oracle & VCS Oracle ASM & JVM DBA
Build DB
SA
Raw Disk NFS VCS ZFS
SA
Raw Disk DBA
ACFS ASM Build DB Load JVM
DBA
HDFS ACFS Java DB Build DB
SA
NFS VCS ZFS
Raw Disk
Big Data
Oracle RDBMS
NoSQL, Berkeley, Unbound ID
ASM / Cluster Ware / RAC / ACFS
MySQL / SQL Server
Exadata / Big Data
2004 2006 2008 2010 2012 2014 2016
Evolution / Revolution
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 13
Organization Prerequisites
• Profile – You need the right people in your
organization to go out and learn new technologies
• Learn quickly, good at exploring new things
• Need passionate employees, who have the drive to go out and learn on the side
• Not adverse to risk • Good at communicating & teaching
new technologies to others in your org
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 14
Communications blocks Tools
Feedback/ratings
About you info
Multimedia Rotating Banner
• Not having a choice is often the best catalyst to moving forward. – Initiated as a POC effort – Responsibility was on us to support it in production
Employee Portal
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 15
Evaluating MongoDB
• Taking a Test Drive – Did not want to sign a contract w/o
seeing how they respond to an outage
– Need to put new vendors to the test. • Need a vendor that is smarter than you
on the subject, one that brings value to the table.
• Outage Response – Site performing slowly
• Caused outage on secondary datacenter
• Missing indexes
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 16
Millions of Terabytes per month Total Cost of Ownership Focus
• Hardware & Software – Turning Innovation into Products – Improving system performance – Accommodate Future Growth vs. System
Usage
• People – Unlearning the old and assimilating the
new – Cross Training on Multiple skill sets – A focus on process engineering – System Processes Automation
0
0.5
1
1.5
2
2.5
3
3.5
4
2009 2010 2011 2012 2013 2014
Central and Eastern Europe Middle East and Africa Latin America Japan North America Asia-Pacific Western Europe
Technology Challenges
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 17
• MongoDB with Hadoop – Hadoop is the buzzword – VZW is a early adopter and has
some huge clusters – Growing at phenomenal volumes
• MongoDB for online log management – Transactional log maintenance – Data Volumes are significant – Challenges on RDBMS – MongoDB a potential replacement
Future Use Cases
Confidential and proprietary materials for authorized Verizon personnel and outside agencies only. Use, disclosure or distribution of this material is not permitted to any unauthorized persons or third parties except by written agreement. 18
Thank You
Thank You Madhu Bhimaraju Shivinder Singh