Mobile Backend as a Service via Cloud Foundry

1EMC CONFIDENTIAL—INTERNAL USE ONLY

MBaaSEMC Labs ChinaVMware vCAS

Grissom Wang, Kay Yan, Roby Chen2012/12


Background


Instagram Success Story

$1 billion acquired by Facebook

Instagram gains one new user every second

One billion photos have been taken with the app

There are roughly 58 photos uploaded each second


Instagram Infrastructure OS / Hosting

– Ubuntu Linux 11.04 (“Natty Narwhal”) on Amazon EC2

Load Balancing– First uses run 2 nginx machines, now use Amazon’s Elastic Load Balancer

Application Servers– Django on Amazon High-CPU Extra-Large machines

Data storage– PostgreSQL on EBS drives

Task Queue & Push Notifications– Gearman, a task queue system originally written at Danga

Monitoring– Munin, Pingdom, PagerDuty

http://nginx.org/

https://www.djangoproject.com/

http://gearman.org/

http://munin-monitoring.org/

http://pingdom.com/

http://pagerduty.com/


Key Drivers of MBaaS

Mobile apps require common backend services.

Backend services are complex to build.

MBaaS can reduce the time-to-market of mobile apps.


Mobile App Development CycleMBaaS can

save 60% time

Backend applicationCommon Services

Backend application Infrastructure

Backend App/service

develop

Backend infrastructure

build

Backend infrastructure

operate

Mobile App develop


MBaaS Market


Market

US: 165m

China: 128m


Market

2011

$6.8B

2015

$25B

Mobile App Market

2011

2012

2013

2014

2015

2016

0 100,000 200,000 300,000 400,000

2893

5018

8142

11853

16430

21672

22044

40599

73280

119842

188946

287933

Mobile App Store Downloads, Worldwide, 2010-2016(millions)

Paid-for Free


MarketCategory of Apps Used in the Past 30 Days

Most Apps need

Backend Application/Service

Mobile developers remain committed to the cloud. 83% of all developers plan to use cloud services, a percentage essentially identical to Q2 2011 when 84% reported the same.

--IDC 2012 Q2 Mobile Developer Report


Market

2009

$400M

2014

$9.5B

* Juniper Research

Mobile Cloud Applications & Services Kinvey raises $5M as mobile developer services market heats up – GIGAOM Jul 11, 2012

Appcelerator buys mobile backend provider Cocoafish – GIGAOMFeb 9, 2012

Flurry buys Trestle to get into mobile backend market - GIGAOM Jul 25, 2012

http://www.juniperresearch.com/shop/viewreport.php?id=201

http://www.juniperresearch.com/reports/mobile_cloud_applications_and_services

http://gigaom.com/2012/07/11/kinvey-raises-5m-as-mobile-developer-services-market-heats-up/

http://gigaom.com/mobile/appcelerator-gobbles-up-mobile-backend-provider-cocoafish/

http://www.techinvestornews.com/Mobile/Mobile-Bloggers/flurry-buys-trestle-to-get-into-mobile-backend-market


Project Description


Goal

Accommodate large-scale connected mobile devices with high throughput and low latency.

Provide standardized service categories for mobile applications.

Provide a scalable infrastructure and platform for mobile applications and services.


Ecosystem/Partners

MBaaS

CloudFoundryPivotal

Mobile Service ProviderGoogle

Facebook

Mobile Application Developer

Rovio

Mobile ManufacturerHTC

Cloud Service ProviderMoPaaS

Enterprise ITVMWare vCAS


Use Cases


Top Cloud Services by Mobile App Developers

Market Research and Gap Analysis

Push/Social/User services are common interests.

Mobile services are more functional oriented rather than PaaS’s data oriented.

Integration and analytic services are gaps in the market.


SystemLarge-scale connected devices

Roaming(Application/Data/Transaction)

Cost of Bandwidth/Battery

Multi-Latency

ServicesPush

Workflow

Social

Analytic

User

LBS

Data Store

MBaaS Use Cases - Prioritized


Mobile Analytic Players in MarketLicense Analysis

CategoryAnalysis Model Workflow Scalable Data Privacy Data Source

Flurry Free No Auto

Google Analytics

Free No Auto

Countly Open Source No Manual

Talking Data No Auto

Mixpanel Free No Auto

Localytics Free No Auto

Cloud Service Real-time Statistic Event Black Box Downloadable Own data Mobile Server


MBaaS Data Analytic ServiceLicense Analysis

CategoryAnalysis Model Workflow Scalable Data Privacy Data Source

MBaaS OSS + Real ++ YesFully

Automated

MBaaS data analytic service is • Fully automatically Scalable • Real Real-time processing and analysis capabilities• Generic Analytic Framework with different analysis models support• Could Integrate and Orchestrate with different analysis tools• Customer fully Own the data• Could analysis both Mobile side and Back-end app side

Cloud Service Real-time Statistic Event Black Box Downloadable Own data Mobile Server


Architecture


Router

ArchitectureMobile

MBaaS ClientLibrary/SDK

…App #2

App #1

Router

BackendApp #1

MB

aaS

S

erv

ices

Analytics

P

P

P

P

MB

aaS

S

erv

ices

A

A

A

Push

XMPP

XMPP

XMPP

…

Publisher

Publisher

ADB

CloudFoundry

MBaaS

DEA

Service

BackendApp #2

BackendApp #3

Block File Object

Documentum Mgt

Documentum

Mobile MgtSyncplicity

Documentum

CMS

Content

Bourne/EMC ASD

…Messag

e B

us

MB

aaS

S

erv

ices

File


Architecture for Push ServiceMobile

App #1

MBaaS Push Client

(Android Service)

RouterXMPP Over HTTP

XMPP Server(Msg Sender)



MessageQueue

(CF Native

Service)

…

Msg

Ad

apt

er

Msg

Adapt

er

Msg

Adapt

er

1) Listen on user unique topic2) Transform msg into XMPP

format

Transmit msg over HTTP

PublisherService(MBaaS Service)

Push msg to user unique topic

BackendApp #1

BackendApp #2

Notification SettingRegister app in MBaaS

Push

lib

rary

Push

lib

rary

Send msg through REST interface

App #2

MBaaS


Architecture for Real-time Data AnalyticMobile

App #1

MBaaS data collection

service/library

RouterHTTP

RT Data Processing

Colle

cti

on

lib

rary

App #2

MBaaS

RT Data Analytic

Repository

Report &Visualization

Con

sum

e lib

rary

App #1 OpDevs

One Tenant

Greenplum DW

Data Mining

BackendApp #1

RT Data Processing Framework

RT Data Analytic

FrameworkData

Analytic Workflow


Architecture for Health ManagerMobile

App #1

MBaaS Client (Metrics)

RouterHTTP

Collector

Collector

Collector

MessageQueue

(CF Native

Service)

…

HM(Graphite)

App #2

MBaaS

Processor

Processor

Processor

…

Metrics

BackendApp #1

Metrics

BackendApp #2


MBaaS

Use Cases

PaaS

Service Provider

CrossMo/MoPaaS/SJTU/ChinaTelecom

MBaaS Controller

Object StorePush User

Technology Stack - SP

Large-Scale Mobile

Cost of Battery

and BandwidthRoaming

Multi-Latency Multi-Cloud

Runtime/Framework Extension

Photo Social OAuth

Pipeline Analytic LBS IFTTT

vSphere

USD/ESD

Bourne DocumentumRSAInfrastructure BRSGreenplum

Isilon


MBaaS

Use Cases

PaaS

Enterprise

Ufida/vCAS

MBaaS Controller

CAS+FilePush LDAP

Technology Stack - Enterprise

Large-Scale Mobile

Cost of Battery

and BandwidthRoaming

Multi-Latency Multi-Cloud

Runtime/Framework Extension

vSphere

USD/ESD

Bourne

Content Management Enterprise Search Security

GreenplumDocumentum

Pipeline Analytic People View BPM

RSAInfrastructure BRS

Isilon


Demo


Push Demo

Push functionality

Push Scalability

Health Monitor(Dashboard)


Intelligent Push Demo