Mobile Performance at London Web Perf Mettup

© 2015 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other marks contained herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. All other marks contained herein are the property of their respective owners. Information contained herein is not an offer, commitment, representation or warranty by AT&T and is subject to change. Mention of a specific company or entity is not an endorsement by AT&T.

Doug Sillars

Native Mobile Performance

AT&T Developer Advocacy@Dougsillars

Your App is Not a Black Box


• Christmas Day Sale: John Lewis – 75% traffic from Mobile

• Amazon – 70% shopped on Mobile

Mobile is Huge

http://www.theguardian.com/business/2015/dec/27/online-christmas-sales-shoppers-new-record-store-frenzyhttp://phx.corporate-ir.net/phoenix.zhtml?c=176060&p=irol-newsArticle&ID=2125057

http://www.theguardian.com/business/2015/dec/27/online-christmas-sales-shoppers-new-record-store-frenzy



http://phx.corporate-ir.net/phoenix.zhtml?c=176060&p=irol-newsArticle&ID=2125057

http://phx.corporate-ir.net/phoenix.zhtml?c=176060&p=irol-newsArticle&ID=2125057


Mobile Website Size (2011-2015)

Source:HTTPArchive


Source:GSMA Intelligence

4G Subscriber Base


App Startup

91%https://t.co/7bMT4A1PIt

49% 72%


App Conversions by Install Size

https://lightspeedindia.wordpress.com/2014/06/12/unbundling-mobile-apps-for-the-emerging-markets/


http://blog.jana.com/2015/01/26/the-data-trap/

Hours of Work at Minimum Wage to Buy 500MB


https://www.flickr.com/photos/photocapy/43580405/sizes/o/in/photostream



Testing is Key

• 44% of all issues are reported by users• 20% issues were only found because of

complaints in app reviews

http://info.perfectomobile.com/rs/perfectomobile/images/why-apps-fail-infographic.pdf


• Memory• CPU• Screen Rendering• Battery Life• Network Connectivity

Aspects of Performance

Testing


Android Memory


Android Memory

CRASH!!


Garbage Collection in Logs

I/art: Explicit concurrent mark sweep GC freed 16519(1029KB) AllocSpace objects, 1(81KB) LOS objects, 14% free, 96MB/112MB, paused 1.660ms total 64.375ms01-11 22:29:56.690 10222-10222/I/iceberg: Captain, I think we might have hit something.01-11 22:29:57.544 10222-10222/I/iceberg: Captain, I think we might have hit something.01-11 22:30:00.745 10222-10222/I/iceberg: Captain, I think we might have hit something.01-11 22:30:01.233 10222-10247/I/art: Explicit concurrent mark sweep GC freed 17289(1157KB) AllocSpace objects, 1(81KB) LOS objects, 13% free, 102MB/118MB, paused 750us total 45.946ms01-11 22:30:01.762 10222-10222/I/iceberg: Captain, I think we might have hit something.01-11 22:30:04.105 10222-10222/I/iceberg: Captain, I think we might have hit something.01-11 22:30:04.792 10222-10222/I/iceberg: Captain, I think we might have hit something.01-11 22:30:05.908 10222-10247/I/art: Explicit concurrent mark sweep GC freed 9906(617KB) AllocSpace objects, 3(1121KB) LOS objects, 12% free, 108MB/124MB, paused 823us total 41.475ms01-11 22:30:06.638 10222-10222/I/iceberg: Captain, I think we might have hit something.01-11 22:30:07.288 10222-10222/I/iceberg: Captain, I think we might have hit something.01-11 22:30:07.953 10222-10222/I/iceberg: Captain, I think we might have hit something.


Android Memory

Eclipse MATAnalyze Heap dumps

Leak Canary:https://github.com/square/leakcanaryhttps://corner.squareup.com/2015/05/leak-canary.html

Square:

94% Drop in OOM crashes!

https://github.com/square/leakcanary


https://corner.squareup.com/2015/05/leak-canary.html

https://corner.squareup.com/2015/05/leak-canary.html


Live Demo


Performance is a Key Update Feature


Mobile Performance

Is Performance REALLY that important? Yes!https://t.co/7bMT4A1PIt


• AT&T’s Application Resource Optimizer• Free• Open Source• iOS/Android (no root)

• Network traces on Device• Grades against 25 Best Practices• http://Developer.att.com/ARO

Testing Your App’s Network Performance

http://Developer.att.com/ARO


• Cellular Networks are High Latency Environments• Not Optimizing Your Content can lead to delays:• 500ms:

• 26% frustration• 8% engagement

• Amazon.com & Walmart: • 100ms delay• 1% revenue

• 4% of mobile users admit to throwing their phones

Mobile Apps Are Highly Network Dependent

http://www.flickr.com/photos/9009139@N08/1263954439http://blog.radware.com/applicationdelivery/applicationaccelerationoptimization/2013/12/mobile-web-stress-the-impact-of-network-speed-on-emotional-engagement-and-brand-perception-reporthttp://www.mobilejoomla.com/mobile-joomla-blog/172-responsive-design-vs-server-side-solutions-infographic.html


Mobile Networks Drain Battery

• Data Connections account for:• 40% of battery use (screen on)• 70% screen off

ARO Speed• Android VPN Trace Collection

https://pixabay.com/en/phone-smatphone-android-vector-804792/https://commons.wikimedia.org/wiki/File:Man_made_communication_tower.svg

VPN

https://pixabay.com/en/phone-smatphone-android-vector-804792/

https://pixabay.com/en/phone-smatphone-android-vector-804792/

ARO Speed• Android VPN Trace Collection

VPN

Werner Heisenberg:

Observer effect:Measurements of a

system cannot be made without affecting the system ARO 4.1 had significant latency (10-100ms per round trip)

ARO 5.0 only 1-2ms added per round trip.


Live Demo of ARO


• sh arocli.sh --startcollector vpn_android --output /Users/Demo/AROcli5 --video yes

• sh arocli.sh --analyze /Users/demo/AROcli5 --output /Users/demo/AROcli5/out.html --format html

• sh arocli.sh --analyze /Users/demo/AROcli5 --output /Users/demo/AROcli5/out.json –format json

But – What About Automated Testing?

ARO Integration into your CI testing

Automated test

ARO –startcollector

StopARO–analyze

Build

ReportsPerformance!

Deploy


HTTPS Traffic

Test data through a proxy:

Charles or MITMProxy

Decrypts all the data

COMING SOON to ARO.



https://www.flickr.com/photos/jaumescar/8793922986


https://upload.wikimedia.org/wikipedia/commons/1/10/Florida_Gopher_Tortoise.jpg





http://bit.ly/HighPerfAndroidApps


PubConf.io


Q&A

https://www.charlesproxy.com/

https://mitmproxy.org/

http://developer.att.com/application-resource-optimizer

http://bit.ly/HighPerfAndroidApps






AT&T DriveMode

https://en.wikipedia.org/wiki/Texting_while_driving#/media/File:NotextinganddrivingWestUTX.JPG


AT&T DriveMode - 2013

Good IdeaStop Device from receiving phone calls and SMS when the phone is in a car > 25 MPHRoute to Voicemail/ Send SMS reply “I’m Driving.”

Poor Implementation

Google Play reviews: excessive battery drain

40


AT&T DriveMode for Android - 2013

3 min

480 GPS connections/24hr

~20% Battery

Good Idea

Poor Implementation

Fix bug:App was going into “drive mode” when not driving.


AT&T DriveMode for AndroidUse activity APIs to identify when your users are in motion

11 minute trace

DetectedActivity.IN_VEHICLEDetectedActivity.ON_BICYCLE:DetectedActivity.ON_FOOT:

http://commons.wikimedia.org/wiki/File:Baby_goats_jan_2007_crop.jpghttp://commons.wikimedia.org/wiki/File:Goat_in_a_car.jpghttp://commons.wikimedia.org/wiki/File:2009_goat_and_bicycle_in_India_6512003001.jpg


“Its déjà vu all over again.”• Yogi Berra

AT&T Drive Mode – iOS (2014)

https://commons.wikimedia.org/wiki/File:Yogi_Berra_1956.png

New application is getting poor reviews in app store for battery drain


AT&T Drive Mode - iOS

Good Idea

Poor Implementation

Collect Analytics






• Excessive Battery Drain• Android

• Long background testing• iOS

• Network trace while driving

• Test!

AT&T Drive Mode Similar Symptoms - Different Culprits


Streaming Radio App


Streaming Radio App


Streaming Radio App


Streaming Radio App

DATA:45% metadata15% Images

<40% of data consumed is Music!

Good Idea

Poor Implementation

Critical KPI – report what is playing on other “channels” with 10s accuracy.


Streaming Radio Metadata


Metadata

DATA:18% metadata20% Images

~60% of data consumed is Music!


• Ensure you have Gzip enabled in your app, and on your server.

• Cache files• Send only changes

Streaming Music Metadata


Music Streaming –Album Art

Good Idea

Poor Implementation

Use a CDN to host all Album Art

API call uses a 302 redirect to access image files

16 requests8 API calls - 302 redirect

1.16s8 CDN calls – download images

1.25s


Redirects Add Latency

115s of added latency ~10% of test


• Have API retrieve the image and send to the device

• Eliminate request• Eliminate several RTs

Redirects add Latency


Broken Links

21% of redirects have no target


Track Movement

• New version: • 18x more connections than this app’s architecture team expected• The triage team discovered that IP/port collisions = loss in sales

Good Idea

Poor Implementation

• Connecting to the network every 5 seconds –• reusing the same connection

Created a new connection every 5s


World Famous Goat RacingWas $79, Now $39

User has to wait for image to load

Image Usage

Downloading the same image twice, in different sizes, doesn’t make sense.Download it once and use it in multiple ways.

54 kb

198 kbWorld Famous Goat Racing Was $79, Now $39

Good Idea

Poor Implementation

App with Rich image usage


• Apps with Multiple & Frequent updates:• Dial in usage• Squash Bugs• Improve Performance

• Testing!

Killer App


Thank You