28
people Lightning Talk: Learnings, Prototypes & Use Cases on Google Glass Tasneem Sayeed October 18,2013

DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Embed Size (px)

DESCRIPTION

This talk was given at the DevFest 2013 Conference held at Google Crittenden campus in Mountain View. It provides insights and lessons learned from innovative experiments for building innovative services for Google Glass for capturing financial data picture and for mobile payments. It covers a number of Glass Use-Cases as well as Glass Prototypes that we implemented across Intuit. Furthermore, the talk highlights "Glass Design Guidelines" from a developer's perspective and conclude with "Lessons Learned".

Citation preview

Page 1: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

people

Lightning Talk: Learnings, Prototypes & Use Caseson Google Glass

Tasneem Sayeed October 18,2013

Page 2: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Agenda

• Glass Use Cases (Mobile SIG: Date with Google Glass)

• Glass Prototypes–Mint Glassware (Mirror API)

– GlassPay (Native app)

– GLOffers (Native app)

• Learnings

Page 3: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

AllergyMeter – allergy check in a snap

Imagine if you or your loved ones have allergies and when you go shopping wearing Glass, it could alert you when you pick a product by scanning the ingredients.

Glass Use Case #1

Page 4: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

AllergyMeter Scenario A

(2) Tap and go(1) I don’t know if I’m buying the right food product given my family’s allergies.

(3) Scanning … (4) Allergy free

Page 5: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

AllergyMeter Scenario B

(2) Tap and go(1) Pick another food product.

(3) Scanning … (4) Allergic for the family

Page 6: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Allergy Meter List

Yay! We have the allergy list

Page 7: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Glass Use Case #2

GlassTimator – scan, estimate, get paid

A landscaper wearing Glass visiting his prospective client could automatically survey the area, get measurements and calculate estimates.

Project: renovate the backyard workflow:1.Backyard dimensions automatically determined

• Using GPS location and Google satellite image2.Total cost and deposit estimated automatically3.Customer pays by check4.Landscaper remotely deposits check

Page 8: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

(1) Survey area

GlassTimator Scenario

(2) Estimate

(3) Scan to deposit (4) Deposit confirmation

Page 9: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Confirmation of the deposit

GlassTimator Scenario

Page 10: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Glass Prototypes

Page 11: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Mint Glassware (Mirror API)

Page 12: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

• Users wearing Glass were more interested in seeing total balances• Need to focus on simple use cases• Hook up glassware with existing Web services where it makes sense

MicroMint: What We Learned

Page 13: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

GlassPay (Native app)

(1) Merchant rings up the purchase

(2) Pending purchase advertised via QR code

(6) Crypto signed

proof of payment

(3) Customer scans with Glass, reviews

and authorizes payment

(5) Customer’s account verified, payment

confirmed

(4) Account verification,

instructions to pay

Merchant’s Bank

Customer’s Bank

Customer

Page 14: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

GlassPay Native App

Page 15: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Glass PaMagic

GlassPay Native App

Page 16: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

GlassPay Native App

Page 17: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

GlassPay Native App

Page 18: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

GlassPay Native App

Page 19: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

GlassPay Native App

Page 20: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

GlassPay Native App

Page 21: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Demos

Page 22: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Lessons Learned

Page 23: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Resources:Mirror Glassware Development

• Start with Google Glass tutorials: https://developers.google.com/glass/quickstart/index• Install Google Plug-in for Eclipse which allows you to easily

deploy to Google App Engine• If you don’t have Glass, – try the Google Glass Emulator • Used for emulating Glassware based on Mirror API

– Develop native Android app designed specifically with Glass in mind and test on an Android phone

Page 24: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Using Mirror API vs Native Android app

• Depends on–What your app needs to do– Developer preferences for server development vs Android

development–Whether you have access to a Glass device for development

• Mirror API development– Supported currently– Limited access to hardware capabilities on Glass (i.e. camera, GPS

and limited voice )

• Native Android Development– Easy to test on an Android phone so not so dependent on

availability of a Glass device – Access to all hardware on the Glass (i.e. GPS, accelerometer, gyro,

etc)

Page 25: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Android GDK

• Not released yet but you can still write native apps using Android v15

• Samples: https://developers.google.com/glass/gdk

• Turn on Debug mode from Glass Settings->Device Info -> Turn on Debug

Side loading an apk:• adb install -r [sampleName].apk• adb shell am start -n com.google.glass.samples.<sampleName>/.<MainActivityName>

Page 26: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

Android GDK (cont)

•Or install Launchy: https://github.com/kaze0/launchy

Launchy is a supplementary native app launcher for Google Glass–Build and deploy Launchy to your Glass device–Select Glass Settings and you should get a typical Android dialog that gives you the option of picking GlassHome or Launchy for this action. Select Launchy and check the box to always use Launchy.–You can now launch your app from here

Page 27: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

More Learnings

• Initial development environment (Mirror API) is based on Java, and not Android! • Apps are server-based and synced to Glass via Google’s Glass

Sync. This may change with the release of the GDK.

Page 28: DevFest West 2013 @Google: LIGHTNING TALK : Learnings, Prototypes & Use Cases on Google Glass

• Google Glass Developer Site• Where to download Mirror API and docs• Glass Quickstart Tutorial• Google Glass Application List (i.e. App Store)• Google I/O Google Glass Sessions• Google Glass Playground• Google Glass Emulator• Develop for Glass - 10 easy steps• Google Glass Help

Useful Links