12
Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura [email protected] Eiji Tokunaga [email protected] Tatsuo Nakajima [email protected] Distributed and Ubiquitous Computing Lab. Waseda University, Japan

Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura [email protected] Eiji Tokunaga [email protected]

Embed Size (px)

Citation preview

Page 1: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

Building Mobile Augmented Reality Servicesin Pervasive Computing Environment

Hiroaki Kimura [email protected] Tokunaga [email protected]

Tatsuo Nakajima [email protected]

Distributed and Ubiquitous Computing Lab.Waseda University, Japan

Page 2: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 2

Motivation - Too-Many-Controllers Problem

Disappeared?

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

• Control panels of current appliances are difficult to use.

• Wireless remote controllers are hard to find, easy to lost.

• As services disappear, controlling them might be more difficult.

• People must remember too many mappings between controllers and appliances.

Page 3: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 3

Motivation - TUI and Universal Remote Controller

• Tangible User Interfaces• Physical form to digital information

• Pros: easy to recognize and use• Cons: hard to deploy and reconfigure

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

musicBottles (MIT) Gesture with 3D VD(University of Tronto)

iCrafter(Stanford Univ.)

Pebbles (CMU)

• Universal Controller Architecture• One personal device as a universal controller

• Pros: easy to deploy and reconfigure• Cons: hard to recognize and use

Page 4: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 4

Movie - Vidgets: Virtual Tangible Widgets

Page 5: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 5

Challenges

HardwareDeveloper

•Size•Weight•Power Consumption•etc.

ServiceProvider•Deployability

•Scalability•Reusability•High level API•etc.

User

•Simple Interaction Style•Usability•etc.

Page 6: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 6

Design Issues• Deployability and Scalability

• Deploy anytime, anywhere• Update or replace easily and cheaply

• Reusability and High level abstraction• Deal with high level user events

• Simple interaction style• Easy to use• Short setting up time

Page 7: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 7

Approaches• Mobile code

• Download controlling software automatically from those services to improve deployability

• Visual tag and Service mapping• Weak mappings between tags and services’ code impro

ve deployability• Visual tag is representation of invisible service

• Controlling using real world interaction• Provides high level sensor API• Reinforces augmented reality

• Simple interaction cycle• Defines three interaction stages

• Searching, Selecting, Using

Page 8: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 9

Architecture - Sequence

Page 9: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 10

Implementation

Page 10: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 11

Evaluation and Discussion• Average size of each mobile code: 14KB• Latency of mobile code migration: less than 419ms

• Divided attention between controllers and services

• Which view a user should look?• The feedback view on the

personal device?• The application view?

QuickTime˛ Ç∆TIFFÅiLZWÅj êLí£ÉvÉçÉOÉâÉÄ

ǙDZÇÃÉsÉNÉ`ÉÉÇ å©ÇÈÇΩÇflÇ…ÇÕïKóvÇ≈Ç∑ÅB

Page 11: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 12

Conclusion• We proposed Vidgets which is a research for

interaction design and building framework that seamlessly integrates personal devices and pervasive services

• We implemented a prototype system that confirms the effectiveness of our framework.

[Future work]• Detailed user studies (for developers, users)• Deal with some issues

• Divided attention• Security risks in mobile code

• Cell phone / PDA implementations

Page 12: Building Mobile Augmented Reality Services in Pervasive Computing Environment Hiroaki Kimura hiroaki@dcl.info.waseda.ac.jp Eiji Tokunaga eitoku@dcl.info.waseda.ac.jp

06.6.27 ICPS ‘06 Lyon 13

Merci beaucoup!

Hiroaki Kimura

[email protected]