VIRTUAL INTERACTION USING MYO AND GOOGLE

CARDBOARD

This project focuses on developing a

mobile application that integrates Google

Cardboard and Myo Armband. The mobile

application developed is an educational

application that teaches users to write

Japanese characters by getting users to

trace the characters display on the phone

screen. The users will air draw the letters

while the Myo Armband will capture the

gestures, send the data to the

smartphones and display the drawn

character on the screen.

Chong Wee Nee, Poo Kuan Hoong (Supervisor), Ian K.T. Tan (Co-Supervisor)

2015 / 2016

Overview

1) To develop a Google Cardboard

application and integrate the Myo

Armband into the 3D environment.

2) To enable user to control the 3D

environment using the Myo Armband.

3) To provide an immersive experience of

learning Japanese characters.

Objectives

Recently, there are many companies

venturing into virtual reality technology and

they believed that virtual reality will be the

next big thing. Majority of the companies

focused on Head Mounted Display (HMD)

and a few focused on projector or special

room to provide virtual environment

experience. Some of the well known HMD

devices are Oculus Rift, HTC Vive,

PlayStation VR, Samsung Gear VR and

Google Cardboard. Google Cardboard is

the most affordable HMD compare to the

rest.

Meanwhile, there are a number of

gesture recognition devices that has been

developed and many of the devices are for

games and virtual reality purposes. Those

devices are Xbox Kinect, Play Station

Move, Wii, Leap Motion and Myo Armband.

Myo Armband is the newest gadget among

all the mentioned gadgets. It is the only

gesture control device that uses EMG data

to manipulate other devices.

Using Myo Armband as an additional

input for Google Cardboard is a new

concept. There are very little Google

Cardboard application that integrates Myo.

One of the existing application is PortalVR.

PortalVR enables the player to be

immersed in the game environment using

the power of Google Cardboard, Myo

armband, and the Wii remote.

Background Study

Development Requirements

1) Android Studio 1.0 or higher

2) Google Cardboard SDK

3) Myo Android SDK

4) Unity 5.0

Hardware Requirements

1) Android phone (4.3 & above)

2) Google Cardboard

3) Myo Armband

Requirements

Figure 1: Start page

Figure 2: Select Japanese character

Figure 3: Drawing Screen

Designs

In this project, a prototype

Android application that integrates

Google Cardboard and Myo

Armbands to be used as immersive

learning environment for Japanese

language was successfully

developed. With the usage of this

Android application, user able to use

the Myo Armband to select a new

Japanese character and trace the

character. User will have a new

immersive experience of learning

Japanese characters.

Conclusion

User

Myo

Armband

Phone

Identify

the Pose

Plugin

Identify the

control

assigned to

the gesture

Track

Rotation

and Track

Position

hand pose

head movement

raw EMG data

gestural data

gestural data

gestural data

manipulated classroom

phone movement

updated orientation of VR world

Implementation

1. Thalmic Labs Inc. (2013). Myo: Home.

(Thalmic Labs Inc.) Retrieved 8

September, 2015, from Myo:

https://www.myo.com/

2. Thalmic Labs Inc. (2013). Tech Specs.

(Thalmic Labs Inc.) Retrieved 8

September, 2015, from Myo:

https://www.myo.com/techspecs

3. Bernhardt, P. (2015). Build your own

Mouse Control with Myo. Retrieved from

Myo Developer Blog:

http://developerblog.myo.com/build-your-

own-mouse-control-with-myo/

4. Hacker League. (2015). PortalVR. (Intel

Corporation) Retrieved 8 September,

2015, from Hacker League:

https://www.hackerleague.org/hackathon

s/uofthacks/hacks/portalvr

References