LECTURE 5: LOCATION-BASED AR
Mark Billinghurst [email protected]
Zi Siang See [email protected]
November 29th-30th 2015
Mobile-Based Augmented Reality Development
Challenges • Design and Development
• Content creation, authoring • Display platforms or systems • Tracking approaches
Wikitude World: location-based AR • KML
• Keyhole Markup Language is a standardized format used in Google Earth. It can provide basic information for POIs and easily uploaded (or using hyperlink) into Wikitude.
• KML files can be created with the Google Earth user interface (in Google Map)
• Alternatively, it can be created using XML or simple text editor to work on raw KML scripts from scratch.
https://developers.google.com/kml/documentation/?hl=en
Wikitude World: location-based AR • ARML
• Augmented Reality Markup Language is an open exchange format based on KML but extends the format for useful data around AR data sets.
• ARML 2.0 is used in the live versions of the 3 leading Augmented Reality Browsers (Junaio, Layar and Wikitude), where it is used to make the AR Browsers interoperable.
• ARML 1.0 file format is currently used in the Wikitude World Browser.
http://openarml.org/wikitude4.html
Steps for Using Wikitude 1. Register for Wikitude account
• http://www.wikitude.com 2. Register for web hosting account
• http://www.000webhost.com • Own domain and server hosting
3. Content authoring • https://www.google.com/mymaps/ • http://studio.wikitude.com • Scripting and customization
KML • Benefits
• Generated from Google Earth • Allows basic editing
• Current limitation • Limited scripting option for Wikitude World • Lack of options for POI details in Wikitude World • Range is confined to ~20km radius
Publish in Wikitude: KML • KML
• [put stuff here] • ARML
• [put stuff here]
provide URL, host the *.kml file from your own server
ARML: XML Scripting • KML
• [put stuff here] • ARML
• [put stuff here]
http://openarml.org/wikitude4.html
wikitude-arml_workshop.xml <?xml version="1.0" encoding="UTF-8"?> <kml xmlns="http://www.opengis.net/kml/2.2" xmlns:ar="http://www.openarml.org/arml/1.0" xmlns:wikitude="http://www.openarml.org/wikitude/1.0"> <Document> <ar:provider id="utm-workshop-arml"> <ar:name>UTM AR Workshop (ARML)</ar:name> <ar:description>Creating POI location-based AR</ar:description> <wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl> <wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo> </ar:provider> <Placemark id="123"> <ar:provider>utm-workshop-arml</ar:provider> <name>LEGOLAND</name> <description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description> <wikitude:info> <wikitude:thumbnail> http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png </wikitude:thumbnail> <wikitude:phone>+6075978888</wikitude:phone> <wikitude:url>http://www.legoland.com.my</wikitude:url> <wikitude:email>[email protected]</wikitude:email> <wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address> </wikitude:info> <Point> <coordinates>103.63179030000003,1.426637,0.0</coordinates> </Point> </Placemark> </Document> </kml>
wikitude-arml_workshop.xml <?xml version="1.0" encoding="UTF-8"?> <kml xmlns="http://www.opengis.net/kml/2.2" xmlns:ar="http://www.openarml.org/arml/1.0" xmlns:wikitude="http://www.openarml.org/wikitude/1.0"> <Document> <ar:provider id="utm-workshop-arml"> <ar:name>UTM AR Workshop (ARML)</ar:name> <ar:description>Creating POI location-based AR</ar:description> <wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl> <wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo> </ar:provider> <Placemark id="123"> <ar:provider>utm-workshop-arml</ar:provider> <name>LEGOLAND</name> <description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description> <wikitude:info> <wikitude:thumbnail> http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png </wikitude:thumbnail> <wikitude:phone>+6075978888</wikitude:phone> <wikitude:url>http://www.legoland.com.my</wikitude:url> <wikitude:email>[email protected]</wikitude:email> <wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address> </wikitude:info> <Point> <coordinates>103.63179030000003,1.426637,0.0</coordinates> </Point> </Placemark> </Document> </kml>
Keep consistent
wikitude-arml_workshop.xml <?xml version="1.0" encoding="UTF-8"?> <kml xmlns="http://www.opengis.net/kml/2.2" xmlns:ar="http://www.openarml.org/arml/1.0" xmlns:wikitude="http://www.openarml.org/wikitude/1.0"> <Document> <ar:provider id="utm-workshop-arml"> <ar:name>UTM AR Workshop (ARML)</ar:name> <ar:description>Creating POI location-based AR</ar:description> <wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl> <wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo> </ar:provider> <Placemark id="123"> <ar:provider>utm-workshop-arml</ar:provider> <name>LEGOLAND</name> <description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description> <wikitude:info> <wikitude:thumbnail> http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png </wikitude:thumbnail> <wikitude:phone>+6075978888</wikitude:phone> <wikitude:url>http://www.legoland.com.my</wikitude:url> <wikitude:email>[email protected]</wikitude:email> <wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address> </wikitude:info> <Point> <coordinates>103.63179030000003,1.426637,0.0</coordinates> </Point> </Placemark> </Document> </kml>
Allows replication (use unique numeric id) For example <Placemark id=“124”> or <Placemark id=“125”>
wikitude-arml_workshop.xml <?xml version="1.0" encoding="UTF-8"?> <kml xmlns="http://www.opengis.net/kml/2.2" xmlns:ar="http://www.openarml.org/arml/1.0" xmlns:wikitude="http://www.openarml.org/wikitude/1.0"> <Document> <ar:provider id="utm-workshop-arml"> <ar:name>UTM AR Workshop (ARML)</ar:name> <ar:description>Creating POI location-based AR</ar:description> <wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl> <wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo> </ar:provider> <Placemark id="123"> <ar:provider>utm-workshop-arml</ar:provider> <name>LEGOLAND</name> <description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description> <wikitude:info> <wikitude:thumbnail> http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png </wikitude:thumbnail> <wikitude:phone>+6075978888</wikitude:phone> <wikitude:url>http://www.legoland.com.my</wikitude:url> <wikitude:email>[email protected]</wikitude:email> <wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address> </wikitude:info> <Point> <coordinates>103.63179030000003,1.426637,0.0</coordinates> </Point> </Placemark> </Document> </kml>
Longlitude, Latitude, Altitude (altitude is optional)
Publish in Wikitude: ARML • KML
• [put stuff here] • ARML
• [put stuff here]
provide URL, host the *.xml file from your own server
ARML • Benefits
• Extended scripting option for Wikitude World • Additional POI details in Wikitude World
• Current limitation • Propagation: Wikitude World may take time to be
visible. • Range is confined to ~20km radius
• Future possibilities • AR link may be interoperated with other AR browser.
Discussion • Potentials
• Location-based AR experience may extend beyond vision (Nurminen, 2015) – multisensory augmentation.
• Sensor such as GPS can be unstable.
Nurminen, A. (2015) Mobile multisensory augmentations with the CultAR platform. SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications.
Discussion • Potentials
• User interface that provides rich audio-visual AR/VR experience, multiple devices (Matomura et al., 2015).
Matomura, W., Yamanaka, M. and Yamamoto, T. (2015) Mobile-based Streaming System of Spatial Audiovisual Contents and Web-based Design System. SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications.
Implication
• Possibilities • Explore other solutions suitable for hybrid approaches
that combine vision-based tracking and sensor input. • Design industry - user interface, content development. • Mixed-reality experience (taste, scent, haptic, touch,
audio, motion).