Augmenting Education: The Collision of Real and Virtual Worlds [SECAC]

Bryan Loar

Senior Director, Research & Knowledge Management

Augmenting Education: The Collision of Real and Virtual Worlds

Presented as part the SECAC 2012 Visual Resources Curator Group session, "When the Past Collides with the Present: Moving Beyond the

Single Classroom Experience via Digital Technologies."

Bryan Loar +

WHAT’S AR?

Bryan Loar +

Augmented Reality (AR) is the augmentation of the visual field of a user by enhancing the current field of vision with additional information - Caudell and Mizell

Augmented Reality By DanieleCivello

Augmented Reality Brings 3-D to Retail By IntelFreePress

augmented reality game bibliotheek deventer By nilsmengedoht Concept Art 'Tijdmachine' By Tijdmachine

Detail of Google Glass By zugaldia

Bryan Loar +

MIXED REALITYCONTINUUM

Real Environment Augmented Reality (AR) Virtual EnvironmentAugmented Virtuality (AV)

3 m.

OSU Fine Arts Library - Nike By Bryan Loar

Global kids Screens By NMC Second Life [Modified]

Bryan Loar +

BEGINNINGS

AR & Virtual Reality (VR) share a common ancestry.

1968Sutherland, Ivan E. A Head-Mounted Three-Dimensional Display. Proceedings of the AFIPS Fall Joint Computer Conference Washington, D.C.: Thompson Books, 1968, p. 757-764.

Ivan Sutherland’s work at MIT starting in 1966 led to the first head-mounted display exhibited in 1968. The display’s translucent properties made it a precursor to AR.

Bryan Loar +

In the late 1990’s, researchers like Wayne Piekarski began to develop mobile AR solutions. Some of the hardware could be purchased ready to use, some modified, and some created. Many of these systems used a backpack design to carry the array of necessary equipment. Tinmith-Endeavour backpack By Wayne Piekarski

EARLYMOBILITY

Bryan Loar +

AR TOOLS TODAY

Bryan Loar +

HEADMOUNTEDDISPLAYS

“Utilizing Vuzix’s patented quantum optic see-thru technology, the STAR 1200XL enables you to see the real world directly through its transparent widescreen video displays. Computer content, such as text, images and video, are overlaid on the displays in full color 2D or 3D in a display overlay equivalent to a 75-inch flat panel display, as seen from 10 feet (~3m).” - Vuzix

Bryan Loar +

MOBILE DEVICESjunaio on iPad 2 - Augmented Reality 2.0 By metaioAR

Exploring In Situ with Layar By Mosman Council

Patti Maes Projects [Detail] By jurvetson

Bryan Loar +

AR TECHNIQUES & POTENTIAL EDUCATIONAL USES

Bryan Loar +

GEO- LOCATED AR

TagWhat AR App - SW Portland By Robin M. Ashford

Bryan Loar +

GEO-LOCATED ARGALLERY SHOWS

Students can see who has been to and how they have critiqued gallery shows on campus. The act of critique can become public discourse without the need to be at the same place at the same time.

I thought the artist demonstrated technical

ability but could not execute their vision

John Doe 12:35 10/18 Twitter

g-spot gallery, northside open studios By autovac

Bryan Loar +

MARKERS“The Augsburg Display Cabinet, the Getty Museum’s 17th-century ‘cabinet of curiosities’… [The] “AR feature is intended to generate excitement for what museums are all about: discovery and wonder.” - Anne Martens, J. Paul Getty Trust

The Getty Museum's Augmented Reality Demo By The Getty Museum

Bryan Loar +

Artist Statement

Jane Doe

Lskdjflkjsdflkjdfsldkfjlskdjfdkfjlskfjsldfkjsldkfjlsdkjflkdjf.

lskjdflksjdflksjdflkjsdlfkjsldkfjlskjflksdjflksjlkdfjlskjflksjflksjldfkjslkfjlskdjflksjlfkjslkjflsdjflkjflksjdflkjsd.

lskjdflskjdflsldfkjlsjlskjfdlksjdflksjdlfkjslkfjlskjflksjflksjlfkjslfjlsjflskjdflsjdljflsjflsjf.

HOMEWORK MARKERS

Students could provide a video presentation along with their homework. The presentation could visually illustrate the concepts they are conveying and build their presenting and public speaking skills.

VineArts Exhibits: Artist Statements By yjessienilo

Bryan Loar +

MARKERLESSChris Drury Cloud Chamber for the Trees and Sky NCMA 4529 By bobistraveling

Cloud Chamber for the Trees and Sky Chris Drury

This shelter operates as an oversized camera obscura or a pinhole camera. A small aperture in the roof projects an inverted image of the sky onto the floor of the chamber, an effect that seems to pull the sky down to the viewer. Inside, one’s perspective is turned upside down. Instead of looking up at the sky, trees, or clouds, one looks down on them from above.

http://www.ncartmuseum.org/museum_park/art_in_the_park/

Bryan Loar +

INSTRUCTION EVERYWHERE

A teacher can create videos that give greater insight to objects in situ where specific points need to be stressed or where little-to-no information exists. The power of seeing the object in situ combined with a deeper understanding can lead to more in-depth discussions.

MARKERLESSMuseum Park NCMA 4502 By bobistraveling

Appreciating Art Lecture Series - Sculpture as Contemporary Art By nhbnhb1

Bryan Loar +

TODAY’SAR PIONEERS

Bryan Loar +

AUGMENTED TYPOGRAPHY

Graffiti artist DAIM partnered with the creative agency Jung von Matt/next GmbH to create an innovative form of typography that can be viewed 360 degrees. The process brings a kinetic element to the creation of digital typography.

"Tagged in Motion" (en) - digital light writing By daimorg

Bryan Loar +

AUGMENTED TYPOGRAPHY

Fiduciary markers, a head-mounted display (HMD), software, and 3 cameras were used to create 3-D graffiti

"Tagged in Motion" (en) - digital light writing By daimorg

Bryan Loar +

AUGMENTED TYPOGRAPHY

The video feed is fed through a computer and the software recognizes the markers.

"Tagged in Motion" (en) - digital light writing By daimorg

Bryan Loar +

“A Spatially- and Body-Aware Window for Collaborative Editing and Animation of 3D Virtual Objects” – Tangible Media Group

T(ether)

Tangible Media Group MIT Media Lab

T(ether) – a Spatially- and Body-Aware Window for Collaborative Editing and Animation of 3D Virtual Objects By Tangible Media Group

Bryan Loar +

T(ether)

Object size, shape, and location can be altered by the use of a glove with markers.

T(ether) – a Spatially- and Body-Aware Window for Collaborative Editing and Animation of 3D Virtual Objects By Tangible Media Group

Bryan Loar +

T(ether)

Multiple collaborators can manipulate their own objects as well as other’s objects.

T(ether) – a Spatially- and Body-Aware Window for Collaborative Editing and Animation of 3D Virtual Objects By Tangible Media Group

Bryan Loar +

AR INTERIOR & INDUSTRIAL DESIGN

In 2009, researchers investigated AR in the context of art, design, and cultural heritage.

Figure 11: Forming sentences of dancing letters. By Jurjen Caarls et al.

Bryan Loar +

AR INTERIOR & INDUSTRIAL DESIGN

Students explore changing the textiles of virtual curtains in a real room by selecting real materials with radio frequency identification (RFID) tags in them. Because they have virtualized the real textile and their system recognizes the ids, real and virtual worlds are uniquely intertwined. Figure 15: Touching the RFID tagged textiles at the pole changes the texture of the virtual

curtains in the room. By Jurjen Caarls et al.

Bryan Loar +

AR INTERIOR & INDUSTRIAL DESIGN

Virtual furniture designs with some that are animated to demonstrate the assembly process.

Figure 17: Virtual furniture designs; some are animated to show the assembly process. By Jurjen Caarls et al.

Bryan Loar +

CHALLENGES TO INCORPORATING AR IN EDUCATION

DEVICE AVAILABILITY

Not all students can be expected to have smart mobile devices.

SOLUTION: Create teams ensuring one person has a smart mobile device.

OFF-SITE ACCESS

Not all student have transportation to visit sites off campus.

SOLUTION: Keep sites on campus as much as possible. This will also give the student a deeper appreciation of the school.

AR CHALLENGES

Bryan Loar +

AR TOMORROW

Bryan Loar +

Google Glass By Stuck in Customs

GOOGLE GLASS

Project Glass: One day... [Detail] By Google

Project Glass eyewear By robpegoraro

Bryan Loar +

In 2011, researchers under Babak Parviz at the University of Washington successfully tested a 1-pixel lens “powered by a remote radio frequency transmitter in free space…on a live rabbit.” (Lingley et al., 2011)

A single-pixel wireless contact lens display By A R Lingley et al.

CONTACT LENSES

Raygun Studio

Bryan Loar +

Imagine working with students where only part of the class is present in a real life and the rest are virtual holograms visible through a head-mounted display (HMD).

Now imagine projects where their actions were recorded and your interaction does not have to be at the same time (i.e. asynchronous collaboration through AR)

MIXED MASS COLLABORATION

Bryan Loar +

Why wait for tomorrow’s tools. Begin exploring augmented reality today!Explore AR Today!

Slin'Gooz

Many apps are available for both iPhones and Android-based smart phones.

Aurasma Lite Tagwhat

Junaio

Bryan Loar +

Find this presentation & more at

bryanloar.com

THANK YOU

For more resources on AR, please go tobit.ly/secac12-AR

All images were used for educational, non-commercial purposes only.