Augmented RealityAugmented Reality

COMP 1701COMP 1701

Nicholas AlbertsNicholas Alberts

What is Augmented Reality?What is Augmented Reality?

Augmented reality is a Augmented reality is a combination of a real life scene combination of a real life scene from a person, and a virtual from a person, and a virtual scene from a computer that scene from a computer that augments the scene with augments the scene with additional information additional information

Specifically, augmented Specifically, augmented reality superimposes audio, reality superimposes audio, graphics and other virtual graphics and other virtual affects upon the surrounding affects upon the surrounding environment. environment.

The GoalThe Goal

Augmented reality Augmented reality enhances one's enhances one's perception. The real perception. The real world is simply the world is simply the foundation. The goal is to foundation. The goal is to make a system that will make a system that will be so efficient that the be so efficient that the user will not be able to tell user will not be able to tell the difference between the difference between the real world and the the real world and the virtual augmentation. virtual augmentation.

Virtual vs. Augmented Virtual vs. Augmented

Virtual Reality is defined as, "a computer generated, interactive, Virtual Reality is defined as, "a computer generated, interactive, three-dimensional environment in which a person is immersed.”three-dimensional environment in which a person is immersed.”In other words, virtual reality completely immerses the use in the In other words, virtual reality completely immerses the use in the virtual environmentvirtual environmentAugmented reality virtually changes the real world while allowing the Augmented reality virtually changes the real world while allowing the user to keep a sense of presence about his surroundingsuser to keep a sense of presence about his surroundings

Performance CriteriaPerformance CriteriaThe mechanism that augments reality can be judged based on two thingsThe mechanism that augments reality can be judged based on two things

Update rate for generating the augmented imageUpdate rate for generating the augmented image Accuracy of the registration of the real and virtual image Accuracy of the registration of the real and virtual image

So in order for AR to be perceived as “real,” the rate at which the system renders So in order for AR to be perceived as “real,” the rate at which the system renders the image must be no fewer than 10 images a second. It also means that the the image must be no fewer than 10 images a second. It also means that the system must be able to register its environment accurately enough so that a system must be able to register its environment accurately enough so that a virtual change can be super imposedvirtual change can be super imposed

The HardwareThe Hardware

In order for the AR In order for the AR system to work, certain system to work, certain hardware is needed, hardware is needed, including: display, including: display, tracking, input devices, tracking, input devices, sensors and a processor. sensors and a processor.

Currently, components Currently, components such as a CPU, camera, such as a CPU, camera, display, accelerometer, display, accelerometer, GPS and solid state GPS and solid state compass.compass.

DisplayDisplay

One can perceive augmented reality in One can perceive augmented reality in generally three different ways:generally three different ways:

Head mounted: the most immersive Head mounted: the most immersive experience, HMD puts the virtual scene experience, HMD puts the virtual scene over the user’s view of the world. The over the user’s view of the world. The device is either optical see-through or device is either optical see-through or video see-throughvideo see-through

Handheld: the most commercially Handheld: the most commercially successful AR system, handheld display is successful AR system, handheld display is generally video see-through with a generally video see-through with a gyroscope in order to orient the imagegyroscope in order to orient the image

Spatial: any AR device separated from the Spatial: any AR device separated from the user. Can be used by multiple people. In user. Can be used by multiple people. In some cases, users are able to touch some cases, users are able to touch virtual physical objects giving a sensation virtual physical objects giving a sensation of realness.of realness.

SoftwareSoftware

AR vision methods are AR vision methods are based on visual based on visual odometry, or determining odometry, or determining position using camera position using camera imagesimages

This generally includes This generally includes feature detection and other feature detection and other image processing methodsimage processing methods

It also requires a real world It also requires a real world coordinate system to be coordinate system to be made once the image is made once the image is processed, created by processed, created by perhaps fiduciary marks on perhaps fiduciary marks on the image, simultaneous the image, simultaneous localization and mapping of localization and mapping of the image, or other the image, or other mapping methodsmapping methods

Applications: MedicalApplications: Medical

Augmented Reality Augmented Reality has the ability to has the ability to enhance the enhance the efficiency of surgeries efficiency of surgeries and diagnosticsand diagnostics Virtual x-raysVirtual x-rays Real time ultra-sound Real time ultra-sound

imagesimages Nuclear magnetic Nuclear magnetic

resonance imagesresonance images MRI images imagesMRI images images

Applications: MilitaryApplications: Military

Numerous applications:Numerous applications:Detect objects not discernable to the naked eye, Detect objects not discernable to the naked eye, such as toxinssuch as toxinsExamine sound of gunfire to determine location Examine sound of gunfire to determine location of shooter and type of weaponof shooter and type of weaponEnhanced visual feedback of surroundingsEnhanced visual feedback of surroundingsRepresent physical objects that aren’t yet Represent physical objects that aren’t yet visible, such as an airplane that has yet to landvisible, such as an airplane that has yet to landDisplays in cockpits of military vehiclesDisplays in cockpits of military vehiclesWar game simulation technologyWar game simulation technologyEtc.Etc.

Applications: NavigationApplications: Navigation

Building navigation; in order to analyze and explore Building navigation; in order to analyze and explore buildings effectivelybuildings effectivelyMilitary operationsMilitary operationsDisaster managementDisaster managementHeads up displays that cover the displays of automobiles, Heads up displays that cover the displays of automobiles, planes, etc.planes, etc.Individual navigation through now urban areas (street to Individual navigation through now urban areas (street to street, place to place (GPS))street, place to place (GPS))

Applications: Entertainment, Applications: Entertainment, Performance and EducationPerformance and Education

Augmented Reality systems Augmented Reality systems can create virtual objects and can create virtual objects and environments that enhance the environments that enhance the experience of entertainment, experience of entertainment, and the quality of educationand the quality of educationMusical performances can be Musical performances can be augmented to add to the augmented to add to the experience or create certain experience or create certain sound effectssound effectsInteraction with educational Interaction with educational toolstoolsVirtual guides that can even Virtual guides that can even activate based on location on activate based on location on GPS or proximity to markerGPS or proximity to marker

Applications: Digital ApplicationsApplications: Digital ApplicationsSince smart phones come with most of the basic Since smart phones come with most of the basic components for an AR system, applications soon components for an AR system, applications soon began to flood the smart phone market, making began to flood the smart phone market, making AR commercially successful AR commercially successful Examples of smart phone apps exemplify the Examples of smart phone apps exemplify the many usesmany uses

Wikitude : Gives the user data about their Wikitude : Gives the user data about their surroundings by overlaying information on the real-surroundings by overlaying information on the real-time scene taken by the phone’s cameratime scene taken by the phone’s camera

Augmented ID : gives the user the ability to identify Augmented ID : gives the user the ability to identify someone by looking at them through the camera of someone by looking at them through the camera of the phonethe phone

Image Space : lets the user record messages, Image Space : lets the user record messages, photos and video and tag them with both place and photos and video and tag them with both place and time. Then, when someone else goes to that same time. Then, when someone else goes to that same location they can see the images that were left in location they can see the images that were left in the areathe area

Layer :Positioning the camera over your Layer :Positioning the camera over your environment, the phone can overlay images from environment, the phone can overlay images from web pages and information about businesses in the web pages and information about businesses in the areaarea

Video Games: A game is generally overlayed on to Video Games: A game is generally overlayed on to the user’s surroundings, then the user may interact the user’s surroundings, then the user may interact with the scene through the phonewith the scene through the phone

Everyday Augmented RealityEveryday Augmented Reality

Powers immersive video gamesPowers immersive video gamesVery common to use it to navigate one’s Very common to use it to navigate one’s surroundingssurroundingsInteract and understand digital content more Interact and understand digital content more interestingly interestingly Clear benefits recognized in using AR technologyClear benefits recognized in using AR technologyNow found on most smart phones, opening up a Now found on most smart phones, opening up a whole new way to interact with the digital and whole new way to interact with the digital and physical environmentphysical environment

There is now an entire market for AR apps, including There is now an entire market for AR apps, including one’s that possibly give schematics for a building, one’s that possibly give schematics for a building, the constellations in the sky or the information about the constellations in the sky or the information about nearby restaurants nearby restaurants

AR now available in Adobe Flash, making AR AR now available in Adobe Flash, making AR accessible through web browsingaccessible through web browsingRecently there has been a new form of crude 2D Recently there has been a new form of crude 2D bar code technology, which can be used to quickly bar code technology, which can be used to quickly transfer informationtransfer information

Limitations and ConsLimitations and ConsDoes not work as well indoorsDoes not work as well indoorsGPS only accurate within 9 metersGPS only accurate within 9 metersDanger of ‘too much information,” where a disconnect forms between the user and the Danger of ‘too much information,” where a disconnect forms between the user and the real worldreal worldPrivacy will be harder to keep due to virtual interaction Privacy will be harder to keep due to virtual interaction Over reliance on AR technology Over reliance on AR technology Image recognition technology not developed to potential yetImage recognition technology not developed to potential yetInaccurate depth perceptionInaccurate depth perceptionCalibration and latency still poorCalibration and latency still poor

The Future of Augmented RealityThe Future of Augmented Reality

Next generation of smart phones will Next generation of smart phones will be able to handle augmented reality to be able to handle augmented reality to a much greater extent due to improved a much greater extent due to improved batteries, compasses, graphics chips batteries, compasses, graphics chips and processors. and processors. The mobility of the smart phone and The mobility of the smart phone and the location based services make AR a the location based services make AR a very popular investment.very popular investment.The line between virtual and physical The line between virtual and physical begins to blur as augmented begins to blur as augmented technology growstechnology growsGreater access to information based Greater access to information based on AR will mean greater awareness of on AR will mean greater awareness of surroundingsurroundingVirtual graffiti and art could be Virtual graffiti and art could be developeddevelopedDesire for increased AR technology in Desire for increased AR technology in the field of medicine, as well as other the field of medicine, as well as other fields.fields.

ReferencesReferences"Augmented reality - Wikipedia, the free encyclopedia." "Augmented reality - Wikipedia, the free encyclopedia." Wikipedia, the free Wikipedia, the free encyclopediaencyclopedia. N.p., n.d. Web. 1 Feb. 2011. . N.p., n.d. Web. 1 Feb. 2011. <http://en.wikipedia.org/wiki/Augmented_reality>. <http://en.wikipedia.org/wiki/Augmented_reality>. Bonsor, Kevin. "HowStuffWorks "Augmented Reality in Video Games and Bonsor, Kevin. "HowStuffWorks "Augmented Reality in Video Games and the Military"." the Military"." Howstuffworks "Computer"Howstuffworks "Computer". N.p., n.d. Web. 30 Jan. 2011. . N.p., n.d. Web. 30 Jan. 2011. <http://computer.howstuffworks.com/augmented-reality3.htm>. <http://computer.howstuffworks.com/augmented-reality3.htm>. Brandon, John. "Augmented Reality Past, Present and Future: How It Brandon, John. "Augmented Reality Past, Present and Future: How It Impacts Our Lives." Impacts Our Lives." Technology News, Product Reviews, Software Technology News, Product Reviews, Software Downloads | Digital TrendsDownloads | Digital Trends. N.p., n.d. Web. 1 Feb. 2011. . N.p., n.d. Web. 1 Feb. 2011. <http://www.digitaltrends.com/features/ge-augmented-reality-iphone-app-<http://www.digitaltrends.com/features/ge-augmented-reality-iphone-app-past-present-and-future-how-it-impacts-our-lives/>. past-present-and-future-how-it-impacts-our-lives/>. Krevelen, D.W.F. van , and R. Poelman Poelman. "A Survey of Augmented Krevelen, D.W.F. van , and R. Poelman Poelman. "A Survey of Augmented Reality Technologies, Applications and Limitations." Reality Technologies, Applications and Limitations." The International The International Journal of Virtual RealityJournal of Virtual Reality. Delft University of Technology, n.d. Web. 1 Jan. . Delft University of Technology, n.d. Web. 1 Jan. 2011. <www.ijvr.org/issues/issue2-2010/paper1%20.pdf>. 2011. <www.ijvr.org/issues/issue2-2010/paper1%20.pdf>. Tumba. "Augmented Reality." Tumba. "Augmented Reality." HubPagesHubPages. N.p., n.d. Web. 1 Feb. 2011. . N.p., n.d. Web. 1 Feb. 2011. <http://hubpages.com/hub/Augmented_Reality>. <http://hubpages.com/hub/Augmented_Reality>. Vallino, Jim. "Augmented Reality Home Pages - Introduction." Vallino, Jim. "Augmented Reality Home Pages - Introduction." Software Software Engineering @ RIT | RIT | Department of Software EngineeringEngineering @ RIT | RIT | Department of Software Engineering. N.p., n.d. . N.p., n.d. Web. 1 Feb. 2011. Web. 1 Feb. 2011. <http://www.se.rit.edu/~jrv/research/ar/introduction.html>. <http://www.se.rit.edu/~jrv/research/ar/introduction.html>.