Upload
sgrrsc
View
234
Download
0
Embed Size (px)
Citation preview
8/10/2019 Virtual Reality - Lecture10- Applications of VR
1/10
1
1
Applications of VR
The pplications of VR
SGN-5406 Virtual Reality Autumn [email protected]
2
Applications of VR
Virtual Reality Technology
Entering the imageMore compelling, expressive and comprehensible than just viewingVarious levels, from Desktop VR to immersive high-end
Need for be tter competitiveness, time-to-market, product developmentand personalizationReduction in hardware cost
N,000,000 is now N,000 , or even in smartphonesWider range of applications3D CAD, CAM systems have become more commonplace
Improved VR technologyVR applications from prototypes to industrial phase3D rendering speed revolution!
Still many problemsUtilization and maintenance require highly skilled personnel. Developmentcosts may be highOften custom software, incomplete documentation, conversion problems
Intuitive: becoming a general-purpose UI?
3
Applications of VR
Signal processingOptics Acoustics
Process tech.
Robotics
Pedagogy
Sociology
Philosophy
Art
Etc. etc.
Computer science
Ergonomics
Measurement tech.Electronics
History
Psychology
Physiology
VR Needs Other Sciences4
Applications of VR
Signal processingOptics Acoustics
Process tech.
Robotics
Pedagogy
Sociology
Philosophy
Art
Etc. etc.
Computer science
Ergonomics
Measurement tech.Electronics
History
Psychology
Physiology
Other Sciences Need VR
5
Applications of VR
The Applications of VR
Applicable to enormous range of thingsDo not try to force VR to everythingImagination sets the limitsVR technology is getting more advanced and lower costHigh demand, enthusiasmUseful and/or entertainingSome applications (in Finnish):http://www.csc.fi/downloadPublication?uid=e252b504caf89b681bc95bc13e93e4ca
Excellent courses on 3D, VR etc at annual SIGGRAPHconferences, http://www.siggraph.org/s2009/sessions/courses/See EUs Intuition research network reports
http://www.intuition-eunetwork.org/
6
Applications of VR
Some Potential Advantages of VR
Cost savings, profitImproved marketing, presentationConveying information, artistic expression, etc.Exploring, familiarizing with data in a new wayEntertainment, games, escapismNon-invasive experimentationWhat if -scenariosSafety, saving livesImproved quality of lifeTraining hard and impossible tasks
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
2/10
2
7
Applications of VR
Some Fields of Applications
Simulators, training, educationPerhaps the most important currently
Product-, virtual planningProduction, manufacturing
real-time walk-through of complex systemsVisualization, data explorationPresentations, marketingMission planningEntertainment, games
ILM, PIXAR, etc.Tele-presence
Augmented realityweb3D
8
Applications of VR
Training, Education: Simulators
All kinds of simulatorsOne of the first VR application fieldsMany simulators also in Finland:
Emergency services college ArmyPoliceFinnair Flight controller trainingTruck driversCranes
Many more applications to come
9
Applications of VR
Why Simulator?
The costsMaterial, time, money
Perils, harmfulnessRare or impossible situationsFast modifications
E.g., full load to empty load
ControllabilityRepeatability, action record
10
Applications of VR
Military Applications
The first field of VR applicationsNASA and US army have developed a lot
Future Combat Systems: $170B project!Simulators, education
Augmented realityHUD, head-up display, onto a windscreen
HMD, head-mounted displayTele-presence, tele-surgery, etc.
Samsung robot watchmanHoneywell Micro Air Vehicle (see image)U.S. drones in Afghanistan, Pakistan
Battle planning, troop training, etc.Space technology
Repairing Hubble Space Telescope in 1999. Therole of VR used in astronaut training was useful
11
Applications of VR
Military Simulators
Finnish air forces, Pirkkala, Finland: HornetFlight, helicopter Ship, submarineTanks, vehiclesInfantry, commandoGame-based learning, simulators
http://adlcommunity.net/Networked battle training
Huge simulator centers100s of LAN -connected mixed simulatorsGoal as 100,000 objects
12
Applications of VR
Military: Parachute simulator
Students wear the VR glasses while suspended in a parachuteharness, and learn to control their movements through a seriesof computer-simulated scenariosThe computer receives signals from the student as they pull onthe risers that control the parachuteSaves lives, money, gas for the jets
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
3/10
3
13
Applications of VR
DARWARS Ambush! simulator
A set of PC simulators for military missionsmultiplayerhttp://www.darwars.net/
DARPA projectRestricted to U.S. MilitaryUser-authorable: soldiers can create new scenarios and trainingTactical language tutors
support.tacticallanguage.comVirtual Vietnam, Virtual Iraq (PTSD) (CGW 8/2008)
14
Applications of VR
Military Application: recruiting
Public military simulator (game)http://www.americasarmy.com/ A realistic training and battlesimulator
Not immersive VR, but a game ona PC monitor
Made by U.S. Army!Made for positive publicity,recruiting
15
Applications of VR
Civil Simulators
Flight simulatorsSince 1920sComputerized in 1960s
Finnair DC-9 (8 KB (!) main memory, 112 KB f ull)
MD-11 etc.
16
Applications of VR
Flight Simulators
Many categories of simulatorsThe best are identical to the real thing
Often big hydraulic systems are usedUnited Airlines Flight Training Center
Denver, CO, USAThe worlds biggest simulation center Try it yourself! Boeing 777: $1350 / h
Microsoft Flight Simulator < $50
17
Applications of VR
Other Simulators
Car simulatorsCar manufacturersDriving schoolsDrinking and driving in Haaga neurological institute
Professional vehiclesHarvestersSkyliftsCranesTrucksTrains, ships
Virtual control desks for nuclear power plantsimulation, IEEE CGA 8/2008Mock up = the physical copy of real cockpit
18
Applications of VR
Driving Simulators
Realistic rally simulator Bus, truck training s imulatorshttp://www.simrac.com/
Mobile truck training simulator http://www.ek-aktiva.fi/rekkasimulaattori-www/
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
4/10
4
19
Applications of VR
Military simus: Insta Group Oy20
Applications of VR
Walking Simulators
TreadportOmniDirectional Treadmill (ODT)
21
Applications of VR
Some Fields of Applications
Oil and Gas explorationExploratory holes 10M each, of which 2/3 drySeismic data is 3DVisualization may raise success rate to 80%
Espionage, militaryimageryvideo
3D terraingeospatial datasimulatorsmission planningbattlefield visualizationdefense imagingintelligence
22
Applications of VR
Scientific Visualization
3D objectsComplex phenomenaCan be more clear, expressiveand comprehensibleTouching the imageImmersionProcessesSimulationsFlows etc.
23
Applications of VR
Applications of Scientific Visualiz.
BiologyMolecular structures
AstronomyHayden Planetarium, NYC, www.amnh.org
Geological seismic interpretationPhysicsDrug designEconomyResearch
Education
24
Applications of VR
Research Tool
Using various flavours of VR to gain knowledge ofhumans
University of Tampere: human balanceHuman cognition, perceptionBehaviour, attitudes, etc.
Science, other phenomenaPhysics, flow dynamics
Astronomical macrostructuresNumerical tables to visualizationsEconomicsEtc.
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
5/10
5
25
Applications of VR
Medicine
Medicine Meets VR-conference (MMVR)
Virtual Human project Augmented reality
SurgeryExamining the fetus
Winning the fearsFear of high placesFear of flyingFear of public speakingMilitary trauma careE.g., http://www.vrphobia.com/
Drug rehabilitationVR pain control:
http://www.hitl.washington.edu/research/burn/
26
Applications of VR
Psych. treatment: pain reduction
27
Applications of VR
Medicine
VisualizationsTelemedicine, military medicine
daVinci Surgical SystemDevelopment of new drugsEndoscopic examination simulators
Virtual surgery and visualisationIEEE CG&A Nov/Dec 2006http://www.brainlab.com
28
Applications of VR
Surgeon simulator case
LiverPlanner: liver surgery planningCombines VR and high-level image analysis algorithmsEffectiveness and ease of useThree main stages:
Image analysis, which involves mostly automatic tissue segmentation and vesselextractionSegmentation refinement, where defects can be checked for, uncovered, andcorrectedTreatment planning, in which a surgical plan can be detailed based on data
inspection, spatial analysis, and resection simulationSmall defects can be corrected in LiverPlanner through the use of directdeformation tools, while template shape tools help users correct largerdefectsLiverPlanner employs a camera-equipped optical tracking system, a TabletPC, a custom-designed hybrid 2D-3D input device dubbed the Eye of Ra,and a stereoscopic large-screen projection systemLiver Surgery Planning Using Virtual RealityIEEE Computer Graphics and Applications (12/06)
Telepresence
In VR the user is immersed in a computer generated worldIn telepresence the user is immersed in a remote real worldReal and virtual data can be mixedRobots are frequently used as part of a tele-operated systemTele-operation in dangerous or impossible environments
Chernobyl tele-operation with VR and robotsU.S. drones, UAVs in Pakistan, teleoperated from Las Vegas
Tight spots, physically demanding jobs, boring jobsUnmanned vehicles are lighter, smaller Battlefield surgery, telemedicine
Communication, tele-conferencing
29
Applications of VR
30
Applications of VR
Nano-, Macropresence
Nanopresence, macropresenceThe scale is micro/macroscopic
Also timescale can be adjustedwww.romereborn.virginia.edu
Live connection possible
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
6/10
6
31
Applications of VR
Telepresence
Dangerous tasksImpossible placesMultiuser systems
32
Applications of VR
CAD & Design
Traditional miniature models, prototypesThe material costThe cost of making, the need for spaceNeed for miniature models reducedFull scale clay car model: $1MFast alteration of plans and designSmall items can even be printed as 3D physical objects
Big, complex devicesBoeing 777Submarines
Engineering Automotive styling etc.Most car manuf acturers employ
Animations, manualsCollaboration over the net
33
Applications of VR
Virtual Design
Entering the image, moving in itVirtual models
Fast prototypingFast designFlexibility
Alternations
Time-to-marketLife-likeExpressivityRemote viewing
Assembly validationErgonomic analysisPlant design, optimizationTraining, marketing
34
Applications of VR
Architecture
BuildingsTraffic networksVirtual prototypesUrban and rural environmentsThe search of potential problemsVisualization of plansMarketing, presentation
35
Applications of VR
Art
Illusion, experience A new tool and art formMuseums, installationsReconstructionsSalvador Dali would have been delighted!
36
Applications of VR
Virtual Orchestra
A training tool for the conductor
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
7/10
7
37
Applications of VR
Simulations
Ergonomy Assembly simul.
Factory modelsLogistics simulation, bottlenecks
Traffic simulationsFinding of bottlenecks in rushPrototyping layouts
Security
38
Applications of VR
Presentations
Cool visualizationsBoosts marketingSupports salesMore expressive, appealingClarifies complex systemsSmall money for big companies
Construction projectsMachines, devices
39
Applications of VR
Other Visualizations
Traffic, 3D city maps Air traffic controlVirtual planetariumsLas Vegas casino, restaurant decorationsHistorical reconstructions
3D Shoe sizer Legal
Accidents, crimesCrime scene 3D scanning
40
Applications of VR
Virtual Stage
Used in TV in daily basisWeather reports
Combining several image sourcesChroma-keyTracking of camerasVirtual worlds + realityMixed reality
41
Applications of VR
3D Movies
3D movies with colored glasses were popular in the 1950s A new coming of 3D movies recently3D versions of movies give better profit than standard movies,but require investment
Thousands of movie theaters are being equippedStereoscopic filming, or 2D -> 3D transformation software
Avatar (Dec09): $237 million for production3D digital cinema is here, thousands of 3D theaters in USA
RealD: market leader (3300), XPAND (1100), Dolby (1000),IMAX (300), MasterImage (300), Sony 4K (300)Panasonic 3D HD camera, E&S ESLP 8K laser 3D projector
A host of consumer-oriented 3D products are likely in the next
few years. Web 3.0?3D: the next big wave in consumer electronics?Hard to pirate a 3D movie with a smuggled in-theater camera
42
Applications of VR
3D Movies
Hollywood plans to release60 3D movies in 18 months 3D theater screens: ~6500
NA 4000, Eur 1200, As 1300
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
8/10
8
43
Applications of VR
Movies, TV
Not really VR, but 3D stereoscopic
TV is broadcast, but could become more interactiveBorder between TV, PC and web may become unclear
3D content is necessary to enable the widespread deploymentand commercial success of 3D displaysMany standard movies Its hard & expensive to make a movie,never mind 3D
All the normal tasks plus many 3D issues intertwinedOld movies can be converted to 3D
Semi-automatic, can sometimes be fa ir quality (or bad)E.g., Philips, DDD, In-Three, Conversion Works, Mercury 3D,JVC, make3D, imcube Media,
Quality conversion is a massive p ost-production taskFor conversion of a 90 -minute film, the post-production schedulewill cover about 10 months
Some new movies are already filmed as 3D just in case
Making 3D Movies
A major transition in HollywoodThe mistakes that can happen in 3D movie making
Left/right eye reversal, unintentional monoscopic frames, out of sequencestereo frames, action within a l imited volume, focus depth changes, etc.
The screen size has an effectRecent examples: Beowulf, Chicken Little, Star Wars, U2 3D,Nightmare Before Christmas, Polar Express, Avatar The 3D industry needs to train a lot more people in the art andscience of 3D movie makingBetter 3D workflow tools, particularly in 3D editing, are needed(being developed in-house in major studios)DIY: StereoMovie Maker, http://stereo.jpn.org/eng/stvmkr http://nowin3d.com/, http://www.digdia.com/
A list of 3D movies, 3D ready HDTVs etc.: www. 3dmovielist.com/
44
Applications of VR
45
Applications of VR
3DTV is coming
Several ideas, prototypes, visionsBlu-ray Disc Association: 3D spec in Dec09
Already here: Colorcode3d glasses in Super bowl 2009Is it technically, commercially feasible (in recession)?
A need, a market for real people (not engineers)?
Commercial issues will dictate deploymentHow about usability (for couch potatoes)?3DTV emerging (glasses or autostereoscopic)3D movies may help, but many obstaclesFew standards, infrastructure not readyEUs 3DTV project, http://www.3dtv -research.org/3D Consortium, http://www.3dc.gr.jp/english/3D @ Home Consortium, www.3dathome.org
46
Applications of VR
3DTV
ddd.com: 3D Conversion in a Set Top BoxReal-time, special LCD TV, polarization glasses
TDVision, http://www.tdvision.com/Develops full HD stereoscopic 3D real-time encoder
Sensio Technologies Inc., www.sensio.tv2D->3D real-time decoder ASIC chip
to be integrated into Hyundai's LCD-TVs and SpectronIQ "Full 3D" TVInThree: semiautomatic 2D->3D conversion, in-three.com/YouTube is working on a 3D stereoscopic video player Sky UK launches Europe's 1st 3DTV in 2010 (&Channel 4 UK?)Sonic Solutions & Nvidia add 3D content to Roxio / CinemaNowInternet movie service for 3D ready TVs and PC displaysTexas Instruments: 3D DLP technology for existing HDTVsSony becoming an active player (3D Bravia TV, Playstation etc)http://www.informationdisplay.org/ July 2009: 3DTV specialGeneral info: http://www.stereoscopy.com/
47
Applications of VR
Entertainment, Games
Game consoles at home!iZ3D 22 3D gaming monitor for $999Resident Evil 5 is designed to exploit S3DWalls into displays
The office of the fu ture, MIT KidsRoomHome VR theatres?
New kinds of interaction, tracking?What is the most violent place of the world?
Our living rooms in front of TV sets!VR has a lot to give for violence etc.
Youll know when S3D is a success when you dont talk aboutit. When was the last time you went to a movie and came outsaying, WOW did you see the color in that movie?
48
Applications of VR
Entertainment, Games
LBE, location-based entertainmentNamco Bandai GamesVR entertainment centers
DisneyQuest VR park, OrlandoFuturoscope (France)Universal Studios, Disneyland
Many kinds of VR experiencesVirtual actors
The virtual actor is created in real time based on tracking ofa real face
Motion capture can be used to create more realistic games
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
9/10
9
Virtual golf cafs in Korea
12,000 simulators, 300,000 players Always nice weather indoorsMat tilts downward to replicate a downhill slopeIn Japan and Korea, golf is very expensive, but VR golf is cheapPlenty of international golf courses to choose fromCameras and sensors capture the club speed, the ball's launchangle, and its spin. The computer creates its trajectory, audioand visual effectshttp://www.businessweek.com/globalbiz/content/oct2008/gb20081027_293085.htm
49
Applications of VR
50
Applications of VR
LBE: DisneyQuest
CyberSpace MountainDesign your ultimate roller coasterride it on a 360 pitch / roll simulator
Aladdin's Magic Carpet Ride
51
Applications of VR
DisneyQuest
Virtual Jungle Cruise Invasion
52
Applications of VR
DisneyQuest
53
Applications of VR
Augmented Reality (AR)
Augmented reality alters how we see the real world(in Finnish: listty todellisuus)
Numerous flavors and applications
54
Applications of VR
AR Visions
www.jntuworld.com
www.jntuworld.com
8/10/2019 Virtual Reality - Lecture10- Applications of VR
10/10
55
Applications of VR
Mobile AR / VR
An emerging field: devices get smaller, display gets bigger,processing faster 3D user interfaces?3G phones with multi-sensorsiPhone and other smartphonesLocation-based visualization
Google Maps 3D for SymbianGIS-based applicationsNumerous consumer personal viewers emerging
E.g., Icuiti iWear, MicroOptical myvu, i-O Displays iTheater,Oriscape Cyberman GVD310A
The disappearing computer, ambient intelligence"The-computer-as-we-know-it" will have no role in our futureeveryday liveshttp://www.arconsortium.org/Mobilizy.com: Augmented Reality Mark-up Language (ARML)
56
Applications of VR
VR Desktop
Take head-mounted display Add tracking =>Virtual desktop, personal data space (mobile AR, iPhone)Extends displayImmersionInteraction
57
Applications of VR
VR Desktop
MobiVRMicrodisplay + finger pointingEnables easy input on a hand-held deviceEnables also VR apps on a mobile phonehttp://www.cs.tut.fi/~ira/MobiVR.html
Tactile feedback ?
58
Applications of VR
Web3D Applications
The same application possibilities as with most of other VR A growing branch of VR, not yet immersive
Typically displayed on a monitor A new UI, aid for communicationEveryman VRTurbulent technologies, browsers
Mobile phones becoming 3D! Ads, product presentations3D comics, gamesCommunity-based services
Sony PS3 Home, Project Wonderland, Active worlds, muse, worlds.com,moove, Lively (Google, ended)
Compresses well!
59
Applications of VR
Some Haptic Applications
Medicine: surgical simulators for medical training; manipulatingmicro and macro robots for minimally invasive surgery; remotediagnosis for telemedicine; aids for the disabled such as hapticinterfaces for the blindEntertainment: video games and simulators that enable the userto feel and manipulate virtual solids, fluids, tools, and avatarsEducation: giving students the feel of phenomena at nano,macro, or astronomical scales; what if -scenarios for non-terrestrial physics; experiencing complex data setsIndustry: integration of haptics into CAD systems such that adesigner can freely manipulate the mechanical components of anassembly in an immersive environmentGraphic Arts: virtual art exhibits, concerts, and museums in whichthe user can login remotely to play the musical instruments, andto touch and feel the haptic attributes of the displays; individual orco-operative virtual sculpturing across the internet
60
Applications of VR
Biggest Gaps for VR Technology
The investment (purchase, integrate, install, maintain)Large corporations, space, militaryPrototype and pilot nature expert personnel requiredBut smartphones, game consoles may make consumer products
CAD VR integrationSeparate systems: incompatible. No direct support for VROften only 2D is used in design. 3D too advanced for SMEs
Content: tools are more for engineers, not for designersLack of physical contact with 3D virtual objects
Only low-level, limited or specialized haptic devicesLimited interaction tools, modalities and user interfaces
Interaction paradigm for shape and part designMulti-user visualization systemsPrecise tracking, expensive trackersCollision detection handling of very large modelsSimulation of complex physical phenomena like thermal diff usion orelectromagnetic interferencesCourse recap in 60 seconds: Dont be a WIMP
www.jntuworld.com
http://www.youtube.com/watch?v=CAKsjfbDwVQhttp://www.youtube.com/watch?v=CAKsjfbDwVQhttp://www.youtube.com/watch?v=CAKsjfbDwVQ