TELEIMMERSION

7/31/2019 TELEIMMERSION .

1/30

TELE-IMMERSION


2/30

Suppose you have a very important meetingwith your business associates. However youhave visitors from Abroad coming to yourhome. So you go to a room you call the

holodeck. There, inside a simulatedenvironment, you contact your businessassociates using information technology. You

are able to conduct a meeting with them . Youeven shake hands with their holographicimages, because they seem to be right there!


3/30

With teleimmersion you will interact instantlywith your friend on the other side of the globethrough a simulated holographic environment.This technology, which will come along with

internet2, will change the way we work, studyand get medical help. It will change the waywe live.


4/30

Introduction

Teleimmersion is a technology that will be

implemented with internet2 it will enable usersin different geographic locations to cometogether and interact in a simulated

holographic environment. Users will feel as if they are actually looking,

talking and meeting with each other face toface in the same place, even though they may

be miles apart physically. In a teleimmersive environment, computer

recognized the presence and movements of

individuals as well as physical and virtualob ects.


5/30

Introduction(Contd)

They can then track these people andnonliving objects, and project them in arealistic way across many geographiclocations.


6/30

History

It was way back in 1965 that the great pioneer of computergraphics, Ivan Sutherland, proposed the concept of theultimate display. It described a graphics display that would

allow the user to experience a completely computer renderedenvironment.

In 1998, Abilene, a backbone research project, was launchedand now serves as a base for Internet2 research. Internet2needed an application that would challenge and stretch itsnetworks capabilities.

. The head of advanced network and services proposedteleimmersion at the application that could drive internet2research forward. That is how the national teleimmersion

initiative as formed in may2000


7/30

The three steps to constructing aholographic environment.

1. The computer recognizes the presence andmovements of people and objects.

2. The computer tracks those images.3. The computer projects those images on a

strereoimmersive surface.


8/30

3D reconstruction for teleimmersion is

performed using stereo, which mean two or

more cameras rapid sequential shots of thesame objects, continuously performingdistance calculations, and projecting them into

the computer. Simulated environment toreplicate real time movements. By combiningcameras and Internet telephony, videoconferencing has allowed real time exchange

of more information than ever, withoutphysically bringing each person into onecentral room.


9/30

Components of a HolographicEnvironment:

Telecubical

Internet2

Display technologies

Haptic sensors Desktop supercomputers


10/30

Telecubical

Users will communicate by using this technology. It consist ofa Stereo immersive desk surface and two stereoimmersivewall surfaces. These three display surfaces join to form avirtual conference table in the centre. This will allow therealistic inclusion of teleimmersion into the work environment,as it will take up the usual amount of desk space.


11/30


12/30


13/30

Internet2:

This will replace the current internet infrastructure. It is aconsortium made up of the US government, industry andacademia (180universities) that has been formed for creatingtomorrows internet. This new network will have a higher

bandwidth and speeds that are 1000 times faster than todays

internet. This high bandwidth, high speed network isnecessary to transfer the large amounts of data thatteleimmersion will produce.


14/30

Internet2:

This will replace the current internet infrastructure. It is aconsortium made up of the US government, industry andacademia (180universities) that has been formed for creatingtomorrows internet. This new network will have a higher

bandwidth and speeds that are 1000 times faster than todays

internet. This high bandwidth, high speed network isnecessary to transfer the large amounts of data thatteleimmersion will produce.


15/30

Display technologies: stereo immersive displays

would have to present a clear view of the scenes beingtransmitted.

Haptic sensors: would allow to touch projections as ifthey were real.

Desktop supercomputers: would perform thetrillions of calculations needed to create a holographicenvironment. A network of computers that share power couldalso possibly support these environments.


16/30

Tele-immersion v/s Tele-conference

Tele-immersion differs significantly from conventionalvideo Tele-conferencing in that the users view of theremote environment changes dynamically as he moveshis head.


17/30

Tele immersion v/s Virtual Reality

Tele immersion may sound like virtual reality but there

are major differences between the two technologies.

Virtual reality allows you to move in a computer-generated 3-D environment.

Tele immersion can only create a 3d environment thatyou can see but not interact with.


18/30

How Tele-immersion Works:

Following the flow of information tele-immersion dependson intense data processing at each end of a connection,mediated by high performance network.

From the sender:

Parallel processors accept visual inputsfrom the cameras and reinterpret the scene as a 3-

Dimensional computer model.

To the receiver:

Specific rendering of remote peopleand places are synthesized from the model as it is receivedto match the point of view of each eye of a user. The wholeprocess repeats many times a second to keep up with theuser head motion.


19/30


20/30

Generating the 3-D Image:

An array of cameras views people and theirsurroundings from different angle . Each cameragenerates an image from its point of view many times in asecond

It uses cluster of cameras each of this havig 4 cameras (3-b/w & one-colour ).

They had it's own dedicated high-end computer toperform the image rectification, pixel correlation, and

triangulation needed to recover depth values from the setsof images produced.


21/30

- camera cluster

2. Each set of the images taken at a given instant issorted into subsets of overlapping trios of images


22/30

3. From each trio of images, a disparity map is

calculated, reflecting the degree of variation among theimages at all points in the Disparity map visual field. Thedisparities are then analyzed to yield depths that wouldaccount for the differences between what each camerasees.

4. Depth maps are combined into a single viewpointindependent of the scene at a given moment.


23/30


24/30

Tele immersion data flow

Control : - consists of data that is used tomanage the tele-immersion session, toauthenticate users or processes, to launchprocesses, to control the display

Text :- provides simple communicationscapability within collaborative sessions forsimple note taking and passing.

Video :- can allow teleconferencing orremote monitoring displayed within thevirtual world

Tele-immersion

management

Synchronizationof events


25/30

Audio :- allows voice communicationsamong users, and is used to issuecommands via voice recognition andspeech synthesis.

Tracking : - is achieved with location andorientation sensors, and captures the

position and orientation of the user.Typically this data is streamed to

the computer responsible for computing theperspective of the scene.

Tele-immersion

management


26/30

Database : - is the heart of a tele-immersionapplication world. The database containsthe graphical models of virtual scenes,objects, and data, and since the databaseis used to provide the models that arerendered.

Haptics : - include force and touchsensing/feedback devices and use a varietyof sensors that are attached to the hands

and/or legs of users

Tele-immersion

management


27/30

APPLICATION :

Uses in Education:

In education, teleimmersion can be used to bringtogether students at remote sites in a single environmentrelationship among educational institutions could improve

tremendously in the future with the use of teleimmersion.

Future Office:


28/30

Medicine:

With the help of teleimmersion, 3d surgicallearning for virtual operation can possible.

Recently, teleconferencing has been used in medicine


29/30

Industrial design, architectural, evaluation

Interactive Scientific Visualization

Army training.

Art and Entertainment.

Virtual game Industrial Design

Architectural Review and Evaluation


30/30

PROBLEMS :

Quality of transmitting multimedia and Tele-immersion

data streams over the internet is affected by high packetsloss rates.

Expensive

Network bandwidth required to make teleimmersion workis one of the main concerns of this new technology.

Documents

TELEIMMERSION