22
1 Mikhail Fominykh Blue Sky Conference http://fet-eye.eu/bs-2014 Budapest, Hungary | June 17–19, 2014 Virtual Reality Experience for Creating and Retrieving Fluid Knowledge Mikhail Fominykh Pietro Piazzolla Albena Turnina David Bertolo Djordjije Dupljanin Jarno Vanne Fridolin Wild Sebastian Kelle Salvatore Distefano Victor Alvarez Puneet Sharma Carl Smith

Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

Embed Size (px)

DESCRIPTION

Blue Sky conference http://fet-eye.eu/bs-2014 Abstract: Virtual reality technologies are going beyond the desktop, allowing mixed-reality to be embedded in common spaces. The application of these technological advances to the creative collaborative processes, including learning, would not only allow spaces for conveying, understanding, expressing, sharing ideas, safe training and trials, but also preserving and retrieving these highly dynamic activities. This project aims at building a system for exploring, preserving and retrieving knowledge that resides in collaborative activities conducted in mixed reality settings. It is believed that such a system can represent the next step in virtual reality-based working and learning, giving access to the knowledge that is usually hidden and too fluid for being captured and re-experienced. The proposed system will be created as an online platform, based on cloud computing. It will use virtual reality in a new way to ensure high educational value for each unique learner, allowing the use of innovative methodologies based on learning by doing while keeping formation costs low.

Citation preview

Page 1: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

1 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Virtual Reality Experience for Creating and Retrieving Fluid

Knowledge Mikhail Fominykh Pietro Piazzolla Albena Turnina David Bertolo

Djordjije Dupljanin Jarno Vanne

Fridolin Wild Sebastian Kelle

Salvatore Distefano Victor Alvarez

Puneet Sharma Carl Smith

Page 2: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

2 Mikhail Fominykh

Motivation

Page 3: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

3 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Idea Capturing and wearing experience accessing fluid

knowledge, experience, talking, thinking, and feeling Challenges

Difficult to store and retrieve fluid knowledge Difficult to automate creation of fluid knowledge

Objective Capturing and retrieving activities in augmented and

mixed reality to facilitate training Impact

Training highly skilled workers, industry, health care

Page 4: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

4 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Recording – Applying Storing - Accessing

Page 5: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

5 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Recording o 3D scanning o Vision o Eye-tracking o Panoramic environment o Gestures o Voice

Page 6: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

6 Mikhail Fominykh

Page 7: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

7 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Applying o 3D scanning to match o Highlight vision area o Laser beam for Eye focus o Panoramic environment or reality o Gestures by ghost hands o Expert’s voice and ambient sound

Page 8: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

8 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Evaluation Impact

Industry partners

Page 9: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

9

Page 10: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

10

Novice experience

Page 11: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

11

Expert guide experience

Page 12: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

12 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

We can do it

Page 13: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

13

Page 14: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

14 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Infrastructure

Pietro Piazzolla Salvatore Distefano Politecnico di Milano

Italy

Page 15: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

15 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Augmented Reality Learning

Sebastian Kelle Stuttgart Media University

Germany

Victor Alvarez Katholieke Universiteit Leuven

Belgium

Page 16: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

16 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Personalization

Albena Turnina Sofia University

Bulgaria

Page 17: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

17 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Creativity Context Engineering

Carl Smith London Metropolitan University

UK

Page 18: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

18 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Image Processing EYE-Tracking

Puneet Sharma Norwegian University of Science and Technology

Norway

Page 19: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

19 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Video and Compression

Jarno Vanne Tampere University of Technology

Finland

Page 20: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

20 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Wide ICT research expertise Industry Application

Fridolin Wild Open University

UK

Page 21: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

21 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Brokering Virtual Reality Training

Mikhail Fominykh Norwegian University of Science and Technology

Norway

Page 22: Virtual Reality Experience for Creating and Retrieving Fluid Knowledge

22 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Yes, we can do it