London Metropolitan University Learning Technology Research Institute

Hybrid Reality, Visualization, and Augmented Spaces for the Generation and

Transformation of Learning. 

Carl SmithDirector / Senior Research Fellow

Learning Technology Research Institute LMU

London Metropolitan University Learning Technology Research Institute

A major research theme at LTRI is designing hybrid technologies and methodologies for the creative industries and creative researchers.

Context engineering (Smith, 2013) is an

experience design practice that attempts to break the perceptual conventions that limit innovation within the social and knowledge construction agendas.

London Metropolitan University Learning Technology Research Institute

Objective 1 of FP7 Challenge 8.1: ICT for Creativity and Learning + Horizon 2020 - Research priorities:

Potential of technology in human creative processes.

Progress towards a formal understanding of creativity with a view to advancing the measurable capability of computers. Improved efficiency of creative processes.

Roadmaps for future research and innovation in the creative industries.

Improved competitive position of the European cultural and creative industries - closer dialogue between research and industry.

London Metropolitan University Learning Technology Research Institute

CRe-AM Creativity Research Adaptive Roadmap.

CRe-AM aims to bridge communities of creators with communities of technology providers, in a collective, strategic intelligence/road mapping effort.

Developing, enhancing, and mainstreaming new ICT technologies and tools by addressing the needs of different sectors of the creative industries (e.g. art, culture, epublishing, design etc.)

Ranked #1 in call

Kick off meeting in Nantes – will feed into Horizon 2020.

London Metropolitan University Learning Technology Research Institute

FlyVIZ headset - 360-degree super(vision)

Giving users the power to see all around them at once. What does this mean?

15 min for brain to adjust. No nausea.

The FlyVIZ can only give you 360-degree vision: you must choose how to use it.

London Metropolitan University Learning Technology Research Institute

Creating entirely new senses – Neil Harbisson can hear colour with a prosthetic device.

London Metropolitan University Learning Technology Research Institute

Artist Neil Harbisson is completely colour-blind so he create a device to allow him to see colour.

Simple device transforms light waves into sound waves using a webcam, computer and a pair of headphones with software that would translate any colour in front of me into a sound. £50

At the beginning he experienced strong headaches because of the constant input of sound, but after five weeks his brain adapted to it.

“Changed the way I perceive art. Now I have created a completely new world - currently working on seeing ultraviolet, which is very important because it can damage our skin.”

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

“We shape our tools, and thereafter our tools shape us” - Marshall McLuhan

London Metropolitan University Learning Technology Research Institute

Ancient Technology with Modern Pedagogy

London Metropolitan University Learning Technology Research Institute

Modern Technology with Ancient Pedagogy

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

Tools, Methodologies and Techniques that enhance Collaboration, Creativity and Knowledge Construction.

1) Hybrid Reality / Intermediality.

2) Analogue and Digital Context Engineering.

3) Body hacking / Reality hacking.

London Metropolitan University Learning Technology Research Institute

1) Hybrid Reality - Deformscape

Architect Thom Faulders: explores interfaces between space, perception, and context. He situates the practice of architecture within a broader context of performative research and material investigations that negotiate dynamic relationships between users and environments.

London Metropolitan University Learning Technology Research Institute

Intermediality - mvrdv cloud

http://www.designboom.com/architecture/mvrdv-the-cloud/

London Metropolitan University Learning Technology Research Institute

Wiesflecker Architecture - Crinkled Wall

London Metropolitan University Learning Technology Research Institute

Adrian Cheok. Professor of Pervasive Computing: Multi-Sensory Internet

London Metropolitan University Learning Technology Research Institute

PrioVR – Oculus + Body Sensors = Full Body Immersion.

London Metropolitan University Learning Technology Research Institute

2) Context Engineering: made possible through the datafication of everything

London Metropolitan University Learning Technology Research Institute

Clay Vision

London Metropolitan University Learning Technology Research Institute

Analogue and Digital Context Engineering

London Metropolitan University Learning Technology Research Institute

A revolution in spatial literacy: Access tonew spaces: Implications for what can be known

London Metropolitan University Learning Technology Research Institute

Fractured View = No common ground / (Cultural Heritage) = Reduction in Creativity / Knowledge Construction.

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

Re-enabling focus in music listening -slowlistening.com

A pair of headphones that force its wearer to focus on the music by dropping the volume if they move.

London Metropolitan University Learning Technology Research Institute

18 months

“We decided we had to give them the whole album for free – but with a catch. You had to be dancing to the music in order to listen to it all.”

London Metropolitan University Learning Technology Research Institute

Same Height Parties : artist Hans Hemmert explores the notion of how first impressions are made, as any height related impressions are subverted. Usually when talking to people it’s suggested you approach them at their level. Eye contact is constantly recommended as a way to bond with people.

Context Engineering - Conversation Spacification

London Metropolitan University Learning Technology Research Institute

Context EngineeringInnespace Productions have created a series of unique dolphin-inspired submersible boats that can jump, dive and roll like real dolphins.

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

3) Body hacking / Reality Hacking – Eidos Outcomes Context engineering: What if we had the same control over our senses – if we could adjust them in realtime? What new experiences could this make possible.

London Metropolitan University Learning Technology Research Institute

Lorenz Potthast's Decelerator helmet

"Decelerator," the avant garde piece of headgear does just that: it has a camera that feeds video to the head-mounted display inside, with the wearer (or someone else) able to control the speed of the video playback with a remote.

London Metropolitan University Learning Technology Research Institute

Perceptual Augmentation Devices

Exploring perceptual expansion through sensory substitution and augmentation.

The function of these devices is to expand the body's senses.

London Metropolitan University Learning Technology Research Institute

Plug-in architecture - Walter Pichler

Absolute Architecture: For Pichler and Hollein, architecture was not what it enables, nor what in encloses, but what it is.

London Metropolitan University Learning Technology Research Institute

Haus-Rucker-Co were exploring on the one hand, the potential of architecture as a form of critique, and on the other the possibility of creating designs for technically mediated experimental environments and utopian cities.

Flyhead-environment-transformer

London Metropolitan University Learning Technology Research Institute

HYUNGKOO LEE – Objectuals

Re-imagining what already exists and using perspective to shape reality instead of changing reality itself is something that intrigues me.

London Metropolitan University Learning Technology Research Institute

Tetris video game fixes lazy eye

The McGill University team discovered the popular tile-matching puzzle could train both eyes to work together.

Works better than conventional patching of the good eye to make the weak one work harder.

www.bbc.co.uk/news/health-22245620

London Metropolitan University Learning Technology Research Institute

FOV technologies- Oculus Rift

London Metropolitan University Learning Technology Research Institute

Apply different types of perspective / lenses to break learnt conventions by reprogramming vision

London Metropolitan University Learning Technology Research Institute

Avegant's Virtual Retinal Display

London Metropolitan University Learning Technology Research Institute

Body Hacking / Reality Hacking Karolinska Institute - Ehrsson Body Illusions : Seeing through another POV

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

Mirror Neurons: Implications from Neuroscience

London Metropolitan University Learning Technology Research Institute

Oculus – Among the Sleep

Among the Sleep, where players experience the world through the eyes of a two-year-old child.

Things seem bigger — you'll need to look up to see a doorknob, for instance — and all you can really do is stumble around like a toddler, walking or crawling away from danger.

London Metropolitan University Learning Technology Research Institute

Julius-Von-Bismarck - Topshot-Helmet – Inducing OBE

London Metropolitan University Learning Technology Research Institute

Olaf Blanke – Neuromodulation via Luis Girae

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

Macroscopic Visualisation

• The macroscope effectively provides the overview and the local point of view of the research object simultaneously.

• Within one field of view, to be both in the world and to see yourself in it. The power of looking through, and occupying, your own field of vision.

• We can see through satellites now.

London Metropolitan University Learning Technology Research Institute

Augmenting the understanding of an art work

Looking at Jackson Pollock whilst listening to jazz that Pollock himself was listening to when he made the artwork deeply effected the viewers understanding of the artwork.

Enrich the content itself with the context (of how the original artwork was created)

London Metropolitan University Learning Technology Research Institute

3D Movie ‘Hugo’ Cured Neuroscientist’s Stereoblindness

Bruce Mcnaughton had lived his entire life “stereoblind”, which meant he was unable to perceive depth correctly.

This new effect stayed with him after he walked out of the theatre, because unlike most regular moviegoers, Bruce had been unable to perceive everyday objects with accurate depth.

London Metropolitan University Learning Technology Research Institute

Weak Signal: Importance of peripheral vision.

Removing peripheral vision is a reliable way of hacking the brain.

Scientists have found that there is a neurotransmitter in the peripheral nervous system, that is crucial to focus and memory.

This is a problem with augmented reality which tends to focus on only what is directly in front of you.

London Metropolitan University Learning Technology Research Institute

SummaryFocus on feeling rather than creating more cognitive dissonance = not living in the

moment is leading to diminished reality.

Take advantage of the plasticity of brain and the plasticity of the senses.

Learn more about human perception and the interaction between different sense modalities.

Fundamental problem is that we think of the technological solution before defining the human need.

New economy coming out of context augmentation rather than content augmentation.

London Metropolitan University Learning Technology Research Institute

Challenges: Stop the Cyborgs are concerned with the ethics of being always on and always augmented.

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

London Metropolitan University Learning Technology Research Institute

The McCollough effect: a phenomenon of visual perception.

London Metropolitan University Learning Technology Research Institute

Experience design: Moving from ‘Information Communication’ to ‘Experience Communication’

London Metropolitan University Learning Technology Research Institute

Summary

Post-digital/hybrid reality design uses these tools to humanise technology via social and cultural applications.

The combination of hybrid reality tools and context engineering practises are fundamentally changing the way we interact, allowing us to access new ways of seeing and knowing.

Fluidity of thinking relates to fluidity of movement (Maher)

Design problem: Replacing imagination with graphics/visualisation?

London Metropolitan University Learning Technology Research Institute

Email:carl.smith@londonmet.ac.uk Facebook:facebook.com/behindthebeats Twitter: behindthebeats

http://www.makototojiki.com/