27
Jeff Burke UCLA School of Theater, Film and Television [email protected] Sensor networks in art and entertainment

Jeff Burke UCLA School of Theater, Film and Television [email protected] Sensor networks in art and entertainment

Embed Size (px)

Citation preview

Page 1: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Jeff BurkeUCLA School of Theater, Film and [email protected]

Sensor networksin art and entertainment

Page 2: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

ENS theory, devices, and systems operate at extremely relevant social & aesthetic boundaries.

Art and entertainment applicationscan provoke relevant fundamental ENS research.

Summary

Page 3: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Entertainment Industry Preoccupations

Digital Media

Pervasive Content

Digital Rights Management

Page 4: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Entertainment Industry Preoccupations

Cellular Technology

Pervasive Displays

Mobile Media Experience

Page 5: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Beyond Entertainment Industry Preoccupations

CENS Research

Pervasive Interfaces

??

Page 6: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Beyond Entertainment Industry Preoccupations

CENS Research

Pervasive Interfaces

Encountered Phenomena

(Observation)

Page 7: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Beyond Entertainment Industry Preoccupations

CENS Research

Pervasive Interfaces

Designed Phenomena

(Feedback)

Page 8: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Beyond Entertainment Industry Preoccupations

CENS Research

Pervasive Interfaces

Internal Phenomena

(Prioproception)

Page 9: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Beyond Entertainment Industry Preoccupations

CENS Research

Pervasive Interfaces

Scale

Page 10: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Beyond Entertainment Industry Preoccupations

CENS Research

Pervasive Interfaces

Rhythm

Behind the Bars (Nicaragua/Panama, 1999)

Page 11: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Beyond Entertainment Industry Preoccupations

Pervasive Interfaces

to

Rhythm and Scale

of

Observed, Designed,

and Internal Phenomena

Page 12: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Rhythm & Scale

Behind the Bars (Nicaragua/Panama, 1999)

Variations V, Cunningham/Cage/Tudor (1965)Their Day, Design: Josef Svoboda (1959)

Page 13: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Rhythm & Scale

The Social Life of Small Urban Spaces (W. Whyte) One localization sensor

Page 14: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Embedded Networked Devices

Virtual Physical

Page 15: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Embedded Networked Devices

Virtual Physical

Designed

Observed

An external observer, or part of the whole design?

Page 16: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Art & Entertainment

Sets

Sets

Architecture

Architecture

Existing media

Controlled Lighting & Sound

Internet traffic

Story structure

Performer

Audience

Bystander

Internet participation

Created media

Crowd

Ambient Lighting & Sound

Movement patterns

Virtual Physical

Designed

Observed

Theme Park

Page 17: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

What conceptual models are needed for artists/designers to express desired

relationships between sensed phenomena and available outputs?

How can research and deployment of ENS systems consider all the purposes of built

environments, including the functional, aesthetic, social, and cultural?

What types of domain knowledge about observed environments available from

artists/designer and most useful in system design?

ENS Research will find itself at this boundary

Virtual Physical

Designed

Observed

What conceptual models most useful for artists/designers to understand sensor network

observations of different phenomena?

Page 18: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Socially Relevant? Yes.

13,5 Million Text MessagesDesigned or Observed?

Page 19: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Socially Relevant? Yes.

How many million online chats?Designed or Observed?

Page 20: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

The Other Direction

CENS Research

Designed Environments

New Aesthetic Experiences

FUNCTIONAL · SOCIAL · AESTHETIC

Page 21: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

OBSERVED + DESIGNED ACTION ENS DESIGNED OUTPUT

CENS Research

ENS as HCI

New Aesthetic Experiences

The Other Direction

Page 22: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

The Other Direction

CENS Research

Media and Control

New Aesthetic Experiences

LOCAL SENSING & DISPLAY · COLLABORATION BETWEEN NETWORKS

Page 23: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

The Other Direction

CENS Research

Sensitivities

New Users

RHYTHM · SCALE · CONTEXT

Page 24: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

The Other Direction

CENS Research

Deployment

New Users

INFRASTRUCTURE INTEGRATION · GUIDED DEPLOYMENT

Page 25: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

The Other Direction

CENS Research

Software

New Users

VISUALIZING · AUTHORING · EVALUATION

Page 26: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

• ENS as pervasive interfaces to rhythm and scale of activity– Observation of what’s encountered– Feedback on what’s designed– Prioproception within systems themselves

• ENS can act as external observer or integral design component– Define quadrants for research along axes of virtual/physical and

designed/observed.– Timely and relevant to communication (mass/local) and new physical

construction.

• Research impacts – Built environments and experiences (and the systems that enable them) have

functional, social and aesthetic considerations– ENS often considered as HCI– Integration with media and control– Sensitivities are different (in both mathematical and non-technical sense)– Deployment requirements are unique to the (sub)domains– Software

Sensors in Art & Entertainment

Page 27: Jeff Burke UCLA School of Theater, Film and Television jeff@hypermedia.ucla.edu Sensor networks in art and entertainment

Jeff BurkeUCLA School of Theater, Film and [email protected]

Sensor networksin art and entertainment