1CITRIS 2010

New Media Research

Profs. Ken Goldberg and Greg NiemeyerProfs. Ken Goldberg and Greg NiemeyerCITRIS at UC BerkeleyCITRIS at UC BerkeleyProf. Marilyn WalkerProf. Marilyn WalkerCITRIS at UCSCCITRIS at UCSCMaurizio ForteMaurizio ForteCITRIS at UC MercedCITRIS at UC Merced

California is the Mecca of new media“The world spends over 110 billion minutes per month on social networks and blog sites.” - NielsenWire, June 2010

3CITRIS 2010

OutlineOverview of CITRIS New Media ResearchOverview of CITRIS New Media ResearchCase StudiesCase Studies

Game-Based Learning for Health Game-Based Learning for Health ApplicationsApplications

Tele-Immersion and ArchaeologyTele-Immersion and ArchaeologyCrowdsourcing Insights and InnovationCrowdsourcing Insights and Innovation

Research PartnersResearch PartnersNext Ten YearsNext Ten Years

4CITRIS 2010

What is a medium?

CITRIS 20105

6CITRIS 2010

7CITRIS 2010

8CITRIS 2010

9CITRIS 2010

10CITRIS 2010

11CITRIS 2010

12CITRIS 2010

14CITRIS 2010

15CITRIS 2010

16CITRIS 2010

17CITRIS 2010

Mission: To critically analyze and shape developments in new media from cross-disciplinary and global perspectives that emphasize humanities and the public interest.

CITRIS 2010 18

machine learning and social interaction (ryokai)

CITRIS 2010 19

phenomenology and second life (dreyfus)

CITRIS 2010 20

trust and video conferencing (canny)

21CITRIS 2010

donation dashboard (goldberg)

22CITRIS 2010

23CITRIS 2010

The New Media Research Roundtable

A bi-weekly series for faculty and graduate students to discuss current research in new media with emphasis on identifying new collaborative research opportunities among participants and presenters.

CITRIS 2010 24

Public Events:

•ATC Lecture Series•Design Futures Lecture Series•Continuous Bodies Symposium•Rip.Mix.Burn. Art Exhibit•ParaSite Symposium•Out of Time-Space•Embodiment and New Media•Conversation on Digital Film•Artist Appropriation Rights•Attention Literacy

CITRIS 2010 25

BCNM Research Lab and Reading Room4th Floor

26CITRIS 2010

Game-Based Learning for Health Applications

Prof. Marilyn WalkerProf. Marilyn WalkerCITRIS at UCSCCITRIS at UCSCProf. Greg NiemeyerProf. Greg NiemeyerCITRIS at UC BerkeleyCITRIS at UC Berkeley

CITRIS 2010 27

Spy Feet: Using mobile gaming to promote physical activity in girls

Research on preventive health has shown that despite various interventions, physical activity declines precipitously in adolescents, especially in girls – leading to obesity, diabetes and cardiovascular problems.

Novel interventions for motivating teenagers to exercise would thus help address a national health problem.

The interest of youth in computer games and in smart phone applications suggests that mobile computer games aimed at increasing physical activity could providing compelling contexts for transforming health-related behaviors in young people

CITRIS 2010 28

UCSC SpyFeet CITRIS Team

Marilyn Walker Research: Adaptive Algorithms,

Dynamic Dialogue Management, Expressive Generation

Noah Wardrip-Fruin Research: Playable Media, Game

Design

Sri Kurniawan Research: Assistive Technologies

and Human Computer Interaction

32

29CITRIS 2010

New Media: RPG’s + Dynamic Dialogue Generation

33

When a scheming mad scientist starts taking over drivers in the player's hometown, it's up to them to solve an ever-deepening mystery. As a budding Nature Warden, players learn to use their secret abilities to speak with animal spirits, uncovering a previously invisible world where ants are foot soldiers and beetles sing opera. Players will go on a series of journeys through familiar streets now alive with animals to befriend, missions to accomplish, and mysteries to unlock. The non-linear dynamically configured story and dialogue generation gives players the freedom to investigate only the characters or story elements that interest them.

CITRIS 2010 30

Research Questions

Technical: Hypotheses: Dynamic elements will increase

motivation to play, replayability, and immersion

SpyGen: A new generation engine to support dynamic adaptive dialogue generation for characters in role playing games

Grail GM: a new role playing game manager that supports dynamic reconfiguration of quests to allow user choices to matter

Societal: What types of motivational elements can

influence behavior change? What is the role of social interaction vs.

narrative world?

CITRIS 2010 31

SpyGen

35

CITRIS 2010 32

Grail GM + Informant Story Manager

36

CITRIS 2010 33

Summary

Societal Will be ready to test with users in November Experiment with role of technical elements in motivating

behavior change

Technical Android Platform very re-usable Dynamic, easily reconfigurable architecture Spy Gen 1.0 Grail GM 2.0

37

37CITRIS 2010

Track FX: A study about game-based learning and therapeutic intervention

• Initial study with Typicals age 28 to 60 months at Child Study Center

• Game played on Tablet PCs.• Data collection on online database.• Four types of players seen in data  (cf. Bartle,

Richard): Learners, Novelty Seekers, Explorers, Competitors

• MOT skills accelerate at 36 months (cf. Lantern Mind)• TrackFX is outcome measure for Minocycline study• Game Type: Intervention and Outcome Measure

Learner

40CITRIS 2010

RuleMaker: Abstraction and Memorization

• Initial study with typicals age 8 to 11 years at MIND institute (Rivera, Langer)

• Game played on web page via Flash• Data collection to an online database• Study: What regions of the brain store abstract

concepts, and what regions store explicit memorization? 

• Game type: research game providing researchers with deep interaction data. 

41CITRIS 2010

42CITRIS 2010

Neuropolis: A game design for neuroscience awareness

• Intended audience is anyone who has a reason to find out how the brain works. 

• Client: MNI. • Data collection on online database.• No player data collected yet, but future versions will

collect deep data. • Game type: Awareness game (The Brain: a playable

owners' manual)

43CITRIS 2010

Pokerwalk: A health game promoting urban awareness

• Intended audience is anyone who wants to understad pedestrian circulation in a city 

• Client: ArtPrize Grand Rapids. • Data collection on online database.• Collected data produces circulation maps• Game type: awareness game (city, health)

44CITRIS 2010

Playable Links:

• Web-based: o Rulemaker: www.rulemaker.orgo TrackFX: www.trackfx.org• Thanks to CITRIS for connecting support, space,

doctors and game designers.• Thanks to Townsend Center for summer interns. 

45CITRIS 2010

The CITRIS Promise: Multi-Campus Interdisciplinarity

• Presentation of "Balance Game" at UC Davis Tele-Immersion conference

• Seed funding for Multi-Campus pilot project• Close collaborations with Drs. Randi Hagerman,

Susan Rivera and Faraz Farzin now include Fragile X game (TrackFX) and RuleMaker

• Collaboration led to international joint venture with the Montreal Neuroscience Institute, Neuropolis.

46CITRIS 2010

Cyber-ArchaeologyVirtual Environments and New Media

Maurizio ForteMaurizio ForteCITRIS at UC MercedCITRIS at UC MercedRuzena BajcsyRuzena BajcsyCITRIS at UC BerkeleyCITRIS at UC Berkeley

Reconstructing the Material Past

The reconstruction of the past, in terms of cultural material, is one of the biggest challenges for contemporary societies.

The link of archaeology and digital technologies is fundamental for revisiting, interpreting and communicating the past

One of the bottlenecks in archaeology is the difficulty to contextualize and share data, models, archives, metadata in a collaborative way.

47

What kind of information can we transmit to the future generations? How do we preserve the knowledge of the past?How can we communicate this knowledge in the Digital Era?

ARCHAEO-PEDIA 3D: A POSSIBLE FUTURE COLLABORATIVE NETWORK ACROSS UC CAMPUSES

Outcomes and Perspectives

The prototypal virtual collaborative work open very challenging perspectives in other research and educational areas in and out the UC system. Ideas > 3D learning, Virtual Classes, Museum Studies, CRM,

Visual Art, Image Processing, Environmental Simulation, Environmental Monitoring, Virtual Labs, 3D Modeling, 3D Publications, Teleimmersive Networks

We are well positioned for the next ten yearsMigration and preservation of 3D digital archives and datasetsSimulation studies, Networking, Collaborative inter-campus

Scenarios, Intelligent Distribution of Digital Resources, Advanced Cognitive Impacts

49

Results of the Prototype Platform (UC Merced, UC Berkeley, UC Davis)

• Two users in the shared virtual space (rendering with applied texture mapping)

• User immersed in the virtual environment

The Cyber Map

Is the 3D modeling sufficient to show and explain the tomb iconographic complexity?

Virtual Reconstruction of a Chinese tomb at Xi’an (Virtual Collaborative System)

CITRIS 2010 52

The Powerwall at UC MercedCollaborative VR. M.Kalmann, M.Forte

CITRIS 2010 53

UCM Students at the Powerwall

Current and Future Partners

NEH

NSF

Trimble Navigation

Nextengine

Erdas

Avie Systems

UNESCO

54

55CITRIS 2010

Social Media for Crowdsourcing Social Media for Crowdsourcing Innovation and InsightsInnovation and Insights

Profs. Ken GoldbergProfs. Ken GoldbergCITRIS at UC BerkeleyCITRIS at UC Berkeley

The challenge: too much of a good thing

20 sec. per comment X 35,387 comments

= 8 days

57CITRIS 2010

Goals

For Organizations Understand the diversity of their community

Engage their community Solicit feedback and creative suggestions Rapidly identify patterns, insightful ideas

For Community Members Understand relationships with other

community members

Engage with a diversity of viewpoints and ideas

Express ideas, and be heard hybrid vigor

Our Approach

1. Visualization 2. Level Playing Field

3. Wisdom of Crowds 4. Game Structure

Opinion Space

Step 1: Enter your opinions and response

Step 2: Visualize your position

Step 3: Read and rate others users

63CITRIS 2010

March-Oct 2010

4,963 Users94 Countries

24,815 Opinions

CITRIS 2010 64

Interpreting Eigenvectors

Direction and magnitude of motion in PCA-space as slider value changes for each individual proposition.

65CITRIS 2010

Research Team:David Wong: EECS MS StudentEphrat Bitton: IEOR PhD StudentSiamak Faridani: IEOR PhD StudentElizabeth Goodman: School of Information PhDStudentTavi Nathanson: EECS Graduate StudentAlex Sydell: EECS Undergraduate StudentSanjay Krishnan: EECS Undergraduate Student

Ken Goldberg: IEOR, EECS, iSchoolGail de Kosnik: Theater, Dance, Performance StudiesKimiko Ryokai: School of InformationMeghan Laslocky: Outside Consultant on ContentAri Wallach: Outside Consultant on Content and StrategySteve Weber: Outside Consultant on ContentPeter Feaver: Outside Consultant on Content

U.S. State Department:Alec Ross: Senior Advisor for InnovationKatie Dowd: New Media Director

Partners thus far

"Opinion Space will harness the power of connection technologies to provide a unique forum for international dialogue. This is ... an opportunity to extend our engagement beyond the halls of government directly to the people of the world."

- Secretary of State Hillary Clinton

67CITRIS 2010

New Media ResearchNext 10 Years…

Profs. Ken Goldberg and Greg NiemeyerProfs. Ken Goldberg and Greg NiemeyerCITRIS at UC BerkeleyCITRIS at UC BerkeleyProf. Marilyn WalkerProf. Marilyn WalkerCITRIS at UCSCCITRIS at UCSCMaurizio ForteMaurizio ForteCITRIS at UC MercedCITRIS at UC Merced

68CITRIS 2010

Were the objectives and goals described in the original CITRIS proposal met by our research?

Absolutely! Our goals have been exceeded but there is exciting work ahead for the next 10 years!:

69CITRIS 2010

70CITRIS 2010

71CITRIS 2010

72CITRIS 2010

Thank you.