3/16/2008
1
The Exciting Future The Exciting Future
of Computingof Computing
Bill GriswoldBill Griswold
Computer Science and EngineeringComputer Science and Engineering
“The Engineer of the future
will have to think more like
a science fiction writer.”
– Vernor Vinge
2
3/16/2008
2
Nanotech convergence - Bio, Physics, Eng, and IT
2 mm
HP
MemorySpotMems - 1000x
Magnification
2 micron
DNA-Conjugated Microbeads
Nano - 400x
Magnification
IBM Quantum Corral
Iron Atoms on Copper
5 nanometers
400,000 x !
3
Second LifeSecond LifeSecond Life ericrice @ flickr4
3/16/2008
3
http://www.hdb.gov.sg/
Andrei Pungovschi / AP
AE Innovations
Bango
5
Example – location-based reminders
– Had not proven useful in small areas supported by 802.11b
– Investigated importance of ubiquity with Place-its phone app
10-person study revealed phenomena unique to ubiquity
– Slowness and coarseness of positioning not a major shortcoming
– Location used as a proxy for other kinds of context, e.g., not busy
– Ubiquity: “Since I was out of town, I would think of things on the
drive that I had to do when I got back and I'd put reminders on
the phone.”
– Distinctiveness: “There are certain activities that my calendaring
app is not particularly good at reminding me about. Especially …
when I’m not near a computer.... [examples are] grocery
shopping, and also when I’m leaving work I’m on my way out,
done for the day, not liable to be checking email.”
– Calm: “It was a relief knowing I would've been reminded....”6
Why Ubiquity? Context Awareness?
store
home
Arriving Arriving
Home:Home:
Call MomCall Mom
3/16/2008
4
Realizing proactive ubiquitous computingHow can we make ubiquitous context awareness work with commodity devices?
Detect proximity reliably
Convey proximity unobtrusively
Short personal sound clip and vibration
Novel vibration encoding algorithms:
- downsamping 44 kHz sounds to 50 Hz
running sum of energies
- 50Hz patterns � binary actuations
think µMorse code7
My Towers Your Towers
AB
C
D
E
PeopleTones -Play a person’s
unique sound
when they
become nearby
F
8
“One time at the library, I wanted to eat with someone and so I went
outside to call someone. The phone vibrated. I just called the person to
meet up.”
“When I was going to Bob’s birthday, I knew who was there when I
pulled up because of the ring tones.”
“Whenever I drive to school I found out where Alice works because I
always get her alert when I’m driving on Miramar. Oh, so she works
around here?”
“I thought it was so neat every time it would ring. It made me really
happy. Oh! They’re right here, or oh! They’re right there.”
“It was cool to see who was home by the time I got home. I could tell if
Melissa was home when I passed by Clairemont…. Oh she’s home, so let’s
call her and see if she wants to eat.”
3/16/2008
5
Escaping the palm top
9
Sousveillance Grid – Jenik, Collins, et al.
10
RealityFlythrough - ubiquitous videoConcept of remote live exploration
– Live video streamed by anyone from anywhere to
anywhere, but not just surveillance monitor view
– Multiple cameras viewing the same scene, stitched
together into a single immersive coherent view
RealityFlythrough makes this possible
3/16/2008
6
11
RealityFlythrough system architecture
802.11H323 Video
Conferencing
Stream
RFT MCU(Multipoint Control Unit)
RFT Engine(OpenGL + extensions)
Cameras
ImageCapture SensorCapture
StreamCombine
(352x288 video
resolution)
RFT Server
RealityFlythroughsystem abstractions for robust ubiquitous video
12
System projects image
from recorded location
and orientation onto
opposite wall
User “walks” between live cameras,
animated via transition
RFT applies number of techniques to
supercharge human’s “closure” process:
motion, fill-in, cross-fade, video freeze
3/16/2008
7
- personal enviro-sensing
• Typical city has just a few air
quality sensors
• Miniaturization, packaging,
and integration make
personal sensing possible
• Squirrel transmits photo
stream with sensor meta-data
• Visualization makes photos
grainier as air quality degrades
Spanhake, Greco, Kimball, et al. (Calit2)
13
Guided waveoptics
Aqueous bio/ chem sensors
Fluidic circuit
Free spaceoptics
Physicalsensors
Gas/chemicalsensors
Electronics (communication, power)
Ivan Schuller holding the first prototype in 2004
I. K. Schuller, A. Kummel, M. Sailor, W. Trogler, Y-H Lo (Physics & Calit2)Integrated nanosensors for ubicomp
Developing Multiple Nanosensors on a Single Chip
Integrated with Local Processing and Wireless Communications
20
06
14
3/16/2008
8
1
5
Future of Education is Inquiry
Capstone
Design
Classes
Faculty-directed
Research Projects
TIES ENG 100L (e.g., DigiNurse)
CSE 118
UbiComp
ActiveCampus
Calit2 internships
COSMOS
UP
Summer
Programs
Ubiquitous Computing(embodied virtuality)
Calm
Invisible
Commodity
Democratic
Networked
Multi-scale
Multimodal
Tangible
Web 2.0
Failure as a
normal mode of
operation
Beautiful
Mobile
Wireless
Mobile 2.0
Personal
Social
Context-awareMiniaturized
and convergent
16
Virtural Reality
3/16/2008
9
Acknowledgments and ThanksCompanies, agencies, and institutes…
Microsoft Research, Hewlett Packard, Motorola Research, Intel Research Seattle
National Library of Medicine, Calit2, CRA
Students and Faculty…
Tim Sohn, Kevin Li, Neil McCurdy, Roshni Malani, Gunny Lee, Steve Brown, Barry Demchak, Tammy Denning, Michelle Wilkerson, David Lindquist, Michael Kelly
Beth Simon, Les Lenert, Jim Hollan, Adriene Jenik, Larry Smarr
Yahoo! and you…
including my many former students who came today (and got me back to reading science fiction)
17
RealityFlythroughsystem abstractions for robust ubiquitous video
Limited bandwidth “in the wild”
1st person video yields little compression
Jumpy, blurry, lossy, very low fps video
Lower frame rate (to 1 fps)
Raise frame quality
Guarantee delivery
Apply RFT transition technique to
animate between frames 19