8/27/09

1

ComputerScienceandEngineering‐UniversityofNotreDame

HistoryandVisions

UbiquitousCompuEng

•  “Themostprofoundtechnologiesarethosethatdisappear.Theyweavethemselvesintothefabricofeverydaylifeun:ltheyareindis:nguishablefromit.”,MarkWeiser1991

ComputerScienceandEngineering‐UniversityofNotreDame

XeroxPARC:Tab

•  PARCTAB(or“tab”)•  TouchsensiEvepanel(usewithfingerorstylus),with128x64

resoluEon,canflipforle]‐handuse

•  3bu_ons,speaker(differenttones)•  Infrared(19.2kbaud)•  LocalizaEonusing“room‐sizedcommunicaEoncells”

•  12MHzIntel8051microcontroller•  Canoperatefor10mins/hour,8hours

perday,1weekbeforerecharging

ComputerScienceandEngineering‐UniversityofNotreDame

8/27/09

2

XeroxPARC:Pad

ComputerScienceandEngineering‐UniversityofNotreDame

•  Pad(Tablet),prototypepencomputer(9x11x1”)

•  4hourba_erylife•  5lbs•  Motorola683xxprocessorw/4MBRAM

•  PCMCIA•  PARPenw/built‐inmicrophone•  640x480display•  Infrared

XeroxPARC:Board

•  BulleEnboards,whiteboards,flipcharts,bookcase,…

•  40”by60”,1024x768•  Wirelesselectronic“chalk”

ComputerScienceandEngineering‐UniversityofNotreDame

•  OlivehResearch,RoyWant

•  WorkerscouldautomaEcallyunlockareastowhichtheyhadbeengrantedaccess

•  Phonecallsroutedtowherevertheyare•  CreaterunningdiariesofmeeEngs•  Couldbetracked(Oliveh’spublicwebsiteallowedvisitors,atonepoint,tofindlocaEonofemployee)

ComputerScienceandEngineering‐UniversityofNotreDame

AcEveBadge

8/27/09

3

AcEveBadge

ComputerScienceandEngineering‐UniversityofNotreDame

AcEveBadge

•  IdenEty+RoomlevellocaEon+Bu_on

•  RelaEvely“simple”technologyledtolotsofapplicaEons–  Dooropensonlytorightbadgewearer(BillGates’house)–  Roomsgreetpeoplebyname

–  TelephonecallsautomaEcallyforwarded–  Computerterminalcanquicklypullyoursehngsfrom“homecomputer”(“teleporEng”)

–  AutomaEcdiary

ComputerScienceandEngineering‐UniversityofNotreDame

PredicEons

•  Displays(h_p://www.americhip.com/)

•  CPUspeeds•  Storage•  OS•  MigraEonofscreencontent•  Networks

ComputerScienceandEngineering‐UniversityofNotreDame

8/27/09

4

TheSalStory

•  “Coffee?”–  Coffeemachineonlyknows“Yes”and“No”–  Nootherspeechinputdevicesnearby,orcanignore–  Coffeemachineknowsifithascoffeegroundsinside

•  “Sheseeselectronictrailsthathavebeenkeptforherofneighborscomingandgoing”– Windowhassomecomputervision– WindowcanalsodisplayinformaEon

TheSalStory

•  “Shecanseethat[herkids]gotup15and20minutesago”–  Noplausibledeniabilityforkidsanymore!

–  Possiblysensorsinbed,microphonesinbedrooms,orlocaEontracking

•  “Shewipesherpenoverthenewspaper’sname,date,secEonandpagenumberandthencirclesthequote.Thepensendsamessagetothepaper,whichtransmitsthequotetoheroffice”–  Howdoesthepenknowwhotosendto?

TheSalStory

•  “[Sal]canpressacodeintotheopenerandthemissingmanualwillfinditself”–  Thesedayswouldprobablybewebbased

•  “ShespotsaslowdownaheadandalsonoEcesonasidestreetthetelltalegreenintheforeviewofafoodshop”–  AdverEser‐basedhardware?Installthisand10%offprice?–  Orsomehowconfigureit?Configurelotsofdevices?

8/27/09

5

TheSalStory

•  “Salglancesoutherwindows:agraydayinSiliconValley…meanwhileithasbeenaquietmorningattheEastCoastoffice”

TheSalStory

•  “ThetelltalebythedoorthatSalprogrammedherfirstdayonthejobisblinking:freshcoffee”–  End‐userprogramming,howtodothisinubicomp?

–  CoffeeseemstobepopularinSiliconValley

TheSalStory

•  “SalpicksupatabandwavesittoherfriendJoe”–  Havetobecarefulofaccidentaldatasharing!–  Howdoesitknowwhattoshare?–  HowtodifferenEateifmulEplepeoplethere?

•  “ThetwohavegiveneachotheraccesstotheirlocaEondetectorsandtoeachother’sscreencontentsandlocaEon”–  Howtoeasilyconfigure?– Wouldco‐workersfindthisacceptable?SocialconvenEons?–  Forgehngtoremovepermissions?

8/27/09

6

TheSalStory

•  “AblanktabonSal’sdeskbeepsanddisplaystheword“Joe”…Joewantstodiscussadocumentwithher,andnowitshowsuponthewall”–  ThesedayswouldprobablybeiniEatedviaIM–  Easytosharedataandtalkreal‐Eme

What’sMissing?

•  Web–  NoEcenomenEonoftheInternet,wasn’tobviousatEme– Makesthepaperfeelali_ledated

–  Subtledifferenceinvision:originalubicompaboutembeddedchipsineverything,webaboutinformaEonanywhereanyEme,webservicesaboutmassscale

•  Socialsciences–  Privacy–  ReallycompellingapplicaEons

What’sMissing?

•  DolaptopssEllhaveafutureinubicomp?–  Lotsofdevicesandsomehowyourdatagetstothem–  LaptopssEllcentral,butcaneasilysharedata

•  Howdocellphonesfitintotheubicomppicture?

8/27/09

7

FamousQuote

•  ThereismoreinformaEonavailableatourfingerEpsduringawalkinthewoodsthaninanycomputersystem,yetpeoplefindawalkamongtreesrelaxingandcomputersfrustraEng.

•  Machinesthatfitthehumanenvironmentinsteadofforcinghumanstoentertheirswillmakeusingacomputerasrefreshingastakingawalkinthewoods

•  Vingeiswell‐knownsci‐fiwriter–  Storysetinyear2020–  Hastobeplausiblevisionoffuture

•  Combineslotsoftechideas:–  Virtualreality–  Digitallibraries–  Ubicomp

•  Wearablecomputers•  Wireless•  Sensornets•  User‐machineinterfaces

SyntheEcSerendipity

WewillreachapointwherethecombinaEonofpowerfulprocessors,limitlessdata‐storagecapacity,ubiquitoussensornetworks,anddeeplyembeddeduserinterfaceswillcreateabondbetweenhumanandmachine“soinEmatethatusersmayreasonablybeconsideredsuperhumanlyintelligent.”‐VernorVinge

AnotherVisionofUbicomp

8/27/09

8

•  SomeinteresEngpoints–  HowGoogle,eBay,FedExusedinfuture–  Notrealcyborgs,butclosetoit

•  Real‐EmeGoogle

•  Silentmessaging

–  InformaEonoverlaysontopofrealworld•  Pipes,navarrows,onlinegamesinworld

SyntheEcSerendipity

•  Willwearablecomputersactuallytakeoff?–  Howtodoinput?Howtoavoidaccidentalinput?–  Nonvisualoutput?Orheadsupdisplays?

SyntheEcSerendipity

h_p://ldt.stanford.edu/~jeepark/jeepark+porxolio/cs147hw8jeepark.html

•  WillitbehardertodifferenEate“reality”?–  Livein“reality”oraworldwecreated?–  AMatrixofourownmaking?WorldofWarcra]addicEon?

•  Howtomakecost‐effecEve?–  Sensornetsnotcheap– Wearablecomputersnotcheap,plusrechargingneeds–  Simplethingswecandofirst?

SyntheEcSerendipity

8/27/09

9

Ubiquitous/PervasiveCompuEng

•  Distributedsystems

•  MobilecompuEng•  EffecEveuseofsmartspaces(light/heatcontrolinroom)

•  Invisibility(minimaluserdistracEon)•  Localizedscalability(scalablebutconstrainttolocal…)•  MaskingunevencondiEoning(willtakelongEmebeforeuniformpenetraEon,“mask”dumbnessofenvironments,e.g.,devicecompensatesforlackofwirelessconnecEvity)

ComputerScienceandEngineering‐UniversityofNotreDame

EvoluEonofPervasiveCompuEng

ComputerScienceandEngineering‐UniversityofNotreDame

PervasiveCompuEng

•  Duringoneofhistalks,WeiseroutlinedasetofprinciplesdescribingpervasivecompuEng(alsocalledubiquitouscompuEng):–  Thepurposeofacomputeristohelpyoudosomethingelse.

–  Thebestcomputerisaquiet,invisibleservant.

–  ThemoreyoucandobyintuiEonthesmarteryouare;thecomputershouldextendyourunconscious.

–  Technologyshouldcreatecalm.

•  Calmtechnology–  “Atechnologythatwhichinformsbutdoesn'tdemandourfocusor

a>en:on”.(DesigningCalmTechnology,WeiserandJohnSeeleyBrown)

ComputerScienceandEngineering‐UniversityofNotreDame

8/27/09

10

Invisibility

•  OnedoesnotneedtoconEnuallyraEonalizeone'suseofapervasivecompuEngsystem.

•  Havinglearntaboutitsusesufficientlywell,oneceasestobeawareofit.

•  Itis"literallyvisible,effecEvelyinvisible"inthesamewaythataskilledcarpenterengagedinhisworkmightuseahammerwithoutconsciouslyplanningeachswing.

•  Similarly,whenyoulookatastreetsign,youabsorbitsinformaEonwithoutconsciouslyperformingtheactofreading.

ComputerScienceandEngineering‐UniversityofNotreDame

CommonTerminology

•  UbiquitousCompuEng•  PervasiveCompuEng•  CalmTechnology•  InternetofThings•  Thingsthatthink•  Everyware•  PervasiveInternet•  AmbientIntelligence•  ProacEveCompuEng•  AugmentedReality

ComputerScienceandEngineering‐UniversityofNotreDame

RelatedAreas

•  SensorNetworks•  MobileCompuEng•  WirelessNetworks•  EmbeddedSystems/Control

•  Human‐computerInteracEon•  ArEficialIntelligence•  AutonomicCompuEng

ComputerScienceandEngineering‐UniversityofNotreDame

8/27/09

11

•  ManypowerfulinsEtuEonsvestedinitscoming

•  EnormousmarketpossibiliEes•  We’realreadythere•  LocaEon‐basedservicesandapps•  Trackingcellphones•  Greatchallengeforus,welikesolvingriddles•  Whowillbemostaffected?Nontechnical,nonspecialist,ordinaryciEzens;won’tevenrealizeit’sthere(wewillknow)

ComputerScienceandEngineering‐UniversityofNotreDame

WillItCome?