2121stst Century Learning Century Learning

P. AnandanP. AnandanManaging DirectorManaging DirectorMicrosoft Research IndiaMicrosoft Research Indiahttp://http://www.research.microsoft.comwww.research.microsoft.com

1-12-2005 2

Challenges in Teaching and Challenges in Teaching and CollaborationCollaboration

Amplify the voice of the teacherAmplify the voice of the teacher Extend and expand the reach of the teacher Extend and expand the reach of the teacher

and the classroomand the classroom

Enhance the learning experienceEnhance the learning experience Seamless interaction between teacher, Seamless interaction between teacher,

students, and learning materialsstudents, and learning materials

Strengthen teamworkStrengthen teamwork Bring the meeting homeBring the meeting home

1-12-2005 3

Technology: Good or Bad?

1-12-2005 4

…A little better?

1-12-2005 5

How about this?

Classroom on your lap

1-12-2005 6

TechnologiesTechnologies

Conference XPConference XP Tablet PC as a medium for teaching and Tablet PC as a medium for teaching and

learninglearning Real-time collaboration and whiteboard Real-time collaboration and whiteboard

capturecapture

Conference XPConference XP

Courtesy: Chris Moffat, MSRCourtesy: Chris Moffat, MSR

1-12-2005 8

Conference XPConference XP

A high-end conferencing system for:A high-end conferencing system for: CollaborationCollaboration Distance LearningDistance Learning

Inexpensive and easy to deployInexpensive and easy to deploy Done in partnership with several US Done in partnership with several US

universitiesuniversities Supports advanced interactive learning Supports advanced interactive learning

(using TabletPC)(using TabletPC)

1-12-2005 9

ConferenceXP Research PlatformConferenceXP Research Platform

High-quality, multi-point conferencing High-quality, multi-point conferencing A framework for the development of real-time A framework for the development of real-time

collaborative applications for teaching and learningcollaborative applications for teaching and learning

1-12-2005 11

Research CollaborationResearch Collaboration

High-quality, High-quality, multipoint multipoint conferencingconferencing

Full-screenFull-screenreal-time videoreal-time videoat 30 fpsat 30 fps

Up to 10-way Up to 10-way conferencing on conferencing on dual processor, dual processor, 3.0 GHz 3.0 GHz workstationworkstation

1-12-2005 12

Real-time CollaborationReal-time Collaboration

Built-in Built-in presentation presentation capabilitycapability

Peer-to-peer Peer-to-peer multicast multicast architecturearchitecture

Simple approach Simple approach to adding 3to adding 3rdrd party party applications applications

1-12-2005 13

Real-time CollaborationReal-time CollaborationSome Some ConferenceXP DeploymentsConferenceXP Deployments

Connected to Internet2Connected to Internet2 Evaluation and/or DevelopmentEvaluation and/or Development

Argonne National Lab Argonne National Lab Brown UniversityBrown UniversityCarnegie Mellon Carnegie Mellon Cornell Theory Center Cornell Theory Center Galway College – IrelandGalway College – IrelandInternet2Internet2NCSA NCSA University of Texas at AustinUniversity of Texas at AustinUC BerkeleyUC BerkeleyUC DavisUC DavisUC San DiegoUC San DiegoUC Santa CruzUC Santa CruzUniversity of Illinois at Urbana-ChampaignUniversity of Illinois at Urbana-ChampaignUniversity of MassachusettsUniversity of MassachusettsUniversity of WashingtonUniversity of Washington

East Carolina University East Carolina University Indiana UniversityIndiana UniversityIndian Institute of Technology - IndiaIndian Institute of Technology - IndiaIowa State UniversityIowa State UniversityMITMITNational Technological University – National Technological University – Argentina Argentina NorthWestern UniversityNorthWestern UniversityPenn State UniversityPenn State UniversitySingapore Management UniversitySingapore Management UniversityUniversity of Milano – Italy University of Milano – Italy University of Pisa – Italy University of Pisa – Italy University of Salerno – Italy University of Salerno – Italy University of Zurich – SwitzerlandUniversity of Zurich – SwitzerlandVirginia Tech Virginia Tech

1-12-2005 14

Distributed LearningDistributed Learning

1-12-2005 15

University of WashingtonUniversity of WashingtonProfessional Masters Program (Computer Sciences)Professional Masters Program (Computer Sciences)

1-12-2005 16

Distributed Learning Case StudyDistributed Learning Case Study

1-12-2005 19

Wireless ClassroomsWireless ClassroomsClassroom Presenter (University of Washington)Classroom Presenter (University of Washington)

Tablet PC–based classroom presentation systemTablet PC–based classroom presentation system Deployed widely at University of Washington and other Deployed widely at University of Washington and other

schoolsschools

http://cs.washington.edu/education/dl/presenter/

Integration withIntegration withstudent devices:student devices: Note taking (OneNote,Note taking (OneNote,

ReMarkableTexts)ReMarkableTexts) Classroom feedbackClassroom feedback Student submissionsStudent submissions

1-12-2005 20

Wireless ClassroomsWireless ClassroomsOneNote IntegrationOneNote Integration

1-12-2005 21

Wireless ClassroomsWireless ClassroomsEngaging Learning EnvironmentsEngaging Learning Environments

Collaborative Labs — Amherst Math Visualization — Brown

Design Sketching — MIT Physics Illustrator — MIT, MS

Enhanced Meeting ExperienceEnhanced Meeting Experience

1-12-2005 23

We all attend meetings/classes …We all attend meetings/classes …

ComplaintsComplaints A class may be distributed (location-shifted)A class may be distributed (location-shifted)

Cannot hear other people clearly from a remote siteCannot hear other people clearly from a remote site Cannot see who is in a remote site Cannot see who is in a remote site Cannot see what is written on the whiteboardCannot see what is written on the whiteboard Feel partially disconnected when I am remoteFeel partially disconnected when I am remote

When watch a recorded class (time-shifted)When watch a recorded class (time-shifted) Can only view the meeting in a linear wayCan only view the meeting in a linear way No clue about the meeting dynamicsNo clue about the meeting dynamics

Develop MM technologies and systems to alleviate the Develop MM technologies and systems to alleviate the painspains Allow time-shifted participationAllow time-shifted participation

Off-line viewingOff-line viewing Allow location-shifted participationAllow location-shifted participation

1-12-2005 24

Real-Time Room ConferencingReal-Time Room Conferencing(Eric Rudolph, Yong Rui, Liwei He, Rico Malvar, Michael Cohen, Ivan Tashev)(Eric Rudolph, Yong Rui, Liwei He, Rico Malvar, Michael Cohen, Ivan Tashev)

Key featuresKey features High fidelity audio (via microphone array)High fidelity audio (via microphone array) High quality video (via wide-angle cam, dewarping)High quality video (via wide-angle cam, dewarping) Live physical whiteboard captureLive physical whiteboard capture Physical document capture and sharingPhysical document capture and sharing

1-12-2005 25

1-12-2005 26

Real-time Whiteboard CaptureReal-time Whiteboard Capture(Liwei He, Zhengyou Zhang)(Liwei He, Zhengyou Zhang)

Goal: turn a video stream of whiteboard into a low bit rate data stream that contains only the changes on the whiteboard.

Solution: use computer vision techniques to analyze the video sequence to determine which changes represent inks on the whiteboard.

Cell based motion detection

Lighting change

Color enhancement Encode

Background color model

No

Yes Reset

Update

New strokes

0100010011

Strokes & background

Cell classification

Incoming frame

1-12-2005 27

1-12-2005 28

ConclusionConclusion

Technology can go beyond being a toolTechnology can go beyond being a tool It can change the experienceIt can change the experience

Enable new scenariosEnable new scenarios Enhance the quality of the experienceEnhance the quality of the experience Extend the reach of the teacherExtend the reach of the teacher

It can revolutionize the way learning is It can revolutionize the way learning is donedone

1-12-2005 29

A Vision For the FutureA Vision For the Future