48
Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University of Virginia June 20, 2012

Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

Embed Size (px)

Citation preview

Page 1: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

Smart Blueprints: Automatically Generated Maps of Homes

and the Devices Within Them

Jiakang Lu and Kamin WhitehouseDepartment of Computer Science

University of Virginia

June 20, 2012

Page 2: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

“Snap In” Smart Home

2

Motion

Temperature

Light

Page 3: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

33

72°F

72°F71°F70°F69°F

“Snap In” Smart Home

Page 4: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

4

Motion #1

Temperature #1

Light Switch #1

Motion #2

Sunlight Sensor #1

Light Switch #2

72°F

Page 5: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

5

72°F

69°F

Page 6: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

6

“Mark and Call” ($2.99 iPhone app store)

[5] Harle, et al

Image from [4] Schindler, et al

Related Work

Page 7: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

7

72°F

69°F

Smart BlueprintsInfer floor plan from the app’s sensor data

• No specialized deployment tools or process• Only minor modifications to sensor design

Page 8: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

Outline

• Sensor Design• Topological Constraints• Search• Evaluation

8

Page 9: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

MotionDoor TemperatureMagnetometer

Page 10: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University
Page 11: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

1111

Page 12: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

Outline

• Sensor Design• Topological Constraints• Search• Evaluation

12

Page 13: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

1313

Page 14: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

14

Page 15: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

1515

Page 16: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

1616

Page 17: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

17

Page 18: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

18

EW

Page 19: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

19

EW

Page 20: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

20

N

S

Page 21: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

21

N

S

Page 22: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

22

Page 23: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

23

N

Page 24: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

24

Page 25: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

Outline

• Sensor Design• Topological Constraints• Search• Evaluation

25

Page 26: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

26

Page 27: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

27

Page 28: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

28

Page 29: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

29

Page 30: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

30

Page 31: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

31

Page 32: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

32

Page 33: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

33

Demo

Page 34: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

Outline

• Sensor Design• Topological Constraints• Search• Evaluation

34

Page 35: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

35

A. B.

C. D.

Page 36: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

36

Page 37: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

37

Page 38: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

38

Downloaded Floor Plans

12.2 average

Page 39: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

Limitations

• Failed on 1 out of 4 homes• 1 week to converge• Only evaluated light, motion, mag’r sensors• How many sensors required?• Restricted floor plan encoding

39

43

12

12

3

1 2

43

Page 40: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

Conclusions

• Simple sensors are enough to infer layout– Floor plan– Sensor locations

• Requires small modifications to sensor design– Physical pairing– Mounting strategies

• One step towards a “Snap In” smart home40

Page 41: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

41

Questions?

(See the demo next!)

Page 42: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

42

Backup Slides

Page 43: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

43

Page 44: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

44

Page 45: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

45

Correlation =

𝐴𝐵

Page 46: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

46

Page 47: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

47

Page 48: Smart Blueprints: Automatically Generated Maps of Homes and the Devices Within Them Jiakang Lu and Kamin Whitehouse Department of Computer Science University

“Snap-In” Smart Home

4848

72°F

72°F

69°F

72°F

70°F

71°F

71°F