A Smartphone-Based System for In-House Safety Using Augmented Reality Technology

Unit for Liveable Cities, Graduate School of Engineering/Medicine, KYOTO UNIVERSITY

京都⼤学⼤学院⼯学研究科・医学研究科安寧の都市ユニット

A SMARTPHONE-BASED SYSTEM FOR IN-HOUSE SAFETY

USING AUGMENTED REALITY TECHNOLOGY

Maki KOYAMA (Kyoto Univ.)Naoto YOKOMAKURA (KDDI)Shigeyuki OKADA (Hokkaido Univ.)Tadayoshi NAKASHIMA (Hokkaido Univ.)Junji KIYONO (Kyoto Univ.)

The 5th Conference of the International Society for Integrated Disaster Risk Management(IDRiM 2014), 30th Oct - 1st Nov, London, CANADA 1



Introduction

The major cause of casualties in a large earthquake in Japan is overturned furniture or the scattering of facilities in a room.

Therefore, moving and fastening furniture are effective for casualty mitigation. However, the executing rate of these countermeasures is not really very high.

One of the reasons is that residents are not aware of the risk of human casualty in their rooms. One of the other reasons is that residents can not fasten furniture because of lease contract or facilities’ material in their room.

The purpose of this study is to develop a smartphone-based human casualty risk evaluation and visualization tool.

2



Augmented Reality (AR)

Marker-based AR is a technology used to acquire spatial information from camera images.

Markers are registered in advance. When a computer recognizes the registered marker by using a

camera, the marker’s spatial coordinates and angle information are calculated.

3



Flowchart of the system

Input size Coordination

acquisition by AR marker

Input furniture’s type

Input overturning type

Calculation of overturning probability

Overlay the furniture on the real

time movie

Input seismic intensity

Generating overturning/scattering

area

Evaluation severity of human casualty

Coordination acquisition by AR

marker

Overlay the risk information on the real‐time movie

Calculation of human casualty severity in selected area

Input size

Overlay the area on the real‐time movie

4



Movie of the developed system5



System Development

Unity (Unity Technology) is used to develop our system.

Unity is a tool for video-game development, architectural visualizations, and interactive media installations.

Usually, the creation of a 3D model and the calculation of the spatial coordinates are complicated; however, we can do that easily by using Unity.

In this study, a Desire HD (HTC Corporation), which is an Android-based smartphone, is used as a prototype system.

6



Evaluation of overturn risk

· Φ 0.7 /0.869 / (1)

where is probability of overturned furniture for the seismic intensity , α is the coefficient of friction between the floor and the furniture (α is fixed to 0.8), and Φ represents the standard normal distribution function. The parameters λ and ζ (ζ is fixed to 0.58) are the mean and standard deviation, respectively. λ is expressed in the following equation:

/ · · 1 / 10 / · 1 / . · 2

(2)

15.6/ · 1 / . (3)

where and are depth and height of the furniture, respectively. is the acceleration due to gravity, and is the equivalent frequency response floor [Hz] ( is fixed 3.18). Fb is the number of boundary vibrations of the furniture [Hz].

7

Nakashima, Okada and Koyama (2012)



Evaluation of human casualty severity

The human casualty severity in the target area is evaluated as follows:

∑ ⋅ (4)

where is the human casualty severity, is number of pieces of furniture in an affected target area, and is the Abbreviated Injury Scale value of the ith piece of furniture.

indicates whether the target area is affected by the ith piece of furniture or not. In the case of “affected,” = 1; otherwise, = 0.

8



Abbreviated Injury Scale (AIS)

Furniture condition AIS

Vase Overturned 1.5Glass case Overturned 1.5Television Overturned 1.5Family Buddhist altar (small)

Overturned 1.5

Full-length mirror Overturned 2Shoe boxes Overturned or Overturned and scattered 3Washing machine Overturned 3Writing bureau Overturned or Overturned and scattered 3.5Bunk bed Overturned 3.5Bookshelf Overturned or Overturned and scattered 4Family Buddhist altar (large) Overturned or Overturned and scattered 4Sideboard Overturned or Overturned and scattered 4Refrigerator Overturned or Overturned and scattered 4Chest of drawers Overturned or Overturned and scattered 4

9




Risk area by overturning or scattering10




Conclusion

This system can display overlapping images of a real-time movie from an attached camera, the overturning risk area, and the human casualty severity.

The system visualizes a virtual image of the in-room conditions due to an earthquake before it occurs.

It is expected that users will become aware of the importance of moving and fastening furniture and which furniture should be the first priority to move or fasten by using this system.

11



12

[email protected]

Software

A Smartphone-Based System for In-House Safety Using Augmented Reality Technology