®
Sponsored by
Guiding Blind People in Indoor Space Guiding Blind People in Indoor Space - A Use-Case of IndoorGML- A Use-Case of IndoorGML
95th OGC Technical Committee
Boulder, Colorado USA
Ki-Joune Li
2 June 2015
OGC®
Movie- Her(2013)
2
OGC®
MotivationsMotivations
• Services for visual impaired people.– The services are mostly limited in outdoor space.
Navigation Map Services for Indoor Space
3
OGC®
ContentsContents
– Requirements– Key Design– Data Model– Implementation– Conclusion
4
OGC®
RequirementsRequirements
– Indoor positioning (<30cm)• So far, no Indoor positioning method provides such a high accuracy
• Braille Block as an alternative
– Voice-Oriented Indoor map for navigation– Guide for the visual impaired people– No extra-devices except smartphone– Interoperability and Standards
5
OGC®
Key Design IssuesKey Design Issues
– Braille block for Assisting Indoor Positioning– Movement Patterns of Blind People
• Separation of Stopping and Movement• Straight walking (not walking in curve)
– Landmark Information– Using Smartphone with Voice-based UI– Using IndoorGML as International Standard
6
OGC®
Braille block Braille block for Assisting Indoor Positioningfor Assisting Indoor Positioning
Dot Block
Stripe Block
7
OGC®
Movement Patterns of Blind PeopleMovement Patterns of Blind People
n1 n2
n3
n1 n2
n3
n2
2e1
e2
e11
e12
e22e21
ege e1 is split to e11 and e12
edge e2 is split to e21 and e22
node n2 is split to n21 and n22 n2
1
new edge e3 and e4 are added
e4
e3
8
OGC®
Landmark InformationLandmark Information
n1
n3
n2
2
n2
1
e32
e31
e12 : - B is on your left, - A is on your right, and - C is on your left over the destination
B
A
C
D
(Case 1) : left side on the path(Case 2) : right side on the path(Case 3) : left side over the path(Case 4) : right side over the path(Case
2)
(Case 1)
(Case 1)
(Case 2)
(Case 3)
(Case 4)
(Case 2)
(Case 1)
9
OGC®
Using Smartphone with Voice-based UIUsing Smartphone with Voice-based UI
TextToSpeech
10
OGC®
Using IndoorGML as international Using IndoorGML as international standardstandard
<<Feature>>IndoorCore::SpaceLayer
<<Feature>>IndoorCore::Transition
<<Feature>>IndoorCore::State
<<Feature>>IndoorCore::MultiSpaceLayer
<<Feature>>IndoorCore::InterLayerConnection
0..*
2
connects
2
interConnects
0..* edges
nodes
0..*
1..*
spaceLayers
interEdges 0..*
11
OGC®
Data ModelData Model
– Data model for VIM– Phase of making VIM network– Sample case constructing network
12
OGC®
Data Model for VIMData Model for VIM
<<Feature>>IndoorCore::State
<<Feature>>IndoorCore::Transition
connects
2
Starting Node
Ending Node
0..*
0..*<<Feature>>
VIMNavi::Node0..*
<<Feature>>VIMNavi::Landmark
<<Feature>>VIMNavi::Edge
- Navigation Instruction- Landmark Instruction
0..*
0..*Landmark Topology
<<Enumeration>>Landmark Topology - onLeft - onRight - overLeft - overRight
Located At
1..1
1..*
connects
IndoorGML
VIM
- Topology
13
OGC®
VIM Part
Topographic IndoorGML Layer
Phase of Making VIM NetworkPhase of Making VIM Network
s1 s2s3
s11
s12 s21
s2
2
s`4
n1
n2
n3
n4
n5
n6
n7
n8
IndoorGML Network
Network of considering route of the Visually Impaired
Navigation LayerFor the Visually Impaired
Subspacing
Separating
instructions
Add Landmark Information n9
Braille Block IndoorGML Part Layer
14
OGC®
Sample CaseSample Case
15
OGC®
Network of considering route Network of considering route of the Visually Impairedof the Visually Impaired
s1
s2
s4
s5
s5
s6
v2 v3
v4
v5v1v8 v9
v7
v10
v6 v11
16
OGC®
v2 v3
v4
v5v1v8 v9
v7
v1
0
v6
v1
1
Network of considering route Network of considering route of the Visually Impairedof the Visually Impaired
17
OGC®
v
2
v
3
v
5
v
1
v
8
v
9
v
7
v
10
v
6
v
11
n
1
n
2
Stair Up/Down
n
3
Recognize Stair/Enter braille block
n
4
n
6n
5
v
4
n
7
Navigation Layer For the Visually Impaired
- Separating Instructions
18
OGC®
v5
v8
v9
v7
v1
0
v6
v1
1
n1
n2
n3
n4
n6
n5
n7
n8
n9
n1
0
n1
1
n1
2
n1
3
n1
4
n1
5
n1
6
n1
6
Navigation Layer For the Visually Impaired
- Separating Instructions
19
OGC®
n1
n2
n3
n4
n6
n5
n7
n8
n9
n1
0
n1
1
n1
2
n1
3
n1
4
n1
5
n1
6
n1
6
Navigation Layer For the Visually Impaired- Add Landmark
20
OGC®
ImplementationImplementation
– Operation Flow– Test environment– Video
21
OGC®
Sample of user-interfaceSample of user-interface
22
OGC®
Cheong-gu subway station Seoul
Test environmentTest environment
AB
Find a path from A to B
23
OGC®
Implementing videoImplementing video
24
OGC®
– Indoor navigation using braille block networks– Voice-based instruction by Smartphone Accessibility function– Data Model extended from IndoorGML Core Module– A very beginning prototype
Summary Summary
25