1
Crowdsourced Geocaching for Indoor Maps Reconstruction Marius Noreikis Aalto University Espoo, Finland marius.noreikis@aalto. Yu Xiao Aalto University Espoo, Finland yu.xiao@aalto. 1 MOTIVATION Indoor mapping is an emerging application in Visual Crowdsourc- ing (VCS). It is utilized to construct indoor oor plans [5] and enable indoor positioning services [1]. However, VCS based mapping is labour intensive, as visual data has to be collected from all around the venue. To mitigate the problem, incentive mechanisms were proposed such as rewarding payments and reverse auctions [2], however they may incur notable costs for large data collection. In our work, we propose to utilize Geocaching [4] as an incentive to aid collection of VCS data for building indoor maps. In Geo- caching, mobile users hide virtual treasures in arbitrary locations, which can later be discovered by other service users. Geocaching typically requires no monetary payments to engage users in the activity. Currently, most Geocaching services rely only on Global Positioning System (GPS). In our work, we extend the range for hiding geocaches to also include indoor areas. We utilize tech- niques from our previous work [3] to build indoor maps and enable accurate image based positioning services. 2 SYSTEM DESIGN e main goal of our work is to eciently collect VCS data for map reconstruction in an unknown indoor venue (building), thus we propose a system that implements a following scenario. A rst user, Alice, enters a building and goes to an arbitrary location, where she wants to hide a virtual treasure (geocache). She then shoots a 360° video around, in an area which has enough visual features. We then store the cache location and build an indoor map from the feature-full video. Alice gains additional virtual points if she hides a treasure in an unmapped area - an area where no visual data was collected yet. In this way we encourage users to collect data in undiscovered places. In order to get an approximate location where Alice hid the treasure, we utilize dead reconing using the last known accurate location (either GPS or image based) as an initial anchor. An another user, Bob, gets a notication that a geocache is hidden in a building. He enters a building and uses an augmented reality based guidance to locate the treasure (Fig. 1b). Note, that at this point we only approximately guide Bob, since a full area model is not yet available. While he is walking, the application collects photos and builds an area map until the map connects to the piece of map created by Alice. At this point Bob receives the treasure and an indoor map coverage is increased (Fig. 1c). e process of hiding and nding geocaches continues, until the venue map is fully built. We build our system utilizing a client-server architecture (see Figure 1a). e server side is responsible for storing treasure loca- tions, building maps from input images and analyzing coverage of the already built maps. We utilize Structure-from-Motion (SfM) to build indoor maps from 360° videos and input images. SfM is robust in building large scale maps, though not suitable for real time map (a) System design (b) User be- ing guided to a treasure location (c) Example scenario. Green area indicates already mapped building, white area indicates unmapped ar- eas, blue area shows a treasure location and map cov- erage from the 360° video, red area shows treasure seeker’s path and an area mapped on the way. generation. erefore we propose to utilize Simultaneous Localiza- tion and Mapping (SLAM) toolkits 1 that provide accurate enough tracking for a short period of time, to track positions of treasure seekers. Once the geocache is found, we run SfM to build a robust and accurate map from all the collected images while searching for and hiding the geocaches. We plan to conduct a user study to prove that it is feasible to adapt geocaching as an engaging incentive to collect crowdsourced images required to build complete indoor maps. We further intend to compare our approach with other incentive mechanisms and state-of-the-art indoor mapping systems. REFERENCES [1] Jiang Dong, Yu Xiao, Marius Noreikis, Zhonghong Ou, and Ani Yl ¨ a-J¨ a¨ aski. 2015. imoon: Using smartphones for image-based indoor navigation. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems. ACM, 85–97. [2] Bin Guo, Qi Han, Huihui Chen, Longfei Shangguan, Zimu Zhou, and Zhiwen Yu. 2017. e Emergence of Visual Crowdsensing: Challenges and Opportunities. IEEE Communications Surveys & Tutorials 19, 4 (2017), 2526–2543. [3] Marius Noreikis, Yu Xiao, and Ani Yl ¨ a-J¨ a¨ aski. 2017. SeeNav: Seamless and Energy-Ecient Indoor Navigation Using Augmented Reality. In Proceedings of the on ematic Workshops of ACM Multimedia 2017 (ematic Workshops ’17). ACM, New York, NY, USA, 186–193. DOI:hps://doi.org/10.1145/3126686. 3126733 [4] Kenton O’Hara. 2008. Understanding geocaching practices and motivations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1177–1186. [5] Han Xu, Zheng Yang, Zimu Zhou, Longfei Shangguan, Ke Yi, and Yunhao Liu. 2016. Indoor localization via multi-modal sensing on smartphones. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 208–219. 1 hps://developers.google.com/ar/

Crowdsourced Geocaching for Indoor Maps …...state-of-the-art indoor mapping systems. REFERENCES [1] JiangDong, YuXiao, MariusNoreikis, ZhonghongOu, andAn−iYl¨a-J a¨aski.2015

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Crowdsourced Geocaching for Indoor Maps …...state-of-the-art indoor mapping systems. REFERENCES [1] JiangDong, YuXiao, MariusNoreikis, ZhonghongOu, andAn−iYl¨a-J a¨aski.2015

Crowdsourced Geocaching for Indoor Maps ReconstructionMarius NoreikisAalto UniversityEspoo, Finland

marius.noreikis@aalto.�

Yu XiaoAalto UniversityEspoo, Finlandyu.xiao@aalto.�

1 MOTIVATIONIndoor mapping is an emerging application in Visual Crowdsourc-ing (VCS). It is utilized to construct indoor �oor plans [5] and enableindoor positioning services [1]. However, VCS based mapping islabour intensive, as visual data has to be collected from all aroundthe venue. To mitigate the problem, incentive mechanisms wereproposed such as rewarding payments and reverse auctions [2],however they may incur notable costs for large data collection.

In our work, we propose to utilize Geocaching [4] as an incentiveto aid collection of VCS data for building indoor maps. In Geo-caching, mobile users hide virtual treasures in arbitrary locations,which can later be discovered by other service users. Geocachingtypically requires no monetary payments to engage users in theactivity. Currently, most Geocaching services rely only on GlobalPositioning System (GPS). In our work, we extend the range forhiding geocaches to also include indoor areas. We utilize tech-niques from our previous work [3] to build indoor maps and enableaccurate image based positioning services.

2 SYSTEM DESIGN�e main goal of our work is to e�ciently collect VCS data for mapreconstruction in an unknown indoor venue (building), thus wepropose a system that implements a following scenario. A �rst user,Alice, enters a building and goes to an arbitrary location, whereshe wants to hide a virtual treasure (geocache). She then shootsa 360° video around, in an area which has enough visual features.We then store the cache location and build an indoor map fromthe feature-full video. Alice gains additional virtual points if shehides a treasure in an unmapped area - an area where no visual datawas collected yet. In this way we encourage users to collect datain undiscovered places. In order to get an approximate locationwhere Alice hid the treasure, we utilize dead reconing using the lastknown accurate location (either GPS or image based) as an initialanchor. An another user, Bob, gets a noti�cation that a geocache ishidden in a building. He enters a building and uses an augmentedreality based guidance to locate the treasure (Fig. 1b). Note, that atthis point we only approximately guide Bob, since a full area modelis not yet available. While he is walking, the application collectsphotos and builds an area map until the map connects to the pieceof map created by Alice. At this point Bob receives the treasure andan indoor map coverage is increased (Fig. 1c). �e process of hidingand �nding geocaches continues, until the venue map is fully built.

We build our system utilizing a client-server architecture (seeFigure 1a). �e server side is responsible for storing treasure loca-tions, building maps from input images and analyzing coverage ofthe already built maps. We utilize Structure-from-Motion (SfM) tobuild indoor maps from 360° videos and input images. SfM is robustin building large scale maps, though not suitable for real time map

(a) System design

(b) User be-ing guidedto a treasurelocation

(c) Example scenario. Green area indicates alreadymapped building, white area indicates unmapped ar-eas, blue area shows a treasure location andmap cov-erage from the 360° video, red area shows treasureseeker’s path and an area mapped on the way.

generation. �erefore we propose to utilize Simultaneous Localiza-tion and Mapping (SLAM) toolkits1 that provide accurate enoughtracking for a short period of time, to track positions of treasureseekers. Once the geocache is found, we run SfM to build a robustand accurate map from all the collected images while searching forand hiding the geocaches.

We plan to conduct a user study to prove that it is feasible toadapt geocaching as an engaging incentive to collect crowdsourcedimages required to build complete indoor maps. We further intendto compare our approach with other incentive mechanisms andstate-of-the-art indoor mapping systems.

REFERENCES[1] Jiang Dong, Yu Xiao, Marius Noreikis, Zhonghong Ou, and An�i Yla-Jaaski. 2015.

imoon: Using smartphones for image-based indoor navigation. In Proceedings ofthe 13th ACM Conference on Embedded Networked Sensor Systems. ACM, 85–97.

[2] Bin Guo, Qi Han, Huihui Chen, Longfei Shangguan, Zimu Zhou, and Zhiwen Yu.2017. �e Emergence of Visual Crowdsensing: Challenges and Opportunities.IEEE Communications Surveys & Tutorials 19, 4 (2017), 2526–2543.

[3] Marius Noreikis, Yu Xiao, and An�i Yla-Jaaski. 2017. SeeNav: Seamless andEnergy-E�cient Indoor Navigation Using Augmented Reality. In Proceedingsof the on �ematic Workshops of ACM Multimedia 2017 (�ematic Workshops’17). ACM, New York, NY, USA, 186–193. DOI:h�ps://doi.org/10.1145/3126686.3126733

[4] Kenton O’Hara. 2008. Understanding geocaching practices and motivations. InProceedings of the SIGCHI Conference on Human Factors in Computing Systems.ACM, 1177–1186.

[5] Han Xu, Zheng Yang, Zimu Zhou, Longfei Shangguan, Ke Yi, and Yunhao Liu.2016. Indoor localization via multi-modal sensing on smartphones. In Proceedingsof the 2016 ACM International Joint Conference on Pervasive and UbiquitousComputing. ACM, 208–219.

1h�ps://developers.google.com/ar/