32
Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, Philippe Giguère and François Pomerleau 12th FSR conference, Tokyo, 2019

Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Large-scale 3D Mapping of Subarctic Forests

Philippe Babin, Philippe Dandurand, Vladimír Kubelka, Philippe Giguère and François Pomerleau

12th FSR conference, Tokyo, 2019

Page 2: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Subarctic Boreal Forest: Research Opportunity

2/27

Page 3: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Our approachNaive approach

3/27

Page 4: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Applications

4/27

Page 5: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Local WildlifeSnow Fall Path obstacles Uneven Path

Challenge of Field Tests

5/27

Page 6: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Mapping of Subarctic Boreal Forest -

Challenges

Unstructured environment → hard to map

Cold temperatures → noisy sensor

Few visual features due to snow → bad for vision based approaches

6/27

Page 7: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Related Work

Williams et al., 2009 Paton et al., 2016

7/27

Page 8: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Contributions

Large-scale mapping of difficult environments

Novel fusion of IMU and GNSS measurement inside of ICP

Generated maps are crisp and without long term drifts

Introduced optimization to scale to large map

8/27

Page 9: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Dataset Environment

4.1 km of forest path

9/27

Page 10: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

10/27

Page 11: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Data Acquisition Platform

GNSS station (RTK)

RS-16 lidar

MTI-30 IMU

10h of battery life

11/27

Page 12: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Iterative Closest Point (ICP)

T ?

12/27

Page 13: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

ICPTinit

T

13/27

Iterative Closest Point (ICP)

Page 14: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Iterative Closest Point (ICP)

14/27

Page 15: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Sensor Fusion

Lidar ICP

IMU

GNSS

SLAM

Lidar

Penalty-ICPIMU

GNSS

mappose

Classical approach Our approach

mappose

Covariance [1]pose

[1] D. Landry, F. Pomerleau, and P. Giguère. CELLO-3D: Estimating the Covariance of ICP in the Real World. In ICRA, 2019

15/27

Point cloud

Pose

Covariance

Pose/Covariance

Legend

Page 16: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Prior ICP with penalty ICP no penalty

Map of lake Dataset

350m

16/27

Page 17: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

ICP with penalty ICP no penalty

17/27

Page 18: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Crispiness

locally consistent

Prior ICP With penalties ICP Without Penalties

18/27

Page 19: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Prior ICP with penalty ICP no penalty

Map of forest Dataset

500m

19/27

Page 20: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Prior ICP with penalty ICP no penalty

Map of forest Dataset

500m

20/27

Page 21: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Map of skidoo Dataset

ICP no penaltyICP with penaltyPrior

670m

21/27

Page 22: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

ICP no penaltyICP with penaltyPrior

670m

22/27

Map of skidoo Dataset

Page 23: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Full Map with Penalty

23/27

Page 24: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Performance improvements

24/27

Page 25: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Future work

25/27

Page 26: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Future work – Project SNOW

26/27

Page 27: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Questions?

27/27

Page 28: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

28

Page 29: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Performance improvements

29/26

Page 30: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Results: effect of penalties

30

Page 31: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Penalty-ICP• Leverage ICP’s minimizer for sensor fusion

• Add penalty term based on GNSS and IMU estimate

• Introduced a point to Gaussian cost function

• Minimize Mahalanobis distance instead of the Euclidian distance

31

Page 32: Large-scale 3D Mapping of Subarctic Forests · Large-scale 3D Mapping of Subarctic Forests Philippe Babin, Philippe Dandurand, Vladimír Kubelka, ... CELLO-3D: Estimating the Covariance

Full Map

32