From Structural Defect to Tree Health: The Use of Remote ... · From Structural Defect to Tree...

Sr Dr WONG Man Sing, Charles

Associate Professor

Department of Land Surveying and Geo-Informatics,

The Hong Kong Polytechnic University

From Structural Defect to Tree Health: The Use of Remote Sensing Technologies to See Through the Urban Forestry

2

Remote Sensing

Hyperspectral

Imaging

Airborne LiDAR

Thermal Imaging

Urban Planning Smart

Sensing

Presentation

Outline

3

Remote Sensing

Vegetation and Habitat Monitoring Using Remote Sensing

4

5

Multi-scale Object-Oriented Segmentation and Classification method (MOOSC) (developed by our research team in 2006)

Level 1Level 2Level 3Level 4

Overview of study area Zoom in

Level 5

6

Vegetation Map from MOOSC

Nichol J.E., Wong M.S. (2008). Photogrammetric Engineering and Remote Sensing, 74(11), 1325-1334.

7

Vegetation / Ecological Study

Image courtesy: the Planning Department of HKSAR

Vegetation areas over non-built up areas

Vegetation areas over the entire territories

Spectral Unmixing Model for Urban Bird Habitat Monitoring

8

Nichol J. E. and Wong M. S. (2007), International Journal ofRemote Sensing, 28(5), 985-1000.

Nichol J. E., Wong M. S., Corlett R. A., Nichol D. W. (2010),Landscape and Urban Planning, 95(1-2), 54-60.

9

Unmixing Model for Urban Bird Habitat

Simulated Bird flying paths

• Route A: birds have preference for denser tree cover over

• Route B: birds which only tolerate dense tree cover

• Route C: birds found where any tree cover is present e.g. 1 -100% tree fraction

• SPOT MLC: simulated with MLC classified image from SPOT (20m)

• IKONOS MLC: simulated with MLC classified images from IKONOS

Route C

Remote Sensing of Phenology Observation & Impact Assessment of a super-typhoon on Hong Kong’s secondary vegetation

10

Remote Sensing of Phenology Observation

Climate-Vegetation Interaction in the Greater Bay Area

11

NDVI dataset spans from 1981 to 2015

Impact Assessment of a super-typhoon on Hong Kong’s secondary vegetation

12

Abbas S., Nichol J. E., Fischer G. A., Wong M. S.*, Irteza S. M. (in press). Agricultural and Forest Meteorology.

a) b) c) d)

Left: 23rd October 2017 (control image); Right: 3rd October 2018 (post-typhoon image)

13

Tree Health Detection Using Remote Sensing Technique

* Supported by the Highways Department of HKSAR

Multispectral Orthophotos

Jan 2017

Pan-sharpened

Jul 2017

Pan-sharpened

Sep 2017

Native

Mar 2018

Native

Mar 2018

Pan-sharpened

14

• Spectral resolution:

• Red

• Green

• Blue

• Near-infra Red

• Camera Specifications:

• UltraCam Eagle Mark 1

• Panchromatic: 20,010 x 13,080 pixels

• Multispectral: 6,670 x 4,360 pixels

• Focal Length: 210.750 mm

Image courtesy: the Lands Department of HKSAR

Machine Learning Approach

15

Vegetation Indices Approach

16

Tree samples

Normalization and outlier removal

24 vegetation indices

calculation

Threshold Determination

Using Distribution Plots

• Vegetation indices are normally higher in summer (Jul 2017, Sep 2017)

• Vegetation indices in winter are consistent from the pan-sharpened image

of Jan 2017 and March 2018 and the native image of March 2018

Index Family 1 Family 2 Family 4 Family 6 Family 7

BDRVI <-0.6 <-0.7 <-0.6

BR <1.1

CI

CIG <1 <1.5 <1.2 <1.5

CVI <1.3 <1.7 <1.8

EVI >0.6

gbNDVI <-0.1 <0.1 <0.1 <0.1

GLIb <0 <0 <0.025

GLIg <0.025 <0.025

GLIr >-0.1 >-0.1

grNDVI <0.2 <0.2

GRVI

N_G >0.2 >0.24 >0.25 >0.24

N_NIR <0.5 <0.6 <0.55

N_R >0.2 >0.16 >0.16

NDGR <0.1 <0.1

NDRGRI >-0.1 >-0.1

NDVI <0.4 <0.4 <0.5 <0.4 <0.5

NDVIg <0.3 <0.45 <0.35 <0.45

NIRG <2.5 <2.7 <2.5

rbNDVI <0.2 <0.2

RGI >0.8 >0.75

RVI <3 <3.5 <4.5

VARIg

17

Yellow = Unhealthy, Green = Healthy

Verification:

Jan 2017 Jul 2017 Sep 2017 Mar 2018(P)

Comments from the Highways Department:

Form 2 record:

20170517 – Healthy tree regarding size, color and density of foliage

20180507 – similar to 05/2017 but a small detected dead branch above the sidewalk notes. Result consistent with change status

Consistent with change status

18Yellow = Unhealthy, Green = Healthy

19

Airborne LiDAR

Basic Tree Data Extraction through LiDAR Technique

* Supported by the Highways Department of HKSAR

20

21

Introduction

• Advantages of LiDAR

• Collect spatially-explicit data

• Finer temporal resolution

• Collect:

• Crown size

• Tree height

• Diameter at Breast Height (DBH)

• Geographic coordinates

22

LiDAR for Tree Survey

23

Airborne LiDAR for Tree Survey

24

Airborne LiDAR for Tree Survey

Number of returns: 5

Nominal point density:

40 points / m2

Average point spacing: 0.2 m

25

Tree Detection

26

Tree Detection

27

Hyperspectral

Imaging

Hyperspectral Imaging for Vegetation Monitoring

* Supported by the Highways Department of HKSAR

28

29

Hyperspectral Vegetative Monitoring

Calibration by Halogen lamp ~ solar light at control environment

30

Data Acquisition Procedures and Field Measurements

31

Typical

Spectral

Plots

32

Mean Canopy Spectral Plots

• Each species shows different plots

• Each species follows different

seasonality based on average

values over canopy

33

Multivariate Regression Tree - Recursive Partitioning

• A recursive partitioning of multivariate

regression tree approach

• A two-stage procedure to build binary

trees

• Stepwise process of

finding the single variable

which best divides the pool

of species

• k-fold cross-validation of

the decision tree

34

AI: Deep Learning Classification

Species 2

0

0

0

0

0

0

1

0

Spectral Cube

One-hot Coding

Input Output

TrainSelect Points

Spectral Images

max

Output Species for each selected points

MajoritySpecies

Inference

35

Smart

Sensing

Jockey Club Smart CityTree Management Project

* Funded by The Hong Kong Jockey Club Charities Trust

36

37

38

IoT wireless sensor

Marked tree

After Typhoon Mangkhut

38

1

3

2

Rotational angle

Tree displacement

Tilting angle

SST Devices

39

SST Network: System Architecture

GIS & Application Server

4G/Optical Fiber

LPWAN SIGNAL Gateway(Private / Public Network)

LPWAN SIGNALCLOUD

Mobile & Tablet

Tree Monitoring & Management Dashboard

40

42

1. High Vehicular Traffic2. High Pedestrian Traffic

43

GIS-based Tree Monitoring System

44

GIS-based Tree Monitoring System

45Thermal Imaging

Detection of Structural Tree Defect Using Thermal Infrared Imaging

* Supported by the Tree Management Office, Greening, Landscape & Tree Management Section, Development Bureau of HKSAR

46

47

Thermal Infrared Image Analysis onboard of Helicopter

Collaborated with the Government Flying Service, HKSAR

•Urban Heat Island √

•Tree ?

Thermal Infrared Assessment

• Thermal infra-red image to

identify the defected areas over

tree trunk and roots

• Structural defect and

corresponding surface

temperature of trees

• Defected area has lower

temperature

(a) True colour image

(b) Raw thermal image of a broadleaf tree48

Data Capture (Artocarpus Hypargyreus with known defect)

49

Thermal Images of Trees with Defects

50

Crateva unilocularis Delonix regia Delonix regiaArtocarpus

hypargyreus

Cinnamomum

camphora

Automatic Structural Defect Detection

51

K-means clusteringSobel

gradient filter ResultTrue colour image Thermal image

Crateva unilocularis

Automatic Structural Defect Detection

52

K-means clustering

Sobel gradient filter Result

True colourimage Thermal image

Delonix regia

Artocarpus hypargyreus

Cinnamomum camphora

Time Series Analysis of Crateva unilocularis

53

Time Series Analysis of Crateva unilocularis

54

Unhealthy part heats up faster in this period

(rate of change of

temperature)

Unhealthy part cools down faster in this

period (rate of change of

temperature)

Results of Tomogram Validation

55

Results of Tomogram Validation

56

57

Urban Planning

Analysis of Urban Green Management

through Remote Sensing and

Geographic Information Systems

58

* Supported by the Planning Department of HKSAR

59

60

61

Yuen W. M. J., …, Wong M. S., et al. (2019), Influence of Urban Green Space and Facility Accessibility on Exercise and Healthy Diet in Hong Kong, International Journal of Environmental Research and Public Health, 16, 1514.

……

On-going Health Related Studies

Sr Dr Wong Man Sing, Charles 黃文聲博士

Email: Lswong@polyu.edu.hk

Tel: 3400-8959

Remote Sensing Laboratory: http://www.lsgi.polyu.edu.hk/rsl/

Research websites: