1
Influence of camera distortions on satellite image registration and change detection application François Ayoub (1) , Sébastien Leprince (1) , Renaud Binet (2) , Kevin. W. Lewis (1) , Oded Aharonson (1) , and Jean-Philippe Avouac (1) (1) California Institute of Technology, Pasadena, CA 91125, USA Email: [email protected] (2) Commissariat à l'Energie Atomique, 91297 Arpajon, France Inputs: Raw images Orbits, platform attitude, camera model Digital Elevation Model Orthorectification Images must superimpose accurately Correlation Outputs: N/S offset field E/W offset field SNR Displacement in rows and columns provide the E/W and N/S components of the surface dynamics The Signal to Noise Ratio represents the measure quality. P r e - e v e n t I m a g e P o s t - e v e n t I m a g e Sub-pixel Correlation The COSI-Corr Flow Chart QUESTION: What are the major sources of limitation for applications requiring high geometric accuracy ? CONCLUSION: Unrecorded satellite jitter and uncertainties on the CCD arrays geometry appear to be the major limiting factors for applications requiring high accuracy ABSTRACT: Applications such as change detection and digital elevation model extraction from optical images require a rigorous modeling of the acquisition geometry. We show that the unrecorded satellite jitter during image acquisition, and the uncertainties on the CCD arrays geometry are the current major limiting factors for applications requiring high accuracy. These artifacts are identified and quantified on several optical satellites, i.e., SPOT, ASTER, Quickbird, and HiRISE. 116°30'W 116°20'W 116°10'W 116°0'W 115°50'W 34°20'N 34°30'N 34°40'N 0 10 20 5 Km -3.0 m +3.0 East-West component of two disparity fields measured from subpixel correlation of a reference 5-m SPOT 5 image and a 10-m SPOT 4 image near Hector Mine, California. Top: the camera geometry provided by SPOT Image Corp. was accounted for. Linear artifacts from SPOT 4 CCD misalignments are identifiable with amplitude greater than 1m. Bottom: the disparity field was generated using the same images but the SPOT 4 CCD arrays misalignments were calibrated according to [1]. Correlation analysis were performed with COSI-Corr on 32x32 pixels window, sliding with a step of 8 pixels. [1] S. Leprince, P. Musé, and J. P. Avouac, “In-flight ccd distortion calibration for pushbroom satellites based on subpixel correlation,” 2007, submitted. SPOT 4 -2 -1 0 1 -2 -1 0 1 -2 0 2 4 -2 0 2 4 CCD distortions in pixels Atittude distortions in pixels Fault discontituity CCD discontinuity 5 km Disparity field in the direction orthogonal to the epipolar direction between two Quickbird images acquired above the city of Bam, Iran, on September 30, 2003, and on January 03, 2004. Images were resampled at a 50 cm resolution and subpixel correlation was performed on 128x128 pixels windows, sliding with a step of 64 pixels. The goal of this study was to detect and to measure the ground rupture produced during the Mw6.6 Bam earthquake of December 26, 2003. In this geometry, the fault rupture is measured to be less than 2 pixels (less than 1 m), but accurate measurements are difficult due to the bias imposed by distortions from the imaging system such as CCD interconnection discontinuity and jitter artifacts. In particular, a CCD distortion seems to exactly coincide with the coseismic signal to be measured. White areas are decorrelation areas, mostly produced by the collapse of buildings during the earthquake. Quickbird 116°40'W 116°30'W 116°20'W 116°10'W 34°20'N 34°30'N 34°40'N 0 10 20 5 Km -10 -5 0 5 Roll variations (m) -15 m +15 Main fault rupture East/west component of the disparity field measured between a SPOT 4 and an ASTER images, acquired on May 10, 2000, and on August 17, 1998 over the Hector Mine area, California. Images were orthorectified on a 10 m resolution UTM projection, and subpixel correlation was performed with COSI-Corr on 32x32 pixels windows, sliding with a step of 8 pixels. The SPOT 4 image was corrected for CCD arrays misalignments as shown in the SPOT 4 figure. The goal of this study was to detect and measure the ground rupture produced during the 1999, Mw 7.1, Hector Mine earthquake. The fault rupture is identifiable but accurate measurements are difficult due to the oscillating bias induced by the unmodeled jitter of the ASTER spacecraft during the image acquisition. ASTER 150 m 0 2 -2 0 2 -2 1 2 3 4 0 5 6 7 8 9 1 3 4 0 5 6 7 8 9 2 -2 -3 -4 -2 -3 -4 -4 3 pixels 1 km pixels pixels Along-track component of the disparity field measured between two 25-cm HiRISE images. The images reconstruction, in the focal plane, accounted for the radiometry, camera geometry, spacecraft attitudes and ephemerides. Topography was not accounted for, but the identical viewing angles remove any stereoscopic effect. Subpixel correlation was performed with COSI-Corr on 64x64 pixels windows, sliding with a step of 16 pixels. The black stripe is due to missing data in one image, and the decorrelation area right of the black stripe is caused by large areas covered with fine material that appear featureless at the correlation window size. Strong artifacts are found in the column and line directions. Crosstrack artifacts (red profile averaged in line direction over the red box) reveal unmodeled spacecraft jitter, while along- track artifacts (blue profile averaged in column direction over the blue box) are produced by a probable combination of CCD arrays misalignment and unmodeled jitter on staggered CCD arrays. The CCD arrays’ relative position of the two images are sketched above and below the disparity field. Shaded DEM generated from HiRISE imagery near Columbia Hills with ISIS3 and BAE SOCET-SET softwares. Residual CCD misalignments generate artifacts in the DEM with an amplitude of around 1 m. HiRISE Co-Registration of Optically Sensed Images and Correlation (COSI-Corr) [1], allows for precise orthorectification, coregistration, and correlation of optical images. The software package is available at: http://www.tectonics.caltech.edu/slip_history/spot_coseis. [1] S. Leprince, S. Barbot, F. Ayoub, and J. P. Avouac, “Automatic and precise ortho-rectification, co- registration and sub-pixel correlation of Satellite images, application to ground deformation measurements,” IEEE Trans. Geosci. Remote Sens., vol. 45, pp. 1529–1558, 2007.

Influence of camera distortions on satellite image ...€¦ · Influence of camera distortions on satellite image registration and change detection application François Ayoub(1),

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Influence of camera distortions on satellite image ...€¦ · Influence of camera distortions on satellite image registration and change detection application François Ayoub(1),

Influence of camera distortions on satellite image registration and change detection applicationFrançois Ayoub(1), Sébastien Leprince(1), Renaud Binet(2), Kevin. W. Lewis(1), Oded Aharonson(1), and Jean-Philippe Avouac(1)

(1) California Institute of Technology, Pasadena, CA 91125, USAEmail: [email protected]

(2) Commissariat à l'Energie Atomique, 91297 Arpajon, France

Inputs:Raw images

Orbits, platform attitude, camera modelDigital Elevation Model

OrthorectificationImages must superimpose accurately

Correlation

Outputs:

N/S offset field E/W offset field SNR

Displacement in rows and

columns provide the

E/W and N/S components of

the surface dynamics

The Signal to Noise Ratio represents

the measure quality.

Pre-event

Image

Post-event

Image

Sub-pixelCorrelation

The COSI-Corr Flow Chart

QUESTION:What are the major sources of limitation for

applications requiring high geometric accuracy ?

CONCLUSION:Unrecorded satellite jitter and

uncertainties on the CCD arrays geometry appear to be the major limiting factors for

applications requiring high accuracy

ABSTRACT: Applications such as change detection and digital elevation model extraction from optical images require a rigorous modeling of the acquisition geometry. We show

that the unrecorded satellite jitter during image acquisition, and the uncertainties on the CCD arrays geometry are the current major limiting factors for applications requiring high

accuracy. These artifacts are identified and quantified on several optical satellites, i.e., SPOT, ASTER, Quickbird, and HiRISE.

116°30'W 116°20'W 116°10'W 116°0'W 115°50'W

34°2

0'N

34°3

0'N

34°4

0'N

0 10 205Km

-3.0 m +3.0

East-West component of two disparity fields measured from subpixel correlation of a reference 5-m SPOT 5 image and a 10-m SPOT 4 image near Hector Mine, California.Top: the camera geometry provided by SPOT Image Corp. was accounted for. Linear artifacts from SPOT 4 CCD misalignments are identifiable with amplitude greater than 1m. Bottom: the disparity field was generated using the same images but the SPOT 4 CCD arrays misalignments were calibrated according to [1]. Correlation analysis were performed with COSI-Corr on 32x32 pixels window, sliding with a step of 8 pixels.

[1] S. Leprince, P. Musé, and J. P. Avouac, “In-flight ccd distortion calibration for pushbroom satellites based on subpixel correlation,” 2007, submitted.

SPOT 4

-2

-1

0

1

-2

-1

0

1

-2

024

-2

024

CC

D d

isto

rtion

s in

pix

els

Atittude distortionsin pixels

Faultdiscontituity

CCDdiscontinuity

5 km

Disparity field in the direction orthogonal to the epipolar direction between two Quickbird images acquired above the city of Bam, Iran, on September 30, 2003, and on January 03, 2004. Images were resampled at a 50 cm resolution and subpixel correlation was performed on 128x128 pixels windows, sliding with a step of 64 pixels. The goal of this study was to detect and to measure the ground rupture produced during the Mw6.6 Bam earthquake of December 26, 2003. In this geometry, the fault rupture is measured to be less than 2 pixels (less than 1 m), but accurate measurements are difficult due to the bias imposed by distortions from the imaging system such as CCD interconnection discontinuity and jitter artifacts. In particular, a CCD distortion seems to exactly coincide with the coseismic signal to be measured. White areas are decorrelation areas, mostly produced by the collapse of buildings during the earthquake.

Quickbird

116°40'W 116°30'W 116°20'W 116°10'W

34°2

0'N

34°3

0'N

34°4

0'N

0 10 205Km-1

0-5

0

5

Roll variations (m)

-15 m +15

Mainfault

rupture

East/west component of the disparity field measured between a SPOT 4 and an ASTER images, acquired on May 10, 2000, and on August 17, 1998 over the Hector Mine area, California. Images were orthorectified on a 10 m resolution UTM projection, and subpixel correlation was performed with COSI-Corr on 32x32 pixels windows, sliding with a step of 8 pixels. The SPOT 4 image was corrected for CCD arrays misalignments as shown in the SPOT 4 figure. The goal of this study was to detect and measure the ground rupture produced during the 1999, Mw 7.1, Hector Mine earthquake. The fault rupture is identifiable but accurate measurements are difficult due to the oscillating bias induced by the unmodeled jitter of the ASTER spacecraft during the image acquisition.

ASTER

150 m

0

2

-2

0

2

-2

12

340

56

78

9

1 340

56

78

92

-2-3-4

-2-3-4

-43

pix

els

1 km

pix

els

pixels

Along-track component of the disparity field measured between two 25-cm HiRISE images. The images reconstruction, in the focal plane, accounted for the radiometry, camera geometry, spacecraft attitudes and ephemerides. Topography was not accounted for, but the identical viewing angles remove any stereoscopic effect. Subpixel correlation was performed with COSI-Corr on 64x64 pixels windows, sliding with a step of 16 pixels. The black stripe is due to missing data in one image, and the decorrelation area right of the black stripe is caused by large areas covered with fine material that appear featureless at the correlation window size. Strong artifacts are found in the column and line directions. Crosstrack artifacts (red profile averaged in line direction over the red box) reveal unmodeled spacecraft jitter, while along-track artifacts (blue profile averaged in column direction over the blue box) are produced by a probable combination of CCD arrays misalignment and unmodeled jitter on staggered CCD arrays. The CCD arrays’ relative position of the two images are sketched above and below the disparity field.

Shaded DEM generated from HiRISE imagery near Columbia Hills with

ISIS3 and BAE SOCET-SET softwares. Residual CCD misalignments

generate artifacts in the DEM with an amplitude of around 1 m.

HiRISE

Co-Registration of Optically Sensed Images and Correlation (COSI-Corr) [1], allows for precise orthorectification, coregistration, and correlation of optical images. The software package is available at: http://www.tectonics.caltech.edu/slip_history/spot_coseis.

[1] S. Leprince, S. Barbot, F. Ayoub, and J. P. Avouac, “Automatic and precise ortho-rectification, co-registration and sub-pixel correlation of Satellite images, application to ground deformation

measurements,” IEEE Trans. Geosci. Remote Sens., vol. 45, pp. 1529–1558, 2007.