V SOIL EROSION ESTIMATES AT EUROPEAN S · European scale, because it is very difficult, if not impossible to acquire direct soil erosion measures for large areas. Therefore indirect

VALIDATION OF SOIL EROSION

ESTIMATES AT EUROPEAN SCALE

Anton J J Van Rompaey, Valerie Vieillefont, Robert J A Jones, Luca Montanarella,

Gert Verstraeten, Paolo Bazzoffi, Thomas Dostal, Jozef Krasa, Joris de Vente, Jean Poesen

EUR 20827 EN

EUROPEAN COMMISSIONJOINT RESEARCH CENTRE

2003

This document may be cited as follows:

Van Rompaey, A.J.J., Vieillefont, V., Jones, R.J.A., Montanarella, L., Verstraeten, G, Bazzoffi

P., Dostal, T, Krasa, J, de Vente, J., Poesen, J.. Validation of soil erosion estimates at European scale. European Soil Bureau Research Report No.13, EUR 20827 EN, (2003), 26pp. Office for Official Publications of the European Communities, Luxembourg.

COVER PICTURES TOP LEFT TO BOTTOM RIGHT (CLOCKWISE)

EROSION IN VINEYARDS, TUSCANY, ITALY

RESERVOIR TRAPPING SEDIMENT IN SEGURA, SPAIN (PHOTO JORIS DEVENTE)

EROSION IN ARABLE LAND, VOLTERRA TUSCANY, ITALY

SEVERE GULLY EROSION IN PEDRERA, ALICANTE, SPAIN

Validation of Soil Erosion Estimates at European Scale

VALIDATION OF

THE REGIONAL Anton Van J.J. Rompaey (1,2), Valerie Vieillefont (1,5),

Robert J.A. Jones (1), Luca Montanarella (1), Gert Verstraeten (2), Paolo Bazzoffi (3), Thomas Dostal (4), Jozef Krasa (4),

Joris de Vente (2), Jean Poesen (2)

(1) European Soil Bureau Institute for Environment & Sustainability

JRC Ispra

(2) Physical and Regional Geography K.U.Leuven, Belgium

(3) Ministry of Agriculture and Forestry Policy, Istituto Sperimentale per lo Studio e la Difesa del Suolo

ISSDS ,Firenze, Italy

(4) Department of Irrigation and Land Management, CVUT, Technical University of Prague, Czech Republic

(5) Ecole Nationale des Ingenieurs des Travaux Agricoles

Bordeaux, France

MISSION OF THE JRC The mission of the Institute of Environment and Sustainability is to provide scientific and technical support to EU strategies for the protection of the environment and sustainable development. Employing an integrated approach to the investigation of air, water and soil contaminants, its goals are sustainable management of water resources, protection and maintenance of drinking waters, good functioning of aquatic ecosystems and good ecological quality of surface waters.

LEGAL NOTICE

Neither the European Commission nor any person acting on behalf of the Commission is responsible for

the use, which might be made of the following information.

A great deal of additional information on the European Union is available on the Internet. It can be accessed through the Europa server

(http://europa.eu.int)

EUR 20827 EN

European Communities, 2003 Reproduction is authorised provided the source is acknowledged

Printed in Italy

Table of Contents 1 Summary............................................................................................................................................. 1 2 Introduction ...................................................................................................................................... 2 3 USLE, INRA and PESERA soil erosion estimates................................................ 3

3.1 USLE estimates ..................................................................................................................................... 3 3.2 INRA estimates ..................................................................................................................................... 4 3.3 PESERA estimates ................................................................................................................................ 5

4 Validation methodology ........................................................................................................... 7 5 Available data and results ...................................................................................................... 9

5.1 The Belgian SY-dataset......................................................................................................................... 9 5.2 The Czech SY-dataset ......................................................................................................................... 12 5.3 The Italian SY-dataset ......................................................................................................................... 14 5.4 The Spanish dataset ............................................................................................................................. 16

6. Discussion........................................................................................................................................ 18 7. Conclusions .................................................................................................................................... 19 8. References ....................................................................................................................................... 24

Table of Figures Figure 1: USLE model application for Europe (after Van der Knijff et al., 2000) ____________________ 3 Figure 2: USLE soil erosion estimates (after Van der Knijff et al., 2000)___________________________ 3 Figure 3: INRA model concept____________________________________________________________ 4 Figure 4: INRA soil erosion estimates (after Le Bissonnais et al., 2002) ___________________________ 4 Figure 5: PESERA modelling concept (Gobin and Govers, 2003) ________________________________ 5 Figure 6: PESERA soil erosion estimates ___________________________________________________ 6 Figure 7: Soil erosion estimates for Belgium and location of the validation basins __________________ 10 Figure 8: Predicted versus observed net soil loss in Belgium (in t/ha/yr) __________________________ 11 Figure 9: Soil erosion estimates for the Czech Republic and location of validation basins. ____________ 12 Figure 10: Observed versus predicted net soil loss in the Czech Republic._________________________ 13 Figure 11: Soil erosion estimates for Italy and location of the validation basins.____________________ 14 Figure 12 Observed versus predicted net soil loss in Italy (in t/ha/yr). ____________________________ 15 Figure 13: Soil erosion estimates for Spain and location of the validation basins.___________________ 16 Figure 14: Predicted versus observed net soil loss in Spain (in t/ha/yr). __________________________ 17 Figure 15: Available mean annual rainfall data in Wales (UK)._________________________________ 20 Figure 16: Land cover classification problems.______________________________________________ 21 Figure 17: Observed versus predicted soil losses (in t/ha/yr) in catchments in Italy with more than 50% of the land in arable cultivation. ________________________________________________ 22

Table of Figures Table 1 Overview of soil erosion estimates at European scale ___________________________________ 2 Table 2 Catchments with measured sediment yield at the outlet __________________________________ 7 Table 3 Summary of the validation results__________________________________________________ 18

EUROPEAN SOIL BUREAU RESEARCH REPORT NO. 13

Validation of soil erosion estimates at European scale. Van Rompaey et al. 2003

1

1. Summary The increasing availability of regional scale data layers on climate, topography and land use has recently led to the application of quantitative soil erosion model applications at European scale. At present soil erosion estimates at Pan-European level are available from three erosion models: Universal Soil Loss Equation – USLE, Institut National Recherche Agronomique – INRA, and the Pan-European Soil Erosion Risk Assessment – PESERA. It is important to assess the accuracy of such soil erosion estimates from models that could be used in the context of soil protection. This is, however, rather problematic at European scale, because it is very difficult, if not impossible to acquire direct soil erosion measures for large areas. Therefore indirect soil erosion data derived from sedimentation volumes in reservoirs in Belgium, the Czech Republic, Italy and Spain were used to assess the accuracy of the USLE, INRA and PESERA soil erosion estimates. Firstly, the area contributing to each reservoir was delineated using automatic watershed delineation algorithms. Next, WaTEM/SEDEM was applied in order to assess for each reservoir a Sediment Delivery Ratio (SDR). Erosion estimates were than multiplied with the SDR-values. Finally observed and predicted sediment yield values were compared. The results show that none of the three models produces accurate soil erosion estimates based on 1km x 1 km data for all European environments. The models are relatively successful in predicting the relative pattern of soil loss from agricultural areas in central Belgium and the Czech Republic. None of the model results however accurately predict the measured soil erosion patterns in Italy and Spain. The main reasons for this are:

1) uncertainty involved in the indirect validation method (i.e. sedimentation data in reservoirs)

2) low resolution of the input data used for model applications at European scale 3) simplified internal model structures that do not take into account all sediment

producing and transporting processes. However, past research has shown that some models perform much better for areas when high quality input data are used (Van Rompaey et al., 2003). For example, runoff is better predicted from a 250m digital elevation model (DEM) than from a 1km DEM. In many cases, these high resolution input data exist in national mapping, meteorological and soil survey institutions but at present are not readily available for the whole of Europe. An important future role for the JRC in future could be to harmonise, aggregate and facilitate access to these data at European level. It is clear than some attempt must be made to estimate soil erosion losses in Europe for the forthcoming EU Soil Protection Strategy and this could be done best by using a standard model applied to standard data sets. Therefore, the Services of the Commission should put much more effort into encouraging national and regional administrations to provide the necessary input data for soil erosion models at much higher resolutions than are currently available.



2

2. Introduction Until the beginning of the 1990’s the scientific community studying soil erosion was mainly focused on the development of physically-based soil erosion models, aiming at a better understanding of erosion processes at the level of plots or individual parcels. However, policy makers need tools to assess soil erosion risk at a regional scale to set up an adequate soil conservation strategy. Furthermore soil erosion is affecting many aspects of the sediment-, nutrient- and hydrological- cycle at a continental scale: the modelling and prediction of its impact on such scales requires an adequate modelling approach. European scale soil erosion risk assessments in the 1980’s and early 1990’s used expert-bases approaches (e.g. De Ploey et al., 1989, Oldeman, 1990) or factorial scoring methods (e.g. CORINE, 1992). These kinds of methods allowed relative delineation of areas with a high soil erosion risk, but offered very limited possibilities to evaluate the effect of different land management scenarios (see also Grimm et al., 2001). The increasing availability of regional scale data layers on climate, topography and land use has recently led to the application of quantitative soil erosion model application at European scale. The soil erosion estimates available from model applications at European scale are listed in Table 1. Table 1 Overview of soil erosion estimates at European scale

Model Type Reference De Ploey Expert based De Ploey et al., 1989 CORINE Factorial scores CORINE, 1992 IMAGE Factorial scores RIVM, 1992

GLASOD Expert based Van Lynden, 1994 Hot Spots Expert based EEA, 2000

USLE Quantitative Van der Knijff et al., 2000 INRA Factorial scores INRA, 2001

PESERA Quantitative Gobin and Govers, 2003 Although all erosion maps were produced with the most accurate data that were available at European scale, many authors warn about the uncertainties involved in this kind of model application. Therefore such estimates must be used with caution. In fact, it is almost impossible to come to well-founded policy-decisions based on regional scale soil erosion maps if there is no reliable assessment of the error on the predicted soil erosion rates. The validation of erosion estimates at continental scale is, however, rather problematic. It is technically and financially not feasible to measure soil erosion for large spatial entities. Moreover soil erosion processes are characterized by a significant spatial and temporal variability. In reality the accuracy of regional and continental scale soil erosion estimates is hardly ever assessed. In this paper, an alternative validation method based on measured sedimentation volumes in lakes and reservoirs is proposed. Reservoir sedimentation data from Belgium, Czech Republic, Italy and Spain are used to assess the accuracy of the USLE-, INRA- and PESERA-estimates.



3

3. Soil erosion estimates from USLE, INRA & PESERA models

3.1 USLE estimates

Van der Knijff et al. (2000) made an attempt to estimate erosion in Europe with an Universal Soil Loss equation (USLE) based methodology. The USLE is an empirical soil erosion model that was originally developed for computing estimates at plot-scale. Mean annual soil erosion rates (in t.ha-1.yr-1) are assessed by multiplying 4 different factors: a rainfall erosivity factor (R), a soil erodibility factor (K), a topographic factor (LS) and crop cover and management factor (C). Van der Knijff et al. assessed these factors for Europe at a 1 km resolution using MARS rainfall data (King et al., 1995), CORINE Land Cover data (Eurostat GISCO) and the European Soil Database at 1:1,000,000 scale (version 1.0) (King et al., 1995; Heineke et al., 1998), see Figure 1.

MARS MeteoDatabase

European Soil Database

Elevation Model (250 m)

NOAA -AVHRR +CORINE

Surf.Texture +Parent Mat.

Slope

MonthlyCover Factor

MonthlyRainfall R

K

LS

C

ErosionRiskMap

A=RKLSC

Classify

Figure 1: USLE model application for Europe (after Van der Knijff et al., 2000)

For each 1km x 1km pixel, a mean annual soil erosion rate in t.ha-1.yr-1 was assessed (Figure 2). For details on the exact procedures used we refer to the original publication.

Figure 2: USLE soil erosion estimates (after Van der Knijff et al., 2000)

Erosion (t/ha/yr)



4

Van der Knijff et al. (1999, 2002) and Grimm et al. (2003) applied a similar model structure for soil erosion risk assessment in Italy but used more accurate input data: a 250m DEM and rainfall data from 366 meteorological stations compared with 46 stations in Italy for the European assessment (King et al., 1995).

3.2 INRA estimates

Subsequent to the application of the USLE, the Institut National Recherche Agronomique (INRA) developed an empirical decision tree-based approach to delineate qualitative soil erosion risk classes (Figure 3). Soil erosion risk is assessed taking into account information on land use (CORINE 9 classes), crust formation (4 classes), slope (8 classes) and soil erodibility (3 classes). For details on the exact procedures used we refer to Le Bissonnais et al. (2002)

Figure 3: INRA model concept

Figure 4: INRA soil erosion estimates (after Le Bissonnais et al., 2002)

Erosion (t/ha/yr)



5

In our research presented here, the risk classes of the original INRA-map where translated into quantitative rates as follows (Daroussin, Pers. Comm): very low risk = 0.5 t.ha-1.yr-1, low risk = 1.5 t.ha-1.yr-1, medium risk = 6.5 t.ha-1.yr-1, high risk = 20 t.ha-1.yr-1, very high risk = 40 t.ha-1.yr-1). This is an approximate translation for comparison purposes but it has not been calibrated (Figure 4).

3.3 PESERA estimates

The Pan-European Soil Erosion Risk Assessment – PESERA is a process-based erosion model developed specifically for application at the European scale under an EU research contract (QLKS-CT-1999-01323). Because it is runoff-based, the model concepts differ fundamentally from empirical models such as the USLE and its derivations (Figure 5). PESERA predicts runoff with a daily time step. Depending on daily rainfall volumes, the soil storage capacity and vegetation interception, runoff occurs. Daily rainfall and temperature data are used to input to a vegetation growth model and to increase or decrease the available soil storage capacity. Runoff is linked with soil loss using equations developed by Kirkby et al. (2000). For more information on the exact procedures used we refer to Gobin and Govers (2003).

Gridded (50 km) Climate Data for Rf, Temp & Pot E-T

VegetationBiomass (kg/m2)

Dig

ital

Soi

l, la

nd-u

se a

nd G

eolo

gy

map

s at

1:1

000

000

Topographic Potential, ΛDTM (1km grid)

Runoff and Climate/Vegetation Erosion Potential, Ω

Erodibility, k

Combined Erosion, kΛΩ

Runoff

Water balance(SMD)

Soil Storage

Ground CoverCompare with AVHRR

Figure 5: PESERA modelling concept (Gobin and Govers, 2003) PESERA is constructed such that it can also function as a tool for evaluating land use and climate change scenarios both on a daily basis and over longer timescales. Long term soil erosion rates (in t.ha-1.yr-1) were assessed using daily rainfall and temperature records from the MARS database (King et al., 1995), see Figure 6. The daily records have been compiled on a 50km x 50km grid using a sophisticated interpolation procedure (Van der



6

Goot, 1998) applied to data for the period 1975-1995. For running the PESERA model, the 50km x 50km daily averages were then interpolated to a 1km x 1km grid, using an inverse spline function and the ARC/INFO GIS software system.

North

No data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

Erosion (t/ha/year)

Kilometres

500

Figure 6: PESERA soil erosion estimates

Erosion (t/ha/yr)



7

4. Validation methodology Given the spatial and temporal variability of soil erosion processes, the direct field-measurement of soil erosion is not feasible for large spatial entities. Two alternative but indirect validation methods are:

1) Monitoring of sediment load in rivers; 2) Measurement of sediment deposition in lakes and reservoirs.

The second option is in general more suited for the validation of long-term soil loss predictions, though data are only available for areas where reservoirs exist. The sediment that is trapped in a reservoir reflects, after correction with a trapping efficiency coefficient, the net soil loss in the contributing drainage basin since the construction or last clearing of the reservoir. It should however be kept in mind that the mean net soil loss (i.e. the sediment yield at the outlet) in a drainage basins differs from the mean total soil erosion (i.e. the total sediment produced in the drainage basin). Depending on the spatial configuration of topography and land use, a significant part of the eroded soil will deposit again before reaching a river channel or the outlet of the drainage basin. The sediment delivery ratio (SDR) is the ratio of sediment yield at the outlet over the total volume of produced sediment in the drainage basin.

SDRerosionsoiltotallosssoilnetorerosionsoiltotal

losssoilnetSDR ×==

SDR-values can be assessed with empirical regression equations (in general using lumped drainage basin parameters) or with spatially explicit sediment routing models that link sediment sources with river channels (e.g., CAESAR, Coulthard et al., 2000; WaTEM/SEDEM,Van Rompaey et al., 2001). Sediment yield datasets for Belgium, Italy, Spain and the Czech Republic were made available by collaborating research groups (Table 2). Table 2 Catchments with measured sediment yield at the outlet

Country Catchments Research Group

Belgium

23 Laboratory for Experimental Geomorphology, K.U.Leuven (G. Verstraeten & J. Poesen)

Italy

44 Instituto Sperimentale per lo Studio e la Difesa dello Suolo, Firenze (P. Bazzoffi)

Czech Republic

5 Czech Republic: Department for Land and Water Management, CVUT, Prague

(T. Dostal & J. Krasa)

Spain

26 International Committee on Large Dams (Avendano Salas) and Laboratory for Experimental Geomorphology, K.U.Leuven (J. Devente, G. Verstraeten & J. Poesen)



8

For each of these catchments, sediment delivery ratios were assessed with WaTEM/SEDEM applied at a high resolution. For more details on the SDR-assessments we refer to: Van Rompaey et al. (2001) for Belgium, Van Rompaey et al. (2003a) for Italy and Van Rompaey et al. (2003b) for the Czech Republic. For the Spanish dataset it was not possible to calculate an SDR-correction because the necessary high-resolution data for a WaTEM/SEDEM application were not available. For each of these catchments predicted erosion rates were multiplied by predicted SDR-values. Finally, the predicted sediment yield values were compared with the measured sediment yield values.



9

5. Results The Belgian sediment yield (SY) dataset was compiled by Verstraeten and Poesen (2001) and consists of data from 15 drainage basins situated in the loess belt of central Belgium (Figure 7). The original database consists of 23 drainage basins but those that are smaller than 1 km² (= 1 pixel) were excluded from this analysis. The Czech SY-dataset was made available by the Department of Irrigation and Land Management of the CVUT (Technical University Prague). It consists of 5 drainage basins in the with an average size 180 km² (see Figure 9). The height difference in the catchments is < 500m. The dominant land use is pasture and arable land. Landscapes and land cover are at present changing very rapidly because of a de-collectivization of the agricultural production. The observed SY-values represent a 10 to 30 year period before the de-collectivization (Dostal et al., 2001, 2002). The Italian SY-dataset was made available by Bazzoffi et al. (1996). Sediment volumes were measured in 44 reservoirs with direct sonar sub-bottom profile techniques or derived from excavation volumes done by ENEL (Italian Electricity Power Company). Data from 34 drainage basins were used in this study (see Figure 11). The average size of the selected basins is 170 km². Avendano Salas et al. (1997) provide a list of mean annual sediment deposition rates for 60 Spanish reservoirs for a time span of at least several decades. Verstraeten et al. (2003) delineated contributing areas of 22 of these reservoirs, which are used in this analysis (see Figure 13). The average size of the drainage basins is 680 km². The height difference in the drainage basins ranges from 500 to 1200m. The dominant land use categories are forest and arable land. The assessment of SDR-values with WaTEM/SEDEM was not possible for this dataset because the necessary high resolution data on land cover and topography were not available.

5.1 The Belgian SY-dataset

Sediment volumes were measured directly when the reservoirs were cleared or estimated from manual measurements with a theodolite. The observed SY-values represent an accumulation over a 5 to 10 year period. The basins are situated on loamy and sandy loam soils and are characterized by a rolling topography (height difference < 100m). The dominant land use is arable land. The average size of the drainage basins is 10 km². More information on this dataset can be found in Verstraeten and Poesen (2001). Observed versus predicted SY-values are plotted in Figure 8, Figure 10, Figure 12 and Figure 14.



10

Figure 7: Soil erosion estimates for Belgium and location of the validation basins

PESERA

100 km

no data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

(t/ha/yr)

USLE

100 km

no data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

(t/ha/yr)

INRA

no data < 1 1 - 3 3 - 10 10 - 30 > 30

(t/ha/yr)

100 km



11

USLE Belgium

y = 0.038x + 0.044R2 = 0.284

0.0

0.1

0.2

0.3

0.4

0.5

0 1 2 3 4 5

Observed net soil loss

Pre

dict

ed n

et s

oil l

oss

INRA Belgium

y = 1.419x - 1.023

R2 = 0.377

0

2

4

6

8

10

12

0 1 2 3 4 5


Pre

dict

ed n

et s

oil l

oss

PESERA Belgium

y = 2.6268x - 0.3325R2 = 0.418

0

5

10

15

20

25

0 1 2 3 4 5


Pre

dict

ed n

et s

oil l

oss

The average of the observed net soil loss in the Belgian catchments is 2.4 t.ha-1.yr-1. With an average predicted value of 0.13 t.ha-1.yr-1 the USLE clearly underestimates soil erosion in Belgium. The average of the INRA-model predictions in the Belgian catchments is 2.3 t.ha-1.yr-1.

The PESERA model seems to overestimate erosion with a predicted average net soil loss of 5.9 t.ha-1.y-1. The PESERA estimates have the best correlation with the observed values with a Pearson’s correlation coefficient of 0.64. The correlation between the INRA estimates and the observed values is 0.61 and that between the USLE estimates and the observed values is 0.53.

Figure 8: Predicted versus observed net soil loss in Belgium (in t/ha/yr)



12

5.2 The Czech SY-dataset

Figure 9: Soil erosion estimates for the Czech Republic and location of validation basins.

PESERA

100 km

no data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

(t/ha/yr)

USLE

100 km

no data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

(t/ha/yr)

INRA

no data < 1 1 - 3 3 - 10 10 - 30 > 30

(t/ha/yr)

100 km



13

USLE Czech Republic

y = 0.2228x - 0.0071R2 = 0.5944

0.0

0.1

0.1

0.2

0.2

0.3

0.0 0.2 0.4 0.6 0.8 1.0


Pre

dict

ed n

et s

oil l

oss

INRA Czech Republic

y = 0.7086x + 0.1241R2 = 0.2579

0.0

0.2

0.4

0.6

0.8

1.0

1.2

0.0 0.2 0.4 0.6 0.8 1.0


Pre

dic

ted

ne

t soi

l lo

ss

PESERA Czech Republic

y = 0.247x + 0.0145R2 = 0.9113

0.0

0.1

0.1

0.2

0.2

0.3

0.0 0.2 0.4 0.6 0.8 1.0


Pre

dict

ed n

et s

oil l

oss

The average of the observed net soil loss in the Czech catchments is 0.52 t.ha-1.yr-1. The USLE model also underestimates soil losses in the Czech catchments with average predicted values of 0.11 t.ha-1.yr-1 . The correlation between observed and predicted net soil loss rates is 0.77 for the USLE. The average of the estimates from the INRA approach is 0.49 t.ha-1.yr-1, which is much closer to the average of the observed values. However, the correlation between the observed and predicted net soil losses is 0.50 for the INRA-model. The PESERA model underestimates soil losses in this area with average predicted values of 0.14 t.ha-1.yr-1 . If we look at the relative pattern of soil losses, it is clear that PESERA performs the best with a Pearson’s correlation coefficient of 0.95.

Figure 10: Observed versus predicted net soil loss in the Czech Republic.



14

5.3 The Italian SY-dataset

Figure 11: Soil erosion estimates for Italy and location of the validation basins.

PESERA

200 km

no data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

(t/ha/yr)

USLE

no data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

(t/ha/yr)

200 km

INRA

no data < 1 1 - 3 3 - 10 10 - 30 > 30

(t/ha/yr)

200 km



15

USLE Italy

y = -0.031x + 1.157

R2 = 0.011

0

1

2

3

4

5

6

7

8

0 5 10 15 20


Pre

dict

ed n

et s

oil l

oss

INRA Italy

y = 0.030x + 0.491

R2 = 0.052

0

1

2

3

4

0 5 10 15 20


Pre

dict

ed n

et s

oil l

oss

PESERA Italy

y = 0.179x + 1.874R2 = 0.042

0

5

10

15

20

25

0 5 10 15 20


Pre

dict

ed n

et s

oil l

oss

The dataset from Italy consists of: • mountain basins of north Italy: height

difference >1000m, dominant land use forest, pasture and bare rock

• hilly basins of central Italy: height difference < 1000m, dominant land use forest, arable land, humid conditions

• hilly basins of south Italy: height difference



16

5.4 The Spanish dataset

Figure 13: Soil erosion estimates for Spain and location of the validation basins.

PESERA

200 km

no data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

(t/ha/yr)

USLE

200 km

no data < 0.5 0.5 - 1 1 - 2 2 - 5 5 - 10 10 - 20 20 - 50 > 50

(t/ha/yr)

INRA

no data < 1 1 - 3 3 - 10 10 - 30 > 30

(t/ha/yr)

200 km



17

USLE Spain

y = 0.4105x + 1.839R2 = 0.3781

0

3

6

9

12

15

0 2 4 6 8 10


Pre

dict

ed n

et s

oil l

oss

INRA Spain

y = 0.0215x + 1.1081

R2 = 0.0166

0

1

2

3

4

5

6

7

8

9

10

0 2 4 6 8 10


Pre

dict

ed n

et s

oil l

oss

PESERA Spain

y = 0.0681x + 5.9488

R2 = 0.002

0

3

6

9

12

15

0 2 4 6 8 10


Pre

dict

ed n

et s

oil

loss

The average observed net soil loss in the Spanish catchments is 4.78 t.ha-1.yr-1. As SDR-correction was not possible for the Spanish dataset it makes no sense to compare average values. Under the assumption that SDR-values are more or less similar in all catchments, the correlation between the observed net soil loss and the predicted erosion may be taken into consideration. In this respect, the USLE performs the best with a correlation coefficient of 0.61 between observed and predicted values. Second are the INRA estimates with a correlation of 0.13 though this is virtually no correlation. The PESERA model produced the poorest correlation with a coefficient of 0.04.

Figure 14: Predicted versus observed net soil loss in Spain (in t/ha/yr).



18

6. Discussion A summary of the validation results is given in Table 3. For each model, four statistical parameters were calculated: the average, the Pearson’s correlation coefficient (R), the model efficiency (ME) and the Relative Root Mean Square Error (RRMSE). Values for ME range from -∞ to 1. The closer ME approximates to 1 (= the perfect model), the better the model performance. Values for RRMSE range from 0 to ∞. The closer RRMSE approximates 0 (= the perfect model), the better the model performance.

( )( )∑

∑−−

−= 22

1meanobs

predobs

YY

YYME

( )

mean

predobs

Yn

YY

RRMSE∑

−

=

2

The ME and the RRMSE are error indicators that do take into account the absolute deviations from the line of perfect agreement. In the case of a systematic error (under or over-prediction) ME will be low and RRMSE will be high, though there may be a good correlation between observed and predicted values Table 3 Summary of the validation results

BELGIUM Observed values USLE INRA PESERA Average 2.37 0.13 2.34 5.89 Correlation Coeff 0.53 0.61 0.64 Model Efficiency -2.68 -2.50 -18.07 RRMSE 1.11 1.08 2.53

CZECH REPUBLIC Observed values USLE INRA PESERA Average 0.52 0.11 0.49 0.14 Correlation Coeff 0.77 0.50 0.95 Model Efficiency -2.62 -0.56 -2.08 RRMSE 0.87 0.57 0.80

ITALY Observed values USLE INRA PESERA Average 5.00 1.00 0.64 2.77 Correlation Coeff 0.10 0.23 0.20 Model Efficiency -0.81 -0.74 -0.61 RRMSE 1.29 1.26 1.22

SPAIN (without SDR-correction) Observed values USLE INRA PESERA Average 4.78 3.79 1.21 6.27 Correlation Coeff 0.61 0.13 0.04 Model Efficiency 0.34 -0.35 -2.23 RRMSE 1.03 1.48 2.29

TOTAL (excluding Spain) Observed values USLE INRA PESERA Average 3.85 0.67 1.11 0.67 Correlation Coeff 0.03 0.06 0.03 Model Efficiency -0.62 -0.56 -0.62 RRMSE 1.42 1.39 1.42



19

For Belgium and the Czech Republic, all model predictions have a relatively high correlation with the observed sediment yield values. This means that all the models are able to estimate, with an acceptable accuracy, the relative difference between the sediment yield in those catchments. There is however no good agreement between the absolute values of the model estimates and the observed values across the different environments studied.. The USLE underestimates sediment yield values by a factor 20 in Belgium and a factor 5 in the Czech Republic. PESERA over-predicts sediment yield by a factor of 2 in Belgium but under-predicts sediment yield by a factor of 4 in the Czech Republic. Assigning soil losses to risk classes, the average values of the INRA estimates for Belgium and the Czech Republic correspond relatively well with the observed values. Because of these systematic errors model efficiency is in all case lower than 0, and the relative root mean square error is higher than 100%. Systematic errors are, however, essentially a problem of calibration. The accuracy of the predictions in the Mediterranean (Italy and Spain) is generally poor for all three models both in terms of relative patterns as well as absolute values. All models underestimate the observed sediment yield values in Italy, the INRA and the USLE models by a factor 5 and the PESERA model by a factor 2. Correlation between predicted and observed values is also poor for the three models with correlation coefficients lower than 0.25. It should however be kept in mind that the erosion measurements for Spain were not corrected with sediment delivery ratios and therefore the same comparison as for Belgium, Czech republic and Italy was not possible. If we assume that the average sediment delivery ratio for the Spanish catchments is 20%, it is clear that all models significantly under-predict erosion in Spain. In general, the results show that none of the three models presented in this study produces accurate soil erosion estimates across all European environments. The models are relatively successful in predicting the relative pattern of soil loss from agricultural areas in central Belgium and the Czech Republic. None of the model results accurately predict the measured soil erosion patterns in Italy and Spain. There are several reasons for the discrepancies between the model results and the observed sediment yield values. Firstly, the validation methodology chosen is indirect. All models estimate soil erosion of which only a fraction of the sediment is transported to the outlet of the catchment. The SDR-coefficient, which is necessary to convert erosion rates into sediment yield values, was calculated with WaTEM/SEDEM. Although the SDR-assessment was done with the best data available at the scale of these catchments, the potential errors can be significant. Moreover the sediment yield measurements themselves are not error-free. Verstraeten et al. (2001) estimated the error on sediment yield measurements at 20%. It should also be kept in mind that sediment volumes in lakes and reservoirs cover only a limited time span in which extreme events rainfall events or exceptionally dry periods may have occurred.



20

Secondly all models were run with low resolution input data (1km x 1km). The 1km resolution DEM, which is available for Europe is almost certainly not sufficiently detailed to capture the important characteristics of the topography, even when upscaling techniques and fractal methods are applied. This problem was already identified by Van der Knijff et al. (2000). Furthermore, Van der Knijff et al. (2000) and Grimm et al. (2003) assessed soil erosion rates in Italy using the same USLE-model as presented above but with more accurate topographic (250m DEM), climate (rainfall data from 366 stations instead of 46 MARS stations and pedological (at 250,000 scale) input data. Van Rompaey et al. (2003a) used the same measured dataset as presented here for accuracy assessment of the Grimm et al. estimates and found a 64% correlation (Pearson’s R) between observed and predicted values. Using exactly the same model but with input data at 1km x 1km resolution in a correlation coefficient of only 10% was found.

Figure 15: Available mean annual rainfall data in Wales (UK).

Thirdly, European data layers interpolated from existing databases on land use and climate are not always reliable. A comparison of rainfall estimates interpolated for the UK, but at European scale (MARS), and the national-scale long term rainfall records shows that in some cases the error on mean annual rainfall estimates at European scale is more than 100%. As most erosion models are very sensitive to the rainfall input, such errors can have an enormous impact on the model output. Figure 15 shows the average annual rainfall (in mm) for Wales derived from national scale meteorological data (left) and from the European dataset (middle), in relation to the PESERA erosion estimates (right). It is clear that, by comparison with the true mean annual rainfall (from the national data set), the interpolated European data underestimate rainfall in north Wales by a factor between 1.5 and 3. This will have had a significant impact on the predicted soil losses for Europe obtained by running the PESERA model at 1km resolution (Figure 6).



21

Fourthly, errors in the CORINE land cover map can lead to erroneous model estimates. For example, Figure 16 shows some land cover classification problems in Italy. In the centre of Sardinia, a block of several square kilometers are mis-classified as arable land resulting in unrealistically high erosion estimates from applying the model. In the north of Italy, land is wrongly classified as water because there is a large area of rice cultivation and the land use was assessed from satellite imagery flown at the time (April/May) when the rice fields were flooded. This results in the models estimating zero erosion.

Figure 16: Land cover classification problems.

Finally the poor performance in Mediterranean areas may also be because important sediment transport processes are operating that are not included in any of the models. The USLE, INRA and the PESERA models were developed essentially to assess soil loss by rill– and inter-rill erosion. These are the dominant soil erosion processes on arable land in most of temperate Europe. In addition to measurments from dominantly arable catchments, the Italian and the Spanish datasets include measurements from semi-natural mountain catchments where mass movements, landslides, avalanches, river storage and bank erosion are very important agents in the total sediment budget. Gully erosion, on the other hand, is the dominant erosion process in the semi-arid catchments in Spain and South-Italy. It is obvious that models that do not include such processes, cannot perform well in these areas and it is important to note that PESERA-estimates are shown to be more accurate (R = 0.59) when only data from the catchments with more than 50% arable land are analysed (Figure 17).

Erosion (t/ha/yr)



22

y = 0.15x + 0.10R2 = 0.35

0

1

2

3

0 5 10 15

Observed SY

Pred

icted

SY

Figure 17: Observed versus predicted soil losses (in t/ha/yr) in catchments in Italy with more than 50% of the land in arable cultivation.



23

7. Conclusion It is important to assess the accuracy of soil erosion estimates from any model that could be used in the context of soil protection in Europe (EC, 2002). However, it is very difficult, if not impossible, to acquire direct soil erosion measurements for large areas of land (at European scale) for validating model results. Therefore an indirect validation method, based on more widely available data, was adopted. Such data exist as measures of sediment accumulation in lakes and reservoirs and these were made available by researchers for a number of catchments in four European countries. For each of the contributing areas, an sediment delivery ratio – SDR-value was calculated in order to convert the observed sediment yield values to soil erosion rates. The accuracy of three soil erosion models: the USLE, an INRA-model and the PESERA-model was assessed. The results presented above show that none of the three models used in this study accurately predicts soil erosion across all European environments. However, the models are relatively successful in predicting the relative pattern of soil loss from agricultural areas in central Belgium and the Czech Republic. However, none of the models accurately predicts the measured soil erosion patterns in Italy and Spain. The main reasons for this are:

1) Uncertainty involved in the indirect validation method 2) Low resolution of the input data used for model applications at European scale 3) the simplified model structures that do not take into account all sediment

producing and transporting processes. Furthermore, our research shows that some models perform much better for areas where high quality input data are available (Van Rompaey et al., 2003a). For example, runoff is better predicted from a 250m digital elevation model (DEM) than from a 1km DEM. In many cases, these high resolution input data exist in national mapping, meteorological and soil survey institutions, though these are at present not readily available at European level. An important future role for the JRC therefore, could be to harmonise, aggregate and facilitate access to these data at European level. It is clear than some attempt must be made to estimate soil erosion losses in Europe for the forthcoming Soil Protection Strategy. This could be done best using a standard model applied to standard data sets. Therefore it is recommended that the Services of the Commission put much more effort in to encouraging national and regional administrations to provide the necessary environmental data (for input to soil erosion models) at much higher resolutions than are currently available.



24

8. References Avendano Salas, C., Sanz Montero, E., Rayan, C., Gomez Montana, J.L. (1997). Sediment yield at Spanish

reservoirs qnd its relationship with drainage basin area. Proceedings of the 19th Symposium of Large Dams, Florence. ICOLD (International Committee on Large Dams), Paris, 863-874.

Bazzoffi, P., Baldassarre G., Vacca S. (1996). Validation of PISA2 model for automatic assessment of

reservoir sedimentation. Proceedings of the International Conference on Reservoir Sedimentation. M.Albertson Ed. Colorado State Univ. 519-528.

CORINE (1992). CORINE - Soil erosion risk and important land resources in the southern regions of the

European Community, final report EUR 13233-EN. Office for Official Publication of the European Communities.

Coulthard, T. J. Kirkby, M. J., Macklin, M. G. (2000). Modelling geomorphic response to environmental

change in an upland catchment. Hydrological Processes. 14, 2031-2045. De Ploey, J. (in collaboration with: Auzet, A.V., Bork, H.-R., Misopolinos, N., Rodolfi, G., Sala, M. and

Silleos, N.G.). (1989). Erosional systems and perspectives for erosion control in European löss areas. Soil Technology Series, 1: 93-102.

Dostal, T., Krasa, J., Vaska, J., Vrana, K. (2001). Map of soil erosion risk and sediment transport in the

Czech Republic. VUV TGM (Czech Journal for Soil and Water Management), 1: 1-21. Dostal, T., Krasa, J., Vaska, J., Vrana, K. (2002). The map of soil erosion hazard and sediment transport at

the scale of the Czech Republic, Vodni Hospodarstvi, 2: 46-50. EC (2002). Communication of 16 April 2002 from the Commission to the Council, the European

Parliament, the Economic and Social Committee and the Committee of the Regions - Towards a Thematic Strategy for Soil Protection. COM (2002) 179 final 35pp. available at: http://europa.eu.int/scadplus/printversion/en//lvb/l28122.htm

EEA (2000). Down to Earth: soil degradation and sustainable development in Europe. Environmental Issues

Series, European Environment Agency. No. 16, 32pp. Gobin, A., Govers, G. (2003). Pan European Soil Erosion Risk Assessment – 3th Annual Report – EU 5th

Framework Programme, Project No. QLK5-CT-1999-01323. 144 pp. Available at: http://pesera.jrc.it/ Grimm, M., Jones, R.J.A., Montanarella, L. (2001). Soil erosion risk in Europe. European Soil Bureau.

EUR 19022 EN, 38pp. Office for Official Publications of the European Communities, Luxembourg. Grimm, M., Jones, R.J.A., Rusco, E., Montanarella, L. (2003). Soil erosion risk in Italy: a revised USLE

approach. European Soil Bureau Research Report No. 11, EUR 20677 EN, 24pp. Office for Official Publications of the European Communities, Luxembourg.

Heineke, H.J., Eckelmann, W., Thomasson, A.J., Jones, R.J.A., Montanarella, L. and Buckley, B. (Eds.)

(1998). Land Information Systems – Developments for planning the sustainable use of land resources. European Soil Bureau Research Report No. 4. EUR 17729 EN. Office of the Official Publications of the European Communities, Luxembourg. 546pp.

King, D., Jones, R.J.A. and Thomasson, A.J. (1995). European Land Information Systems for Agro-

environmental Monitoring. EUR 16232 EN, 285pp. Office for Official Publications of the European Communities, Luxembourg.

Kirkby, M.J., Le Bissonais, Y., Coulthard, T.J., Daroussin, J., McMahon., M.L. (2000). The development

of Land Quality Indicators for Soil Degradation by Water Erosion. Agriculture, Ecosystems and Environment, 81, 125-36.



25

Le Bissonnais, Y., Thorette, J., Bardet, C., Daroussin, J. (2002). L'erosion hydrique du sols en France. Technical Report INRA et IFEN, 63pp. (Unpublished).

Oldeman, L.R. (1990). World map of the status of human-induced soil degradation (GLASOD): an

explanatory note. ISRIC, Wageningen, The Netherlands. RIVM (1992). The environment in Europe: a global perspective. Report 481505001, RIVM, Bilthoven. The

Netherlands. Van der Knijff, J.M., Jones, R.J.A., Montanarella, L. (1999). Soil erosion risk assessment in Italy. European

Soil Bureau. EUR 19022 EN, 52pp. Office for Official Publications of the European Communities, Luxembourg.

Van der Knijff, J.M., Jones, R.J.A., Montanarella, L. (2000). Soil erosion risk assessment in Europe, EUR

19044 EN, 44pp. Office for Official Publications of the European Communities, Luxembourg. Van der Knijff, J., Jones, R.J.A., Montanarella, L. (2002). Soil Erosion Risk Assessment in Italy. In: J.L.

Rubio, R.P.C Morgan, S. Asins and V. Andreu (eds). Proceedings of the third International Congress Man and Soil at the Third Millennium. Geoforma Ediciones, Logrono. p.1903-1913.

Van der Goot, E. (1998). Spatial interpolation of daily meteorological data for the Crop Growth Monitoring

System (CGMS). EUR 18472 EN, p.141-153. Office for Official Publications of the European Communities, Luxembourg.

Van Lynden, G.W.J. (1994). The European soil resource: current status of soil degradation in Europe:

causes, impacts and need for action. ISRIC, Wageningen. Council of Europe. Strassbourg. Van Rompaey, A., Verstraeten, G., Govers, G., Van Oost, K, Poesen, J. (2001). Modeling mean annual

sediment yield using a distributed approach. Earth Surface Processes and Landforms 26: 1221-1236. Van Rompaey, A., Bazzoffi, P., Jones, R., Montanarella, L., Govers, G. (2003a). Validation of soil erosion

risk assessments in Italy. European Soil Bureau Research Report No. 12, EUR 20676 EN, 25 pp. Office for Official Publications of the European Communities, Luxembourg.

Van Rompaey, A., Krasa, J., Dostal, T., Govers, G. (2003b). Modeling sediment supply to rivers and

reservoirs in Eastern Europe during and after the collectivization period. Hydrobiologia, in press. Verstraeten, G., Poesen, J. (2001). Factors controlling sediment yield for small intensively cultivated

catchments in a temperate humid climate. Geomorphology 40, 123-144. Verstraeten, G., Poesen, J., De Vente, J., Koninckx, X. (2003). Sediment variability in Spain: a quantitative

and semi-quantitative analysis using reservoir sedimention rates. Geomorphology 50: 327-348.


Validation of Soil Erosion Assessments in Italy. Van Rompaey et al.

European Soil Bureau Research Reports: No.1 European Land Information Systems for Agro-environmental Monitoring. D. King, R.J.A. Jones and

A.J. Thomasson (eds). EUR 16232 EN, 284pp. (1995). Office for the Official Publications of the European Communities, Luxembourg.

No.2 Soil Databases to support sustainable development. C. Le Bas and M. Jamagne (eds). EUR 16371

EN 149pp. (1996). Office for Official Publications of the European Communities, Luxembourg. No.3 The use of pedotransfer in soil hydrology research in Europe. A. Bruand, O. Duval, H.Wösten and

A. Lilly (eds). EUR 17307 EN 211pp. (1997). Office for Official Publications of the European Communities, Luxembourg.

No.4 Land Information Systems: Developments for planning the sustainable use of land resources. H.J.

Heineke, W. Eckelmann, A.J. Thomasson, R.J.A. Jones, L. Montanarella and B. Buckley (eds). EUR 17729 EN 546pp. (1998). Office for Official Publications of the European Communities, Luxembourg.

No.5 Georeferenced Soil Database for Europe: Manual of Procedures Version 1.0. European Soil Bureau,

Scientific Committee. EUR 18092 EN 184pp. (1998). Office for Official Publications of the European Communities, Luxembourg.

No.6 Soil Resources of Europe. P. Bullock, R.J.A. Jones and L. Montanarella (eds). EUR 18991 EN

202pp. (1999). Office for Official Publications of the European Communities, Luxembourg. No.7 Soil Classification 2001. Erika Micheli, Freddy O. Nachtergaele, Robert J.A. Jones & Luca

Montanarella. EUR 20398 EN, 248pp. (2002). Office for Official Publications of the European Communities, Luxembourg.

No.8 Soil Geographical Database for Eurasia & The Mediterranean: Instructions Guide for Elaboration at

scale 1:1,000,000. Version 4.0. J.J. Lambert, J. Daroussin, M. Eimberck, C. Le Bas, M. Jamagne, D. King & L. Montanarella. EUR 20422 EN, 64pp. (2003). Office for Official Publications of the European Communities, Luxembourg.

No.9 Soil Resources of Europe: incorporating EU Candidate Countries. P. Bullock, R.J.A. Jones & L.

Montanarella (eds). EUR 20559 EN. (2003). Office for Official Publications of the European Communities, Luxembourg. [In press].

No.10 Land Degradation. Robert .J.A. Jones and Luca Montanarella (eds). EUR 20688 EN, 324pp. (2003).

Office for Official Publications of the European Communities, Luxembourg. No.11 Soil erosion risk in Italy: a revised USLE approach. M. Grimm, R.J.A. Jones, E. Rusco & L.

Montanarella. EUR 20677 EN, 25pp. (2003). Office for Official Publications of the European Communities, Luxembourg.

No.12 Validation of soil erosion risk assessements in Italy. A.J.J. Van Rompaey, P. Bazzoffi, R.J.A. Jones,

L. Montanarella & G. Govers. EUR 20676 EN, 24pp. (2003). Office for Official Publications of the European Communities, Luxembourg.

No.13 Validation of soil erosion estimates at European scale. A.J.J. Van Rompaey, V. Vieillefont, R.J.A.

Jones, L. Montanarella, G. Verstraeten, P. Bazzoffi, T. Dostal, J.Krasa, J. Devente, J. Poesen. (2003). EUR 20827 EN, 26pp. Office for Official Publications of the European Communities, Luxembourg.


Validation of Soil Erosion Assessments in Italy. Van Rompaey et al.

MISSION OF THE JRC The mission of the Institute of Environment and Sustainability is to provide scientific and technical support to EU strategies for the protection of the environment and sustainable development. Employing an integrated approach to the investigation of air, water and soil contaminants, its goals are sustainable management of water resources, protection and maintenance of drinking waters, good functioning of aquatic ecosystems and good ecological quality of surface waters.

Documents

V SOIL EROSION ESTIMATES AT EUROPEAN S · European scale, because it is very difficult, if not impossible to acquire direct soil erosion measures for large areas. Therefore indirect