13

Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

Scientia Iranica A (2018) 25(4), 1943{1955

Sharif University of TechnologyScientia Iranica

Transactions A: Civil Engineeringhttp://scientiairanica.sharif.edu

Predicting shear wave velocity of soil using multiplelinear regression analysis and arti�cial neural networks

O. Ataeea, N. Hafezi Moghaddasa;�, Gh.R. Lashkaripoura, andM. Jabbari Nooghabib

a. Department of Geology, Faculty of Science, Ferdowsi University of Mashhad, Mashhad, Iran.b. Department of Statistics, Faculty of Science, Ferdowsi University of Mashhad, Mashhad, Iran.

Received 16 May 2016; received in revised form 11 October 2016; accepted 28 January 2017

KEYWORDSShear wave velocity;SPT;Depth;Fine-content;Arti�cial neuralnetwork;Multiple linearregression;Mashhad.

Abstract. This paper investigates the correlation between shear wave velocity and some ofthe index parameters of soils, including Standard Penetration Test blow counts (SPT), Fine-Content (FC), soil moisture (W ), Liquid Limit (LL), and Depth (D). The study attemptsto show the application of arti�cial neural networks and multiple regression analysis tothe prediction of the shear wave velocity (VS) value of soils. New prediction equations aresuggested to correlate VS with the mentioned parameters based on a dataset collected fromMashhad city in the north east of Iran. The results suggest that, in the case of ANN methoduse, highly accurate correlations in the estimation of VS are acquired. The predicted valuesusing ANN method are checked against the real values of VS to evaluate the performanceof this method. The minimum correlation coe�cient obtained in ANN method is higherthan the maximum correlation coe�cient obtained from the MLR. In addition, the value ofestimation error in the ANN method is much less than that in the MLR method, indicatingthe role of higher con�dence coe�cient of the ANN in estimating VS of soil.© 2018 Sharif University of Technology. All rights reserved.

1. Introduction

Shear wave velocity (VS) is a fundamental parameterin de�ning the dynamic properties of soils, evaluatingdynamic site response, and characterizing dynamicsite [1,2]. The pro�le of VS in the ground is consid-ered as the most reliable predictor of site-dependentproperties from a seismic action in stable sites [3]. VSis measured often by in-situ methods in low strainlevels; therefore, the measured VS can be employed todetermine the maximum shear modulus (Gmax) of soildeposit in di�erent depths [1]. Gmax is an essential

*. Corresponding author.E-mail addresses: [email protected] (O. Ataee);[email protected] (N. Hafezi Moghaddas);[email protected] (Gh.R. Lashkaripour);[email protected] (M. Jabbari Nooghabi).

doi: 10.24200/sci.2017.4263

input parameter for analyzing the dynamic stability ofslopes, dams, embankments, etc. [4].

Although it is preferable to determining VS di-rectly through �eld tests, conducting these tests ismostly not feasible due to economic considerations,lack of space in urban areas, lack of specialized per-sonnel, and high noise levels in all situations [4-8]. Inthe absence of in-situ dynamic tests data, it is commonworldwide to calculate VS through reported empiricalrelationships between VS and other geotechnical soilproperties such as SPT, CPT, dry density, etc. [4]. SPTis one of the most economical and commonly employedin-situ tests involving very strong relationships withmany of geotechnical soil properties. Many studieshave proposed statistical relationships between VS andSPT blow counts [1,3-6,8-20].

Generally, the relationships between VS and SPTshow considerable dispersion, which is probably due tothe di�erent methods employed in measuring VS and

Page 2: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

1944 O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955

SPT N value, as well as the geotechnical and geologicalconditions speci�c to any area. Another reason for lowaccuracy of these relationships is the type of regressionanalysis employed [21]. Traditionally, statistical meth-ods, such as simple and multiple regression analyses,are used in geotechnical engineering to create predic-tive models. All of conventional regression methodshave limitations. Besides, empirical methods are notapplicable to complicated and non-linear problems [22].

Arti�cial Neural Network (ANN) is an over-simpli�ed simulation of human brain made up of simpleprocessing units, called neurons. This system is ableto learn and generalize experimental data, even whenthe data are noisy, incomplete with a non-linear na-ture [23,24]. Unlike the conventional statistical models,the main advantage of ANN is that it does not requireany prior knowledge related to the kind of relationshipbetween input and output data. ANNs are also ableto function very well in situations with limited dataaccessibility [25].

In recent years, Arti�cial Intelligent (AI) methodshave been widely used for predicting purposes [26,27].So far, neural networks have been used for estimatingand predicting some of the geotechnical propertiesof soil such as estimation of soil compaction pa-rameters [28,29], compressive and shear strength ofsoils [22,30,31], prediction of soil permeability [29,32],prediction of CBR in �ne-grained soils [33], predictionof compressibility indices of saturated clays [34-36],pile bearing capacity [37,38], prediction of soil settle-ment [39], soil liquefaction [40-43], and analysis of slopestability [44-46]. Researchers have also used neuralnetwork models to predict VS value in oil wells [26,47-50]. In addition, ANNs have been used to estimateand predict VS values of soils using geotechnical soilproperties such as CPT [51-53].

The present study aims to develop an optimalmodel to predict VS of soils in Mashhad city basedon the parameters of SPT, depth, �ne content, liquidlimit, and percentage of soil moisture. In this study, amultilayer perceptron with feed-forward backpropaga-tion is used for modeling VS in soil. The best neuralnetwork model is found and selected through analysisof di�erent models' performances (with di�erent hiddenlayers and neurons in each layer). The purpose of thisstudy is to identify properties of soil that have a moree�cient role in predicting VS of soil; it also attemptsto compare the capabilities of neural networks andmultiple regression technique in predicting VS valueusing the variables mentioned above.

2. Study area

This study was carried out in Mashhad, Iran, which isthe second most populated city in the center of Kho-rasan Razavi province in Iran. Mashhad is located at

36:10�-36:24�N latitude and 59:25�-59:43�E longitudein the northeast of Iran. It is situated on Mashhadplain, which is covered with thick Quaternary alluvialsediments. Kashafrood River is the main drainage sys-tem of Mashhad plain as well as the streams originatingfrom the southern parts of Mashhad (Figure 1).

From the seismotectonical perspective, Mashhadis situated between two folded-thrusted mountains(Koppe-Dagh in northeast and Binalood in south-west). According to Berberian et al. [54], there wereintense earthquake activities in the area in the pastcenturies, especially in the 18th century. The existenceof active faults within a short distance and on the twosides of Mashhad plain indicates that this area has ahigh potential for earthquake. Shandiz, Kashafrood,Toos, south of Mashhad, the north of Neishaboor, andKheirabad faults are the main active faults in thisarea [55].

Mashhad city is an earthquake-prone area andis situated in the high-risk earthquake zone, with0.30-0.35 g maximum acceleration in return period of475 years, according to the Iranian Code of Practicefor Seismic Resistance Design of Buildings (StandardNo. 2800) [56]. These issues indicate the seismicvulnerability of Mashhad city; hence, an accurateestimation of VS for this city is required.

3. Materials and methods

3.1. RegressionRegression analysis is one of the analytical instrumentswidely applied to the investigation of relationshipsbetween a dependent variable and a set of independent(predictor) variables. Regression analysis is eitherlinear or non-linear. In linear regression, data are mod-eled using linear-independent variables or predictivefunctions. In non-linear regression, data are modeledusing a function that is a non-linear combination ofmodel parameters. This type of regression is dependenton one or more independent variables. Regressionanalysis is one of the common methods for creatingpredictive models between VS and soil geotechnicalproperties, including SPT and CPT. In addition toSPT, this paper aims to study the in uence of �necontent, soil moisture, liquid limit, and soil depthon estimating VS value. Therefore, Multiple LinearRegression analysis (MLR) will be employed.

3.2. Multiple Linear Regression analysis(MLR)

Simple linear regression is a useful technique to predicta response based on a single predictor variable. How-ever, in practice, it often occurs that there is more thanone predictor. MLR is used when there are more thanone explanatory variable in a model, which can helpexplain or predict the response variable; therefore, all

Page 3: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955 1945

Figure 1. Geological map of study area with location of boreholes and faults.

Page 4: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

1946 O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955

of these explanatory variables are put into the model tocarry out a multiple linear regression analysis. Then,the MLR equation is given as follows:

Y = �0 + �1X1 + �2X2 + � � �+ �pXp + "; (1)

where Xp represents the pth predictor, and �p quan-ti�es the relation between the variable and response.�p is interpreted as the mean e�ect on Y of a one-unit increase in Xp, holding all other predictors �xed.Regression coe�cients, �0; �1 � � ��p, in Eq. (1) areunknown and must be estimated using the least squaresapproach as is the case in simple linear regression [57].

3.3. Arti�cial Neural Network (ANN)ANN is a massively parallel-distributed informationprocessing system with certain performance character-istics, simulating the biological neural networks of thehuman brain [58]. A neuron is the basic componentof the neural networks that accepts and sums upinputs, applies a transfer function, which is normallynonlinear, and gives the result that is as either a modelprediction or input into other neurons. An arti�cialneural network is a combination of many such neuronsconnected in a systematic way. Neurons with the sameproperties in an ANN are ordered in groups, calledlayers [33]. One-layer neurons are connected to theneurons of the adjacent layers (not to the neurons of thesame layer). The strength of connection between thetwo neurons in adjacent layers is recognized throughthe strength of connection or weight.

Usually, an ANN has three layers: one inputlayer, one hidden layer, and one output layer. SinceANNs have an error tolerance and the ability to workwith incomplete data, they can easily produce modelsfor complicated problems. In particular, for semi-structural or non-structural problems, neural networkmodels can provide very successful results. Further-more, they are faster and more reliable than thetraditional methods are [23].

3.4. Multi-Layer Perceptron (MLP)MLPs, also known as feed-forward neural networks,typically trained with back propagation algorithm, areusually used for prediction. Neurons in such networksare arranged in di�erent layers (typically one inputlayer, one or more hidden layers, and one output layer)each of which is interconnected to its preceding andfollowing layers. Figure 2 depicts a feed-forward three-layer ANN with the description of input and outputlayers employed in the current study. Connectionsbetween neurons have weights associated with them.These weights determine the strength of in uence thatone neuron can have on another. From the input layerand through the processing layer(s), information owsto the output layer to generate predictions. Duringtraining, the network learns to generate predictions

Figure 2. Architecture of multilayer neural network forthis study.

that are more accurate through adjusting the connec-tion weights so that predictions can be matched withtarget values for speci�c records.

Determining the network architecture requires theoptimum number of hidden layers between input andoutput layers and the optimum number of neurons ineach hidden layer. That is one of the most importantand most complicated parts of designing neural net-works, as there is no single theory or accepted rulefor determining the optimal network architecture [59-61]. The number of hidden layers and their neurons ismostly determined by trial and error [62,63].

3.5. Data preparation and normalizationThe dataset used in this study was collected fromgeotechnical and geophysical reports from civil engi-neering projects done across Mashhad city by con-sulting engineering companies. Data related to 85drilled boreholes were employed in data analysis. Acomplete dataset of six variables was required for thisstudy; �nally, 185 soil samples were used for regres-sion analysis, neural network design, and its accuracyevaluation. The model input variables selected for thepresent study are SPT, LL, W , FC, and D; the targetor output variable is VS of the soil.

In most of the datasets, there is a lot of variabilityin the scale of range �elds. Therefore, to nullify thee�ect of scale, range �elds are transformed to havethe same scale for all. In this situation, normalizationcan speed up the training process and improve theaccuracy of the output model. Range �elds are rescaledin Clementine to have values between 0 and 1. In thisstudy, before inserting data into ANN, the input andoutput datasets were normalized through the followingformula [64]:

xnormalized =xactual � xmin

xmax � xmin; (2)

where xnormalized is the normalized value of the ob-served variable, xactual is the real value of the observedvariable, and xmax and xmin are the maximum andminimum values of observed variable in the dataset,

Page 5: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955 1947

respectively. When the function of the network iscomplete, network outputs are post-processed so thatdata can be converted into non-normalized units [28].For ANN modeling, data are divided randomly intothree categories of training, testing, and validation [60].The network is trained by the �rst category of data.The training set is also used for adjusting the weightsof the connections. The validation set is used to testthe performance of the network in di�erent stages oftraining. When the training is successful, the testingset is used to evaluate the performance of the model.

The dataset collected from the Mashhad cityregion was �rst analyzed for possible relationshipsbetween the parameters, and those variables whichseemed likely to be in uential in predicting VS wereseparated. Finally, �ve main parameters, includingSPT, LL, W , FC, and D, were considered as inputparameters in MLR and ANN models. In designinga neural network, data were divided into training,testing, and validation sets. From 185 datasets usedin this study, 80% (137 samples) were employed fortraining the model, 10% (19 samples) for testing themodel, and 10% (29 samples) for validation of ANNanalysis. All data were employed in regression analysis.Table 1 shows descriptive statistics related to the inputand output parameters for all sets.

3.6. Performance evaluation criteriaFor the assessment of methods, the obtained results

from each model (MLR and ANN) were evaluatedbased on di�erent criteria. There are many criteria forassessing the performance of models. In this section,the e�ciency criteria used in this study are presentedand evaluated. There are four criteria herein: thecorrelation coe�cient (R), coe�cient of determination(R2), Root Mean Square Error (RMSE), and MeanAbsolute Error (MAE). Each of the above criteriaused in this study was computed through the followingequations:

3.6.1. Pearson Correlation Coe�cient (R)R can be used to estimate the correlation betweenmodel and observations:

R =Pni=1(mi � �m) � (pi � �p)qPn

i=1(mi � �m) �Pni=1 (pi � �p)2

; (3)

where mi is the measured value, Pi is the predictedvalue, �m is the mean of measured values, and �P is themean of predicted values.

3.6.2. Coe�cient of determination or the square ofthe Pearson correlation coe�cient (R2)

R2 describes how much of the variance between the twovariables is described by the linear �t.

3.6.3. Root Mean Square Error (RMSE)The RMSE of a model prediction is de�ned as thesquare root of the mean squared error:

Table 1. Descriptive statistics of input and output data.

Partition Statistics D SPT FC W LL VS (m/s)

All

data

set Mean 16.20 43 31.41 6.56 21.46 515

Std. Deviation 10.40 21 28.21 5.18 5.97 157Minimum 0.50 10 1.80 1.60 2.00 202Maximum 49.00 97 99.00 26.10 55.00 850

Tra

inin

gse

t Mean 15.94 44 30.50 6.18 21.48 516Std. Deviation 10.11 21 26.77 4.48 6.38 148Minimum 0.50 10 1.80 1.60 2.00 202Maximum 49.00 97 97.00 21.95 55.00 850

Tes

ting

set Mean 19.00 42 37.97 9.22 21.74 524

Std. Deviation 12.25 20 36.34 8.54 5.60 175Minimum 1.50 16 6.00 2.10 15.00 204Maximum 41.00 91 99.00 26.10 35.00 773

Val

idat

ion

set

Mean 15.59 40 31.42 6.63 21.18 504Std. Deviation 10.53 22 29.45 5.12 4.06 186Minimum 1.50 11 7.30 2.00 15.00 210Maximum 41.50 91 98.50 26.00 32.70 790

Page 6: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

1948 O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955

RMSE =

rPni=1(mi � pi)2

n; (4)

where n is the number of data presented in thedatabase.

3.6.4. Mean Absolute Error (MAE)The Mean Absolute Error (MAE) is a quantity usedto measure how close predictions are to the eventualoutcomes. The mean absolute error is given by:

MAE =Pni=1 jmi � pij

n: (5)

4. Results and discussion

4.1. Regression analysisAs previously mentioned, �ve independent variables formultiple regression analysis were selected. At �rst, therelationships between VS and each of the independentvariables were studied. The relationship between VSand SPT as well as VS and depth has a power-lawform [1-20]. Therefore, the most preferred functionalform of relation between SPT and VS proposed inliterature (VS = a � N b) has been used as the mainformat for MLR analysis. This equation is given below:

VS = a �N b �Dc � FCd �W e � LLf : (6)

In this equation, N , D, FC, W , and LL represent SPT,depth, �ne-content, moisture content, and liquid limit,respectively, and a to f are coe�cients that should bedetermined by regression. The power-law form of thismodel allows us to write it as follows:

log VS = log a+ b logN + c logD + d log FC

+ e logW + f log LL: (7)

In this case, the linear regression can be used todetermine the constant values. MLR analysis wasperformed on 31 possible combinations of independentvariables. After comparing the results, nine combina-tions whose coe�cient of determination exceeded 0.5were selected to obtain the best model to govern VS .The combination of input variables in di�erent modelsin this study is given in Table 2. The MLR regressionanalysis was performed using SPSS software, and thecriteria for performance evaluation were calculated foreach combination, as shown in Table 3.

A comparison of the above results demonstratesthat C�3 with a higher correlation coe�cient and coef-�cient of determination (0.856 and 0.733, respectively)and smaller values of RMSE and MAE is the bestmodel for predicting the value of VS of soil. It can beobserved that the combination of the three parameters,including D, SPT, and FC (silt and clay), shows thebetter correlation with VS . Figure 3 shows the scatterplot of VS values predicted by MLR and its measuredvalues in the �eld.

Table 2. Input and output for the di�erent combinations.

Combinationno.

Input Output

C � 1 D, SPT, LL

VS

C � 2 D, SPT, WC � 3 D, SPT, FCC � 4 D, FC, WC � 5 D, SPTC � 6 D, LLC � 7 D, WC � 8 D, FCC � 9 SPT

Table 3. Performance evaluation criteria for the di�erentcombinations obtained by MLR analysis.

Combinationno.

R2 R RMSE(m/s)

MAE(m/s)

C � 1 0.719 0.848 84.28 70.84C � 2 0.729 0.854 83.34 69.89C � 3 0.733 0.856 82.29 68.81C � 4 0.588 0.767 100.74 82.02C � 5 0.711 0.843 85.7 71.34C � 6 0.506 0.711 111.37 90.27C � 7 0.560 0.748 106.45 87.73C � 8 0.573 0.757 102.09 83.77C � 9 0.599 0.774 99.52 85.44

4.2. Arti�cial neural network developmentIn this study, a FFBP-based ANN solver (Clementinedata mining system) was used for designing and testingANN models. Clementine is a preeminent data-miningtoolkit widely used in academic researches and indus-trial applications. To apply Clementine ANN solver,like other FFBP-based software products, diverse net-work architectures should be examined to obtain thebest result. The �rst step in this process is to selectinput and output variables for this study, selected inprior sections.

In the next step, the number of hidden layers andneurons in each layer is de�ned for the model. Thereis no obvious solution for determining hidden layersand neurons for the ANN network. Although Zhang etal. [65] suggested that the optimum number of hiddenlayers in FFBP architecture is mostly one or two, someresearchers have also suggested that, between n and2n, hidden neuron is enough for FFBP models [66].

Generally, there are two fundamental approachesto constructing a FFBP network [67]. In a methodcalled additive or constructive, the model starts witha minimal network consisting of a single hidden layer,and, gradually, hidden layers and neurons are added

Page 7: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955 1949

Figure 3. Scatter plot of measured VS versus predictedVS for the best model by MLR analysis.

and the e�ectiveness of the obtained model is evalu-ated using the evaluation instruments. In the secondapproach, the model starts with a very large network;moreover, pruning algorithm is used to reduce the sizeof the model [68].

Clementine provides both approaches: The dy-namic method uses the additive approach. In this state,the network topology changes during the training phaseby the neurons that are added so that the network canobtain an optimum performance, while the system alsomonitors lack of improvement and overtraining. Thisprocess continues until no improvement can be achievedfrom the future model expansion. Conceptually, theprune method is di�erent from the dynamic method.The prune method starts with a large network and,then, gradually prunes it by removing the unhelpfulneurons from the input and hidden layers. There aretwo stages for pruning: pruning the hidden neuronsand the input neurons. The two-stage process iteratescontinuously until the overall stopping criteria are met.These two stages are described below. The trainingprocess in this approach discards the weakest hiddenneurons and selects the optimal size of the hiddenlayers. When one hidden layer is obviously enough,another option called Quick can be used where a simplemode creates a network with one hidden layer and at-tempts to determine the number of hidden neurons giv-ing the best results. The stopping rules in Clementineinclude a measure of desirable accuracy, the number ofcycles on which the model is run, and the real amountof time in which the model is allowed to run.

In the present study, combinations of these ap-proaches were used to reach the best results. Duringthe construction of these models, the prevent over-training parameter is always in the selection mode

to prevent the overtraining of the model. Input andoutput data were normalized before being inserted inthe network. To design the neural network, the datasetwas randomly divided into three discrete sets calledtraining, testing, and validation (80%, 10%, and 10%,respectively). Only those data concerning the trainingset are used by neural network to learn the existingpatterns in the data and optimize model parameters.During network training, the optimum numbers ofneurons in the hidden layer and the learning rate arecalculated. The training phase stops when the varia-tion of error becomes su�ciently small. After buildinga model using the training set, the performance of thetrained model must be validated using new data. Toget a more realistic estimation of how the model wouldperform with unseen data, we must allocate a part ofthe data not trained during the training process to thispurpose. This set of data is known as the ValidationSet. The testing set includes the unseen data forevaluating the performances of various candidate modelstructures and testing the network's generalization.

In this study, data analysis with neural networkswas performed using the SPSS Clementine software.The ANN analysis was also carried out on nine selectedcombinations of independent variables in the previoussections. Di�erent network methods were employedfor each combination. In addition, the method wasselected capable of estimating the value of the targetparameter with higher accuracy and the least numberof hidden layers and hidden neurons.

The performance criteria required for evaluatingthe accuracy of the designed models were computed forthe training, testing, and validation stages (Table 4).Based on the model performance in validation stage,the best ANN model was determined. By comparingthe evaluation criteria in Table 4, compared with othercombinations, the combination (C � 3) involving astructure of 3-2-3-1, which has the highest value ofcorrelation and coe�cient of determination and thelowest values of RMSE and MAE, was selected asthe optimal model in neural network analysis. Withrespect to this combination, it was observed that thevalues of RMSE and MAE were obtained as 63.42 and52.64 m/s for testing set and as 66.92 and 57.34 m/sfor validation set, respectively. Therefore, concerningcertain �ndings through regression analysis, it can beconcluded that VS correlates well with SPT, FC, andD. Results showed that high correlation coe�cient andlow RMSE values were also obtained for C�2 and C�5in both ANN and MLR methods, implying that thecomposition of two parameters SPT and depth of soilcould be good estimators for predicting VS ; however,joining parameters, such as FC and W , would improvethe prediction accuracy.

Furthermore, the coe�cient of determination forboth of the testing and validation data shows that the

Page 8: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

1950 O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955

Table 4. Performance criteria for di�erent models in testing and validation stage by ANN method.

Combinationno.

R2 R RMSE MAE

Test Validation Test Validation Test Validation Test Validation

C � 1 0.856 0.869 0.926 0.932 64.27 69.41 53.7 61.84

C � 2 0.854 0.885 0.924 0.941 70.95 67.32 58.4 57.37

C � 3 0.878 0.887 0.931 0.942 63.42 66.92 52.64 57.34

C � 4 0.681 0.817 0.825 0.904 101.07 86.29 77.96 73.52

C � 5 0.863 0.870 0.929 0.933 76.86 69.32 60.71 60.2

C � 6 0.748 0.839 0.865 0.916 88.97 82.93 70.52 67.58

C � 7 0.760 0.759 0.872 0.871 90.46 96.65 75.5 83.1

C � 8 0.741 0.812 0.861 0.901 90.39 87.53 76.19 71.47

C � 9 0.669 0.803 0.818 0.896 104.05 89.99 88.07 74.19

Figure 4. Relationship between measured and predicted shear wave velocity by ANN analysis in (a) testing and (b)validation phase.

predicted values of VS , using ANN method, show areasonably good correlation with actual values. Fig-ure 4 shows the relationship between the actual andpredicted values of VS using the ANN in testing andvalidation phases for the optimal model.

4.3. Comparison between ANN predictionsand results of MLR

Combinations 1 to 9 were analyzed using both ANNand MLR methods. The predicted VS by the ANNmodels for the testing and validation sets was comparedwith the estimated VS by multiple regression analysismodels. The MAE, RMSE, and R2 values extractedfrom ANN and MLR methods for di�erent combina-tions are depicted in Figures 5, 6, and 7. Figures 5 and6 show that the values of RMSE and MAE obtainedfrom regression analysis are greater than the ANNmethod for all of the above combinations in bothtesting and validation sets. It is also obvious accordingto Figure 7 that the correlation coe�cient obtained

from ANN models is more than that from the MLRmodels, re ecting the higher ability of ANN models foraccurate prediction of VS value.

Finally, to compare the ANN and MLR methodsand evaluate their performances, the predicted VSvalues by these two methods for the optimal model(C � 3) and for 20 random soil samples are presentedin Figure 8. As the �gure shows, the neural networkspredict VS values closer to the actual (measured VS)values for most of the samples.

5. Conclusions

The goal of this study is to evaluate the feed-forwardneural networks as a possible tool for predicting VSin Mashhad city. Five important input variables wereused for predicting VS value. Di�erent combinations ofthese inputs have been studied. Nine combinations ofthese variables, which achieved the highest correlationcoe�cient in regression analysis, were selected for

Page 9: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955 1951

Figure 5. Comparison of RMSE values obtained by ANN and MLR: (a) Testing set and (b) validation set.

Figure 6. Comparison of MAE values obtained by ANN and MLR: (a) Testing set and (b) validation set.

Figure 7. Coe�cient of determination (R2) obtained by ANN and MLR: (a) Testing set and (b) validation set.

comparing the ANN and MLR methods. The neuralnetworks were trained for nine mentioned combinationsby the feed-forward backpropagation algorithm; itseems that it correlated the static properties of soil wellwith VS . To validate the neural network models, new

observation data were introduced to the networks andthe forecasted VS were compared with actual values ofVS in the study area. Good agreement exists betweenreal and calculated data.

Both of the methods showed that the combina-

Page 10: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

1952 O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955

Figure 8. Measured VS versus predicted VS by ANN and MLR methods for the best model (C � 3): (a) Testing set and(b) validation set.

tions of the three parameters including D, SPT Nvalue, and FC give the best estimation of VS of soil.The value of correlation coe�cient and coe�cient ofdetermination obtained from the ANN method washigher than that of the MLR method. It should bementioned that the error values computed throughRMSE and MAE obtained from the MLR method weremore than those extracted from the ANN method forall combinations under study. Therefore, it can beconcluded that in comparison with MLR models, ANNmodels give more reliable prediction of VS . In otherwords, ANN models have a better performance and canbe used with a higher con�dence coe�cient to predictVS value of soil.

Acknowledgment

The authors appreciate cooperation from consultingengineering companies and soil mechanics laboratoriesin Mashhad city for providing their geotechnical re-porting for use in this paper. They also acknowledgethe kind cooperation from the Zamin Physics PooyaConsulting Engineering Company for giving permissionto use measured shear wave velocity.

Geolocation Information: Mashhad is the secondmost populated city in the center of the KhorasanRazavi province. It is located 850 km North East ofTehran, the capital of Iran, at 36:20� north latitude and

59:35� east longitudes in the valley of the KashafroodRiver near Turkmenistan, between the two mountainranges of Binalood and Hezar-Masjid, which are closeto the borders of Afghanistan, and Turkmenistan.

Role of funding sources: The work was not �nan-cially supported by any funding sources.

References

1. Akin, M.K., Kramer, S.L., and Topal, T. \Empir-ical correlations of shear wave velocity (VS) andpenetration resistance (SPT-N) for di�erent soils inan earthquake-prone area (Erbaa-Turkey)", EngGeol.,119, pp. 1-17 (2011).

2. Fabbrocino, S., Lanzano, G., Forte, G., Santucci deMagistris, F., and Fabbroccini, G. \SPT blow countvs. shear wave velocity relationship in the structurallycomplex formations of the Molise Region (Italy)",Engineering Geology, 187, pp. 84-97 (2015).

3. Sil, A. and Sitharam, T.G. \Dynamic site character-ization and correlation of shear wave velocity withstandard penetration test `N' values for the city ofAgartala, Tripura state, India", Pure and AppliedGeophysics, 171(8), pp. 1859-1876 (2014).

4. Chatterjee, K. and Choudhury, D. \Variations in shearwave velocity and soil site class in Kolkata city usingregression and sensitivity analysis", Nat. Hazards, 69,pp. 2057-2082 (2013).

Page 11: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955 1953

5. Hasancebi, N. and Ulusay, R. \Empirical correlationsbetween shear wave velocity and penetration resistancefor ground shaking assessments", Bulletin of Engineer-ing Geology and the Environment, 66, pp. 203-213(2007).

6. Dikmen, U. \Statistical correlations of shear wavevelocity and penetration resistance for soils", Journalof Geophysics and Engineering, 6, pp. 61-72 (2009).

7. Maheswari, R.U., Boominathan, A., and Dodagoudar,G.R. \Use of surface waves in statistical correlationsof shear wave velocity and penetration resistance ofChennai soils", Geotechnical and Geological Engineer-ing, 28, pp. 119-137 (2010).

8. Ghazi, A., Hafezi Moghadas, N., Sadeghi, H.,Ghafoori, M., and Lashkaripour, G.L. \Empiricalrelationships of shear wave velocity, SPT-N value andvertical e�ective stress for di�erent soils in Mashhad,Iran", Annals of Geophysics, 58(3), S0325 (2015).

9. Brandenberg, S.J., Bellana, N., and Shantz, T. \Shearwave velocity as a statistical function of standard pen-etration test resistance and vertical e�ective stress atCaltrans bridge sites", Soil Dynamics and EarthquakeEngineering, 30, pp. 1026-1035 (2010).

10. Shooshpasha, I., Mola-Abasi, H., Jamalian, A., Dik-men, U., and Salahi, M. \Validation and applicationof empirical shear wave velocity models based onstandard penetration test", Computational Methods inCivil Engineering, 4(1), pp. 25-41 (2013).

11. Imai, T. \P- and S-wave velocities of the groundin Japan", In Proceedings of the IX, InternationalConference on Soil Mechanics and Foundation Engi-neering, pp. 127-132 (1977).

12. Imai, T. and Yoshimura, Y. \Elastic wave velocity andsoil properties in soft soil (in Japanese)", Tsuchito-Kiso., 18(1), pp. 17-22 (1970).

13. Jafari, M.K., Sha�ee, A., and Razmkhah, A. \Dynamicproperties of �ne grained soils in south of Tehran", SoilDynamics and Earthquake Engineering, 4, pp. 25-35(2002).

14. Kiku, H., Yoshida, N., Yasuda, S., Irisawa, T.,Nakazawa. H., Shimizu. Y., Ansal, A., and Erkan, A.\In situ penetration tests and soil pro�ling in Ada-pazari, Turkey", In Proceedings of the ICSMGE/TC4Satellite Conference on Lessons Learned from RecentStrong Earthquakes, pp. 259-265 (2001).

15. Lee, SHH. \Regression models of shear wave veloci-ties", Journal of the Chinese Institute of Engineers,13, pp. 519-532 (1990).

16. Ohsaki, Y. and Iwasaki, R. \On dynamic shear moduliand Poisson's ratio of soil deposits", Soils and Foun-dations, 13(4), pp. 61-73 (1973).

17. Ohta, Y. and Goto, N. \Empirical shear wave velocityequations in terms of characteristics soil indexes",Earthquake Engineering and Structural Dynamics, 6,pp. 167-187 (1978).

18. Pitilakis, K.D., Anastasiadis, A., and Raptakis, D.\Field and laboratory determination of dynamic prop-erties of natural soil deposits", In Proceedings of the10th World Conference on Earthquake Engineering,Rotherdam, pp. 1275-1280 (1992).

19. Seed, H.B. and Idriss, I.M. \Evaluation of liquefactionpotential sand deposits based on observation of per-formance in previous earthquakes", Preprint 81-544,In Situ Testing to Evaluate Liquefaction Susceptibil-ity, ASCE National Convention, Missouri, pp. 81-544(1981).

20. Sykora, D.E. and Stokoe, K.H. \Correlations of in-situmeasurements in sands of shear wave velocity", SoilDynamics and Earthquake Engineering, 20, pp. 125-136 (1983).

21. Dehghan Nayeri, G., Dehghan Nayeri, D., andBarkhordari, K. \A new statistical correlation betweenshear wave velocity and penetration resistance of soilsusing genetic programming", Electronic Journal ofGeotechnical Engineering, 18, pp. 2071-2078 (2013).

22. Sivrikaya, O. \Comparison of arti�cial neural networksmodels with correlative works on undrained shearstrength", Eurasian Soil Science, 42(13), pp. 1487-1496, Pleiades Publishing, Ltd (2009).

23. Dehghan, S., Sattari, Gh., Chehreh chelghani, S., andAliabadi, M.A. \Prediction of uniaxial compressivestrength and modulus of elasticity for Travertine sam-ples using regression and arti�cial neural networks",Mining Science and Technology, 20, pp. 0041-0046(2010).

24. Sarmadian, F. and Keshavarzi, A. \Developing pedo-transfer functions for estimating some soil propertiesusing arti�cial neural network and multivariate regres-sion approaches", International Journal of Environ-mental and Earth Sciences, 1(1), pp. 31-37 (2010).

25. Schaap, M.G., Leij, F.J., and Van Genuchten, M.Th.\Neural network analysis for hierarchical predictionof soil hydraulic properties", Soil Science Society ofAmerica Journal, 62, pp. 847-855 (1998).

26. Maleki, S., Moradzadeh, A., Ghavami Riabi, R.,Gholami, R., and Sadeghzadeh, F. \Prediction of shearwave velocity using empirical correlations and arti�cialintelligence methods", NRIAG Journal of Astronomyand Geophysics, 3, pp. 70-81 (2014).

27. Mohammadi, H. and Rahmannejad, R. \The estima-tion of rock mass deformation modulus using regres-sion and arti�cial neural network analysis", ArabianJournal for Science and Engineering, 35(1A), pp. 67-77 (2009).

28. Gunaydm, O. \Estimation of soil compaction param-eters by using statistical analyses and arti�cial neuralnetworks", Environ. Geol., 57, pp. 203-215 (2009).

29. Sudha Rani, Ch. \Arti�cial neural networks (ANNs)for prediction of engineering properties of soils", Inter-national Journal of Innovative Technology and Explor-ing Engineering (IJITEE), 3(1), pp. 123-130 (2013).

Page 12: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

1954 O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955

30. Khanlari, G.R., Heidari, M., Momeni, A.A., andAbdilor, Y. \Prediction of shear strength parameters ofsoils using arti�cial neural networks and multivariateregression methods", Engineering Geology, 131-132,pp. 11-18 (2012).

31. Mola-Abasi, H. and Shooshpasha, I. \Prediction ofzeolite-cement-sand uncon�ned compressive strengthusing polynomial neural network", The EuropeanPhysical Journal Plus, 131(4), pp. 1-12 (2016).

32. Park, H.I. \Development of neural network model toestimate the permeability coe�cient of soils", MarineGeosources and Geotechnology, 29(4), pp. 267-278(2011).

33. Harini, H.N. and Naagesh, S. \Predicting CBR of�ne grained soils by arti�cial neural network andmultiple linear regression", International Journal ofCivil Engineering and Technology (IJCIET), 5(2), pp.119-126 (2014).

34. Moayed, R.Z., Kordnaeij, A., and Mola-Abasi, H.\Compressibility indices of saturated clays by groupmethod of data handling and genetic algorithms",Neural Computing and Applications, pp. 1-14 (2016).

35. Mola-Abasi, H. and Shooshpasha, I. \Prediction ofcompression index of saturated clays (Cc) using poly-nomial models", Scientia Iranica, 23(2), pp. 500-507(2016).

36. Kordnaeij, A., Kalantary, F., Kordtabar, B., andMola-Abasi, H. \Prediction of recompression indexusing GMDH-type neural network based on geotech-nical soil properties", Soils and Foundations, 55(6),pp. 1335-1345 (2015).

37. Das, S.K. and Basudhar, P.K. \Undrained lateral loadcapacity of piles in clay using arti�cial neural network",Computers and Geotechnics, 33, pp. 454-459 (2006).

38. Teh, C.I., Wong, K.S., Goh, A.T.C., and Jaritngam,S. \Prediction of pile capacity using neural networks",J. Computing in Civil Engineering, ASCE, 11(2), pp.129-138 (1997).

39. Sivakugan, N., Eckersley, J.D., and Li, H. \Settlementpredictions using neural networks", Australian CivilEngineering Transactions, CE40, pp. 49-52 (1998).

40. Mola-Abasi, H., Shooshpasha, I., and Amiri, I. \Pre-diction of liquefaction induced lateral displacementsusing GMDH type neural networks", Global Journalof Scienti�c Researches, 2(1), pp. 21-26 (2014).

41. Goh, A.T.C. \Probabilistic neural network for evaluat-ing seismic liquefaction potential", Canadian Geotech-nical Journal, 39, pp. 219-232 (2002).

42. Kim, Y.S. and Kim, B.K. \Use of arti�cial neuralnetworks in the prediction of liquefaction resistance ofsands", Journal of Geotechnical and GeoenvironmentalEngineering, 132(11), pp. 1502-1504 (2006).

43. Ural, D.N. and Saka, H. \Liquefaction assess-ment by neural networks", Electronic Journalof Geotechnical Engineering, 3, pp. 1-27 (1998).(http://www.ejge.com/ 1998/JourTOC3.htm)

44. Cho, S.E. \Probabilistic stability analyses of slopesusing the ANN-based response surface", Computersand Geotechnics, 36, pp. 787-797 (2009).

45. Ferentinou, M.D. and Sakellariou, M.G. \Computa-tional intelligence tools for the prediction of slopeperformance", Computers and Geotechnics, 34(5), pp.362-384 (2007).

46. Wong, F.S. \Time series forecasting using back-propagation neural networks", Neurocomputing, 2, pp.147-259 (1991).

47. Eskandari, H., Rezaee, M.R., and Mohammadnia, M.\Application of multiple regression and arti�cial neuralnetwork techniques to predict shear wave velocity fromwell log data for a carbonate reservoir, South-WestIran", Cseg Recorder, pp. 42-48 (2004).

48. Moatazedian, I., Rahimpour-Bonab, H., Kadkhodaie-Ilkhchi, A., and Rajoli, M.R. \Prediction of shear andcompressional wave velocities from petrophysical datautilizing genetic algorithms technique: A case study inHendijan and Abuzar �elds located in Persian Gulf",Geopersia, 1, pp. 1-17 (2011).

49. Akhundi, H., Ghafoori, M., and Lashkaripour, G.R.\Prediction of shear wave velocity using arti�cialneural network technique, multiple regression andpetrophysical data: A case study in Asmari reservoir(SW Iran)", Open Journal of Geology, 4, pp. 303-313(2014).

50. Rezaee, M.R., Kadkhodaie Ilkhchi, A., and Barabadi,A. \Prediction of shear wave velocity from petrophysi-cal data utilizing intelligent systems: An example froma sandstone reservoir of Carnarvon Basin, Australia",Journal of Petroleum Science and Engineering, 55, pp.201-212 (2007).

51. Mola-Abasi, H., Dikmen, U., and Shooshpasha, I.\Prediction of shear-wave velocity from CPT data atEskisehir (Turkey) using a polynomial model", NearSurface Geophysics, 13(2), pp. 155-167 (2015).

52. Mola-Abasi, H., Eslami, A., and Tabatabaie Shourijeh,P. \Shear wave velocity by polynomial neural networksand genetic algorithms based on geotechnical soil prop-erties", Arabian Journal for Science and Engineering,38(4), pp. 829-838 (2013).

53. Shooshpasha, I., Kordnaeij, A., Dikmen, U., Mo-laAbasi, H., and Amir, I. \Shear wave velocity bysupport vector machine based on geotechnical soilproperties", Natural Hazards and Earth System Sci-ences Discussions, 2(4), pp. 2443-2461 (2014).

54. Berberian, M. and Ghoreshi, M., Seismic-Fault Haz-ard and Project Engineering of Thermal Power Plantof Nishapur, Seismotectonical Survey, Ministry ofEnergy, Power Engineering Corporation (Moshanir),Tehran (1989) (in Persian).

55. Azadi, A., Javan-Doloei, G.H., Hafezi Moghadas, N.,and Hessami-Azar, K. \Geological, geotechnical andgeophysical characteristics of the Toos fault locatednorth of Mashhad, north-eastern Iran ", Journal of theEarth and Space Physics, 35(4), pp. 17-34 (2010) (inPersian).

Page 13: Predicting shear wave velocity of soil using multiple linear regression …scientiairanica.sharif.edu/article_4263_57852cf72ee... · 2021. 2. 17. · ods, such as simple and multiple

O. Ataee et al./Scientia Iranica, Transactions A: Civil Engineering 25 (2018) 1943{1955 1955

56. Building and Housing Research Center, Iranian Codeof Practice for Seismic Resistant Design of Buildings,Standard No. 2800, 3rd Edn., Tehran, Iran (2007).

57. James, G., Witten, D., Hastie, T., and Tibshirani, R.,An Introduction to Statistical Learning with Applica-tions in R, Springer, New York, Heidelberg Dordrecht,London (2013).

58. Haykin, S., Neural Networks: A Comprehensive Foun-dation, 2nd. Ed. Prentice-Hall, Upper Saddle River,New Jersey, pp. 26-32 (1999).

59. Shahin, M.A., Jaksa, M.B., and Maier, H.R. \Ar-ti�cial neural network applications in geotechnicalengineering", Australian Geomechanics, 36(1), pp. 49-62 (2001).

60. Isik, F. and Ozden, G. \Estimating compaction pa-rameters of �ne and coarse grained soils by meansof arti�cial neural networks", Environmental EarthSciences, 69, pp. 2287-2297 (2013).

61. Kisi, O. \Stream ow forecasting using di�erent arti�-cial neural network algorithms", Journal of HydrologicEngineering. ASCE, 12(5), pp. 532-539 (2007).

62. Kanungo, D.P., Arora, M.K., Sarkar, S., and Gupta,R.P. \A comparative study of conventional, ANN blackbox, fuzzy and combined neural and fuzzy weightingprocedures for landslide susceptibility zonation in Dar-jeeling Himalayas", Engineering Geology, 85, pp. 347-366 (2006).

63. Kartam, N., Flood, I., and Garrett, J.H. \Arti�cialneural networks for civil engineers", Fundamentals andApplications, ASCE, New York (1997).

64. Kayadelen, C. \Estimation of e�ective stress param-eter of unsaturated soils by using arti�cial neuralnetworks", International Journal for Numerical andAnalytical Methods in Geomechanics, 32(9), pp. 1087-1106 (2008).

65. Zhang, G., Patuwo, E.B., and Hu, M.Y. \Forecastingwith arti�cial neural network: The state of the art",International Journal of Forecasting, 14, pp. 35-62(1998).

66. Wang, H.B., Xu, W.Y., and Xu, R.C. \Slope stabilityevaluation using back propagation neural networks",Engineering Geology, 80, pp. 302-315 (2005).

67. Rivals, I. and Personnaz, L. \Neural-network con-struction and selection in nonlinear modeling", IEEETransaction on Neural Networks, 14(4), pp. 804-819(2003).

68. Ghiassi, M. and Nangoy, S. \A dynamic arti�cial neu-ral network model for forecasting nonlinear processes",Computers & Industrial Engineering, 57(1), pp. 287-297 (2009).

Biographies

Omolbanin Ataee is a PhD Student at the Depart-ment of Geology at Ferdowsi University of Mashhad,Iran. Her main areas of research interest are soilmechanics, geostatistics and environmental geology.

Naser Hafezi Moghaddas is currently a Professor ofEngineering Geology at Ferdowsi University of Mash-had. His research interests focus on the landslide, sitee�ect and micro zonation of earthquake, slop stability.

Gholam Reza Lashkaripour is a Professor of Engi-neering Geology at Ferdowsi University of Mashhad.He teaches courses such as environmental geology,hydrology, advanced engineering geology, rock mechan-ics, groundwater and geotechnical problems, geologicalhazards, site investigation, and soils improvement atgraduate and postgraduate levels.

Mehdi Jabbari Nooghabi is an Assistant Professorat the Department of Statistics at Ferdowsi Universityof Mashhad. He taught di�erent courses such as sta-tistical applications in management, statistical qualitycontrol, time series, research method and statisticalconsulting, statistics for managers, business mathemat-ics and statistics, statistical analysis, special topics, ad-vanced applied statistics, statistics meteorology, linearmodels and their application in genetic improvementof farm animals, advanced methods of statistical in-ference, industrial statistics, and multivariate discreteand continuous analysis at graduate and postgraduatelevels.