Upload
sidxxxnitc
View
226
Download
0
Embed Size (px)
Citation preview
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
1/48
Traffic flow forecasting
ASEMINAR REPORT
ON
Traffic Flow Forecasting Using Grey NeuralNetwork Model
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
2/48
Traffic flow forecasting
ABSTRACT
In this Report, a kind of Grey Neural Network (abbreviates GNN) is
proposed which combines grey system theory with neural network, that is,
the GNN model has been built by adding a grey layer before neural input
layer anda white layer after neural output layer Gray neural network can
elaborate advantages of both grey model and neural network, and enhance
further precision of forecasting The GNN model is employed to forecast areal vehicle traffic flow of !ING"#I highway with favor precision and result,
which is firstly applied GNN to traffic flow forecasting $valuation method has
been used for comparing the performance of forecasting techni%ues The
e&periments show that the GNN model is outperformed G' model and neural
network model, and traffic flow forecasting based on GNN is of validity and
easibility In this study, we consider an application of grey system theory to
the time series data forecasting problem, called grey forecasting, where grey
implies incomplete or uncertain, and grey system describes a system lacking
information about structure messages, operation mechanism and or
behavior documents In case of bad data lacking information, grey
forecasting method is known to be effective in time series data analysis e
present the design of grey forecasting model, and compare it with other
methods
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
3/48
Traffic flow forecasting
CONTENTS
*g no
CA!TER "# $NTRO%UCT$ON
++ General-
+- Importance of Traffic orecasting in #ighway
"ector-
+. Need and "trategy of orecasting-
+/ $&periences in Traffic orecasting.
+0 Traffic low orecasting 'odels/
CA!TER ART$F$C$A' NEURA' NET(OR)S *ANN+
-+ hat is
NN1
0
-- #istory of 2NN0
-. hy use NN3
-/ 4iological Inspiration 3
-0 2pplication of 2NN5
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
4/48
Traffic flow forecasting
-6 2NN 'odel and 2rchitecture
-6+ Neuron 'odel++
-6- Network architecture+6
CA!TER ,# GRE- S-STEM TEOR- AN% T$ME SER$ES ANA'-S$S
.+ 4ack Ground of Grey "ystem Theory-7
.- undamental concepts of G"T and its main
contents-+
.. Grey Time "eries 2nalysis-.
./ Grey orecasting 'odel-.
CA!TER.# GRE- NEURA' NET(OR)S
/+ 8onstruction of Grey Neural network
'odel-9
/- $&periment Result and 8omparison of GNN, G' (+, +) :NN
.7
CA!TER/; 8onclusions./
References.0
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
5/48
Traffic flow forecasting
'ist of figures
0g1no
+ "chematic diagram of biological neurons3
- "ingle Input Neuron+-
. #ard
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
6/48
Traffic flow forecasting
3 Neuron with R inputs with 2bbrivated notations+3
9
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
7/48
Traffic flow forecasting
CA!TER "
$NTRO%UCT$ON
Traffic flow forecasting is significant to traffic programming, traffic guide,
traffic controlling, traffic management, traffic security, etc It has become an
emphasis %uestion for discussion in traffic engineering domain and one
kernel study in Intelligent Transportation "ystem Grey system theory and
neural networks have been successfully used to predict traffic Grey system
theory utili=es accumulated generating data instead of original data to build
forecasting model, which makes raw data stochastic weak, or reduces noiseinfluence in a certain e&tent, therefore, intrinsic regularity of data can be
searched easily, and model can be built with relatively little data Neural
network has been a primary nonlinear forecasting method because of its
ability of self>learning, nonlinear map and parallel distributed manipulation
Traffic system is a complicated system with rather great stochastic,
traffic flow possess characteristic of great time>dependent and nonlinear If
combine grey system theory with neural networks to build GNN (Grey Neural
Network), we can e&ploit sufficiently the characteristic of grey system model
re%uiring less data and feature of nonlinear map of neural network, and
develop both advantages, thus raise predicting precision much more In this
paper, a kind of forecasting model combining grey system theory with neural
networks is proposed, which adds a grey layer before neural input layer and
a white layer after neural output layer The GNN model is firstly applied to
forecast a real vehicle traffic flow of !ING"#I highway with favorable
precision and prediction result $valuation methods are used for comparing
the performance of forecasting techni%ues, which show that the GNN model
is outperformed G' model and neural network The e&periment shows that
this kind information manipulation and forecasting method based on GNN is
of validity and feasibility
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
8/48
Traffic flow forecasting
"1" GENERA'
TRAFF$C FORECAST$NG
Traffic flow forecasting is significant in traffic programming, traffic guide,
traffic controlling, traffic management, traffic security etc It has become an
emphasis %uestion for discussion in traffic engineering domain and in
intelligent transportation system orecasting of data is a key element of
management decision making It becomes all the more important when
decision involves huge investments
"1& $M!ORTANCE OF TRAFF$C F'O( FORECAST$NG $N $G(A-SECTOR#
Transportation is a basic infrastructural facility for the economical, social,
cultural and administrative development country It has been recogni=ed that
the sustainable development of an area is dependent on the type and
%uantum of the transportation infrastructure linking the various centers of
human population, employment, economic growth and market centers
ast depleting financial and other resources and over increasing travel needs
call for careful planning and optimum resource utili=ation in the road sector
as all the decisions regarding planning, construction and maintenance of
road sector are based on estimates of the traffic for the design period, it is
necessary to cut down the dependence on the chance while forecasting the
traffic over estimation of traffic will result in more than necessary capital
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
9/48
Traffic flow forecasting
being tied up in a fewer pro?ects, thus preventing other potential pro?ects
being taken up where as under estimation of the traffic will result in
premature failure of the pavement structure, causing heavy financial losses
increased maintenance costs
"1, NEE% AN% STRATEG- OF FORECAST$NG
$&istence in an environment governed by time re%uires allocation of
available time among competing resources in some optimal manner This is
accomplished by making forecasts of future activities and taking the proper
actions as suggested by these forecasts The time series underlying the
process to be forecasts is bound to be influenced by many casual factors
"ome forcing the time series up while conflicting factors act to force the
series down nevertheless it is essential to make forecasts in order to
effectively ad?ust budget and resources
orecasts by e&tending the patterns revealed by smoothing techni%ues, is a
very speculative procedure It must be assumed to start with that past is a
mirror of the future the past trends and cycles will continue in the future this
is seldom the case ,in the end ,mathematical forecasting procedures and
?udgments must work hand in hand thus one must not only smooth the data
and try to e&tend the signal components in to the future but also predict the
impact of unknown factors such as political events, research and inventions,
new land use development ,changes in the present land use ,vehicle use
,change of behavior of vehicle user etc in connections with traffic volumes
The sub?ective evaluations must, in turn, be used to conditions the forecast
obtained from the mathematical forecasting model
"1. E3!ER$ENCES $N TRAFF$C FORECST$NG#
Numbers of methods are available for forecasting ranging from the simplest
methods such as the one using the most recent observations as to forecast
to highly comple& approaches like econometric system of simultaneous
e%uations #owever, the methods for generating forecasts can be broadly
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
10/48
Traffic flow forecasting
classified as %ualitative, depending upon the e&tent to which mathematical
and statistical methods are used
@uantitative methods, market research methods, panel consensus, historical
analogy, visionary forecasts etc, involve sub?ective estimation through the
e&perts opinion from a panel of forecasts
#ence such forecast may differ from panel to panel or e&pert to e&pert
"ometimes the divergence in opinion among the e&pert is so e&tensive that
it becomes hard to imagine any substantial could be placed in the results
An the other hand substantial forecasting procedures e&plicitly define how
the forecast is determined the logic is clearly stated and the operations are
mathematical The methods involve e&amination of historical data to
determine the underlying process generating the variable and assuming that
the process is stableB use this knowledge to e&trapolate the process into the
future The two basic types of these models are time series models and
casual models
8asual models e&ploit the relationship between the time series of interest
and one or more other time series data of casual variables Cnowing the
future values o the casual variables, one can use the model to forecast the
dependent variable 4ut the future value of casual variable may itself be
obtained by forecasting it either by casual models or time series models
#ence this method is comple& to operate "ome of the casual models are
regression analysis, econometric models, input>output modelsB anticipation
surveys etcTime series models use only the time history of the variable
being forecasted in order to develop a model for predicting future values
The selection of appropriate forecasting methods is influenced by the
following factors such as ,
+ orm of forecasts re%uired
- orecasts hori=on, period and interval
. Data availability
/ 2ccuracy re%uired
0 4ehavior of process being forecast
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
11/48
Traffic flow forecasting
6 8ost of development
3 $ase of pattern
9 'anagement comprehension and cooperation
"1/ TRAFF$C F'O( FORECAST$NG MO%E'S#
"everal types of mathematical models currently e&ist and are used to
forecast the traffic flow
These models range from simple regression to complicated transition
probability method An the other hand grey forecasting model and neural
networks, fu==y logic have been applied in traffic flow forecasting to certain
e&tent
Development of traffic forecasting models has been an active area in the last
couple of decades, which constitute a key component of management
decision making The traffic forecasting model, when considered as a system
with inputs of historical and current data and outputs of future data, behaves
in a nonlinear fashion and varies with time of day Traffic data are found to
change abruptly during the transition times of entering or leaving rush hours
2ccurate and real time models are needed to appro&imate the nonlinear
time variant functions between system inputs and outputs from a continuous
stream of training data
There has been a steady increase in both rural and urban freeway traffic in
recent years resulting in congestion in many freeway systems 2ccurate and
timely forecasting of traffic flow is of paramount importance for effective
management of traffic congestion and decision making The basic types of
forecasting models are given below
+ Time series models
-
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
12/48
Traffic flow forecasting
CA!TER &
ART$F$C$A' NEURA' NET(OR)S
&1" (AT $S NEURA' NET(OR)4
2n 2rtificial Neural Network (2NN) is an information processing paradigm
that is inspired by the way biological nervous systems, such as the brain,
process information The key element of this paradigm is the novel structure
of the information processing system It is composed of a large number of
highly interconnected processing elements (neurons) working in unison to
solve specific problems 2NNs, like people, learn by e&le 2n 2NN is
configured for a specific application, such as pattern recognition or data
classification, through a learning process
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
13/48
Traffic flow forecasting
"ome of the background work for the field of neural networks occurred in the
late +5th and early -7th centuries This consisted primarily of
interdisciplinary work in physics, psychology and neurophysiology by such
scientists as #ermann von #elmholt=, $rnst 'ach and Ivan *avlov This early
work emphasi=ed general theories of learning, vision, conditioning, etc,and
did not include specific mathematical models of neuron operation
The modern view of neural networks began in the +5/7s with the work of
arren 'c8ulloch and alter *itts E'c*i/.F, who showed that networks of
artificial neurons could, in principle, compute
any arithmetic or logical function Their work is often acknowledged as the
origin of the neural network field
'c8ulloch and *itts were followed by Donald #ebb , who proposed that
classical conditioning (as discovered by *avlov) is present because of the
properties of individual neurons #e proposed a mechanism for learning in
biological neurons
The first practical application of artificial neural networks came in the late
+507s, with the invention of the perception network and associated learning
rule by rank Rosenblatt Rosenblatt and his colleagues built a perception
network and demonstrated its ability to perform pattern recognition This
early success generated a great deal of interest in neural network research
nfortunately, it was later shown that the basic perception network could
solve only a limited class of problems unfortunately, both RosenblattHs and
indrows networks suffered from the same inherent limitations, #owever,
they were not able to successfully modify their learning algorithms to train
the more comple& networks During the +597s both of these impediments
were overcome, and research in neural networks increased dramatically
New personal computers and workstations, which rapidly grew in capability,
became widely available
In addition, important new concepts were introduced The second key
development of the +597s was the back propagation algorithm for training
multilayer perception networks, which was discovered independently by
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
14/48
Traffic flow forecasting
several different researchers The most influential publication of the back
propagation algorithm was by David Rumelhart and !ames 'c8lelland
ERu'c96F
These new developments reinvigorated the field of neural networks In the
last ten years, thousands of papers have been written, and neural networks
have found many applications The field is bu==ing with new theoretical and
practical work 'any of the advances in neural networks have had to do with
new concepts, such as innovative architectures and training rules !ust as
important has been the availability of powerful new computers on which to
test these new concepts
Neural networks will not only have their day but will have a permanent place,
not as a solution to every problem, but as a tool to be used in appropriate
situations In addition, remember that we still know very little about how the
brain works The most important advances in neural networks almost
certainly lie in the future
&1, (- USE NEURA' NET(OR)S4
Neural networks, with their remarkable ability to derive meaning from
complicated or imprecise data, can be used to e&tract patterns and detect
trends that are too comple& to be noticed by either humans or other
computer techni%ues 2 trained neural network can be thought of as an
e&pert in the category of information it has been given to analyse This
e&pert can then be used to provide pro?ections given new situations of
interest and answer what if %uestions
Ather advantages include; 2daptive learning; 2n ability to learn how to do
tasks based on the data given for training or initial e&perience
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
15/48
Traffic flow forecasting
+ "elf>Argani=ation; 2n 2NN can create its own organi=ation or
representation of the information it receives during learning time
- Real Time Aperation; 2NN computations may be carried out in parallel,
and special hardware devices are being designed and manufactured
which take advantage of this capability
ault Tolerance via Redundant Information 8oding; *artial destruction of a
network leads to the corresponding degradation of performance #owever,
some network capabilities may be retained even with ma?or network damage
&1.Biological $ns0iration#
2n 2rtificial Neural Network (2NN) is an information processing paradigm
that is inspired by the way biological nervous systems, such as the brain,
process information
The brain consists of a large number (appro&imately +7++) of highly
connected elements (appro&imately +7/connections per element) called
neurons or our purposes these neurons have three principal components;
the dendrites, the cell body and the a&on The dendrites are tree>like
receptive networks of nerve fibers that carry electrical signals into the cell
body The cell body effectively sums and thresholds these incoming signals
The a&on is a single long fiber that carries the signal from the cell body out
to other neurons The point of contact between an a&on of one cell and a
dendrite of another cell is called a synapse It is the arrangement of neurons
and the strengths of the individual synapses, determined by a comple&
chemical process that establishes the function of the neural network igure
+ is a simplified schematic diagram of two biological neurons
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
16/48
Traffic flow forecasting
ig;+ "chematic diagram of biological neurons
2rtificial neural networks do not approach the comple&ity of the brain There
are, however, two key similarities between biological and artificial neural
networks irst, the building blocks of both networks are simple
computational devices (although artificial neurons are much simpler than
biological neurons) that are highly interconnected "econd, the connections
between neurons determine the function of the network
It is worth noting that even though biological neurons are very slow when
compared to electrical circuits (+7>.s compared to +7>5s), the brain is able to
perform many tasks much faster than any conventional computer This is in
part because of the massively parallel structure of biological neural
networksB all of the neurons are operating at the same time 2rtificial neural
networks share this parallel structure
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
17/48
Traffic flow forecasting
&1/ A!!'$CAT$ONS
The applications are e&panding because neural networks are good at solving
problems, not ?ust in engineering, science and mathematics, but in medicine,
business, finance and literature as well
Their application to a wide variety of problems in many fields makes them
very attractive 2lso, faster computers and faster algorithms have made it
possible to use neural networks to solve comple& industrial problems that
formerly re%uired too much computation
Neural networks have been applied in many fields 2 list of some applications
mentioned in the literature follows
Aeros0ace
#igh performance aircraft autopilots, flight path simulations, aircraft control
systems, autopilot enhancements, aircraft component simulations, aircraft
component fault detectors
Auto5oti6e
2utomobile automatic guidance systems, warranty activity analy=ers
Banking
8heck and other document readers, credit application evaluators
%efense
eapon steering, target tracking, ob?ect discrimination, facial recognition,
new kinds of sensors, sonar, radar and image signal processing including
data compression, feature e&traction and noise suppression, signalJimage
identification
Electronics
8ode se%uence prediction, integrated circuit chip layout, process control,
chip failure analysis, machine vision, voice synthesis, nonlinear modeling
Entertain5ent
2nimation, special effects, market forecasting
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
18/48
Traffic flow forecasting
Financial
Real estate appraisal, loan advisor, mortgage screening, corporate bond
rating, credit line use analysis, portfolio trading program, corporate financial
analysis, currency price prediction
$nsurance
*olicy application evaluation, product optimi=ation
Manufacturing
'anufacturing process control, product design and analysis, process and
machine diagnosis, real>time particle identification, visual %uality inspection
systems, beer testing, welding %uality analysis, paper %uality prediction,
computer chip %uality analysis, analysis of grinding operations, chemical
product design analysis, machine maintenance analysis, pro?ect bidding,
planning and management, dynamic modeling of chemical process systems
Medical
4reast cancer cell analysis, $$G and $8G analysis, prosthesis design,
optimi=ation of transplant times, hospital e&pense reduction, hospital %uality
improvement, and emergency room test advisement
Ro2oticsTra?ectory control, forklift robot, manipulator controllers, vision systems
S0eec7
"peech recognition, speech compression, vowel classification, te&t to speech
synthesis
Securities
'arket analysis, automatic bond rating, and stock trading advisory systems
Teleco55unications
Image and data compression, automated information services, real>time
translation of spoken language, customer payment processing systems
Trans0ortation
Truck brake diagnosis systems, vehicle scheduling, routing systems
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
19/48
Traffic flow forecasting
&18 ANN MO%E' AN% ARC$TECTURE
&181" NEURON MO%E'
"ingle>Input Neuron#
2 single>input neuron is shown in igure - The scalar input is multiplied by
the scalar weight to form , one of the terms that is sent to the summer The
other input,, is multiplied by a bias and then passed to the summer The
summer output, often referred to as the net input , goes into a transfer
function , which produces the scalar neuron output ("ome authors use the
term activation function rather than transfer function and offset rather than
bias)
The weight corresponds to the strength of a synapse, the cell body is
represented by the summation and the transfer function, and the neuron
output represents the signal on the a&on
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
20/48
Traffic flow forecasting
Fig#& "ING+0 then aK f(.(-)L +0)K f(/0)
The actual output depends on the particular transfer function that is chosen
The bias is much like a weight, e&cept that it has a constant input of
+#owever, if you do not want to have a bias in a particular neuron, it can be
omitted
Note that w and b are both adustab!e scalar parameters of the neuron
Typically the transfer function is chosen by the designer and then the
parameters w and b will be ad?usted by some learning rule so that the
neuron inputJoutput relationship meets some specific goal
Transfer Functions#
The transfer function in igure - may be a linear or a nonlinear function of 2
particular transfer function is chosen to satisfy some specification of the
problem that the neuron is attempting to solve
2 variety of transfer functions have been included and Three of the most
commonly used functions are discussed below
ard 'i5it Transfer Function#
The hard !imit transfer function"shown on the left side of igure . , sets the
output of the neuron to 7 if the function argument is less than 7, or + if its
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
21/48
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
22/48
Traffic flow forecasting
ig;/
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
23/48
Traffic flow forecasting
T24
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
24/48
Traffic flow forecasting
Multi0le;$n0ut Neuron#
eight matri&;
Typically, a neuron has more than one input 2 neuron with R inputs is shown
in igure 6 The individual inputs p+,p-,p. are each weighted by
corresponding elements w+,w-,w.of the weight matri# $
IG;6 '
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
25/48
Traffic flow forecasting
represents the connection to the first (and only) neuron from the second
source
e would like to draw networks with several neurons, each having several
inputs urther, we would like to have more than one layer of neurons Mou
can imagine how comple& such a network might appear if all the lines were
drawn It would take a lot of ink, could hardly be read, and the mass of detail
might obscure the main features Thus, we will use an abbre%iated notation
2 multiple>input neuron using this notation is shown in igure3
IG;3 Neuron with R inputs with 2bbrivated notations
&181& NET(OR) ARC$TECTURES
8ommonly one neuron, even with many inputs, may not be sufficient e
might need five or ten, operating in parallel, in what we will call a layer
A 'ayer of Neurons
2 single>!a&er network of " neurons is shown in igure9 Note that each of
the R inputs is connected to each of the neurons and that the weight matri&
now has " rows
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
26/48
Traffic flow forecasting
IG;9
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
27/48
Traffic flow forecasting
that this weight represents the connection to the third neuron from the
second source
2 layer whose output is the network output is called an output !a&er The
other layers are called hidden
'a&ers( It is shown in fig ):
FI*:)Topology of eed orward Neural Network
Multiple layers:
Now consider a network with several layers $ach layer has its own weight
matri& , its own bias vector b, a net input vector n and an output vector a
e need to introduce some additional notation to distinguish between these
layers e will use superscripts to identify the layers "pecifically, we append
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
28/48
Traffic flow forecasting
the number of the layer as a superscript to the names for each of these
variables Thus, the weight matri& for the first layer is written as +, and the
weight matri& for the second layer is written as -as shown in fig +7
IG;+7 Three layer network
2s shown, there are Rinputs, S+neurons in the first layer, S-neurons in the
second layer, etc 2s noted, different layers can have different numbers of
neurons
The outputs of layers one and two are the inputs for layers two and three
Thus layer - can be viewed as a one>layer network with R K "+inputs, "K"-
neurons, and an "+&"- weight matri& The input to layer - is a+, and the
output is a-
ow to !ick Arc7itecture
*roblem specifications help define the network in the following ways;
+ Number of network inputs K number of problem inputs
- Number of neurons in output layer K number of problem outputs
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
29/48
Traffic flow forecasting
. Autput layer transfer function choice at least partly determined by
*roblem specification of the output
CA!TER ,
,1" TE BAC)GROUN% OF GST
4ased on widespread divisions in activities of scientific research, the highly
synthetic tendency has brought forward many cross>disciplinary research
activities possessing significant methodological meanings The systemsscience has revealed more profoundly and essentially some important
internal relations among the sub?ects, who have deeply promoted the
integrative progress of modem science and technology ith the help of
these newly emerging fields of study, many complicated problems,
unsolvable before, can be resolved successfully and much deeper
understandings about the nature have been brought forward These cross
disciplinary theories include, to say a few, the systems theory, information
theory and cybernetics, which were formulated during the end of the +5/7s,
the theory of dissipative structures, synergetic and fractals, which started to
be known during the end of the +567s and the beginning of +53As, the ultra
circular theory and general systems theory, which have been more maturing
after late +537s
In a systems research, due to noises from both inside and outside of the
system of our concern and the limitation of our cognitive level, the
information people obtain is always uncertain and limited in scope ith the
development of science and technology and the progress of the social
society, peopleHs understanding about the uncertainties of %arious systems is
much more profound than ever before, and the study on uncertainties is also
more in>depth During the later half of -7 century, in the field of systems
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
30/48
Traffic flow forecasting
science and engineering, a variety of systems theories and methodologies on
uncertainty had been emerging constantly or instance, *rofessor long from 8hina It was a new theory and method applicable to the
study of unascertained problems with few data and or poor information Grey
systems theory works on unascertained systems with partially known and
partially unknown information by drawing out valuable information by
generating and developing the partially known information It can describe
correctly and monitor effectively the systemic operational behavior
'any systems, such as social, economic, agricultural, industrial, ecological
biological systems, are named based on the fields and ranges where theresearch sub?ects belong to . In contrary, the name of grey systems is
chosen based on the colors of the sub?ects under investigation or e&le,
in control theory, the darkness of colors has been commonly used to indicate
the degree of clarity of information Ane of the most well accepted
representations is the so>called Pblack bo&Q, which stands for an ob?ect with
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
31/48
Traffic flow forecasting
its internal relations or structure totally unknown to the investigator #ere,
we will use 'ackQ to represent unknown information, PwhiteQ for completely
known information ,and PgreyQ for those information which are partially
known and partially unknown 2ccordingly, we will name the systems with
completely unknown information as black systems, and the systems with
partially known and partially unknown information as grey systems,
respectively
In our daily social economic and scientific research activities, we often face
situations of incomplete information or e&le, in some studies of
agriculture, even though all the information, related to the area which is
planted, the %uality of seeds, fertili=ers, irrigation, et al, is completely
known, it is still difficult to estimate the production %uantity and the
conse%uent annual income due to various unknowns or vague information
related to labor %uality, the level of technology employed, natural
environment, weather conditions, et al 2s for the case of insects control, we
might have known very well the relationship between the special kind of
insect and its Natural enemies 4ut it might still be difficult for us to achieve
the desirable certainty due to the reason that we do not have enough
information regarding the relationship between the insects of our concern
and the baits, its natural enemies and the baits, one natural enemy and
other natural enemies, one kind of insect and other kinds of insects, et al
or each ad?ustment of a price system in our economy, the decision makers
often face the difficulty of not knowing the definite information on the effect
of the price change on consumers, on the prices of goods, et al 2ll li%uid
pressure systems are difficult to control due to some immeasurable
%uantities $lectricity systems are hard to observe because of the stochastic
parameters of the voltage and currents, which is caused by not having
enough knowledge on motion and parameters In a general social or
economic system, it is difficult to analy=e the effect of the input on the
output for the reasons that there do not e&ist clear differences between the
PinteriorQ and the Pe&teriorQ, the system self and its environment, and that
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
32/48
Traffic flow forecasting
the boundary of the system may be sometime easy to tell or on other
occasions difficult to clarify In stochastic works, a same economic variable
could be seen as endogenous by some scholars and e&ternal by some other
scholars The appearance of such a phenomenon is due to the lack of
'odeling information, or the reason that an appropriate systems model has
not been found, or the fact that the right observation and control variables
have not been employed
#aving been developed for more than -7 years, grey "ystems theory has
already built up the framework of a new discipline Its main contents include;
a theory system based on ha=y integration, an analysis system depending on
space of grey incidence, a modeling system with G' as its vital part, a
methodological system on the foundation of grey se%uence generation, and
a technological system 8onstructed mainly by systems analysis, modeling,
forecasting, decision, controlling and optimi=ation #a=y Integration, grey
algebraic system, grey e%uations and grey matri& are the foundation of grey
systems theory, and there are still many problems worth further studying in
order to perfect itself Grey systems analysis consists of mainly grey
incidence analysis, grey clustering and grey statistical evaluation, et al The
generation of grey se%uence relies on functions of se%uence operators
including buffer operator (weakening operator, strengthening operator),
average generation operator, stepwise ratio generation operator, inverse
accumulating generation operator and accumulating generation operator, et
al Grey systems modeling is famished based on the thought of five>step>
modeling 2nd hidden laws are found through the generation of grey
numbers or functions of se%uence operators The new promise of using
discrete data se%uence to construct continuous dynamical differential
e%uations is achieved by interchanging grey difference e%uations with grey
differential e%uations Grey prediction is a %uantitative prediction based on
GM *"
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
33/48
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
34/48
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
35/48
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
36/48
Traffic flow forecasting
That is the forecasting model G' (+, I) by e%(.>a)is based on a
difference e%uation concerning
"ince U(+)
(&(+)(
k))K &(7)
(k),kK+,-,.n from e%n (.>b)the difference can berewritten as
here a is called the development of G', and b is called the grey input
The fifth e%n will be satisfied when, if and only if
hen kK-, .n
here =(+)(k) is the mean of &(+)(k) defined as
here kK-, .n
nder the demand for parallel shooting, e% (0) can therefore be transformed
to
here kK-, .n
here a, b are determined to minimi=e the least s%uare error on
& (+)(k)>(b>a O(+)(k)) where
kK-,.n
ie 'in; $T $
here
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
37/48
Traffic flow forecasting
4ased on identification algorithm E-F, optimal a and b are given by
or the given discrete n th>dimensional se%uence &(7),the forecasting model
is then determined,with a and b shown by e%n(3)and the se%uence &W (+)(k)
is given by
here kK+, -
(9)
Is said to be the response of the G' (+, +)
2ccordingly the following se%uence
Is said to be the G' (+,+) se%uence of the 2GA and
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
38/48
Traffic flow forecasting
Is called the G'(+,+) se%uence while the se%uence
Is called the forecasting se%uence of G' (+, +)
There by, the grey forecasting for a given time series data se%uence &KS&
(7), & (+)& (n) is to determined the correspondent forecasting se%uence
of G' (+, +) by e% (++)
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
39/48
Traffic flow forecasting
CA!TER .
.1" TE CONSTRUCT$ON OF GRE- NEURA' NET(OR)
The grey system theory has been initially presented by Deng 1 The grey
system puts each stochastic variable as a grey %uantity or a grey procedure
that changes within a given range or a certain time period It does not rely
on statistical method to deal with the grey %uantityB instead, it uses grey
generating method to deal with these disorderly and unsystematic raw data
and then changes them into a time series data with regularity In this way,
the stochastic degree of the grey %uantity is reduced, and it is easy for some
functions to characteri=e the grey %uantity Grey Neural Network model has
been built according to above ideology GNN model has three basic parts; a
grey layer, a general neural network (such as back propagation), and a white
layer The grey layer before neural input nodes has accumulated generating
operation (2GA)to initial input data, then these new data generated by the
accumulated generating operation are feed into the network, at last, the
white layer after neural output nodes inverses accumulated generation to
the output data of the network Therefore, the prediction value we need is
obtained The construction of GNN model is shown in fig+
Fig""# t7e construction of grey neural network
5odel
Neural network design includes determining network structure, the number
of layers and the number of neurons in every layer Generally, the neural
network adopts neural network back propagation with three layers, and the
NN learning algorithm is error back propagation
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
40/48
Traffic flow forecasting
by the grey relational analysis, that is, taking into account the relationships
e&isted between several known traffic flow and the prediction value The
value of m can be determined by thorough tests The GNN model mechanism
is described in the following "uppose the neural network in the GNN model
has n input nodes, the original data & (7)with nVl entries taken as training
sample is
where &(7)(i) is the time series data at time i 4ased on the initial se%uence
&(7), a new se%uence &(+)with nVl entries is generated by the, accumulated
generating operation,
where &((k! is derived as follows;
n train samples to train NN
hen the GNN is successfully trained, it can be used to predict traffic flow
The forecast is estimated through one operation of the inverse of the
accumulated generating operation The prediction value of & (7) (n V "+ can
be written as follows
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
41/48
Traffic flow forecasting
where &W(++(nVI) is output value of the Neural Network in GNN model, &W(7)(n
V ++ is output value of the white layer in GNN model, it is prediction value of
&(7) (nV+) at time nVl 4esides the most common method accumulated
generating operation, the grey generating operation done to raw data also
includes multipoint>moving>average, opening the n power or takes the
logarithmic transformation to raw data The original data has been
preprocessed by grey generating operation before feeding into a neural
network the unknown system can be easily characteri=ed by then on linear
function of neural network Thus, the training time of the network can be
shortening, so, while the prediction precision advanced, the convergent
process also can be speeded up
.1& E3!ER$MENT RESU'TS
The time series data of traffic volume in the period of a day from 9: OO to
+3;77at X"#I west in !lNG"#I highway have been used as test data sets,
there are 3-traffic flow data regarding a small car as a unit, and the
sampling interval between two ad?acent data is +7 minutes Three
forecasting model, ie, the Grey Neural Network model, the G' (+,l) grey
model, the Neural Network model are used to forecast this same traffic flow
The time series data from no+ to no6- are used as known data (ie, in>
sample data) to forecast the last +7 data from no6. to no3- (ie, out>of>
sample data) The difference between the actual and the forecast are used
to evaluate the accuracy of the forecasting models our criteria, ie, the
mean root of s%uares error ('R"$), the mean absolute percentage error
('2*$), the ma&imum absolute percentage error('2X2*$), the minimum
absolute percentage error('IN2Y$) are used to compare the performance of
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
42/48
Traffic flow forecasting
the GNN model against other two models, ie, the grey forecasting model
G' *+,l+ and the neural network model
T7e Forecasting Results of GM *"
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
43/48
Traffic flow forecasting
se this neural network model to forecast the last l7 traffic flow data, theforecasting results are showed in tab!e
T7e Forecasting Results of GNN Model#
2pply GNN model to forecasting traffic flow The raw data goes through one
operation of the accumulated generating operation done by the grey layer,
the forecast is estimated through one operation of the inverse of
accumulated generating operation done by the white layer The neural
network in GNN model has .,layers, from the result of the grey relation, the
number of input nodes is /+,+F
The neurons connection weighs and bias of a success trained neural networkin the GNN model are as follows:
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
44/48
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
45/48
Traffic flow forecasting
Table-; the results obtained from three forecasting models and
compares
Transportation division
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
46/48
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
47/48
Traffic flow forecasting
REFERENCES;
+"#>M2N 8#$NY, G2A>$NG @Y, XING>#$ 2NGY, #'>O#ANG
HTR2I8 Introduction of
Time "eries Data 2nalysis using Grey "ystem TheoryQ +559 "econd
International 8onference on Cnowledge>4ased Intelligent $lectronic "ystem,
-+>-. 2pril +559, 2delaide, 2ustralia $ditors, cheng P2 new grey forecasting model based on 4*
neural network and 'arkov chain P"*RING$R
8/12/2019 46862603 Traffic Flow Forecasting Using Grey Neural Network Model
48/48
Traffic flow forecasting
3 "tamatios ZCartalopoulosPND$R"T2NDING A N$R2< N$TARC"
2ND OOM