Upload
eftekhary2010
View
231
Download
0
Embed Size (px)
Citation preview
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 1/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
Genetic Algorithm
Saif Hasan Sagar Chordia Rahul Varshneya
February 6, 2012
GuidePushpak Bhattacharyya
1 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 2/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
INTRODUCTION
2 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 3/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
Introduction
Genetic algorithms are a family of computational modelsbelonging to the class of evolutionary algorithms, part of
artificial intelligence
3 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 4/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
Introduction
Genetic algorithms are a family of computational modelsbelonging to the class of evolutionary algorithms, part of
artificial intelligence
These algorithms encode a potential solution to a specificproblem on a simple chromosome like data structure
3 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
I d i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 5/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
Introduction
Genetic algorithms are a family of computational modelsbelonging to the class of evolutionary algorithms, part of
artificial intelligence
These algorithms encode a potential solution to a specificproblem on a simple chromosome like data structure
Uses techniques inspired by natural evolution such as
inheritance, mutation, selection and crossover
3 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
I t d ti
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 6/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
Introduction
Genetic algorithms are a family of computational modelsbelonging to the class of evolutionary algorithms, part of
artificial intelligenceThese algorithms encode a potential solution to a specificproblem on a simple chromosome like data structure
Uses techniques inspired by natural evolution such as
inheritance, mutation, selection and crossoverThey are often viewed as function optimizers
3 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 7/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
History
First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution
4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 8/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
History
First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution
Idea of inheritance and mutation introduced by Ingo
Rechenberg which is termed as evolution strategy (1965)
4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 9/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
History
First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution
Idea of inheritance and mutation introduced by Ingo
Rechenberg which is termed as evolution strategy (1965)M.J. Walsh introduced evolutionary programming (1966)
4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionI d i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 10/162
IntroductionAlgorithm
TheoryWhy GA?
Applications
IntroductionHistoryMotivationTerminology
History
First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution
Idea of inheritance and mutation introduced by Ingo
Rechenberg which is termed as evolution strategy (1965)M.J. Walsh introduced evolutionary programming (1966)
Later versions introduced population which leads to theGenetic Algorithms
4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionI t d ti
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 11/162
AlgorithmTheory
Why GA?Applications
IntroductionHistoryMotivationTerminology
History
First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution
Idea of inheritance and mutation introduced by Ingo
Rechenberg which is termed as evolution strategy (1965)M.J. Walsh introduced evolutionary programming (1966)
Later versions introduced population which leads to theGenetic Algorithms
In 1975 John Holland published book Adaptation in Naturaland Artificial System. This was the first book to representconcept of adaptive digital systems using mutation, selectionand crossover.
4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionIntroduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 12/162
AlgorithmTheory
Why GA?Applications
IntroductionHistoryMotivationTerminology
Motivation
Evolution is very powerful theory since biological principles likecommon descent and selective breeding have been used forthe benefit of humans
5 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 13/162
AlgorithmTheory
Why GA?Applications
IntroductionHistoryMotivationTerminology
Motivation
Evolution is very powerful theory since biological principles likecommon descent and selective breeding have been used forthe benefit of humans
Living organisms are consummate problem solvers. Theyexhibit a versatility that puts the best computer programs toshame.
5 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 14/162
AlgorithmTheory
Why GA?Applications
IntroductionHistoryMotivationTerminology
Motivation
Evolution is very powerful theory since biological principles likecommon descent and selective breeding have been used forthe benefit of humans
Living organisms are consummate problem solvers. Theyexhibit a versatility that puts the best computer programs toshame.
Most organisms evolve by means of two primary processes:
natural selection and sexual reproduction. The first determineswhich members of population survive and reproduce, and thesecond ensures mixing and recombination among the genes of their offspring. Similar analogy is used in GA.
5 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAl i h
Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 15/162
AlgorithmTheory
Why GA?Applications
IntroductionHistoryMotivationTerminology
Terminology
Search space/ State space : the space of all feasible solutions.
6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAl ith
Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 16/162
AlgorithmTheory
Why GA?Applications
HistoryMotivationTerminology
Terminology
Search space/ State space : the space of all feasible solutions.
Chromosome : a set of genes; a chromosome contains the
solution in form of genes.
6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 17/162
AlgorithmTheory
Why GA?Applications
HistoryMotivationTerminology
Terminology
Search space/ State space : the space of all feasible solutions.
Chromosome : a set of genes; a chromosome contains the
solution in form of genes.Population : a set of solutions (or individuals/chromosomes).
6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Introduction
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 18/162
AlgorithmTheory
Why GA?Applications
HistoryMotivationTerminology
Terminology
Search space/ State space : the space of all feasible solutions.
Chromosome : a set of genes; a chromosome contains the
solution in form of genes.Population : a set of solutions (or individuals/chromosomes).
Generation : the process of evaluation, selection,recombination and mutation.
6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
IntroductionHi
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 19/162
AlgorithmTheory
Why GA?Applications
HistoryMotivationTerminology
Terminology
Search space/ State space : the space of all feasible solutions.
Chromosome : a set of genes; a chromosome contains the
solution in form of genes.Population : a set of solutions (or individuals/chromosomes).
Generation : the process of evaluation, selection,recombination and mutation.
Fitness : the value assigned to an individual based on how faror close it is from the solution; greater the fitness value betterthe solution it contains.
6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
AlgorithmE di
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 20/162
AlgorithmTheory
Why GA?Applications
EncodingOperations of GAParameters of GA
ALGORITHM
7 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
AlgorithmEncoding
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 21/162
gTheory
Why GA?Applications
EncodingOperations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
AlgorithmEncoding
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 22/162
TheoryWhy GA?
Applications
EncodingOperations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
Choose the initial population of individuals
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
AlgorithmEncoding
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 23/162
TheoryWhy GA?
Applications
EncodingOperations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
Choose the initial population of individuals
Evaluate the fitness of each individual in population
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Th
AlgorithmEncoding
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 24/162
TheoryWhy GA?
Applications
EncodingOperations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
Choose the initial population of individuals
Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Th
AlgorithmEncoding
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 25/162
TheoryWhy GA?
Applications
gOperations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
Choose the initial population of individuals
Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:
Selection: Select the individuals with greater fitness forreproduction
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
AlgorithmEncoding
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 26/162
TheoryWhy GA?
Applications
gOperations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
Choose the initial population of individuals
Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:
Selection: Select the individuals with greater fitness forreproductionCrossover: Breed new individuals through crossover
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
AlgorithmEncoding
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 27/162
TheoryWhy GA?
Applications
Operations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
Choose the initial population of individuals
Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:
Selection: Select the individuals with greater fitness forreproductionCrossover: Breed new individuals through crossover
Mutation: Apply probabilistic mutation on new individuals
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
AlgorithmEncodingO f G
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 28/162
TheoryWhy GA?
Applications
Operations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
Choose the initial population of individuals
Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:
Selection: Select the individuals with greater fitness forreproductionCrossover: Breed new individuals through crossover
Mutation: Apply probabilistic mutation on new individualsForm a new population with these offsprings.
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
AlgorithmEncodingO i f GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 29/162
TheoryWhy GA?
Applications
Operations of GAParameters of GA
Algorithm
Psuedocode of Genetics Algorithm
Choose the initial population of individuals
Evaluate the fitness of each individual in population
Repeat until termination condition satisfied:
Selection: Select the individuals with greater fitness forreproductionCrossover: Breed new individuals through crossover
Mutation: Apply probabilistic mutation on new individualsForm a new population with these offsprings.
Terminate
8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
AlgorithmEncodingO ti f GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 30/162
yWhy GA?
Applications
Operations of GAParameters of GA
Flow Chart
9 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
AlgorithmEncodingOperations of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 31/162
yWhy GA?
Applications
Operations of GAParameters of GA
Encoding
Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.
10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
AlgorithmEncodingOperations of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 32/162
Why GA?Applications
Operations of GAParameters of GA
Encoding
Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.
Common approaches are:
Binary Encoding : every chromosome is a string of 0 or 1
10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Wh GA?
AlgorithmEncodingOperations of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 33/162
Why GA?Applications
Operations of GAParameters of GA
Encoding
Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.
Common approaches are:
Binary Encoding : every chromosome is a string of 0 or 1
Permutation Encoding : every chromosome is a string of numbers that represent position in a sequence
10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Wh GA?
AlgorithmEncodingOperations of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 34/162
Why GA?Applications
Operations of GAParameters of GA
Encoding
Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.
Common approaches are:
Binary Encoding : every chromosome is a string of 0 or 1
Permutation Encoding : every chromosome is a string of numbers that represent position in a sequence
Tree Encoding : a tree structure represents the chromosome
10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Wh GA?
AlgorithmEncodingOperations of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 35/162
Why GA?Applications
pParameters of GA
Encoding
Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.
Common approaches are:
Binary Encoding : every chromosome is a string of 0 or 1
Permutation Encoding : every chromosome is a string of numbers that represent position in a sequence
Tree Encoding : a tree structure represents the chromosome
Value Encoding : every chromosome is a sequence of somevalues (real numbers, characters or objects)
10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?
AlgorithmEncodingOperations of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 36/162
Why GA?Applications
Parameters of GA
Encoding Examples
Binary Encoding : Suppose we have a knapsack of capacity C and N items, then we can encode this problem as follows
11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?
AlgorithmEncodingOperations of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 37/162
Why GA?Applications
Parameters of GA
Encoding Examples
Binary Encoding : Suppose we have a knapsack of capacity C and N items, then we can encode this problem as follows
Chromosome, in this case, is a string of 0s and 1s with N bits
11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?
AlgorithmEncodingOperations of GAP f GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 38/162
Why GA?Applications
Parameters of GA
Encoding Examples
Binary Encoding : Suppose we have a knapsack of capacity C and N items, then we can encode this problem as follows
Chromosome, in this case, is a string of 0s and 1s with N bits
Represent item i of problem with i th
bit in the chromosome
11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?
AlgorithmEncodingOperations of GAP t f GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 39/162
y GApplications
Parameters of GA
Encoding Examples
Binary Encoding : Suppose we have a knapsack of capacity C and N items, then we can encode this problem as follows
Chromosome, in this case, is a string of 0s and 1s with N bits
Represent item i of problem with i th
bit in the chromosomei th bit is 1 iff i th item has been selected, 0 otherwise.
11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 40/162
yApplications
Parameters of GA
Encoding Examples
Binary Encoding : Suppose we have a knapsack of capacity C and N items, then we can encode this problem as follows
Chromosome, in this case, is a string of 0s and 1s with N bits
Represent item i of problem with i th
bit in the chromosomei th bit is 1 iff i th item has been selected, 0 otherwise.The set of all such chromosomes (2N ) is the solution space of the problem.
11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 41/162
ApplicationsParameters of GA
Encoding Examples
Binary Encoding : Suppose we have a knapsack of capacity C and N items, then we can encode this problem as follows
Chromosome, in this case, is a string of 0s and 1s with N bits
Represent item i of problem with i th
bit in the chromosomei th bit is 1 iff i th item has been selected, 0 otherwise.The set of all such chromosomes (2N ) is the solution space of the problem.
Chromosome 1: 1 0 1 1 0 0 1 0 1 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1
Chromosome 2: 1 1 1 1 1 1 1 0 0 0 0 0 1 1 0 0 0 0 0 1 1 1 1 1The example shown above has 24 items (and therefore 24 bits)with item1 selected in both chromosome 1 and 2 whereasitem2 is selected in chromosome 2 but not in chromosome 1.
11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 42/162
ApplicationsParameters of GA
Encoding Examples
Permutation Encoding : Travelling Salesman Problem
12/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?A li i
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 43/162
ApplicationsParameters of GA
Encoding Examples
Permutation Encoding : Travelling Salesman Problem
Problem descripition : There are cities and given distancesbetween them. Travelling salesman has to visit all of them, but
he doesn’t want to travel more than necessary. Find asequence of cities with a minimal travelled distance.
12/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?A li ti
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 44/162
Applications
Encoding Examples
Permutation Encoding : Travelling Salesman Problem
Problem descripition : There are cities and given distancesbetween them. Travelling salesman has to visit all of them, but
he doesn’t want to travel more than necessary. Find asequence of cities with a minimal travelled distance.
Chromosome A: 1 5 3 2 6 4 7 9 8
Chromosome B: 8 5 6 7 2 3 1 4 9
Encoding : Here, encoded chromosomes describe the order of
cities the salesman visits. For example, in chromosome A, thesalesman visits city-1 followed by city-5 followed by city-3 andso on.
12/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 45/162
Applications
Encoding Examples
Tree Encoding : Genetic Programming
13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 46/162
Applications
Encoding Examples
Tree Encoding : Genetic Programming
In tree encoding, every chromosome is a tree of some objects,such as functions or commands in programming language.
13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 47/162
Applications
Encoding Examples
Tree Encoding : Genetic Programming
In tree encoding, every chromosome is a tree of some objects,such as functions or commands in programming language.Tree encoding is useful for evolving programs or any otherstructures that can be encoded in trees.
13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 48/162
Applications
Encoding Examples
Tree Encoding : Genetic Programming
In tree encoding, every chromosome is a tree of some objects,such as functions or commands in programming language.Tree encoding is useful for evolving programs or any otherstructures that can be encoded in trees.The crossover and mutation can be done relatively easy way .
13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 49/162
pp
Encoding Examples
Tree Encoding : Genetic Programming
In tree encoding, every chromosome is a tree of some objects,such as functions or commands in programming language.Tree encoding is useful for evolving programs or any otherstructures that can be encoded in trees.The crossover and mutation can be done relatively easy way .
Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf
13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 50/162
Operations of Genetic Algorithm
Genetic operators used in GA maintain genetic diversity.
14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 51/162
Operations of Genetic Algorithm
Genetic operators used in GA maintain genetic diversity.
Genetic diversity or variation is a necessity for evolution.
14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 52/162
Operations of Genetic Algorithm
Genetic operators used in GA maintain genetic diversity.
Genetic diversity or variation is a necessity for evolution.Genetic operators are analogous to those which occur in thenatural world:
14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 53/162
Operations of Genetic Algorithm
Genetic operators used in GA maintain genetic diversity.
Genetic diversity or variation is a necessity for evolution.
Genetic operators are analogous to those which occur in thenatural world:
Reproduction (or Selection)
14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 54/162
Operations of Genetic Algorithm
Genetic operators used in GA maintain genetic diversity.
Genetic diversity or variation is a necessity for evolution.
Genetic operators are analogous to those which occur in thenatural world:
Reproduction (or Selection)Crossover (or Recombination)
14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 55/162
Operations of Genetic Algorithm
Genetic operators used in GA maintain genetic diversity.
Genetic diversity or variation is a necessity for evolution.
Genetic operators are analogous to those which occur in thenatural world:
Reproduction (or Selection)Crossover (or Recombination)
Mutation
14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 56/162
Reproduction or Selection
Concept : From the population, the chromosomes are selectedto be parents to crossover and produce offspring.
15/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 57/162
Reproduction or Selection
Concept : From the population, the chromosomes are selectedto be parents to crossover and produce offspring.
Problem : How to select these chromosomes ?
15/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 58/162
Reproduction or Selection
Concept : From the population, the chromosomes are selectedto be parents to crossover and produce offspring.
Problem : How to select these chromosomes ?
Hint : According to Charles Darwin’s evolution theory”survival of the fittest” - the best ones should survive andcreate new offspring.
15/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 59/162
Reproduction or Selection
Concept : From the population, the chromosomes are selectedto be parents to crossover and produce offspring.
Problem : How to select these chromosomes ?
Hint : According to Charles Darwin’s evolution theory”survival of the fittest” - the best ones should survive andcreate new offspring.
Solution : Fitness function quantifies the optimality of a
solution (chromosome) so that a particular solution may beranked against all the other solutions. The function depictsthe closeness of a given ’solution’ to the desired result.
15/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 60/162
Reproduction or Selection
Popular methods of selection include :
16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
R d i S l i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 61/162
Reproduction or Selection
Popular methods of selection include :
Roulette-wheel selection
16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
R d i S l i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 62/162
Reproduction or Selection
Popular methods of selection include :
Roulette-wheel selection
Tournament selection
16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
R d i S l i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 63/162
Reproduction or Selection
Popular methods of selection include :
Roulette-wheel selection
Tournament selectionRank selection
16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
R d ti S l ti
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 64/162
Reproduction or Selection
Popular methods of selection include :
Roulette-wheel selection
Tournament selectionRank selection
Steady-state selection
16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
R d ti S l ti
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 65/162
Reproduction or Selection
Popular methods of selection include :
Roulette-wheel selection
Tournament selectionRank selection
Steady-state selection
Boltzmann selection
16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Reproduction or Selection
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 66/162
Reproduction or Selection
Popular methods of selection include :
Roulette-wheel selection
Tournament selectionRank selection
Steady-state selection
Boltzmann selection
Scaling selection
16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Roulette Wheel Selection
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 67/162
Roulette-Wheel Selection
Concept : the chance of an individual’s being selected isproportional to its fitness, greater or less than its competitors’fitness.
17/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Roulette Wheel Selection
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 68/162
Roulette-Wheel Selection
Concept : the chance of an individual’s being selected isproportional to its fitness, greater or less than its competitors’fitness.
17/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Roulette Wheel Selection
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 69/162
Roulette-Wheel Selection
Concept : the chance of an individual’s being selected isproportional to its fitness, greater or less than its competitors’fitness.
Implementation : Probability of selection of i th individual is:p i = f i
ΣN j =1f j
where f i :fitness of i th individual, N : number of individuals
Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf
17/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Elitist Selection
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 70/162
Elitist Selection
Concept : Most fit members of each generation areguaranteed to be selected for next generation.
18/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Elitist Selection
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 71/162
Elitist Selection
Concept : Most fit members of each generation areguaranteed to be selected for next generation.
Advantages :
18/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheory
Why GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Elitist Selection
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 72/162
Elitist Selection
Concept : Most fit members of each generation areguaranteed to be selected for next generation.
Advantages :Ensures that the best solution found so far is not lost due tocrossover and mutation.
18/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Elitist Selection
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 73/162
Elitist Selection
Concept : Most fit members of each generation areguaranteed to be selected for next generation.
Advantages :Ensures that the best solution found so far is not lost due tocrossover and mutation.Speeds up convergence once a good solution has beendiscovered.
18/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 74/162
Crossover
Concept : Selects genes from parent chromosomes, combinesthem and creates a new offspring.
19/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 75/162
Crossover
Concept : Selects genes from parent chromosomes, combinesthem and creates a new offspring.
Idea : New chromosome may be better than both of theparents if it takes the best characteristics from each of them
19/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 76/162
Concept : Selects genes from parent chromosomes, combinesthem and creates a new offspring.
Idea : New chromosome may be better than both of theparents if it takes the best characteristics from each of them
Consider the two parents selected for crossover.
19/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 77/162
Concept : Selects genes from parent chromosomes, combinesthem and creates a new offspring.
Idea : New chromosome may be better than both of theparents if it takes the best characteristics from each of them
Consider the two parents selected for crossover.
Interchange the parents chromosomes after crossover points.The offsprings produced are :
Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf
19/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 78/162
The Crossover operators are of many types.
20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 79/162
The Crossover operators are of many types.
Single-Point crossover
20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 80/162
The Crossover operators are of many types.
Single-Point crossoverTwo Point crossover
20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 81/162
The Crossover operators are of many types.
Single-Point crossoverTwo Point crossoverUniform crossover
20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 82/162
The Crossover operators are of many types.
Single-Point crossoverTwo Point crossoverUniform crossoverArithmetic crossover
20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 83/162
The Crossover operators are of many types.
Single-Point crossoverTwo Point crossoverUniform crossoverArithmetic crossover
Which Crossover operator is to be selected is based onchromosome encoding
20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 84/162
The Crossover operators are of many types.
Single-Point crossoverTwo Point crossoverUniform crossoverArithmetic crossover
Which Crossover operator is to be selected is based onchromosome encoding
Specific crossover made for a specific problem can improveperformance of the genetic algorithm
20/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 85/162
The Crossover operators are of many types.
Single-Point crossoverTwo Point crossoverUniform crossoverArithmetic crossover
Which Crossover operator is to be selected is based onchromosome encoding
Specific crossover made for a specific problem can improveperformance of the genetic algorithm
Some research suggests more than two “parents” are better toreproduce a good quality chromosome (Eiben, A.E. et al (1994),
Ting, Chuan-Kang (2005))
20/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Two-Point Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 86/162
Operation : randomly select two crossover points within achromosome, then interchange the two parent chromosomesbetween these points to produce two new offspring.Consider the two parents selected for crossover.
21/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Uniform Crossover
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 87/162
Operation : mixing ratio decides the contribution of eachparent to the gene values in the offspring chromosomes.
Advantage : allows the parent chromosomes to be mixed atthe gene level rather than the segment level
Consider the two parents selected for crossover.
If the mixing ratio is 0.5 approximately, then the possible set of
offsprings after crossover would be :
Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf
22/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
Introduction
AlgorithmTheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 88/162
Concept : Mutation alters one or more gene values in achromosome from its initial state.
23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 89/162
Concept : Mutation alters one or more gene values in achromosome from its initial state.
Advantages :
23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 90/162
Concept : Mutation alters one or more gene values in achromosome from its initial state.
Advantages :
Mutation can generate new genes values not already present in
sample space which can lead to better solution.
23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 91/162
Concept : Mutation alters one or more gene values in achromosome from its initial state.
Advantages :
Mutation can generate new genes values not already present in
sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).
23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 92/162
Concept : Mutation alters one or more gene values in achromosome from its initial state.
Advantages :
Mutation can generate new genes values not already present in
sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).
Operators : Mutation operators are of many type :
23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 93/162
Concept : Mutation alters one or more gene values in achromosome from its initial state.
Advantages :
Mutation can generate new genes values not already present in
sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).
Operators : Mutation operators are of many type :
one simple way is, Flip Bit.
23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 94/162
Concept : Mutation alters one or more gene values in achromosome from its initial state.
Advantages :
Mutation can generate new genes values not already present in
sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).
Operators : Mutation operators are of many type :
one simple way is, Flip Bit.the others are Boundary, Uniform, and Gaussian.
23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 95/162
Concept : Mutation alters one or more gene values in achromosome from its initial state.
Advantages :
Mutation can generate new genes values not already present in
sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).
Operators : Mutation operators are of many type :
one simple way is, Flip Bit.the others are Boundary, Uniform, and Gaussian.
Operators are selected based on encoding of chromosomes.
23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Flip Bit
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 96/162
The mutation operator simply inverts the value of the chosengene i.e. 0 goes to 1 and 1 goes to 0.
Consider the two original offsprings selected for mutation.
The Mutated Off-spring produced are :
Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf
24/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Parameters of Genetic Algorithm
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 97/162
There are three basic parameters of Genetic Algorithm.
25/ 42 Saif Hasa Saga Cho dia Rah l Va sh e a Ge etic Algo ith
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Parameters of Genetic Algorithm
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 98/162
There are three basic parameters of Genetic Algorithm.
Crossover Probability
25/ 42 S if H S Ch di R h l V h G ti Al ith
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Parameters of Genetic Algorithm
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 99/162
There are three basic parameters of Genetic Algorithm.
Crossover ProbabilityMutation Probability
25/ 42 S if H S Ch di R h l V h G ti Al ith
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Parameters of Genetic Algorithm
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 100/162
There are three basic parameters of Genetic Algorithm.
Crossover ProbabilityMutation Probability
Population Size
25/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 101/162
Definition : Crossover probability represents how oftencrossover is performed.
26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 102/162
Definition : Crossover probability represents how oftencrossover is performed.
Constraint :
26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 103/162
Definition : Crossover probability represents how oftencrossover is performed.
Constraint :
If the crossover rate is too high, high performance strings are
eliminated faster than selection can produce improvements.
26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 104/162
Definition : Crossover probability represents how oftencrossover is performed.
Constraint :
If the crossover rate is too high, high performance strings are
eliminated faster than selection can produce improvements.A low crossover rate may cause stagnation due to the lowerexploration rate.
26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 105/162
Definition : Crossover probability represents how oftencrossover is performed.
Constraint :
If the crossover rate is too high, high performance strings are
eliminated faster than selection can produce improvements.A low crossover rate may cause stagnation due to the lowerexploration rate.
Solution : Crossover rate generally should be high, about80%-95%.
26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Crossover Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 106/162
Definition : Crossover probability represents how oftencrossover is performed.
Constraint :
If the crossover rate is too high, high performance strings are
eliminated faster than selection can produce improvements.A low crossover rate may cause stagnation due to the lowerexploration rate.
Solution : Crossover rate generally should be high, about80%-95%.Some results show that for some problems crossover rateabout 60% is the best.
26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 107/162
Defintion : Mutation probability represents how oftenmutation is performed.
27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Algorithm
EncodingOperations of GAParameters of GA
Mutation Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 108/162
Defintion : Mutation probability represents how oftenmutation is performed.
Constraints :
27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Mutation Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 109/162
Defintion : Mutation probability represents how oftenmutation is performed.
Constraints :
A very small mutation rate may lead to convergence to localoptima areas.
27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Mutation Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 110/162
Defintion : Mutation probability represents how oftenmutation is performed.
Constraints :
A very small mutation rate may lead to convergence to localoptima areas.A mutation rate that is too high results in almost randomsearch.
27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Mutation Probability
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 111/162
Defintion : Mutation probability represents how oftenmutation is performed.
Constraints :
A very small mutation rate may lead to convergence to localoptima areas.A mutation rate that is too high results in almost randomsearch.
Solution :Best rates reported are about 0.5%-1%.
27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Population Size
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 112/162
Definition : Number of chromosomes in population (in onegeneration).
28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
AlgorithmEncodingOperations of GAParameters of GA
Population Size
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 113/162
Definition : Number of chromosomes in population (in onegeneration).
Constraints :
28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Population Size
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 114/162
Definition : Number of chromosomes in population (in onegeneration).
Constraints :
Too few chromosomes implies GA have a few possibilities toperform crossover and only a small part of search space isexplored.
28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Population Size
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 115/162
Definition : Number of chromosomes in population (in onegeneration).
Constraints :
Too few chromosomes implies GA have a few possibilities toperform crossover and only a small part of search space isexplored.Too many chromosomes implies GA slows down.
28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
AlgorithmEncodingOperations of GAParameters of GA
Population Size
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 116/162
Definition : Number of chromosomes in population (in onegeneration).
Constraints :
Too few chromosomes implies GA have a few possibilities toperform crossover and only a small part of search space isexplored.Too many chromosomes implies GA slows down.
Solution : Good population size is about 20-30, however
sometimes sizes 50-100 are reported as best.
28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 117/162
Why Genetic Algorithms Work?
29/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Schema and HyperPlane
Schema - solution string with some blank fields
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 118/162
geg: 01***********
30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Schema and HyperPlane
Schema - solution string with some blank fields
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 119/162
geg: 01***********
Solution is combination of these schemas. Schema representsa particular component of solution.
30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Schema and HyperPlane
Schema - solution string with some blank fields
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 120/162
geg: 01***********
Solution is combination of these schemas. Schema representsa particular component of solution.
Solution space : N-dimensional HyperCube
30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Schema and HyperPlane
Schema - solution string with some blank fields
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 121/162
eg: 01***********
Solution is combination of these schemas. Schema representsa particular component of solution.
Solution space : N-dimensional HyperCube
Schema : HyperPlane
30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Schema and HyperPlane
Schema - solution string with some blank fields
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 122/162
eg: 01***********
Solution is combination of these schemas. Schema representsa particular component of solution.
Solution space : N-dimensional HyperCubeSchema : HyperPlane
In 3D cube, 0** represent front face.
30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Schema and HyperPlane
Schema - solution string with some blank fields
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 123/162
eg: 01***********
Solution is combination of these schemas. Schema representsa particular component of solution.
Solution space : N-dimensional HyperCubeSchema : HyperPlane
In 3D cube, 0** represent front face.
There is competition between Schema with n bit values insame positions.e g:- 00*, 01*, 10*, 11* are competing
Winner is the schema with highest fitness.
30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Implicit Parallelism
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 124/162
A solution string belongs to many HyperPlanes (2N −1).eg: 010 belongs to 0** , *1*, **0
31/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Implicit Parallelism
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 125/162
A solution string belongs to many HyperPlanes (2N −1).eg: 010 belongs to 0** , *1*, **0
Single Evaluation of string leads to evaluation of different
hyperplanes in an implicitly parallel fashion (John Holland 1975
);
31/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Implicit Parallelism
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 126/162
A solution string belongs to many HyperPlanes (2N −1).eg: 010 belongs to 0** , *1*, **0
Single Evaluation of string leads to evaluation of different
hyperplanes in an implicitly parallel fashion (John Holland 1975
);Evaluation of population of strings, samples far morehyperplanes as compared to number of strings contained inthe population.
31/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
Implicit Parallelism
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 127/162
A solution string belongs to many HyperPlanes (2N −1).eg: 010 belongs to 0** , *1*, **0
Single Evaluation of string leads to evaluation of differenthyperplanes in an implicitly parallel fashion (John Holland 1975 );
Evaluation of population of strings, samples far morehyperplanes as compared to number of strings contained inthe population.
These cumulative effects provides statistical information to
GA about any particular subset of hyperplanes.
31/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?Applications
Schema and HyperPlane
Implicit ParallelismThe Schema Theorem
The Schema Theorem
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 128/162
32/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Schema and HyperPlaneImplicit ParallelismThe Schema Theorem
The Schema Theorem
The Schema Theorem (Holland 1992; Goldberg 1989)
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 129/162
The Schema Theorem (Holland 1992; Goldberg 1989 ).It provides a lower bound on the change in the sample rate fora single hyperplane from generation t to generation t + 1.
32/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Schema and HyperPlaneImplicit ParallelismThe Schema Theorem
The Schema Theorem
The Schema Theorem (Holland 1992; Goldberg 1989)
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 130/162
The Schema Theorem (Holland 1992; Goldberg 1989 ).It provides a lower bound on the change in the sample rate fora single hyperplane from generation t to generation t + 1.
Equation:
32/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Schema and HyperPlaneImplicit ParallelismThe Schema Theorem
The Schema Theorem
The Schema Theorem (Holland 1992; Goldberg 1989)
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 131/162
The Schema Theorem (Holland 1992; Goldberg 1989 ).It provides a lower bound on the change in the sample rate fora single hyperplane from generation t to generation t + 1.
Equation:
Building Blocks Hypothesis (Holland, 1975; Gold-berg, 1989 )Low-order, highly-fit schemas recombine to form even betterschemas.
In Goldberg’s words, “we construct better and better stringsfrom the best partial solutions of past samplings”
32/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Advantages
Disadvantages
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 132/162
WHY GA?
33/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Advantages
Disadvantages
Advantages
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 133/162
Implicit Parallelism - Solution Space is explored in multipledirections (GoldBerg - GA in Search and Optimization)
34/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Advantages
Disadvantages
Advantages
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 134/162
Implicit Parallelism - Solution Space is explored in multipledirections (GoldBerg - GA in Search and Optimization)
Nonlinear problems -Large Solution space, but GA areideal.(Forrest - 1993 Genetic Algorithm)
34/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Advantages
Disadvantages
Advantages
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 135/162
Implicit Parallelism - Solution Space is explored in multipledirections (GoldBerg - GA in Search and Optimization)
Nonlinear problems -Large Solution space, but GA areideal.(Forrest - 1993 Genetic Algorithm)
Works on complex landscape (discontinuous, noisy, changingwith time) (John Koza - Genetic Programming IV 2004 )
34/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Advantages
Disadvantages
Advantages
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 136/162
Dilemma of global optimum vs many local optima. GA strikeperfect balance (John Holland - Genetic Algorithm 1992 )
35/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Advantages
Disadvantages
Advantages
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 137/162
Dilemma of global optimum vs many local optima. GA strikeperfect balance (John Holland - Genetic Algorithm 1992 )
GA can manipulate many parameters simultaneously (Forrest -
Genetic algorithms: principles of natural selection applied to computation.1993 )
35/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
TheoryWhy GA?
Applications
Advantages
Disadvantages
Advantages
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 138/162
Dilemma of global optimum vs many local optima. GA strikeperfect balance (John Holland - Genetic Algorithm 1992 )
GA can manipulate many parameters simultaneously (Forrest -
Genetic algorithms: principles of natural selection applied to computation.1993 )
GA don’t have specific knowledge of problem. All possiblesearch pathways are considered in GA.(John Koza - Genetic
Programming III 1999 )
35/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Advantages
Disadvantages
Disadvantages
Computationally expensive and time consuming
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 139/162
Computationally expensive and time consuming
36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Advantages
Disadvantages
Disadvantages
Computationally expensive and time consuming
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 140/162
Computationally expensive and time consuming
Issues in representation of problem
36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Advantages
Disadvantages
Disadvantages
Computationally expensive and time consuming
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 141/162
Computationally expensive and time consuming
Issues in representation of problem
Proper writing of fitness function
36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Advantages
Disadvantages
Disadvantages
Computationally expensive and time consuming
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 142/162
Computationally expensive and time consuming
Issues in representation of problem
Proper writing of fitness function
Proper values of size of population, crossover and mutationrate
36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Advantages
Disadvantages
Disadvantages
Computationally expensive and time consuming
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 143/162
Computationally expensive and time consuming
Issues in representation of problem
Proper writing of fitness function
Proper values of size of population, crossover and mutationrate
Deceptive Fitness Function (Mitchell, Melanie 1996 )
36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Advantages
Disadvantages
Disadvantages
Computationally expensive and time consuming
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 144/162
p y p g
Issues in representation of problem
Proper writing of fitness function
Proper values of size of population, crossover and mutationrate
Deceptive Fitness Function (Mitchell, Melanie 1996 )
Premature Convergence
36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Advantages
Disadvantages
Disadvantages
Computationally expensive and time consuming
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 145/162
p y p g
Issues in representation of problem
Proper writing of fitness function
Proper values of size of population, crossover and mutationrate
Deceptive Fitness Function (Mitchell, Melanie 1996 )
Premature Convergence
No one mathematically perfect solution since problems of biological adaptation don’t have this issue.
36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Applications
Aeronautics
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 146/162
APPLICATIONS
37/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Applications
Aeronautics
Applications
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 147/162
Image courtesy: http://www.google.com
38/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
Applications
Aeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraft
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 148/162
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraft
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 149/162
Four major considerations for wing design
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraftF j id i f i d i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 150/162
Four major considerations for wing design
Minimizing aerodynamic drag at supersonic cruising speeds
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraftF j id i f i d i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 151/162
Four major considerations for wing design
Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speeds
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraftF j id ti f i d i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 152/162
Four major considerations for wing design
Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraftF j id ti f i d i
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 153/162
Four major considerations for wing design
Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)Minimizing twisting moment of wing
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraftFour major considerations for wing design
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 154/162
Four major considerations for wing design
Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)Minimizing twisting moment of wing
Objectives are mutually exclusive and optimizing themrequires tradeoff
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraftFour major considerations for wing design
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 155/162
Four major considerations for wing design
Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)
Minimizing twisting moment of wing
Objectives are mutually exclusive and optimizing themrequires tradeoff
Chromosomes - 66 real valued numbers, with population size -
64 and simulated for 70 generations.
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Aeronautics
Multiple-objective genetics algorithm to design wing shape for
supersonic aircraftFour major considerations for wing design
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 156/162
Four major considerations for wing design
Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)
Minimizing twisting moment of wing
Objectives are mutually exclusive and optimizing themrequires tradeoff
Chromosomes - 66 real valued numbers, with population size -
64 and simulated for 70 generations.Evolved wing configurations outperformed existing humandesigned-wings
39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
References
Obayashi, Shigeru, Daisuke Sasaki, Yukihiro Takeguchi, and NaokiHirose. “Multiobjective evolutionary computation for supersonicwing shape optimization ” IEEE Transactions on Evolutionary
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 157/162
wing-shape optimization. IEEE Transactions on EvolutionaryComputation, vol.4, no.2, p.182-187 (July 2000).
Genetic Programming : On the Programming of Computers byMeans of Natural Selection by John R. Koza
http://www.myreaders.info/09 Genetic Algorithms.pdf
http://www.obitko.com/tutorials/genetic-algorithms/search-space.php
http://www.talkorigins.org/faqs/genalg/genalg.html
http://en.wikipedia.org/wiki/Genetic algorithm
http://brainz.org/15-real-world-applications-genetic-algorithms/
40/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Conclusion
Large Appeal of Genetic Algorithms
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 158/162
41/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Conclusion
Large Appeal of Genetic Algorithms
Is it because of Performance?
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 159/162
41/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Conclusion
Large Appeal of Genetic Algorithms
Is it because of Performance?Or is it Aesthetic pleasing origins in theory of evolution ?
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 160/162
p g g y
41/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Conclusion
Large Appeal of Genetic Algorithms
Is it because of Performance?Or is it Aesthetic pleasing origins in theory of evolution ?
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 161/162
41/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm
IntroductionAlgorithm
Theory
Why GA?Applications
ApplicationsAeronautics
Questions
7/27/2019 genetic algorithm.pdf
http://slidepdf.com/reader/full/genetic-algorithmpdf 162/162
Questions ?
42/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm