162
Introduction Algorithm Theory Why GA? Applications Genetic Algorithm Saif Hasan Sagar Cho rdia Rahul Varshneya February 6, 2012 Guide Pushpak Bhattacharyya 1 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya  Genetic Algorithm

genetic algorithm.pdf

Embed Size (px)

Citation preview

Page 1: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 1/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

Genetic Algorithm

Saif Hasan Sagar Chordia Rahul Varshneya

February 6, 2012

GuidePushpak Bhattacharyya

1 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Page 2: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 2/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

INTRODUCTION

2 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Page 3: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 3/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

Introduction

Genetic algorithms are a family of computational modelsbelonging to the class of evolutionary algorithms, part of 

artificial intelligence

3 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Page 4: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 4/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

Introduction

Genetic algorithms are a family of computational modelsbelonging to the class of evolutionary algorithms, part of 

artificial intelligence

These algorithms encode a potential solution to a specificproblem on a simple chromosome like data structure

3 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

I d i

Page 5: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 5/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

Introduction

Genetic algorithms are a family of computational modelsbelonging to the class of evolutionary algorithms, part of 

artificial intelligence

These algorithms encode a potential solution to a specificproblem on a simple chromosome like data structure

Uses techniques inspired by natural evolution such as

inheritance, mutation, selection and crossover

3 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

I t d ti

Page 6: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 6/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

Introduction

Genetic algorithms are a family of computational modelsbelonging to the class of evolutionary algorithms, part of 

artificial intelligenceThese algorithms encode a potential solution to a specificproblem on a simple chromosome like data structure

Uses techniques inspired by natural evolution such as

inheritance, mutation, selection and crossoverThey are often viewed as function optimizers

3 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

Page 7: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 7/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

History

First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution

4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

Page 8: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 8/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

History

First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution

Idea of inheritance and mutation introduced by Ingo

Rechenberg which is termed as evolution strategy (1965)

4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

Page 9: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 9/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

History

First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution

Idea of inheritance and mutation introduced by Ingo

Rechenberg which is termed as evolution strategy (1965)M.J. Walsh introduced evolutionary programming (1966)

4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionI d i

Page 10: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 10/162

IntroductionAlgorithm

TheoryWhy GA?

Applications

IntroductionHistoryMotivationTerminology

History

First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution

Idea of inheritance and mutation introduced by Ingo

Rechenberg which is termed as evolution strategy (1965)M.J. Walsh introduced evolutionary programming (1966)

Later versions introduced population which leads to theGenetic Algorithms

4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionI t d ti

Page 11: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 11/162

AlgorithmTheory

Why GA?Applications

IntroductionHistoryMotivationTerminology

History

First appeared in 1950s and early 1960s while biologists wereexplicitly seeking to the model of natural evolution

Idea of inheritance and mutation introduced by Ingo

Rechenberg which is termed as evolution strategy (1965)M.J. Walsh introduced evolutionary programming (1966)

Later versions introduced population which leads to theGenetic Algorithms

In 1975 John Holland published book Adaptation in Naturaland Artificial System. This was the first book to representconcept of adaptive digital systems using mutation, selectionand crossover.

4 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionIntroduction

Page 12: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 12/162

AlgorithmTheory

Why GA?Applications

IntroductionHistoryMotivationTerminology

Motivation

Evolution is very powerful theory since biological principles likecommon descent and selective breeding have been used forthe benefit of humans

5 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction Introduction

Page 13: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 13/162

AlgorithmTheory

Why GA?Applications

IntroductionHistoryMotivationTerminology

Motivation

Evolution is very powerful theory since biological principles likecommon descent and selective breeding have been used forthe benefit of humans

Living organisms are consummate problem solvers. Theyexhibit a versatility that puts the best computer programs toshame.

5 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction Introduction

Page 14: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 14/162

AlgorithmTheory

Why GA?Applications

IntroductionHistoryMotivationTerminology

Motivation

Evolution is very powerful theory since biological principles likecommon descent and selective breeding have been used forthe benefit of humans

Living organisms are consummate problem solvers. Theyexhibit a versatility that puts the best computer programs toshame.

Most organisms evolve by means of two primary processes:

natural selection and sexual reproduction. The first determineswhich members of population survive and reproduce, and thesecond ensures mixing and recombination among the genes of their offspring. Similar analogy is used in GA.

5 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAl i h

Introduction

Page 15: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 15/162

AlgorithmTheory

Why GA?Applications

IntroductionHistoryMotivationTerminology

Terminology

Search space/ State space  : the space of all feasible solutions.

6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAl ith

Introduction

Page 16: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 16/162

AlgorithmTheory

Why GA?Applications

HistoryMotivationTerminology

Terminology

Search space/ State space  : the space of all feasible solutions.

Chromosome  : a set of genes; a chromosome contains the

solution in form of genes.

6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Introduction

Page 17: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 17/162

AlgorithmTheory

Why GA?Applications

HistoryMotivationTerminology

Terminology

Search space/ State space  : the space of all feasible solutions.

Chromosome  : a set of genes; a chromosome contains the

solution in form of genes.Population : a set of solutions (or individuals/chromosomes).

6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Introduction

Page 18: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 18/162

AlgorithmTheory

Why GA?Applications

HistoryMotivationTerminology

Terminology

Search space/ State space  : the space of all feasible solutions.

Chromosome  : a set of genes; a chromosome contains the

solution in form of genes.Population : a set of solutions (or individuals/chromosomes).

Generation : the process of evaluation, selection,recombination and mutation.

6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

IntroductionHi

Page 19: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 19/162

AlgorithmTheory

Why GA?Applications

HistoryMotivationTerminology

Terminology

Search space/ State space  : the space of all feasible solutions.

Chromosome  : a set of genes; a chromosome contains the

solution in form of genes.Population : a set of solutions (or individuals/chromosomes).

Generation : the process of evaluation, selection,recombination and mutation.

Fitness  : the value assigned to an individual based on how faror close it is from the solution; greater the fitness value betterthe solution it contains.

6 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

AlgorithmE di

Page 20: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 20/162

AlgorithmTheory

Why GA?Applications

EncodingOperations of GAParameters of GA

ALGORITHM

7 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

AlgorithmEncoding

Page 21: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 21/162

gTheory

Why GA?Applications

EncodingOperations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

AlgorithmEncoding

Page 22: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 22/162

TheoryWhy GA?

Applications

EncodingOperations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

Choose the initial population of individuals

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

AlgorithmEncoding

Page 23: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 23/162

TheoryWhy GA?

Applications

EncodingOperations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

Choose the initial population of individuals

Evaluate the fitness of each individual in population

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Th

AlgorithmEncoding

Page 24: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 24/162

TheoryWhy GA?

Applications

EncodingOperations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

Choose the initial population of individuals

Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Th

AlgorithmEncoding

Page 25: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 25/162

TheoryWhy GA?

Applications

gOperations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

Choose the initial population of individuals

Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:

Selection: Select the individuals with greater fitness forreproduction

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

AlgorithmEncoding

Page 26: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 26/162

TheoryWhy GA?

Applications

gOperations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

Choose the initial population of individuals

Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:

Selection: Select the individuals with greater fitness forreproductionCrossover: Breed new individuals through crossover

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

AlgorithmEncoding

Page 27: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 27/162

TheoryWhy GA?

Applications

Operations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

Choose the initial population of individuals

Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:

Selection: Select the individuals with greater fitness forreproductionCrossover: Breed new individuals through crossover

Mutation: Apply probabilistic mutation on new individuals

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

AlgorithmEncodingO f G

Page 28: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 28/162

TheoryWhy GA?

Applications

Operations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

Choose the initial population of individuals

Evaluate the fitness of each individual in populationRepeat until termination condition satisfied:

Selection: Select the individuals with greater fitness forreproductionCrossover: Breed new individuals through crossover

Mutation: Apply probabilistic mutation on new individualsForm a new population with these offsprings.

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

AlgorithmEncodingO i f GA

Page 29: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 29/162

TheoryWhy GA?

Applications

Operations of GAParameters of GA

Algorithm

Psuedocode of Genetics Algorithm

Choose the initial population of individuals

Evaluate the fitness of each individual in population

Repeat until termination condition satisfied:

Selection: Select the individuals with greater fitness forreproductionCrossover: Breed new individuals through crossover

Mutation: Apply probabilistic mutation on new individualsForm a new population with these offsprings.

Terminate

8 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

AlgorithmEncodingO ti f GA

Page 30: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 30/162

yWhy GA?

Applications

Operations of GAParameters of GA

Flow Chart

9 / 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

AlgorithmEncodingOperations of GA

Page 31: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 31/162

yWhy GA?

Applications

Operations of GAParameters of GA

Encoding

Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.

10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

AlgorithmEncodingOperations of GA

Page 32: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 32/162

Why GA?Applications

Operations of GAParameters of GA

Encoding

Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.

Common approaches are:

Binary Encoding : every chromosome is a string of  0 or 1

10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Wh GA?

AlgorithmEncodingOperations of GA

Page 33: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 33/162

Why GA?Applications

Operations of GAParameters of GA

Encoding

Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.

Common approaches are:

Binary Encoding : every chromosome is a string of  0 or 1

Permutation Encoding : every chromosome is a string of numbers that represent position in a sequence

10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Wh GA?

AlgorithmEncodingOperations of GA

Page 34: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 34/162

Why GA?Applications

Operations of GAParameters of GA

Encoding

Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.

Common approaches are:

Binary Encoding : every chromosome is a string of  0 or 1

Permutation Encoding : every chromosome is a string of numbers that represent position in a sequence

Tree Encoding : a tree structure represents the chromosome

10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Wh GA?

AlgorithmEncodingOperations of GA

Page 35: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 35/162

Why GA?Applications

pParameters of GA

Encoding

Before a genetic algorithm can be put to work on any problem, amethod is needed to encode potential solutions to that problem ina form so that a computer can process.

Common approaches are:

Binary Encoding : every chromosome is a string of  0 or 1

Permutation Encoding : every chromosome is a string of numbers that represent position in a sequence

Tree Encoding : a tree structure represents the chromosome

Value Encoding : every chromosome is a sequence of somevalues (real numbers, characters or objects)

10/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?

AlgorithmEncodingOperations of GA

Page 36: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 36/162

Why GA?Applications

Parameters of GA

Encoding Examples

Binary Encoding : Suppose we have a knapsack of capacity C and N  items, then we can encode this problem as follows

11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?

AlgorithmEncodingOperations of GA

Page 37: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 37/162

Why GA?Applications

Parameters of GA

Encoding Examples

Binary Encoding : Suppose we have a knapsack of capacity C and N  items, then we can encode this problem as follows

Chromosome, in this case, is a string of 0s and 1s with N  bits

11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?

AlgorithmEncodingOperations of GAP f GA

Page 38: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 38/162

Why GA?Applications

Parameters of GA

Encoding Examples

Binary Encoding : Suppose we have a knapsack of capacity C and N  items, then we can encode this problem as follows

Chromosome, in this case, is a string of 0s and 1s with N  bits

Represent item i  of problem with i th

bit in the chromosome

11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?

AlgorithmEncodingOperations of GAP t f GA

Page 39: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 39/162

y GApplications

Parameters of GA

Encoding Examples

Binary Encoding : Suppose we have a knapsack of capacity C and N  items, then we can encode this problem as follows

Chromosome, in this case, is a string of 0s and 1s with N  bits

Represent item i  of problem with i th

bit in the chromosomei th bit is 1 iff  i th item has been selected, 0 otherwise.

11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?

AlgorithmEncodingOperations of GAParameters of GA

Page 40: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 40/162

yApplications

Parameters of GA

Encoding Examples

Binary Encoding : Suppose we have a knapsack of capacity C and N  items, then we can encode this problem as follows

Chromosome, in this case, is a string of 0s and 1s with N  bits

Represent item i  of problem with i th

bit in the chromosomei th bit is 1 iff  i th item has been selected, 0 otherwise.The set of all such chromosomes (2N ) is the solution space of the problem.

11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?

AlgorithmEncodingOperations of GAParameters of GA

Page 41: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 41/162

ApplicationsParameters of GA

Encoding Examples

Binary Encoding : Suppose we have a knapsack of capacity C and N  items, then we can encode this problem as follows

Chromosome, in this case, is a string of 0s and 1s with N  bits

Represent item i  of problem with i th

bit in the chromosomei th bit is 1 iff  i th item has been selected, 0 otherwise.The set of all such chromosomes (2N ) is the solution space of the problem.

Chromosome 1: 1 0 1 1 0 0 1 0 1 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1

Chromosome 2: 1 1 1 1 1 1 1 0 0 0 0 0 1 1 0 0 0 0 0 1 1 1 1 1The example shown above has 24 items (and therefore 24 bits)with item1 selected in both chromosome 1 and 2 whereasitem2 is selected in chromosome 2 but not in chromosome 1.

11/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?

AlgorithmEncodingOperations of GAParameters of GA

Page 42: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 42/162

ApplicationsParameters of GA

Encoding Examples

Permutation Encoding : Travelling Salesman Problem

12/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?A li i

AlgorithmEncodingOperations of GAParameters of GA

Page 43: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 43/162

ApplicationsParameters of GA

Encoding Examples

Permutation Encoding : Travelling Salesman Problem

Problem descripition : There are cities and given distancesbetween them. Travelling salesman has to visit all of them, but

he doesn’t want to travel more than necessary. Find asequence of cities with a minimal travelled distance.

12/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?A li ti

AlgorithmEncodingOperations of GAParameters of GA

Page 44: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 44/162

Applications

Encoding Examples

Permutation Encoding : Travelling Salesman Problem

Problem descripition : There are cities and given distancesbetween them. Travelling salesman has to visit all of them, but

he doesn’t want to travel more than necessary. Find asequence of cities with a minimal travelled distance.

Chromosome A: 1 5 3 2 6 4 7 9 8

Chromosome B: 8 5 6 7 2 3 1 4 9

Encoding : Here, encoded chromosomes describe the order of 

cities the salesman visits. For example, in chromosome A, thesalesman visits city-1 followed by city-5 followed by city-3 andso on.

12/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 45: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 45/162

Applications

Encoding Examples

Tree Encoding : Genetic Programming

13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 46: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 46/162

Applications

Encoding Examples

Tree Encoding : Genetic Programming

In tree encoding, every chromosome is a tree of some objects,such as functions or commands in programming language.

13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 47: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 47/162

Applications

Encoding Examples

Tree Encoding : Genetic Programming

In tree encoding, every chromosome is a tree of some objects,such as functions or commands in programming language.Tree encoding is useful for evolving programs or any otherstructures that can be encoded in trees.

13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 48: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 48/162

Applications

Encoding Examples

Tree Encoding : Genetic Programming

In tree encoding, every chromosome is a tree of some objects,such as functions or commands in programming language.Tree encoding is useful for evolving programs or any otherstructures that can be encoded in trees.The crossover and mutation can be done relatively easy way .

13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 49: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 49/162

pp

Encoding Examples

Tree Encoding : Genetic Programming

In tree encoding, every chromosome is a tree of some objects,such as functions or commands in programming language.Tree encoding is useful for evolving programs or any otherstructures that can be encoded in trees.The crossover and mutation can be done relatively easy way .

Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf 

13/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 50: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 50/162

Operations of Genetic Algorithm

Genetic operators used in GA maintain genetic diversity.

14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 51: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 51/162

Operations of Genetic Algorithm

Genetic operators used in GA maintain genetic diversity.

Genetic diversity or variation is a necessity for evolution.

14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 52: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 52/162

Operations of Genetic Algorithm

Genetic operators used in GA maintain genetic diversity.

Genetic diversity or variation is a necessity for evolution.Genetic operators are analogous to those which occur in thenatural world:

14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 53: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 53/162

Operations of Genetic Algorithm

Genetic operators used in GA maintain genetic diversity.

Genetic diversity or variation is a necessity for evolution.

Genetic operators are analogous to those which occur in thenatural world:

Reproduction (or Selection)

14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 54: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 54/162

Operations of Genetic Algorithm

Genetic operators used in GA maintain genetic diversity.

Genetic diversity or variation is a necessity for evolution.

Genetic operators are analogous to those which occur in thenatural world:

Reproduction (or Selection)Crossover (or Recombination)

14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 55: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 55/162

Operations of Genetic Algorithm

Genetic operators used in GA maintain genetic diversity.

Genetic diversity or variation is a necessity for evolution.

Genetic operators are analogous to those which occur in thenatural world:

Reproduction (or Selection)Crossover (or Recombination)

Mutation

14/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 56: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 56/162

Reproduction or Selection

Concept  : From the population, the chromosomes are selectedto be parents to crossover and produce offspring.

15/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 57: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 57/162

Reproduction or Selection

Concept  : From the population, the chromosomes are selectedto be parents to crossover and produce offspring.

Problem : How to select these chromosomes ?

15/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 58: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 58/162

Reproduction or Selection

Concept  : From the population, the chromosomes are selectedto be parents to crossover and produce offspring.

Problem : How to select these chromosomes ?

Hint  : According to Charles Darwin’s evolution theory”survival of the fittest” - the best ones should survive andcreate new offspring.

15/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 59: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 59/162

Reproduction or Selection

Concept  : From the population, the chromosomes are selectedto be parents to crossover and produce offspring.

Problem : How to select these chromosomes ?

Hint  : According to Charles Darwin’s evolution theory”survival of the fittest” - the best ones should survive andcreate new offspring.

Solution : Fitness function quantifies the optimality of a

solution (chromosome) so that a particular solution may beranked against all the other solutions. The function depictsthe closeness of a given ’solution’ to the desired result.

15/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Page 60: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 60/162

Reproduction or Selection

Popular methods of selection include :

16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

R d i S l i

Page 61: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 61/162

Reproduction or Selection

Popular methods of selection include :

Roulette-wheel selection

16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

R d i S l i

Page 62: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 62/162

Reproduction or Selection

Popular methods of selection include :

Roulette-wheel selection

Tournament selection

16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

R d i S l i

Page 63: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 63/162

Reproduction or Selection

Popular methods of selection include :

Roulette-wheel selection

Tournament selectionRank selection

16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

R d ti S l ti

Page 64: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 64/162

Reproduction or Selection

Popular methods of selection include :

Roulette-wheel selection

Tournament selectionRank selection

Steady-state selection

16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

R d ti S l ti

Page 65: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 65/162

Reproduction or Selection

Popular methods of selection include :

Roulette-wheel selection

Tournament selectionRank selection

Steady-state selection

Boltzmann selection

16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Reproduction or Selection

Page 66: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 66/162

Reproduction or Selection

Popular methods of selection include :

Roulette-wheel selection

Tournament selectionRank selection

Steady-state selection

Boltzmann selection

Scaling selection

16/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Roulette Wheel Selection

Page 67: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 67/162

Roulette-Wheel Selection

Concept  : the chance of an individual’s being selected isproportional to its fitness, greater or less than its competitors’fitness.

17/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Roulette Wheel Selection

Page 68: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 68/162

Roulette-Wheel Selection

Concept  : the chance of an individual’s being selected isproportional to its fitness, greater or less than its competitors’fitness.

17/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Roulette Wheel Selection

Page 69: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 69/162

Roulette-Wheel Selection

Concept  : the chance of an individual’s being selected isproportional to its fitness, greater or less than its competitors’fitness.

Implementation : Probability of selection of  i th individual is:p i  = f  i 

ΣN  j =1f   j 

where f i  :fitness of  i th individual, N  : number of individuals

Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf 

17/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Elitist Selection

Page 70: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 70/162

Elitist Selection

Concept  : Most fit members of each generation areguaranteed to be selected for next generation.

18/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Elitist Selection

Page 71: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 71/162

Elitist Selection

Concept  : Most fit members of each generation areguaranteed to be selected for next generation.

Advantages  :

18/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheory

Why GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Elitist Selection

Page 72: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 72/162

Elitist Selection

Concept  : Most fit members of each generation areguaranteed to be selected for next generation.

Advantages  :Ensures that the best solution found so far is not lost due tocrossover and mutation.

18/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Elitist Selection

Page 73: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 73/162

Elitist Selection

Concept  : Most fit members of each generation areguaranteed to be selected for next generation.

Advantages  :Ensures that the best solution found so far is not lost due tocrossover and mutation.Speeds up convergence once a good solution has beendiscovered.

18/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Crossover

Page 74: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 74/162

Crossover

Concept  : Selects genes from parent chromosomes, combinesthem and creates a new offspring.

19/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Crossover

Page 75: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 75/162

Crossover

Concept  : Selects genes from parent chromosomes, combinesthem and creates a new offspring.

Idea : New chromosome may be better than both of theparents if it takes the best characteristics from each of them

19/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Crossover

Page 76: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 76/162

Concept  : Selects genes from parent chromosomes, combinesthem and creates a new offspring.

Idea : New chromosome may be better than both of theparents if it takes the best characteristics from each of them

Consider the two parents selected for crossover.

19/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Crossover

Page 77: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 77/162

Concept  : Selects genes from parent chromosomes, combinesthem and creates a new offspring.

Idea : New chromosome may be better than both of theparents if it takes the best characteristics from each of them

Consider the two parents selected for crossover.

Interchange the parents chromosomes after crossover points.The offsprings produced are :

Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf 

19/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover

Page 78: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 78/162

The Crossover operators are of many types.

20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover

Page 79: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 79/162

The Crossover operators are of many types.

Single-Point crossover

20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover

Page 80: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 80/162

The Crossover operators are of many types.

Single-Point crossoverTwo Point crossover

20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover

Page 81: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 81/162

The Crossover operators are of many types.

Single-Point crossoverTwo Point crossoverUniform crossover

20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover

Page 82: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 82/162

The Crossover operators are of many types.

Single-Point crossoverTwo Point crossoverUniform crossoverArithmetic crossover

20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover

Page 83: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 83/162

The Crossover operators are of many types.

Single-Point crossoverTwo Point crossoverUniform crossoverArithmetic crossover

Which Crossover operator is to be selected is based onchromosome encoding

20/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover

Page 84: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 84/162

The Crossover operators are of many types.

Single-Point crossoverTwo Point crossoverUniform crossoverArithmetic crossover

Which Crossover operator is to be selected is based onchromosome encoding

Specific crossover made for a specific problem can improveperformance of the genetic algorithm

20/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover

Page 85: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 85/162

The Crossover operators are of many types.

Single-Point crossoverTwo Point crossoverUniform crossoverArithmetic crossover

Which Crossover operator is to be selected is based onchromosome encoding

Specific crossover made for a specific problem can improveperformance of the genetic algorithm

Some research suggests more than two “parents” are better toreproduce a good quality chromosome (Eiben, A.E. et al (1994),

Ting, Chuan-Kang (2005))

20/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Two-Point Crossover

Page 86: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 86/162

Operation : randomly select two crossover points within achromosome, then interchange the two parent chromosomesbetween these points to produce two new offspring.Consider the two parents selected for crossover.

21/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Uniform Crossover

Page 87: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 87/162

Operation : mixing ratio decides the contribution of eachparent to the gene values in the offspring chromosomes.

Advantage  : allows the parent chromosomes to be mixed atthe gene level rather than the segment level

Consider the two parents selected for crossover.

If the mixing ratio is 0.5 approximately, then the possible set of 

offsprings after crossover would be :

Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf 

22/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

Introduction

AlgorithmTheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation

Page 88: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 88/162

Concept  : Mutation alters one or more gene values in achromosome from its initial state.

23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation

Page 89: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 89/162

Concept  : Mutation alters one or more gene values in achromosome from its initial state.

Advantages  :

23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation

Page 90: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 90/162

Concept  : Mutation alters one or more gene values in achromosome from its initial state.

Advantages  :

Mutation can generate new genes values not already present in

sample space which can lead to better solution.

23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation

Page 91: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 91/162

Concept  : Mutation alters one or more gene values in achromosome from its initial state.

Advantages  :

Mutation can generate new genes values not already present in

sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).

23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation

Page 92: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 92/162

Concept  : Mutation alters one or more gene values in achromosome from its initial state.

Advantages  :

Mutation can generate new genes values not already present in

sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).

Operators  : Mutation operators are of many type :

23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation

Page 93: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 93/162

Concept  : Mutation alters one or more gene values in achromosome from its initial state.

Advantages  :

Mutation can generate new genes values not already present in

sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).

Operators  : Mutation operators are of many type :

one simple way is, Flip Bit.

23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation

Page 94: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 94/162

Concept  : Mutation alters one or more gene values in achromosome from its initial state.

Advantages  :

Mutation can generate new genes values not already present in

sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).

Operators  : Mutation operators are of many type :

one simple way is, Flip Bit.the others are Boundary, Uniform, and Gaussian.

23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation

Page 95: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 95/162

Concept  : Mutation alters one or more gene values in achromosome from its initial state.

Advantages  :

Mutation can generate new genes values not already present in

sample space which can lead to better solution.Randomness introduced by mutation helps in searching forglobal optima solutions and not geting stuck in local optima.(premature convergence).

Operators  : Mutation operators are of many type :

one simple way is, Flip Bit.the others are Boundary, Uniform, and Gaussian.

Operators are selected based on encoding of chromosomes.

23/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Flip Bit

Page 96: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 96/162

The mutation operator simply inverts the value of the chosengene i.e. 0 goes to 1 and 1 goes to 0.

Consider the two original offsprings selected for mutation.

The Mutated Off-spring produced are :

Image courtesy: http://www.myreaders.info/09 Genetic Algorithms.pdf 

24/ 42 Saif Hasan Sagar Chordia Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Parameters of Genetic Algorithm

Page 97: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 97/162

There are three basic parameters of Genetic Algorithm.

25/ 42 Saif Hasa Saga Cho dia Rah l Va sh e a Ge etic Algo ith

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Parameters of Genetic Algorithm

Page 98: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 98/162

There are three basic parameters of Genetic Algorithm.

Crossover Probability

25/ 42 S if H S Ch di R h l V h G ti Al ith

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Parameters of Genetic Algorithm

Page 99: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 99/162

There are three basic parameters of Genetic Algorithm.

Crossover ProbabilityMutation Probability

25/ 42 S if H S Ch di R h l V h G ti Al ith

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Parameters of Genetic Algorithm

Page 100: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 100/162

There are three basic parameters of Genetic Algorithm.

Crossover ProbabilityMutation Probability

Population Size

25/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover Probability

Page 101: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 101/162

Definition : Crossover probability represents how oftencrossover is performed.

26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover Probability

Page 102: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 102/162

Definition : Crossover probability represents how oftencrossover is performed.

Constraint  :

26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover Probability

Page 103: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 103/162

Definition : Crossover probability represents how oftencrossover is performed.

Constraint  :

If the crossover rate is too high, high performance strings are

eliminated faster than selection can produce improvements.

26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover Probability

Page 104: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 104/162

Definition : Crossover probability represents how oftencrossover is performed.

Constraint  :

If the crossover rate is too high, high performance strings are

eliminated faster than selection can produce improvements.A low crossover rate may cause stagnation due to the lowerexploration rate.

26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover Probability

Page 105: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 105/162

Definition : Crossover probability represents how oftencrossover is performed.

Constraint  :

If the crossover rate is too high, high performance strings are

eliminated faster than selection can produce improvements.A low crossover rate may cause stagnation due to the lowerexploration rate.

Solution : Crossover rate generally should be high, about80%-95%.

26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Crossover Probability

Page 106: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 106/162

Definition : Crossover probability represents how oftencrossover is performed.

Constraint  :

If the crossover rate is too high, high performance strings are

eliminated faster than selection can produce improvements.A low crossover rate may cause stagnation due to the lowerexploration rate.

Solution : Crossover rate generally should be high, about80%-95%.Some results show that for some problems crossover rateabout 60% is the best.

26/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation Probability

Page 107: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 107/162

Defintion : Mutation probability represents how oftenmutation is performed.

27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Algorithm

EncodingOperations of GAParameters of GA

Mutation Probability

Page 108: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 108/162

Defintion : Mutation probability represents how oftenmutation is performed.

Constraints  :

27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Mutation Probability

Page 109: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 109/162

Defintion : Mutation probability represents how oftenmutation is performed.

Constraints  :

A very small mutation rate may lead to convergence to localoptima areas.

27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Mutation Probability

Page 110: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 110/162

Defintion : Mutation probability represents how oftenmutation is performed.

Constraints  :

A very small mutation rate may lead to convergence to localoptima areas.A mutation rate that is too high results in almost randomsearch.

27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Mutation Probability

Page 111: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 111/162

Defintion : Mutation probability represents how oftenmutation is performed.

Constraints  :

A very small mutation rate may lead to convergence to localoptima areas.A mutation rate that is too high results in almost randomsearch.

Solution :Best rates reported are about 0.5%-1%.

27/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Population Size

Page 112: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 112/162

Definition : Number of chromosomes in population (in onegeneration).

28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

AlgorithmEncodingOperations of GAParameters of GA

Population Size

Page 113: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 113/162

Definition : Number of chromosomes in population (in onegeneration).

Constraints  :

28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Population Size

Page 114: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 114/162

Definition : Number of chromosomes in population (in onegeneration).

Constraints  :

Too few chromosomes implies GA have a few possibilities toperform crossover and only a small part of search space isexplored.

28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Population Size

Page 115: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 115/162

Definition : Number of chromosomes in population (in onegeneration).

Constraints  :

Too few chromosomes implies GA have a few possibilities toperform crossover and only a small part of search space isexplored.Too many chromosomes implies GA slows down.

28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

AlgorithmEncodingOperations of GAParameters of GA

Population Size

Page 116: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 116/162

Definition : Number of chromosomes in population (in onegeneration).

Constraints  :

Too few chromosomes implies GA have a few possibilities toperform crossover and only a small part of search space isexplored.Too many chromosomes implies GA slows down.

Solution : Good population size is about 20-30, however

sometimes sizes 50-100 are reported as best.

28/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Page 117: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 117/162

Why Genetic Algorithms Work?

29/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Schema and HyperPlane

Schema - solution string with some blank fields

Page 118: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 118/162

geg: 01***********

30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Schema and HyperPlane

Schema - solution string with some blank fields

Page 119: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 119/162

geg: 01***********

Solution is combination of these schemas. Schema representsa particular component of solution.

30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Schema and HyperPlane

Schema - solution string with some blank fields

Page 120: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 120/162

geg: 01***********

Solution is combination of these schemas. Schema representsa particular component of solution.

Solution space : N-dimensional HyperCube

30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Schema and HyperPlane

Schema - solution string with some blank fields

Page 121: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 121/162

eg: 01***********

Solution is combination of these schemas. Schema representsa particular component of solution.

Solution space : N-dimensional HyperCube

Schema : HyperPlane

30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Schema and HyperPlane

Schema - solution string with some blank fields

Page 122: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 122/162

eg: 01***********

Solution is combination of these schemas. Schema representsa particular component of solution.

Solution space : N-dimensional HyperCubeSchema : HyperPlane

In 3D cube, 0** represent front face.

30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Schema and HyperPlane

Schema - solution string with some blank fields

Page 123: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 123/162

eg: 01***********

Solution is combination of these schemas. Schema representsa particular component of solution.

Solution space : N-dimensional HyperCubeSchema : HyperPlane

In 3D cube, 0** represent front face.

There is competition between Schema with n bit values insame positions.e g:- 00*, 01*, 10*, 11* are competing

Winner is the schema with highest fitness.

30/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Implicit Parallelism

Page 124: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 124/162

A solution string belongs to many HyperPlanes (2N −1).eg: 010 belongs to 0** , *1*, **0

31/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Implicit Parallelism

Page 125: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 125/162

A solution string belongs to many HyperPlanes (2N −1).eg: 010 belongs to 0** , *1*, **0

Single Evaluation of string leads to evaluation of different

hyperplanes in an implicitly parallel fashion (John Holland 1975 

);

31/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Implicit Parallelism

Page 126: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 126/162

A solution string belongs to many HyperPlanes (2N −1).eg: 010 belongs to 0** , *1*, **0

Single Evaluation of string leads to evaluation of different

hyperplanes in an implicitly parallel fashion (John Holland 1975 

);Evaluation of population of strings, samples far morehyperplanes as compared to number of strings contained inthe population.

31/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

Implicit Parallelism

Page 127: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 127/162

A solution string belongs to many HyperPlanes (2N −1).eg: 010 belongs to 0** , *1*, **0

Single Evaluation of string leads to evaluation of differenthyperplanes in an implicitly parallel fashion (John Holland 1975 );

Evaluation of population of strings, samples far morehyperplanes as compared to number of strings contained inthe population.

These cumulative effects provides statistical information to

GA about any particular subset of hyperplanes.

31/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?Applications

Schema and HyperPlane

Implicit ParallelismThe Schema Theorem

The Schema Theorem

Page 128: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 128/162

32/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Schema and HyperPlaneImplicit ParallelismThe Schema Theorem

The Schema Theorem

The Schema Theorem (Holland 1992; Goldberg 1989)

Page 129: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 129/162

The Schema Theorem (Holland 1992; Goldberg 1989 ).It provides a lower bound on the change in the sample rate fora single hyperplane from generation t  to generation t + 1.

32/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Schema and HyperPlaneImplicit ParallelismThe Schema Theorem

The Schema Theorem

The Schema Theorem (Holland 1992; Goldberg 1989)

Page 130: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 130/162

The Schema Theorem (Holland 1992; Goldberg 1989 ).It provides a lower bound on the change in the sample rate fora single hyperplane from generation t  to generation t + 1.

Equation:

32/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Schema and HyperPlaneImplicit ParallelismThe Schema Theorem

The Schema Theorem

The Schema Theorem (Holland 1992; Goldberg 1989)

Page 131: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 131/162

The Schema Theorem (Holland 1992; Goldberg 1989 ).It provides a lower bound on the change in the sample rate fora single hyperplane from generation t  to generation t + 1.

Equation:

Building Blocks Hypothesis (Holland, 1975; Gold-berg, 1989 )Low-order, highly-fit schemas recombine to form even betterschemas.

In Goldberg’s words, “we construct better and better stringsfrom the best partial solutions of past samplings”

32/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Advantages

Disadvantages

Page 132: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 132/162

WHY GA?

33/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Advantages

Disadvantages

Advantages

Page 133: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 133/162

Implicit Parallelism - Solution Space is explored in multipledirections (GoldBerg - GA in Search and Optimization)

34/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Advantages

Disadvantages

Advantages

Page 134: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 134/162

Implicit Parallelism - Solution Space is explored in multipledirections (GoldBerg - GA in Search and Optimization)

Nonlinear problems -Large Solution space, but GA areideal.(Forrest - 1993 Genetic Algorithm)

34/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Advantages

Disadvantages

Advantages

Page 135: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 135/162

Implicit Parallelism - Solution Space is explored in multipledirections (GoldBerg - GA in Search and Optimization)

Nonlinear problems -Large Solution space, but GA areideal.(Forrest - 1993 Genetic Algorithm)

Works on complex landscape (discontinuous, noisy, changingwith time) (John Koza - Genetic Programming IV 2004 )

34/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Advantages

Disadvantages

Advantages

Page 136: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 136/162

Dilemma of global optimum vs many local optima. GA strikeperfect balance (John Holland - Genetic Algorithm 1992 )

35/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Advantages

Disadvantages

Advantages

Page 137: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 137/162

Dilemma of global optimum vs many local optima. GA strikeperfect balance (John Holland - Genetic Algorithm 1992 )

GA can manipulate many parameters simultaneously (Forrest -

Genetic algorithms: principles of natural selection applied to computation.1993 )

35/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

TheoryWhy GA?

Applications

Advantages

Disadvantages

Advantages

Page 138: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 138/162

Dilemma of global optimum vs many local optima. GA strikeperfect balance (John Holland - Genetic Algorithm 1992 )

GA can manipulate many parameters simultaneously (Forrest -

Genetic algorithms: principles of natural selection applied to computation.1993 )

GA don’t have specific knowledge of problem. All possiblesearch pathways are considered in GA.(John Koza - Genetic 

Programming III 1999 )

35/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Advantages

Disadvantages

Disadvantages

Computationally expensive and time consuming

Page 139: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 139/162

Computationally expensive and time consuming

36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Advantages

Disadvantages

Disadvantages

Computationally expensive and time consuming

Page 140: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 140/162

Computationally expensive and time consuming

Issues in representation of problem

36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Advantages

Disadvantages

Disadvantages

Computationally expensive and time consuming

Page 141: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 141/162

Computationally expensive and time consuming

Issues in representation of problem

Proper writing of fitness function

36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Advantages

Disadvantages

Disadvantages

Computationally expensive and time consuming

Page 142: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 142/162

Computationally expensive and time consuming

Issues in representation of problem

Proper writing of fitness function

Proper values of size of population, crossover and mutationrate

36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Advantages

Disadvantages

Disadvantages

Computationally expensive and time consuming

Page 143: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 143/162

Computationally expensive and time consuming

Issues in representation of problem

Proper writing of fitness function

Proper values of size of population, crossover and mutationrate

Deceptive Fitness Function (Mitchell, Melanie 1996 )

36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Advantages

Disadvantages

Disadvantages

Computationally expensive and time consuming

Page 144: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 144/162

p y p g

Issues in representation of problem

Proper writing of fitness function

Proper values of size of population, crossover and mutationrate

Deceptive Fitness Function (Mitchell, Melanie 1996 )

Premature Convergence

36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Advantages

Disadvantages

Disadvantages

Computationally expensive and time consuming

Page 145: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 145/162

p y p g

Issues in representation of problem

Proper writing of fitness function

Proper values of size of population, crossover and mutationrate

Deceptive Fitness Function (Mitchell, Melanie 1996 )

Premature Convergence

No one mathematically perfect solution since problems of biological adaptation don’t have this issue.

36/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Applications

Aeronautics

Page 146: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 146/162

APPLICATIONS

37/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Applications

Aeronautics

Applications

Page 147: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 147/162

Image courtesy: http://www.google.com

38/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

Applications

Aeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraft

Page 148: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 148/162

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraft

Page 149: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 149/162

Four major considerations for wing design

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraftF j id i f i d i

Page 150: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 150/162

Four major considerations for wing design

Minimizing aerodynamic drag at supersonic cruising speeds

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraftF j id i f i d i

Page 151: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 151/162

Four major considerations for wing design

Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speeds

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraftF j id ti f i d i

Page 152: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 152/162

Four major considerations for wing design

Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraftF j id ti f i d i

Page 153: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 153/162

Four major considerations for wing design

Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)Minimizing twisting moment of wing

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraftFour major considerations for wing design

Page 154: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 154/162

Four major considerations for wing design

Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)Minimizing twisting moment of wing

Objectives are mutually exclusive and optimizing themrequires tradeoff 

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraftFour major considerations for wing design

Page 155: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 155/162

Four major considerations for wing design

Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)

Minimizing twisting moment of wing

Objectives are mutually exclusive and optimizing themrequires tradeoff 

Chromosomes - 66 real valued numbers, with population size -

64 and simulated for 70 generations.

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Aeronautics

Multiple-objective genetics algorithm to design wing shape for

supersonic aircraftFour major considerations for wing design

Page 156: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 156/162

Four major considerations for wing design

Minimizing aerodynamic drag at supersonic cruising speedsMinimizing drag at subsonic speedsMinimizing aerodynamic load (bending force on wing)

Minimizing twisting moment of wing

Objectives are mutually exclusive and optimizing themrequires tradeoff 

Chromosomes - 66 real valued numbers, with population size -

64 and simulated for 70 generations.Evolved wing configurations outperformed existing humandesigned-wings

39/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

References

Obayashi, Shigeru, Daisuke Sasaki, Yukihiro Takeguchi, and NaokiHirose. “Multiobjective evolutionary computation for supersonicwing shape optimization ” IEEE Transactions on Evolutionary

Page 157: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 157/162

wing-shape optimization. IEEE Transactions on EvolutionaryComputation, vol.4, no.2, p.182-187 (July 2000).

Genetic Programming : On the Programming of Computers byMeans of Natural Selection by John R. Koza

http://www.myreaders.info/09 Genetic Algorithms.pdf 

http://www.obitko.com/tutorials/genetic-algorithms/search-space.php

http://www.talkorigins.org/faqs/genalg/genalg.html

http://en.wikipedia.org/wiki/Genetic algorithm

http://brainz.org/15-real-world-applications-genetic-algorithms/

40/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Conclusion

Large Appeal of Genetic Algorithms

Page 158: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 158/162

41/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Conclusion

Large Appeal of Genetic Algorithms

Is it because of Performance?

Page 159: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 159/162

41/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Conclusion

Large Appeal of Genetic Algorithms

Is it because of Performance?Or is it Aesthetic pleasing origins in theory of evolution ?

Page 160: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 160/162

p g g y

41/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Conclusion

Large Appeal of Genetic Algorithms

Is it because of Performance?Or is it Aesthetic pleasing origins in theory of evolution ?

Page 161: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 161/162

41/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm

IntroductionAlgorithm

Theory

Why GA?Applications

ApplicationsAeronautics

Questions

Page 162: genetic algorithm.pdf

7/27/2019 genetic algorithm.pdf

http://slidepdf.com/reader/full/genetic-algorithmpdf 162/162

Questions ?

42/ 42 Saif Hasan, Sagar Chordia, Rahul Varshneya Genetic Algorithm