Competitive Networks

Outline

Hamming Network

Hamming Network

Layer 1 (Correlation)

Layer 2 (Competition)

Layer 2 (Competition)

Competitive Transfer Function

Competitive Layer

Competitive Learning

Graphical Representation

Example

Competition

Update

Diagram

Convergence

Problem with Competitive Layers

choice of learning rate

cluster are close together

dead neuron

the number of neurons

Biological neural networks

Weights assigned

on-center/off-surround

Mexican-Hat function

SOFM

Neighborhoods

Example 1

Convergence

Example 2

Training Process

Improving Feature Map

LVQ Network

LVQ Network (conti.)

LVQ Learning

Example

First Iteration

Second Layer

Figure

Final Decision Regions

LVQ2 Learning

Example

Second layer

Figure