Classical Conditioning

It’s unconditioned

because it happens

automatically!

Neutral Stimulus No Response

How do we make the bell a stimulus?

Neutral Stimulus

Unconditioned Stimulus

Unconditioned Response

Neutral Stimulus Conditioned Stimulus

Conditioned Response

Terms to Know:• Unconditioned Stimulus (US): an event that elicits a certain

predictable response without previous training

• Unconditioned Response (UR): an organism’s automatic or natural reaction to a stimulus

• Conditioned Stimulus (CS): a once-neutral event that elicits a given response after a period of training in which it has been paired with an unconditioned stimulus

• Conditioned Response (CR): the learned reaction to a conditioned stimulus

• Often, the unconditioned response and the conditioned response are the same thing.

• Classical conditioning generally deals with involuntary responses.

2 More Things:

http://www.youtube.com/watch?v=Xg3WuvCrIZg

Ivan Pavlov

Russian scientist whose studies gave rise to the study of behaviorism. He won the Nobel Peace Prize in 1904 for his

work with digestion.

Acquiring a Conditioned Response

• Occurs gradually

• Is strengthened the more often the US and CS are paired

• Optimal timing to create a CR is to offer the CS half a second before the US

Generalization

When an organism responds to a second stimulus that is similar to the original CS without any training.

Hmmm…that sounds a lot like that bell I’ve been hearing lately.

Discrimination

the ability to respond differently to similar but distinct stimuli

You may have fooled me before, but

I’ve learned the difference between

a bell and a phone.

Extinction

the gradual disappearance of a CR when the CS is repeatedly presented without the CS

spontaneous recovery: when the CR appears out of the blue some time later

=

Taste Aversions

CS CR US UR

Trying escargot Throwing up Getting the flu Throwing up

CS CR US URSound of a drill Anxiety Pain at the

dentist’s officeAnxiety

CS CR US UR

Fiat Happiness Jennifer Lopez Happiness

CS CR US UR

Flashing police car lights

Distress Speeding ticket Distress

Operant Conditioning

Hmm…how can I get the food???

http://www.youtube.com/watch?v=PQtDTdDr8vs

B. F. Skinner

Behavior is influenced by a

person’s history of rewards and

punishments.

Reinforcement:

An event that follows a response and increases the likelihood that the response will be repeated.

Punishment

An event that follows a response and decreases the likelihood that the response will be repeated.

? What are some common reinforcements? Some common punishments?

Reinforcement Punishment

= a good or bad thing= giving or taking away

Positive Reinforcement Great job! You’ve really

gotten good at this! A+

We are giving (+) a good thing (+).

Punishment Stupid boy, you will have to stay after

every day until you get the hang of

this!We are giving (+) a bad thing (-).

or…

PunishmentStupid boy, I am

telling your parents to take your phone

away!We are taking

away (-) a good thing (+).

Negative Reinforcement Great job! I think you can stop coming after school every day!

We are taking away (-) a negative thing (+).

Escape Conditioning

A type of negative reinforcement in which the subject behaves in a way that allows them to escape an

unpleasant event.

Behavior:Whining and Gagging When

Served a Disliked Food

Negative Reinforcement: Removing the Disliked Food

Avoidance Conditioning

A type of negative reinforcement in which the subject behaves in a way that allows them to avoid an unpleasant event altogether (the

event never even occurs because of their behavior).

Behavior:Whining and Gagging When You

See the Unwanted Food

Negative Reinforcement:Putting the Disliked Food Back

in the Fridge

Schedules of Reinforcement

When should reinforcement occur? How can you maximize the impact of the reinforcement?

Continuous Reinforcement: reinforces the desired response each time it occurs

Partial Reinforcement: reinforces the desired response only part of the time

And the Winner Is…

PartialReinforcement

Behaviors acquired on a partial

reinforcement schedule are

established more slowly but are more

persistent.

FixedRatio

FixedInterval

Variable Ratio

Variable Interval

FixedRatio

FixedInterval

Variable Ratio

Variable Interval

A set number of responses must occur before

reinforcement is given.

A set amount of time must elapse before reinforcement

is given.

An unpredictable number of responses must occur before

reinforcement is given.

An unpredictable amount of time must elapse before reinforcement is given.

FixedRatio

A set number of responses must occur

before reinforcement is given.

Typist paid by number of pages typed.

Dentist paid for each cavity filled.Child given a sticker for every

third chore they complete.

FixedIntervalA set amount of time must elapse before

reinforcement is given.

An employee gets a raise every year.

A plumber gets paid for every hour he works.

A commuter willingly waits for the bus because they know it comes every 15

minutes.

VariableRatio

An unpredictable number of responses must occur before reinforcement is

given.

A gambler wins the jackpot on a slot machine.

A door to door salesman occasionally sells his product.

A student receives praise for answering questions.

VariableInterval

An unpredictable amount of time must elapse

before reinforcement is given.

A fisherman puts his line over and eventually catches a fish.

A baby’s cries are eventually responded to by the parent.

You’re put on hold while on the phone, but eventually someone takes your call.

Fixed Ratio? Fixed Interval?Variable Ratio? Variable Interval?

Putting It All Together…

Shaping

The process by which

Chaining

The process by which

Effectiveness

Whether or not a particular stimulus is a reinforcement or a punishment depends on the effect the stimulus has on the

learner. What works for some will not necessarily work for others.

Reinforcement Gone Bad…

You’ve been so

good. Why don’t w

e

go get a

cheeseburger as a

special treat???

Ugh. I hate

cheeseburgers.

Why bother

behaving if

that’s the treat?

Punishment Gone Bad…I want some

attention! I think I’ll have a tantrum…

Knock it off! What are you thinking? I can’t believe you’re acting like that. You need to stop that right now,

young lady. I’m going to make you sit right

here with me until you stop.

Hey, I got some attention. Maybe I’ll try it again!