Embed Size (px)
Citation preview
Bell Ringer – in your notes
• List and explain some of the basic forms of learning. – you should have gotten this from the reading last night
• Be prepared to discuss.
Pavlov….Pavlov STOP
• Volunteers – 5
• Paper cup with sugar
• Hear “Pavlov” Dip finger in sugar and eat
• Hear “Pavlov STOP” DO NOT DIP FINGER –close eyes & concentrate on what you’re experiencing.
• Reflect on Experience.
Fact/Falsehood 8-1
• Discuss
Learning Videos
• Boring one on dog salivating: http://www.youtube.com/watch?v=cP5lCleK-PM
• Philly zimbardo explains: http://www.youtube.com/watch?v=hhqumfpxuzI&feature=related
• Roommate – airgunhttp://www.youtube.com/watch?v=Eo7jcI8fAuI&feature=related
Learning
Long lasting change in behavior due to
experience.
Learning and Behaviorism
• Three major areas of learning– Classical Conditioning: Pavlov
– Instrumental /Operant Conditioning: Skinner
– Social Learning Theory: Bandura
How do we learn?
• Associative Learning is learning that certain events occur together. The events may be 2 stimuli (classical) or a response and its consequences (operant).
• Conditioning is the process of learning associations
Conditioning• Classical Conditioning – learn to assoc 2
stimuli and thus to anticipate events
• Operant Conditioning - learn to assoc a response (our behavior) & its consequences & thus to repeat acts followed by good results and avoid ones with bad results
• Observational Learning we learn by watching others’ experiences & examples.
Think About It…
• Can you remember example from childhood of learning through classical conditioning?
• What about operant conditioning?
• What about watching someone perform an act and you later repeated that act?
• Discuss
What is Behaviorism?
• School of psychology- studies scientifically observable behaviors, not unconscious drives.
• Behaviorists like tabula rasa (blank slate)
• Free will is an illusion.
• Includes classical, operant and social learning theory
John B. Watson
“Give me a dozen healthy infants, well-formed, and my own special world to bring them up in, and I’ll guarantee to take any one at random and train him to become any type of specialist I might select –doctor, lawyer, merchant-chief, and yes, beggar man or thief, regardless of his talents, penchants, tendencies, abilities, vocations, and race of his ancestors.”
Classical Conditioning
• Who was Pavlov?
• Ivan Pavlov
• Studied Digestion of Dogs.
• Dogs would salivate before they were given food (triggered by sounds, lights etc…)
• Dogs must have LEARNED to salivate.
What is classical conditioning?
• When your brain and nervous system make an association between 2 stimuli (things).
• Example: food and a bell
Classical Conditioning
• This is passive learning (automatic…learner does NOT have to think).
• First thing you need is a unconditional relationship.
• Unconditional Stimulus (UCS)- something that elicits a natural, reflexive response.
• Unconditional Response (UCR)- response to the UCS.
Classical Conditioning• Next you find a neutral stimulus (something
that by itself elicits no response).
• You present the stimulus with the UCS a whole bunch of times.
Classical Conditioning
• After a while, the body begins to link together the neutral stimulus with the UCS.
• Called Acquisition
Classical Conditioning
• We know learning takes place when the previously neutral stimulus elicits a response.
• At this point the neutral stimulus is called the conditioned stimulus (CS) and the unconditional response becomes the conditioned response (CR).
Popular Classical Conditioning Example
See if you can identify the UCS, UCR, CS and CR.
Jim Classically Trains Dwight
HOMEWORK PRACTICE
• Examples of Classical Conditioning – Identify the US, UR, CS, & CR for each scenario
What is the Little Albert experiment?
• John Watson classically conditioned a baby to fear a white rat. Then the baby feared all furry things. (this is called generalization)
Pavlov spent the rest of his life outlining his ideas. He came up with 5 critical terms that
together make up classical conditioning.
• Acquisition
• Extinction
• Spontaneous Recovery
• Generalization
• Discrimination
Classical Conditioning
• TRICKY FACT: We know learning exists because the CS is linked to the UCS.
• This is called ACQUISITION.
• Acquisition does not last forever.
• The moment the CS is no longer associated with the UCS, we have EXTINCTION.
Acquisition
Does timing matter?
• The CS should come before the UCS
• They should be very close together in timing. (about ½ second)
Timing Matters • Delayed Conditioning: present CS, while CS is still there,
present UCS.• Trace Conditioning: present CS, short break, then
present UCS.• Simultaneous Conditioning: CS and UCS are presented at
the same time.• Backward Conditioning: UCS is presented, then CS is
presented.
Spontaneous Recovery
• Sometimes, after extinction, the CR still randomly appears after the CS is presented.
• Apply this to real life. How could it be a problem?
Generalization and DiscriminationGeneralization
• Something is so similar to the CS that you get a CR.
Discrimination
• Something so different to the CS so you do not get a CR.
Classical Conditioning and Humans
• John Watson brought Classical Conditioning to psychology with his Baby Albert experiment.
This type of Classical Conditioning is also known as Aversive Conditioning.
Higher-Order ConditioningWhen a new neutral stimulus becomes a new conditioned stimulus
First Order Conditioning.
•Bell + meat = salivation.
•Bell = Salivation.
Second Order Conditioning(After first order conditioning has occurred)
•Light + Bell = Salivation.
•Light = Salivation.
Garcia and Koelling Study
• Studied rats and how they make associations.
• Some associations seem to be adaptive.
CS UCS Learned Response
Loud Noise Shock Fear
Loud Noise Radiation (nausea) Nothing
Sweet Water Shock Nothing
Sweet Water Radiation (nausea) Avoid Water
Are you being conditioned without knowing it?
• Advertisers use association all the time!
• Associating attractive models/celebrities with their product makes us feel positive when we see that product.
• Trauma as classical conditioning
• Rape leads to fear of all sexual encounters
Learned Taste Aversions
• When it comes to food being paired with sickness, the conditioning is incredible strong.
• Even when food and sickness are hours apart.
• Food must be salient (noticeable.)
Ever Experiences a Taste Aversion?
• Discuss
Applications of Taste Aversion• treating alcoholism, using the
drug Antabuse– causes nausea and violent vomiting
when combined with alcohol
– attempts to create a taste aversion to alcohol
• Problem: alcoholics tend to stop taking Antabuse so they can drink again– but when used properly, Antabuse
does reduce total amount of alcohol consumed (Brewer et al., 2000; Chick et al., 1992)
Applications of Taste Aversion• humane methods of
controlling predators, agricultural pests?– coyotes & wolves ate sheep
carcasses laced with nausea-inducing poison; developed aversion to sheep meat (Gustavson et al., 1974, 1976)• wolves penned with sheep later
seemed to fear it!
– similar results with baboons in African gardens, raccoons attacking chickens, ravens & crows feeding on raven eggs
Operant Conditioning
The Learner is NOT passive.
Learning based on consequence!!!
The Law of Effect
• Edward Thorndike• Locked cats in a cage• Behavior changes because of
its consequences.• Rewards strengthen
behavior.• If consequences are
unpleasant, the Stimulus-Reward connection will weaken.
• Called the whole process instrumental learning (aka operant conditioning).
Thorndike’s Puzzle Box• Edward Thorndike (1874-
1949): created a puzzle box: cage with latched door that could only be opened by pressing lever inside
– cats became quicker and quicker to press lever once they figured it out
– Law of Effect: rewarded behaviors are more likely to be repeated
B.F. Skinner• The Mac Daddy of
Operant Conditioning.
• Nurture guy through and through.
• Used a Skinner Box (Operant Conditioning Chamber) to prove his concepts.
Skinner Box
Reinforcer
• Any event that STRENGTHENS the behavior it follows.
Two Types of Reinforcement:
Positive and Negative
Positive Reinforcement
• Strengthens a response by presenting a stimulus after a response.
Negative Reinforcement• Strengthens a response by reducing or
removing an aversive stimulus.
Negative Reinforcement:
• The removal of something unpleasant. Two types of NR:
Escape Learning
Avoidance Learning
(Getting kicked out of class versus cutting class)
Positive or Negative?
Putting your seatbelt on.Studying for a test.
Having a headache and taking an aspirin.
Faking sick to avoid AP Psych class.
Breaking out of jail.
Getting a kiss for doing the dishes.
Negative Reinforcement Examples• Taking aspirin to get rid of headache
• Hurrying home in winter to get out of cold
• Giving in to an argument or dog’s begging/whining
• Fanning yourself to escape the heat
• Leaving theater if movie is bad
• Smoking to relieve anxiety
• Following prison rules to be released from confinement
• Putting in seatbelt to make car stop beeping
• Umbrella to escape rain
• Saying “uncle” to stop being beaten
PunishmentMeant to decrease a
behavior.Positive Punishment• Addition of something
unpleasant. (spanking=positive punishment)
Negative Punishment (Omission Training)
• Removal of something pleasant.
Punishment works best when it is immediately done after behavior and if it is harsh!
Punishment & Classical Conditioning• Spanking can lead to association b/w
parent & pain.
• US=spanking
• CS=Parent’s upraised hand that does the spanking
• UR=fear & crying from pain
• If parent’s upraised hand is paired often enough with the pain of spanking, children can begin to associate the gesture with pain & fear of their own parents. Can lead to children not trusting parents at early age
The following are examples of what???
Answer choices are positive punishment, negative punishment, positive
reinforcement, negative reinforcement
Spanking a child for writing on the walls.
Giving candy for correct answers.
Nagging and nagging until you do the dishes.
Child whines and cries until he gets his candy at the store.
Taking away cell phone privileges to reduce low grades.
Stop jamming toothpicks up one’s fingernails in exchange for
information
Practice Applying Concepts
• Complete reinforcement vs punishment wkst
How do we actually use Operant Conditioning?
Do we wait for the subject to deliver the desired behavior?
Sometimes, we use a process called shaping.
Shaping is reinforcing small steps on the way to the desired behavior.
To train a dog to get your slippers, you would have to reinforce him in small steps. First, to find the slippers. Then to put them in his mouth. Then to bring them to you and so on…this is shaping behavior.
To get Adam to become a better student, you need to do more than give him a massage when he gets good grades. You have to give him massages when he studies for ten minutes, or for when he completes his homework. Small steps to get to the desired behavior.
Chaining Behaviors
• Subjects are taught a number of responses successively in order to get a reward.
Click picture to see a rat chaining behaviors.
Click to see a cool example of chaining behaviors.
Can all animals be taught anything?
Instinctive drift
• Animals will drift (or revert) back to instinctual behaviors while performing tasks.
• Example: Pigs will deposit coins in a piggy bank but will push the coins through the mud and flip it around on its way.
• Behaviorists successfully taught a raccoon to deposit wooden coins into a metal container for food reinforcement. But soon the raccoon started rubbing the coins together and dipping them (not dropping them) into the container. It was performing the motor program raccoons use to "wash" food in a stream. This interfered with the trick to such an extent the Brelands had to give up on it. Instead, they trained the raccoon to "play basketball." The basketball was so large that the raccoon did not attempt to wash it.
Primary v. Secondary ReinforcersPrimary Reinforcer
• Things that are in themselves rewarding.
Secondary Reinforcer
• Things we have learned to value.
• Money is a special secondary reinforcercalled a generalized reinforcer (because it can be traded for just about anything)
Token Economy
• Every time a desired behavior is performed, a token is given.
• They can trade tokens in for a variety of prizes (reinforcers)
• Used in homes, prisons, mental institutions and schools. (Book-it = free pizza)
How is operant conditioning used at school?
• Discuss
Premack Principle
• You have to take into consideration the reinforcersused.
• Is the reinforcerwanted….or at least is it more preferable than the targeted behavior.
Wick’s pizza might be a great positive reinforcer for me, but it would not work well on a vegetarian.
Reinforcement Schedules
How often to you give the reinforcer?
• Every time or just sometimes you see the behavior.
Continuous v. Partial Reinforcement
Continuous
• Reinforce the behavior EVERYTIME the behavior is exhibited.
• Usually done when the subject is first learning to make the association.
• Acquisition comes really fast.
• But so does extinction.
Partial/Intermittent
• Reinforce the behavior only SOME of the times it is exhibited.
• Acquisition comes more slowly.
• But is more resistant to extinction.
• FOUR types of Partial Reinforcement schedules.
Ratio Schedules
Fixed Ratio• Provides a
reinforcement after a SET number of responses.
Variable Ratio• Provides a
reinforcement after a RANDOM number of responses.
• Very hard to get acquisition but also very resistant to extinction.
Fixed Ratio- She gets a manicure for every 5 pounds she loses.
Interval Schedules
Fixed Interval• Requires a SET amount
of time to elapse before giving the reinforcement.
Variable Interval• Requires a RANDOM
amount of time to elapse before giving the reinforcement.
• Very hard to get acquisition but also very resistant to extinction.
• EG – Pop Quizzes
Fixed Interval: She gets a manicure for every 7 days she stays on her diet.
Delayed Gratification• Delayed gratification is a skill that many
parents want their children to have. People who can delay gratification are able to achieve more in life. Consider the following:
• What types of real world rewards occur on a delayed schedule?
• Did you learn to wait for rewards? Why or why not?
• Does the media encourage people to delay gratification? Why or why not?
Practice Applying Concepts
• Complete Schedules of reinforcement wkst
Observational Learning
• Albert Bandura and his BoBo Doll
• We learn through modeling behavior from others.
• Observational learning + Operant Conditioning = Social Learning Theory
Click pic to see some observational learning.
A very powerful ad - may be slightly disturbing for some
Latent Learning
• Edward Toleman
• Three rat experiment.
• Latent means hidden.
• Sometimes learning is not immediately evident.
• Rats needed a reason to display what they have learned.
Cognition & Operant Conditioning
How does latent learning and external rewards affect learning?
• Rats put in maze for 10 days to explore. No reward.
• Next time in maze, they solved it very fast with food reward at end –developed cognitive map.
• Latent Learning - learning that becomes apparent only when incentive to demonstrate it.
Cognition and MotivationHow do in/extrinsic affect learning?
• Intrinsic Motivation - desire to perform behavior effectively for its own sake.People with this work and play for enjoyment, interest, self-expression or challenge. Examples?
• Extrinsic Motivation – desire to behave in certain ways to receive external rewards or to avoid threatened punishment. Examples?
Insight Learning
• Wolfgang Kohler and his Chimpanzees.
• Some animals learn through the “ah ha” experience.
Click pic to see insight learning.
• Insight Learning: This is an extension of the term, insight which was identified by Wolfgang Kohler while studying the behavior of chimpanzees. He said that insight learning is a type of learning or problem solving that happens all-of-a-sudden through understanding the relationships of various parts of a problem rather than through trial and error.
Sultan, one of Kohler's chimpanzes, learned to use a stick to pull bananas from outside of his cage by putting pieces of stick together. Given two sticks that could be fitted together to make a single pole that was long enough to reach the bananas, aligned the sticks and in a flash of sudden inspiration, fitted the two sticks together and pulled in the bananas. He didn't do this by trial and error, but had a sort of sudden inspiration or insight.
Classical Conditioning(to tune of You Are My Sunshine)
You are my Pavlov,
The dogs of Pavlov
You paired the food
with the lights and bells
Response was very involuntary
You taught
classic conditioning well
OPERANT CONDITIONING
His name is Skinner, oh BF Skinner
You put the lab rats
inside your box
With reinforcements,
and even punishments
Consequences shape the response
Don’t forget to write your answers on a separate piece of paper to grade when you’re done!
1. Once Pavlov’s dogs learned to salivate to the sound of a tuning fork, the tuning fork was a(n)
a) unconditioned stimulus
b) neutral stimulus
c) conditioned stimulus
d) unconditioned response
2. Shaping is
a) a pattern of responses that must be made before classical conditioning is
completed
b) rewarding behaviors that get closer and closer to the desired goal behavior
c) completing a set of behaviors in a succession before a reward is given
d) giving you chocolate pudding to increase the likelihood you will eat more carrots
3. John loves to fish. He puts his line in the water and leaves it there until he feels a tug. On what reinforcement schedule is he rewarded?
a) fixed ratio
b) fixed interval
c) variable ratio
d) variable interval
4. Chimpanzees given tokens for performing tricks were able to put the tokens in vending machines to get grapes. The tokens acted as
a) primary reinforcers
b) classical conditioning
c) secondary reinforcers
d) unconditioned reinforcers
5. Try as you might, you are unable to teach your dog to do a somersault. He will roll around on the ground, but he refuses to execute the gymnastic move you desire because of
a) preparedness
b) instinctive drift
c) chaining
d) shaping
6. Watson and Rayner’s classical conditioning of “Little Albert” was helpful in explaining that
a) some conditioned stimuli do not generalize
b) human emotions such as fear are subject to classical conditioning
c) drug dependency is subject to classical as well as operant conditioning
d) small children are not as easily conditioned as older children
7. Jamel got very sick after eating some mushrooms on a pizza at his friend’s house. He didn’t know that he had a stomach virus at the time, blamed his illness on the mushrooms, and refused to eat them again. Which of the following is the unconditioned stimulus for his taste aversion to mushrooms?
a) pizza
b) stomach virus
c) mushrooms
d) headache
8. If a previous experience has given your pet the expectancy that nothing it does will prevent an aversive stimulus from occurring, it will likely
a) be motivated to seek comfort from you
b) experience learned helplessness
c) model the behavior of other pets in hopes of avoiding it
d) seek out challenges like this in the future to disprove the expectation
9. While readying to take a free-throw shot, you suddenly arrive at the answer to a chemistry problem you’d been working on several hours before. This is an example of:
a) insight
b) backward conditioning
c) latent learning
d) discrimination
10. Which of the following is an example of positive reinforcement?
a) Buying a child a video game after she throws a tantrum.
b) Going inside to escape a thunderstorm.
c) Assigning a student detention for fighting.
d) Getting a cavity filled at the dentist to halt a toothache.
11. The first step in a behavior modification program is to
a) gather baseline data
b) specify the antecedent
c) specify the target behavior
d) design a program
12. In classical conditioning, the stimulus that is originally neutral in regard to the response to be learned is the
a) unconditioned stimulus
b) unconditioned response
c) conditioned stimulus
d) conditioned response
13. Typically, most people would
a) enjoy being negatively reinforced or punished
b) dislike being negatively reinforced or punished
c) enjoy being negatively reinforced and dislike being punished
d) enjoy being punished and dislike being negatively reinforced
14. Classical conditioning could account for how a child learns to
a) sing a song
b) tie shoe laces
c) print letters
d) fear the dark
15. The initial stage of learning a response is called
a) extinction
b) contiguity
c) acquisition
d) conditioning
Answer Key
1. C
2. B
3. D
4. C
5. B
6. B
7. B
8. B
9. A
10. A
11. C
12. C
13. C
14. D
15. C
