48
Announcements Papers Group 3 Final Version due Friday 11:55 pm PsychPortal-D2L integration Blah blah blah … sure … but odds are better than Powerball Grade Query Tool Check your scores, as this tool will be the definitive source for your final grade! Rectify Wrecktify

Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

  • Upload
    others

  • View
    4

  • Download
    2

Embed Size (px)

Citation preview

Page 1: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

AnnouncementsPapers

Group 3 Final Version due Friday 11:55 pm

PsychPortal-D2L integrationBlah blah blah … sure … but odds are better than Powerball

Grade Query ToolCheck your scores, as this tool will be the definitive source for

your final grade!

RectifyWrecktify

Page 2: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to
Page 3: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to
Page 4: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Is your clicker on this list?If so, you’re an unlucky winner! You are not getting credit for attendance, and should come

to instructor office hours

5A7DC77BB2784537B47D814018630787486

8754587BD087DA88893E8A0B98A0D28DBD7

8E7C08F012911E491F0C9202E92939

Page 5: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Operant Conditioning(a wee bit more…)

Page 6: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

The fundamental principle of Operant Conditioning

is captured by Thorndike’s Law of Effect

This law states that is rewarded behavior is likely to occur again.

Page 7: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to
Page 8: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Rewarded Behavior likely to recur

So ….. If we can exceed 1000 students in attendance next Monday, every person in attendance gets one free attendance point!

Page 9: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Schedules of Intermittent Reinforcement

But how often and consistently should one give rewards?

Page 10: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Schedules of reinforcement Continuous vs Partial Parital reinforcement schedules Interval schedules Fixed Interval (FI): interval is always same

between rxfx Variable Interval (VI): interval length varies

Ratio Schedules Fixed ratio (FR): Ratio always same Variable ratio (VR): Ratio varies

Page 11: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Four types of partial rxfx schedulesVariable rxfx = smooth rates of respondingFixed rxfx = "scalloping"

Page 12: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

The Operant World…Generalization – same response to similar stimuli

Discrimination – learn different responses to similar stimuli

Shaping – reward successive approximations

Chaining – string together already learned behaviors

Superstition Learning – “learn” associations that don’t in fact exist

Page 13: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Basketball Superstitions

Page 14: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Michael Jordan’s Superstitions

Page 15: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Who, us? Superstitious?

The GreatHiccup Cure

Survey

Page 16: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Hold your breath for 48 seconds exactly, no less no more.

Page 17: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

While holding your breath, eat five green olives. Do NOT breath at all while you eat them, but don't pass out.

Page 18: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Spin around clockwise while rubbing your stomach counterclockwise while jumping up and down

Page 19: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Go to a drinking fountain or grab a glass of water. While you are drinking (it must literally by during the drinking process), mumble Mississippi MississippiMississippi. It has worked since I was little. I promise it will work its magic on you.

Page 20: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Drink from the other side of a cup (than you know.. the usual) and bend over while drinking. Sounds complicated, but it works. My disclaimer however, if you're sloppy, be prepared to get your shirt wet.

Page 21: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Put you pinky fingers together, the ends, and hold them right in front of your eyes. Then look at the spot where your pinkies touch and without looking away say hiccup, diccup, three sips of my ticcup and take three sips of a drink.

Page 22: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Hang upside from a really high bed, as you sing a little jig about pink elephants, and finally as you are hanging upside down chug a whole liter of smart water! This combination works like a charm!

Page 23: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

I better get Extra Credit for this. Think of three bald men fast, say them out loud and picture each one in great detail. If this does not work hold your breath while doing a handstand. Good Luck

Page 24: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Chug a dr. pepper eat 3 red skittles and then stand on your head. IT WORKS I SWEAR!

Page 25: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Put a lit match in a glass of cold water then drink the water

Page 26: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

Say the Alphabet backwards in one breath and skip the vowels

Page 27: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Surefire Hiccup Cure:

There is a cure however it only treats 1% of the world's population and the other 99% of us have to suffer through with it.

Page 28: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

The Main Point

There may be valid mechanisms behind many of these (e.g. breath alteration to change diaphragm movement)

But there may also have been additional elaborations learned that are not essential, and they become part of the ritual

The unabridged list of submitted hiccup cures is on the class website: www.PSY150A1.org

Page 29: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Operant Chamber

Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to study operant conditioning.

Walter D

awn/ Photo R

esearchers, Inc.

From

The

Ess

entia

ls o

f Con

ditio

ning

and

Lea

rnin

g, 3

rd

Editi

on b

y M

icha

el P

. Dom

jan,

200

5. U

sed

with

per

mis

sion

by T

hom

son

Lear

ning

, Wad

swor

th D

ivis

ion

Page 30: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

The Operant World….

Page 31: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

D. Operant Conditioning: Types of Reinforcers

1. Positive Rxfx: REWARD!!!2. Negative Rxfx: Termination of an aversive

condition. NOT PUNISHMENT!3. Punishment: Presentation of an aversive

condition – often good only in short term, or to stop a behavior

4. NOTE: 1. positive and negative rxfx are used to increase a

desirable behavior2. punishment is used to decrease an undesirable

behavior

Page 32: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

What do you think? The instructor’s bell, rung when the ambient noise climbs to

unacceptable levels, represents:

1. Positive Reinforcement2. Negative Reinforcement3. Punishment

Page 33: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Email as combination of positive and negative reinforcement

Page 34: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Inadvertent reinforcement of undesirable behaviors

Page 35: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Inadvertent reinforcement of undesirable behaviors

Page 36: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Test your Knowledge about Phobias

Page 37: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

II. Avoidance learning (Phobias) as combination of CC and OC

A. CC: Generalization & Extinction in Simple Phobias

B. OC: Avoiding the dogs is reinforcing; negative rxfx

Page 38: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Classical Conditioning of Phobias

Conditioned Stimulus (CS)

Dog

Conditioned Response (CR)

Fear!!

UnConditioned Response (UCR)

Fear!

UnConditioned Stimulus (UCS)

Bite

Page 39: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Operant Reinforcement

Sight or thought of dog creates aversive state. (Classical)

Escape or avoidance of the dog reduces or eliminates the aversive state = negative reinforcement (Operant)

Page 40: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Little Albert

Sight or thought of white animal creates aversive state. (Classical)

Escape or avoidance of the animal reduces or eliminates the aversive state = negative reinforcement (Operant)

Page 41: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

III. Application of Associative Principles--Token Economies

A. Contingencies set up: rewarded and non-rewarded behaviors

B. Prisoners/Mental Patients/school children given tokens if desired behaviors performed

C. Tokens later good for privileges, cigarettes, candy, magazines, etc.

D. Efficacy

Page 42: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Classesas a Token Economy

Points don’t have inherent value Points contribute to grades Grades don’t have inherent value, but good grades …

create other desirable outcomes (positive reinforcement) avert undesirable outcomes (avoid punishment or

nonreinforcement)

Page 43: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Class and Clickersas a Token Economy

Attendance is defined as a desirable behavior (it’s good for learning)

Attendance is rewarded with points (a token) Lack of attendance is not rewarded Fraudulent behavior (faking attendance) is punished

Page 44: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

One more Operant Conditioning Case…

Clever HansThis mathematical horse got famous for being capable of a variety of arithmetic and literate feats, reporting his conclusions by tapping the ground with his hoof. However, the psychologist Oskar Pfungst did a variety of experiments on Clever Hans, demonstrating that that horse was picking up unconsciously-generated cues from his questioners, and working from those when to stop tapping. What Clever Hans's owner, Wilhelm von Osten, had inadvertently done was some operant conditioning; giving Hans a piece of carrot whenever he had tapped the right number of times. The horse then learned to associate his master's getting subtly tense with when to continue tapping, and his master's getting relieved with when to stop. Pfungst even went on to demonstrate that he could do what Clever Hans had done, picking up subtle cues from his human experimental subjects.

Page 45: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

This slide intentionally left blank (except for this disclaimer)(which means it’s not really blank then, is it?)

Page 46: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to
Page 47: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

Memory

Page 48: Lecture18 Operant Memory - University of ArizonaOperant Chamber Using Thorndikeʹs law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to

DEMO!!!

Listen to this list…