Behavioral AssessmentBehavioral Assessment

Selection and Definition of Target BehaviorsSelection and Definition of Target Behaviors Selection of a Measurement DeviceSelection of a Measurement Device Recording behavior (Collection of Data)Recording behavior (Collection of Data) Assessment of Reliability or IOA (Lecture 6)Assessment of Reliability or IOA (Lecture 6) Selection of Data Display/graphing (Lecture 7)Selection of Data Display/graphing (Lecture 7)

Freedom of Speech?Freedom of Speech?

Behavioral (OP) DefinitionsBehavioral (OP) Definitions

WalkingWalking Form: Body movement with alternating L/R leg forwardForm: Body movement with alternating L/R leg forward

Restriction: Body erectRestriction: Body erect Restriction: One foot always in contact with groundRestriction: One foot always in contact with ground Revised form: Body movement with erect torso, with Revised form: Body movement with erect torso, with

alternating L/R leg forward with one foot always in contact alternating L/R leg forward with one foot always in contact with the groundwith the ground

HallucinationHallucination Form: Verbal statement (usually of personal experience)Form: Verbal statement (usually of personal experience)

Restriction: Experience or events unlikely to have basis in Restriction: Experience or events unlikely to have basis in realityreality

Revised form: Verbal statement about a personal experience Revised form: Verbal statement about a personal experience unlikely to have any basis in factunlikely to have any basis in fact

Characteristics of a Good Measurement SystemCharacteristics of a Good Measurement System

Objectivity:Objectivity: Response (R) definitions are observable, unambiguous Response (R) definitions are observable, unambiguous

““Poor self-concept”Poor self-concept”

Reliability:Reliability: Instrument produces consistent (repeatable) results Instrument produces consistent (repeatable) results

Verbal estimate of amount of time spent running Verbal estimate of amount of time spent running

Validity:Validity: Instrument produces accurate representation of events Instrument produces accurate representation of events

An 11.5-inch rulerAn 11.5-inch ruler

Sensitivity:Sensitivity: Instrument reflects changes in R Instrument reflects changes in R

Use of an analog watch to time a raceUse of an analog watch to time a race

Recording behavior (Data Collection)Recording behavior (Data Collection)

Outcome (product): Observable results of ROutcome (product): Observable results of R

Process: Observable aspects of ongoing RProcess: Observable aspects of ongoing R

Outcome ObservationOutcome Observation

Advantage:Advantage: Convenience; does not require presence of observer Convenience; does not require presence of observer

Disadvantages:Disadvantages: Some Rs do not always produce the same outcomeSome Rs do not always produce the same outcome

Study, athletic practice, amount of time spent workingStudy, athletic practice, amount of time spent working Some outcomes can be produced by Rs other than the targetSome outcomes can be produced by Rs other than the target

Weight loss (from diet, exercise, laxatives)Weight loss (from diet, exercise, laxatives)

Process ObservationProcess Observation

Advantage: Flexible; can accommodate a wide range of RsAdvantage: Flexible; can accommodate a wide range of Rs

Disadvantage: Requires system to account for multiple R dimensionsDisadvantage: Requires system to account for multiple R dimensions

*Topography: Form of R; usually restricted by R definition*Topography: Form of R; usually restricted by R definition Magnitude: Force of RMagnitude: Force of R *Frequency: Number of occurrences of R*Frequency: Number of occurrences of R *Duration: Amount of time during which R occurs*Duration: Amount of time during which R occurs Latency: Time elapsed from some starting point to R onsetLatency: Time elapsed from some starting point to R onset Interresponse time (IRT): Time elapsed between episodes of RInterresponse time (IRT): Time elapsed between episodes of R

Measuring Ongoing BehaviorMeasuring Ongoing Behavior(Process Observation)(Process Observation)

Continuous Recording: Every instance of R is countedContinuous Recording: Every instance of R is counted Event recording: Frequency, rateEvent recording: Frequency, rate Duration recording: Duration, latency, IRTDuration recording: Duration, latency, IRT

Discontinuous sampling (i.e., interval recording): Only a Discontinuous sampling (i.e., interval recording): Only a subset of Rs is countedsubset of Rs is counted Divide session time into equal intervalsDivide session time into equal intervals Record occurrences of R during an intervalRecord occurrences of R during an interval Convert into % of intervals during which R occurredConvert into % of intervals during which R occurred

Sampling MethodsSampling Methods

Data Collection ExercisesData Collection Exercises VideosVideos In vivoIn vivo

Interobserver Agreement (Reliability)Interobserver Agreement (Reliability)

Definition:Definition: Consistency of an observational code, or the Consistency of an observational code, or the extent to which an observational code produces the same extent to which an observational code produces the same results across samples (subjects, behaviors, time, observers, results across samples (subjects, behaviors, time, observers, etc.)etc.)

Method for assessment:Method for assessment: Collect independent samples of data; Collect independent samples of data; compare results to a standard or to each othercompare results to a standard or to each other

Reliability CalculationsReliability Calculations

Total agreement: Compare overall session values (totals) Total agreement: Compare overall session values (totals) obtained by two observersobtained by two observers Rel = Smaller / Larger Rel = Smaller / Larger

Interval agreement: Compare individual data entries by two Interval agreement: Compare individual data entries by two observers and score as agreements or disagreementsobservers and score as agreements or disagreements

Rel = # Agreements / (# Intervals)Rel = # Agreements / (# Intervals) Exact agreement: Compare frequencies entered by two Exact agreement: Compare frequencies entered by two

observers and score exact agreementsobservers and score exact agreements Rel = # Exact agreements / (# Intervals)Rel = # Exact agreements / (# Intervals)

Proportional (frequency-within-intervals) agreement: Proportional (frequency-within-intervals) agreement: Compare frequencies entered by two observers and score Compare frequencies entered by two observers and score proportional agreementsproportional agreements Rel = ∑ (Smaller/Larger) / # IntervalsRel = ∑ (Smaller/Larger) / # Intervals

Reliability Calculation ActivityReliability Calculation Activity

Calculate interval agreement score for the following data:Calculate interval agreement score for the following data:

Intervals 1 2 3 4 Data: Observer 1 1 1 0 3 Data: Observer 2 2 0 1 3