28
PTP 560 • Research Methods • Week 4 Thomas Ruediger, PT

PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Embed Size (px)

Citation preview

Page 1: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

PTP 560

• Research Methods

• Week 4

Thomas Ruediger, PT

Page 2: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Design

• Similar (not identical) to clinical practice

• Independent variable is the intervention• Dependent variable is the response (outcome)

• Requires strict attention and control

• Allows for flexibility to observe change– In clinical (real world) setting

Page 3: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Designs• Sample

– Single individual or small group: Assume 1 person for this class– A community, department or institution

• Advantage– Small sample: saves time/money; clinically useful– Appreciates/differentiates unique characteristics

• Methods– Clinically viable, controlled experimental approach– Flexible to observe change in ongoing treatments

Page 4: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure

• Repeated Measures to start - Baseline– This is where it differs from clinical practice (“the single feature” – P &

W)– Attempt to reflect ongoing background effects– How is this different than clinical practice?

• In the clinic we start right away, not wait for a baseline.• While for SSS we will wait for 3 treatments to begin specific intervention to

test• Also subjects needs to sign consent form.

• Two caveats on these baseline measures– Not unethical to withhold treatment when outcome is not known– Not all treatment is withheld, just the one of interest

Page 5: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure• Baseline Measures (AT LEAST THREE!)– Stable baseline is most desirable

• Indicates that the behavior is stable• Increases confidence that changes after the intervention

begins are due to that intervention

– Variable baseline is problematic• Usually requires continued baseline collection• Investigate possible causes (Cyclical, time of day/week etc)• If cannot resolve, at risk for obscuring intervention effect

– Trend or slope of baseline• Accelerating or decelerating• May be stable or unstable

Page 6: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure

• How many baseline measure are needed?– AT LEAST 3

Page 7: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Designs

Baseline Characteristics• Stable or variable?– Consistency of the

response

– Left are stable, right are unstable

• Trend– Rate of change or slope

Page 8: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject StructureTarget behavior

• Quantifying the measure?

– Frequency• % correct• In an interval

– Duration

– Quantitative Score (Magnitude)

Page 9: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure• Intervention Phase

– At least 3 data points

– The minimum number of data points needed in an A-B study is 6 (3 for phase A and 3 for phase B)

• Reliability usually assessed=assuming no change the measurement is the same. – Concurrently with data collection– Instead of in pilot study– Inter-rater by percentage agreement

• A(baseline)-B(intervention or independent variable) is the simplest form of Single Subject Design– Major limitation is ability to control– This limitation is a threat to internal validity

Page 10: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Designs

Design Phases• Baseline Phase (Left)

– Information during “no treatment”

– Serves as a control condition

• Intervention Phase (Right)– Measures during treatment– Serves as comparison

Page 11: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure• A-B-A design useful to help internal validity

– The Causal Nature, However, behavior must be reversible• Reversibility just needs to be sig. different, but not back to baseline.

• A-B-A-B– Strengthens design– Again behavior must be reversible

• Consider Multiple Baselines (Fig 12.7)– To avoid being unethical, if withdrawal is unethical– If behavior is:

• Nonreversible• Prone to carryover

Page 12: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Week 1 Week 2 Week 3 Week 4

Baseline Intervention

Function

A Baseline

B Intervention

A Baseline

ABA Design

Page 13: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Week 1 Week 2 Week 3 Week 4

Baseline Intervention

Function

A Baseline

B Intervention

A Baseline

B Intervention

ABAB Design

Page 14: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure• Multiple Baselines– Across behaviors

• One subject• Multiple behaviors (outcomes)

– Across subjects• Multiple individual subjects• One target behavior

– Across conditions• One subject• One behavior• Two or more conditions/situations/environments

Page 15: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure• Non-concurrent Multiple Baselines (Fig 12.8)

– Multiple individual subjects– One target behavior– Intervention begun at randomly assigned intervals

• Alternate Treatments (Fig 12.9)– Appropriate when response is immediate– Session by session– Day by Day

• Multiple Treatment A-B-C-A (Fig 12.10)– Across conditions

• One subject• One behavior• Two or more conditions/situations/environments

Page 16: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure

• Data analysis– Comparisons ONLY across adjacent phases

• Only compare letters that are next to each other, so can’t compare A to C.

– Are the data level?– Visual – Mean

– Is there a trend?– Direction within a phase– Accelerating/decelerating/constant

– What is the slope?– Rate of change

Page 17: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure

• When making comparisons in these scenarios, what can you compare?

A-B-A

A-B-C-A

A-B-C-D-E-F-G-A

Page 18: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Structure

• Data analysis– The split middle• Apply the binomial test (Table A.9)

– Two standard deviation method– Serial dependency– C statistic

– Statistical Process Control• Upper and Lower Control Limits

– Based on 3 standard deviations– Then apply the three rules (p 266)

Page 19: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

• Autocorrelation: if data are correlated

Page 20: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Designs

• Celeration Line (Split Middle Line)

– Measure of central tendency

– Represents the median point of the data

– Counts data points above or below in a given phase.

– Adjust line up or down to a point where data is equally divided

– Extend into intervention phase

Page 21: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Celeration Line

Page 22: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Celeration Line

Page 23: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Celeration Line

Page 24: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Designs

Non-ParametricCeleration LineBinomial Test

1. Extend split middle line of baseline phase into intervention phase

2. Count Total points• Count points above • Count points below

3. Consult Table A.9

This Figure is 12.13 in Ed 3

Page 25: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Design

• Generalization is a challenge

Strengthened by:– Direct replication

– Systematic Replication: with purposeful change in some parameter

– Clinical Replication: taking it out of realm of research, take it out to a clinic

– Social Validation: is it okay to use this intervention.

Page 26: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Single Subject Designs

Social Validation• Importance within specific social context– Setting Treatment Goals

• Appropriate to functional needs of patient; social importance

– Procedures• Acceptable treatments/interventions; patient preference, comfort

and safety

– Effects• Appropriate Magnitude of treatment & treatment effects

Page 27: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Exploratory Research

• Prospective: randomized-control study• Retrospective: chart review study• Exploratory: generating questions• Descriptive• For relationship investigation: SSS• For correlation (how much does X vary with Y) and

regression analysis (predicted ability)• The Case of the “Haves” and the “Have Nots”

Fig 13.2, Fig 13.3 : with an ACL without an ACL have this risk

Page 28: PTP 560 Research Methods Week 4 Thomas Ruediger, PT

Exploratory Research

• Causality can be argued for better with– 1. Established time sequence

– 2. Strong association

– 3. Biologic credibility

– 4. Consistency with other studies

– 5. Dose-response relationship