Embracing Data & Celebrating Error

Introduction to Data Driven Instruction

CAHSEE Pass and Proficient

350

380

340

330

360

370

390

400

Pass

Proficient

~56 RS or ~62% ELA

~44 RS or ~55% Math

~70 RS or ~78% ELA

~59 RS or ~74% Math

~14 Items ELA

~15 Item Math

275

450

How Far Have We Come?

Medical Metaphor Symptoms Examination Diagnosis Cause Prescription Treatment Prognosis

Data Informed Instruction Three Models

Curriculum(Standards)

Instruction

Learning

Very Bad Model

Teach Whole Standard Again

Louder?

Non-Informed Instruction

Data-Informed Instruction Curriculum(Standards)

Instruction

Learning

Assessment

Feedback

?

Intervention Model

Data-Informed Instruction Curriculum(Standards)

Instruction

Learning

Feed Forward

Preventive Model

PedagogyData AnalysisExisting Info

BFI

Collaborative Focus Questions

1. What is it we want the students to learn?

2. How do we know if they learned it?

3. What do we do if they haven’t learned it?

4. Why DIDN’T they learn it?

5. What do we do when they have learned it?

Assessment HierarchyCalifornia Standards Tests (CSTs)Benchmark AssessmentsShort-Cycle Assessments Instructional Program AssessmentsTeacher Made AssessmentsQuestioning Observation

STAR CSTs

Reduction Funnel

Dist-Bmk

S-C-As

Funneling enables us to zoom in on achievement problems at increased levels of magnification and detail

Big Hand?

12

6

39

1110

54

12

78

Little Hand?

What is Error Analysis?

12

6

39

1110

54

12

78

12

6

39

1110

54

12

78

12

6

39

1110

54

12

78

12 ÷ 3 = ? A.

B.

C.

D.

9

15

36

ITEM

STEM

RESPONSES

DISTRACTORS

CORRECT RESPONSE

Selected-Response Item

4

Item Diagnosis Example17. Last year the cost of tuition at Community College was $2200 a semester. If the tuition increases by 15%, what will the will the new cost be?

A. $ 330

B. $1,870

C. $2,332

D. $2,530

32%

7%

3%

58%

Didn’t add increase to principal

Subtracted increase to principal

Incorrectly calculated increase

Correct

What About Reporting?

Common Assessment Data ReportStandard % Correct N % Students

6.NS.1.4. Calculate interest, % increases, discounts, tips, etc.

56% 100 A B C D

Increase Item #17 99 32 7 3 58

Interest Item #22 100 8 62 28 2

Discounts Item #25 100 47 45 6 2

6.MG.1.1. Use π to calculate circle area & circumference

47% 100 A B C D

6.AF.1.1. Linear equations 42% 100 A B C D

6.NS.1.3. Proportions 31% 100 A B C D

6.NS.2.4. LCM 22% 100 A B C D

32%58%

7%3%