PADI: Principled Assessment Designs for Inquiry Geneva Haertel, PI

SRI International

This material is based upon work supported by the National Science Foundation under Grant No. REC-0129331. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

ACKNOWLEDGMENTS

P A D I

M I C H I G A NM I C H I G A N

Robert J. Mislevy, PIUniversity of Maryland

General Specific

Student Model

Evidence Model

Task Model

Development of FOSS/ASK Assessments Using the PADI Design System

PADI Gradebook

Student Database

Task Specs

Assessment Management Information

Instantiated Tasks

Repository

PADI Scoring Engine

PADI Calibration

Engine

Assessment Delivery System

(4 process model)

Assessment Authoring

System

Concrete Tasks

scoresscores +

design info

PADI Design System is used to:• Articulate the purpose and rationale of a

particular assessment• Develop design patterns, task templates, and task

specifications detailing the qualities required in the assessment tasks

Authoring System is used to:• Generate instantiated tasks that will be delivered

to students following the task specifications• Calibrate instantiated tasks before widespread

administration

Assessment Delivery System is used to:• Present tasks to students and gather student

responses• Evaluate student work and compute estimates of

student proficiency or access separate applications to perform those functions

• Update the Student Database with new proficiency estimates

Kathy LongFOSS Project,

Lawrence Hall of Science

Cathleen Kennedy & Mark WilsonUniversity of California,

Berkeley

Nancy Butler SongerBioKIDS Project,

University of Michigan

Assessment Design and Implementation

Using PADI ToolsAbility to plan investigations

Ability to gather and organize data

Multidimensional Item Response

Modeling

Some dichotomous and some partial credit responses

Materials include sample lab report to be

evaluated by student

Grade level will determine complexity

of items

Multiple choice items and short constructed

responses

Ability to interpret data and build explanations

Evaluation Phase

Observable Variables

Measurement Model

Materials and Presentation

Work Products

Student Model with Three Proficiencies

PADI Scoring Engine

PADI Gradebook

ScoredResponse

ScoredResponseScored

Response

Scored Responses of Students

Derived from the Principles of Scientific Inquiry Design Pattern Derived from Student Model, Activities, and Task Specifications

Update

ScoredResponse

NSF REC Grant #0129331

PADI Design Products

Repository

Student Model

Flow of Design Decisions

PADI Design System

Project site: http://padi.sri.com/

ScoredResponse

Implementation