Work Session 1Locating Baseline DataOffice of Research, Evaluation and Policy StudiesXimena D. Burgin, Ed.D.November 30th, 2010

Databases

Restricted Databases Public Databases Commercial Databases Your Own

Restricted Databases: Institute of Education Sciences (IES):

Assessments Early Childhood Elementary / Secondary International Library Postsecondary

Public Databases: Illinois Interactive Report Card (IIRC):

Commercial Databases:Survey of Enacted Curriculum

Commercial Databases:California Critical Thinking Skills Survey

Your own:Alcohol, Tobacco, and Other Drug (ATOD)

Data Collection

Techniques to collect data Observations Interviews Questionnaires (open-

ended questions) Documents Audiovisual materials

Qualitative Exploration of

the unknown. Understanding

of a central phenomena.

Quantitative Trends or

explanation of relationships among variables.

Data Analysis

Textual analysis (Qualitative) Perform preliminary exploratory analysis Code the data Create themes Summarize findings (choose narrative discussion)

Statistical analysis (Quantitative) Descriptive statistics Inferential statistics

Sample of ATOD Survey Questions

Validity

“Whether an instrument measures what it is suppose to measure”

Appropriateness, correctness, meaningfulness, and usefulness of the specific inferences made from data

Reliability

Consistency of scores obtained from individuals

Are results repeatable from one administration of instrument to another?

Validity and reliability

Assessing reliability

Test-retest reliability Alternate (Parallel) forms reliability Alternate (Parallel) forms & test-retest

reliability Internal consistency reliability Inter-Rater or Inter-Observer reliability

Internal consistency reliability

Inferential statistics

Generalizing from samples to populations