Transcript
Page 1: CDE Special Report: Measuring Learning Success

Q1 Special

Report Webinar

April 10, 2014

Page 2: CDE Special Report: Measuring Learning Success

www.centerdigitaled.com

DECEMBER 17, 2013April 10, 2014

Page 3: CDE Special Report: Measuring Learning Success

DECEMBER 17, 2013

• Special Report Overview

• Guest Speakers

• Q&A

Today’s Agenda

Tom Ryan, Ph.D.Sr. FellowCenter for Digital EducationFormer CIO, Albuquerque Public Schools

April 10, 2014

Page 4: CDE Special Report: Measuring Learning Success

April 10, 2014

Page 5: CDE Special Report: Measuring Learning Success

Q & A Participation

•To ask a question, enter it into the“Ask a Question” box and click “Submit”

•We will answer as many questions as possible in the available time

•This webcast will be posted to http://www.centerdigitaled.com

April 10, 2014

Page 6: CDE Special Report: Measuring Learning Success

April 10, 2014

Assessment is much more than accountability

The focus of assessment is shifting to authentic, ongoing measurements, relevant feedback to inform personalized instructional practices

Page 7: CDE Special Report: Measuring Learning Success

April 10, 2014

“OLD SCHOOL” ASSESSMENTS

Paper-based

Limited

Not Applicable to real world

Infrequent

Unwieldy and error-prone

Difficult to customize

Limits how to assess higher order thinking

Page 8: CDE Special Report: Measuring Learning Success

April 10, 2014

Knowledge Test Performance Test

http://www.stanforddrivingschool.com

Both are Essential

Page 9: CDE Special Report: Measuring Learning Success

April 10, 2014

Reduced Grading Burden

Increased instructional Time

Quick Return on Results

Improved Test Security

Accessibility &Accommodation

Page 10: CDE Special Report: Measuring Learning Success

April 10, 2014

Instructional ObjectivesExecutive SponsorshipBuy-inStart SmallAdd Technology IncrementallyProfessional development

PLCsResearch compatibilityTotal Cost of OwnershipVendor relationshipsThoughtful ApproachMeasure Success

Page 11: CDE Special Report: Measuring Learning Success

April 10, 2014

Platforms to aggregate data

Dashboards

Learning AnalyticsPredictiveDiagnostic

Page 12: CDE Special Report: Measuring Learning Success

April 10, 2014

Page 13: CDE Special Report: Measuring Learning Success

April 10, 2014

Page 14: CDE Special Report: Measuring Learning Success

Our 1st Guest Speaker

Bill JamesTeacherMilford High SchoolHighland, Michigan

April 10, 2014

Page 15: CDE Special Report: Measuring Learning Success

Using data properlyBill James

Milford High School

Highland, MI

Page 16: CDE Special Report: Measuring Learning Success

Examining Examinations

O Central tendency

O Not sufficient though

O Need to examine a detailed report

Page 17: CDE Special Report: Measuring Learning Success

Item analysis

Page 18: CDE Special Report: Measuring Learning Success

Numbers to focus on…O KR20

O Measures overall test reliability

O Range from 0.0 – 1.0

O Closer to 1.0 = more reliable

O Point biserial

O Measures item reliability

O Range from -1.0 – 1.0

O Closer to 1.0 = more reliableO 0.3 = very good items

O 0.09 and less = poor items

O Negative should prompt review of questionO Student who did well on test overall did not do well on

that question

Page 19: CDE Special Report: Measuring Learning Success

Another look

Page 20: CDE Special Report: Measuring Learning Success

Formative assessments

O In class and spur of moment

O Assessment of lesson

O Change on the fly too

Page 21: CDE Special Report: Measuring Learning Success

Feedback is key

Page 22: CDE Special Report: Measuring Learning Success

Question types

Page 23: CDE Special Report: Measuring Learning Success

Question construction

Page 24: CDE Special Report: Measuring Learning Success

Know where to review

Page 25: CDE Special Report: Measuring Learning Success

Students keep track

Page 26: CDE Special Report: Measuring Learning Success

Our 2nd Guest Speaker

Jack HoranDirector of Technology Oratory Preparatory SchoolSummit, NJ

April 10, 2014

Page 27: CDE Special Report: Measuring Learning Success

Non-Traditional Assessments(or maybe traditional ones done

in new ways)

Jack Horan

AP Teacher/ Director of Technology

Oratory Preparatory School

Summit, NJ

Page 28: CDE Special Report: Measuring Learning Success

Some assessment types

Formative or Summative

• Online simulations/experiments

• Writing Assignments

• Multiple Choice (and similar) testing

Page 29: CDE Special Report: Measuring Learning Success

Online Simulation Benefits

• speed of setup

• speed of feedback

• ability to involve students (or teachers) from a distance

• take advantage of coolness factor

Page 30: CDE Special Report: Measuring Learning Success

AP Econ Simulation

Never underestimate the power of enjoyment!

Game-style assessments can grab student attention

Page 31: CDE Special Report: Measuring Learning Success

Writing Assignments

• Best with shared documents (e.g. Google Docs)

• Faster feedback/rewrite cycle

• Easier to share rubrics

• Long-lasting feedback

• Automatic portfolio creation

Page 32: CDE Special Report: Measuring Learning Success
Page 33: CDE Special Report: Measuring Learning Success

Multiple Choice Benefits

• T- faster, easier grading

• T- see problems and adjust accordingly

• S- quicker feedback

• S- Higher scores by students

– questions easier to read

– less distraction other questions

– easy to see graphs, etc that accompany questions

Page 34: CDE Special Report: Measuring Learning Success

Student Benefits

• Easier to read

• No other questions to distract

• images, etc. stay with question

• Can even add video clip

Page 35: CDE Special Report: Measuring Learning Success
Page 36: CDE Special Report: Measuring Learning Success

Important Issues

• compatibility with student devices

• ability to upload assessments from your test-generator programs

• ability to easily embed images, text, and even video/audio clips with questions

• ability to easily correlate questions with whatever standards

Page 37: CDE Special Report: Measuring Learning Success

Tech Director Concerns

• THE NETWORK MUST WORK!!!!!!!!!!!

• Devices must work

• One device per student is optimal, but not necessary

Page 38: CDE Special Report: Measuring Learning Success

Teacher Planning

•Groups of teachers can plan and develop common assessments, and collect group data more quickly and easily

•schoolwide (or district-wide) data can perform the same function

•more effective and quicker intervention, for individuals and groups

Page 39: CDE Special Report: Measuring Learning Success

Specific help for students and parents

• No more “he needs to work harder (or smarter, etc.)”

• Link data to standards

• Find specific areas of weakness

• “In math class, she has trouble the distributive property, but she really nails the commutative.”

Page 40: CDE Special Report: Measuring Learning Success

April 10, 2014

Page 41: CDE Special Report: Measuring Learning Success

Wrap Up

Access to this Special Report and Webinar Archive

http://www.centerdigitaled.com

April 10, 2014

Page 42: CDE Special Report: Measuring Learning Success

April 10, 2014