42
Q1 Special Report Webinar April 10, 2014

CDE Special Report: Measuring Learning Success

Embed Size (px)

DESCRIPTION

The use of digital and online tools to measure performance is causing educators to rethink not only how we collect assessment data but also how we teach and learn in information age schools. The upcoming Common Core online assessments are driving school districts to build out infrastructure, purchase devices, shift to digital content and capture student performance data that would be extremely difficult using paper and pencil methods. Regardless of whether your state is participating in the Common Core, online assessments will play a critical role in the future of education. Please join the Center for Digital Education as we discuss the future of assessment in a digital world and how to best prepare for that future. On this interactive webinar, we will cover: • The changing role of assessment • Trends and opportunities with online assessment • Expert advice on implementing assessment technology and tools • Review of emerging assessment technologies • Educator insights on implementing successful assessment programs

Citation preview

Page 1: CDE Special Report: Measuring Learning Success

Q1 Special

Report Webinar

April 10, 2014

Page 2: CDE Special Report: Measuring Learning Success

www.centerdigitaled.com

DECEMBER 17, 2013April 10, 2014

Page 3: CDE Special Report: Measuring Learning Success

DECEMBER 17, 2013

• Special Report Overview

• Guest Speakers

• Q&A

Today’s Agenda

Tom Ryan, Ph.D.Sr. FellowCenter for Digital EducationFormer CIO, Albuquerque Public Schools

April 10, 2014

Page 4: CDE Special Report: Measuring Learning Success

April 10, 2014

Page 5: CDE Special Report: Measuring Learning Success

Q & A Participation

•To ask a question, enter it into the“Ask a Question” box and click “Submit”

•We will answer as many questions as possible in the available time

•This webcast will be posted to http://www.centerdigitaled.com

April 10, 2014

Page 6: CDE Special Report: Measuring Learning Success

April 10, 2014

Assessment is much more than accountability

The focus of assessment is shifting to authentic, ongoing measurements, relevant feedback to inform personalized instructional practices

Page 7: CDE Special Report: Measuring Learning Success

April 10, 2014

“OLD SCHOOL” ASSESSMENTS

Paper-based

Limited

Not Applicable to real world

Infrequent

Unwieldy and error-prone

Difficult to customize

Limits how to assess higher order thinking

Page 8: CDE Special Report: Measuring Learning Success

April 10, 2014

Knowledge Test Performance Test

http://www.stanforddrivingschool.com

Both are Essential

Page 9: CDE Special Report: Measuring Learning Success

April 10, 2014

Reduced Grading Burden

Increased instructional Time

Quick Return on Results

Improved Test Security

Accessibility &Accommodation

Page 10: CDE Special Report: Measuring Learning Success

April 10, 2014

Instructional ObjectivesExecutive SponsorshipBuy-inStart SmallAdd Technology IncrementallyProfessional development

PLCsResearch compatibilityTotal Cost of OwnershipVendor relationshipsThoughtful ApproachMeasure Success

Page 11: CDE Special Report: Measuring Learning Success

April 10, 2014

Platforms to aggregate data

Dashboards

Learning AnalyticsPredictiveDiagnostic

Page 12: CDE Special Report: Measuring Learning Success

April 10, 2014

Page 13: CDE Special Report: Measuring Learning Success

April 10, 2014

Page 14: CDE Special Report: Measuring Learning Success

Our 1st Guest Speaker

Bill JamesTeacherMilford High SchoolHighland, Michigan

April 10, 2014

Page 15: CDE Special Report: Measuring Learning Success

Using data properlyBill James

Milford High School

Highland, MI

Page 16: CDE Special Report: Measuring Learning Success

Examining Examinations

O Central tendency

O Not sufficient though

O Need to examine a detailed report

Page 17: CDE Special Report: Measuring Learning Success

Item analysis

Page 18: CDE Special Report: Measuring Learning Success

Numbers to focus on…O KR20

O Measures overall test reliability

O Range from 0.0 – 1.0

O Closer to 1.0 = more reliable

O Point biserial

O Measures item reliability

O Range from -1.0 – 1.0

O Closer to 1.0 = more reliableO 0.3 = very good items

O 0.09 and less = poor items

O Negative should prompt review of questionO Student who did well on test overall did not do well on

that question

Page 19: CDE Special Report: Measuring Learning Success

Another look

Page 20: CDE Special Report: Measuring Learning Success

Formative assessments

O In class and spur of moment

O Assessment of lesson

O Change on the fly too

Page 21: CDE Special Report: Measuring Learning Success

Feedback is key

Page 22: CDE Special Report: Measuring Learning Success

Question types

Page 23: CDE Special Report: Measuring Learning Success

Question construction

Page 24: CDE Special Report: Measuring Learning Success

Know where to review

Page 25: CDE Special Report: Measuring Learning Success

Students keep track

Page 26: CDE Special Report: Measuring Learning Success

Our 2nd Guest Speaker

Jack HoranDirector of Technology Oratory Preparatory SchoolSummit, NJ

April 10, 2014

Page 27: CDE Special Report: Measuring Learning Success

Non-Traditional Assessments(or maybe traditional ones done

in new ways)

Jack Horan

AP Teacher/ Director of Technology

Oratory Preparatory School

Summit, NJ

Page 28: CDE Special Report: Measuring Learning Success

Some assessment types

Formative or Summative

• Online simulations/experiments

• Writing Assignments

• Multiple Choice (and similar) testing

Page 29: CDE Special Report: Measuring Learning Success

Online Simulation Benefits

• speed of setup

• speed of feedback

• ability to involve students (or teachers) from a distance

• take advantage of coolness factor

Page 30: CDE Special Report: Measuring Learning Success

AP Econ Simulation

Never underestimate the power of enjoyment!

Game-style assessments can grab student attention

Page 31: CDE Special Report: Measuring Learning Success

Writing Assignments

• Best with shared documents (e.g. Google Docs)

• Faster feedback/rewrite cycle

• Easier to share rubrics

• Long-lasting feedback

• Automatic portfolio creation

Page 32: CDE Special Report: Measuring Learning Success
Page 33: CDE Special Report: Measuring Learning Success

Multiple Choice Benefits

• T- faster, easier grading

• T- see problems and adjust accordingly

• S- quicker feedback

• S- Higher scores by students

– questions easier to read

– less distraction other questions

– easy to see graphs, etc that accompany questions

Page 34: CDE Special Report: Measuring Learning Success

Student Benefits

• Easier to read

• No other questions to distract

• images, etc. stay with question

• Can even add video clip

Page 35: CDE Special Report: Measuring Learning Success
Page 36: CDE Special Report: Measuring Learning Success

Important Issues

• compatibility with student devices

• ability to upload assessments from your test-generator programs

• ability to easily embed images, text, and even video/audio clips with questions

• ability to easily correlate questions with whatever standards

Page 37: CDE Special Report: Measuring Learning Success

Tech Director Concerns

• THE NETWORK MUST WORK!!!!!!!!!!!

• Devices must work

• One device per student is optimal, but not necessary

Page 38: CDE Special Report: Measuring Learning Success

Teacher Planning

•Groups of teachers can plan and develop common assessments, and collect group data more quickly and easily

•schoolwide (or district-wide) data can perform the same function

•more effective and quicker intervention, for individuals and groups

Page 39: CDE Special Report: Measuring Learning Success

Specific help for students and parents

• No more “he needs to work harder (or smarter, etc.)”

• Link data to standards

• Find specific areas of weakness

• “In math class, she has trouble the distributive property, but she really nails the commutative.”

Page 40: CDE Special Report: Measuring Learning Success

April 10, 2014

Page 41: CDE Special Report: Measuring Learning Success

Wrap Up

Access to this Special Report and Webinar Archive

http://www.centerdigitaled.com

April 10, 2014

Page 42: CDE Special Report: Measuring Learning Success

April 10, 2014