Customized Report - 3P Learning · Teacher testimonials 01 02 04 07 03 05 08 13 11 15 06 10 14 12 16 Contents. OCSB Customized Report - Mathletics Pilot Study 1 Mathletics is a multi-award

OCSB Customized Report - Mathletics Pilot Study1

Customized Report

prepared for Ottawa Catholic School Board

www.mathletics.ca

Follows provincial curricula

Powerfulreporting

Studentcentred

Introduction. A pilot study with Ottawa Catholic School Board

Before we start, we listen.Gathering teacher insight

Gathering student insight

How Mathletics can help Addressing OCSB objectives

Mathletics Reporting

Mathletics Assessments and EQAO practice

Reviewing the findings.Improvement in results – by grade

Most improved math expectations – by grade

Tracking an increase in conceptual mastery

Diagnosed strengths

Diagnosed weaknesses

How did we do?Reviewing teacher objectives – differentiation and engagement

Reviewing teacher objectives – results

Student feedback

Teacher testimonials

01

02

04

07

03

05

08

13

11

15

06

10

14

12

16

Contents

OCSB Customized Report - Mathletics Pilot Study 1

Mathletics is a multi-award winning learning resource that encourages students and rewards results – hugely popular with students, teachers, administrators and parents alike. The education team at Mathletics is committed to providing a resource that is powerful, targeted and most importantly relevant to all students.

Mathletics includes well over 1200 individual adaptive practice activities and eBooks available for all grades. Our team of education publishers have created a course that specifically follows the Ontario curriculum.

Strands, sub-strands and learning expectations of the curriculum are supported with activities, each with pre and post assessment. What’s more, Mathletics contains an extensive library of eBooks – for use on screen or as a printable resource – that are also mapped to the requirements of the Ontario Curriculum.

To highlight the impact of Mathletics, a pilot study has been conducted in schools across the Ottawa Catholic School Board. This document reports on the results of that study.

While this pilot study was conducted using the Mathletics resource in English, a full range of assessments and eBooks are also available in French.

The impact of Mathletics.A pilot study with Ottawa Catholic School Board

4.3 million The number of students

using Mathletics.

17 000The number of

schools subscribed to Mathletics.

18.7 billionThe total number of activities completed within Mathletics.

+35.9%The average annual

improvement in student results following Mathletics use.

Date of Pilot Study

April - May 2014

No. of Students

181

Grades Involved

Grades 2, 3, 6 and 10


As is standard with any new Mathletics subscription, participating teachers were interviewed by the team at Mathletics prior to the start of the study to gain a stronger insight into the educational and technological landscape across the district. Particular educational objectives and aims were discussed.

Below is a summary of the key findings from the schools participating in the pilot study: St. Gabriel, Our Lady of Mount Carmel, Notre Dame High School, Georges Vanier, St. Michael Fitzroy, Mother Theresa High School.

Top math challenges faced in your classroom or district

Differentiation

EQAO practice

Engaging content

Accessing manipulative

Home support

01

02

03

04

05

Top numeracy goals in your classroom or district

Word problems

Creating learning goals

Number sense skills

Increasing confidence

100% at Grade level

01

02

03

04

05

Most valuable features of a math learning resource

Differentiation

Curriculum alignment

Extra resources

Diagnostic tools

Canada-based support

01

02

03

04

05

What strand or expectation will you be focussing on during the pilot?

How would you quantify success in your students?

Percentage of teacher responses

Fractions

Addition, subtraction, multiplication

Trigonometry

Quadratic Expressions and Equations

Measurement and Geometry

01

02

03

04

050 20 40 60 80 100

Results

Increase in confidence

Increase in engagement

Before we start, we listen.Gathering teacher insight...


Equally important to our successful development of Mathletics is our community of students. Our teams regularly speak with them to gather valuable insight.

Pre-pilot interviews were conducted with 86 OCSB students. The findings mirror the objectives of OCSB teachers, specifically their concerns regarding student perception of (and engagement with) math.

Math is...

Hard

DifficultBoring

Amazing

Fun

ChallengingComplex

Interesting

Frustrating

Most favourite things about math

Word problems

Difficult to understand

Frustrating

Decimals

Division

01

02

03

04

05

Least favourite things about math

Time spent on math per week outside of school

0% 10% 20%

0-1 hr

1-2 hrs

3-4 hrs

4+ hrs

30% 40% 50% 60%

51%

33%

13%

9%

Before we start, we listen.Gathering student insight...

Learning new things

It can be fun

There is a clear answer

It can be challenging

Mentally stimulating

01

02

03

04

05


Mathletics can help!Addressing the primary objectives of the OCSB…

Engage.With dedicated student interfaces for Elementary and High School learners, Mathletics provides a safe, secure and engaging online world of learning for K-12 students. Rewards and certificates keep students motivated, with mathematical gaming to expand upon the core strands learned along the way. No other learning resource can beat the Mathletics Effect.

Diagnose.Each curriculum area includes pre and post assessment. Plus the powerful Assessments tool within the Mathletics teacher console provides full diagnostic analysis of students’ positioning and progress through the curriculum. It’s one-click diagnosis. A range of Assessments designed specifically for EQAO are available.

Resources. A powerful Reporting Centre with dynamic access to real-time data. Over 120 eBooks to print or use online. Interactives (virtual manipulatives) for Grades 7-12. Problem Solving – a range of activities developed with Dr. Marian Small. A range of Assessments designed specifically for EQAO are available.

We’re not done yet... Follows the Ontario curriculum. Powerful tools for learning foundation skills. Simple drag-and-drop differentiation for teachers. Mobile ready – iPad, Android tablet and Chromebook. French language assessment and eBooks available. Use at home and school.


Mathletics Real-time Reporting.A powerful tool for all OCSB schools

Sam

ple

Live real time data. A dynamic interface for teachers and school administrators that puts live data right where you need it – at your fingertips. Your data your way. Reports has been designed for schools to make most use of their data. View live data for a single student, a whole class, multiple classes – right up to the entire school.Diagnose. Automated diagnosis of relative strengths and weaknesses within the school. Powerful reporting to individually focus learning where it is needed most.Report


Mathletics Assessments gather valuable information to identify and target student learning gaps, helping to direct teaching strategies.

EQAO-like assessments available for Grades 3 and 6, plus many more. Set timed assessments to assess, diagnose and prepare students. Randomized answers ensure reliable results. Automatic marking and individual reporting for each student. View all correctly and incorrectly answered questions. Determine gaps and target learning to each individual student. Benchmark and track improvement. Backed up with Mathletics activities, interactives and printable resources.

Assess

Mathletics AssessmentsPowerful diagnostics and EQAO practice

French language

assessments also available.


Reviewing the findingsImprovement in results – by grade

The Mathletics course contains 1200 individual targeted practice activities for students. Each activity automatically adapts to the ability of the student, gradually increasing the level of difficulty as the student correctly progresses through the questions.

Questions are automatically generated, allowing students to repeat activities with new content each time. Results are tracked by Mathletics for each student in each activity – comparing their initial attempt with their latest to track longitudinal improvement.

0

10

20

30

40

50

60

70

80

90

100

Grade 2 Grade 3 Grade 6 Grade 10

Per

cent

ag

e R

esul

t

Initial Avg Result Latest Avg Result

80% of participating students

achieved a result of >90% after repeating

an activity at least once.

Improvement during pilot period

Grade 2

+14.4%Grade 3

+15.8%Grade 6

+15.1%Grade 10

+8.6%

Initial Average Result Latest Average Result


Reviewing the findings…Most improved math expectations – by grade(% improvement over study period shown)

Grade 2

0% 10% 20% 30% 40% 50%

Columns that Subtract

Bar model problems 1

Addition Facts to 18

Measuring Length

Quarter to and Quarter past

Grade 3

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

Nearest 10?

Shading Equivalent Fractions

Counting by Tens

Model Fractions

What Fraction is Shaded?

(ON2.M1.8)

(ON2.M1.2)

(ON2.PA2.3)

(ON2.DMP2.1)

(ON2.NS3.1)

(ON3.NS1.7)

(ON3.NS1.7)

(ON3.NS1.7)

(ON3.NS2.2)

(ON3.NS1.5)


Reviewing the findings…Most improved math expectations – by grade(% improvement over study period shown)

Grade 10

Grade 6

0% 10% 20% 30% 40% 50% 60% 70%

Ordering Fractions

Decimal Order

Simple Subtraction

Multiply Multiples of 10

Column Addition 1

0.0% 10.0% 20.0% 30.0% 40.0% 50.0%

Vertex of a Parabola

Factorising Quadratics 1

Expanding Binomial Products

Special Binomial Products

Factorising Quadratics 2

(ON6.NS2.1)

(ON6.NS2.1)

(ON6.NS2.1)

(ON6.NS1.1)

(ON6.NS1.4)

(ON10.QR1.2)

(ON10.QR3.1)

(ON10.QR3.1)

(ON10.QR1.1)

(ON10.QR1.1+4)


Reviewing the findingsTracking an increase in conceptual mastery

One of the focusses of Mathletics curriculum content is the improvement of student results towards a position of mastery*. Students are awarded gold bars within their individual Mathletics interface as they achieve scores of >85% within curriculum activities.

Mathletics reporting for teachers and administrators allows for tracking of this student progress to mastery – visually displaying groups of students as their results improve over time.

During this pilot study, benchmarking snapshots of student ability were taken – based on their results as they progress through curriculum activities. Illustrated below are the improvement results over the timeframe of the pilot.

Note: Student results across the same set of curriculum activities were compared at the start, middle and end of the pilot. As of this date, over 87% of the activities had been mastered by students – an increase of 41%.

87 600 individual curriculum

questions completed by students during OCSB

pilot.

KEY

Before pilot

10.3% 43.6% 46.2%

Currently

10.3% 87.2%

Results of <50%

Results of <51%-84%

Results of >85%

*A result of >85% in a Mathletics activity is a benchmark indicating

a student has achieved “mastery” of a particular

concept.


Mathletics reporting includes automated diagnosis of relative strengths and weaknesses within a school. Powerful reporting to individually target learning activities where they are needed most.

Live diagnosis of curriculum topic strengths and weaknesses.

Diagnose an individual student – or a whole class.

School Administrators can instantly report on target areas by entire grade or year level – or even across the entire school.

Reviewing the findings…Strengths

Diagnose

Diagnosed curriculum strengths following pilot study

Mathletics Activity Grade Ottawa Curriculum Sub-strand and Expectation

Columns that Add 2 Addition, subtraction, multiplication & division (ON2.NS3.1)

Column Addition 1 2 Addition, subtraction, multiplication & division (ON2.NS3.1)

Addition Facts to 18 2 Addition and subtraction to 18. (ON2.PA2.3)

Nearest 10? 3 Read/compare/order whole numbers to 1000 (ON3.NS1.5)

Triangle Tasters 3 Compare 2D & 3D figures and sort by their properties (ON3.G1.4)

How many Faces? 3 Compare 2D & 3D figures and sort by their properties (ON3.G1.4)

Area: Parallelograms 6 Area and volume (ON6.M2.6)

Subtracting Colossal Columns 6 Addition, Subtraction, Multiplication and Division (ON6.NS2.1)

Magic Mental Addition 6 Addition, Subtraction, Multiplication and Division (ON6.NS2.1)

Factorising Quadratics 1 10 Basic properties of quadratic relations (ON10.QR1.1)

Special Binomial Products 10 Quadratic Equations (ON10.QR3.1)

Factorising Quadratics 2 10 Quadratic Equations (ON10.QR3.2)


Mathletics reporting includes automated diagnosis of relative strengths and weaknesses within a school. Powerful reporting to individually target learning activities where they are needed most.

Live diagnosis of curriculum topic strengths and weaknesses.

Diagnose an individual student – or a whole class.

School Administrators can instantly report on target areas by entire grade or year level – or even across the entire pilot.

Reviewing the findings…Weaknesses

Diagnose

Diagnosed curriculum weaknesses following pilot study

Mathletics Activity Grade Ottawa Curriculum Sub-strand and Expectation

Measuring Length 2 Length/perimeter/area/mass/capacity/time/temp (ON2.M1.2) Columns that Subtract 2 Addition, subtraction, multiplication & division (ON2.NS3.1)

Estimate Differences 1 3 Addition/subtraction of single/multi-digit whole number (ON3.NS3.3)

Estimate Sums 3 Addition/subtraction of single/multi-digit whole number (ON3.NS3.3)

Estimate Differences 2 3 Addition/subtraction of single/multi-digit whole number (ON3.NS3.3)

Ordering Fractions 6 Whole Numbers, Decimals and Fractions (ON6.NS1.4) Comparing Fractions 2 6 Whole Numbers, Decimals and Fractions (ON6.NS1.5) Decimal Order 2 6 Whole Numbers, Decimals and Fractions (ON6.NS1.1)

Expanding Binomial Products 10 Quadratic Equations (ON10.QR3.1)Vertex of a Parabola 10 Basic properties of quadratic relations (ON10.QR1.4)

y = x² and its transformations (ON10.QR2.1)


DifferentiationMathletics live reporting and results data is a powerful tool for differentiating students. Classes can be split into learning groups via a simple drag-and-drop interface – allowing for different course content to be assigned to each.

Meeting OCSB teacher objectivesStudent differentiation and engagement

148reward certificates awarded to students

1432total individual logins over pilot period

557hrs 51minstotal login time by students

Avg 2.5learning groups created

per class by OCSB teachers

876curriculum activities

assigned to students by OCSB teachers

546 176total curriculum & gaming questions

PlatinumACHIEVEMENT AWARD

to

Tim PowerCEO, 3P Learning

All Gold BarsACHIEVEMENT AWARD

to

Tim PowerCEO, 3P Learning

Engage


In reviewing the original objectives of teachers and comparing the results seen during the Mathletics pilot, the following was observed:

So how are we doing?A review of OCSB objectives vs. results…

Top math challenges faced in your classroom or district

Differentiation

EQAO practice

Engaging content

Accessing manipulative

Home support

01

02

03

04

05

Most valuable features of a math learning resource

What strand of concept will you be focussing on during the pilot?

Differentiation

Curriculum alignment

Extra teaching resources

Diagnostic tools

Canada-based support

Fractions

Addition, subtraction, multiplication

Trigonometry

Quadratic Expressions and Equations

Measurement and Geometry

Average result now 92% (up 34%)

Average result now 96.4% (up 26%)



Average result now 92.7% (up 18%)

01

01

02

02

03

03

04

04

05

05


The team at Mathletics surveyed students. Below is an unedited selection of their responses.

Feedback from students across Ontario

I love Mathletics. My times tables have gotten better because of Mathletics.

My favourite thing is Live Mathletics!

Diedrich.

Mathletics helps me learn how to multiply and divide. I like Mathletics because you

get to learn about math. My favourite thing is now

multiplying.

Orin.

Mathletics helps me learn because I don’t know

everything about math and it teachers me a lot. My

favourite things has been learning new things.

Morgan.

Sometimes I don’t understand the teacher.

Mathletics is helping me do more math. My favourite thing is Live Mathletics.

Ryan.

I like Mathletics. You can learn new lessons and

adding and subtracting. My favourite this is now

three digit addition – and more!

Chevelle.

Math is now super fun. My favourite part is Live

Mathletics.

Autumn.


The team at Mathletics surveyed teachers across Ontario. Below is an unedited selection of their responses.

Feedback from Ontario teachers

Mathletics reinforces the importance of doing mathematics at home, largely the domain of literacy. Mathletics online system enables students to reinforce hundreds of Ontario curriculum math topics. There is also a real-time competitive section where students can compete against students from all over the world. Classes and students are ranked in the world and Canada.

Most importantly, Mathletics has allowed mathematics to become a focus for the whole school beyond the classroom. The energy and competition are extremely engaging and add to the positive culture of mathematics, but also connects our parents to the school’s initiative.

Doug Duff, Principal, Parkview Public School

Mathletics has engaged and encouraged all of my middle school students to become confident mathematicians. For the students that have always had success in math, the program is set to reach and extend their learning to maximize their potential.

As for my students that have never been able ‘to do’ math or never ‘got it’ they have be able to feel success and want to learn and be challenged to more difficult material.

The feedback from the parent community has been positive and the cost to them seems reasonable for the material being given. Parents cannot believe their children wanting to do their math homework.

Mary Rizos, Principal Sir William Gage Middle School

We introduced Mathletics last

year. This April’s testing showed a remarkable jump in Math scores for all of our students.

Most now score above the 80th

percentile and our school is now well ahead of the other schools in Ontario

in Math scores. I will be strongly

recommending that all of our schools use Mathletics.


The team at Mathletics surveyed teachers across Ontario. Below is an unedited selection of their responses.

We just received the results from our spring CAT4 testing. All of our students from grade 2 through 8 have been tested over the past several years. We noticed that our students continually scored around the national average in math, whereas in all other subjects they tended to score above the 80th percentile.

We introduced Mathletics last year. This April’s testing showed a remarkable jump in Math scores for all of our students. Most now score above the 80th percentile and our school is now well ahead of the other schools in Ontario in Math scores. I will be strongly recommending that all of our schools use Mathletics. Our students thoroughly enjoy the program and are eager to get to the computer lab for their time with it. Many parents report that their children do it at home as well. We have tried a variety of programs, over the past 10 years… but none have worked as well or as quickly as Mathletics.

Daniel Carley, Principal College Park Elementary School

This has been an exciting year in my career as a mathematics teacher. Not only we introduce a one-to-one tablet program, but we also began using Mathletics with our students on a regular basis. This program has proven to be an extremely versatile and engaging program, which is accessible through the Internet.

The program provides access to the extensive variety of applications designed to enhance students’ enjoyment of the subject, build on their skills and monitor their own progress. Teachers are able to guide and monitor their students with an extensive array of tools and, parents are also able to receive weekly updates.

Personally, I have found Mathletics to be a very valuable resource and have used it in a variety of ways. It is a program that has the potential for significant growth, and I look forward to using it as the one-to-one tablet initiative expands at Branksome Hall. Given my initial use of the program, and having had the opportunity to meet with the developers of the program, I am left excited about all of the possibilities that Mathletics will provide me as math teacher and consequently my students.

Trevor Ritchie, Math Teacher

Feedback from Ontario teachers

powered by

Call: +1 877 467 6851Email: [email protected]

3P Learning, Suite 1220, 1122 4th Street SW, Calgary, AB T2R 1M1.

www.3plearning.com/mathletics

Documents

Customized Report - 3P Learning · Teacher testimonials 01 02 04 07 03 05 08 13 11 15 06 10 14 12 16 Contents. OCSB Customized Report - Mathletics Pilot Study 1 Mathletics is a multi-award