1

TIMSS 2007

Ina V.S. Mullis and Michael O. Martin

47th IEA General Assembly

Amiens, France

9-12 October, 2006

2

TIMSS 2007• Mathematics and Science

• Grades 4 and 8

• Trends 1995, 1999, 2003, 2007

• Baseline for New Countries

3

Mathematics Content Domains

Fourth-Grade Percentages

Number 50%

Geometric Shapes and Measures 35%

Data Display 15%

Eighth-Grade

Number 30%

Algebra 30%

Geometry 20%

Data and Chance 20%

4

Science Content Domains

Fourth-Grade Percentages

Life Science 45%

Physical Science 35%

Earth Science 20%

Eighth-Grade

Biology 35%

Chemistry 20%

Physics 25%

Earth Science 20%

5Countries ParticipatingAlgeria

Armenia

Australia

Austria

Bahrain

Bosnia

Botswana

Bulgaria

Canada, Alberta

Canada, B.C.

Canada, Ontario

Canada, Quebec

Chinese Taipei

Colombia

Cyprus

Czech Republic

Denmark

Djibouti

Egypt

El Salvador

England

Georgia

Ghana

Oman

Palestinian Auth.

Qatar

Romania

Russian Federation

Saudi Arabia

Scotland

Serbia

Singapore

Slovak Republic

Slovenia

Spain, Basque Country

Sweden

Syrian Arab Republic

Thailand

Tunisia

Turkey

Ukraine

United States

United States, Massachusetts

United States, Minnesota

Yemen, Rep. of

Honduras

Hong Kong, SAR

Hungary

Indonesia

Iran

Israel

Italy

Japan

Jordan

Kazakhstan

Korea, Rep. of

Kuwait

Latvia

Lebanon

Lithuania

Malaysia

Malta

Moldova

Mongolia

Morocco

Netherlands

New Zealand

Norway

6

Major Accomplishments Since Last General Assembly

• Conducted Field Test

– 100,000 Students

• Finalized Main Survey Instruments

• Began Data Collection in Southern Hemisphere

7

TIMSS 2007 SMIRC

Mathematics Experts

Kiril Bankov, Bulgaria

Hanako Senuma, Japan

Khattab Mohammad Abu Lebdeh, Jordan

Robert Garden, New Zealand

Liv Sissel Gronmo, Norway

Mary Lindquist, United States

8

TIMSS 2007 SMIRC

Science Experts

Ahmed Mohammed Rafea, Bahrain

Chen-yung Lin, Chinese Taipei

Jophus Anamuah-Mensah, Ghana

Gabriela Noveanu, Romania

Galina Kovaleva, Russian Federation

Jackie Heaton, Scotland

Audrey Champagne, United States

9

TIMSS 2007 QIRC

Sue Thomson, Australia

Serge Baillergeon, Quebec

Solaiman El-Khodary El-Sheikh, Egypt

Martina Meelissen, The Netherlands

Boey Kok Leong, Singapore

Barbara Japelj, Slovenia

Patrick Gonzales, United States

10

TIMSS 2007 Assessment Specialists

• Mathematics Coordinator

– Graham Ruddock, NFER

• Science Coordinator

– Christine O’Sullivan, K-12 Consulting

• Special “Task Force” Consultants in Mathematics and Science

– Intensive Week-long Working Sessions

11

TIMSS 2007 Assessment Specialists

• Staff at TIMSS & PIRLS ISC

– Content/Measurement Experience

– Production/Graphics Experience

• NRCs – National Research Coordinators

– Wealth of Knowledge and Experience

12

Overview of Year’s Activities

Finalized Field-test Instruments

• 3rd NRC Meeting for Final Review of Instruments and Procedures

– Ljubljana, Slovenia, November 2005

• Materials for TIMSS 2007 Field Test Posted on Web

– December 2005

13

Translation and Verification

• Translation and Verification Began

– January 2006

• Layout and Verification Began

– January 2006

• Translation Verification and Layout Verification Completed

– April 2006

14

Scoring Training for Field Test

• Pilot Test in Six English-Speaking Countries

– January 2006

• Task Forces Met to Develop Training Materials

– February 2006

• Training Materials Posted on Website

– February 2006

• 4th NRC Meeting to Conduct Scoring Training

– March 2006

15

Conducted Field TestMarch-April 2006

• 8th Grade

– 46 Countries

– 60,000 Students

– 1,200 Schools

• 4th Grade

– 33 Countries

– 40,000 Students

– 1,000 Schools

16

Analyzed and Reviewed Field-test Results• Mathematics and Science Data Processed and

Analyzed for Grades 4 and 8

– July 2006

• School, Teacher, and Student Questionnaire Data Processed and Analyzed for Grades 4 and 8

– July 2006

• 3rd SMIRC Meeting to Review Results and Propose a Set of Items for Data Collection

– St. Petersburg, July 2006

17

Analyzed and Reviewed Field-test Results (cont.)

• 2nd QIRC Meeting to Review Results and Recommend Questionnaires for Data Collection

– Hamburg, July 2006

• Posted Recommended Items, Questionnaires, and Field-test Statistics for NRC Review

– July 2006

18

Analyzed and Reviewed Field-test Results (cont.)• 5th NRC Meeting to Review and Approve Items

and Questionnaires for TIMSS 2007 Data Collection

– Riga, Latvia, August 2006

• Final Instruments Posted on Website

– August 25, 2006

19

Data Collection – Southern Hemisphere

• Translation and Verification

– September-October 2006

• Layout and Verification

– September-October 2006

• Arabic Translation

– August-November 2006

20

Data Collection – Southern Hemisphere (cont.)

• Scoring Training Materials Prepared

– September-October 2006

• Training Materials Posted on Web for Southern Hemisphere Countries

– October 2006

• Scoring Training Meeting

– Melbourne, October 2006

21

Data Collection – Southern Hemisphere (cont.)

TIMSS 2007 Begins Data Collection Now!!

22

Data Collection – Northern Hemisphere

• Translation Verification

– January-March 2007

• 6th NRC Meeting for Scoring Training

– Amman, Jordan, March 2007

Data Collection March – June 2007

23

TIMSS 2007

Ina V.S. Mullis and Michael O. Martin

47th IEA General Assembly

Amiens, France

9-12 October, 2006