31
State Matura in Croatia – Milestones and Challenges Maja Jukić, director of National Centre for External External Evaluation of Education, Croatia Belgrade, December 15, 2014

State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

  • Upload
    ngoque

  • View
    217

  • Download
    0

Embed Size (px)

Citation preview

Page 1: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

State Matura in Croatia – Milestones and Challenges

Maja Jukić, director of National Centre for External External Evaluation of Education, Croatia

Belgrade, December 15, 2014

Page 2: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

National Center for External Evaluation of Education

= public institution responsible for external evaluation of pre-tertiar education system in Republic of Croatia, including student assessment

Objectives of external evaluation: to establish a system for improving the quality of education and to establish a system of standardized evaluation of knowledge and skills – competencies

Page 3: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

National Center for External Evaluation of Education

Some of the NCEEE responsabilities:

• Research and preparation of national standards and exam materials

• Conducts international student achievement tests and surveys

• Coordinates the work of all participants responsible for conducting national exams (task forces, reviewers, exam coordinators, evaluators)

• Organizes and conducts training of afore-mentioned groups

• Organizes and conducts national exams and State Matura (print, distribution)

• Processes and analyzes results, makes proposals for modifications

• Provides training for all participants to use results and to introduce modifications in the system

Page 4: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA

• is basically SUMMATIVE test

• has to provide standardized

evaluation of knowledge and skills

of senior-year students at the end

of their secondary education

• also has FORMATIVE purpose:

basis for improving educational

system and for initiating self-

evaluation process in schools

Page 5: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA – development path

• First scientific elaboration and plan for introducing of State Matura in

Croatian education system was written by educational experts in 2003

• In 2005 Ministry of Science, Education and Sport of Republic of Croatia

founded an operative unit which goal was preparation of the whole

education system for the introducing of State Matura

• First content method groups for the test construction started with work in

2005

• By 2007 all the content method groups for all the subject fields were

formed

• Each content method group have had 4 – 6 members (one is a university

representative; other ones are experienced teachers)

• Their first task was putting together exam catalogues

– Educational outcomes

Page 6: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA – development path

•In 2009 “trial” State Matura was administered

•In 2010 State Matura become regular part of the Croatian education system

•During the last five years some slight changes occurred in the examination

technology (most of them in the last administration)

Page 7: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

• Compulsory for Grammar school students (from 2009/2010) - a

certificate of completion of secondary education

• Elective for vocational schools students – they access to State

Matura exams only to ensure enrollment at the universities

• Two terms: summer and autumn

• Conditions: standardized test administration under the supervision

of independent parties (university profesors or educational

agencies staff)

• Location: schools, examination centers in 5 cities in Croatia

STATE MATURA

Page 8: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

• State Matura consists of mandatory and elective part

• State Matura is the same for everyone, meaning that all

students have to take mandatory exams from Math, Croatian

language and Foreign language at elementary or higher level

• 37 exams

STATE MATURA

Page 9: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA

• Elective part of State Matura consists of taking subjects that students

selected by themselves

• Students can choose any number of 30 offered elective exams

• The choice of exams is primarily determined by the admission criteria

required by the tertiary education institutions (e.g. students who want to

enroll in School of Medicine should take Physics, Chemistry and Biology)

Page 10: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA - Exams

• In the elective part of State Matura, students can take exams from the following subjects:

• English, French, German, Spanish, Italian, Classic languages (Ancient Greek and Latin), Biology, Ethics, Philosophy, Physics, Geography, Musical Art, Information Technology, Chemistry, Visual Arts, Politics and Economy, History, Psychology, Sociology, and Religion

• Foreign languages exams could be taken in the optional part of State Matura at advanced level only

• Latin exam can be taken at advanced or elementary level

• Exams from Greek and other subjects in the optional part of State Matura have no levels

Page 11: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams
Page 12: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA - specific adjusments

• students of classic comprehensive schools, under mandatory part of exam of State Matura, can take an exam from Latin or Ancient Greek instead of foreign language exam

• Students educated using the language and script of ethnic minorities, under mandatory part of State Matura have to take an exam from the ethnic minority language (plus Croatian language exam)

Page 13: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA - accomodations and modifications

• Exam accommodations and modifications are available for special needs students

• i.e. In the summer term 2013/2014, 469 applicants had right to take adapted exams

– 104 of that number had expert support assistants

– 10 different exams for 8 candidates were made in Braille

– in the autumn term 2013/2014: 110 applicants, of whom 44 had expert support assistants

Page 14: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA - Scoring

Each exam is consisted both of closed and open-ended items

•Some exams (Croatian and foreign languages, Philosophy, Ethics,

Visual Art) contain essay question, as well

•Croatian language essay is scored independently by the two raters

(trained teachers)

– If they differ significantly, the essay goes to the third rating

which is made by the content method specialist and his/her rate

is final

•The price for rating of an exam vary on number and types of open-

ended items

– There are defined unit prices for each type of open-ended item

Page 15: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA - Milestones

•Teachers and students have started to teach and learn in terms of educational outcomes

•We have tests that are standardized (more or less)

•Connection between secondary and tertiary education

•Tool for improvement of education system

Page 16: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA - Challenges

• Reconsideration of State Matura goals

– Certification vs. Entrance exam

• According to Standards (APA, AERA, NCME),

test MUST NOT have multiple purposes

• Higher level of exam standardization

– Pretested items

– Item bank

– Pre-set standards of student achievement

Page 17: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

STATE MATURA - Challenges

• Moving toward using exams in a more formative manner

• Introducing of innovative item formats that will allow us to measure key competencies and higer-level cognitive functions

• E-assessment

• Establishing protocols and procedures for quality assurance

according to the international standards (International Test

Commission)

• Continuous improvements based on validity research

• Certification of achieved vocational qualifications and

mobility ensuring towards higher education in a related field

of work

Page 18: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Lesson that we have learned...

•Once the procedures and techniques for exam preparation and administration are set, huge efforts are necessary to modify them

•Good communication with all stakeholders within the system is crucial in order to get support for making improvements

Page 19: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Thank you!

[email protected]

Page 20: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Comparison between some previous and recent data

Mandatory exams

School year 2009./2010. 2010./2011. 2011./2012. 2012./2013. 2013./2014.

Number of

candidates

In total 33.577 32.181 33.019 33.786 33.262

Gimnasium %37 %36 %37 %37 %40

VET schools %50 %51 %50 %51 %47

Others %13 %13 %13 %12 %13

Page 21: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Exam Number of

attenders

Number of

successful

att.

% of

successful

att.

Croatian Language A 24 689 22 341 90,49 %

Croatian Language B 11 188 9 076 81,12 %

Math A 11 072 10 178 91,93 %

Math B 25 562 21 949 85,87 %

Foreign language A 18 375 16 758 91,20 %

Foreign language B 14 941 12 645 84,63 %

French A 98 78 79,59 %

French B 6 3 50,00 %

German A 1 152 999 86,72 %

German B 1 780 1 512 84,94 %

Spanish A 124 111 89,52 %

Spanish B 3 3 100,00 %

Page 22: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Exam Number of

attenders

Number of

successful

att.

% of

successful

att.

Italian A 387 344 88,89 %

Italian B 40 34 85,00 %

Greek 43 39 90,70 %

Latin A 56 55 98,21 %

Latin B 51 46 90,20 %

Hungarian (maternal) 8 8 100,00 %

Serbian (maternal) 171 167 97,66 %

Italian (maternal) A 69 67 97,10 %

Italian (maternal) B 56 55 98,21 %

Biology 7 672 6 836 89,10 %

Ethic 74 48 64,86 %

Philosophy 447 369 82,55 %

Physics 9 025 8 092 89,66 %

Geography 651 535 82,18 %

Page 23: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Exam Number of

attenders

Number of

successful att.

% of

successful att.

Music Art 32 24 75,00 %

Informatics 2 718 2 358 86,75 %

Chemistry 3 760 3 423 91,04 %

Art 1 181 1 019 86,28 %

Logic 194 168 86,60 %

Politic and economy 8 624 7 718 89,49 %

History 1 503 1 265 84,17 %

Psyhology 5 085 4 575 89,97 %

Sociology 1 321 1 162 87,96 %

Chatechizm 191 161 84,29 %

Page 24: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Negative grade on state matura Number of students

% students

1 mandatory exam 211 98,14 %

2 mandatory exams 4 1,86 %

215 100,00 %

Page 25: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Mandatory exam Number % students

Croatian Language A 25 11,42 %

Croatian Language B 2 0,91 %

Math A 91 41,55 %

Math B 62 28,31 %

Foreign language A 5 2,28 %

Foreign language B 31 14,16 %

Greek 2 0,91 %

Latin A 1 0,46 %

219 100,00 %

Page 26: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Grade

1 2 3 4 5

High school students

25 302 5 253

5 272

1 037

Candidate 54 401 832 163 13

Foreign students

9 83 371 123 22

Vocational school students

282 1 940

5 295

830 34

370 2 726

11 751

6 388

1 106

Page 27: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Grade

1 2 3 4 5

High school students

2 32 535 672 69

Candidate 14 43 189 40 0

Foreign students

1 19 141 50 3

Vocational school students

514 1 292

4 809

645 6

531 1 386

5 674

1 407

78

Page 28: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Grade

1 2 3 4 5

High school students

94 1 363

2 978

1 444

724

Candidate 199 337 196 56 17

Foreign students

64 196 156 25 9

Vocational school students

401 1 063

662 173 21

758 2 959

3 992

1 698

771

Page 29: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Grade

1 2 3 4 5

High school students

64 984 2 986

2 100

448

Candidate 202 723 518 131 20

Foreign students

27 145 167 39 6

Vocational school students

1 800

5 847

4 564

1 084

94

2 093

7 699

8 235

3 354

568

Page 30: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Grade

1 2 3 4 5

High school students

5 186 3 013

5 034

1 941

Candidate 18 154 571 323 63

Foreign students

6 64 230 118 15

Vocational school students

46 559 2 840

1 406

166

75 963 6 654

6 881

2 185

Page 31: State Matura in Croatia Milestones and Challengeserasmusplus.rs/wp-content/.../01-Maja-Jukic-State-Matura-in-Croatia...• In the elective part of State Matura, students can take exams

Grade

1 2 3 4 5

High school students

31 324 994 856 357

Candidate 117 197 192 86 36

Foreign students

18 89 113 63 24

Vocational school students

1 029

2 898

3 359

1 560

302

1 195

3 508

4 658

2 565

719