42
ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October 2006

ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

Embed Size (px)

Citation preview

Page 1: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

ICCS ASSESSMENT FRAMEWORKCivics and Citizenship Framework(Content and Cognitive Domains)

National Research Coordinators Meeting Amsterdam, 16 - 19 October 2006

Page 2: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Links to CIVED

• ICCS C&C framework incorporates the three CIVED domains.

• CIVED trend items will be included in ICCS.

• ICCS C&C framework aims to extend CIVED model and increase specificity.

Page 3: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

ICCS C&C Framework Structure

The three affective-behavioural domains are:

• Domain 1: Values

• Domain 2: Attitudes

• Domain 3: Behaviours

Page 4: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

ICCS C&C Framework Structure

The three cognitive domains are:

• Domain 1: Knowing

• Domain 2: Reasoning

• Domain 3: Analysing

Page 5: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

ICCS C&C Framework Structure

The four content domains are:

• Domain 1: Civic Society and Systems

• Domain 2: Civic Orientations

• Domain 3: Civic Practices

• Domain 4: Civic Identities

Page 6: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

ICCS C&C Framework Structure – Content Domains

• Sub-domain: This refers to a substantive or contextual component of a domain. The sub-domains have been described where they include sufficient discrete content to warrant individual definition and articulation.

• Aspect: This refers to specific content that is regarded as being largely situated with a given sub-domain.

• Key Concept: This refers to conceptual content or process that is common to Sub-domains within a given domain.

Page 7: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Citizens

State institutions

Civil institutions

Sub-domains

power/authority rules/law democracy sovereigntynation-building statelessness franchise/voting human rightsdecision-making/negotiation

Key concepts (e.g.)

are expressed within

governments legislatures

responsibilities roles

bureaucracies political parties

consist of

Aspects (e.g.)

Page 8: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

ICCS C&C Framework Structure

From concepts to assessment measures(What will be assessed?)• Perceptions questionnaire – construct

scales– Constructs to be identified in C&C

framework

• Cognitive test - achievement scale(s)– Items to sample the content of the

domains in the framework

Page 9: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 1 Civic society and systems

Sub-domain: Citizens focuses on the civic relationships between individual and groups of citizens and their societies.

Aspects Roles Rights Responsibilities Community capacity building

Page 10: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Sub-domain: State Institutions are those that are central to the processes and enacting of civic governance and legislation in the common interest of the people they represent and serve.

Aspects • Parliaments • Governments• Supranational governance bodies • Legislatures • Judiciaries and law enforcement bodies• Bureaucracies (civil or public services)• Electoral commissions.

Domain 1Civic society and systems

Page 11: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 1 Civic society and systems

• Religious institutions• Companies/corporations• Non-governmental

organisations (NGOs)• Cultural/special interest

organisations

Sub-domain: Civil institutions are those institutions that can mediate citizens’ contact with their state institutions and allow citizens actively to pursue many of their roles in their societies. Aspects

• Pressure groups• The media• Schools• Trade unions • Political parties

Page 12: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 1Civic society and systems

• power/authority• rules/law• constitution• governance• decision-making• negotiation• democracy• sovereignty

• nation-building• statelessness• franchise/voting• human rights• the economy• sustainable

development• globalisation

Key concepts

Page 13: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 1Civic society and systems

What will be assessed? Constructs accessed by the student

perceptions questionnaire items in this domain could be related to:

• Beliefs about the roles of citizens in a democracy

• Perceptions of the effectiveness of participation

• Trust in civic systems

Page 14: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 1Civic society and systems

What will be assessed?

Some examples of elements that may be accessed by the cognitive test items in this domain are:

• Knowing the key aspects of democracy

• Analysing civic policy

• Reasoning about the attributes and powers of state and civil institutions.

Page 15: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 2 Civic orientations

Sub-domain: The orientation towards equity refers to the concept that all people are born equal in dignity and rights and that protecting and promoting this principle is essential to achieving peace, harmony and productivity within and between communities.

Page 16: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 2Civic orientations

Sub-domain: The orientation towards freedom refers to the concept that all people should have freedom of belief, freedom of speech, freedom from fear and freedom from want as articulated in the United Nations Universal Declaration of Human Rights, 1948. The orientation towards freedom includes the position to the notion that communities have a responsibility to protect actively the freedom of their members and to support the protection of freedom in all communities including those that are not their own.

Page 17: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 2Civic orientations

Sub-domain: The orientation towards social cohesion refers to the concept that social cohesion is an essential element of a community’s social well-being. The orientation towards social cohesion sub-domain accommodates the range of perspectives that individuals’ will have about social cohesion within their own and within other communities.

Page 18: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 2Civic orientations

• Concern for the common good• Empathy• Respect• Social justice• Inclusiveness

Key concepts

Page 19: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 2Civic orientations

What will be assessed? Constructs accessed by the student

perceptions questionnaire items in this domain could be related to:

• Beliefs about the importance of civil rights

• Attitudes towards immigration

• Attitudes towards social justice.

Page 20: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 2Civic orientations

What will be assessed? Some examples of elements that may

be accessed by the cognitive test items in this domain are:

• Knowing the key aspects of the common good

• Analysing the relationship between multiculturalism and inter-cultural tensions

• Reasoning about the manifestations of freedom in different contexts.

Page 21: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 3Civic practices

Sub-domain: Decision-making refers to active participation that directly results in the implementation of policy or practice regarding the individual’s community or a group within that community.

Aspects• Engaging in organisational governance • Voting

Page 22: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 3Civic practices

Sub-domain: Influencing refers to action aimed at informing and affecting any or all of the policies, practices and attitudes of others or groups of others in the individual’s community.

Aspects • Engaging in public debate • Engaging in public protest• Engaging in policy development through a

political youth organisation or youth forum• Selective purchasing of products according

to ethical beliefs about the way they were produced (ethical consumption/ethical consumerism)

Page 23: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 3Civic practices

Sub-domain: Community participation refers to participation with a primary focus on enhancing one’s connections with a community and for ultimate benefit of the community.

Aspects• Volunteering• Participating in religious, cultural and

sporting organisations• Keeping oneself informed• Acting on/responding to reflections on past

actions

Page 24: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 3Civic practices

Key Concepts

• Civic participation 

• Civic self-efficacy

• Co-operation/ collaboration

• Negotiation/resolution

• Engagement 

Page 25: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 3Civic practices

What will be assessed? Constructs accessed by the student

perceptions questionnaire items in this domain could be related to:

• Beliefs about the importance of citizenship participation

• Citizenship self-efficacy

• Expected political participation

• Expected social participation as citizens

Page 26: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 3Civic practices

What will be assessed? Some examples of the types of

behavioural indicators of active citizenship that will be collected are:

• Discussions of political or social issues• Accessing media information• Participating in civic-related

organisations in the community• Engaging in school-based civic-related

activities

Page 27: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 3Civic practices

What will be assessed?

Some examples of elements that may be accessed by the cognitive test items in this domain are:

• Analysing citizens’ motivations for participation in civic action

• Knowing differing governance options

• Reasoning about a negotiation process

Page 28: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Sub-domain: Civic self-image refers to the combination of an individual’s beliefs and feelings about their place in each of their civic communities.

• civics and citizenship values• management of multiple civic identities• recognition of self related C&C dilemmas,

understanding/evaluation of the derivation of dilemmas and of possible personal responses

Domain 4Civic identities

Page 29: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 4Civic identities

Sub-domain: Civic connectedness refers to the individual’s sense of the connection they have to their different civic communities and the different civic roles they play within each community.

• identity within groups• management of diversity of ideas/beliefs

within group• management of multiple identities and

perspectives within and across groups

Page 30: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 4Civic identities

Key concepts

• Civic self-concept

• Interdependence

• Multiplicity

• Diversity

• Cultures/ location

• Patriotism

• Civic and citizenship values

Page 31: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 4Civic identities

What will be assessed?

Constructs accessed by items in the student perceptions questionnaire in this domain could be related to:

• Attitudes towards the nation• Citizenship self-concept• Interdependence.

Page 32: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Domain 4Civic identities

What will be assessed? Some examples of elements that may be

accessed by the cognitive test items in this domain are:

• Reasoning about the development of civic identity

• Analysing the relationships between an individual’s multiple civic identities

• Analysing the nature and sources of conflict between different cultural values

Page 33: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Content Domain Cog. Att-Behav

Civic Systems and Citizens

Civic Orientations

Civic Practices

Civic Identities

Structural Modifications being Considered AD (V3) From:

Page 34: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Structural Modifications being Considered AD (V3) To:

Content Domain Cog Att -Beh

State (?)

Systems

Orientations

Practices

Identities

Civil (far)

Systems

Orientations

Practices

Identities

Civil (near)

Systems

Orientations

Practices

Identities

Page 35: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Structural Modifications being Considered AD (V3)

• Combining Civic Orientations and Civic Identities to comprise one Domain (Civic foundations/fundamentals)

Page 36: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Substantive Modifications being Considered AD (V3)

• Name changes– Equity to become Equality– Civic Orientations to Civic Principles OR

(depending on restructure) Civic Foundations/Fundamentals

– State Institutions to become Supranational(?) and State Institutions

• Additional concept definition– Add Nationalism as a separate Key

Concept to Patriotism

Page 37: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Cognitive domain 1: Knowing

Define: Recall or recognise statements that define civic and citizenship concepts and content.

Describe: Recall or recognise statements that describe the key characteristics of civic and citizenship concepts and content.

Illustrate with examples: Provide or recognise examples that support or clarify statements about civic and citizenship concepts and content.

Page 38: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Cognitive domain 2: Reasoning

Interpret information: Make or recognise statements about information presented in textual, graphical or tabular form that make sense of the information in the light of a civic and citizenship concept.

Relate: Use the key defining aspects of a civic and citizenship concept to explain or recognise how an example illustrates a concept.

Justify: Use evidence and civic and citizenship concepts to construct or recognise a reasoned argument to support a point of view.

Page 39: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Cognitive domain 2: Reasoning

Integrate: Make or recognise connections between different concepts across themes and civic and citizenship content domains.

Generalise: Provide or recognise civic and citizenship conceptual principles that have been manifest as specific examples and explain how these may apply in other civic and citizenship contexts.

Page 40: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Cognitive domain 3: AnalysingEvaluate: Make or recognise judgements about

the advantages and disadvantages of alternative points of view or approaches to civic and citizenship concepts and actions.

Solve problems: Provide or recognise courses of action or thought that can be used to alleviate civic and citizenship problems that have been expressed as conflict, tension or unresolved or contested ideas.

Hypothesise: Make or recognise predictions about the effects and outcomes of civic and citizenship policies, strategies or actions.

Page 41: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Cognitive domain 3: Analysing

Reflect: Make or recognise judgements about the outcomes of completed civic actions.

Understand civic motivation: Provide or recognise the factors that motivate individuals’ or groups’ civic action.

Understand civic change: Identify and explain the factors and processes that lead to change in the substance and structure of civic and citizenship concepts and entities.

Page 42: ICCS ASSESSMENT FRAMEWORK Civics and Citizenship Framework (Content and Cognitive Domains) National Research Coordinators Meeting Amsterdam, 16 - 19 October

NRCMeeting

Amsterdam16-19 Oct 2006

Substantive Modifications being Considered CD (V3)

• Domain 3 – Subsume Reflect into Evaluate

• Replace reference to ‘provide or recognise’ with ‘identify’ where appropriate.