General Education ProgramAssessment Forum
Sponsored by theGeneral Education Council
(http://utlc.uncg.edu/genedu)
in collaboration with the Office of Assessment & Accreditation
(http://assessment.uncg.edu/academic/GenEd/)
August 2015
Overview• UNCG’s General Education Program• General Education Program assessment process
• Results from fall 2014 pilot of VALUE rubrics
• Discussion• Recommendations to GE Council
August 2015
General Education Council: 2014‐15Jonathan Zarecki (Chair) CAS: Classical Studies (2014-15)Stuart Allen BSBE: Economics (2016-17)Jamie Anderson CAS: History (2015-16)Pam Brown HHS: Kinesiology (2014-15)Greg Carroll SMTD (2014-15)Liam Duffy CAS: Chemistry & Biochemistry (2015-16)Jennifer Feather CAS: English (2014-15)Stephanie Kurtts SOE (2014-15)Jessica McCall CAS: Communication Studies (2016-17)Angela Newman SON (2016-17)Jan Rychtar CAS: Mathematics and Statistics (2015-16)
August 2015
General Education Learning GoalsLearning Goal 1: Foundational Skills (Think
critically, communicate effectively, and develop appropriate fundamental skills in quantitative and information literacies.)
Learning Goal 2: The Physical & Natural World
Learning Goal 3: Knowledge of Human Histories, Cultures, & the Self
Learning Goal 4: Knowledge of Social & Human Behavior
Learning Goal 5: Personal, Civic, & Professional Development
August 2015
General Education Program: Categories (8)
Categories:Learning Goal 1
Learning Goal 2
Learning Goal 3
Learning Goal 4
Learning Goal 5
Fine Arts (GFA) Historical Perspectives (GHP)
Literature (GLT) Mathematics (GMT) Natural Sciences (GNS) Philosophical, Religious, & Ethical Principles (GPR)
Reasoning & Discourse(GRD) Social & Behavioral Sciences (GSB)
August 2015
General Education Program: Markers (4)
Markers:Learning Goal 1
Learning Goal 2
Learning Goal 3
Learning Goal 4
Learning Goal 5
GlobalPerspectives (GL)
GlobalPerspectives Non‐Western (GN)
Speaking Intensive (SI) Writing Intensive (WI)
August 2015
Gen Ed Program Assessment Process• Process created and controlled by Faculty
– May 2011: Planning workshop– Fall 2011: Process piloted– Spring 2012*: GFA, GLT, GPR evaluated using process– Fall 2012*: GFA, GHP, GRD, GSB, GL, GN, SI, WI evaluated using process
• Step 1: Course instructors– Identify student work products aligned with GEC student learning outcomes
– Submit six random SWPs – Assess all SWPs using 3‐point scale (Highly Prof./Prof./Not Prof.)
August 2015 *See http://assessment.uncg.edu/academic/GenEd/
Gen Ed Program Assessment Process• Step 2: Peer faculty reviewers (Workshop)
– GEP faculty pairs review sample SWPs and assess on same 3‐point scale
– Feedback/recommendations made to GE Council• Step 3: All stakeholders (Forum)
– Data summarized, aggregated, and comparisons made available to University
– Feedback requested– Final summary submitted to GE Council
August 2015
UNC General AdministrationGeneral Education Council
Presentation “Educational Outcomes: The Role of Competencies and The Importance of Assessment” (Apr 2014)• Competency = knowledge + skill• Goals:
– Review and identify competencies– Identify and address assessment challenges– Examine connection of competencies to curricula
• Identifying competencies:– Critical Thinking– Written Communication
August 2015
Subcompetencies
Critical Thinking• Define the problem/issue• Evaluate the evidence and
data on the topic• Consider context or
assumptions in the evidence• Propose an interpretation or
hypothesis• Identify alternatives,
conclusions, or implications
Written Communication• Define the purpose of the
writing to be done• Select relevant and
compelling content• Comply with norms or
conventions• Select credible sources
and evidence• Use correct syntax and
mechanics
August 2015
Fall 2014 Pilot Process• Replaced three‐point rating scale with three AAC&U VALUE rubrics (http://www.aacu.org/value/rubrics?CFID=21223692) – Critical Thinking*– Information Literacy*– Written Communication**included in Gen Ed Program’s Learning Goal 1 (Foundational Skills)
• Aug 2014 VALUE rubric training workshop– Presenter: Dr. Ashley Finley, Senior Director of Assessment & Research, AAC&U
– Calibration training process
August 2015
Fall 2014 Pilot Process• GRD: piloted Critical Thinking VALUE rubric
– 13 GRD sections from 2 departments (n=286 students)– 78 sample students’ work products collected
• GL/GN: piloted Information Literacy VALUE rubric– 2 GL/GN sections from 2 departments (n=62 students)– 11 sample students’ work products collected
• WI: piloted Written Communication VALUE rubric– 5 WI sections from 2 departments (n=82 students)– 23 sample students’ work products collected
August 2015
Fall 2014 Pilot Process• Departments (all from CAS) represented:
– Communication Studies– English– Philosophy– Political Science
• Course faculty applied VALUE rubrics to all students’ work for selected assignment
August 2015
Jan 2015 Peer‐review Workshop• Critical Thinking rubric
– 79 GRD student work products– Six unique pairs of faculty raters
• Information Literacy rubric– 11 GL/GN student work products– One pair of faculty raters
• Written Communication rubric– 23 WI student work products– Two unique pairs of faculty raters
• Calibration practice for each rubric group
August 2015
Critical Thinking VALUE Rubric
Criteria (or dimensions):• CT01: Explanation of issues• CT02: Evidence (selecting and
using information to investigate a point of view or conclusion)
• CT03: Influence of context and assumptions
• CT04: Student’s position (perspective, thesis/hypothesis)
• CT05: Conclusions and related outcomes (implications and consequences)
Performance Levels:• PL 4: Capstone• PL 3: Milestone 2• PL 2: Milestone 1• PL 1: Benchmark• PL 0: does not meet PL 1• NA: student work is not
intended to meet criterion
August 2015
Ratings of Sample Student Work Products (n=78) by Course Faculty (CF)and by Workshop Faculty (WF) Using the VALUE Critical Thinking Rubric
CT01: Explanation of issues Performance Level 2:CF(n=6)
WF(n=12) Performance Levels:
Issue/problem to be considered critically is stated but description leaves some terms undefined, ambiguities unexplained, boundaries undetermined, and/or backgrounds unknown
33% 41% above Level 249% 40% at Level 218% 19% below Level 2 0% 0% Not Applicable
CT02: Evidence (selecting and using information to investigate a point of view or conclusion) Performance Level 2:
CF(n=6)
WF(n=12) Performance Levels:
Information is taken from source(s) with some interpretation/evaluation, but not enough to develop a coherent analysis or synthesis.Viewpoints of experts are taken as mostly fact, with little questioning.
30% 19% above Level 233% 42% at Level 237% 39% below Level 2 0% 0% Not Applicable
CT03: Influence of context and assumptions Performance Level 2:CF(n=6)
WF(n=12) Performance Levels:
Questions some assumptions. Identifies several relevant contexts when presenting a position. May be more aware of others’ assumptions than one’s own (or vice versa).
37% 17% above Level 2 47% 39% at Level 216% 44% below Level 20% 0% Not Applicable
CT04: Student’s position Performance Level 2:CF(n=6)
WF(n=12) Performance Levels:
Specific position (perspective, thesis/hypothesis) acknowledges different sides of an issue.
21% 19% above Level 242% 32% at Level 237% 49% below Level 2 0% 0% Not Applicable
CT05: Conclusions and related outcomes Performance Level 2:CF(n=6)
WF(n=12) Performance Levels:
Conclusion is logically tied to information (because information is chosen to fit the desired conclusion); some related outcomes (consequences and implications) are identified clearly.
23% 17% above Level 247% 56% at Level 230% 27% below Level 2 0% 0% Not Applicable
See CT handout
August 2015
Information Literacy VALUE Rubric
Criteria (or dimensions):• IL01: Determine the
extent of information needed
• IL02: Access the needed information
• IL03: Evaluate information and its sources critically
• IL04: Use information effectively to accomplish a specific purposes
• IL05: Access and use information ethically and legally
August 2015
Ratings of Sample Student Work Products (n=11) by Course Faculty (CF)and by Workshop Faculty (WF) Using the VALUE Information Literacy Rubric
IL01: Determine the extent of information needed Performance Level 2:CF(n=2)
WF(n=2) Performance Levels:
Defines the scope of the research question or thesis incompletely (parts are missing, remains too broad or too narrow, etc.). Can determine key concepts. Types of information (sources) selected partially relate to concepts or answer research question.
73% 55% above Level 218% 36% at Level 29% 9% below Level 2 0% 0% Not Applicable
IL02: Access the needed information Performance Level 2:CF(n=2)
WF(n=2) Performance Levels:
Accesses information using simple search strategies, retrieves information from limited and similar sources.
73% 0% above Level 227% 0% at Level 20% 0% below Level 2 0% 100% Not Applicable
IL03: Evaluate information and its sources critically Performance Level 2:CF(n=2)
WF(n=2) Performance Levels:
Chooses a variety of information sources. Selects sources using basic criteria (such as relevance to the research question and currency).55% 36% above Level 2
36% 27% at Level 29% 36% below Level 2 0% Not Applicable
IL04: Use information effectively to accomplish a specific purpose Performance Level 2:
CF(n=2)
WF(n=2) Performance Levels:
Communicates and organizes information from sources. The information is not yet synthesized so the intended purpose is not fully achieved.55% 36% above Level 2
27% 27% at Level 218% 36% below Level 2 0% 0% Not Applicable
IL05: Access and use information ethically and legally Performance Level 2:CF(n=2)
WF(n=2) Performance Levels:
Students use correctly two of the following information use strategies (use of citations and references; choice of paraphrasing, summary, or quoting; using information in ways that are true to original context; distinguishing between common knowledge and ideas requiring attribution) and demonstrates a full understanding of the ethical and legal restrictions on the use of published, confidential, and/or proprietary information.
55% 45% above Level 236% 18% at Level 29% 36% below Level 2 0% 0% Not Applicable
See IL handout
August 2015
Written Communication VALUE Rubric
Criteria (or dimensions):• WC01: Context of, and
purpose for, writing• WC02: Content
development• WC03: Genre and
disciplinary conventions
• WC04: Sources and evidence
• WC05: Control of syntax and mechanics
August 2015
Ratings of Sample Student Work Products (n=23) by Course Faculty (CF)and by Workshop Faculty (WF) Using the VALUE Written Communication Rubric
WC01: Context of and purpose for writing (includes considerations of audience, purpose, and the circumstances surrounding the writing task(s)) Performance Level 2:
CF(n=3)
WF(n=4) Performance Levels:
Demonstrates awareness of context, audience, purpose, and to the assigned task(s) (e.g., begins to show awareness of audience’s perceptions and assumptions).
78% 37% above Level 217% 43% at Level 24% 20% below Level 2 0% 0% Not Applicable
WC02: Content development Performance Level 2:CF(n=3)
WF(n=4) Performance Levels:
Uses appropriate and relevant content to develop and explore ideas through most of the work.43% 39% above Level 2
48% 48% at Level 29% 13% below Level 2 0% 0% Not Applicable
WC03: Genre and disciplinary conventions (formal and informal rules inherent in the expectations for writing in particular forms and/or academic fields) Performance Level 2:
CF(n=3)
WF(n=4) Performance Levels:
Follows expectations appropriate to a specific discipline and/or writing task(s) for basic organization, content, and presentation52% 41% above Level 2
26% 41% at Level 222% 18% below Level 2 0% 0% Not Applicable
WC04: Sources and evidence Performance Level 2:CF(n=3)
WF(n=4) Performance Levels:
Demonstrates an attempt to use credible and/or relevant sources to support ideas that are appropriate for the discipline and genre of the writing.
43% 28% above Level 222% 39% at Level 213% 11% below Level 2 22% 22% Not Applicable
WC05: Control of syntax and mechanics Performance Level 2:CF(n=3)
WF(n=4) Performance Levels:
Uses language that generally conveys meaning to readers with clarity, although writing may include some errors.39% 41% above Level 2
44% 46% at Level 217% 13% below Level 2 0% 0% Not Applicable
See WC handout
August 2015
See handoutComparison of Median and Mode
Information Literacy: 11 SWPs
Course Faculty Workshop Faculty Raters
RubricDim1 Dim2 Dim3 Dim4 Dim5 Dim1 Dim2 Dim3 Dim4 Dim5
IL Median1 3 3 3 3 3 3 NA 2 2 2
IL Mode2 3 3 3 3 2 3 NA 3 2 3
Critical Thinking: 78 SWPs
Course Faculty Workshop Faculty Raters
RubricDim1 Dim2 Dim3 Dim4 Dim5 Dim1 Dim2 Dim3 Dim4 Dim5
CT Median 2 2 2 2 2 2 2 2 2 2
CT Mode 2 2 2 2 2 2 2 2 1 2
Written Communication: 23 SWPs
Course Faculty Workshop Faculty RatersRubric
Dim1 Dim2 Dim3 Dim4 Dim5 Dim1 Dim2 Dim3 Dim4 Dim5
WC Median 3 2 3 3 2 2 2 2 2 2WC Mode 3 2 3 3 2 2 2 2 2 2
August 2015
Actionable Items from Faculty*Create a UNCG‐specific rubric.Develop a checklist that would generate a level of
proficiency.Offer more practice during rubric calibration training.Offer training to faculty on how to integrate good
rubrics and assessment.Develop a common assignment: By course? By Gen Ed
category?Have a campus‐wide discussion about the perceived
misalignment between Gen Ed category/marker student learning outcomes and competencies (i.e., critical thinking, written communication).
August 2015 *Course and Workshop
Forum Participation
1. Individually, rank six actionable items derived from course and Workshop faculty.
2. As a group, select the top three items to go to the General Education Council.
August 2015
General Education Council: 2015‐16David Carlone (Chair) CAS: Communication Studies (2017-18)Stuart Allen BSBE: Economics (2016-17)Jamie Anderson CAS: History (2015-16)Aaron Terranova HHS: Kinesiology (2017-18)Michael Flannery SMTD (2017-18)Liam Duffy CAS: Chemistry & Biochemistry (2015-16)Amy Vines CAS: English (2017-18)Stephanie Kurtts SOE (2nd term) (2017-18)Jessica McCall CAS: Communication Studies (2016-17)Angela Newman SON (2016-17)Jan Rychtar CAS: Mathematics and Statistics (2015-16)
August 2015
Thank You!Questions?• Jon Zarecki, 2014‐15 Chair, Gen Ed Council
([email protected])• David Carlone, 2015‐16 Chair, Gen Ed Council
([email protected])• Jodi Pettazzoni, Director of Assessment & Accreditation ([email protected])
• Terry Brumfield, Assessment Specialist ([email protected])
August 2015
General Education Program Assessment for 2014-15
Pilot of Critical Thinking, Information Literacy, and Written Communication VALUE Rubrics
Results from Critical Thinking rubric:
Ratings of Sample Student Work Products (n=78) by Course Faculty (CF)
and by Workshop Faculty (WF) Using the VALUE Critical Thinking Rubric
CT01: Explanation of issues Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Issue/problem to be considered
critically is stated but description
leaves some terms undefined,
ambiguities unexplained, boundaries
undetermined, and/or backgrounds
unknown
33% 41% above Level 2
49% 40% at Level 2
18% 19% below Level 2
0% 0% Not Applicable
CT02: Evidence (selecting and using information to
investigate a point of view or conclusion) Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Information is taken from source(s)
with some interpretation/evaluation,
but not enough to develop a
coherent analysis or synthesis.
Viewpoints of experts are taken as
mostly fact, with little questioning.
30% 19% above Level 2
33% 42% at Level 2
37% 39% below Level 2
0% 0% Not Applicable
CT03: Influence of context and assumptions Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Questions some assumptions.
Identifies several relevant contexts
when presenting a position. May be
more aware of others’ assumptions
than one’s own (or vice versa).
37% 17% above Level 2
47% 39% at Level 2
16% 44% below Level 2
0% 0% Not Applicable
CT04: Student’s position Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Specific position (perspective,
thesis/hypothesis) acknowledges
different sides of an issue. 21% 19% above Level 2
42% 32% at Level 2
37% 49% below Level 2
0% 0% Not Applicable
CT05: Conclusions and related outcomes Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Conclusion is logically tied to
information (because information is
chosen to fit the desired conclusion);
some related outcomes
(consequences and implications) are
identified clearly.
23% 17% above Level 2
47% 56% at Level 2
30% 27% below Level 2
0% 0% Not Applicable
General Education Program Assessment for 2014-15
Pilot of Critical Thinking, Information Literacy, and Written Communication VALUE Rubrics
Results from Information Literacy rubric:
Ratings of Sample Student Work Products (n=11) by Course Faculty (CF)
and by Workshop Faculty (WF) Using the VALUE Information Literacy Rubric
IL01: Determine the extent of information needed Performance Level 2:
CF
(n=2)
WF
(n=2) Performance Levels:
Defines the scope of the research question or
thesis incompletely (parts are missing, remains
too broad or too narrow, etc.). Can determine
key concepts. Types of information (sources)
selected partially relate to concepts or answer
research question.
73% 55% above Level 2
18% 36% at Level 2
9% 9% below Level 2
0% 0% Not Applicable
IL02: Access the needed information Performance Level 2:
CF
(n=2)
WF
(n=2) Performance Levels:
Accesses information using simple search
strategies, retrieves information from limited
and similar sources. 73% 0% above Level 2
27% 0% at Level 2
0% 0% below Level 2
0% 100% Not Applicable
IL03: Evaluate information and its sources critically Performance Level 2:
CF
(n=2)
WF
(n=2) Performance Levels:
Chooses a variety of information sources.
Selects sources using basic criteria (such as
relevance to the research question and
currency). 55% 36% above Level 2
36% 27% at Level 2
9% 36% below Level 2
0% Not Applicable
IL04: Use information effectively to accomplish a
specific purpose Performance Level 2:
CF
(n=2)
WF
(n=2) Performance Levels:
Communicates and organizes information from
sources. The information is not yet synthesized
so the intended purpose is not fully achieved. 55% 36% above Level 2
27% 27% at Level 2
18% 36% below Level 2
0% 0% Not Applicable
IL05: Access and use information ethically and legally Performance Level 2:
CF
(n=2)
WF
(n=2) Performance Levels:
Students use correctly two of the following
information use strategies (use of citations and
references; choice of paraphrasing, summary, or
quoting; using information in ways that are true
to original context; distinguishing between
common knowledge and ideas requiring
attribution) and demonstrates a full
understanding of the ethical and legal
restrictions on the use of published, confidential,
and/or proprietary information.
55% 45% above Level 2
36% 18% at Level 2
9% 36% below Level 2
0% 0% Not Applicable
General Education Program Assessment for 2014-15
Pilot of Critical Thinking, Information Literacy, and Written Communication VALUE Rubrics
Results from Critical Thinking rubric:
Ratings of Sample Student Work Products (n=78) by Course Faculty (CF)
and by Workshop Faculty (WF) Using the VALUE Critical Thinking Rubric
CT01: Explanation of issues Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Issue/problem to be considered
critically is stated but description
leaves some terms undefined,
ambiguities unexplained, boundaries
undetermined, and/or backgrounds
unknown
33% 41% above Level 2
49% 40% at Level 2
18% 19% below Level 2
0% 0% Not Applicable
CT02: Evidence (selecting and using information to
investigate a point of view or conclusion) Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Information is taken from source(s)
with some interpretation/evaluation,
but not enough to develop a
coherent analysis or synthesis.
Viewpoints of experts are taken as
mostly fact, with little questioning.
30% 19% above Level 2
33% 42% at Level 2
37% 39% below Level 2
0% 0% Not Applicable
CT03: Influence of context and assumptions Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Questions some assumptions.
Identifies several relevant contexts
when presenting a position. May be
more aware of others’ assumptions
than one’s own (or vice versa).
37% 17% above Level 2
47% 39% at Level 2
16% 44% below Level 2
0% 0% Not Applicable
CT04: Student’s position Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Specific position (perspective,
thesis/hypothesis) acknowledges
different sides of an issue. 21% 19% above Level 2
42% 32% at Level 2
37% 49% below Level 2
0% 0% Not Applicable
CT05: Conclusions and related outcomes Performance Level 2:
CF
(n=6)
WF
(n=12) Performance Levels:
Conclusion is logically tied to
information (because information is
chosen to fit the desired conclusion);
some related outcomes
(consequences and implications) are
identified clearly.
23% 17% above Level 2
47% 56% at Level 2
30% 27% below Level 2
0% 0% Not Applicable
Comparison of Median and Mode
Information Literacy: 11 SWPs
Course Faculty Workshop Faculty Raters
Rubric Dim1 Dim2 Dim3 Dim4 Dim5 Dim1 Dim2 Dim3 Dim4 Dim5
IL Median1 3 3 3 3 3 3 NA 2 2 2
IL Mode2 3 3 3 3 2 3 NA 3 2 3
Critical Thinking: 78 SWPs
Course Faculty Workshop Faculty Raters Rubric Dim1 Dim2 Dim3 Dim4 Dim5 Dim1 Dim2 Dim3 Dim4 Dim5
CT Median 2 2 2 2 2 2 2 2 2 2
CT Mode 2 2 2 2 2 2 2 2 1 2
Written Communication: 23 SWPs
Course Faculty Workshop Faculty Raters Rubric Dim1 Dim2 Dim3 Dim4 Dim5 Dim1 Dim2 Dim3 Dim4 Dim5
WC Median 3 2 3 3 2 2 2 2 2 2 WC Mode 3 2 3 3 2 2 2 2 2 2
1Median: the point in a distribution at which 50% of scores lie below 2Mode: the score of greatest frequency in a distribution
GEPA Forum Participants' Ranking of Top 3 Choices
1st
2nd 3rd 1
st2
nd 3rd 1st
2nd 3rd
2 1 5 8 2 7 9 2 A. Create a UNCG-specific rubric.
0 1 3 0 2 2 0 3 5B. Develop a checklist that would generate a level of
proficiency.
1 1 0 0 3 6 1 4 6 C. Offer more practice during rubric calibration training.
2 1 2 6 2 3 8 3 5D. Offer training to faculty on how to integrate good rubrics
and assessment.
0 0 0 0 1 0 0 1 0E. Develop a common assignment: By course? By Gen Ed
category?
0 1 0 5 0 2 5 1 2
F. Have a campus-wide discussion about the perceived
misalignment between Gen Ed category/marker student
learning outcomes and competencies (i.e., critical thinking,
written communication).
Rank(1 = first
choice)Actionable Items from Course and Workshop Faculty
Rank(1 = first
choice)
Rank(1 = first
choice)
8/13/2015 results 8/26/2015 results TOTAL results
CRITICAL THINKING VALUE RUBRIC for more information, please contact [email protected]
The VALUE rubrics were developed by teams of faculty experts representing colleges and universities across the United States through a process that examined many existing campus rubrics and related documents for each learning outcome and incorporated additional feedback from faculty. The rubrics articulate fundamental criteria for each learning outcome, with performance descriptors demonstrating progressively more sophisticated levels of attainment. The rubrics are intended for institutional-level use in evaluating and discussing student learning, not for grading. The core expectations articulated in all 15 of the VALUE rubrics can and should be translated into the language of individual campuses, disciplines, and even courses. The utility of the VALUE rubrics is to position learning at all undergraduate levels within a basic framework of expectations such that evidence of learning can by shared nationally through a common dialog and understanding of student success.
Definition Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or formulating an opinion or conclusion.
Framing Language This rubric is designed to be transdisciplinary, reflecting the recognition that success in all disciplines requires habits of inquiry and analysis that share common attributes. Further, research suggests that successful critical thinkers from all disciplines increasingly need to be able to apply those habits in various and changing situations encountered in all walks of life. This rubric is designed for use with many different types of assignments and the suggestions here are not an exhaustive list of possibilities. Critical thinking can be demonstrated in assignments that require students to complete analyses of text, data, or issues. Assignments that cut across presentation mode might be especially useful in some fields. If insight into the process components of critical thinking (e.g., how information sources were evaluated regardless of whether they were included in the product) is important, assignments focused on student reflection might be especially illuminating.
Glossary The definitions that follow were developed to clarify terms and concepts used in this rubric only.
• Ambiguity: Information that may be interpreted in more than one way. • Assumptions: Ideas, conditions, or beliefs (often implicit or unstated) that are "taken for granted or accepted as true without proof." (quoted from
www.dictionary.reference.com/browse/assumptions) • Context: The historical, ethical. political, cultural, environmental, or circumstantial settings or conditions that influence and complicate the consideration of any issues, ideas, artifacts, and
events. • Literal meaning: Interpretation of information exactly as stated. For example, "she was green with envy" would be interpreted to mean that her skin was green. • Metaphor: Information that is (intended to be) interpreted in a non-literal way. For example, "she was green with envy" is intended to convey an intensity of emotion, not a skin color.
CRITICAL THINKING VALUE RUBRIC for more information, please contact [email protected]
Definition Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or formulating an opinion or conclusion.
Evaluators are encouraged to assign a zero to any work sample or collection of work that does not meet benchmark (cell one) level performance.
Capstone
4
Milestones
3 2
Benchmark
1
Explanation of issues Issue/problem to be considered critically is stated clearly and described comprehensively, delivering all relevant information necessary for full understanding.
Issue/problem to be considered critically is stated, described, and clarified so that understanding is not seriously impeded by omissions.
Issue/problem to be considered critically is stated but description leaves some terms undefined, ambiguities unexplored, boundaries undetermined, and/or backgrounds unknown.
Issue/problem to be considered critically is stated without clarification or description.
Evidence Selecting and using information to investigate a point of view or conclusion
Information is taken from source(s) with enough interpretation/evaluation to develop a comprehensive analysis or synthesis. Viewpoints of experts are questioned thoroughly.
Information is taken from source(s) with enough interpretation/evaluation to develop a coherent analysis or synthesis. Viewpoints of experts are subject to questioning.
Information is taken from source(s) with some interpretation/evaluation, but not enough to develop a coherent analysis or synthesis. Viewpoints of experts are taken as mostly fact, with little questioning.
Information is taken from source(s) without any interpretation/evaluation. Viewpoints of experts are taken as fact, without question.
Influence of context and assumptions Thoroughly (systematically and methodically) analyzes own and others' assumptions and carefully evaluates the relevance of contexts when presenting a position.
Identifies own and others' assumptions and several relevant contexts when presenting a position.
Questions some assumptions. Identifies several relevant contexts when presenting a position. May be more aware of others' assumptions than one's own (or vice versa).
Shows an emerging awareness of present assumptions (sometimes labels assertions as assumptions). Begins to identify some contexts when presenting a position.
Student's position (perspective, thesis/hypothesis)
Specific position (perspective, thesis/hypothesis) is imaginative, taking into account the complexities of an issue. Limits of position (perspective, thesis/hypothesis) are acknowledged. Others' points of view are synthesized within position (perspective, thesis/hypothesis).
Specific position (perspective, thesis/hypothesis) takes into account the complexities of an issue. Others' points of view are acknowledged within position (perspective, thesis/hypothesis).
Specific position (perspective, thesis/hypothesis) acknowledges different sides of an issue.
Specific position (perspective, thesis/hypothesis) is stated, but is simplistic and obvious.
Conclusions and related outcomes (implications and consequences)
Conclusions and related outcomes (consequences and implications) are logical and reflect student’s informed evaluation and ability to place evidence and perspectives discussed in priority order.
Conclusion is logically tied to a range of information, including opposing viewpoints; related outcomes (consequences and implications) are identified clearly.
Conclusion is logically tied to information (because information is chosen to fit the desired conclusion); some related outcomes (consequences and implications) are identified clearly.
Conclusion is inconsistently tied to some of the information discussed; related outcomes (consequences and implications) are oversimplified.
INFORMATION LITERACY VALUE RUBRIC for more information, please contact [email protected]
The VALUE rubrics were developed by teams of faculty experts representing colleges and universities across the United States through a process that examined many existing campus rubrics and related documents for each learning outcome and incorporated additional feedback from faculty. The rubrics articulate fundamental criteria for each learning outcome, with performance descriptors demonstrating progressively more sophisticated levels of attainment. The rubrics are intended for institutional-level use in evaluating and discussing student learning, not for grading. The core expectations articulated in all 15 of the VALUE rubrics can and should be translated into the language of individual campuses, disciplines, and even courses. The utility of the VALUE rubrics is to position learning at all undergraduate levels within a basic framework of expectations such that evidence of learning can by shared nationally through a common dialog and understanding of student success.
Definition The ability to know when there is a need for information, to be able to identify, locate, evaluate, and effectively and responsibly use and share that information for the problem at hand. - Adopted from the National Forum on Information Literacy
Framing Language This rubric is recommended for use evaluating a collection of work, rather than a single work sample in order to fully gauge students’ information skills. Ideally, a collection of work would contain a wide variety of different types of work and might include: research papers, editorials, speeches, grant proposals, marketing or business plans, PowerPoint presentations, posters, literature reviews, position papers, and argument critiques to name a few. In addition, a description of the assignments with the instructions that initiated the student work would be vital in providing the complete context for the work. Although a student’s final work must stand on its own, evidence of a student’s research and information gathering processes, such as a research journal/diary, could provide further demonstration of a student’s information proficiency and for some criteria on this rubric would be required.
INFORMATION LITERACY VALUE RUBRIC for more information, please contact [email protected]
Definition The ability to know when there is a need for information, to be able to identify, locate, evaluate, and effectively and responsibly use and share that information for the problem at hand. - The National Forum on Information Literacy
Evaluators are encouraged to assign a zero to any work sample or collection of work that does not meet benchmark (cell one) level performance.
Capstone 4
Milestones 3 2
Benchmark 1
Determine the Extent of Information Needed
Effectively defines the scope of the research question or thesis. E ffectively determines key concepts. Types of information (sources) selected directly relate to concepts or answer research question.
Defines the scope of the research question or thesis completely. Can determine key concepts. Types of information (sources) selected relate to concepts or answer research question.
Defines the scope of the research question or thesis incompletely (parts are missing, remains too broad or too narrow, etc.). Can determine key concepts. Types of information (sources) selected partially relate to concepts or answer research question.
Has difficulty defining the scope of the research question or thesis. Has difficulty determining key concepts. Types of information (sources) selected do not relate to concepts or answer research question.
Access the Needed Information Accesses information using effective, well-designed search strategies and most appropriate information sources.
Accesses information using variety of search strategies and some relevant information sources. Demonstrates ability to refine search.
Accesses information using simple search strategies, retrieves information from limited and similar sources.
Accesses information randomly, retrieves information that lacks relevance and quality.
Evaluate Information and its Sources Critically
Thoroughly (systematically and methodically) analyzes own and others' assumptions and carefully evaluates the relevance of contexts when presenting a position.
Identifies own and others' assumptions and several relevant contexts when presenting a position.
Questions some assumptions. Identifies several relevant contexts when presenting a position. May be more aware of others' assumptions than one's own (or vice versa).
Shows an emerging awareness of present assumptions (sometimes labels assertions as assumptions). Begins to identify some contexts when presenting a position.
Use Information Effectively to Accomplish a Specific Purpose
Communicates, organizes and synthesizes information from sources to fully achieve a specific purpose, with clarity and depth
Communicates, organizes and synthesizes information from sources. Intended purpose is achieved.
Communicates and organizes information from sources. The information is not yet synthesized, so the intended purpose is not fully achieved.
Communicates information from sources. The information is fragmented and/or used inappropriately (misquoted, taken out of context, or incorrectly paraphrased, etc.), so the intended purpose is not achieved.
Access and Use Information Ethically and Legally
Students use correctly all of the following information use strategies (use of citations and references; choice of paraphrasing, summary, or quoting; using information in ways that are true to original context; distinguishing between common knowledge and ideas requiring attribution) and demonstrate a full understanding of the ethical and legal restrictions on the use of published, confidential, and/or proprietary information.
Students use correctly three of the following information use strategies (use of citations and references; choice of paraphrasing, summary, or quoting; using information in ways that are true to original context; distinguishing between common knowledge and ideas requiring attribution) and demonstrates a full understanding of the ethical and legal restrictions on the use of published, confidential, and/or proprietary information.
Students use correctly two of the following information use strategies (use of citations and references; choice of paraphrasing, summary, or quoting; using information in ways that are true to original context; distinguishing between common knowledge and ideas requiring attribution) and demonstrates a full understanding of the ethical and legal restrictions on the use of published, confidential, and/or proprietary information.
Students use correctly one of the following information use strategies (use of citations and references; choice of paraphrasing, summary, or quoting; using information in ways that are true to original context; distinguishing between common knowledge and ideas requiring attribution) and demonstrates a full understanding of the ethical and legal restrictions on the use of published, confidential, and/or proprietary information.
WRITTEN COMMUNICATION VALUE RUBRIC for more information, please contact [email protected]
The VALUE rubrics were developed by teams of faculty experts representing colleges and universities across the United States through a process that examined many existing campus rubrics and related documents for each learning outcome and incorporated additional feedback from faculty. The rubrics articulate fundamental criteria for each learning outcome, with performance descriptors demonstrating progressively more sophisticated levels of attainment. The rubrics are intended for institutional-level use in evaluating and discussing student learning, not for grading. The core expectations articulated in all 15 of the VALUE rubrics can and should be translated into the language of individual campuses, disciplines, and even courses. The utility of the VALUE rubrics is to position learning at all undergraduate levels within a basic framework of expectations such that evidence of learning can by shared nationally through a common dialog and understanding of student success.
Definition Written communication is the development and expression of ideas in writing. Written communication involves learning to work in many genres and styles. It can involve working with many different writing technologies, and mixing texts, data, and images. Written communication abilities develop through iterative experiences across the curriculum.
Framing Language This writing rubric is designed for use in a wide variety of educational institutions. The most clear finding to emerge from decades of research on writing assessment is that the best writing assessments are locally determined and sensitive to local context and mission. Users of this rubric should, in the end, consider making adaptations and additions that clearly link the language of the rubric to individual campus contexts. This rubric focuses assessment on how specific written work samples or collectios of work respond to specific contexts. The central question guiding the rubric is "How well does writing respond to the needs of audience(s) for the work?" In focusing on this question the rubric does not attend to other aspects of writing that are equally important: issues of writing process, writing strategies, writers' fluency with different modes of textual production or publication, or writer's growing engagement with writing and disciplinarity through the process of writing. Evaluators using this rubric must have information about the assignments or purposes for writing guiding writers' work. Also recommended is including reflective work samples of collections of work that address such questions as: What decisions did the writer make about audience, purpose, and genre as s/he compiled the work in the portfolio? How are those choices evident in the writing -- in the content, organization and structure, reasoning, evidence, mechanical and surface conventions, and citational systems used in the writing? This will enable evaluators to have a clear sense of how writers understand the assignments and take it into consideration as they evaluate The first section of this rubric addresses the context and purpose for writing. A work sample or collections of work can convey the context and purpose for the writing tasks it showcases by including the writing assignments associated with work samples. But writers may also convey the context and purpose for their writing within the texts. It is important for faculty and institutions to include directions for students about how they should represent their writing contexts and purposes. Faculty interested in the research on writing assessment that has guided our work here can consult the National Council of Teachers of English/Council of Writing Program Administrators' White Paper on Writing Assessment (2008; www.wpacouncil.org/whitepaper) and the Conference on College Composition and Communication's Writing Assessment: A Position Statement (2008; www.ncte.org/cccc/resources/positions/123784.htm)
Glossary The definitions that follow were developed to clarify terms and concepts used in this rubric only.
• Content Development: The ways in which the text explores and represents its topic in relation to its audience and purpose. • Context of and purpose for writing: The context of writing is the situation surrounding a text: who is reading it? who is writing it? Under what circumstances will the text be shared or circulated? What social or political factors might affect how the text is composed or interpreted? The purpose for writing is the writer's intended effect on an audience. Writers might want to persuade or inform; they might want to report or summarize information; they might want to work through complexity or confusion; they might want to argue with other writers, or connect with other writers; they might want to convey urgency or amuse; they might write for themselves or for an assignment or to remember. • Disciplinary conventions: Formal and informal rules that constitute what is seen generally as appropriate within different academic fields, e.g. introductory strategies, use of passive voice or first person point of view, expectations for thesis or hypothesis, expectations for kinds of evidence and support that are appropriate to the task at hand, use of primary and secondary sources to provide evidence and support arguments and to document critical perspectives on the topic. Writers will incorporate sources according to disciplinary and genre conventions, according to the writer's purpose for the text. Through increasingly sophisticated use of sources, writers develop an ability to differentiate between their own ideas and the ideas of others, credit and build upon work already accomplished in the field or issue they are addressing, and provide meaningful examples to readers. • Evidence: Source material that is used to extend, in purposeful ways, writers' ideas in a text. • Genre conventions: Formal and informal rules for particular kinds of texts and/or media that guide formatting, organization, and stylistic choices, e.g. lab reports, academic papers, poetry, webpages, or personal essays. • Sources: Texts (written, oral, behavioral, visual, or other) that writers draw on as they work for a variety of purposes -- to extend, argue with, develop, define, or shape their ideas, for example.
WRITTEN COMMUNICATION VALUE RUBRIC for more information, please contact [email protected]
Definition Written communication is the development and expression of ideas in writing. Written communication involves learning to work in many genres and styles. It can involve working with many different writing technologies, and mixing texts, data, and images. Written communication abilities develop through iterative experiences across the curriculum.
Evaluators are encouraged to assign a zero to any work sample or collection of work that does not meet benchmark (cell one) level performance.
Capstone 4
Milestones 3 2
Benchmark 1
Context of and Purpose for Writing Includes considerations of audience, purpose, and the circumstances surrounding the writing task(s).
Demonstrates a thorough understanding of context, audience, and purpose that is responsive to the assigned task(s) and focuses all elements of the work.
Demonstrates adequate consideration of context, audience, and purpose and a clear focus on the assigned task(s) (e.g., the task aligns with audience, purpose, and context).
Demonstrates awareness of context, audience, purpose, and to the assigned tasks(s) (e.g., begins to show awareness of audience's perceptions and assumptions).
Demonstrates minimal attention to context, audience, purpose, and to the assigned tasks(s) (e.g., expectation of instructor or self as audience).
Content Development Uses appropriate, relevant, and compelling content to illustrate mastery of the subject, conveying the writer's understanding, and shaping the whole work.
Uses appropriate, relevant, and compelling content to explore ideas within the context of the discipline and shape the whole work.
Uses appropriate and relevant content to develop and explore ideas through most of the work.
Uses appropriate and relevant content to develop simple ideas in some parts of the work.
Genre and Disciplinary Conventions Formal and informal rules inherent in the expectations for writing in particular forms and/or academic fields (please see glossary).
Demonstrates detailed attention to and successful execution of a wide range of conventions particular to a specific discipline and/or writing task (s) including organization, content, presentation, formatting, and stylistic choices
Demonstrates consistent use of important conventions particular to a specific discipline and/or writing task(s), including organization, content, presentation, and stylistic choices
Follows expectations appropriate to a specific discipline and/or writing task(s) for basic organization, content, and presentation
Attempts to use a consistent system for basic organization and presentation.
Sources and Evidence Demonstrates skillful use of high-quality, credible, relevant sources to develop ideas that are appropriate for the discipline and genre of the writing
Demonstrates consistent use of credible, relevant sources to support ideas that are situated within the discipline and genre of the writing.
Demonstrates an attempt to use credible and/or relevant sources to support ideas that are appropriate for the discipline and genre of the writing.
Demonstrates an attempt to use sources to support ideas in the writing.
Control of Syntax and Mechanics Uses graceful language that skillfully communicates meaning to readers with clarity and fluency, and is virtually error-free.
Uses straightforward language that generally conveys meaning to readers. The language in the portfolio has few errors.
Uses language that generally conveys meaning to readers with clarity, although writing may include some errors.
Uses language that sometimes impedes meaning because of errors in usage.