© Linda Suskie, MSCHE
Assessing Student Learning in General Education
Linda Suskie, Executive Associate Director Middle States Commission on Higher Education
3624 Market Street, Philadelphia PA 19104 Web: www.msche.org Email: [email protected]
College of Staten Island
March 2007
© Linda Suskie, MSCHE
Today…
1. Laying a foundation for Gen Ed assessment
Ø Engaging faculty
Ø Getting organized
2. Identifying and articulating Gen Ed learning goals
3. Aligning Gen Ed goals & curricula
4. The assessment tool box
© Linda Suskie, MSCHE
What is Assessment of Student Learning?
l Deciding what we want our students to learn
l Making sure they learn it!
Jane Wolfson, Director, Environmental Science & Studies Program, Towson University
© Linda Suskie, MSCHE
The TeachingLearningAssessment Cycle
Learning Goals
Using Results
Learning Opportunities
Assessment
© Linda Suskie, MSCHE
Why is it so hard to assess General Education?
l Unclear definitions of Gen Ed & its components l Lack of ownership l Lack of concern & engagement
l Lack of coordination l Some Gen Ed curricula are ineffective l Outdated l Politically driven
l Little interest in improving Gen Ed l Time consuming to assess & improve
© Linda Suskie, MSCHE
Five Stages of Assessment (from Elisabeth KublerRoss)
1. Denial 2. Anger or resentment 3. Bargaining 4. Depression 5. Acceptance 6. [Panic!!!]
© Linda Suskie, MSCHE
Two Major Barriers
1. Lack of understanding of the value & importance of assessment
2. Lack of resources to engage in assessment • Marilee Bresciani
© Linda Suskie, MSCHE
1. Tests, assignments, and grades often don’t match goals.
l Would your colleagues have come up with the same list?
l Would your students have come up with the same list?
© Linda Suskie, MSCHE
Tests, assignments, and grades often...
2. Don’t focus on thinking skills
3. Poor quality
4. (Grades) Reflect things other than student learning
5. Not used to improve things
© Linda Suskie, MSCHE
Getting Faculty “On Board”
l Professional development l Grants/stipends to get started l Value efforts to improve teaching
l Scholarship of teaching l Value assessment efforts
l Written letters of thanks l Pay attention to results and use them to make
improvements!
© Linda Suskie, MSCHE
More Ideas
l Help faculty find time. l Help faculty stop doing something else. l Help them see that assessment is not an “add on.”
l Provide clear guidelines. l Set priorities.
l Provide support & resources. l Minimize paperwork. l Provide feedback.
© Linda Suskie, MSCHE
Keep your sanity!
l Recognize that some important goals can’t be assessed.
l Realistic expectations for quality l Don’t expect to get everyone on board.
© Linda Suskie, MSCHE
What about academic freedom?
l Teachers are entitled to freedom in the classroom in discussing their subject.
l AAUP 1940 Statement of Principles on Academic Freedom & Tenure
l Excellence in student learning can be demanded without telling a faculty member how to achieve or how to evaluate it. Such a demand is not a violation of academic freedom.
l Marilee Bresciani
© Linda Suskie, MSCHE
What about adjuncts?
l Provide common core materials l Core syllabi l Core learning goals l Core assignments/tests
l Require assessment participation in contract l Invite to professional development l Coordinators for adjunctheavy courses/programs l Appoint faculty mentors (with stipend)
© Linda Suskie, MSCHE
Getting Organized
l Identify someone to coordinate/shepherd Gen Ed assessment.
l Identify faculty committee to set Gen Ed assessment policies & monitor/review efforts.
l Invite faculty teaching Gen Ed courses to participate in discussions.
© Linda Suskie, MSCHE
2. Articulating Assessable Learning Goals
l Learning objectives l Learning competencies
l Learning outcomes
© Linda Suskie, MSCHE
Middle States Standard 12: General Education
l The institution’s curricula are designed so that students acquire and demonstrate collegelevel proficiency in general education and essential skills, including l Written communication l Oral communication l Scientific reasoning l Quantitative reasoning l Technological competence l Critical analysis & reasoning
© Linda Suskie, MSCHE
Middle States Standard 11: Educational Offerings
l [Foster] information literacy and technological skills across the curriculum.
l What is information literacy? l Recognize the need for information. l Identify what information is needed. l Find that information efficiently and effectively. l Evaluate information critically for relevance & credibility.
l Use information to solve a problem or answer a question.
l Use information legally & ethically.
© Linda Suskie, MSCHE
Other External Sources of Potential General Education Goals
l League for Innovation Learning Outcomes l Equipped for the Future l Greater Expectations l Teaching Goals Inventory l National Resource Center for the First Year Experience & Students in Transition (www.sc.edu/fye)
© Linda Suskie, MSCHE
Internal Sources of Potential General Education Goals
l Mission statement & strategic goals l Syllabi of current Gen Ed courses l Transcript analysis l What Gen Ed courses do most students take? l When? l In what sequence?
l Ask faculty to meet and brainstorm common goals across courses
© Linda Suskie, MSCHE
Why are you here?
l What do you need to learn in this session? l Why? l What do you want to be prepared to do when you get “back home”?
l How do you want to use what you’ll learn “back home”?
© Linda Suskie, MSCHE
What is a good learning goal?
l Outcomes – what graduates should be able to do l Observable –what graduates should be able to DO
l Action words l Understand
l Clear – no fuzzy terms l Demonstrate (how?), critical thinking, communication skills
l Skills and/or attitudes/values l Important meet student/employer needs
© Linda Suskie, MSCHE
More Examples of Learning Goals
l Demonstrate effective communication skills across disciplines.
l Demonstrate understanding of other cultures. l Demonstrate ability to work effectively with computer components.
© Linda Suskie, MSCHE
Time to Think!
n Why do many colleges have a General Education requirement in the social sciences?
n Why is it a good idea for college students to study the social sciences?
n How should our students be different 510 years from now, because they completed this requirement?
n Draft three learning goals for a General Education requirement in the social sciences.
© Linda Suskie, MSCHE
Time to Practice!
1. Draft at least one learning outcome for your General Education curriculum.
2. Trade papers with someone else; critique & edit the other person’s goals. l Clear? No fuzzy words? l Observable? Action words? l Outcomes? l Important? Lasting?
3. If you need help, ask me!
© Linda Suskie, MSCHE
Prioritizing and Achieving Consensus on Learning Outcomes
l Ask faculty to “vote.” l Write goals on flip chart paper. l Maybe group similar goals together. l Vote with dot stickers.
© Linda Suskie, MSCHE
3. Aligning Goals & Curricula
l Do you want to develop a new General Education curriculum?
l Or keep and tinker with the one you have?
© Linda Suskie, MSCHE
Analyzing Your Current General Education Curriculum
l Grid of Gen Ed goals x courses l Look for underrepresented and “overkilled” Gen Ed goals.
l Transcript analysis l What courses do students usually take to fulfill Gen Ed requirements?
l Are students achieving a Gen Ed goal through courses in their majors?
l Syllabus analysis l Do students have enough classwork & assignments to achieve this goal?
© Linda Suskie, MSCHE
Consider Modifying Syllabi
l State relevant General Education goals. l Grid of General Education goals x assignments l Reapprove all General Education courses regularly (every five years?). l Check that classwork and assignments address relevant General Education Goals.
© Linda Suskie, MSCHE
Used
Cost effective
Reasonably accurate &
truthful results
Clear & important
goals
What is “Good” Assessment?
Valued
© Linda Suskie, MSCHE
Build on Existing Learning Experiences and Assessments
l Focus on only the most popular Gen Ed courses? l Ask faculty how students achieve your goals.
l Homework/classwork (e.g., lab reports) l Endofcourse papers, projects, performances, presentations
l Final exams in Gen Ed courses l “Capstone” experiences l Field experience evaluations
l Surveys l Create grid of Gen Ed goals x existing assessments?
© Linda Suskie, MSCHE
Create New/Improved Tools As Needed
l Coursespecific assessment l All sections of each course have common assessment approaches.
AND/OR l Multicourse assessment l All courses with common goals have common assessment approaches.
AND/OR l Institutionwide assessment l Published tests & surveys l Portfolios l Capstone experiences
© Linda Suskie, MSCHE
Useful and Not Too Much Work
l Rubric (rating scales/grading criteria) to assess papers, projects, performances, presentations, portfolios
l Set of questions on final exams l Identical on all exams in multiple courses l Identical on all exams in one course
© Linda Suskie, MSCHE
Assessing Values & Attitudes
l Reflective writing l If you met two alumni… l One had achieved your goal; the other hadn’t. l How would you tell them apart?
l Proxy measures l As the twig is bent, so grows the tree. l Do students now show signs of the dispositions we hope to instill?
l Some goals aren’t assessable. l Some goals aren’t teachable.
© Linda Suskie, MSCHE
Useful But More Time & Work
l Portfolios l Locally developed tests l Locally developed surveys l Interviews & focus groups
© Linda Suskie, MSCHE
Published Tests? l Published Tests
l Out of the ivory tower l See growth over time l Sometimes...
l Breadth of coverage
l Good quality questions
l Evidence of validity and reliability
l Identify strengths and weaknesses
l Local Assessments l Your learning goals don’t match test goals.
l Your curriculum doesn’t match test content.
l Good (validated) instruments aren’t available.
l Motivating students to take a published test and give it their best effort
l Published instruments don’t yield diagnostic information.
© Linda Suskie, MSCHE
Published Tests May Have Value If and Only If
l They match our learning outcomes. l They yield useful information. l We give students compelling incentives. l There is sound evidence of their quality (validity). l They are part of a multiple measures approach.
© Linda Suskie, MSCHE
Volunteer for Middle States Evaluation Teams!
l Go to our web site (www.msche.org) l Click on “Evaluators.” l Click on “How to Become an Evaluator.” l Download the “Evaluator Biographical Data Form.” l Complete it and send it to us with your resume.