12
Using Embedded Using Embedded Assessment to Assessment to Collect Evidence of Collect Evidence of Student Learning Student Learning

Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Embed Size (px)

Citation preview

Page 1: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Using Embedded Using Embedded Assessment to Collect Assessment to Collect

Evidence of Student Evidence of Student LearningLearning

  

Page 2: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Presentation OverviewPresentation Overview

What is Embedded Assessment?What is Embedded Assessment? Advantages of Embedded AssessmentAdvantages of Embedded Assessment Disadvantages of Embedded AssessmentDisadvantages of Embedded Assessment Types of Course-Embedded AssessmentTypes of Course-Embedded Assessment Process of Embedding AssessmentProcess of Embedding Assessment Creating and Designing Course-Creating and Designing Course-

Embedded AssessmentsEmbedded Assessments

Page 3: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

What is Embedded Assessment?What is Embedded Assessment?

Take place in a class or a group Take place in a class or a group of classes  of classes 

Determines whether students are learning Determines whether students are learning pre-established learning outcomes pre-established learning outcomes

Take advantage of pre-existing student Take advantage of pre-existing student motivation to perform well motivation to perform well

Assess what is actually taughtAssess what is actually taught

Page 4: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Advantages of Embedded AssessmentAdvantages of Embedded Assessment

Student motivation is high because the assessment Student motivation is high because the assessment activity is part of a course activityactivity is part of a course activity

Costs are reduced because incentives are unnecessaryCosts are reduced because incentives are unnecessary It usually does not require additional student time as it is It usually does not require additional student time as it is

part of the curriculumpart of the curriculum It is faculty-driven and thus, more likely, to be used for It is faculty-driven and thus, more likely, to be used for

improvementimprovement Because it’s linked to the curriculum, it’s more likely to Because it’s linked to the curriculum, it’s more likely to

identify specific curricular needs/deficienciesidentify specific curricular needs/deficiencies Feedback to faculty is usually quickFeedback to faculty is usually quick

Page 5: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Disadvantages of Embedded AssessmentDisadvantages of Embedded Assessment

Faculty commitment is absolutely Faculty commitment is absolutely essential, but can be hard to getessential, but can be hard to get

Faculty resistance to the process may be Faculty resistance to the process may be substantialsubstantial

Achieving agreement among faculty on an Achieving agreement among faculty on an assessment approach across courses is a assessment approach across courses is a challenge challenge

Usually there are no comparable dataUsually there are no comparable data

Page 6: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Types of Course-Embedded Types of Course-Embedded AssessmentAssessment

ExamsExams QuizzesQuizzes Research PapersResearch Papers ProjectsProjects Field ExperiencesField Experiences Lab Reports Lab Reports InternshipsInternships Pre/Post Comparisons Pre/Post Comparisons Student PortfoliosStudent Portfolios Capstone EvaluationsCapstone Evaluations

Page 7: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Process of Embedding AssessmentProcess of Embedding Assessment

All faculty involved must identify specific learning goals for All faculty involved must identify specific learning goals for course(s)course(s)

The goals should be succinct and central to the overall The goals should be succinct and central to the overall objectives of the course objectives of the course

For multiple sections, all faculty must agree to the goals and For multiple sections, all faculty must agree to the goals and commit to teaching to the goalscommit to teaching to the goals

Assessment methods must be agreed upon, including when Assessment methods must be agreed upon, including when and what will be used, e.g. pre/post, final exam, etc. Rubrics, and what will be used, e.g. pre/post, final exam, etc. Rubrics, exam questions, prompts, etc.exam questions, prompts, etc.

Standards must be agreed uponStandards must be agreed upon Results must be analyzed and then interpretedResults must be analyzed and then interpreted Information must be shared with all relevant faculty Information must be shared with all relevant faculty Where appropriate, the course should be improved or the Where appropriate, the course should be improved or the

assessment technique modifiedassessment technique modified

Page 8: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Creating and Designing Creating and Designing Course-Embedded AssessmentsCourse-Embedded Assessments

Select the course SLO to be assessed; or sSelect the course SLO to be assessed; or select some elect some aspect of that existing assignment that aligns with the course aspect of that existing assignment that aligns with the course SLOSLO

Evaluate and review course assignments which could be used Evaluate and review course assignments which could be used for assessment; for assessment;

Decide which course elements would best serve as Decide which course elements would best serve as assessment tools and which elements will need to be assessment tools and which elements will need to be modified to be modified to meet the needs of assessing modified to be modified to meet the needs of assessing course objectives; course objectives;

Integrate the embedded assessments elements into the Integrate the embedded assessments elements into the course;course;

Page 9: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Creating and Designing Creating and Designing Course-Embedded AssessmentsCourse-Embedded Assessments

Collect the results of the assessment tools; Collect the results of the assessment tools; Analyze that aspect, across all Analyze that aspect, across all students, to see how successfully achieved it was by all students.students, to see how successfully achieved it was by all students.

Determine the level of student achievement as a result of the assessment Determine the level of student achievement as a result of the assessment tools and evaluate the achievement of course SLO; tools and evaluate the achievement of course SLO;

Make appropriate changes to the course content or curriculum if this is Make appropriate changes to the course content or curriculum if this is indicated by the assessment results. indicated by the assessment results.

Using the example below, let’s say you wanted to analyze punctuation Using the example below, let’s say you wanted to analyze punctuation across the entire class; you would see that punctuation fared pretty well…across the entire class; you would see that punctuation fared pretty well…while spelling seemed to miss the mark.while spelling seemed to miss the mark.

You can make this process as straightforward, or as rigorous as you want!You can make this process as straightforward, or as rigorous as you want!

Page 10: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

SLOs Assessment vs. GradesSLOs Assessment vs. GradesIdentified Learning Identified Learning

OutcomesOutcomesStudent 1Student 1 Student 2Student 2 Student 3Student 3 Student 4Student 4 Student 5Student 5 LearningLearning

OutcomeOutcomeAverageAverage

SpellingSpelling 33 44 11 22 33 2.62.6

GrammarGrammar 22 55 33 22 55 3.43.4

PunctuationPunctuation 44 55 22 33 44 3.63.6

StructureStructure 44 33 44 55 33 3.83.8

TOTALTOTAL 1313 1717 1010 1212 1515   

Individual Student Grade:Individual Student Grade: CC AA DD CC BB   

Assessment isn’t the same as assigning grades. Assessment isn’t the same as assigning grades. Grading standards might be vague, while assessment Grading standards might be vague, while assessment

information is very specific. information is very specific. Grades do not provide:Grades do not provide:

• Specific information about students’ performance on discrete tasksSpecific information about students’ performance on discrete tasks• Meaningful data across sectionsMeaningful data across sections• Objective student data which can be used for improvement of Objective student data which can be used for improvement of

student learning or recognition of student achievementstudent learning or recognition of student achievement• Grades alone do not give enough information on specific strengths Grades alone do not give enough information on specific strengths

and weaknesses of students.and weaknesses of students.

Page 11: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Considerations for Using Considerations for Using Embedded AssessmentEmbedded Assessment

Political considerations if selecting samples, e.g. Political considerations if selecting samples, e.g. Why me or my class?Why me or my class?

Incentives for faculty to be involved?Incentives for faculty to be involved?

Incentives for students?Incentives for students?

Course-embedded assessment can be labor Course-embedded assessment can be labor intensiveintensive

It is the most likely to produce real improvement It is the most likely to produce real improvement in the classroom.in the classroom.

Page 12: Using Embedded Assessment to Collect Evidence of Student Learning Using Embedded Assessment to Collect Evidence of Student Learning

Lets go and Embedded Lets go and Embedded Some Assessment Some Assessment