OUTCOMES OUTCOMES ASSESSMENTASSESSMENT
Developing and Implementing Developing and Implementing an Effective Planan Effective Plan
Principle 1. Outcome Principle 1. Outcome AssessmentAssessment Excellence in sport management Excellence in sport management
education is evaluated through education is evaluated through the assessment of student the assessment of student learning outcomes and learning outcomes and operational outcomes.operational outcomes.
Institution is required to have Institution is required to have developed and fully implemented developed and fully implemented an O/A process.an O/A process.
Creating the Outcomes Creating the Outcomes Assessment Plan Assessment Plan
1. Mission and Broad-Based Goals1. Mission and Broad-Based Goals
2. Student Learning Outcomes2. Student Learning Outcomes
3. Basic Skills Development3. Basic Skills Development
4. Student Personal Development4. Student Personal Development
5. Methods for Measuring 5. Methods for Measuring Effectiveness Effectiveness
Mission and Broad-Based Mission and Broad-Based GoalsGoals
Institution: Institution: Provide your institution’s Provide your institution’s approved mission & broad-based approved mission & broad-based goalsgoals
Sport Management Program: Sport Management Program: Provide Provide the approved broad-based goals for the approved broad-based goals for your sport management programyour sport management program
Measurement: Measurement: State how you will State how you will provide evidence that the goals are provide evidence that the goals are being accomplishedbeing accomplished
Student Learning Student Learning OutcomesOutcomes
What is a learning outcome?What is a learning outcome? Description of what Description of what
your students are your students are able to doable to do
Clear and Clear and measurablemeasurable
Related to the goals Related to the goals of the institution.of the institution.
Identify Identify measurement tools measurement tools you will use/Rubric you will use/Rubric designdesign
Institutional Goals
Program Learning Outcome
Communicate effectively both orally and written.
Comprehension and application of professional written and oral communication business skills.
Measure Attainment of Measure Attainment of Learning OutcomesLearning Outcomes
Identify a minimum of:Identify a minimum of:– two direct measurestwo direct measures– two indirect measurestwo indirect measures
Explain the process for how your Explain the process for how your measures will provide meaningful measures will provide meaningful resultsresults
Provide copies of your Provide copies of your instruments/rubrics in the appendixinstruments/rubrics in the appendix
Determine Measures and Determine Measures and Assessment ToolsAssessment Tools
Types of Measures:Types of Measures: Student Learning Outcomes (Direct)Student Learning Outcomes (Direct) Student Learning Outcomes (Indirect)Student Learning Outcomes (Indirect) Student Satisfaction (Indirect)Student Satisfaction (Indirect) Operational Effectiveness (Indirect)Operational Effectiveness (Indirect)
NoteNote: Two direct and two indirect : Two direct and two indirect measures are required.measures are required.
Direct MeasuresDirect Measures
Direct Measures:Direct Measures:DemonstratesDemonstrates direct evidence of direct evidence of
student learning student learning ExamplesExamples:: Comprehensive exams Comprehensive exams Standardized national exams Standardized national exams Pretest and posttest assessments Pretest and posttest assessments Portfolios Portfolios Capstone assessmentCapstone assessment
Pre/Post TestingPre/Post Testing
Develop test to address course content – Develop test to address course content – relate to CPC areasrelate to CPC areas
AdministrationAdministration– Embed within select courseEmbed within select course
Introduction to sport managementIntroduction to sport management Capstone seminarCapstone seminar
Set benchmarks for expected improvement Set benchmarks for expected improvement
Written & Oral Written & Oral Communication Communication AssessmentAssessmentWrittenWritten FormatFormat MechanicsMechanics GrammarGrammar Content Content OrganizationOrganization StyleStyle
Oral Oral CommunicationCommunication
Use of technologyUse of technology Presentation designPresentation design Speaks clearlySpeaks clearly EnthusiasmEnthusiasm Stays on topicStays on topic ContentContent Professional ImageProfessional Image
College Goals
Program Learning Outcome
Benchmark Measurement Tool
Communicate effectively both orally and written.
Comprehension and application of professional written and oral communication skills.
80% of the students will meet defined proficiency standards in writing skills using the writing rubric
80% of the students will meet defined proficiency standards in presentation skills using the presentation rubric
Written assignments in BU450 evaluated with Rubric
Presentations in BUS 311 evaluated with Rubric
Capstone Assessment Capstone Assessment
Capstone course measurements Capstone course measurements – Foundation courses used as a Foundation courses used as a
basis for instrument basis for instrument developmentdevelopment
Internship PortfolioInternship Portfolio Case studyCase study
Case Assessment - Case Assessment - Selection & Question Selection & Question DevelopmentDevelopment
Direct Measure – link to specific outcomeDirect Measure – link to specific outcome Define clear purposeDefine clear purpose
– What are you trying to measure?What are you trying to measure?– Broad range of outcomes vs. specific Broad range of outcomes vs. specific
areasareas Issues to considerIssues to consider
– Is the case comprehensive enough to Is the case comprehensive enough to address all areas being assessedaddress all areas being assessed
– Case selection for graduate and Case selection for graduate and undergraduate programsundergraduate programs
Case Selection & Question Case Selection & Question Development (cont.)Development (cont.)
Select Specific Learning OutcomeSelect Specific Learning Outcome– Demonstrate knowledge of the Demonstrate knowledge of the
fundamental principles of the sport fundamental principles of the sport management field. management field.
Cases and questions developed to Cases and questions developed to address this outcomeaddress this outcome
Questions tested, reviewed and refinedQuestions tested, reviewed and refined
Development Of Development Of Evaluation RubricEvaluation Rubric
Rubric developmentRubric development– Analysis of core sport management Analysis of core sport management
content areas and relevancy of content areas and relevancy of measurement through selected casemeasurement through selected case
– Evaluation criteria and weightings Evaluation criteria and weightings agreed uponagreed upon
Grading consistencyGrading consistency– TrainingTraining
Indirect MeasuresIndirect Measures
Indirect Measures:Indirect Measures:
Indirect evidence of student learning outcomes Indirect evidence of student learning outcomes (asking versus demonstrating)(asking versus demonstrating)
ExamplesExamples:: Internship evaluationsInternship evaluations National or program-specific student National or program-specific student
satisfaction surveys - NSSEsatisfaction surveys - NSSE Student SWOT analysisStudent SWOT analysis Alumni surveyAlumni survey
Basic Skills Basic Skills DevelopmentDevelopment Prepare a statement on the “Basic Prepare a statement on the “Basic
Skills” development program at your Skills” development program at your institutioninstitution
Describe how this is administered Describe how this is administered within the sport management dept.within the sport management dept.– Programs to help students with writing Programs to help students with writing
deficienciesdeficiencies– Tutoring servicesTutoring services
Personal Development Personal Development of Studentsof Students
Prepare a statement on the “Personal Prepare a statement on the “Personal Development” of students at your Development” of students at your institutioninstitution
Describe how this is administered within Describe how this is administered within your academic unityour academic unit– Special programs focused on personal Special programs focused on personal
development – student leadershipdevelopment – student leadership– First year seminarFirst year seminar
Measuring Program Measuring Program EffectivenessEffectiveness
Explain how you will measure the Explain how you will measure the effectiveness of your sport management effectiveness of your sport management programprogram
– Accomplishment of goals and objectives Accomplishment of goals and objectives in the strategic planin the strategic plan
– Retention dataRetention data– Graduation ratesGraduation rates– Teaching evaluationsTeaching evaluations– SWOTSWOT
Final Step – Action Final Step – Action PlansPlans
College Goals
Student Learning Outcomes
Benchmark Measurement Tool
Results Action Plan
Communicate effectively both orally and written.
Comprehension and application of professional written and oral communication business skills.
80% of the students meet proficiency standards in writing - measured using writing rubric
Written assignments
in BU210
and BU404
85.6% of the student in BU210 & BU404 met the standard
Continue to record scores for writing evaluation the these two courses.
Discuss the possibility of a standardized test in the core courses to meet this competency
Problem AreasProblem Areas
Direct measures – linking Direct measures – linking measure to specific outcomemeasure to specific outcome
Rubric development & data Rubric development & data collectioncollection– Go beyond use course gradesGo beyond use course grades
Role of teaching evaluationsRole of teaching evaluations