View
216
Download
2
Tags:
Embed Size (px)
Citation preview
HUNTER COLLEGE ADMINISTRATIVE ASSESSMENT TRAINING SESSION 2009-2010
What is Administrative Assessment
•An organizational practice that evaluates administrative services to promote the continuous improvement of the college and to influence planning and budgeting decisions.
Administrative Assessment at Hunter College
Why Assess?1. Achieve Hunter College goals for
Recruitment, Retention, and Graduation of students.
2. Promote the continuous improvement of Hunter College as an institution of higher education.
3. Ensure the accountability of the college departments.
4. Aid in resource and budget allocations.
Administrative Assessment at Hunter College
Assessment at Hunter •Assessment at Hunter is already in
place. •Our goal is to formalize it.
Administrative Assessment at Hunter College
How assessment works
•Who is responsible for Assessment?▫Departments and Programs:
Complete actual assessment practices and reporting.
Directors document assessment on Department Assessment Report online. http://ww3.hunter.cuny.edu/coo/view.php?id=1
Administrative Assessment at Hunter College
How assessment works
• Who is responsible for Assessment?▫Assessment Subcommittees:
Help directors create department assessment plans. Review assessment plans and end reports that are
submitted online. Seven subcommittees in assessment (B.L.A.S.T.E.R.):
Barfit Libraries Advising Scholarship Technology Enterprise Resource
Administrative Assessment at Hunter College
How assessment works
Who is responsible for Assessment? Administrative Assessment Committee (AAC):
Steering committee for Administrative Assessment. Informs subcommittees on large goals of the college
for assessment. Reports to the President at the end of each
assessment cycle.
Administrative Assessment at Hunter College
Administrative Assessment
Committee
Assessment Subcommitte
e
Department/ Program
Assessment Subcommitte
e
AAC identifies broad assessment goals and informs subcommittees
Directed by the AAC, subcommittees work with directors to create a departmental assessment plans.
Departments/Programs complete assessment process and submit completed assessment forms for review and evaluation to subcommittees
Subcommittees summarize and report departmental assessments to AAC
President
College President and CUNY PMP inform AAC on yearly goals and objectives.
AAC gives annual report to College President which informs the next year's CUNY PMP goals and objectives
Assessment Workflow
Administrative Assessment at Hunter College
Documenting Assessment
•The Department Assessment Report:▫Subcommittees work with Directors to
create the Department Assessment Plan (Goals through Timeline).
▫Directors with their departments complete the assessment process (Outcomes through Follow-Up).
▫The Department Assessment Report is completed online at: http://ww3.hunter.cuny.edu/coo/view.php?id=
1
Administrative Assessment at Hunter College
Documenting Assessment HUNTER MISSION GOALS
GOALS Objectives Strategies to Meet Objectives
Assessment Method
Timeline Outcomes / Results
Feedback and Follow-Up
What is the main over arching Hunter goal that the assessment aims to achieve?
Recruitment
Retention
Graduation
PMP Objective
What does the department/ program do to meet the goals --- what practices are currently in place
What is done to meet the objective – how does the department meet the objective (already in place)
How will this practice (objective) be assessed – what tools are used to see if the objective is working
When/how often will assessment take place
What does the data say
Analysis of the data – expected outcomes, successes, weaknesses
Administrative Assessment at Hunter College
Documenting Assessment• Hunter Mission Goals
▫ Recruitment, Retention, Graduation• Goals
▫ PMP Objective• Objectives
▫ What are you doing to meet the PMP Objective?• Strategies to Meet Objectives
▫ How do you meet the department objective? • Assessment Method
▫ How will you assess the strategies in place?• Timeline
▫ When and how often does assessment take place?• Outcomes /Results
▫ What does the assessment show? What is the data?• Feedback and Follow-Up Recommendations
▫ Analysis of the data
Administrative Assessment at Hunter College
Documenting Assessment: Hunter Mission Goals
•Hunter Mission Goals are large, long-term, and general goals.
•These goals are Recruitment, Retention, and Graduation of students.
•Each assessment practice should be directed at one or more of these larger goals.
Administrative Assessment at Hunter College
Documenting Assessment:Goals•Goals refer directly to the PMP objectives. •These goals are more specific to Hunter
College and the CUNY system. •Each assessment practice must aim to reach
one of the PMP objectives as its goal.
Administrative Assessment at Hunter College
Documenting Assessment: Goals
Administrative Assessment at Hunter College
PMP OBJECTIVES = ASSESSMENT GOALS
1. Strengthen CUNY Flagship and college priority programs, and continuously update curricula and program mix
2. Attract and nurture a strong faculty that is recognized for excellent teaching, scholarship and creative activity
3. Ensure that all students receive a quality general education and effective instruction
4. Increase retention and graduation rates and ensure students make timely progress toward degree completion
5. Improve postgraduate outcomes 6. Improve quality of student academic support services7. Increase or maintain access and enrollment; facilitate
movement of eligible students to and among CUNY campuses
8. Increase revenues and decrease expenses 9. Improve administrative services
Documenting Assessment:Objectives•Objectives are short-term,
measurable, and specific goals. •Objectives can reflect the quality of a
service, the quantity of a service, or the learning outcome of a service.
•Example: ▫ Department/Program: AccessABILITY▫ Hunter Mission Goal: Retention▫ Goal: Increase retention and graduation rates and ensure
students make timely progress toward degree completion (4).
▫Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students meet with academic advisor.
Administrative Assessment at Hunter College
Documenting Assessment: Strategies•Strategies are the practices that are
currently being done to achieve the objective.
•Example: ▫ Department/Program: AccessABILITY▫ Hunter Mission Goal: Retention▫ Goal: Increase retention and graduation rates and ensure
students make timely progress toward degree completion (4).▫ Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students
meet with academic advisor.
▫Strategy: Collaborative program/referral with Advising Services; SIMS to ID students; multi-medium communications.
Administrative Assessment at Hunter College
Documenting Assessment: Method• Method of assessment is the process by which
assessment is completed. • Method of assessment outlines how data is
collected and analyzed.• Example:
▫ Department/Program: AccessABILITY▫ Hunter Mission Goal: Retention▫ Goal: Increase retention and graduation rates and ensure
students make timely progress toward degree completion (4).▫ Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students
meet with academic advisor.▫ Strategy: Collaborative program/referral with Advising
Services; SIMS to ID students; multi-medium communications.
▫Method: Program attendance records; SIMS data (GPAs).
Administrative Assessment at Hunter College
Documenting Assessment: Timeline• The Timeline outlines when and for how
long assessment will take place. • Example:
▫ Goal: Increase retention and graduation rates and ensure students make timely progress toward degree completion (4).
▫ Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students meet with academic advisor.
▫ Strategy: Collaborative program/referral with Advising Services; SIMS to ID students; multi-medium communications.
▫ Method: Program attendance records; SIMS data (GPAs).
▫Timeline: Assessment process begins November, 2009 Data Collection completed by March, 2010 Data analysis complete by May, 2010 Follow-up completed by June, 2010.
Administrative Assessment at Hunter College
Documenting Assessment: Outcomes• Outcomes are the data results. • These results should be summarized for each
assessment. • Example:
▫ Goal: Increase retention and graduation rates and ensure students make timely progress toward degree completion (4).
▫ Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students meet with academic advisor.
▫ Strategy: Collaborative program/referral with Advising Services; SIMS to ID students; multi-medium communications.
▫ Method: Program attendance records; SIMS data (GPAs).▫ Timeline: Assessment process begins November, 2009, Data
Collection completed by March, 2010, Data analysis complete by May, 2010, Follow-up completed by June, 2010.
▫Outcomes: XX% of at-risk registered students met with advisors
Administrative Assessment at Hunter College
Documenting Assessment: Follow-Up• Follow-Up is the data analysis step in the assessment
process. • The Follow-Up stage answers the questions: What is the
data saying? What lessons does the data teach us? What improvements can be made? Did the assessment provide an answer for the objective? Did we reach the objective?
• Example: ▫ Strategy: Collaborative program/referral with Advising Services; SIMS to
ID students; multi-medium communications.▫ Method: Program attendance records; SIMS data (GPAs).▫ Timeline: Assessment process begins November, 2009, Data Collection
completed by March, 2010, Data analysis complete by May, 2010, Follow-up completed by June, 2010.
▫ Outcomes: XX% of at-risk registered students met with advisors
▫Follow-Up: Query non-participants re: reasons of non attendance; modify program/ communication outreach, as needed
Administrative Assessment at Hunter College
Examples of Department Assessment Plan
AREA GOAL OBJECTIVE STRATEGY METHOD TIMELINE OUTCOME FOLLOWUP
AccessABILITY Increase Retention
50% of at-risk (2.0 -2.5 GPA) ”registered” students meet with academic advisor
Collaborative program/referral with Advising Services; SIMS to ID students; multi- medium communications
Program attendance records; SIMS data (GPAs)
Fall 2009 - Spring 2010
XX% of at-risk registered students who met with advisors
Query non-participants re: reasons of non-attendance; modify program/ communication outreach, as needed
Administrative Assessment at Hunter College
Examples of Department Assessment Plan
AREA GOAL OBJECTIVE STRATEGY METHOD TIMELINE OUTCOME FOLLOWUPCareer Development Services
Increase Post Graduate Outcome
XX% increased use of NACELink Symplicity ) and Optimal Resume systems (i.e., # of on-campus recruitment programs
Multi- medium communications to promote systems
NACElink Symplicity and Optimal Resume systems data
Fall 2009- Summer 2010
XX% increase in usage
Coordinate with Alumni Relations and Institutional Advancement to track student job placements
Administrative Assessment at Hunter College
What to assess?
•Assessment Practices Already in Place?▫Continue your assessment. Document
it in the Department Assessment Report.
•New to Assessment? ▫Look at what you currently do. Look to
see if you are achieving your mission goals and set tasks.
Administrative Assessment at Hunter College
Qualities of Good Assessment• Choose projects that are able to be assessed:
▫ Manageable projects.▫ Reasonable requirement of human and time resources.▫ Easily attainable data.▫ Cost-effective.
• Choose projects that are most important to the department or program.
• Choose projects that reflect the college goals of Recruitment, Retention, and Graduation.
• Choose projects that can influence budget and planning decisions.
• Choose projects that can provide valuable answers.• Choose projects that can better define problems or change
initiative plans.
Administrative Assessment at Hunter College
Types of Assessment•What can you measure?
▫Quality: Effectiveness, efficiency or quality of a service. Example: How accessible advisors are to students.
▫Quantity: Number of activities, events, students, benchmarks, entries, processes. Example: The number of students who meet with
advisors. ▫Learning Outcomes: knowledge and
comprehension. Example: Student awareness of health precautions.
Administrative Assessment at Hunter College
Types of Assessment
•Methods of Assessment:▫Surveys ▫Data records▫Committees▫Interviews▫Manager feedback▫Focus groups
Administrative Assessment at Hunter College
Schedule of Assessment
•The schedule is created each year by the AAC. It will be distributed to all Assessment participants.
•The schedule will be made available on the Administrative Assessment Website.
•Assessment Cycles begin right before the fall semester.
•Department Assessment Reports are due in June after graduation.
Administrative Assessment at Hunter College
Assessment Resources• At Hunter
▫ Office of Institutional Resource. http://www.hunter.cuny.edu/institutional-research/assessment-resources-1
▫ CUNY Office of Institutional Research Homepage. http://owl.cuny.edu:7778/portal/page/portal/oira/OIRA_HOME
▫ CUNY Student Experience Survey 2008. http://owl.cuny.edu:7778/portal/page/portal/oira/OIRA_HOME/SES_2008_Final_Report.pdf
▫ Hunter Internal Control Report. Internal Control Reports can be found at the Office of Budget and Planning.
▫ Library Task Force Report 2007. http://www.hunter.cuny.edu/middle-states/repository/files/standard-11/President-Library-Task-Force-2007.pdf
▫ IT Status Report 2008. http://www.hunter.cuny.edu/middle-states/repository/files/standard-2/IT%20Status%20Report%20-%20Nov%202008.pdf
▫ CUNY Faculty Experience Survey 2005. http://www.hunter.cuny.edu/middle-states/repository/files/standard-7/Hunter%20Faculty%20CUNY.pdf
Administrative Assessment at Hunter College
Assessment Resources• Literature on Assessment
▫ Astin, Alexander W. (1990) Assessment for Excellence: The Philosophy and Practice of Assessment and Evaluation in Higher Education, American Council on Education: Series on Education, Oryx Press. http://books.google.com/books?hl=en&lr=&id=Sp7zIMokH00C&oi=fnd&pg=PR9&dq=administrative+evaluation+of+higher+education&ots=4-GajfZcmS&sig=ypxk30n0dsIl0HSsgEXossciGV8#PPP1,M1
▫ Banta, Trudy W. (2007). An Accountability Program Primer for Administration. Recruitment & Retention in Higher Education, Vol. 21 Issue 10, p1-3, 3p; (AN 27339631)
▫ Banta, Trudy W., Lund, J.P. Black, K.E. & Oblander, F.W. (1996). Assessment in practice: Putting principles to work on college campuses. San Francisco: Jossey-Bass.
▫ Cox, Kelline S. and Downey, Ronald G. (2002) Resurgence of Administrative Evaluations and Unit Climate Surveys to Improve and Strengthen Institutional Leadership. Association for Institutional Research. Toronto, Canada, www.k-state.edu/pa/researchinfo/papers/adminevalpaper.doc
▫ Heck, Ronald H., Johnsrud, Linda K. and Rosser, Vicki J. (2000) Administrative Effectiveness in Higher Education: Improving Assessment Procedures. Research in Higher Education. Vol. 41, No. 6, 2000, http://www.springerlink.com/content/hmnr32v1390h71x1/fulltext.pdf
▫ Jennings Jr., Edward T. (1989). Public Administration Review, Vol. 49 Issue 5, p438, 9p, 1 bw; (AN 4589815) http://web.ebscohost.com/ehost/pdf?vid=17&hid=5&sid=91536058-d2d3-42d3-9963-e9bb6fc0c95e%40sessionmgr10
▫ Kotler, Philip and Murphy, Patrick E., Strategic Planning for Higher Education. The Journal of Higher Education, Vol. 52, No. 5 (Sep. - Oct., 1981), pp. 470-489. Ohio State University Press. http://www.jstor.org/stable/1981836?cookieSet=1
▫ Wergin, J. and Braskamp, L.A. (eds.) (1987). Evaluation of Campus Services and Programs. San Francisco, CA: Jossey-Bass.
Administrative Assessment at Hunter College
Assessment Resources• Good Practices Resources
▫Linda Suskie, Middle States Association of Colleges and Schools: Commission on Higher Education (MSA-CHE). 2006. http://planning.iupui.edu/page/download/?key=129728430&path=/consult/conferences/national/06/handouts/monday/suskie.pdf
▫Middle States Report and Requirements - http://www.hunter.cuny.edu/middle-states/institutional-assessment
Administrative Assessment at Hunter College
More information
•For more information on Administrative Assessment at Hunter College, please visit the website. ▫http://www.hunter.cuny.edu/adminassessme
nt
Administrative Assessment at Hunter College