Embed Size (px)
Citation preview
BENCHMARKINGBENCHMARKING
Not everything that can be counted counts,and not everything that counts
can be counted.
-Sign hanging in Albert Einstein’s office at Princeton
The Accountability EnvironmentThe Accountability Environment
nn Results Based BudgetingResults Based Budgeting
nn Strategic PlanningStrategic Planning
nn Audits of state business practices and stateAudits of state business practices and stateagenciesagencies
nn Governor’s Office of EducationalGovernor’s Office of EducationalAccountabilityAccountability
nn Board leadership in Benchmarking andBoard leadership in Benchmarking andAccountabilityAccountability
Benchmarking StudyBenchmarking StudyObjectivesObjectives
nn Increase System and institutionalIncrease System and institutionaleffectiveness and efficiencyeffectiveness and efficiency
nn Develop baseline for future System andDevelop baseline for future System andinstitutional performance evaluationinstitutional performance evaluation
nn Start a process to support the Governor’sStart a process to support the Governor’sand Regents’ long-term accountabilityand Regents’ long-term accountabilityagendaagenda
Selection of IndicatorsSelection of IndicatorsModelsModels
nn Input, process, outcomeInput, process, outcome–– value added to departing studentsvalue added to departing students
nn Resource efficiency and effectivenessResource efficiency and effectiveness–– use of resourcesuse of resources
nn State need and return on investmentState need and return on investment–– workforce preparation and trainingworkforce preparation and training
nn Customer need and return on investmentCustomer need and return on investment–– impact on individual needs (earning potential)impact on individual needs (earning potential)
Selection of IndicatorsSelection of IndicatorsStudy ApproachStudy Approach
nn Best practices identified by expertsBest practices identified by experts
nn Other states’ use of indicatorsOther states’ use of indicators
nn Professional associations’ benchmarkingProfessional associations’ benchmarking
nn Availability of dataAvailability of data
ComparatorComparator Institutions Institutions
nn Research UniversitiesResearch Universities 4848
nn Regional & State UniversitiesRegional & State Universities 6060
nn State CollegesState Colleges 3030
nn Two-Year CollegesTwo-Year Colleges 5757
Section of Section of ComparatorsComparators
nn Criterion variablesCriterion variables
nn Selection (mission-related) variablesSelection (mission-related) variables
nn Factor AnalysisFactor Analysis–– Factor ScoresFactor Scores
–– Distance ScoresDistance Scores
nn Inclusion of institution-specific peersInclusion of institution-specific peers
Categories of IndicatorsCategories of Indicators
nn AcademicAcademic
nn Financial/AdministrativeFinancial/Administrative
nn Economic Development/ResearchEconomic Development/Research
Academic IndicatorsAcademic Indicators3 Groups3 Groups
1.1. Who our students areWho our students are
2. How the University2. How the UniversitySystem serves themSystem serves them
3. How successful and3. How successful andsatisfied they aresatisfied they are
Academic Indicators Group 1Academic Indicators Group 1Who our students areWho our students are
nn Enrollment by Level and Race/EthnicityEnrollment by Level and Race/Ethnicity
nn Percent of Students who are Part TimePercent of Students who are Part Time
nn Average SAT Composite Score of EnteringAverage SAT Composite Score of EnteringStudentsStudents
nn Percent of Entering Freshmen inPercent of Entering Freshmen inDevelopmental/Learning Support CoursesDevelopmental/Learning Support Courses
nn Average GRE, GMAT, LSAT, MCAT andAverage GRE, GMAT, LSAT, MCAT andVAT Scores of Entering StudentsVAT Scores of Entering Students
nn Freshman to Sophomore Retention RatesFreshman to Sophomore Retention Rates
nn Percent of Undergraduate Credit HoursPercent of Undergraduate Credit HoursTaught by Tenured/Tenure Track FacultyTaught by Tenured/Tenure Track Faculty
nn Graduation Rates by Race/EthnicityGraduation Rates by Race/Ethnicity
Academic IndicatorsAcademic IndicatorsGroup 2Group 2How we serve themHow we serve them
Academic IndicatorsAcademic IndicatorsGroup 3Group 3Success and SatisfactionSuccess and Satisfaction
nn Percent of Entering Freshmen who CompletePercent of Entering Freshmen who CompleteAssociate Degrees or Transfer to 4-Year ProgramAssociate Degrees or Transfer to 4-Year Program
nn Percent of Graduates Employed or PursuingPercent of Graduates Employed or PursuingFurther Education Within 1 Year of GraduationFurther Education Within 1 Year of Graduation
nn Performance of Graduates on GRE andPerformance of Graduates on GRE andProfessional School Entrance ExamsProfessional School Entrance Exams
nn Measures of student, alumni, employerMeasures of student, alumni, employersatisfactionsatisfaction
Financial/AdministrativeFinancial/AdministrativeIndicatorsIndicators
nn Unrestricted State Appropriations Plus TuitionUnrestricted State Appropriations Plus TuitionRevenues Per FTE StudentRevenues Per FTE Student
nn Institutional Support Expenditures as aInstitutional Support Expenditures as aPercentage of Total E&G ExpendituresPercentage of Total E&G Expenditures
nn Unrestricted Instruction and Instruction-Unrestricted Instruction and Instruction-Related Expenditures per FTE StudentRelated Expenditures per FTE Student
nn Private GivingPrivate Giving
Economic DevelopmentEconomic Developmentand Research Indicatorsand Research Indicators
Economic DevelopmentEconomic Development
nn Job Placement Rates of Students inJob Placement Rates of Students inOccupational/Vocational ProgramsOccupational/Vocational Programs
nn Annual Continuing Education Programs andAnnual Continuing Education Programs andContracts for Workforce TrainingContracts for Workforce Training
nn Formal Ties to Business and IndustryFormal Ties to Business and Industry
Economic DevelopmentEconomic Developmentand Research Indicatorsand Research Indicators(continued)(continued)
ResearchResearch::
nn Sponsored Research ExpendituresSponsored Research Expenditures
per Full-Time Faculty Memberper Full-Time Faculty Member
nn Percent of Full-Time FacultyPercent of Full-Time Faculty
Receiving Externally Sponsored FundsReceiving Externally Sponsored Funds
nn Annual Income from PatentsAnnual Income from Patents
Statistics are like bikinis.
What they reveal is suggestive, butwhat they conceal is vital.
- Aaron Levenstein
Indicators are inter-related.Indicators are inter-related.No single indicator tells the whole storyNo single indicator tells the whole story..
ExamplesExamples::
nn 4-year Graduation Rates and4-year Graduation Rates and
Part-time StudentsPart-time Students
nn 4-year Graduation Rates and4-year Graduation Rates and
6-year Graduation Rates6-year Graduation Rates
What is a Normative Range?What is a Normative Range?
0
1
2
3
4
5
6
0 - 25 25 - 50 50 - 75 75 - 100
Our Analysis will focus on Our Analysis will focus on OutliersOutliers..
nn Which campuses are outside the range?Which campuses are outside the range?
nn Why?Why?
nn What can we learn - inside and outside USGWhat can we learn - inside and outside USG- about best practices?- about best practices?
nn How else could we improve performance?How else could we improve performance?
Indicators Reviewed in OctoberIndicators Reviewed in October
nn SAT Scores of Entering FreshmenSAT Scores of Entering Freshmen
nn Race & Gender of StudentsRace & Gender of Students
nn Part-Time StudentsPart-Time Students
nn Unrestricted State/Local Appropriations &Unrestricted State/Local Appropriations &Tuition Revenues per FTE StudentTuition Revenues per FTE Student
850 900 950 1000 1050 1100 1150 1200 1250 1300 1350
Two-Year Peers
Reg./State U. Peers
UGA Peers
G S U P e e r s
G I T P e e r s
SAT Normative RangeSAT Normative RangeInstitutional/Sector PeersInstitutional/Sector Peers
GIT Peers
GSU Peers
UGA Peers
Regional/State Peers
Insufficient Data
Race/Ethnicity ofRace/Ethnicity ofUndergraduates: GITUndergraduates: GIT
3.9
9.2
0.2
11.5
2.8
72.4
0 20 40 60 80 100
Non-Res. Alien
African-Amer./Non-Hisp.
Native American
Asian
Hispanic
White/Non-Hisp.
Above Normative Range
Race/Ethnicity ofRace/Ethnicity ofUndergraduates: GSUUndergraduates: GSU
2.2
30.9
0.3
8.4
2.8
55.3
0 20 40 60 80 100
Non-Res. Alien
African-Amer./Non-Hisp.
Native American
Asian
Hispanic
White/Non-Hisp.
Above Normative Range
Race/Ethnicity ofRace/Ethnicity ofUndergraduates: UGAUndergraduates: UGA
1.1
6.4
0.2
3
1.1
88.3
0 20 40 60 80 100
Non-Res. Alien
African-Amer./Non-Hisp.
Native American
Asian
Hispanic
White/Non-Hisp.
Within Normative Range
0 10 20 30 40 50 60 70 80 90 100
Two-Year Peers
State Colleges
Reg./State U. Peers
UGA Peers
GSU Peers
GIT Peers
Part-Time UndergraduatesPart-Time UndergraduatesNormative Range of PeersNormative Range of Peers
GIT Peers
GSU Peers
UGA Peers
Regional/State Peers
Two-Year College Peers
State College Peers
0 5,000 10,000 15,000 20,000 25,000
GSU
GT
UGA
Appropriations and Tuition RevenuesAppropriations and Tuition RevenuesPer FTE StudentPer FTE Student
Research Universities and PeersResearch Universities and Peers
Peers
Peers
Peers
MCG is well within range at 54,827
0 2,000 4,000 6,000 8,000 10,000 12,000 14,000
CSU
S S U
S P S U
Normative Peers
Appropriations and Tuition RevenuesAppropriations and Tuition RevenuesPer FTE StudentPer FTE Student
Regional & State UniversitiesRegional & State Universities
0 2,000 4,000 6,000 8,000 10,000
Macon State
Dalton
Appropriations and Tuition RevenuesAppropriations and Tuition RevenuesPer FTE StudentPer FTE Student
State Colleges and PeersState Colleges and Peers
Normative Peers
0 2,000 4,000 6,000 8,000 10,000
Appropriations and Tuition RevenuesAppropriations and Tuition RevenuesPer FTE StudentPer FTE Student
Two Year College SectorTwo Year College Sector
Two Year Peers – Uncertain Data
USG Two-Year Average $7,667
Issues for Further ConsiderationIssues for Further Considerationand Board Strategic Planningand Board Strategic Planning
1.1. Revisit Regional and State SAT data after fullRevisit Regional and State SAT data after fullimplementation of admissions policyimplementation of admissions policy
2.2. Work with Work with HBCUs HBCUs to continue progress on SATto continue progress on SATscores.scores.
3.3. Opportunity for improvement in two sectors in Opportunity for improvement in two sectors inminority enrollmentminority enrollment
4.4. Address issue of low enrollment for African - Address issue of low enrollment for African -American males.American males.
5.5. Look further into how well USG institutions meet Look further into how well USG institutions meetneeds of part time and other non-traditional students.needs of part time and other non-traditional students.
Issues for Further ConsiderationIssues for Further Considerationand Board Strategic Planningand Board Strategic Planning
6.6. Further review financial data and include Further review financial data and includeamong variables considered in developingamong variables considered in developingannual allocation recommendations.annual allocation recommendations.
7.7. Study relationship between enrollment of Study relationship between enrollment of partparttime students and the funding per FTE student.time students and the funding per FTE student.
Board Schedule forBoard Schedule forBenchmarking AnalysisBenchmarking Analysis
October Who Our Students Are
How States Fund Higher Education
November Retention and Graduation
Financial Data
January How Institutions Function – Management Review
February Graduate/Professional School, Employment andBeyond
March Economic Development
April Research
May Board Retreat
Developing Plans for Further Study and Action
June Finalize and Approve Action Plans
All of the most important decisionsAll of the most important decisionsare based on insufficient data.are based on insufficient data.
- Sheldon - Sheldon KoppKopp
