Sustaining Agronomy Sustaining Agronomy Outcomes AssessmentOutcomes Assessment

Michelle D. CookMichelle D. CookGraduate Research AssistantGraduate Research Assistantmcook@iastate.edumcook@iastate.eduMay 18, 2004May 18, 2004

Opening Go-RoundOpening Go-Round

Please tell us your name, area of Please tell us your name, area of specialty, and one personal or specialty, and one personal or professional goal you have for the professional goal you have for the summersummer

Workshop OverviewWorkshop Overview

Learning OutcomesLearning Outcomes Participants willParticipants will

Be aware of planned changes within courses based on Be aware of planned changes within courses based on TEACH Grant activitiesTEACH Grant activities

Be able to identify three changes that need to made in the Be able to identify three changes that need to made in the undergraduate curriculum as a result of the Alumni, undergraduate curriculum as a result of the Alumni, Employer, and Faculty Survey ReportEmployer, and Faculty Survey Report

Be aware of how and where Agronomy learner outcomes Be aware of how and where Agronomy learner outcomes are embedded in the curriculumare embedded in the curriculum

Understand their role in the proposed plan for systematic Understand their role in the proposed plan for systematic and continuous student outcomes assessmentand continuous student outcomes assessment

Workshop OverviewWorkshop Overview

Workshop ActivitiesWorkshop Activities TEACH GrantTEACH Grant Alumni, Employer, and Faculty SurveyAlumni, Employer, and Faculty Survey Curriculum MapCurriculum Map Proposed plan for systematic and Proposed plan for systematic and

continuous student outcomes assessmentcontinuous student outcomes assessment

TEACH Grant OverviewTEACH Grant Overview

PurposePurpose ActivitiesActivities Planned course changesPlanned course changes

CourseCourse Assignment or experienceAssignment or experience EnhancementEnhancement Feedback from colleaguesFeedback from colleagues

TEACH Grant ReflectionTEACH Grant Reflection

What assignment or experience would I What assignment or experience would I like to enhance in one of my classes?like to enhance in one of my classes?

What resources would I need in order to What resources would I need in order to improve an assignment or experience for improve an assignment or experience for my students?my students?

Alumni, Employer, and Alumni, Employer, and Faculty Survey ReportFaculty Survey Report

PurposesPurposes MethodsMethods

Samples: Alumni, Employers, and FacultySamples: Alumni, Employers, and Faculty Measures: Measures: Agronomy Alumni Survey, Agronomy Alumni Survey,

Agronomy Employer Survey, and Agronomy Employer Survey, and Undergraduate Teaching Faculty SurveyUndergraduate Teaching Faculty Survey

AnalysisAnalysis

Your perspective…Your perspective…

Agronomy Learner Outcomes

1.00

1.50

2.00

2.50

3.00

3.50

4.00

4.50

5.00

5.50

6.00

6.50

7.00

1.00 1.50 2.00 2.50 3.00 3.50 4.00 4.50 5.00 5.50 6.00 6.50 7.00

Importance

Pe

rfo

rma

nc

e

Which Learner Outcomes Which Learner Outcomes Have Higher Alumni Have Higher Alumni Performance?Performance?

Access and use electronic mailAccess and use electronic mail Prepare a resumePrepare a resume Communicate effective using electronic mediaCommunicate effective using electronic media Organize, manage, and communicateOrganize, manage, and communicate information information

using computer tools (three outcomes combined)using computer tools (three outcomes combined) Work effectively in a team situation as a participantWork effectively in a team situation as a participant Understand and use terminology appropriate to your Understand and use terminology appropriate to your

professionprofession Perform mathematical calculations appropriate to your Perform mathematical calculations appropriate to your

professionprofession Understand the soil as a resource upon which Understand the soil as a resource upon which

ecosystems, agriculture, and other land uses dependecosystems, agriculture, and other land uses depend

Which Learner Outcomes Which Learner Outcomes Have Lower Alumni Have Lower Alumni Performance?Performance?

Understand basic strategies for efficient and abundant Understand basic strategies for efficient and abundant production, production, harvest, and storageharvest, and storage of high-quality forage and pasture crops of high-quality forage and pasture crops (three outcomes combined)(three outcomes combined)

Understand basic technical principles and methods relating to Understand basic technical principles and methods relating to crop marketing methods and strategiescrop marketing methods and strategies

Construct an enterprise budgetConstruct an enterprise budget Understand agronomic practices used in other parts of the world Understand agronomic practices used in other parts of the world

in their political, cultural, and economic contextsin their political, cultural, and economic contexts Calculate and interpret a simple ANOVA, linear regression, and Calculate and interpret a simple ANOVA, linear regression, and

correlationcorrelation Understand basic technical principles and methods relating to Understand basic technical principles and methods relating to

crop storagecrop storage Access and use electronic bulletin boardsAccess and use electronic bulletin boards Value the humanities, arts, and recreation as meaningful activities Value the humanities, arts, and recreation as meaningful activities

that enrich our culturethat enrich our culture

Which Learner Outcomes Which Learner Outcomes Have Higher Importance?Have Higher Importance?

Understand and use terminology appropriate to your Understand and use terminology appropriate to your field of expertisefield of expertise

Demonstrate high standards of achievementDemonstrate high standards of achievement Work effectively in a team situation as a participantWork effectively in a team situation as a participant Demonstrate effective time managementDemonstrate effective time management Perform mathematical calculations appropriate to your Perform mathematical calculations appropriate to your

professionprofession Manage, organize, and interpretManage, organize, and interpret information using information using

computer tools (three outcomes combined)computer tools (three outcomes combined) Identify resources needed to solve a problemIdentify resources needed to solve a problem Answer oral questions extemporaneously and Answer oral questions extemporaneously and

understandablyunderstandably

Which Learner Outcomes Which Learner Outcomes Have Lower Importance?Have Lower Importance?

Understand basic strategies for efficient and abundant Understand basic strategies for efficient and abundant production, production, harvest, and storageharvest, and storage of high-quality forage and pasture crops of high-quality forage and pasture crops (three outcomes combined)(three outcomes combined)

Understand basic technical principles and methods relating to Understand basic technical principles and methods relating to crop marketing methods and strategiescrop marketing methods and strategies

Construct an enterprise budgetConstruct an enterprise budget Understand agronomic practices used in other parts of the world Understand agronomic practices used in other parts of the world

in their political, cultural, and economic contextsin their political, cultural, and economic contexts Calculate and interpret a simple ANOVA, linear regression, and Calculate and interpret a simple ANOVA, linear regression, and

correlationcorrelation Understand basic technical principles and methods relating to Understand basic technical principles and methods relating to

crop storagecrop storage Access and use electronic bulletin boardsAccess and use electronic bulletin boards Value the humanities, arts, and recreation as meaningful activities Value the humanities, arts, and recreation as meaningful activities

that enrich our culturethat enrich our culture

Which Learner Outcomes Which Learner Outcomes Are Important and Alumni Are Important and Alumni Performance Is High?Performance Is High?

Access and use electronic mailAccess and use electronic mail Communicate effectively using electronic mediaCommunicate effectively using electronic media Organize, manage, interpret, and communicateOrganize, manage, interpret, and communicate

information using computer tools (four outcomes information using computer tools (four outcomes combined)combined)

Access and use databasesAccess and use databases Understand basic soil principlesUnderstand basic soil principles Present an effective oral reportPresent an effective oral report Perform mathematical calculations appropriate to your Perform mathematical calculations appropriate to your

professionprofession

Which Learner Outcomes Which Learner Outcomes Are Important and Alumni Are Important and Alumni Performance Is Lagging? Performance Is Lagging?

Recognize a conflict of interest involving oneself and one’s client Recognize a conflict of interest involving oneself and one’s client or employeror employer

Propose and evaluate alternative solutions to a problem based on Propose and evaluate alternative solutions to a problem based on the resources of the clientthe resources of the client

Identify resources needed to solve a problemIdentify resources needed to solve a problem Assess and evaluate the credibility and biases of different sources Assess and evaluate the credibility and biases of different sources

of informationof information Debate issues in a professional mannerDebate issues in a professional manner Answer oral questions extemporaneously and understandablyAnswer oral questions extemporaneously and understandably Work effectively in a team situation as a leaderWork effectively in a team situation as a leader Define a problemDefine a problem Demonstrate high standards of achievementDemonstrate high standards of achievement Analyze and interpret simple research dataAnalyze and interpret simple research data

Which Learner Outcomes Which Learner Outcomes Are Unimportant and Alumni Are Unimportant and Alumni Performance High?Performance High?

Be able to use the metric system of weights and measuresBe able to use the metric system of weights and measures Access and use electronic bulletin boardsAccess and use electronic bulletin boards Acknowledge differences in political, cultural, religious, and ethic Acknowledge differences in political, cultural, religious, and ethic

beliefs and practicesbeliefs and practices Appreciate the family as an interdependent and supportive unitAppreciate the family as an interdependent and supportive unit Value the humanities, arts, and recreation as meaningful activities Value the humanities, arts, and recreation as meaningful activities

that enrich our culturethat enrich our culture Appreciate that our cultural diversity adds richness to our livesAppreciate that our cultural diversity adds richness to our lives Apply fundamental concepts of economics and the social sciences Apply fundamental concepts of economics and the social sciences

to human interaction and organizationto human interaction and organization Understand, in modern perspective, the basic principles important Understand, in modern perspective, the basic principles important

to sustained production and land useto sustained production and land use Understand agronomic practices used in other parts of the world Understand agronomic practices used in other parts of the world

in their political, cultural, and economic contextsin their political, cultural, and economic contexts Recognize the interdependence of economies, cultures, and Recognize the interdependence of economies, cultures, and

politics at all scales from local to internationalpolitics at all scales from local to international

Which Learner Outcomes Which Learner Outcomes Are Unimportant and Alumni Are Unimportant and Alumni Performance Is Lagging?Performance Is Lagging?

Understand basic technical principles and methods relating to crop Understand basic technical principles and methods relating to crop marketing methods and strategiesmarketing methods and strategies

Interpret laws and regulations as they related to agriculture and the Interpret laws and regulations as they related to agriculture and the environmentenvironment

Understand the structure and process of governments as they influence Understand the structure and process of governments as they influence agricultural policyagricultural policy

Recognize the potential effects of amelioration of stresses on plants at Recognize the potential effects of amelioration of stresses on plants at various stages of crop developmentvarious stages of crop development

Recognize options for amelioration of stresses with minimal disturbance Recognize options for amelioration of stresses with minimal disturbance to the environmentto the environment

Interpret a financial statementInterpret a financial statement Construct an enterprise budgetConstruct an enterprise budget Recognize common biotic stressesRecognize common biotic stresses Adopt a professional code of ethics such as A Federation of Certifying Adopt a professional code of ethics such as A Federation of Certifying

Boards in Agriculture, Biology, Earth, and Environmental Sciences Boards in Agriculture, Biology, Earth, and Environmental Sciences (ARCPACS) Code of Ethics(ARCPACS) Code of Ethics

Calculate and interpret a simple ANOVA, linear regression, and Calculate and interpret a simple ANOVA, linear regression, and correlationcorrelation

Critical Learner Critical Learner Outcomes in the Future?Outcomes in the Future?

Both Alumni and Employers: Communication Both Alumni and Employers: Communication Skills, Technical Skills, Problem Solving, Basic Skills, Technical Skills, Problem Solving, Basic Agronomic Knowledge, Business Skills, Agronomic Knowledge, Business Skills, Motivation, Understanding how government Motivation, Understanding how government policies and forces affect farmer actions, Ability policies and forces affect farmer actions, Ability react to real-world situationsreact to real-world situations

Employers: Computer SkillsEmployers: Computer Skills

Alumni: General Professional Issues, Practical Alumni: General Professional Issues, Practical Technical Knowledge, and “Hot Topics”Technical Knowledge, and “Hot Topics”

Knowledge Foundation, Knowledge Foundation, Career Advancement, and Career Advancement, and Adapt to ChangeAdapt to Change

Alumni rated their ability to adapt to change Alumni rated their ability to adapt to change significantly higher than did employerssignificantly higher than did employers

Both alumni and employers rated alumni Both alumni and employers rated alumni knowledge foundation as somewhat to mostly knowledge foundation as somewhat to mostly strongstrong

Alumni rated their aptitude for career Alumni rated their aptitude for career advancement as mostly strong while employers advancement as mostly strong while employers rated the same areas as somewhat strong (not rated the same areas as somewhat strong (not statistically significant)statistically significant)

Alumni Degrees, Alumni Degrees, Certifications, and Certifications, and Professional DevelopmentProfessional Development

Pursuing or have completed:Pursuing or have completed: Graduate education (26%)Graduate education (26%) Certified Crop Advisor certification (26%)Certified Crop Advisor certification (26%) Pesticide Applicator certificate (8%)Pesticide Applicator certificate (8%)

Participation in professional development Participation in professional development (42%)(42%) Professional organization membership and/or Professional organization membership and/or

meeting attendance, workshops and training, meeting attendance, workshops and training, continuing education, sales training, and field dayscontinuing education, sales training, and field days

Employer Professional Employer Professional Development ExpectationsDevelopment Expectations

Continuing EducationContinuing Education Workshops and trainingWorkshops and training Skill developmentSkill development Sales trainingSales training Keep current with changes and new conceptsKeep current with changes and new concepts Extension meetings and field daysExtension meetings and field days Read literatureRead literature Professional organization membership and/or Professional organization membership and/or

meeting attendancemeeting attendance Self-directedSelf-directed

Faculty PerceptionsFaculty Perceptions

Percentage of graduates comfortable hiringPercentage of graduates comfortable hiring Range of 10% to 90%Range of 10% to 90% M = 61.75%M = 61.75%

Reasons for hiringReasons for hiring Technical competence, strong work ethic, initiative, Technical competence, strong work ethic, initiative,

communication skills, leadership skills, critical thinking/problem communication skills, leadership skills, critical thinking/problem solving, and time managementsolving, and time management

Reasons for not hiringReasons for not hiring Poor work ethic, poor communication skills, marginal technical Poor work ethic, poor communication skills, marginal technical

knowledge/skills, lack of professional/personal ethics, shallow knowledge/skills, lack of professional/personal ethics, shallow depth of understanding, lack of critical thinking skills, and depth of understanding, lack of critical thinking skills, and attitudeattitude

AEF Survey Report AEF Survey Report ReflectionReflection

List three changes that will need to be List three changes that will need to be made in the curriculum as a result of this made in the curriculum as a result of this reportreport

Agronomy Curriculum Agronomy Curriculum MapMap

DescriptionDescription Group assignmentGroup assignment

Assign roles: facilitator, recorder, reporter/ Assign roles: facilitator, recorder, reporter/ timekeepertimekeeper

Review assigned learner outcomes Review assigned learner outcomes Technical KnowledgeTechnical Knowledge Professional SkillsProfessional Skills Perspective, Ethics/Values, and DiversityPerspective, Ethics/Values, and Diversity

As a group, review and answer questionsAs a group, review and answer questions Be prepared to report back to the larger groupBe prepared to report back to the larger group

DiscussionDiscussion

Report by groupReport by group Based on this discussion Based on this discussion

What changes should be made in the curriculum? What changes should be made in the curriculum? What changes should be made in the learner What changes should be made in the learner

outcomes?outcomes? As the undergraduate teaching facultyAs the undergraduate teaching faculty

What four outcomes would you like to focus on over What four outcomes would you like to focus on over the next academic year?the next academic year?

What embedded measures could be used to assess What embedded measures could be used to assess student achievement of the outcomes?student achievement of the outcomes?

What additional resources or support are necessary What additional resources or support are necessary for achieving these outcomes? for achieving these outcomes?

Personal ReflectionPersonal Reflection

As an individual faculty memberAs an individual faculty member What outcomes would you like to focus on in What outcomes would you like to focus on in

one or more in your classes?one or more in your classes? What embedded measures could be used to What embedded measures could be used to

assess student achievement of the assess student achievement of the outcome?outcome?

What additional resources or support are What additional resources or support are necessary for assessing these outcomes?necessary for assessing these outcomes?

Identify and Identify and document changes todocument changes to

curriculum, learnercurriculum, learneroutcomes, and measures outcomes, and measures

based on assessmentbased on assessmentresultsresults

Annually, share Annually, share results summary withresults summary with

appropriateappropriateaudiencesaudiences

Collect Collect departmental-departmental-

and course-leveland course-leveldatadata

Develop Develop measures to assess measures to assess

student’s achievement student’s achievement of the outcomesof the outcomes

SystematicSystematicAnd Continuous And Continuous

Outcomes Outcomes AssessmentAssessment

CalendarCalendar

SOASOACommitteeCommittee

Chair and CommitteeChair and Committee

Faculty Who TeachFaculty Who TeachTeaching PanelTeaching Panel

Department ChairDepartment ChairAgronomy FacultyAgronomy Faculty

Organizational Organizational ChartChart

Closing ReflectionClosing Reflection

How will you use the information How will you use the information presented today in your courses?presented today in your courses?

What aspect of sustaining Agronomy What aspect of sustaining Agronomy outcomes assessment do you need to outcomes assessment do you need to know more about?know more about?