November 13, 1999 http://www.uofs.edu/~beidler 1

Collecting Assessment DataCollecting Assessment Data

John BeidlerJohn Beidler

University of ScrantonUniversity of Scranton

Scranton, PA 18510Scranton, PA 18510

beidler@cs.uofs.edu

http://www.cs.uofs.edu/~beidler

Nicholas DeLilloNicholas DeLillo

Manhattan CollegeManhattan College

Bronx, NY 10471Bronx, NY 10471

ndelillo@manhattan.edu

November 13, 1999 http://www.uofs.edu/~beidler 2

Collecting Assessment DataCollecting Assessment Data(Sources)(Sources)

• StudentsStudents• Recent GraduatesRecent Graduates• AlumniAlumni• FirmsFirms

– Industry Advisory BoardIndustry Advisory Board

– RecruitersRecruiters

– Feed back requestsFeed back requests

• OthersOthers

November 13, 1999 http://www.uofs.edu/~beidler 3

Collecting Assessment DataCollecting Assessment Data(Verification)(Verification)

• No source of data is perfectNo source of data is perfect

• Potential BiasesPotential Biases– The instrument may be flawedThe instrument may be flawed– The approach may be flawedThe approach may be flawed

• Multiple sources provide verificationMultiple sources provide verification

November 13, 1999 http://www.uofs.edu/~beidler 4

Collecting Assessment DataCollecting Assessment Data(Feedback Loop)(Feedback Loop)

• You’ve collected itYou’ve collected it• You’ve evaluated itYou’ve evaluated it• Now what do you do Now what do you do

with itwith it– DiscussionDiscussion

– DecisionDecision

– ActAct

– AssessAssess

November 13, 1999 http://www.uofs.edu/~beidler 5

Student Exit Survey

• Goals• Process• Product• Results

November 13, 1999 http://www.uofs.edu/~beidler 6

Student Exit SurveyStudent Exit Survey(Goal)(Goal)

• Student perceptions ofStudent perceptions of– CurriculaCurricula

– CoursesCourses

– Laboratories/ResourcesLaboratories/Resources

– Academic ServicesAcademic Services

• CSAB CriteriaCSAB Criteria– AssessmentAssessment

– FacultyFaculty

– StudentsStudents

– CurriculumCurriculum

– Labs./ComputingLabs./Computing

– Support/ResourcesSupport/Resources

– FacilitiesFacilities

November 13, 1999 http://www.uofs.edu/~beidler 7

Student Exit SurveyStudent Exit Survey(Process)(Process)

• QuestionnaireQuestionnaire• AnonymityAnonymity

– Submit two itemsSubmit two items• Control sheet (name)Control sheet (name)

• Answer sheetAnswer sheet

– Secretary controlsSecretary controls

• Analysis after Analysis after graduationgraduation

November 13, 1999 http://www.uofs.edu/~beidler 8

Student Exit SurveyStudent Exit Survey(Product)(Product)

• Cover/Control SheetCover/Control Sheet• Demographic Demographic

InformationInformation– Degree program(CS,IS)Degree program(CS,IS)

– QPAQPA

• Courses/Curricula(10)Courses/Curricula(10)– Projects Course(2)Projects Course(2)

– Analysis and Design(1)Analysis and Design(1)

– Social/Ethical(1)Social/Ethical(1)

• Labs.(1) Labs.(1) • Oral/Written Skills(1)Oral/Written Skills(1)• Cognate Courses(2)Cognate Courses(2)• Advising(3)Advising(3)• Classrooms(1)Classrooms(1)• Miscellaneous(6)Miscellaneous(6)

November 13, 1999 http://www.uofs.edu/~beidler 9

Student Exit SurveyStudent Exit Survey(Results)(Results)

• Posted on our web sitePosted on our web site• http://www.cs.uofs.edu/http://www.cs.uofs.edu/

– See Assessment ResultsSee Assessment Results

– Get a copy of the questionnaireGet a copy of the questionnaire

• Discussed in Dept. MeetingDiscussed in Dept. Meeting• Need other sources to validateNeed other sources to validate

– Industry Day on Campus (Spring ‘00)Industry Day on Campus (Spring ‘00)

November 13, 1999 http://www.uofs.edu/~beidler 10

Survey Cover Sheet

NAME: _____________________________

Return the survey to Mrs Lynott in T483. Give this sheet to her. Place the survey in the enclosed envelope and place it in the survey box.

This sheet is used for tracking purposes only. The contents of the survey box will not be opened and tabulated until after graduation.

November 13, 1999 http://www.uofs.edu/~beidler 11

Survey Demographic Data

The following information is being collected as part of our on-going self-evaluation. This survey is designed for graduating Computer Science and Computer Information Systems majors for the purpose of obtaining feedback from students with the goal of improving our courses and degree programs. Your responses to this survey will remain anonymous. Results will be analyzed and reported in terms of group statistics and collected comments. Do not place your name on the form.

Major: Computer Information Systems [ ] Computer Science [ ]

Approximate overall GPA:____ Approximate GPA in major:____

November 13, 1999 http://www.uofs.edu/~beidler 12

Survey Instructions

For each statement that follows, please indicate your level of agreement. Space is provided for your comments that explain or clarify your answer. Use backs of sheets to continue comments (label by question number). While we are principally interested in the courses in the major and cognate, you may add comments on other courses at the university if you wish but please make clear to which courses you are referring.

November 13, 1999 http://www.uofs.edu/~beidler 13

Survey Sample Questions

1. I have learned a great deal in my major.

[ ]Strongly Disagree [ ] Disagree [ ] Not Sure [ ] Agree [ ] Strongly Agree

Comment:

2. I am well prepared for employment in my major.

[ ]Strongly Disagree [ ] Disagree [ ] Not Sure [ ] Agree [ ] Strongly Agree

Comment:

3. The work required for my major was

[ ] Too Difficult [ ] Difficult [ ] Reasonable [ ] Easy [ ] Too Easy

Comment:

November 13, 1999 http://www.uofs.edu/~beidler 14

Survey Sample Questions4. Faculty are readily available for assistance on course work.

[ ]Strongly Disagree [ ] Disagree [ ] Not Sure [ ] Agree [ ] Strongly Agree

Comment:

5. The quality of teaching in the major is good.

[ ]Strongly Disagree [ ] Disagree [ ] Not Sure [ ] Agree [ ] Strongly Agree

Comment: (name courses)

6. The computer labs that support the program are satisfactory for that purpose.

[ ]Strongly Disagree [ ] Disagree [ ] Not Sure [ ] Agree [ ] Strongly Agree

Comment: