16
Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 [email protected]

Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 [email protected]

Embed Size (px)

Citation preview

Page 1: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

Developing Surveys

John C. OryChris Migotsky

Center for Teaching Excellence249 Armory

3-3370 [email protected]

Page 2: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

Know your….

Topic

Respondents

Costs

Time

Purpose

Page 3: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

Survey Examples

Annual Campus Senior Survey

Proposed General Education Survey

Page 4: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

From 40 Suggestions …..About questions• “Is this question worth asking?”• Keep items short as possible• Avoid double-barreled wording

Rate the quality and value of the capstone course

• Focus response choices “Rate the quality of …” Use P-F-G-VG-EX rather than

“The capstone was excellent.” SD-D-A-SA

Page 5: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

• Balance your scales Poor Fair Good VG Excellent

• Decide on number of scale points4 or 5 or 6?

• Should you use “Neutral category” or “Don’t know”

• Place positive responses to right Poor=1, Fair=2, etc…

Page 6: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

About survey

• Make the questionnaire “eye-appealing”professional with plenty of white space

• Group items into logically coherent sections

• Avoid putting important items at the end

• Do you need demographics?

Page 7: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

GETTING RESPONSES

Phase I: Getting their attention

• If your survey arrives in style, it may not get tossed in trash

• If your survey appears seductive, the respondent may be attracted

• If your survey appeals to a basic value,, it may get read.

• If your survey arrives at the right time, it has a chance of being completed

Page 8: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

Phase II: Keeping their attention

• If the students know what it is for and why it is important, they may want to respond

• If you give them something for their effort, they may expend the effort to respond

• If it is easy to complete, it might get completed• If you ask questions that “grab” students, you

might get responses

Page 9: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

Phase III: Getting their feedback

• If you keep it confidential, they may feel “safe” to respond

• If you make it easy to return, you might get it back

• If you follow-up, you even can get a better return rate

Page 10: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

E-mails and Cover Letters

• Date letter or e-mail of the day it actually goes out• Use letterhead when possible• Personalize salutation• Explain purpose

• Describe who is sponsoring• Provide name and phone for further info• Consider sending advance e-mail or letter• Consider other methods to publicize survey

Page 11: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

• Explain how respondents were chosen

• Explain how and when to return survey• Describe incentives• Provide a realistic time required to complete survey• Explain how the confidentiality of the respondent and

data will be protected• Identify deadline for returning

Page 12: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

How to get 75% Return

4 mailings 2 weeks apart = 40+20+10+5

Send complete package on 1st and 3rd mailings (cover letter, questionnaire, envelope with stamp)

Send reminder cards on 2nd and 4th mailings

E-mails or Cover letters are different:

1st thorough content2nd gentle and friendly reminder3rd emphasize confidentiality and stress importance4th set a final deadline

Page 13: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

A handy campus tool for developing electronic surveys -

Public Affairs’ Web Services Toolbox

Presented by Chris Migotsky

Page 14: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

Web Surveys in the Toolboxhttp://www.webservices.uiuc.edu

Info

Page 15: Developing Surveys John C. Ory Chris Migotsky Center for Teaching Excellence 249 Armory 3-3370 ory@uiuc.edu

Main Toolbox Page