Telephone Interviews Case Study: Restoring Rivers One Reach at a Time: Results from a Survey of U.S. River Restoration Practitioners Boris Bruk February

Telephone Interviews

Case Study: Restoring Rivers One Reach at a Time: Results from a Survey of U.S. River Restoration

Practitioners

Boris BrukFebruary 20, 2008


A telephone interview is a technique that allows administering a survey or a questionnaire orally.

One of the most frequently used methods of collecting information.

Usually relatively brief but allows collecting extensive information within a short period of time.


Establishing the atmosphere of trust and respect is important.

Research shows that respondents often provide more honest answers, when they are interviewed by phone.

GAO experts believe that “voice and verbal mannerisms are key factors in the success of the [telephone] interview.”

Telephone InterviewsOne of the technologies currently used by survey and

analysis centers is Computer Assisted Telephone Interviewing (CATI).

CATI combines the functions of interviewing, data entry, and data-cleaning.

Questions are displayed on the screen. The interviewer enters responses directly into the database.

Questions in the questionnaire are designed in accordance with specific guidelines for structured telephone surveys.

Advantages of Telephone Interviews

High speed of collecting information within a comparatively short period of time.

Individuals often provide more honest responses than the respondents of mail or face-to-face surveys.

Help obtain relatively high response rates.

May quickly cover broader geographic scope.

Advantages of Telephone Interviews

Often allow effective handling of unexpected events while collecting information.

Do not require extensive staff training.

The non-respondent problem is usually comparatively insignificant.

Disadvantages of Telephone Interviews

Instrument development takes relatively long time.

Costs may be significant.

Do not allow oral and visual communication, which can make it difficult to establish contact with the respondents.

Case Study: Restoring Rivers One Reach at a Time: Results from Survey

of U.S. River Restoration PractitionersBackground InformationRiver restoration: a range of activities aimed at

managing U.S. freshwaters. Over $1 billion is spent annually on river

restoration efforts.In 2001, the National River Restoration

Science Synthesis (NRRSS) working group was created.Purpose:

- to evaluate river restoration in the U.S. from a scientific perspective

- to determine the common elements of ecologically successful restoration projects

Case Study: Restoring Rivers One Reach at a Time: Results from Survey of U.S. River Restoration

Practitioners

37,000 records on river restoration projects from 800 data sources were compiled and incorporated into the NRRSS data-base.

ProblemsLack of detailed information on restoration

projects.

Only 10% of project records indicated any form of monitoring.


Practitioners

MethodsTelephone interviews to obtain detailed

information on randomly selected projectsThe interviews were based on information

entered in the NRRSS data-base

EligibilityProjects within the data-base, which (1) occurred

within one of 23 states contained in 7 regional nodes; (2) implemented b/n 1996-2002; (3) had info about the project contact; (4) listed at least one of selected project goals.


Practitioners

Process and ProceduresIdentified research questions (the role of

science in restoration; the extent and types of project evaluation; evaluation of success; lessons learned).

Designed the interview questionnaire Grouped questions by topic area Reduced the # of questions for the

interview not to exceed 30 minutesSubmitted the questionnaire for expert

review.


Practitioners

Process and ProceduresThe interview was pilot tested on one or

two project contacts from each node

Conducted additional working group meeting (eliminated redundant questions, rephrased confusing questions, etc.)

Submitted all required documents to IRB.


Practitioners

Process and ProceduresSent a 1-page summary of interview

themes and a confidentiality agreement to respondents (project managers).

Scheduled time for the interview.Interviews followed the common pattern.Questions allowed open-ended responses

that were then classified into specific categories.


Practitioners

Process and ProceduresAll data was entered in Microsoft Access

data-bases (7; 1 for each node).

The databases were then compiled into a single data-base.

All identifying information (names, project names, locations) was removed from the data-base.


Practitioners

ResultsObtained a high response rate: 75%.

Completed interviews with the coordinators of 317 river restoration projects.

50% indicated that projects were initiated because of the recognized need to address river degradation.


Practitioners

ResultsMost projects involved partnerships of 7 to 8

organizations + citizen groups.

Over 65% of project coordinators stated that their project was completely successful.

Optimistic view of the standard practice of river restoration in the U.S.


Practitioners

Results83% of respondents indicated that some

monitoring data had been collected.Importantly, the previous analysis of

written records showed that only 10% contained information about some monitoring framework.


Practitioners

Major Recommendations - Increase cost effectiveness of the river

restoration projects

- Improve project monitoring and information sharing

- Rigorous and coordinated monitoring of the key projects is needed.


Practitioners

Quality of the Case

/+/ Excellent case study to examine if you are interested in the process and procedures for conducting a telephone interview.

/- / Often confusing and hard to follow on the level of research project goals and results.

Thank You!

Documents

Telephone Interviews Case Study: Restoring Rivers One Reach at a Time: Results from a Survey of U.S. River Restoration Practitioners Boris Bruk February