… what did Delaware do?

… what did Delaware do?

Ensuring representative sample for Family Survey….

2

The Basics

Already had existing Family Survey in place

OPEC (Ongoing Program Evaluation Committee) provided guidance on survey creation and modifications

Updated questions now include those that align with Federal Outcomes

3

The Basics

Letters mailed to explain Family Survey

Postcard reminder sent

Up to four attempts made to survey families via phone

For those families with no phone– surveys are hand-delivered by Service Coordinators

4

The Basics

Initially conducted through telephone survey. Starting this year, survey can be accessed by families through Survey Monkey (in English and Spanish), or may respond through telephone survey (surveyors made up to four attempts), or hand delivered by Service Coordinators

University of Delaware conducts survey and analyzes results

5

The Basics

Unique Identifier

Allows for identification of primary household language to ensure appropriate survey version

Ensures no duplication of responses

Allows oversampling for demographic indicators

Allows for further data analysis

6

The Basics

Survey includes families with:

children who are currently enrolled in Part C and have been enrolled for at least 6 months

and

children who were enrolled in Part C for at least 6 months and who have transitioned from Part C within the past 6 months

7

The Basics

To achieve representative sample, matrix is used and we oversample the population How do we know when we have a representative sample? As

we fill the cells, we know if we have any areas where we need to concentrate our efforts….

Goal for each cell is 30% of eligible population

Cells are defined by geographic region (North/South) Ethnicity (African American/Caucasian/Other) Eliminated in 2008 Survey: length of time in program

(less than 18 months/more than 18 months)

8

The Basics

Even though Sampling Matrix does not include gender, data is analyzed to ensure results are representative of the population we serve

Delaware did not report out gender as part of Indicator 4/Family Outcomes in FFY06 APR

9

The Basics

Response rates for 2007: Initial sample size of 433 158 surveys completed 36.5% response rate

Response rate for 2008 Initial sample size of 556 189 surveys completed 34% response rate

10

Sampling Matrix from 2008 Family Survey

Cell

NumberIn Cell

(a)

“Contact-able”

Families(b)

Goal for Cell(c)

Number of Completed Surveys in

Cell (d)

% of Completed

Surveys(d/a)

North, Caucasian 176 152 53 62 35.23%

North, African American 107 68 33 26 24.30%

North, Latino 34 21 12 9 26.47%

North, Other 35 31 13 16 45.71%

South, Caucasian 118 101 36 41 34.75%

South, African American 46 32 14 15 32.61%

South, Latino 39 23 14 20 51.28%

South, Other 1 1 -- 0 0.00%

Total 556 429 175 189

11

Ensuring Statewide Race/Ethnicity Representation for 2008 Family Survey

2008 Results+ CDW

Program Rate Ethnic

Background Number Percent Caucasian 104 55.0% 53.2% African American 34 18.2% 28.0% Latino 24 12.7% 12.0% Asian 5 2.6% 2.8% Other 16 8.5% 4.0% Not identified 6 3.0% -- Total 189 100.0% 100.0%

+ as reported 08-08-08 CDW Program Rate = 618 data

12

Ensuring Regional Race/Ethnicity Representation for 2008 Family Survey

Ethnic Background

2008 Results

North Surveys

Completed

CDW North Program

Rate

South Surveys

Completed

CDW South Program

Rate

Caucasian 54.87% 50.70% 53.95% 58.10%

African American 23.01% 30.40% 19.74% 23.10%

Latino 7.96% 9.50% 26.31% 16.90%

Other 14.16% 9.40% 0.00% 1.90%

CDW Program Rate = 618 data

13

Representation by Region for 2008 Family Survey

Frequency PercentCDW

Program Rate

North 115 60.8% 62.8%

South 68 36.0% 37.2%

Missing 6 3.2% ---

CDW Program Rate = 618 data

14

Above and Beyond APR Reporting

Delaware also analyzes data by:GenderLength of time in program for questions

regarding transition planning (State focus) removed in 2008 as variable in sampling

because cell sampling size became too small and analysis by length of time in program showed no difference except in questions on transition planning

15

So Delaware asks:

What are the minimum requirements in ensuring representativeness?

16

2007 Family Survey Report can be viewed on Delaware’s Birth to Three website:

http://www.dhss.delaware.gov/dhss/dms/epqc/birth3/directry.html

2008 Family Survey Report will become available in the fall

Delaware’s Contacts:

Rosanne Griff-Cabelli, Part C Coordinatorrosanne.griff-cabelli@state.de.us

Susan Campbell, Asst Part C Coordinatorsusan.campbell@state.de.us