Upload
aislin
View
33
Download
3
Tags:
Embed Size (px)
DESCRIPTION
Ensuring representative sample for Family Survey…. … what did Delaware do?. The Basics. Already had existing Family Survey in place OPEC (Ongoing Program Evaluation Committee) provided guidance on survey creation and modifications - PowerPoint PPT Presentation
Citation preview
… what did Delaware do?
Ensuring representative sample for Family Survey….
2
The Basics
Already had existing Family Survey in place
OPEC (Ongoing Program Evaluation Committee) provided guidance on survey creation and modifications
Updated questions now include those that align with Federal Outcomes
3
The Basics
Letters mailed to explain Family Survey
Postcard reminder sent
Up to four attempts made to survey families via phone
For those families with no phone– surveys are hand-delivered by Service Coordinators
4
The Basics
Initially conducted through telephone survey. Starting this year, survey can be accessed by families through Survey Monkey (in English and Spanish), or may respond through telephone survey (surveyors made up to four attempts), or hand delivered by Service Coordinators
University of Delaware conducts survey and analyzes results
5
The Basics
Unique Identifier
Allows for identification of primary household language to ensure appropriate survey version
Ensures no duplication of responses
Allows oversampling for demographic indicators
Allows for further data analysis
6
The Basics
Survey includes families with:
children who are currently enrolled in Part C and have been enrolled for at least 6 months
and
children who were enrolled in Part C for at least 6 months and who have transitioned from Part C within the past 6 months
7
The Basics
To achieve representative sample, matrix is used and we oversample the population How do we know when we have a representative sample? As
we fill the cells, we know if we have any areas where we need to concentrate our efforts….
Goal for each cell is 30% of eligible population
Cells are defined by geographic region (North/South) Ethnicity (African American/Caucasian/Other) Eliminated in 2008 Survey: length of time in program
(less than 18 months/more than 18 months)
8
The Basics
Even though Sampling Matrix does not include gender, data is analyzed to ensure results are representative of the population we serve
Delaware did not report out gender as part of Indicator 4/Family Outcomes in FFY06 APR
9
The Basics
Response rates for 2007: Initial sample size of 433 158 surveys completed 36.5% response rate
Response rate for 2008 Initial sample size of 556 189 surveys completed 34% response rate
10
Sampling Matrix from 2008 Family Survey
Cell
NumberIn Cell
(a)
“Contact-able”
Families(b)
Goal for Cell(c)
Number of Completed Surveys in
Cell (d)
% of Completed
Surveys(d/a)
North, Caucasian 176 152 53 62 35.23%
North, African American 107 68 33 26 24.30%
North, Latino 34 21 12 9 26.47%
North, Other 35 31 13 16 45.71%
South, Caucasian 118 101 36 41 34.75%
South, African American 46 32 14 15 32.61%
South, Latino 39 23 14 20 51.28%
South, Other 1 1 -- 0 0.00%
Total 556 429 175 189
11
Ensuring Statewide Race/Ethnicity Representation for 2008 Family Survey
2008 Results+ CDW
Program Rate Ethnic
Background Number Percent Caucasian 104 55.0% 53.2% African American 34 18.2% 28.0% Latino 24 12.7% 12.0% Asian 5 2.6% 2.8% Other 16 8.5% 4.0% Not identified 6 3.0% -- Total 189 100.0% 100.0%
+ as reported 08-08-08 CDW Program Rate = 618 data
12
Ensuring Regional Race/Ethnicity Representation for 2008 Family Survey
Ethnic Background
2008 Results
North Surveys
Completed
CDW North Program
Rate
South Surveys
Completed
CDW South Program
Rate
Caucasian 54.87% 50.70% 53.95% 58.10%
African American 23.01% 30.40% 19.74% 23.10%
Latino 7.96% 9.50% 26.31% 16.90%
Other 14.16% 9.40% 0.00% 1.90%
CDW Program Rate = 618 data
13
Representation by Region for 2008 Family Survey
Frequency PercentCDW
Program Rate
North 115 60.8% 62.8%
South 68 36.0% 37.2%
Missing 6 3.2% ---
CDW Program Rate = 618 data
14
Above and Beyond APR Reporting
Delaware also analyzes data by:GenderLength of time in program for questions
regarding transition planning (State focus) removed in 2008 as variable in sampling
because cell sampling size became too small and analysis by length of time in program showed no difference except in questions on transition planning
15
So Delaware asks:
What are the minimum requirements in ensuring representativeness?
16
2007 Family Survey Report can be viewed on Delaware’s Birth to Three website:
http://www.dhss.delaware.gov/dhss/dms/epqc/birth3/directry.html
2008 Family Survey Report will become available in the fall
Delaware’s Contacts:
Rosanne Griff-Cabelli, Part C [email protected]
Susan Campbell, Asst Part C [email protected]