Upload
lynette-flowers
View
218
Download
3
Embed Size (px)
Citation preview
Military Family Services Program
Participant Survey
Briefing Notes
What are the elements of the MFSP Accountability Framework?Financial accountabilityMOUNeeds assessmentAuditsFormal site visitsEvaluation of services(see MFSP: Parameters for Practice, pp. 15-16)
MFSP Accountability Framework at a Glance
Service
Category
Service Components
Objectives Indicators
Personal development and community integration
5 22 34
Child and youth development and parenting support
5 19 26
Family separation and reunion
1 7 11
Prevention support and intervention
4 14 22
TOTAL 15 62 93
Why Collect this Information?
Implementation of the service accountability framework in MFSP: Parameters for Practice (pp. 33-52)
It is hoped that this system will replace BSI and NID
Will provide more meaningful information for decision making at national and local level
MFSP Accountability Framework The System
The method (survey) used to collect data to measure the performance indicators within the MFSP Accountability Framework.
How Was the MFSP Accountability System Developed?
Involvement of field throughout the process
With intention to create value at centre level and at MFSP level
With an emphasis on how to improve
Why a Survey Approach?
Our main choices are to: – observe– ask
Surveys are an efficient method of obtaining information about experiences, opinions, past behaviors– these cannot be observed
Surveys are easy to analyze
The Accountability System Aim was to create feasible system that
provided meaningful information for a reasonable effort
A selection from the accountability framework– Based on field based workgroup priorities– DMFS management priorities
17 objectives and indicators selected– All service components represented (two have 2
indicators each)– Some relate to process; some to outcomes
The Accountability System (2) In addition 4 items were selected from
principles of family support as described in MFSP: Parameters for Practice
11 structured items look at participant characteristics and participation patterns
3 open ended items to allow respondents to expand on any answers or provide additional information.
Final Overview of the Survey
Questions 1 – 4 – How you and your family were treated in this centre.
Questions 5 -21 – Your family’s experiences in the community in which
you live. Questions 22 – 43
– information about you and members of your family 3 Open ended questions
– Further explanation– Other comments about this centre– Other comments about this community experience
How Does the Survey Work?
Items are written to obtain information about the experience of participants, – not a direct reflection of centre
services (services may be provided directly, indirectly or by others)
Respondents should think of current posting when answering questions
How will information be used?
Responses within each centre will be aggregated
Centres can look for trends in responses and use information to better understand what works well and what needs attention
DMFS will also aggregate data on national level and use information to manage MFSP
DatabaseWill enable completion of surveys on line
or on paper by 2007– For Year 1 surveys will be completed
on paper (machine scorable forms)Will automatically analyze in real timeCentres will have reports of own data and
comparison data (national, previous year)DMFS will have aggregated dataResults will be presented in tables and
charts
What Impact Will Survey Results Have on Funding?
The survey will not have a direct impact on funding.
It is one of many sources of information that are taken into account in the management and funding of centres and of the MFSP as a whole.
How does the MFSP Accountability Framework System (MFSP
Participant Survey) link to Local Evaluation?
Evaluation Planning DMFS establishes
evaluation requirements common to all MFRCs
Centres determine their own additional evaluation needs
Centre Evaluation Committee or equivalent
Develops a centre evaluation plan that integrates local and corporate
evaluation requirements
Example of a Local Evaluation Plan
Required MFSP survey
Interested in more detail about Assessment and Referral component—develops own survey
Conducts focus groups to get more
detail and context for survey results
Can use items in accountability
framework and/or create own
Possible Uses of Evaluation Information
Information
Funding application
Service delivery planning
Organizationalplanning
Activity Listing
Evaluation Plan
OtherInformation
Improvements
in Services
Improvements In Programs
New Programs
Strategic Planning
Staff Training
Facility Issues
Advocacy
DNDPartners
Community
Partners
Access, Use,Uptake Issues
Marketing,Promotion
The MFSP Evaluation SurveyGeneral Procedures
When is the survey conducted?
Two-week period, chosen by centre, during last fiscal quarter
Centres should maximize legitimate participation during evaluation period
Who is the Survey data about?
The survey is collecting data that reflects the experience of MFSP participants as defined in MFSP: Parameters for Practice (page 26/27)
Who can complete the survey?
One person per family,18 years or over Normally this would be an immediate member of that family and knowledgeable about the entire family experienceIf not an immediate family member then they must ensure that they are responding based on that families experience.Paid staff are not eligible even if participating in services (volunteers are)
Can we combine the survey with other evaluation activities?
To ensure consistency across C/MFRCs and to maintain the integrity of the process, we ask that no other formal evaluation activities be undertaken during the two-week period
How do we assure confidentiality?
Respondents do not provide their name They seal their completed survey into an
envelope Envelope is placed into a sealed collection box
that will be shipped to DMFS When surveys are analyzed it will be in
aggregate—no individual responses will be reported.
What Is the Role of the Board of Directors, Staff, Volunteers and Partners?
Promote the survey in general conversation.
Encourage families to complete the survey.
Be prepared to explain why another survey is necessary.