103 a mcguire v2

Utilizing Outcome Measurements with Bereaved Children

Presenter:Beth A. McGuire, MDiv, NCBF, CT

[email protected] Robertson Bereavement Center (RBC)

…a community outreach of Hospice of Medina County797 N. Court St., Medina OH 44256

330-725-1900www.hospiceofmedina.org

Thursday, June 24, 2010; 10:30am – noonWorkshop session #1; 103-A

mailto:[email protected]

http://www.hospiceofmedina.org/

Workshop ObjectivesThursday, June 24, 2010; 10:30-12:00

At the conclusion of this workshop, participants will be able to:

• Review variety of camp opportunities and their impact on data collection

• Describe the four components of Outcome Measurements

• Describe importance of Developmental Assets in program planning

• Identify one Outcome Measurement to implement in their own children’s grief program

The Robertson Bereavement Center Hospice of Medina County

Ohio

Types of Kids Grief Camps

– one all day camp– one week day-long camp– one week camp as part of other camp

(YMCA)– weekend camp with or without families– overnight week long camp– adventure camp


Ohio


Ohio

Goals of RBC Camp• To provide a safe, non-threatening

environment for children who have experienced a recent loss through the death of a loved one.

• To normalize the grief process.

• To correct any misinformation about death, dying and grief.

• To help children understand they are not alone and to encourage the development of peer support.


Ohio

Goals of RBC Camp (cont’d)• To provide opportunities for participants to

express their feelings (fear, anger, regret, sadness, guilt) in constructive and healthy ways.

• To help children build new ways of coping with grief which will help them in years to come.

• To incorporate Search Institute's Developmental Assets.

• To teach the Grief Facts©

GRIEF Facts©created by The Robertson Bereavement Center

Hospice of Medina County, Ohio

• Grief is normal• It Really hurts• It’s Important not to grieve alone• Express your feelings• Find ways to cope


Ohio

Developmental Assets: What are They?http://www.search-institute.org

• Search Institute’s 40 Developmental Assets® are common sense, positive experiences and qualities that help influence choices young people make and help them become caring, responsible adults.

• Research-based comprehensive vision of what young people need to thrive

• They include both External & Internal Assets


Ohio

http://www.search-institute.org/

External Assets: Support(age 8-12)

• Family Support • Positive Family Communication • Other Adult Relationships • Caring Neighborhood • Caring School Climate • Parent Involvement in Schooling


Ohio

External Assets: Empowerment

• Community Values Youth

• Children as Resources

• Service to Others

• Safety


Ohio

External Assets: Boundaries & Expectations

• Family Boundaries

• School Boundaries

• Neighborhood Boundaries

• Adult Role Models

• Positive Peer Influence

• High ExpectationsThe Robertson Bereavement Center

Hospice of Medina County Ohio

External Assets: Constructive Use of Time

• Creative Activities

• Child Programs

• Religious Community

• Time at Home


Ohio

Internal Assets: Commitment to Learning

• Achievement Motivation

• Learning Engagement

• Homework

• Bonding to School

• Reading for Pleasure


Ohio

Internal Assets:Positive Values

• Caring

• Equality and Social Justice

• Integrity

• Honesty

• Responsibility

• Healthy LifestyleThe Robertson Bereavement Center


Internal Assets:Social Competencies

• Planning and Decision Making

• Interpersonal Competence

• Cultural Competence

• Resistance Skills

• Peaceful Conflict Resolution


Ohio

Internal Assets:Positive Identity

• Personal Power

• Self-Esteem

• Sense of Purpose

• Positive View of Personal Future


Ohio

What is an Evaluation?

– A systematic acquisition and assessment of information to provide useful feedback about some subject.

– The generic goal of most evaluations is to “provide useful feedback" to a variety of audiences including sponsors, donors, client-groups, administrators, staff, and other relevant constituencies.


Ohio

Results of Collected Data

PARENT’S EVALUATION QUESTIONS• Were stated purposes met?• My child/ teen understands the Grief Facts©• My child/teen is able to identify four grief

emotions.• My child/teen is able to identify coping skills.• Other changes you have observed.• How might we improve our program?


Ohio

Parents Comments/Observations on Evaluation

• Openness about events that led up to the death and how we must remember and go on.

• Seem to be freer with their feelings. It helps me to realize to be more creative with dealing with their grief.

• They seem to know what to do when they feel emotions such as anger and sadness. They seem to feel they can handle it better.

• Great tools for them to relate to.


Ohio

Parents Comments/Observations on Evaluation(cont’d)

• More open, brighter attitude when talking about Grandpa. He felt very loved, accepted and understood by the whole group-that was GREAT!

• She is more communicative, talks more.• They know what grieving is and that it’s OK

to grieve.• We have been very satisfied with the

activities etc. this camp has provided-I would recommend it in a heart beat to anyone experiencing the loss of a loved one.


Ohio

• It helped me with my feelings and I tried new things

• We each got to tell our own feelings about how we felt

• Liked making friends and learning how to deal

• I learned I wasn’t the only one • Liked knowing other kids lost a family

member just like me

Campers Comments on Evaluation


Ohio

• Everyone cared about me• Everyone was nice and couldn’t judge you• It was a comfortable environment and I felt

that I could open up• I knew I wasn’t alone• I thought it was the best!• I think this is a great camp and it helps a lot

Campers Comments on Evaluation(cont’d)


Ohio

Outcome Measurements: What are they?• A method to assist organizations in gauging the

effectiveness of their programs and needs of clients.

• Process and procedures to assess programs.• Assess what happens for participants as a result

of the program.• Regular systematic tracking of benefits/changes.• http://www.liveunited.org/_cs_upload/Outcomes/

Resources/What/3870_1.pdf


Ohio

Outcome Measurements: Why do them?• Benchmark against self to improve program

performance• Identify effective program strategies• Funding & accountability to funders/donors• Tangible evidence of impact to bereaved• Future success• State & local governments, private foundations,

national associations, etc. are shifting to OM• Builds confidence & support• Improve service delivery


Ohio

Outcome Measurements: Components

1. Inputs

2. Activities

3. Outputs

4. Outcomes


Ohio

Outcome Measurements: Inputs


Ohio

Resources dedicated to or consumed by the program:

•curriculum/materials (binder)•profiles/registration•trained staff•safe, supportive environment•participants•money, facility, equipment•supplies•regulations or funder’s requirements

Outcome Measurements: Activities

• What the program does with the inputs to fulfill its mission

• Training, counseling, education, strategies, techniques

• Types of treatment that comprise the program’s service methodology


Ohio

Outcome Measurements: Outputs


Ohio

•Direct products of program activities, usually measured in volume of work accomplished: - number of classes taught - number of counseling sessions conducted - hours of service delivered - number of participants served - educational materials distributed

• 35 hours: five days @ 7 hours/day (units)• 12-20 campers per camp (# limited by site)

Outcome Measurements: Outcomes


Ohio

Benefits or changes for individuals or populations during or after participating in

program activities:• They are influenced by a program's

outputs• New knowledge• Increased skills • Changed attitudes or values• Modified behavior• Improved condition• Altered status

Outcome Measurements:The Robertson Bereavement Center

• Campers will be able to verbalize the GRIEF Facts© with 80% accuracy.

• Campers will be able to identify at least four of the following grief emotions: sad, mad, glad, afraid, fear, guilt, regret, loneliness, worried, jealous, confused.

• Campers will be able to identify two or more coping skills (example: talk to a friend or family member, draw a picture, write or journal, call The Robertson Bereavement Center, etc.)


Ohio

Background InformationCampers recruited through: • advertisements in local papers, web sites• hospice newsletter and mailings (10,000+)• Referrals (schools, JFS, counseling

agencies, etc)

Telephone interviews were conducted with interested parents, who then completed referral and permission forms. To gain a clearer understanding of the loss, the forms included a check list of reactions and narrative responses.


Ohio

Background Information: StaffStaffing for 12-20 children, ages 6-13 years:• Registered nurse• Bereavement Director• Two lead teachers – a bereavement social

worker and a registered art therapist • Hospice staff & volunteers; university interns• Prevention specialist on loan from a local

alcohol and drug counseling agency• A designated staff person spent time with

parents & guardians of children both at drop off and pick up; education provided; referrals were given for additional follow-up


Ohio

Background Information: Activities

• Camp includes both bereavement and recreational activities (children’s grief patterns)

• Bereavement activities focused on creating a safe place for children to grieve, identify and express feelings in healthy ways, reduce feelings of isolation, normalize grief (goals)


Ohio

Background Information: Activitiescont’d

• The program utilized the nature setting to inform campers of the cycle of life and death

• A butterfly release concluded the camp


Ohio

Outcome Data Collection Process

Outcome Measurement data was collected for seven years.

This data consists of: -a pre-test given to campers on day one -a post-test given on day five -a follow-up post test given 30 days after the camp was concluded -evaluations also given to both campers and

parentsThe Robertson Bereavement Center


Outcome Data Collection Processcont’d

Overall, campers retained the information that was presented and the evaluations by both campers and parents were positive.


Ohio

Outcome Measurement Questions

• Pre Test – Day #1• Post Test – Day #5• What are the Grief Facts©?• Name at least 4 feelings you have

experienced since your person died • What do you do to cope with or manage

your difficult feelings? (name 2 or more)• Who do you turn to when you need help?


Ohio

What are the GRIEF Facts©?

0 0 0 0 0 0

78

9

80

69

9082

90100

0

20

40

60

80

100

2002 2004 2005 2006 2007 2008 2009

Per

cent

age

of C

orre

ct R

espo

nses

pre test post test

Name at Least 4 Feelings

44 44

30

63

80 83

70 69

18

8 13

73

2733

0

20

40

60

80

100

2002 2004 2005 2006 2007 2008 2009

Perc

enta

ge o

f Cor

rect

Res

pons

es

pre test post test

How do You Cope? (name two)

22 20

9 90 0

30

45

80

46

2011

75

33

0

20

40

60

80

100

2002 2004 2005 2006 2007 2008 2009

Perc

enta

ge o

f Cor

rect

Res

pons

es

pre test post test

What are the GRIEF Facts©?

0 0 09

0 0 0

9083 86 86

0

100

78 8290

69

80

100 100

50

78

17

50

14 11 14

0

20

40

60

80

100

2002 2004 2005 2006 2007 2008 2009

Perc

enta

ge o

f Cor

rect

Res

pons

es

pre test post test parents evaluation: agree parents evaluation: somewhat agree

Name 4 Grief Feelings

138

18

73

30

4444

27

6970

8380

63

33

7175

89100

83100

50

2925

1117

50

0

20

40

60

80

100

2002 2004 2005 2006 2007 2008 2009

Perc

enta

ge o

f Cor

rect

Res

pons

es

pre test post testparents evaluation: agree parents evaluation: somewhat agree

How do You Cope (name two)

0 0099

2022

11

20

46

80

45

30

75

33

8686

67

100 100 100

78

1422

1417

0

20

40

60

80

100

2002 2004 2005 2006 2007 2008 2009

Perc

enta

ge o

f Cor

rect

Res

pons

es

pre test post testparents evaluation: agree parents evaluation: somewhat agree

Resources• Doka, Kenneth J. & Amy S. Tucci, Eds. (2008). Living With Grief:

Children and Adolescents. Ill: Quality Books, Inc.• Schachter, S. & Georgopoulos, M. Camp for grieving children:

lessons from the field; Doka, KJ & Tucci, AS (editors), (2008).Living With Grief: Children and Adolescents.

• Schachter, S.. Bereavement summer camp for children and teen: a reflection of nine years.

• Search Institute (2008). What Kids Need to Succeed. http://www.search-institute.org/content/what-kids-need

• United Way of America (2002) Outcome Measurements: What and Why http://www.liveunited.org/_cs_upload/Outcomes/Resources/What/3870_1.pdf


Ohio

http://www.search-institute.org/content/what-kids-need

http://www.liveunited.org/_cs_upload/Outcomes/Resources/What/3870_1.pdf

http://www.liveunited.org/_cs_upload/Outcomes/Resources/What/3870_1.pdf

Documents

103 a mcguire v2