42
Using ANSA for Client Assessment and Program Evaluation Catholic Charities USA Conference, 2013 Dan Bowersox [[email protected]] Shona Q. Baum, LCSW [[email protected]]

2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

Embed Size (px)

Citation preview

Page 1: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 1/41

Using ANSA for Client Assessment and Program

Evaluation

Catholic Charities USA Conference, 2013

Dan Bowersox

[[email protected]]

Shona Q. Baum, LCSW[[email protected]]

Page 2: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 2/41

• Who we are, and how we got here

• Choosing ANSA

• A deeper look at ANSA

• Examples and vignettes

• Our implementation and results

• Discussion

Agenda

Page 3: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 3/41

• Who we are – Founded in 1989

 – Serving 3,300 families per year

 – Diverse staff of 70

• Education

• Work experience,• Case management skill level

• What we do

 – Case Management

• Substance Abuse

• Domestic Violence• Child Welfare

 – Housing

 – Wellness Center

In partnership with our families, break the cycle of childhood poverty  

Homeless Prenatal Program (HPP)

Page 4: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 4/41

 • Intensive job training program

• Participants are low-income parents – Many are former clients of the agency

 – Limited education/employment experience

• Majority of HPP case managers are graduatesof the program

 – First agency in San Francisco to hire former clients

CHW Training Program

Page 5: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 5/41

The Challenges

• Ensure consistent quality of client service

• Meet increasing need from funders for data and formal program

evaluation

Or: We know we are doing great work. How do we prove it? 

Page 6: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 6/41

• Ensure consistency in assessing clients’ needs and strengths 

• Facilitate creation of service plans

• Allow monitoring of outcomes

• Standard language for communication between team members

The Solution:

Standardized Assessment

Page 7: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 7/41

Why ANSA?

• Open domain tool, widely used

 – Interface with other agencies

• DPH, Child Welfare

• Cross-disciplinary

• Focus on necessary actions• Non-judgmental

• Appropriate for multi-cultural environment

Page 8: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 8/41

About ANSA

• Developed and copyrighted by the Praed Foundation*

• Free to use

• Training and certification available

* Copyright 1999, the Praed Foundation, www.praedfoundation.org 

Page 9: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 9/41

ANSA Categories 

Life Domain Functioning

 – Physical/Medical

 – Family Functioning

 – Employment

 – Social Functioning

 – Recreational

 – Intellectual

 – Sexuality

 – Living Skills

 – Residential Stability

 – Legal

 – Sleep

 – Self Care

 – Medication Compliance

Acculturation

 – Language

 – Identity

 – Ritual

 – Cultural Stress

Mental Health Needs

 – Psychosis

 – Impulse Control

 – Depression

 – Anxiety

 – Interpersonal Problems

 – Antisocial Behavior

 – Adjustment to Trauma

 – Anger Control

 – Substance Use

 – Eating Disturbance

Risk Behaviors

 – Suicide Risk

 – Self Injurious Behavior

 – Other Self Harm

 – Exploitation

 – Danger to Others

 – Sexual Aggression

 – Criminal Behavior

Strengths

 – Family Involvement

 – Social Connections

 – Optimism

 – Educational

 – Job History

 – Talents/Interests

 – Spiritual/Religious – Natural Supports

 – Resiliency

 – Resourcefulness

 – Volunteering

 – Community Connection

Page 10: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 10/41

HPP Assessment Categories 

Life Domain Functioning

 – Physical/Medical

 – Family Functioning

 – Employment

 – Social Functioning

 – Recreational

 – Intellectual

 – Sexuality

 – Living Skills

 – Residential Stability

 – Legal

 – Sleep

 – Self Care

 – Medication Compliance

Acculturation

 – Language

 – Identity

 – Ritual

 – Cultural Stress

Mental Health Needs

 – Psychosis

 – Impulse Control

 – Depression

 – Anxiety

 – Interpersonal Problems

 – Antisocial Behavior

 – Adjustment to Trauma

 – Anger Control

 – Substance Use

 – Eating Disturbance

Risk Behaviors

 – Suicide Risk

 – Self Injurious Behavior

 – Other Self Harm

 – Exploitation

 – Danger to Others

 – Sexual Aggression

 – Criminal Behavior

Strengths

 – Family Involvement

 – Social Connections

 – Optimism

 – Educational

 – Job History

 – Talents/Interests

 – Spiritual/Religious – Natural Supports

 – Resiliency

 – Resourcefulness

 – Volunteering

 – Community Connection

Page 11: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 11/41

ANSA Ratings: Needs

0 1 2 3

Evidence of 

need

No evidence of 

need

Mild degree of 

need

Moderate

degree of need

Severe or

disabling

degree of need

Page 12: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 12/41

ANSA Ratings: Needs (Action-based)

0 1 2 3

Need for

Action

No need for

action

Watchful

waitingNeed for action

Need for

immediate or

intense action

Page 13: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 13/41

ANSA Ratings: Strengths

0 1 2 3

Presence of 

strength?

Significant

strength

Moderate

level of 

strength

Mild

level of 

strength

No

strength

present

Page 14: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 14/41

ANSA: Physical/Medical

Page 15: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 15/41

Physical/Medical Rating

0 1 2 3

Evidence of 

physical/

medical

problems?

No evidence

Mild or

well-managed

conditions

Chronic or

moderate

conditions

Severe or

life-threatening

conditions

Page 16: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 16/41

ANSA Principles

• Rating pertains to the individual, irrespective of services theyare receiving

• Rating must be based on stated or observed need, not

assumed need

• Culture and development should be considered when rating – Examples: Housing, religion, family

• 30-day window to ensure "freshness"

• Needs rated 2 or 3 should appear in service plan

Page 17: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 17/41

ANSA: Residential Stability

Page 18: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 18/41

Residential Stability Rating

0 1 2 3

Current

Situation Stable Housing

Mostly Stable

Housing

Unstable

Housing Homeless

Risk Factors:Could the client

lose their housing due

to problems with

self-care, disruptivebehavior, financial

situation, or another

reason? 

No Evidence of 

Risk

Some Warning

Signs

Moderate Risk

Level

Severe Risk

Level

Page 19: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 19/41

Brenda

Brenda left a DV situation last year and she and her daughter have been

staying in a DV shelter ever since. She is suffering from major depression

and speaks only limited English.

Page 20: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 20/41

Anthony

Anthony and his family have been living in a rental apartment for the

past 2 years. He just got laid off from his job as a mechanic and is

worried about paying his bills. He has been in recovery for 1 year.

Page 21: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 21/41

Courtney

Courtney was evicted a few months ago and went to

stay with her cousin. Her cousin wants her to leave,

but she has been unable to find another place due to

the eviction on her record.

Page 22: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 22/41

The Client Interview

Coaching case managers on how to interview clients

Page 23: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 23/41

Assess Current Living Situation

 – How do you feel about your living situation? – Is it clean/safe/healthy there?

 – Do you feel like you are in control of your housing?

 – Are you and your kids sleeping well at night?

Page 24: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 24/41

Assess History

 – Have you ever been homeless?

 – Have you ever been evicted?

 – How did that happen?

 – Where did you stay?

 – How long?

 – Who helped you?

Page 25: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 25/41

HENRI (HPP database) Demo

• ANSA in HENRI

 – Built-in 30-day time limit

 – Rating, plus note for justification

 – UNCOPE and other add-ons

 – Exporting data (e.g. KFT assessments)

 – Outsourced development

Page 26: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 26/41

 HPP’s Results So Far 

Over 1700 assessments conducted in first year

E m ploym ent

P hysical/M edical

R esidential S tability

Fam ily Functioning

Legal

Living S kills

C ultural S tress

Fam ily Involvem entS ocial C onnectedness

D epression

A nxiety

A djustm ents to Traum a

S ubstance Abuse

0% 5% 10% 15% 20% 25% 30% 35% 40%

% w ith 2 or 3 R ating

Page 27: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 27/41

Issues encountered

Data quality/consistency Instituted manager approval process

Resistance to change:

“This feels like a college exam” 

Slow rollout with lots of training and

support

Issue Action

Page 28: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 28/41

Benefits of implementation

• Winning federal demo grant – HPP's use of ANSA strengthened proposal

 – Other grants require evidence-based assessment

• Linking assessment to case plans

• Smoother transfer of clients between case managers

• Using as basis for discussion of housing stability risks

Page 29: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 29/41

 HPP’s Future Plans 

• Follow-up assessments

• Comparisons to baseline

 – Individual -- tracking client's progress

 – Aggregate -- several possibilities for doing

comparisons

• Number of clients who improved total score

• Number improved within a specific category

Page 30: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 30/41

ANSA Certification

http://www.canstraining.com

Page 31: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 31/41

Discussion

• Your experiences with assessment?

• Questions?

Page 32: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 32/41

Backup

Page 33: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 33/41

HENRI Screen Shots

Page 34: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 34/41

Backup

Page 35: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 35/41

Backup

Page 36: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 36/41

Backup

Page 37: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 37/41

Backup

Page 38: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 38/41

Vignettes

• How would you interview the client to obtain the necessary information?

• What additional questions would you ask?

• How would you rate the client in the given category?

Page 39: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 39/41

Vignette 1: Employment

• Client reports history of short-term employment.

• Client has worked at fast food restaurants, retail, hotels.

• Client's longest employment was working part-time with a friend's

mother in home daycare for one year, in 2009.

• Client reports most recent employment was at a supermarket in 2010.• Client states she has never been fired.

Page 40: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 40/41

Vignette 2: Family Functioning

• Client has history of instability and trauma in her family life.

• Mother is in recovery for substance use.

• Client reports father is not in her life.

• Client reports older brother was murdered last year due to a possible

gang dispute.• Client reports has 2 sons from two different partners.

• Client states having no parental rights of 2 sons. Children are currently

staying with partners' families.

• Client reports she is excited about present partner's release from jail in

about 9 months. They are considering having a baby as soon as he is free.• Client does not want to disclose cause of partner's jail sentence.

Page 41: 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

7/27/2019 2013 Annual Gathering: Workshop#11B: Using ANSA for Client Assessment

http://slidepdf.com/reader/full/2013-annual-gathering-workshop11b-using-ansa-for-client-assessment 41/41

Vignette 3: Mental Health

• Client is a 35-year-old mother of three children.

• Client lives with her partner and her children.

• She states "I don't know what is happening to me. I just want to sleep. I

have to force myself to get out of bed to cook, or to take the children to

school. I just don't have the energy to do anything. I feel tired, and have

no interest in doing things, or going out. I am often feeling very sad and

crying, but I don't want to talk to my family or friends about my feelings. I

sometimes wonder what is the point of having a life like mine."