27
1 Assessment in the Arts Conference July 2013 Angie L. Miller, Ph.D. Amber D. Lambert, Ph.D. Center for Postsecondary Research, Indiana University Best  Practices in Using Alumni Data for  Arts Program Assessment Introduction to  SNAAP

Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

1

Assessment in the Arts Conference

July 2013

Angie L. Miller, Ph.D.

Amber D. Lambert, Ph.D.

Center for Postsecondary Research, Indiana University

Best Practices in Using Alumni Data for Arts Program Assessment

Introduction to SNAAP

Page 2: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

2

SNAAP Mission

We investigate the educational experiences and career paths of arts graduates nationally

Provide the findings to educators, policy makers, and philanthropic organizations 

To improve arts training, inform cultural policy, and support artists

SNAAP Basics: Who is surveyed?

Participants drawn from..Arts high schoolsIndependent arts colleges, arts schools or departments in comprehensive colleges & universities

Broad definition of “arts”

All arts alumni, all years (since 2011)2008‐2010: surveyed selected cohorts

Page 3: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

3

Increasing Numbers…

2011 Administration 36,000 respondents 66 institutions

2012 Administration 33,000 respondents 70 institutions

Combining 2011 and 2012 respondents to create 

SNAAP Database with 69,000 respondents

Questionnaire Topics

1. Formal education and degrees

2. Institutional experience and satisfaction

3. Postgraduate resources for artists

4. Career

5. Arts engagement

6. Income and debt

7. Demographics

Page 4: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

4

Participating institutions receive...

Institutional Reports: Customized, Confidential Separate reports for undergraduate and graduate alumni

Both quantitative and qualitative data

New report on “Recent Grads”

Comparative data with other schools 

Complete data file of responses

Workshops/webinars on how to use data

Using the Data

Page 5: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

5

Examples of institutions using alumni data for...

Sharing on campus

Alumni and donor outreach

Recruitment

Assessment and curricular change

Advocacy and public policy 

Sharing on Campus

Page 6: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

6

Page 7: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

7

Page 8: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

8

Alumni and Donor Outreach

Page 9: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

9

Page 10: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

10

Page 11: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

11

Page 12: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

12

Page 13: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

13

Recruitment

Page 14: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

14

Page 15: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

15

Assessment and Curricular Change

Page 16: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

16

Using SNAAP for Curricular Assessment and Change

Using SNAAP for Curricular Assessment (cont.) Most important skills:

1. Creative thinking and problem solving2. Listening and revising3. Interpersonal relations and working collaboratively4. Broad knowledge and education5. Critical thinking and analysis of arguments and 

information

Recommend that faculty: Incorporate open‐ended projects (top skill #1) and group projects (top skill #3)

Require analysis of theories or reviews/critiques (top skill #5) and provide opportunities for feedback and revision (top skill #2)

Ensure curricula include a firm knowledge foundation in a wide variety of areas (top skill #4)

Page 17: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

17

Using SNAAP for Curricular Assessment (cont.)

Using SNAAP for Curricular Assessment (cont.) Identify strengths: 

What skills have the highest % of alumni reporting the institution helped them develop “very much” or “quite a bit”?

Identify areas for improvement: 

What skills have the highest % of alumni reporting the institution helped them develop “very little” or “not at all”?

Peer group information provides context: 

Do other institutions have similar strengths and weaknesses?

Page 18: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

18

Examples From Aggregate Findings

77% 81%

71%

90%

22%26%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Artistic technique Financial and businessmanagement skills

Entrepreneurial skills

"Very" or "Somewhat Important" to profession or work life

Institution contributed "Very much" or "Some" to development of skill

Using SNAAP for Curricular Assessment  (cont.) Alumni receive strong training in learning artistic techniques

Discrepancies between those who say a skill is important for their work and those who say the institution helped them develop that skill suggest some improvements that could be made, such as: Requiring business  and financial classes, or incorporating these elements into existing courses 

Include classes looking at the “nontraditional” career paths of arts graduates

Page 19: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

19

Page 20: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

20

Advocacy and Policy

Page 21: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

21

Page 22: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

22

Page 23: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

23

SNAAP Data Resources

Aggregate Reports

Page 24: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

24

Aggregate Report (detail)

Annual Reports

Page 25: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

25

Annual Report (detail)

SNAAP Special Reports

Page 26: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

26

SNAAP Special Reports (detail)

SNAAP DataBriefs 

Page 27: Best Practices - FINALsnaap.indiana.edu/pdf/Best Practices - PDF (small).pdf · Microsoft PowerPoint - Best Practices - FINAL Author: anglmill Created Date: 7/17/2013 1:49:16 PM

27

Available at: http://snaap.indiana.edu/snaapshot

Questions or Comments?

Contact Information: Angie L. Miller [email protected] Amber D. Lambert [email protected]

Strategic National Arts Alumni Project (SNAAP)

www.snaap.indiana.edu

(812) 856‐5824

[email protected]