6

Click here to load reader

Spring 2009 Learning Outcomes Assessment Report for ... · 2009-2010 Assessment Report for Division of Student Affairs . ... test, focus group, ... SOAL Team Meetings, Post Program

  • Upload
    doliem

  • View
    212

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Spring 2009 Learning Outcomes Assessment Report for ... · 2009-2010 Assessment Report for Division of Student Affairs . ... test, focus group, ... SOAL Team Meetings, Post Program

2009-2010 Assessment Report for Division of Student Affairs Department Student Involvement – Student Organizations and Leadership (SOAL)

Person(s) Submitting Report Nam Nguyen, Associate Director, Student Organizations and Leadership Date July 16, 2010 Director Signature Richard C. Kelley, Director of Student Involvement

Please list department learning outcomes (add addl rows if needed) Learning Outcome #1 COMMUNICATION: Students will speak, listen and write to achieve intended and meaningful

understanding. Learning Outcome #2 REASONING: Students will use knowledge of evidence and context in order to reach conclusions and

reason, as well as to innovate in imaginative ways. Learning Outcome #3 LEADERSHIP: Students will acquire core leadership skills, enabling them to lead productive and

meaningful lives within the SJSU and global community. Learning Outcome #4 INDIVIDUAL RESPONSIBILITY: Students will advance their understanding and sense of self and live

healthier lives in order to be successful at SJSU and beyond. Learning Outcome #5 SOCIAL RESPONSIBILITY: Students will cultivate their understanding and duty to be socially

responsible and global citizens. Learning Outcome #6 UNIVERSITY RESPONSIBILITY: Students will be responsible to SJSU for becoming a campus citizen

and seeking out ways to become academically and socially integrated into the community. Demonstrating this responsibility will lead to an increased institutional commitment.

For Fall 2009, please indicate which learning outcomes were the focus of data collection, type(s) of assessment was/were utilized, and results.

L.O. # Was data collected in Fall 09? (yes/no)

Type(s) of assessment utilized (rubric, survey, test, focus group, employee evaluations,, etc)

Findings (how many students participated in assessment, most significant findings, summary of themes and/or actual data if available)

1 Yes Written Assessment (Pre and Post Assessment) and Surveys

Student Organization Leadership Conference: 88.9% of attendees believed they gained communication skills from their experience at the conference. Nuts and Bolts for Student Organization: An averaged 92.3% of the participants believed they gained communication skills from their experience at the workshops

2 Yes Written Assessment (Pre and Post Assessment) and Surveys

Student Organization Leadership Conference: 88.9% of attendees believed they gained reasoning skills from their experience at the conference. Nuts and Bolts for Student Organization: An averaged 69.2% of the participants believed they gained reasoning skills from their experience at the workshops

3 Yes Written Assessment (Pre and Post Assessment) and Surveys

Student Organization Leadership Conference: 85.6% of attendees believed they gained leadership skills from their experience at the conference. New Student Organization Orientation: 100% of attendees believed they gained leadership skills from their experience at the orientation. Nuts and Bolts for Student Organization: An averaged 97.3% of the participants believed they gained leadership skills from their experience at the workshops

4 Yes Written Assessment (Pre and Post Assessment) and Surveys

Student Organization Leadership Conference: 88.9% of attendees believed they gained individual responsibility from their experience at the conference. Nuts and Bolts for Student Organization: An averaged 64.5% of the participants believed they gained individual responsibility from their experience at the workshops.

5 Yes Written Assessment (Pre and Post Assessment) and Surveys

Student Organization Leadership Conference: 78.6% of attendees believed they gained social responsibility from their experience at the conference. Nuts and Bolts for Student Organization: An averaged 72.4% of the participants believed they gained social responsibility from their experience at the workshops.

6 Yes Written Assessment (Pre and Post Assessment) and Surveys

Student Organization Leadership Conference: 80.4% of attendees believed they gained university responsibility from their experience at the conference. Nuts and Bolts for Student Organization: An averaged 83.6% of the participants believed they gained university responsibility from their experience at the workshops.

Page 2: Spring 2009 Learning Outcomes Assessment Report for ... · 2009-2010 Assessment Report for Division of Student Affairs . ... test, focus group, ... SOAL Team Meetings, Post Program

For Fall 2009, please indicate if findings noted above were discussed in your department and/or what actions have been taken in response to the findings. L.O. # How were findings analyzed?

(statistical analysis, generation of common themes, benchmarked with previous data)

How were findings communicated to staff in your department? (staff meeting, retreat, email, etc)

Actions taken as a result of findings (revised training, revised curriculum for workshops, revised materials, development of a new instrument, revised instrument, etc)

1:Communication Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Addition of different types of communication trainings at SOLC, revised instrument for SOLC, more intentional communication about skills attained at SOLC, creation of Advisor Newsletter and Meetings

2: Reasoning Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Creation of the Leadership Library to provide students academic tools to assist in reasoning skills, need for more analytical thinking based workshops at SOLC

3: Leadership Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Continuation with SOLC Student Chairs to provide a comprehensive leadership experience and will revise training for those students hired for Fall 2010.

4: Individual Responsibility

Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Creation of the November “Nuts and Bolts” workshop focused on health and balance for student leaders.

5: Social Responsibility

Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Offerings of sessions at SOLC on sustainability and social responsibility

6: University Responsibility

Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Continuation of “Involvement Days” and creation of “Student Organization Spotlight” to cultivate an overall university connection and “SOAL Mates Awards” to recognize staff members’ commitment to the student organization community

For Spring 2010, please indicate which learning outcomes were the focus of data collection, type(s) of assessment was/were utilized, and results.

L.O. # Was data collected in Spring 10? (yes/no)

Type(s) of assessment utilized (rubric, survey, test, focus group, employee evaluation, etc)

Findings (how many students participated in assessment, most significant findings, summary of themes and/or actual data if available)

1:Communication No Written Assessment (Pre and Post Assessment) and Surveys

2: Reasoning No Written Assessment (Pre and Post Assessment) and Surveys

3: Leadership Yes Written Assessment (Pre and Post Assessment) and Surveys

New Student Organization Orientation: 93% of attendees believed they gained leadership skills from their experience at the orientation. Appeals Student Organization Orientation: 91% of attendees believed they gained leadership skills from their experience at the orientation.

4: Individual Responsibility

No Written Assessment (Pre and Post Assessment) and Surveys

5: Social Responsibility

No Written Assessment (Pre and Post Assessment) and Surveys

6: University Responsibility

No Written Assessment (Pre and Post Assessment) and Surveys

Page 3: Spring 2009 Learning Outcomes Assessment Report for ... · 2009-2010 Assessment Report for Division of Student Affairs . ... test, focus group, ... SOAL Team Meetings, Post Program

For Spring 2010, please indicate if findings noted above were discussed in your department and/or what actions have been taken in response to the findings. L.O. # How were findings analyzed?

(statistical analysis, generation of common themes, benchmarked with previous data)

How were findings communicated to staff in your department? (staff meeting, retreat, email, etc)

Actions taken as a result of findings (revised training, revised curriculum for workshops, revised materials, development of a new instrument, revised instrument, etc)

1:Communication Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Began devising methods for alternative forms of communication with students (media clips, electronic documents), conducted follow up meetings with all New and Appeals groups for 2009-2010 to discuss stronger communication strategies, work with Student Organization Advisors to assist in communication training and advisement, creation of the Curriculum Advisory Board for SOLC, will be offering a Competency on “Individual Growth” at SOLC that will include training on Communication

2: Reasoning Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Began recruitment of 2010 SOLC presenters to include problem solving sessions, creation of the Curriculum Advisory Board for SOLC, conducted follow up meetings with all New and Appeals groups for 2009-2010 to discuss problem solving

3: Leadership Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Developed the leadership library to serve as a resource to student organizations and leaders, began development of advanced training curriculum for SOLC chairs, assessed Nuts and Bolts program and how it can be retooled, merge of SOLC and New Member Experience to provide additional leadership resources, creation of the Curriculum Advisory Board for SOLC, will be offering a Competency on “Individual Growth ” at SOLC that will include training on leadership skills and organization management

4: Individual Responsibility

Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Investigating new methods to deliver Alcohol Education at SOLC, creation of the Curriculum Advisory Board for SOLC, will be offering a Competency on “Health and Wellness”

5: Social Responsibility

Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Developing online process for registrations to cut back on paper consumption, creation of the Curriculum Advisory Board for SOLC, will be offering a Competencies on “Community Involvement” and “Diversity/Multiculturalism” at SOLC, in the process of redesigning the entire Leadership Today curriculum (including the training of facilitators) to be more relevant to the SJSU population

6: University Responsibility

Benchmarked with previous data, generation of common themes, analysis and tracking of qualitative remarks

Staff meetings, SOAL Team Meetings, Post Program Narratives, Committee Planning Meetings

Implementation of “Involvement Days” to create an overall university connection, creation of the Curriculum Advisory Board for SOLC, will be offering a Competency on “Community Involvement” at SOLC as well as building in networking opportunities within the groups on the day of the program

For Fall 2010, please indicate which learning outcomes will be the focus of data collection and what type(s) of data collection will be utilized. L.O. # Will data be collected in Fall 10? (yes/no) Type of assessment utilized (rubric, survey, test, focus group, evaluations, etc)

1:Communication Yes Student Organization Leadership Conference, New Student Organization Orientations, SOLC Student Chairs Programs, Leadership Today 2011, Nuts and Bolts for Student Organizations, Advisor Meetings will use evaluations that will include satisfaction based questions and direct assessment

2: Reasoning Yes Student Organization Leadership Conference, New Student Organization Orientations, SOLC Student Chairs Programs, Leadership Today 2011, Nuts and Bolts for Student Organizations, Advisor Meetings will use evaluations that will include satisfaction based questions and direct assessment

3: Leadership Yes Student Organization Leadership Conference, New Student Organization Orientations, SOLC Student Chairs Programs, Leadership Today 2011, Nuts and Bolts for Student Organizations, Advisor Meetings will use evaluations that will include satisfaction based questions and direct assessment

Page 4: Spring 2009 Learning Outcomes Assessment Report for ... · 2009-2010 Assessment Report for Division of Student Affairs . ... test, focus group, ... SOAL Team Meetings, Post Program

4: Individual Responsibility

Yes Student Organization Leadership Conference, New Student Organization Orientations, SOLC Student Chairs Programs, Leadership Today 2011, Nuts and Bolts for Student Organizations, Advisor Meetings will use evaluations that will include satisfaction based questions and direct assessment

5: Social Responsibility

Yes Student Organization Leadership Conference, New Student Organization Orientations, SOLC Student Chairs Programs, Leadership Today 2011, Nuts and Bolts for Student Organizations, Advisor Meetings will use evaluations that will include satisfaction based questions and direct assessment

6: University Responsibility

Yes Student Organization Leadership Conference, New Student Organization Orientations, SOLC Student Chairs Programs, Leadership Today 2011, Nuts and Bolts for Student Organizations, Advisor Meetings will use evaluations that will include satisfaction based questions and direct assessment

Based on your assessment experience in 2009-10, what changes (if any) do you plan to make for 2010-11? (instrument, analysis, communication to staff, etc) I would recommend that all teams within Student Involvement select a few questions (directly related to SI’s learning outcomes) to be used in all program assessments. This continuity would allow us to cross assess our office as a whole and provide more structured direction for the teams. For 2009-10, please indicate any satisfaction assessments that were completed for your department. Date and type of assessment (survey, focus group, etc)

What areas were assessed related to satisfaction? (services, service hours, customer service, etc.

Findings (# of students who responded, response rate, summary of themes, etc)

Fall Student Organization Faire: September 2, 2009

Check In, Program Satisfaction Check-in was easy and efficient: 96% Attendees Agreed Club spent time planning and delegating: 90.1% Attendees Agreed Event helped my org promote upcoming events: 89.5% Attendees Agreed Event communicated the purpose of my student org: 94.3% Attendees Agreed Event helped my org recruit new members: 88.3% Attendees Agreed Event helped me learn about other student orgs: 82.3% Attendees Agreed

Fall Advisors Reception: October 15, 2009

Program Satisfaction, Information Gathering

Overall themes: Prefer more structured meeting vs “meet and greet”, wanted to know about the resources on campus for advisors

Spring Advisors Meeting: January 29, 2010

Program Satisfaction, Information Gathering

Overall themes: Appreciated all the information shared (Risk Management and Officer Transition Tips), Would like more information on fundraising and finance

Spring Student Organization Faire: February 3, 2010

Check In, Program Satisfaction Check-in was easy and efficient: 97% Attendees Agreed Club spent time planning and delegating: 82.1% Attendees Agreed Event helped my org promote upcoming events: 91% Attendees Agreed Event communicated the purpose of my student org: 95.4% Attendees Agreed Event helped my org recruit new members: 84% Attendees Agreed Event helped me learn about other student orgs: 87.2% Attendees Agreed

2009-2010 New Student Organization Recognition Process (Fall and Spring Groups):

Service Satisfaction, Information Gathering

Summary of Significant Information: 1. How did your group know about the process to start a new student

organization at SJSU?: 50% SI Website, 37.5% SJSU Faculty/Staff, 37.5% Knew from experience

2. What did your organization spend the most time?: 50% Developing constitution, 25% Acquiring Membership

3. Who completed the majority of your student organization recognition application?: 75% President

4. How useful was the first “Drop In Meeting”?: 100% Very Useful/Somewhat Useful

5. How often did you meet with your student organization advisor this semester?: 62.5% 1-3 Times, 25% 9+ Times, 12.5% Never

6. Of the topics covered at the New Student Organization Orientation session, which areas did you find most useful?: 62.5% University Resources, 62.5% On Campus Events Scheduling, 62.5% AS Funding Process, 50% Recognition Info, 50% Banking Info, 50% Student Organization Policies

7. Overall, how difficult was it for your group to participate in the New Student Organization Recognition process?: 50% Very Easy/Easy, 50% Neutral

Page 5: Spring 2009 Learning Outcomes Assessment Report for ... · 2009-2010 Assessment Report for Division of Student Affairs . ... test, focus group, ... SOAL Team Meetings, Post Program

Spring 2010 Appeals Recognition Process:

Service Satisfaction, Information Gathering

Summary of Significant Information: 1. Why did your organization not complete the Fall 2009 Recognition Process?:

75% Former Leaders did not update information with SI, 25% Did not know to renew, 25% Did not know how to renew

2. How did your group know about the process to start a new student organization at SJSU?: 50%% SJSU Faculty/Staff, 33.3% Email/Call from SI, 33.3% Advisor

3. What did your organization spend the most time?: 33.3% Developing constitution, 33.3% Acquiring Membership

4. Who completed the majority of your student organization recognition application?: 83.3% President

5. How useful was the first “Drop In Meeting”?: 83.3% Very Useful/Somewhat Useful

6. How often did you meet with your student organization advisor this semester?: 50% 4-8 Times, 33.3% 1-3 Times, 16.7% 9+ Times

7. Of the topics covered at the New Student Organization Orientation session, which areas did you find most useful?: 83.3% University Resources, 33.3% On Campus Events Scheduling, 50% AS Funding Process, 66.7% Recognition Info, 50% Banking Info, 16.7% Student Organization Policies

8. Overall, how difficult was it for your group to participate in the New Student Organization Recognition process?: 50% Easy, 50% Neutral

For 2009-10, please indicate any other assessment activities that took place in your department (usage, demographics, event participation, etc). Student Organization Recognition Banquet: Feedback was compiled during follow-up meetings with the SOAL staff, student assistants, and Club Sport coordinator. These points will be utilized in the early planning for the 2011 Student Organization Recognition Banquet and will also include input from Fraternity and Sorority Life. Positives - Introduction video for the banquet was a fun addition - First time having the SJSU President speak and attend the event; giving it further prestige - Décor and set up was unique. Runway made recipients feel appreciated and special, gave the “wow factor”, and alternating blue and yellow table

cloths & orchids was beautiful and classic - Full house attendance (over 300); more advisors present during this year’s banquet - Enjoyed the President student speaker – short, relevant, and fun - Video aspect & slideshow for new & small student organizations was a nice addition. Will want to keep the new student organization spotlight as a

standard aspect of the program. - Including student assistants in the planning process, which gave the program a fun and creative edge - Having a theme and name for the awards, the “Sammy Awards”, made the event more memorable and cohesive Changes - Application Process

o Use Microsoft Word instead of .pdf for the applications to ensure greater accessibility o Target the marketing to all listed officers, not just Presidents o Increase personalized marketing and presentations to applicants from historically low classifications (i.e. recreation/leisure) o Focus flyers and marketing material for professional/academic organizations in the college’s center and office o Upload all selection committee files onto an online file sharing website instead of using CDs o Create an brief application form for selection committee members to have it feel more official

- Program: o Keep the audience engaged more during the awards segment and to have them stay the entire duration

Need award description and overview for Club Sports and FASL Create video to introduce the Club Sports & Greek community

o Create a unified structure versus having different parts of the program coming together Consistent format for video introductions (initial MC introductions, Club Sport video, slideshows, etc)

o Screen performers with content guidelines to keep the event tasteful and with clean material o Possible keynote instead of having the President or administrator speak. Have a dynamic off campus speaker (maybe alumni) open the

event. o Shorten award descriptions (maybe less time on award descriptions and instead have more time for winner to give thanks) o Maybe have 2 performances instead of 3 in the interest of time o Look into obtaining a Spartan Daily ad and press release early to ensure greater coverage o Have a conversation with Athletics on modifying or keeping the Sammy Award name

- Set up: o Include ADA accessibility description on the poster ; ensure ADA ramp is included in Event Services meeting o Shorten ramp to accommodate stage and performance area (cut the runway in half) o Make actual announcement for recipients to walk down the stage to receive award.

Create a formalized receiving ceremony (handshake, award, photo, etc.)

Page 6: Spring 2009 Learning Outcomes Assessment Report for ... · 2009-2010 Assessment Report for Division of Student Affairs . ... test, focus group, ... SOAL Team Meetings, Post Program

o Lighting in the back makes it seem less “formal.” Move step and repeat photos back to side stage area o Needed more assistance from the SU staff. Early mike set up and clearly instructed stage arrangement for the performers (i.e. moving the

podium during performances) - Check - In:

o Streamline check-in process (signage for club names, different lines for various groups – Club Sports, Advisors, Staff, etc.) o Have pre-packaged plates for administrators and special guests (i.e. President, off-campus guests) , or earlier admission for the RSVP area

- Program AV/Tech: o Have music files prepared on CD (or USB) o Ensure laptop has updated software and is compatible with Apple iMovie for the slideshow

Look into borrowing Event Center’s AV laptop o Earlier set-up time for AV is needed (at least 1 hour prior to the event)

OTHER SORB Data: Applicants were asked to check the marketing methods that reached them regarding the Student Organization Recognition Banquet. Question: How did you hear about the awards? (check all that apply)

Email 37 76%

Word of Mouth 10 20%

Website 15 31%

Flyer/Banner 10 20%

Presentation 0 0%

Past Applicant 14 29%

Advisor 0 0%

Total respondents 49 Award Packet Applicants by Organization’s Position. Question: Please check whether you are: Member or Officer (state position)

Member 1 2%

Advisor 4 7%

President 27 47%

Secretary 5 9%

Vice President 8 14%

Treasurer 2 3%

Other 12 21%

Total respondents: 58 Number of Award Applicants by Student Organization Categories:

Professional/Academic: 23 40%

Fraternity: 3 5%

Sorority: 4 7%

Governance/Advisory: 3 5%

Honorary: 2 3%

Religious/Spiritual: 3 5%

Arts/Entertainment/Publication: 2 3%

Cultural/Int'l/Social Justice: 11 19%

Political: 1 2%

Service: 4 7%

Club Sports 2 3%

Total 58