10-10-04_04 Tim Lawrence Skill Connect Assessments

Skill Connect Assessments

Industry-driven employability assessments for the

next generation

NASESManchester, New Hampshire

October 4, 2010

2

AgendaToday’s discussion:

• Assessing STEM-related employability skills– Technical Assessments

– Teaching employability skills

– STEM and 21st Century Skills Related Assessments

– Q&A

But first…

• Thank you for your support!

3

4

Another Year of Growth

5

FY10 GrowthFY10 Growth

ANOTHER NEW MEMBERSHIP RECORD!

6

All-Time High National Conference

7

Largest Championships Ever

Largest Cash Pledge in History

$9 million to states and chapters

9

Largest World Team in 22 Years

10

44 Skill Connect Assessments

Alumni reached an all time high

Engineering Alliance Launched

13

New Records in Media Exposure

Advocacy on Capitol Hill

16

Social Networking Expanded

SkillsUSA BLOG

17

Highest Ever Grant Support

29 PVSAs Presented

18

Teacher incentives

19

20

FY09 Income

FY09 Revenue = $9.22 million

21

Expenditures

FY09 Functional Expenses = $9.52 million

Student Return on Investment highest ever as $8 National Dues returned a value of $29.76 in programs and services provided

Looking toward the future…

22

Vision 2020

Reach

• Impact the lives of one million students and teachers annually

• 100,000 alumni members

23

24

IMPACT

Vision 2020

Partner Network• A national resource that benefits members,

education and industry• A strong organization positioned to deliver

needed services

25

Vision 2020

Leaders & Experts SkillsUSA is nationally and

internationally known for employability education and workforce readiness leading to career success

26

27

IMPACT

Work Force Ready System

Designed to meet the needs of both education and industry:•Interactive•Industry-driven•Up-to-date•Real-time feedback•Affordable•Meets Perkins IV requirements

The Development Process

What differentiates the Skill Connect Assessments?

• Online, native assessment. (Didn’t originate as a paper-pencil test)

• Interactive questions with media-rich content (videos, animation, images)

– More closely assesses student practical knowledge than text-only– More engaging – less test fatigue!

• Screen readers for students with IEPs• Compression technology minimizes

bandwidth issues• Developed through a rigorous,

educationally-sound process– Based on critical competencies, standards and criteria as defined

by industry– Comply with standards for testing

31

The development process

A rigorous, sound process monitored

closely by a team of psychometricians…

1. Validation of the technical standard

2. Construction of the assessment matrix

3. Validation of the assessment matrix

4. Assessment item development

5. Validation of assessment items

6. Field testing (pilots)

7. Analysis of field test results

8. Deployment

Assessments

32

Available Now3D Visualization & AnimationAdvertising DesignArchitectural DraftingAudio-Radio ProductionAutomated Manufacturing TechnologyAviation Maintenance (Secondary)Aviation Maintenance (Post-Secondary)CabinetmakingCNC Milling and Turning TechnologyCommercial BakingComputer Maintenance TechnologyComputer ProgrammingCosmetologyCulinary ArtsEmployabilityInternetworkingMajor Appliance RepairMechatronicsMedical AssistingMotorcycle Service TechnologyNail CareNurse AssistingPhotographyPlumbingPower Equipment TechnologyPractical NursingResidential WiringRoboticsTechnical DraftingTelevision Video ProductionWelding

Available Now (Co-brand)ASE-AYES-SkillsUSA Co-brandAutomotive RefinishingAutomotive Service TechnologyCollision Repair TechnologyDiesel Equipment

CarpentryCustomer ServiceCriminal Justice/CSIEngineering TechnologyElectronics Application & TechnologyMarine Service TechnologyMasonryScreen Printing Technology

In developmentDental AssistingHVAC & Refrigeration

33

How They Can Be Used

How they’re used

• Focus is on the students• Candidates prove skills and knowledge

to instructors and employers• Support instructional programs as

– Pre-assessments– End-of-program evaluation– Prepare for industry certification

(on-ramp) • Instructors demonstrate the value of

their programs

Feedback

What was liked best

37What did you like best about the Skill Connect Assessments?*Based on 327 participants in a survey at NLSC

38

Students related

• “The Skill Connect Assessment is much easier than the assessment we’ve been using. I liked the colors, and it’s just a better assessment. Students related to it better than any other assessments they have taken. It was so nice to have the results in the same day! This seems like the way to go with assessments in the future.”

– Dave OwensBarry Tech, NY

39

More accurate than written exam

• “It was better than taking a written exam. The interactivity made it a more accurate presentation to help me understand the questions and answers.”

– Joshua, Student N. Kansas City School District, MO

Easy to administer and navigate

23

If you took the test, please rate your experience with the test based on the following criteria.

How the assessments work…

How the test works

• Each assessment includes approximately 50 questions of different question types– 4 equivalent forms (A, B, C, D) for item security– A student takes only one form

• Tests are all online• Approximately one hour to administer• Students and instructors get immediate

results• Skill Connect Certificates available

immediately for students who achieve industry-defined cut score

42

Skill Connect Certificates

Competency areas fromnationalindustry standards

Companylogos

Teaching 21st Century Skills

47

Employabiity skills blueprint

48

Robust reporting

• Robust, real-time and dynamic reporting – reports available immediately after assessments submitted

• All reports can be printed AND exported to a CSV file (Excel readable)

• Course (school)-specific reports for teachers

• Aggregated reports for administrators

49

50

Shows final grades for students in a course (assessment), as compared to the course, school, state and national average.

50

Assessment Grades (course)

Assessment Grades (Aggregated)

51

Shows administrators the # of submissions and average score per assessment form. (Missouri in this case)

Certificates Issued

52

Shows teachers how many students in a school received certificates for an assessment vs. how many were ineligible. Also shows cut rate, # of users who took the test form and average score per form.

Certificates Issued (Aggregated)

53

Shows administrators the number of certificates issued for each assessment form per school and per state.

Competency Profile

54

Details student progress per competency, including the # of questions answered per competency and average score. Can be used as a skills gap analysis.

Demo Skill Connect Assessments

55

To see 10-question mini-assessments in 44 areas:• Open your browser and go to http://www.skillconnect.org.

• Click Self-enroll to system on the right-hand side of the page.

– Enter your personal details.Enter demo in the Enrollment Key field.

– Click Create my new account.

• Log in with the username and password you just created.

Thank you NASES for your interest in Skill Connect Assessments

Industry-driven assessments for the next generation