Compliance Training Done Well Using Mobile and the xAPI

807 - Compliance Training Done Well Using Mobile and the xAPI

mLearnCon 2015, Austin, TX

Jon BrastedStaff Mobile Learning Engineer, Qualcomm

2

Agenda

Discussion: How can you improve compliance training in your workplace?

Case study: Preventing Sexual Harassment web app

Tips for your future compliance training

Introduction

Compliance Training challenges

1

3

4

6

Lessons learnt5

2

3

Qualcomm employee landscapeOver 31,000 employees

~65% have engineering backgrounds

181 worldwide locationsHeadquartered in San Diego, CA65% of employees located in USA35% of employees located internationally

4

Qualcomm mobile learning team focus

Developing and licensing apps to make work life easier

Supporting other teams with mobile initiatives, like compliance training

Making mobile content available wherever and whenever our employees need it

5

Agenda

Discussion: How can you improve compliance training in your workplace?

Case study: Preventing Sexual Harassment web app

Tips for your future compliance training

Introduction

Compliance Training challenges

3

4

6

Lessons learnt5

1

2

6

Image credit: http://dilbert.com/strip/2003-07-22

7

Challenge 1: Compliance Training and auditing is critical to every organization

1 http://www.ponemon.org/local/upload/file/True_Cost_of_Compliance_Report_copy.pdf2 http://www.trainingmag.com/importance-improving-quality-compliance-training

Non-compliance is very expensive1

A recent study by the Brandon Hall Group showed that 49% of organizations surveyed considered compliance training to be either a priority or critical to their business2

Compliance Training challenges

8

Challenge 2: Decision-makers have limited hours available for training

How do you best use your learner’s time?53% of decision makers listed having limited time for training *Time restrictions for training complianceIn-person and online often requires a fixed block of time

Compliance Training challenges

* http://blog.navexglobal.com/2014/05/28/four-surprising-ethics-compliance-training-statisticsImage credit: http://previews.123rf.com/images/dirkercken/dirkercken1110/dirkercken111000046/10806627-time-limit-icon-tight-schedule-limited-hours-and-urgent-deadline-clock-indicating-countdown-Stock-Photo.jpg

9

Challenge 3: E-learning and course vendors are often not adapting quickly enough

Hard to find good vendors who produce engaging, mobile-ready coursesA lot of courses are only available via desktop

Compliance Training challenges

There are a few very promising vendors that we have recently started to work with.inkling – great authoring tool and content delivery platform: mobile-ready, mobile responsive

Image credit: https://upload.wikimedia.org/wikipedia/en/1/1c/Inkling_company_logo.png

10

Challenge 4: New generation of constantly mobile connected learners

The old training paradigms are not be as well accepted as before

Why only offer in-person or desktop courses?Learners are used to bite-sized, ‘on-the-go’ training

Compliance Training challenges

Image credit: http://cdn.makeuseof.com/wp-content/uploads/2015/02/bite-sized-learning-840x420.jpg?7b0931

11

Challenge 5: Budget constraints

How do you best use your budget to deliver your desired training outcomes?

Budgets are shrinking or staying flatVendor-provided solutions often incur ongoing license costs

Compliance Training challenges

Image credit: http://westorlandonews.com/wp-content/uploads/2011/07/budget-cuts-.jpg

12

Agenda

Discussion: How can you improve compliance training in your workplace?

Case study: Preventing Sexual Harassment web app

Tips for your future compliance training

Introduction

Compliance Training challenges

4

6

Lessons learnt5

1

3

2

13

Case study: Preventing Sexual Harassment web appCalifornia requires mandatory Preventing Sexual Harassment training

All managers with direct reportsTwo hours training every two yearsQualcomm has over 4500 line-managers in California

Image credit: http://www.nclc.org/images/graphics/issues/california.png

14

Case study: Preventing Sexual Harassment web appSolution one – commission in-person training

Two hour in-person group session taught by Qualcomm Legal representatives− Challenging to arrange time for 20 to 30

managers to meet concurrently− Hard to retain concentration and

engagement

Image credit: http://piciandpici.com/wp-content/uploads/2013/04/bored-people1.jpg

15

Case study: Preventing Sexual Harassment web appSolution two – buy online (desktop) training

Two hour e-learning desktop course (from third party vendor)− Have to complete in one sitting – cannot

pause and resume− Hard to retain concentration and

engagement− Six-figure annual license cost for a

company like Qualcomm

Image credit: http://www.freeimages.com/pic/m/l/le/len-k-a/328927_working_with_laptop_3.jpg

16

Case study: Preventing Sexual Harassment web app

Accessible on mobile any time, anywhere2 hour course content split into 12 easy-to-digest chaptersCourse content delivered through videos and quizzes created by Qualcomm Legal representatives− Use it as an opportunity to teach Qualcomm culture

and values− Easy for Qualcomm to update the content

Automatically synchronizes user progress across multiple devicesUtilizes Experience API (xAPI) for detailed compliance trackingRecords completed progress in Qualcomm’s LMS

Solution three – build our own mobile web app course

17

Case study: Preventing Sexual Harassment web app

Uses Rustici Software’s TinCanJS1 and Rustici SCORM Engine2

Utilizes verbs from ADL's xAPI Vocabulary3 and W3C Activity Vocabulary4

We use verbs like:− initiated− launched− read− played and paused− satisfied− completed

Uses xAPI Extensions to store detailed tracking data− Video duration

1 https://github.com/RusticiSoftware/TinCanJS2 http://scorm.com/scorm-solved/scorm-engine/3 http://adlnet.gov/expapi/index.html4 http://www.w3.org/TR/activitystreams-vocabulary

Solution three – build our own mobile web app course

18

Employees can access content, and courses from both mobile, and non-mobile devices. Transition between devices is fluid, as all progress data is stored in the Qualcomm cloud, in the Learning Record Store (LRS).

Mobile progress data from the LRS can be synced regularly with traditional, internal HR systems for full compliance monitoring

LRS LMS

CompanyFirewall / Network

App Server

Case study: Preventing Sexual Harassment web appSolution three – build our own mobile web app course

19

Agenda

Discussion: How can you improve compliance training in your workplace?

Case study: Preventing Sexual Harassment web app

Tips for your future compliance training

Introduction

Compliance Training challenges

6

Lessons learnt5

1

2

4

3

20

Tips for your future compliance trainingWhat you should expect / request from a vendor

Availability on mobile any time, anywhere

Easily digestible material split into bite-sized chunks (video: 4 – 12 mins max)

Make the content interesting− Can be used as an opportunity for teach

about additional topics

Auto-resume content (video, audio, application page/position)

21

Tips for your future compliance training

Allow users to start, pause and resume the training

Automatically synchronize user progress across all devices

Utilize Experience API (xAPI) for detailed compliance tracking− Use well defined verb lists

− ADL's xAPI Vocabulary− W3C Activity Vocabulary− CMI5 when it is available later this year

− Store detailed tracking data with xAPI Extensions

What you should expect / request from a vendor

22

Agenda

Discussion: How can you improve compliance training in your workplace?

Case study: Preventing Sexual Harassment web app

Tips for your future compliance training

Introduction

Compliance Training challenges

6

Lessons learnt

4

1

2

3

5

23

Lessons learntWe have experienced some struggles…

Get buy-in from your HR, Legal and compliance teams− Make them part of the decision process− Encourage them to take ownership / part-credit, if possible

Show the ability for clear auditing− Experience API− Analytics

Image credit: http://www.adlnet.gov/wp-content/uploads/2013/06/xAPI-transparent_300px.pngImage credit: http://marketingland.com/wp-content/ml-loads/2014/02/analytics-600.jpg

24

Lessons learntWe have experienced some struggles…

Test and then re-test the technical connections between the training application and your LMS− Initial design: send data directly to LRS− Data messages are small, but critical

− One lost message could be the flag to mark completion− Sometimes the tracking messages got “lost” in transit

LRS LMS

CompanyFirewall / Network

App Server

25

Agenda

Discussion: How can you improve compliance training in your workplace?

Case study: Preventing Sexual Harassment web app

Tips for your future compliance training

Introduction

Compliance Training challenges

5 Lessons learnt

4

1

2

3

6

26

How can you improve compliance training in your workplace?

27

WorkLearnMobile.org

Case StudiesTrends and ideas

News & ViewsInsights from Qualcomm’s m-

learning team

ResourcesLinks to m-learning info

Expert InsightsFree advice from experts

28

A small plug…Join me and a colleague for DemoFest, 5pm to 7pm

Qualcomm’s Patent Wall Experience – Jon Brasted and Anurag Jain− Demo and explanation of our Patent Wall Experience application, powered by Qualcomm’s Vuforia mobile vision

platform and Unity3D.

Image credit: http://www.elearningguild.com/assets/images/MLC15/logos/mlearning-demofest-wisetail_200.png

29

Thank You!