Byod! making mobile assessments work for you(chicago e learning13-ipad final)

Copyright © 1995-2013 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

BYOD! Making Mobile Assessments

Work for You

Jeff Place

[email protected]

mailto:[email protected]


. . . a digital person in an analog world!


Agenda

Get Your Smart Phone Ready! A Real-life Mobile Experience Potential Applications for Mobile

Delivery Creating a Mobile Philosophy Case Study Practical Tips for mLearning Required Functionality for mLearning


Test for Learning

The purpose of this quizzing is not to

motivate students to pay attention and to

study more; if those things happen, the

researchers say, they are nice side effects.

The real point is that quizzing, if done

correctly, is a uniquely powerful method for

implanting facts in students' memory.

David Glenn: You Will be Tested on This Researchers are dusting off an old insight:

To maximize classroom learning, quiz early and often


Types of Assessments


The Role of Assessment in the Learning Process

Retrieval = Learning – Forgetting

Advantages of Questioning

Provides cue for your search and retrieval process

Obvious: The question

Less obvious: The environment

Assessments provides search and retrieval

practice

Stimulus Search Action


Get Your Smart Phone Ready!


9


The Big Switch – Survey

http://goo.gl/lrlcy

http://goo.gl/lrlcy


What are QR Codes?

QR = Quick Response

Type of barcode

Allows more data than traditional barcode

Used in marketing, advertising, entertainment

Increasing use in elearning/mlearning


Apps to Scan QR Codes

www.url.com/xxx

iPhone • Redlaser • Neoreader • ScanLife

Android • Google

Goggles • QR Droid • Scanlife

Windows Mobile

• QR Reader • BeeTag • Quickmark

Blackberry • ScanLife • BeeTag • QR Code

Scanner


Enables quick launching of quizzes and course evaluations

Benefits •Ease of access for increased response rates •Demographic data easily captured •Better data accuracy •Easier analysis of survey results by demographic


QR Codes for Launching Assessments

Course evaluation example: • Embed demographic data in the URL to be saved to

“special fields” in the assessment results, e.g. o Course name o Instructor name o Location

If you are delivering a survey (or course evaluation), QR Codes can help by: • Increasing response rates because… o Quick and easy to access the right URL (no typing required)

• Increasing data captured allows… o Data easily captured (no typing required) o Easier analysis of survey results by demographic


Example Use Case

Company X is delivering onboarding training sessions at 8 locations with several different instructors

Attendees don’t have immediate access to workstations/laptops but are equipped with smartphones

Each location includes a unique QR code at the training location (or on handouts) for attendees to scan

QR Code contains survey URL including demographic parameters such as o Instructor name o Location

Survey/Course Eval reports can than provide analysis with breakdown/comparison by relevant demographic


How Do You Make a QR Code?

http://ipad-emulator.org/

https://ondemand.questionmark.com/399331/delivery/open/?SESSION=0748345875025265&NAME=TheBigSWitch

http://goo.gl/

http://goo.gl/

http://goo.gl/

http://goo.gl/




http://goo.gl/


Potential Applications for Mobile Delivery

Deliver to the device in your

hand

Observational assessments

Mobile test centers


Mobile Apps

Android

iPhone, iPad and iPod touch

http://itunes.apple.com/us/app/questionmark-for-ipad/id377556777?mt=8

http://play.google.com/store/search?q=questionmark+measure+knowledge+skills+certification&c=apps


Demonstration

App

https://ondemand.questionmark.com/398609/participants

https://ondemand.questionmark.com/398609/observer

http://ondemand.questionmark.com/398609/participants


Observational Assessment

Example Applications


Uses of Observational Assessment

Certification Process •Observational assessments can be used as critical

components of the certification process – in some cases are required by regulatory authorities.

Medical and Dental School exams: •Medical and dental schools make extensive use of

observational assessments such as the Objective Structured Clinical Examination (OSCE).

Equipment operation: •Observational assessment can be used to record and rate

operators' skills, abilities, safety practices and adherence to required procedures


Demonstration








Mobile Test Centers

Use notebooks/3G laptops/iPads to create mobile test centers

Enables greater flexibility in where you deliver assessments

Assessments can be conducted in ‘on location’ environments


“Securing” an iPad…

An app should prevent candidates from easily getting to other URLs

But – access to “home button” allows task-switching

Hardware solutions are available to enable use of iPad in a “kiosk” mode


Questionmark Secure One Setting – Multiple Platforms

Slide 25

Windows

Mac

iPad

Printing

Screen capture

Task switching

Control/system keys

Right-click / context menu options

View source

Accidentally exiting exam

Prevents….


Kiosk Mode Apps

Mobile Kiosk App

• Lockdown to a website • Allow linked websites • Custom message if linked website is

not allowed • Back to home timer • Browsing limit timer • Custom message when browsing time

limit is reached • Show address bar • Show forward / back page navigation

arrows • Digital signage mode (non touch) • Scale pages to fit • Clear local HTML presentation files

Padlock App

Kiosk Pro App


Tablet Enclosures

27


Considerations:

The higher the stakes, the higher the propensity to cheat –still require human monitoring!

Bandwidth – Be sure to test the wifi and/or 3G signal strength prior to event


Creating a Mobile Learning Philosophy


Dive In!


Assessment Planning

• Survey

• Learning Check

• Quiz

• Test

• Observation


Perform an analysis

Develop assessment goals

Select assessment type for each goal (Survey, Quiz, Test, Exam)

Develop measurable objectives

Develop Questions

Develop Assessment

Administer assessment

Analyze results

Improve or complete as required

Developing an Assessment Plan

The nature of these activities will vary depending upon the type of assessment you are creating.


Slide 33

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=jSmNzUHVDl5ObM&tbnid=eDgvwi9Ao6faHM:&ved=0CAUQjRw&url=http://socialmediaseo.net/2010/03/26/facebook-fan-page-become-a-fan/&ei=unmlUYWYHqeJiwKN2oD4Dg&bvm=bv.47008514,d.cGE&psig=AFQjCNGHchOmAXhjVZfGy-haRGQFELtTJg&ust=1369885253634717


Mode of Deployment


Implement Develop Design Evaluate Analyze

Course Planning


Backward Design

Design the Course

Plan Learning Experience

Collect the Content Material

Develop the Assessment

2-4 Essential Questions

Mode of Deployment


Mode of Deployment

Mobile (phone) – short 1-5 minute modules

o Updates on new information o Review of previous curriculum o Learning Check to enhance retention

Video (iPad) – 10-20 minute modules

o Content involves more explanation o Larger volume of content required to present

eLearning (computer) – 15-45 minute modules o Difficult or complex content o Requires interaction and instruction o Higher level of security needed

Classroom – 1hr+


Essential Questions

• Essential Questions – Questions that should be answered after

completion of course (objectives)

• Content – Collection of content needed to answer

essential questions

• Tools – Related tools and/or skills necessary to

communicate content when answering essential questions • videos, charts, models, acronyms, sales

methodology, etc.


The Art of Simplification

“Je n’ai fait celle-ci plus longue que parce que n’ai pas eu le loisir de la faire plus courte”

The present letter is a very long one, simply because I had no leisure to make it shorter.

Blaise Pascal, Provincial Letters


Does anyone have a question?


Any questions?


Questions?



Train on Device

Understand the devices used

Become an expert

Know the limitations


Prepare for the Pain


Case study a. What their Mobile

Delivery needs were

b. How our software addressed those needs

c. Demo of solution

Customer Case Study


Case Study Situation

Vascular Therapies Division

All Sales Reps take training on iPhones/iPads

Solutions solved 1. Quick easy learning/testing sessions

2. Certified on the spot

3. Uses QR Codes on products


mLearning/eLearning Virtual Classroom In-House

Self-based Facilitator-based Experience-based

Knowledge Analyze Synthesize

Recall of information Discuss Information Evaluate Information

Define, Describe,

Reproduce,

Interact, Interpret, Explain Demonstrate, Simulate,

Create

Customer Learning Structure



Products They Use


Practical Tips for mLearning



Back in 2 and 2

If you had 2 minutes to teach your most important concept . . .

Stop Light Learning

1 Main Point – 3 ways

Make it Stick


Develop for the Device

Browser screen – 480 pixels

Graphics – 200 pixels wide

Video – H.264

Audio – mp3 at 22 khz


Lay-Out

Most important goes high and left (4-5 inch square)

Finger size matters (44 x 44)

Place videos last

Avoid Flash

Beware of the “Fold Line”

Font size – 15-22

1 or 2 columns of content/page


Test on the Device

Test

Test

Test


What Else Can You Use?


Required Functionality for mLearning


Responsive Design

Slide 59

2. Device drivers used to format assessment for device/browser

Part

icip

ant

Dev

ices

4. On-the-fly auto-sizing of content and controls

1. Senses device/Browser 3. Sends assessment to browser


Responsive Design

• Will resize the assessment tools/content for optimum fit

• Consider if your assessment content will be affective on smaller screens


Mobile Assessments: Item Types Question Type Apple® Windows Mobile® Blackberry® Android®

Multiple Choice

Multiple Response

Likert Scale

Fill in Blanks

Select a Blank

Matching

Ranking

Pull-down List

Numeric

Text Match

Survey Matrix

Knowledge Matrix

Essay

Explanation

True/False

Yes/No

Adobe Captivate

Adobe Flash

File Upload

Hotspot

Drag and Drop


Text is unreadable and requires participant to zoom and scroll around to see details in image

Text is readable and it is not necessary to zoom or scroll to see image.


Mobile assessments and learning

Adds value to anytime/anywhere learning content

Enables flexible/personalised learning

Encourages social and collaborative learning

Expands your ability to complete assessments in the most relevant and appropriate context

Enables you to leverage devices already in the hands of your participants


Embedding Assessments in Wikis, blogs, portals


Benefits of Embedding in Blogs, Portals, Wiki’s

For Organizations

Focus the learners’ attention

Practice memory recall

Identify what was learned

Provide feedback to assist the learner to: o Correct misconceptions

o Instill confidence

o Point to relevant material

Embrace 70+20+10 with confidence

Easily use assessments throughout the learning process

Provide seamless user experience

Centralized management of assessment content and results

For Learners


Have the technology work for you

Author once – deliver

anywhere Auto-sensing Embedded Mobile Apps


Enterprise Portal – To Analyze the Results

https://ondemand.questionmark.com/399331

https://ondemand.questionmark.com/399331


Thank you for attending!

Jeff Place

[email protected]

mailto:[email protected]


Brief Course Evaluation

Technology

Byod! making mobile assessments work for you(chicago e learning13-ipad final)