Alms analysis presentation

Measuring the Diffi culty of Revising/Remixing OER

ALMS Analysis

First Rule of Delphi Study

http://www.slideshare.net/OpenEdBlogger/

alms-analysis-presentation

Slides Available

http://www.slideshare.net/OpenEdBlogger/alms-analysis-presentation




1.Reuse

2.Revise

3.Remix

4.Redistribute

4R’s

OER Revise/Remix

Photo by Crisitano Betta

Why?

Photo by Greg Westfall.

1.Content

2.Pedagogical

3.Technical

Categories of Difficulty

1.Access to editing tools?

2.Level of expertise required to revise or remix?

3.Meaningfully editable?

4.Source-file access?

Hilton, J., Wiley, D., Stein, J., & Johnson, A. (2010). The Four R’s of Openness and ALMS Analysis: Frameworks for Open Educational Resources. Open Learning: The Journal of Open and Distance Learning, 25(1), 37-44.

ALMS Analysis

http://contentdm.lib.byu.edu/cdm4/item_viewer.php?CISOROOT=/IR&CISOPTR=774&CISOBOX=1&REC=16

http://contentdm.lib.byu.edu/cdm4/item_viewer.php?CISOROOT=/IR&CISOPTR=774&CISOBOX=1&REC=16

1. Break down each part of the ALMS Analysis into parts

2. Requires some technical knowledge and training

3. Apply to a variety OER

Rubric

1 2 3 4

Is appropriate software application pre-installed with the operating system?

No - - Yes N/A

Is an appropriate software application downloadable from the Internet?

Not found through Internet search

Found through significa

nt research

Found through some

research

Found through Internet search easily

Access

Access Part 21 2 3 4

How much does the application cost?

Program cost is

expensive

Program cost is

significant

Some program

cost

No program

cost

N/A

How large is the program to be downloaded?

File to be downloaded

is prohibitivel

y large

File to be download

ed a significant

size

Found through some

research

Found through Internet search easily


Does the program depend on other software or programming libraries?

Program depends on

a large amount of libraries or

other programs

Program depends

on a significant amount of libraries or other

programs

Program depends on some libraries or other

programs

Program does not depend on any

libraries or files

N/A

Is appropriate functionality available from a web-based service?

No Access with

significant restriction

s

Access with some restriction

s

Access with no

restrictions or

sign-up only


Does the program depend on other software or programming libraries?

Program depends on

a large amount of libraries or

other programs

Program depends

on a significant amount of libraries or other

programs

Program depends on some libraries or other

programs

Program does not depend on any

libraries or files

N/A

Is appropriate functionality available from a web-based service?

No Access with

significant restriction

s

Access with some restriction

s

Access with no

restrictions or

sign-up only


How much does the service cost?

Service cost is

expensive

Service cost is

significant

Some service

cost

No service

cost

N/A

Does the service require the user to have an account?

Service requires

extensive account

with major privacy

concerns

Service requires

an account with a

significant amount of informatio

n

Service requires

an account

with some or no

information

Service does not require

an account


Are you able to cut-and-paste the text into a word processor or text editor?

No - - Yes N/A

Expertise1 2.5 4

What degree of text editing expertise is required

Extensive text editing expertise required

(Example: multi-

column layout)

Some text editing expertise required

(Example: footnotes, headers)

Minimal text

editing expertise required

(Example: bolding,

headings)

N/A

What degree of image editing expertise is required?

Extensive image editing

expertise required

(Example: masking,

clone stamp)

Some image editing expertise required (Example: multiple

layers, filters)

Minimal image editing

expertise required

(Example: cropping, brightness/ contrast)

Expertise Part 21 2.5 4

What degree of audio editing expertise is required

Extensive audio


(Example: remixing/re

vising multiple sources)

Some audio editing expertise required (Example: audio

filters, transitions)

Minimal audio


(Example: trimming

and saving in

appropriate format)

N/A

What degree of video editing expertise is required?

Extensive video


(Example: remixing/re

vising multiple sources)

Some video editing expertise required

(Example: transitions, filters)

Minimal video


(Example: trimming

and saving in

appropriate format)

Expertise Part 21 2.5 4

What degree of programming expertise is required?

Extensive video


(Example: data

structures such as Object-

Oriented programmin

g)

Some video editing expertise

required (Example:

functions, if/then statements)

Minimal video


(Example: variable

manipulation, basic

arithmetic)

N/A

What degree of specialty expertise is required?

Extensive specialty expertise required

(Example: Advanced animation

or 3D modeling)

Some video editing expertise

required (Example:

intermediate animation or 3D

modeling)

Minimal video


(Example: basic

animation or 3D

modeling)

Editable1 2 3 4

What portion of the text in the OER is editable? (Example: Text stored independently, not embedded in an image)

No text can be edited

Some text can be edited

A significant amount of text can

be edited

All of the text can

be edited

N/A

What portion of the images in the OER is editable?(Example: Images stored independently, not embedded in a PDF)

No images can be edited

Some images can be edited

A significant amount of

the images can be edited

All of the images can be edited

• What portion of the audio in the OER is editable?

(Example: Audio stored independently, not embedded in a video)

• What portion of the video in the OER is editable?

(Example: Video stored independently, not embedded in a Flash object)

• What portion of the other components in the OER is editable?

(Example: 3D Model)

Editable continued

Source Files1 2 3 4

What portion of the source files for the text in the OER is available?(Example: a Word document available for a PDF)

Text source

files are not

available

Some text source

files are available

A significant amount of the text source

files are available

All text source

files are available

N/A

What portion of the source files for the images in the OER is available? (Example: a Photoshop file with all layers available)

Image source

files are not

available

Some image source

files are available

A significant amount of the image

source files are available

All image source

files are available

• What portion of the source files for the video in the OER is available?

(Example: Video project files)

• What portion of the source files for the programming code in the OER is available?

(Example: Source code downloadable from a website)

• What portion of the source files for the other components of the OER is available?

(Example: FLA files for SWF Flash objects)

Source Files continued

Each category subtotal is the Total score divided by the number of Non-N/A responses

Calculations

Subtotal Score

Access to Editing Tools

3.75

Level of Expertise 3Meaningfully Editable

4

Source Files Available

4

Average 3.69

Delphi Study

1. Reliability

2. Desirability

3. Feasibility

Participants asked to rater each cell, some gave an entire row the same score.

Criteria

Reliability Desirability

Feasibility Mean

Access 2.53 2.99 3.08 2.87

Level 2.97 3.09 2.93 3

Meaningful 3.17 3.41 3.35 3.31

Source 3.07 3.18 3.31 3.19

Total 2.93 3.17 3.17 3.09

1st Round Results

• Concerns about cost of technical reusability.

• Concerns about technical reusability being only one of many values.

• Concerns about properties of the OER itself versus the context in which reuse is occurring.

Comments

1.Possible automated scoring of Access component

2.Revising other components for future Delphi study rounds

3.Rating a sample of OER for inter-rater reliability

Future Directions

Photo by walknboston

Seth Gurell

[email protected]

On Google+ or Facebook

Thank You

mailto:[email protected]