Assignment & Assessment Tool: Feature Review. Goals for Today Quick review of AAM (Assessment Assignment Manager) Introduce Template system for AAM Introduce

Assignment & Assessment Tool:

Feature Review

Goals for Today

Quick review of AAM (Assessment Assignment Manager)Introduce Template system for AAMIntroduce proposed feature set for Assignment/AssessmentGet Your Feedback on featuresDiscuss design for document submission and peer reviewAudience for today’s presentation Instructional Tech Support Staff who can provide

on features in AAM

AAM-What is it?

Tool that replaces the Assignment Tool in CourseWorkDesign focus is on formative assessment (homework)Two areas of emphasis-large lecture courses and language instructionWorking with Michigan and Indiana to build modular, plug-in tool for OKI frameworks

Timeline

June 15, 2003 AAM Alpha Aug 1, 2003 AAM Beta Jan 1, 2004 AAM 1.0Apr 1, 2004 AAM 1.1 (with language and large lecture

interfaces and features)

AAM Team

Design Marc Brierley Charles Kerns Julie Mai Huong Nguyen

Development Rachel Gollub Sherwin Lu Huong Nguyen Qingru Zhang Ganapathy

Subramaniam Daisy Flemming

Communication with AAM Team

AAM Design Blog:http://www.stanford.edu/group/coursework/AAMdesign/

Template Editor

Authoring Templates and Assessments

TemplateFile

ATSCreates

Assessment Editor

AssessmentFile

(Based on Template)

InstructorCreates

Templates

All templates have default characteristics which define release, presentation, evaluation, and feedback. Template characteristics can be set to be: Either displayed or hidden from instructors

and students Either locked or editable by instructors

12 Item Access - Sequential

If Sequential, then one must proceed from web page to web page with no return allowed.Nav buttons for Next page only.

Assessment

Header

Part 1

Next >>

Assessment

Header

Part 1

Assessment

Header

Part 1

Next >>

Done

12- Item Access – Random Access to Parts

If Random Access to Parts, then one may proceed to any “chunk” from Table of Contents but sequential path is avail. Nav buttons for prev and next page.

Assessment

Header

Part 1

Next >> Done

Assessment

Header

Part 1

Assessment

Table of ContentsPart 1Part 2

TOC<< Prev DoneTOC

Assessment

Header

Part 1B

Question 1

Assessment

Header

Part 2

Question 1

Question 2

12- Item Access – Random Access to ItemsIf Random Access to Items, then one

may proceed to any item from Table of Contents but sequential path is avail. Nav buttons for prev and next page.

Assessment

Header

Table of ContentsPart 1A

Q1Q2

Part 1BQ1

Part 2Q1Q2

<< Prev DoneTOC

Assessment

Header

Part 1A

Question 1

Question 2

<< Prev TOC Next >>

TOC Next >>

Assessment

Header

Part 2

Question 1

Question 2

13- Bookmarking of ItemsIf Bookmarking = TRUE, then• toggling bookmark button/flag is located at each question, • a Bookmarks button at bottom of each page, and •A bookmark page has links to each of the bookmarked questions

Assessment

Header

BookmarksPart 1

Q2Part 2

Q1

<< Prev DoneTOC

Assessment

Header

Part 2

Question 1

Question 2

TOC Next >>BookmarksBookmarks

X BM

- BMX BM

- BM

76- Display Chunking

If DisplayChunking = byitem, then each item is displayed on a separate web page

Assessment

Header

Part 1

Question 1

TOC Next >>Bookmarks

Assessment

Header

Part 1

Question 2

<< Prev DoneTOCBookmarks

- BM

- BM

76- Display ChunkingIf DisplayChunking = byPart, then each part is displayed on a separate web page

Assessment

Header

Part 2

Question 1

Question 2


- BM

- BM

Assessment

Header

Part 3

Question 1

Question 2

TOC DoneBookmarks

- BM

- BM

<< Prev

76- Display ChunkingIf DisplayChunking = byMultiPart, then each part is can displayed on a multiple web pages

Assessment

Header

Part 2A

Question 1

Question 2


- BM

- BM

Assessment

Header

Part 2B

Question 3

Question 4

TOC DoneBookmarks

- BM

- BM

<< Prev

76- Display ChunkingIf DisplayChunking = byAssessment, then full assessment is displayed in one web pageAssessment

Header

TOCBookmarks

Part 1

Question 1

Question 2- BM

- BM

Done

Part 2

Question 1

Question 2- BM

- BM

Question 3- BM

Question4- BM

11- Multipart Allowed

If TRUE, then in Assessment Editor:

Assessment

Header

Part 1

Create New Part

If FALSE, then in Assessment Editor:

Assessment

Header

Part 1

Group Access:

Full ClassSectionsAny Class Groups

(Can set access variables for each group)

Assessment Access: When does it become available

ImmediatelyBy Date Release Date

By Action Completion of another assessment Completion of another assessment

with minimum grade

Assessment Access: When is it unavailable?

ImmediatelyBy Date Retract Date

By Action Completion of this assessment

Assessment Access: Where/How is it available?

By IP Address Allowed IP Address List Forbidden IP Address List

By Special Password (for site-located assessments)

Assessment Access: Due Date

At Date No late submissions accepted Late accepted and tagged

No Due Date

Assessment Access: Number of Submissions

Only OneAny number set by instructorUnlimited

(When allowed number of submissions is made then response check boxes, radio buttons, text boxes, etc. change to fixed displays)

Assessment Access: Special Controls for Instructor

Retry-allows instructor to override access settings and to give a student one more submission

Assessment Access: Timed Assessments

Assessment can have time limit from first download.Questions and Parts can also have time limits.

Feedback Access:

Immediate (while taking assessment) Feedback and Score

Feedback Release Dates Score Release Date Solution and Comment Release Date

No Feedback or Scores

14- Feedback Chunking(only valid if ReleaseModel = immediate)

If FeedbackChunking = byitem, then when a response is entered for question 1 the display is automatically updated for the assessment display to show feedback and score information. Most common use will probably be for sections to be displayed one item at a time, but this is not necessary.

Assessment

Header

Part 2

Question 1

Question 2


Assessment

Header

Part 2

Question 1

Question 2


Q1 Feedback (score, feedback)

- BM

- BM

- BM

- BM


If FeedbackChunking = bypart, then when the Next>> button is clicked, the same part is displayed with feedback.

Assessment

Header

Part 2

Question 1

Question 2


- BM

- BM

Assessment

Header

Part 2

Question 1

Question 2

<< Prev Next>>TOCBookmarks


- BM

- BM


Assessment

Header

Part 3

Question 1

Question 2

TOC DoneBookmarks

- BM

- BM

<< Prev


If FeedbackChunking = byassessment, then when the Done button is clicked, the same part is displayed with feedback. After this time, all nav buttons take testee to pages with feedback. Same view as after feedback display date.

Assessment

Header

Part 2

Question 1

Question 2

<< Prev Next>>TOCBookmarks


- BM

- BM


Assessment

Header

Part 3

Question 1

Question 2

TOC DoneBookmarks

- BM

- BM

<< Prev

Assessment

Header

Part 3

Question 1

Question 2



- BM

- BM


To TOC

Evaluation Types:

Item scores Numeric (negative values accepted) ABCDEF/+- Plus-check-minus Completed/not completed

Comments For each question For each part For full assessment

Evaluation by:

Instructor

Section leader

Peer or peer group

Testee

Auto-Scoring

Testee Info Available to Evaluators

Anonymous (false name) Submission Report identifiees submitters

Identified Name SUNet ID Email Address

Score and Total Assessment Values:

Total = Sum of all question scores With default question score

Total Value set with weighted Parts having equal-valued questions Weighting by points Weighting by percent

Total Value set with equal-valued questions in all Parts

Results Distribution:

to section leader

to group

to instructor

to testee

to grade book

to secty

Types of Results that can be distributed:

Combined statistics (summary data)

Anon Resp and Scores

Testee’s personal score

All testees’ responses and scores

Analytic statistics

Objective

Metadata

Rubric

Question

Response

Answer 1

Answer 2

Answer 3 Feedback

Feedback

Feedback

FeedbackHint Eval Comments

Score

%Val

%Val

%Val

MaxValue

KEYInitial Item InformationAdded by Instructor, Testee, Auto-scoring during use

Italicized box can contain multiple types of Multimedia Data

Structure of an Item Name

Type

Name

Type

Related Files & Links

Inline Multimedia

Description

hwork Study quest quiz exam Keywords

Objective

Part 2

Part 1

Assessment

Attributes

Role-RubricRole-Rubric

TemplateTemplate Description

Structure of an Assessment

Name

Layout Type

Related Files & Links

Inline Multimedia

Description

Keywords

Objective

Item 2

Item 1

Part

Attributes

Structure of a Part

Documents

Assignment & Assessment Tool: Feature Review. Goals for Today Quick review of AAM (Assessment Assignment Manager) Introduce Template system for AAM Introduce