3 Year Plan Financial Summary

Using DITA’s Subject Scheme Support for Educational Assessment Content

Edwina Lui Information Architect, Kaplan Publishing

Kaplan Test Prep: Overview

Graduate programs Pre-college programs

Health programs Bar review

Preparation for business, medical, law and graduate admissions exams

Tutoring and test prep for K-8 state test readiness, college prep

solutions, K12 resources for teachers

Professional licensing preparation programs for doctors and nurses

Comprehensive and Multi-State bar review for aspiring lawyers

Publishing Print and digital course and retail materials for all units of KTP

Grad

• BMAT • DAT • GMAT • GRE • GRE Subject Tests

(multiple) • LSAT • MAT • MCAT • OAT • PCAT • UKCAT

Pre-College

• ACT • AP Exams (multiple) • ASVAB • CAHSEE English-

Language Arts • CAHSEE

Mathematics • CLEP • COOP • GED Exams

(multiple) • HSPT • ISEE • PSAT/NMSQT • SAT • SAT Subject Tests

(multiple) • SHSAT • SSAT • TACHS

Health

• CCRN • COMLEX • NAPLEX • NBDE Part I • NBDE Part II • NCLEX-PN • NCLEX-RN • PANCE/PANRE • USMLE Step 1 • USMLE Step 2 CK • USMLE Step 2 CS • USMLE Step 3

Bar Review

• MBE • MPRE • MPT • State exams

Misc.

• IELTS • NYSTCE exams

(multiple) • PRAXIS exams

(multiple) • TOEFL

Kaplan Test Prep: Exams Served

Test Prep Product Components

“Test-Like” Study Materials

Practice Assessment

Information and

Examples

Learning Objectives

“Test-Like” Study Materials

Lesson books, study guides, workbooks Teaching materials, instructor guides

Mobile apps Online interactive learning products

Required Metadata

• Aligned with course curricula • Based on subject or test structure

Learning Objective

• Fixed difficulty level (scale dependent on exam) • Relative, determined by student behavior

across population

Difficulty Level

• Structural/functional types shared across exams • Drives functionality in learning products

Interaction Type

• Classification of content (particularly assessment content) per test structure

Test-Based Classification

Assessment Content Reuse

GRE

Analytical Writing

Quantitative Reasoning

Verbal Reasoning

Reading Comprehension

Sentence Equivalence

Text Completion

SAT

Critical Reading

Reading Comprehension

Sentence Completion

Math

Writing

Uses for Classification of Assessment Content

• Preset count and types of sections • Preset count, types, proportions, and/or sequences of question types

“Test-like” assembly

• Inclusion/exclusion of content based on subject and appropriateness

Content reuse

• Test-specific presentation and labeling • Test- or UI-specific interactivity

Processing

• Faceted search based on hierarchical classification

Search

Known Classification Labels

Known Classification Labels: Cross-Referenced

Related Classification Values

Related Classification Labels

Classification Requirements

•Test • Section •Question Type

Define subject values in three categories

•Test values have only one label each • Section and Question Type values have multiple labels, depending on context

Specify one or more labels for each subject value

•Different related subjects per test •Different subject hierarchy per test

Establish multiple hierarchies

• Section label dependent on Test value •Question Type label dependent on Test and Section values

Specify contextual labels via hierarchical relationship between three categories of values

Discarded Solution: Custom Metadata, User Entry

<!ENTITY % KTPTestName.content "(%KTPSectionType;)?" > <!ENTITY % KTPTestName.attributes "name CDATA 'TestName' %univ-atts; value CDATA #REQUIRED" >

Specialized <data> elements with specified nesting to indicate hierarchy

Require user-entered @value for each specialized <data> element

•Hierarchy indicated, but not controlled ✗ ACT > Quantitative > Analytical Writing ✓ ACT > English > Passage Based Question

•User-entered values allow for human error, variation Quantive vs. Quantitative

Passage-Based Question vs. Passage Based Question

<!ENTITY % KTPSectionType.content "(%KTPQuesType;)?" > <!ENTITY % KTPSectionType.attributes "name CDATA 'SectionType' %univ-atts; value (Analytical_Writing | Analytical_Writing_Assessment | Writing | Writing_Skills) #REQUIRED" >

Discarded Solution: Custom Metadata, Controlled Values

Specialized <data> elements with specified nesting to indicate hierarchy

Controlled values specified to eliminate possibility of typos

•Hierarchy indicated, but not controlled ✗ ACT > Quantitative > Analytical Writing ✓ ACT > English > Passage Based Question

•Term confusion, unwieldy list: 4 similar-sounding values, each appropriate for a different context

Proposed Solution: Multiple Subject Schemes

Test Subject Scheme Map •Define unique classification value for each test • Specify default display label

Section Subject Scheme Map •Define unique classification value for each section by

subject • Specify default display label (shared across most tests)

Question Type Subject Scheme Map •Define unique classification value for each question type • Specify default display label (shared across most tests and

sections)

Subject Scheme Relationship Table • Establish reltable for each

test • Define relationship between

test, section, and question type values

• Specify section and question type values for each test

• Specify display labels (if other than default)

Code Sample: <subjectScheme>

Section Subject Scheme Question Type Subject Scheme <hasInstance> <subjectdef keys="section"> <subjectdef keys="math"> <topicmeta> <navtitle>Math</navtitle> </topicmeta> </subjectdef> <subjectdef keys="reading"> <topicmeta> <navtitle>Reading Comprehension</navtitle> </topicmeta> </subjectdef> <subjectdef keys="verbal"> <topicmeta> <navtitle>Verbal Reasoning</navtitle> </topicmeta> </subjectdef> <subjectdef keys="writing"> <topicmeta> <navtitle>Writing</navtitle> </topicmeta> </subjectdef> </subjectdef> </hasInstance>

<hasInstance> <subjectdef keys="questype"> <subjectdef keys="reading-comp"> <topicmeta> <navtitle>Reading Comprehension</navtitle> </topicmeta> </subjectdef> <subjectdef keys="sentence-correx"> <topicmeta> <navtitle>Sentence Correction</navtitle> </topicmeta> </subjectdef> <subjectdef keys="sentence-equiv"> <topicmeta> <navtitle>Sentence Equivalence</navtitle> </topicmeta> </subjectdef> <subjectdef keys="text-compl"> <topicmeta> <navtitle>Text Completion</navtitle> <shortdesc>Description of cognitive task.</shortdesc> </topicmeta> </subjectdef>

Code Sample: <enumerationdef>

Section Subject Scheme Parent Map <hasInstance> <subjectdef keys="section"> <subjectdef keys="math"> <topicmeta> <navtitle>Quantitative Reasoning</navtitle> </topicmeta> </subjectdef> <subjectdef keys="verbal"> <topicmeta> <navtitle>Verbal Reasoning</navtitle> </topicmeta> </subjectdef> <subjectdef keys=“writing"> <topicmeta> <navtitle>Analytical Writing</navtitle> </topicmeta> </subjectdef> </subjectdef> </hasInstance> <enumerationdef> <elementdef name="KTPSectionType"/> <attributedef name="value"/> <subjectdef keyref="section"/> </enumerationdef>

<acKTPQuesSetMap> <mapref href=“section-subjectScheme.ditamap" type="subjectScheme" format="ditamap"/> <acKTPStimulusRef href=“stimulus.dita"/> </acKTPQuesSetMap>

Stimulus Topic using <KTPSectionType> <acKTPStimulus id=“stimulus"> <title/> <prolog> <KTPmeta> <KTPTestName value="GRE"> <KTPSectionType value=“verbal“/> </KTPTestName> </KTPmeta> </prolog>

Code Sample: <topicsubject> & <subjectref>

Section Subject Scheme Parent Map <hasInstance> <subjectdef keys="section"> <subjectdef keys="math"> <topicmeta> <navtitle>Quantitative Reasoning</navtitle> </topicmeta> </subjectdef> <subjectdef keys="verbal"> <topicmeta> <navtitle>Verbal Reasoning</navtitle> </topicmeta> </subjectdef> <subjectdef keys=“writing"> <topicmeta> <navtitle>Analytical Writing</navtitle> </topicmeta> </subjectdef> </subjectdef> </hasInstance>

<acKTPQuesSetMap> <mapref href=“test-subjectScheme.ditamap" type="subjectScheme" format="ditamap"/> <mapref href=“section-subjectScheme.ditamap" type="subjectScheme" format="ditamap"/> <mapref href=“questype-subjectScheme.ditamap" type="subjectScheme" format="ditamap"/> <acKTPStimulusRef href=“stimulus.dita"> <topicsubject keyref="GRE"> <subjectref keyref="verbal"/> <subjectref keyref="text-compl"/> </topicsubject> </acKTPStimulusRef> </acKTPQuesSetMap>

Section Subject Scheme Parent Map <hasInstance> <subjectdef keys="section"> <subjectdef keys="math"> <topicmeta> <navtitle>Quantitative Reasoning</navtitle> </topicmeta> </subjectdef> <subjectdef keys="verbal"> <topicmeta> <navtitle>Verbal Reasoning</navtitle> </topicmeta> </subjectdef> <subjectdef keys=“writing"> <topicmeta> <navtitle>Analytical Writing</navtitle> </topicmeta> </subjectdef> </subjectdef> <enumerationdef> <elementdef name="KTPSectionType"/> <attributedef name="value"/> <subjectdef keyref="section"/> </enumerationdef> </hasInstance>

<map> <mapref href=“test-subjectScheme.ditamap" type="subjectScheme" format="ditamap"/> <mapref href=“section-subjectScheme.ditamap" type="subjectScheme" format="ditamap"/> <mapref href=“questype-subjectScheme.ditamap" type="subjectScheme" format="ditamap"/> <topicSubjectTable> <title/> <topicSubjectHeader> <topicCell type="stimulus"> <topicref/> </topicCell> <subjectCell type="test"/> <subjectCell type="section"/> <subjectCell type="questype"/> </topicSubjectHeader> <topicSubjectRow> <topicCell> <topicref href="stimulus.dita"/> </topicCell> <subjectCell> <topicsubject keyref="GRE"/> </subjectCell>

Code Sample: <topicSubjectTable>

Code Sample: <subjectRelTable>

Define relationship between test, section, and question type values

Specify values permitted at each level, and contextual display labels

<subjectRelTable> <subjectRelHeader> <subjectRole> <subjectdef keyref="test"> <hasPart> <subjectdef keyref="section"/> </hasPart> </subjectdef> </subjectRole> <subjectRole> <subjectdef keyref="section"> <hasPart> <subjectdef keyref="questype"/> </hasPart> </subjectdef> </subjectRole> <subjectRole> <subjectdef keyref="questype"/> </subjectRole> </subjectRelHeader>

<subjectRel> <subjectRole> <subjectdef keyref=“GRE"/> </subjectRole> <subjectRole> <subjectdef keyref=“verbal"> <topicmeta> <navtitle>Verbal Reasoning</navtitle> </topicmeta> </subjectdef> </subjectRole> <subjectRole> <subjectdef keyref="reading-comp"/> <subjectdef keyref="text-compl"> <topicmeta> <navtitle>Sentence Completion</navtitle> </topicmeta> </subjectdef> </subjectRole> </subjectRel>

Open Questions

Abstract subject scheme classifications

to CCMS

Drive processing based on classification

values applied

Support faceted search based on

hierarchical classification

UI for applying classification to

content

UI for updating/maintaining

subject schemes

Other applications and/or taxonomies

Q&A