RICHARD M. LUECHT PHD · Richard M. Luecht Page 2 EXPERIENCE 1999‐present.Professor, Educational...

Richard M. Luecht Page 1

RICHARDM.LUECHT,PHDBUSINESS HOMEUniversityofNorthCarolinaatGreensboro 5204SouthwindRoadEducationalResearchMethodology Greensboro,NC27455‐2233Rm.240SchoolofEducationBuilding Greensboro,NC27455‐6170Phone: (336)404‐0746(cell) (336)286‐5335(home)E‐mail: rmluecht@uncg.eduAREASOFEXPERTISE Designengineeringandimplementationofcomprehensive,large‐scalecomputer‐

basedtestingsystems Assessmentengineeringoftemplatesanddatamodelsfortestitemsandperformance

assessmenttasks Automatedtestassemblyalgorithmsandheuristics,includingsystemsintegration

withitembankingapplications Computer‐adaptivetesting,includingmultidimensionalitemresponsetheory

applicationsandmultistagetestingapplications Scoringmodelsforcomplexperformanceassessments Standardsettingmethods ItemresponsetheoryestimationtechniquesEDUCATIONPh.D.Degree,SchoolofEducation‐UrbanEducation,UniversityofWisconsin,Milwaukee,WI,1989.MajorinEducationalPsychology(EmphasisonResearch,Measurement&Evaluation)andminorinSpeech&LanguageScience.Dissertationtitle:AComparisonofAppliedMethodsforEstimatingVarianceComponentsunderLarge,RandomEffectsDesignswithUnbalancedData.M.S.Degree,UniversityofWisconsin,Milwaukee,WI,1985.MajorinEducational&PsychologicalResearch,MeasurementandEvaluationB.S.Degree,CarrollCollege,Waukesha,WI,1978.MajorinPsychologyandminorinPoliticalScience

Richard M. Luecht Page 2 EXPERIENCE1999‐present.Professor,EducationalResearchMethodology(Tenured).UniversityofNorthCarolinaatGreensboro,SchoolofEducation,Greensboro,NorthCarolina.DirectoroftheCenterforEducationalResearchandEvaluationatUNCG(1999‐2005).ERMDepartmentChair(Fall1999toSpring2002).DirectorofGraduateStudies(1999‐2002,2011‐present)1994‐1998.SeniorPsychometrician&Director,ComputerizedAdaptiveTestingResearch,PsychometricsDivision,NationalBoardofMedicalExaminers(NBME),Philadelphia,Pennsylvania.1989‐1994.PsychometricianIandPsychometricianII.ACT,Inc.(formerlyAmericanCollegeTesting),IowaCity,Iowa.1984‐1989.Instructor/Lecturer.SchoolofAlliedHealthProfessions,UniversityofWisconsin—Milwaukee,Milwaukee,Wisconsin.1982‐1984.ProposalCoodinator.HarrisCorporation,GovernmentSystemsDivision.Melbourne,Florida.1979‐1982.TestingProgramCoordinator.Manpower,Inc.,Milwaukee,Wisconsin.PROFESSIONALAFFILIATIONS&SERVICEAwards:SamuelJ.MessickMemorialLectureAwardgivenbyEducationalTestingServiceTOEFLProgram,2001.ActiveMemberships:(1)AmericanEducationalResearchAssociation;(2)NationalCouncilonMeasurementinEducation;(3)PsychometricSociety.Also,pastTreasurerofthePsychometricSociety(1991‐1995)UniversityService(UNCG):Chair/co‐chairoffiveERMsearchcommitteesforfacultymembers(1999‐2013).ChairofthefollowingSchoolofEducation(SOE)committees:(1)SearchCommitteeforSOEWeb‐Coordinatorposition(2002);SearchCommitteeforWebandMultimediaServicesposition(2004),SearchCommitteeforERMAssistantProfessors(2006,2010,2012),ERMDepartmentChairposition(2011),ERMAssociate/FullProfessorposition(Eval.,2013);ResearchSymposiumPlanningTaskForce(2002‐3);NominationsandElectionsCommittee(2002‐2006).Memberofthefollowingcommittees:GraduateSchoolDeanSearch(2002);ERMClinicalFacultySearchCommittee(2012)SchoolofEducationDeanSearch(2001);UNCGResearchAdvisoryCommittee,OfficeoftheAssociateProvostforResearch(2002‐present);UNCGCommitteeonCommittees(2002‐2006);UNCGTechnologyTransferAdvisoryPanel(2003‐present);SOECurriculumCommittee(2001‐2003,2005‐present);SOERecruitmentandAlumniRelationsCommittee(1999‐2002);SOE

Richard M. Luecht Page 3 FacultyPromotionsandTenureCommittee(1999‐present);GraduateSchoolFaculty(1999‐present);SOEExecutiveCouncil(1999‐2002);SOEHumanSubjectsCommittee(1999‐2000);SOEFacultyGrievanceCommittee(1999‐2001)ScholarlyService:SoftwareReviewEditorforAppliedPsychologicalMeasurementPastAdvisoryEditorfortheJournalofEducationalMeasurementJournalmanuscriptreviewerforPsychometrika,AppliedPsychologicalMeasurement,InternationalJournalofTesting,ResearchQuarterlyforExerciseandSport,JournalofEducationalMeasurement,MeasurementIssues&Practices,JournalofEducationalandBehavioralStatistics,AppliedMeasurementinEducation,AlliedHealthSciencesEducation,AcademicMedicine,AnnalsofOperationsResearch,andPsychometrikaConferencepaperrevieweranddiscussant:(1)AmericanEducationalResearchAssociation,(2)NationalCouncilonMeasurementinEducation,(3)ResearchinMedicalEducation;(4)theOttawaConferenceonMedicalEducation;(5)theAssociationofAmericanMedicalCollegesGraduateStudentResearchProgramProposalreviewerfortheNationalBoardofMedicalExaminers(NBME)MedicalEducationResearchFund,2000‐2004,2007.ReviewerfortheCreativeIndustriesofNWO,theDutchResearchCouncil,2012‐13.BookreviewerforKluwer,SagePublications,Spring‐VerlagNewYork,andLawrenceErlbaumandAssociates.MemberoftheTechnicalAchievementAwardCommitteefortheNationalCouncilonMeasurementinEducation(1996‐7).MemberoftheCareerAchievementAwardCommitteefortheNationalCouncilonMeasurementinEducation(2003‐2006).Chair,CareerAchievementAwardCommitteefortheNationalCouncilonMeasurementinEducation(2004‐5).Boards,Committees,andProfessionalAdvisoryServiceMemberofthePARCCConsortiumofStatesTechnicalAdvisoryCommittee.PlanningandadvisorygroupforRace‐to‐the‐TopassessmentsintheU.S.MemberoftheDelawareDepartmentofEducationTechnicalAdvisoryCommitteefortheDCAS,workingwiththeDelawareDepartmentofEducation.Advisoryactivitiesonassessmentdevelopment,psychometrics,andresearch.January2010topresent.

Richard M. Luecht Page 4 MemberofthePuertoRicoDepartmentofEducationTechnicalAdvisoryCommittee.Advisoryactivitiesonassessmentdevelopment,psychometrics,andresearch.January2009topresent.MemberoftheNewYorkDepartmentofEducationTechnicalAdvisoryCommittee.Advisoryactivitiesonassessmentdevelopment,psychometrics,andresearch.January2012topresent.MemberofthePennsylvaniaDepartmentofEducationTechnicalAdvisoryCommittee.Advisoryactivitiesonassessmentdevelopment,psychometrics,andresearch.October2012topresent.MemberofthePennsylvaniaDepartmentofEducationEducatorEffectivenessTechnicalAdvisoryCommittee.Advisoryactivitiesonassessmentdevelopment,psychometrics,andstatisticalmodelingresearchforteacheraccountability.March2013topresent.SeniorPsychometricAdvisor,Prometric,Inc.,Baltimore,MD.Advisingonadvancedpsychometricsissuesrelatedtocomputer‐basedtesting.MemberoftheTechnicalAdvisoryGroupfortheNationalBoardofProfessionalTeachingStandards(NBPTS)AccomplishedPrincipalsAssessmentDevelopmentProject,March2010topresent.Consultingonassessmentdesign,supportingresearchandpsychometrics.ChairofthePsychometricAdvisoryTeamfortheAdvancedPlacement(AP)Re‐designResearchProjectforTheCollegeBoard,2005‐present.DirectresearchplanningandevaluateprogressonredesigningtestdevelopmentpracticesandpsychometricsupportproceduresformultipleadministrationsoftheAPexaminationsinthefutureMemberoftheHigh‐StakesDigitalTesting(HS‐DT)TechnicalAdvisoryGroup,TheCollegeBoard,2010‐2013.Advisingonlarge‐scalecomputerizationandtestdesignissuesforthedigitalSATinitiative.MemberoftheResearchAdvisoryPanelforTheCollegeBoard,2004‐2007.OverseefundingallocationsandresearchprioritiesfortheCollegeBoard’sResearchDivisionMemberoftheDiagnosticMethodsCommittee,TheCollegeBoard,2003‐2007.ProvidetechnicaladviceandconductresearchforTheCollegeBoard,reportingtheResearchAdvisoryPanel,regardingtechnicaltestdevelopmentandpsychometricoptionsfordiagnosticandformativescorereportingforlarge‐scaleK‐16assessments

Richard M. Luecht Page 5 MemberoftheVisitingResearchPanelforEducationalTestingService(ETS),Princeton,NJ,2001‐2008.Participateinreviewingstate‐of‐the‐artpsychometricresearchatETS(assumingroleofChairoftheVPRinFall,2006)MemberoftheNorthCarolinaDepartmentofPublicInstruction’sTechnicalAdvisoryCommittee,2000topresent.AdvisorontechnicalpsychometricissuesrelatedtotheNorthCarolinaDPIK‐12stateEOG,EOG,andalternativeassessmenttestingprogramsMemberoftheGeorgiaDepartmentofEducation’sTechnicalAdvisoryCommittee,2001topresent.AdvisorontechnicalpsychometricissuesrelatedtotheGeorgiastateK‐12testingprogramsMemberoftheGeorgiaDepartmentofEducationEducatorEffectivenessTechnicalAdvisoryCommittee.Advisoryactivitiesonassessmentdevelopment,psychometrics,andstatisticalmodelingresearchforteacheraccountability.June2011topresent.Externalpsychometricadvisor/evaluatorforNewJerseyDepartmentofEducationTechnicalAdvisoryCommittee,2006‐present.AdvisorontechnicalequatingandotherpsychometricissuesrelatedtotheNJK‐12statetestingprogramsConsultanttotheAssociationofAmericanMedicalCollegesonissuesrelatedtocomputerizingtheMedicalCollegeAdmissionsTest(February,2004)TechnicalconsultanttotheDefenseLanguageInstitute(DLI)andNationalSecurityAgency(NSA),2001to2005.ProvidetechnicaladviseonpsychometricmodelingoflanguageproficiencyassociatedwiththeInteragencyLanguageRoundtable(ILR)ProficiencyScale,aswellassoftwareengineeringadvicerelatedtodesigningandimplementingpsychometricandtestdevelopmentsoftwaresystemsandproceduresassociatedwithconvertingtheDefenseLanguageProficiencyTests(DLPT)inReadingComprehensionandListeningComprehensiontomultilingual,computer‐adaptivemultistagetestsMemberoftheExamDevelopmentAdvisoryCommitteefortheMedicalCouncilofCanada,Ottawa,Canada,1998‐2006.AdvisorontechnicalimplementationandresearchrelatedtotheQualifyingandClinicalReasoningExaminations,Ottawa,CanadaMemberoftheProgramReviewAdvisoryCommitteefortheMedicalCollegeAdmissionsTest(MCAT),AssociationofAmericanMedicalColleges,Washington,DC,1999‐2002TechnicalDesignandPsychometricConsultantonInnovativeItemTypesProjectfortheWindows2000Examinations,MicrosoftCorporation,Redmond,WA,1999‐2003Chair/memberoftheTechnicalResearchandImplementationOversight(TRIO)committeefortheAmericanInstitutesofCertifiedPublicAccountants,Ewing,NJ,2000‐

Richard M. Luecht Page 6 2008.Technicalbraining‐storminggrouponhigh‐levelresearchprioritiesandpotentialsolutionsfortheAICPA(withDr.WimvanderLinden,UniversityofTwente,andDr.RonHambleton,UniversityofMassachusetts,Amherst)MemberoftheBoardofExaminersfortheAmericanInstituteofCertifiedPublicAccountants(AICPA),Ewing,NJ,2000‐2004.PolicyoversightfortheUniformCPAExaminationMemberofthePsychometricOversightCommitteefortheAmericanInstituteofCertifiedPublicAccountants(AICPA),Ewing,NJ,1999‐2005.PsychometricresearchpolicyandtechnicaloversightforresearchontheUniformCPAExaminationMemberoftheResearchConsortiumfortheAmericanInstituteofCertifiedPublicAccountants(AICPA),JerseyCity,NJ,1999‐2004.Psychometricresearchfor2003implementationoftheUniformCPAExaminationMemberoftheSimulationsDevelopmentTaskForcefortheAmericanInstituteofCertifiedPublicAccountants(AICPA),JerseyCity,NJ,1999‐2002.ResearchanddevelopmentforinnovativeassessmentsfortheUniformCPAExaminationMemberoftheCommitteeofExaminersfortheTestofEnglishasaForeignLanguage(TOEFL),ETS,Princeton,NJ,2000‐2004.LanguagetestingresearchoversightfortheTOEFLprogram.AlsomemberoftheCOETestDevelopmentsubcommitteeforTOEFLMemberoftheBoardofExaminersfortheTestofEnglishasaForeignLanguage(TOEFL),ETS,Princeton,NJ,2001‐2003.PolicyadvisingandoversightfortheTOEFLprogramMemberoftheScientificAdvisoryBoardforOrdinateSystems,Inc.,MenloPark,CA,2001‐2005.Providetechnicaladviceontechnologicalassessmentissuesrelatedtolanguagetestingandspeech/languagerecognitionMemberofthePeerReviewPanelforthePhase1SmallBusinessInnovativeResearchandSmallBusinessTechnologyTransferProgram,sponsoredbytheNationalScienceFoundation,September,2001GRANTSANDCONTRACTSPrincipleinvestigator.UnderstandingCriticalDecision‐MakingintheContextofExtendedResponseItemTypes:ImplicationsforDesigning,CalibratingandScoringExtendedResponseItemsTypes.NationalCouncilofStateBoardsofNursing,2014‐2015.($63,722).Principalinvestigator.ca‐MSTSimulationandAnalysisResearchforHS‐DTProject.TheCollegeBoard,2010‐11.($42,291).

Richard M. Luecht Page 7 Co‐principalinvestigator.PsychometricresearchconsultingandsupportforthePROMISSexualFunctioningGrant(subcontractwithDukeUniversity).NationalInstitutesforHealth(NIH),2010to2014.($209,000)Co‐principalinvestigatorontheNationalCommissiononCertificationofPhysiciansAssistantspsychometricresearchproject,Fall2008‐Summer,2009($15,000)Co‐principalinvestigatorontheNationalCommissiononCertificationofPhysiciansAssistantsstake‐holdersurveyproject,Fall2005‐Spring,2006($35,000)PrincipalinvestigatoronNationalBoardofProfessionalTeachingStandardsgrant.Proposaltitle,ScalingTheNBPTSAssessments:AnInvestigationOfDichotomousHolisticScoringAndLatentClassAnalysisForPossiblyMultidimensionalPerformanceAssessments.($63,790).Activegrant:(initiated,2002;awardedfor2003‐4)PrincipalinvestigatoronAmericanInstitutesofCertifiedPublicAccountantsresearchcontracttoinvestigateissuesrelatedtocomputerizingtheUniformCPAExamination.$300,000overfiveyears.(Academicyears:1999‐0to2003‐4)Principalinvestigator,contractwithJos.BryanFoundationforprogramevaluationstudytoassesseffectsofPaideiaimplementationinGuilfordCountySchools.$50,000peryear,1999‐2001PrincipalinvestigatorontheMicrosoft,Inc.contracttoprovidepsychometricandresearchservicescomputerizingtheUniformCPAExamination.$150,000fora12‐monthcontract,Sept.2000toSept,2001.RESEARCH&SCHOLARSHIPACTIVITIES1A.PUBLICATIONS(inchronological‐firstauthororder)Luecht,R.M.(2015).Computer‐basedtestdeliverymodels,data,andoperationalimplementationissues.InF.Drasgow(Ed.),Technologyandtesting,pp.179‐205.NewYork:Routledge.Luecht,R.M.(2015).Applicationsofitemresponsetheory:Itemandtestinformationfunctionsfordesigningandbuildingmasterytests.InS.Lane,M.Raymond&T.Haladyna(Eds.).Handbookoftestdevelopment2ndedition,pp.485‐506.NewYork:Routledge.Luecht,R.M.(2014).Computerizedadaptivemultistagedesignconsiderationsandoperationalissues(pp.69‐83).InD.Yan,A.A.vonDavier&C.Lewis(Eds.)ComputerizedMultistageTesting:TheoryandApplications.London,UK:CRCPress/ Taylor&FrancisGroup.

Richard M. Luecht Page 8 Luecht,R.M.(2013).Assessmentengineeringtaskmodelmaps,taskmodelsandtemplatesasanewwaytodevelopandimplementtestspecifications.JournalofAppliedTestingTechnology,14(www.testpublishers.org/journal‐of‐applied‐testing‐technology).Shu,Z.;Henson,R.&Luecht,R.(2013).Usingdeterministic,gateditemresponsetheorymodeltodetecttestcheatingduetoitemcompromise.Psychometrika,78,481‐49.Clark,D.B.;Martinez‐Garza,M.;Biswas,G;.Luecht,R.M.;&Sengupta,P.(2012).DrivingAssessmentOfStudents’ExplanationsinGameDialogUsingComputer‐AdaptiveTestingandHiddenMarkovModeling.InD.Ifenthaler;D.Eseryel;X.Ge(Eds.),AssessmentinGame‐basedLearning:Foundations,Innovations,andPerspectives,pp.173‐200.NewYork:Springer.Luecht,R.M.(2012).Computer‐BasedandComputer‐AdaptiveTesting.InK.Ercikan,M.Simon&M.Rousseau(Eds.),ImprovingLargeScaleAssessmentinEducation:Theory,Issues,andPractice,pp.91‐114,.NewYork:Taylor‐Francis/Routledge.Luecht,R.M.(2012).AnIntroductiontoAssessmentEngineeringforAutomaticItemGeneration.InM.Gierl&T.Haladyna(Eds.),AutomaticitemGeneration,pp.59‐101.NewYork:Taylor‐Francis/Routledge.Luecht,R.M.(2012).Automaticitemgenerationforcomputerizedadaptivetesting.InM.Gierl&T.Haladyna(Eds.),AutomaticitemGeneration,pp.196‐216.NewYork:Taylor‐Francis/Routledge.Luecht,R.M.(2012).OperationalCBTImplementationIssues:MakingItHappen.InR.Lissitz&H.Jiao(Eds.),ComputersandTheirImpactonStateAssessments:RecentHistoryandPredictionsfortheFuture.Baltimore,MD:InformationAgePublishers.Raymond,M.R.;&Luecht,R.M.(2012).LicensureandCertificationTesting.InK.F.Geisinger(Ed).APAHandbookofTestingandAssessmentinPsychology.APAPublications.Luecht,R.M.&Sireci,S.G.(2011).AReviewofModelsforComputer‐BasedTesting.NewYork.,NY:TheCollegeBoard,ResearchReport,2011‐12.Zenisky,A.;Hambleton,R.J.;&Luecht,R.M.(2010).MultistageTesting:Issues,Designs,andResearch.InW.J.vanderLindenandC.E.W.Glas(Eds).ElementsofAdaptiveTesting,pp.355‐372.NewYork:Springer.Luecht,R.M.(2009).BookReviewofLinearModelsforOptimalTestDesignbyWimJ.vanderLinden.JournalofEducationalMeasurement,33,238‐243.

Richard M. Luecht Page 9 Blue,A.V.;Crandall,S.;Nowacek,G.;Luecht,R.M.;Swick,H.(2009).Assessmentofmatriculatingmedicalstudents’knowledgeandattitudestowardsprofessionalism.MedicalTeaching,13,1‐5.Luecht,R.M.(2007).Usinginformationfrommultiple‐choicedistractorstoenhancecognitive‐diagnosticscorereporting.InJacquelineP.Leighton&MarkJ.Gierl(Eds).Cognitivediagnosticassessmentforeducation:theoryandapplications,pp.319‐340.London:CambridgeUniversityPress.Drasgow,F.;Luecht,R.M.;&Bennett,R.(2006).TechnologyandTesting.InR.L.Brennan(Ed.),EducationalMeasurement,4thEdition,pp.471‐515.Washington,DC:AmericanCouncilonEducation/PraegerPublishers.Luecht,R.M.;Brumfield,T.;andBreithaupt,K.(2006).ATestletAssemblyDesignfortheUniformCPAExamination.AppliedMeasurementinEducation,19,189‐202.Luecht,R.M.(2006).DesigningTestsforPass/FailDecisionsUsingIRT.InS.Downing&T.Haladyna(Eds.).HandbookofTestDevelopment(pp.575‐596).Mahwah,NJ:LawrenceErlbaumandAssociates.Luecht,R.M.(2006).OperationalIssuesinComputer‐BasedTesting.InD.BartrumandR.Hambleton(Eds).Computer‐BasedTestingandtheInternet,(pp.91‐114).WestSussex,England:JohnWiley&SonsLtd..Luecht,R.M.(2005).SomeUsefulCost‐BenefitCriteriaforEvaluatingComputer‐basedTestDeliveryModelsandSystems.JournalofAppliedTestingTechnology.7(2),(www.testpublishers.org/journal.htm)Luecht,R.M.(2005).ItemAnalysis.InB.Everitt&D.Howell(Eds),EncyclopediaofStatisticsinBehavioralScience.WestSussex,UK:JohnWiley&Sons,Ltd.Luecht,R.M.(2005).Computer‐AdaptiveTesting.InB.Everitt&D.Howell(Eds),EncyclopediaofStatisticsinBehavioralScience.WestSussex,UK:JohnWiley&Sons,Ltd.Luecht,R.M.(2005).Computer‐BasedTesting.EncyclopediaofSocialMeasurement,Volume1.Elsevier,Inc,419‐427.Luecht,R.M.(2004).Multistagecomplexityinlanguageproficiencyassessment:Aframeworkforaligningtheoreticalperspectives,testdevelopment,andpsychometrics.ForeignLanguageAnnals,36(4),518‐526.Myers,J.E.,Luecht,R.M.,&Sweeney,T.J.(2004).ExaminingtheFive‐FactorWelInventory:ResultsOfAnExploratoryFactorAnalysis.JournalofCounselingandDevelopment.

Richard M. Luecht Page 10 Luecht,R.M.&Clauser,B.(2002).Testmodelsforcomplexcomputer‐basedtesting.InC.Mills,M.Potenza,J.Fremer,andW.Ward(Eds.)Computer‐basedTesting:BuildingtheFoundationforFutureAssessments,pp.67‐88.Mahwah,NJ:Erlbaum.Luecht,R.M.&Sireci,S.G.(October,2002).DescriptionandEvaluationofModelsforComputer‐BasedTesting.CommissionedTechnicalReportfortheCollegeBoard.Pitoniak,M.J.,Sirici,S.G.&Luecht,R.(2002).Amultitrait‐multimethodvalidityinvestigationofscoresfromaprofessionallicensureexamination.EducationalandPsychologicalMeasurement,62(3),498‐516.Luecht,R.M.andBaker,W.K.(2000).EvaluatingthePaideiaPrograminGuilfordCountySchools,SecondYearReport:1999‐2000.UniversityofNorthCarolinaatGreensboro:CenterforEducationalResearchandEvaluation.Luecht,R.M.&Nungester,R.J.(2000).Computer‐adaptivesequentialtesting.InC.Glas&W.J.vanderLinden(Eds).Computer‐AdaptiveTesting,pp.117‐128.Dordrecht,TheNetherlands:KluwerAcademicPublishers.Luecht,R.M.(1999).ThepracticalutilityofRaschmeasurementmodels.InM.Chalhoub‐Deville(Ed.)StudiesinLanguageTesting:IssuesinComputer‐AdaptiveTestingofReadingProficiency(pp.192‐211).NewYork:CambridgeUniversityPress.Luecht,R.M.,Baker,W.K.&Karkee,T.(1999).EvaluatingthePaideiaPrograminGuilfordCountySchools,SecondYearReport:1998‐1999.UniversityofNorthCarolinaatGreensboro:CenterforEducationalResearchandEvaluation.Hadadi,A.&Luecht,R.M.(1998)Somemethodsfordetectingandunderstandingtestspeedednessontimedmultiplechoicetests.AcademicMedicine,73,47‐50.Luecht,R.M.,Hadadi,A.,Swanson,D.B.&Case,S.M.(1998).Acomparativestudyofacomprehensivebasicsciencestestusingpaper‐and‐pencilandcomputerizedformats.AcademicMedicine,73,51‐53.Luecht,R.M.(1998).Computer‐assistedtestassemblyusingoptimizationheuristics.AppliedPsychologicalMeasurement,22,224‐336.Luecht,R.M.(1998).Areactionto“moderatingpossiblyirrelevantmultiplescoremeandifferencesonatestofmathematicalreasoning”.JournalofEducationalMeasurement,35,223‐225.Luecht,R.M.(1998).Automatedtestassembly(ATA)intheeraofcomputerizedtesting.CLEARExamReview.FallIssue.

Richard M. Luecht Page 11 Luecht,R.M.&Nungester,R.J.(1998).Somepracticalapplicationsofcomputerizedadaptivesequentialtesting.JournalofEducationalMeasurement,35,229‐249.vanderLinden,W.J.&Luecht,R.M.(1998).Observed‐scoreequatingasatestassemblyproblem.Psychometrika,63,401‐418.Clauser,B.E.,Ross,L.P.,Luecht,R.M.,Nungester,R.J.&Clyman,S.G.(1997).UsingtheRaschmodeltoequateformsforperformanceassessmentsofphysician’sclinicalskills.InA.Scherpbier,C.vanderVleuten,J.RethansandA.vanderSteeg,(Eds.).AdvancesinMedicalEducation,pp.416‐419.Dordrecht,TheNetherlands:KluwerAcademicPublishers.Luecht,R.M.,DeChamplain,A.,Nungester,R.J.(1997).Maintainingcontentvalidityincomputerizedadaptivetesting.InA.Scherpbier,C.vanderVleuten,J.RethansandA.vanderSteeg,(Eds.).AdvancesinMedicalEducation,pp.416‐419.Dordrecht,TheNetherlands:KluwerAcademicPublishers.Luecht,R.M.,DeChamplain,A.,Nungester,R.J.(1997).Maintainingcontentvalidityincomputerizedadaptivetesting.AdvancedinHealthSciencesEducation,3,29‐41.Luecht,R.M.(1996).Multidimensionalcomputerizedadaptivetestinginacertificationorlicensurecontext.AppliedPsychologicalMeasurement,20,389‐404.Luecht,R.M.(1996).ThepracticalutilityfRaschmeasurementmodels.InM.Chalhoub‐Deville(Ed.).IssuesinComputer‐AdaptiveTestingofReadingProficiency,pp.196‐223.NewYork:CambridgeUniversityPress.vanderLinden,W.J.&Luecht,R.M.(1996).Anoptimizationmodelfortestassemblytomatchobservedscoredistributions.InG.Englehard&M.Wilson(Eds.).ObjectiveMeasurement:TheoryintoPractice(Volume3).Norwood,NJ:Ablex.Luecht,R.M.(1995).AnIntroductiontoComputerizedAdaptiveTesting.Philadelphia,PA:NBMETechnicalReport.Loomis,S.,Luecht,R.M.&Reckase,M.R.(1993).SettingAchievementLevelsonthe1992NationalAssessmentofEducationalProgressinMathematics,Reading,andWriting:ATechnicalReportonReliabilityandValidity.IowaCity,IA:AmericanCollegeTesting.Luecht,R.M.(1993).Interpolatingθforthepartialcreditmodel.InLoomis,S.,Luecht,R.M.&Reckase,M.R..SettingAchievementLevelsonthe1992NationalAssessmentofEducationalProgressinMathematics,Reading,andWriting:ATechnicalReportonReliabilityandValidity.IowaCity,IA:AmericanCollegeTesting.

Richard M. Luecht Page 12 Luecht,R.M.(1993).SomeresultsfromtheNAGBALSprojectinreading.InLoomis,S.,Luecht,R.M.&Reckase,M.R..SettingAchievementLevelsonthe1992NationalAssessmentofEducationalProgressinMathematics,Reading,andWriting:ATechnicalReportonReliabilityandValidity.IowaCity,IA:AmericanCollegeTesting.Meisner,R.;Luecht,R.M.;&Reckase,M.R.(1993).Statisticalcharacteristicsofitemsgeneratedbycomputeralgorithms,ACTResearchReportSeries,RR‐93‐9.IowaCity,IA:ACT,Inc..Luecht,R.M.&Hirsch,T.M.(1992).Itemselectionusinganaveragegrowthapproximationoftargetinformationfunctions.AppliedPsychologicalMeasurement,16(1),41‐51.Smith,P.L.&Luecht,R.M.(1992).Correlatedeffectsingeneralizabilitystudies.AppliedPsychologicalMeasurement,16(3),229‐235.Luecht,R.M.&Miller,T.R.(1992).Unidimensionalcalibrationsandinterpretationsofcompositetraitsformultidimensionaltests.AppliedPsychologicalMeasurement,16(3),279‐293.Luecht,R.M.&Hirsch,T.M.(1990).Computerizedtestconstructionusinganaveragegrowthapproximationoftargetinformationfunctions.IowaCity,IA:ACTResearchReportSeries,90‐6.Luecht,R.M.,Madsen,M.K.,Taugher,M.P.&Petterson,B.J.(1990).Assessingprofessionalperceptions:designandvalidationofaninterdisciplinaryeducationperceptionscale.JournalofAlliedHealth,19(2),181‐191.Luecht,R.M.,Madsen,M.K.&Sander,E.(1989).Amultidimensionalmodelforcomputertrainingofalliedhealthfaculty.ImprovingUniversityTeaching,2,207‐216.Luecht,R.M.,Madsen,M.K.&Sander,E.(1988).Amultidimensionalmodelforcomputertrainingofalliedhealthfaculty.5thAnnualAcademicChairpersonsConference,Orlando,Florida:IssuesinHigherEducation:Proceedingsfromthe5thAnnualAcademicChairpersonsConference,28,270‐277.Madsen,M.K.,Taugher,M.P.&Luecht,R.M.(1988).Maritalcounselingandfamilytherapywithoneormorementallyretardedadults.8thAnnualWorldCongressoftheInternationalAssociationfortheScientificStudyofMentalDeficiency,Dublin,Ireland:AWCIA‐SSMDProceedings.Madsen,M.K.,Taugher,M.P.&Luecht,R.M.(1988).Whenthemotherismentallyretarded.Paperpresentedatthe8thAnnualWorldCongressoftheInternationalAssociationfortheScientificStudyofMentalDeficiency,Dublin,Ireland.Publishedin1988AWCIA‐SSMDProceedings.

Richard M. Luecht Page 13 Luecht,R.M.(1987).TestPac:Aprogramforcomprehensiveitemandreliabilityanalysis.JournalofEducationalandPsychologicalMeasurement.,47(3),623‐626.Luecht,R.M.,Madsen,M.K.&Sander,E.(1987).Amodelforcomputer‐trainingofalliedhealthprofessionals.AAMSICongress,SanFrancisco:Proceedings:AmericanAssociationforMedicalSystemsandInformaticsCongress,367‐371.Luecht,R.M.(1986).Determiningsamplesizesinproductivityandcostanalysis,WisconsinMedicalRecordsAssociation,SpecialEdition,35(4),6.B. BOOKSANDBOOKCHAPTERSINPREPARATION(alphabeticalorder)Luecht,R.M.(inpress).Calibratingtechnology‐enhanceditems.Handbookofitemresponsetheory,2ndedition.(Accepted,waitingforrevisionrecommendations).Luecht,R.M.(inpress).Applicationsofitemresponsetheoryitemandtestinformationfunctionsfordesigningandbuildingmasteryandcriterion‐referencedtests.InT.Haladyna,S.Lane&M.Raymond(Eds.).HandbookofTestDevelopment,2ndEdition.Taylor‐Francis.Luecht,R.M.(inpress).Computer‐basedtestdeliverymodels,dataandoperationalimplementationissues.InF.Drasgow(Ed.).TestingandTechnology.CommissionedvolumetobepublishedwithsupportfromtheNationalCouncilonMeasurementinEducation.Luecht,R.M.(inpreparation).AssessmentEngineering.Textbook.C.CONFERENCEPAPERS&PRESENTATIONS(inchronological‐alphabeticalorder)Luecht,R.M.(2013,May).OperationalDesignandImplementationIssuesforLarge‐ScaleMultistageTesting.InvitedsymposiumpaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,SanFrancisco.Luecht,R.M.(2012,November).IRTModels,Calibration,andDiagnosticsforComplexItemTypes.InvitedkeynoteaddressattheRonference,UniversityofAmherst.Luecht,R.M.(2012,July).EngineeringtheDesignofAssessmentTaskModelsandTemplates.InvitedkeynoteaddressattheInternationalTestCommissionAnnualMeeting,Amsterdam,TheNetherlands.Luecht,R.M.(2012,May).ACaseforComputerizedAdaptiveMultistageTesting(ca‐MST).InvitationalResearchSymposiumonTechnologyEnhancedAssessments,Washington,DC.

Richard M. Luecht Page 14 Dallas,A.,Wang,X.,Furter,R.&Luecht,R.M.(2012,April).ItemPoolSize,TargetedItemWriting,andPanelReplicationStrategiesfora1‐3‐3MultistageTestDesign.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Vancouver,BCCanada.Luecht,R.M.(2012,April).AssessmentEngineeringTaskModelMaps,TaskModelsandTemplatesasaNewWaytoDevelopandImplementTestSpecifications.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Vancouver,BCCanada.Luecht,R.M.(2012,April).ComputerizedAdaptiveMultistageDesignConsiderations..PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Vancouver,BCCanada.Wang,X.,Fluegge,L.&Luecht,R.M.(2012,April).ALarge‐scaleComparativeStudyoftheAccuracyandEfficiencyofca‐MSTPanelDesignConfigurations.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Vancouver,BCCanada.Willse,J.T.,Ackerman,T.A.&Luecht,R.M.(2012,April).AnOverviewofca‐MST:FromPanelConfigurationstoTestAssembly.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Vancouver,BCCanada.Xiao,L.,Luecht,R.M.,Godfrey,K.,Sweeney,K.,&Melican,G.(2012,February).OntheTechnicalTreatmentofGuessingBehaviorsintheContextofFormula‐ScoringInstructions.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Vancouver,BCCanada.Luecht,R.M.(2012,February).ImplementingAutomatedTestAssembly(ATA).PaperpresentedattheAnnualMeetingoftheAssociationofTestPublishers,PalmSprings,CA.Luecht,R.M.(2012,February).PrincipledItemDesignUsingAssessmentEngineering.PaperpresentedattheAnnualMeetingoftheAssociationofTestPublishers,PalmSprings,CA.Luecht,R.M.(2011,August).AssessmentEngineeringinTestDesign,Development,Assembly,andScoring.InvitedworkshoppresentedattheDefenseManpowerDataCenter,Monterrey,CA.Luecht,R.M.(2011,August).AETaskModels,Templates&Items.InvitedworkshoppresentedattheDefenseManpowerDataCenter,Monterrey,CA.

Richard M. Luecht Page 15 Luecht,R.M.(2011,April).FutureofDirectionsforTesting.InvitedpaneldiscussionattheAnnualSummitofthePerformanceTestingCouncil,ChevyChase,MD.Shu,Z.;Luecht,R.;&Henson,R.(2011,April).UsingtheDeterministic,GatedIRTModeltoMonitorItemOver‐Exposure.PaperpresentedattheAnnualMeetingoftheNationalCommissiononMeasurementinEducation,NewOrleans.Luecht,R.M.(2011,March).AssessmentDesignandDevelopment,Version2.0:FromArttoEngineering.Invited,closingkeynoteaddressattheAnnualMeetingoftheAssociationofTestPublishers,Phoenix,AZ.Luecht,R.M.(2010,October).OperationalCBTImplementationIssues:MakingItHappen.InvitedkeynoteaddressatTenthAnnualMarylandAssessmentConference:ComputersandTheirImpactonStateAssessments:RecentHistoryandPredictionsfortheFuture,CollegeParkMD.Luecht,R.M.(2010,April).TheInfluenceandImpactofTechnologyonEducationalMeasurement.InvitedgraduatestudentsymposiumpresentationattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Denver,CO.Luecht,R.M.(2010,April).ControllingDifficultyandSecurityforComplexComputerizedPerformanceExercisesUsingAssessmentEngineering.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Denver,CO.Luecht,R.M.(2010,April).SomeSmallSampleStatisticalQualityControlProceduresforConstructedResponseScoringinLanguageTesting.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Denver,CO.Luecht,R.M.,Dallas,A.,&Steed,T.(2010,April).DevelopingAssessmentEngineeringTaskModels:ANewWaytoDevelopTestSpecifications.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Denver,CO.Masters,J.S.&Luecht,R.M.(2010,April).AssessmentEngineeringQualityAssuranceSteps:AnalyzingSourcesofVariationinTaskModelsandTemplates.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Denver,CO.Shu,Z.,Burke,M.,&Luecht,R.M.(2010,April).SomeQualityControlResultsofUsingaHierarchicalBayesianCalibrationSystemforAssessmentEngineeringTaskModels,Templates,andItems.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Denver,CO.Luecht,R.M.;&Masters,J.(2010,February).TheEfficiencyofCalibratingMultiple‐ItemTemplatesandTaskModelsUsingaHierarchicalCalibrationModel.PaperpresentedattheAnnualMeetingoftheAssociationofTestPublishers,Orlando,FL.

Richard M. Luecht Page 16 Luecht,R.M.(2009,June).AdaptiveComputer‐BasedTasksUnderandAssessmentEngineeringParadigm.Paperpresentedatthe2009GMACConferenceonComputerizedAdaptiveTesting,Minneapolis,MN(publishedonlineinProceedings.http://www.psych.umn.edu/psylabs/catcentral/).Luecht,R.M.;Burke,M.;Devore,R.(2009,April).TaskModelingofComplexComputer‐BasedPerformanceExercises.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,SanDiego,CA.Luecht,R.M.(2008,October).AssessmentEngineeringinTestDesign,Development,Assembly,andScoring.InvitedkeynoteaddressattheAnnualMeetingoftheEastCoastOrganizationofLanguageTesters(ECOLT),Washington,D.C.Goodman,J.;Luecht,R.M.;Zhang,O.(2008,April).ScoringandScalingDecisionsinTestswithComplexPerformanceAssessment:ExaminingItemDependenciesandDimensionality.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,NewYork.Luecht,R.M.(2008,February).AssessmentEngineering.SessionpaperatAssessmentEngineering:MovingfromTheorytoPractice,CoordinatedpanelpresentationattheAnnualMeetingoftheAssociationofTestPublishers,Dallas,TX.Luecht,R.M.(2008,February).TheApplicationofAssessmentEngineeringtoandOperationalLicensureTestingProgram.PaperpresenedattheAnnualMeetingoftheAssociationofTestPublishers,Dallas,TX.Luecht,R.M.(2007,October).MultipleObjectiveFunction,MultipleConstraintSetOptimizationModelsforAutomatedTestAssembly.InvitedpaperpresentedattheAnnualMeetingofInternationalConferenceonAdvancesinInterdisciplinaryStatisticsandCombinatorics,Greensboro,NC.Luecht,R.M.(2007,October).AssessmentEngineering:AnIntegratedApproachtoTestDesign,Development,Assembly,andScoring.InvitedkeynoteandworkshoppresentedatthePerformanceTestingCouncilSummit,Scottsdale,AZ.Luecht,R.M.(2007,June).EmergingTopics(inCBTandCAT).Invitedkeynotepresentationatthe2007GMAC®ConferenceonComputerizedAdaptiveTesting,Minneapolis,MN.Luecht,R.M.(2006,May).EngineeringtheTest:PrincipledItemDesigntoAutomatedTestAssembly.InvitedspecialeventpresentationattheAnnualMeetingoftheSocietyforIndustrialandOrganizationalPsychology.

Richard M. Luecht Page 17 Luecht,R.M.;Gierl,M;Tan,X.;andHuff,K..(2006,April).ScalabilityandtheDevelopmentofUsefulDiagnosticScales.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,SanFrancisco,CA.Luecht,R.M.;Nowacek,G.(2006,April).MeasuringandPredictingProfessionalisminMedicalSchool:FromKnowledgeandAttitudestoClinicPractice.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,SanFrancisco,CA.Luecht,R.M.(2006,March).MeasuringMultidimensionalLanguageProficiencyinaMultistageAdaptiveTestingContext.InvitedpaperpresentedattheUniversityofMassachusetts‐Amherst.Luecht,R.M.(2006,February).Computer‐basedApproachestoDiagnosticAssessment.InvitedpresentationattheAnnualMeetingoftheAssociationofTestPublishers,Orlando,FL.Luecht,R.M.(2005,April).SomeUsefulCost‐BenefitCriteriaforEvaluatingComputer‐basedTestDeliveryModelsandSystems.InvitedsymposiumpaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Montreal,Quebec.Luecht,R.M.(2005,April).ExtractingMultidimensionalInformationfromMultiple‐ChoiceQuestionDistractorsforDiagnosticScoring.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Montreal,Quebec.Luecht,R.M.(2004,February).AutomatedTestAssembly(ATA):Systems,ProceduresandPracticalIssues.InvitedworkshopandpresentationattheAnnualMeetingoftheAssociationofTestPublishers,PalmSprings/IndianWells,CA.Luecht,R.M.(2004,February).CalibrationandScoring.SymposiumpresentationattheAnnualMeetingoftheAssociationofTestPublishers,PalmSprings/IndianWells,CA.Luecht,R.M.(2004,February).MeasuringMultidimensionalLanguageProficiencyinaMultistageAdaptiveTestingContext.InvitedpresentationattheAnnualMeetingoftheAssociationofTestPublishers,PalmSprings/IndianWells,CA.Luecht,R.M.(February,2003).AggregatedPerformance‐BasedStandard‐SettingMethodologies.InvitedworkshopandpresentationattheAnnualMeetingoftheAssociationofTestPublishers,AmeliaIsland,FL.Luecht,R.M.(April,2003).ApplicationsofMultidimensionalDiagnosticScoringForCertificationAndLicensureTests.InvitedsymposiumpaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.

Richard M. Luecht Page 18 Luecht,R.M.(April,2003).ExposureControlUsingAdaptiveMulti‐StageItemBundles.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.Luecht,R.M.,&Burgin,W.(April,2003).MatchingTestDesigntoDecisions:TestSpecificationsandUseofAutomatedTestAssemblyforAdaptiveMulti‐StageTestlets.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.Luecht,R.M.(February,2002).SettingCompetency‐BasedStandardsforComplexPerformance‐BasedTasksinCertificationorLicensureTesting.InvitedpaperpresentedattheAnnualMeetingoftheAssociationofTestPublishers,Carlsbad,CA.Luecht,R.M.(February,2002).AnAutomatedTestAssemblyHeuristicforMultistageAdaptiveTestswithComplexComputer‐BasedPerformanceTasks.InvitedpaperpresentedattheAnnualMeetingoftheAssociationofTestPublishers,Carlsbad,CA.Luecht,R.M.(April,2002).FromDesigntoDelivery:EngineeringtheMassProductionofComplexPerformanceAssessments.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation.Luecht,R.M.(June,2002).OperationalIssuesinComputer‐BasedTesting.InvitedkeynoteaddressattheInternationalTestCommissionConferenceonComputer‐basedTestingandtheInternet,Winchester,England.Luecht,R.M.(July,2002).MeasuringMultidimensionalCompetencyinaMultistageAdaptiveTestingContext.InvitedkeynoteaddressattheUSDefenseLanguageInstituteForeignComputerizedAdaptiveTestingConference,Monterey,CA.Luecht,R.M.,Brumfield,T.,Breithaupt,K.(April,2002).ATestletAssemblyDesignfortheUniformCPAExamination.Paperpresented(byT.Brumfield,UNCGgraduatestudent)attheAnnualMeetingoftheNationalCouncilonMeasurementinEducation.Brumfield,T.,Burroughs,R.&Luecht,R.(April,2001).OptimalcalibrationsamplingdesignsfortheUniformCPAExamination.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,Seattle,WA.Luecht,R.M.(2001,February).Newdirectionsincomputerizedtestingresearch.InvitedkeynoteaddressattheAnnualMeetingoftheLanguageTestingResearchColloquium,St.Louis,MO.Luecht,R.M.(2001,April).Challengesofweb‐basedassessment.InvitedsymposiumpaperattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Seattle,WA.

Richard M. Luecht Page 19 Luecht,R.M.(2001,April).Capturing,codifyingandscoringcomplexdataforinnovativecomputer‐baseditems.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,,Seattle,WA.Luecht,R.M.(2001,August).Asystemsengineeringapproachtocomputer‐basedtesting.InvitedpaperpresentedattheDefenseLanguageInstitute/NationalSecurityAgencyComputer‐AdaptiveTestingConference,Baltimore,MD.Luecht,R.M.(2000,April).Implementingthecomputer‐adaptivesequentialtesting(CAST)frameworktomassproducehighqualitycomputer‐adaptiveandmasterytests.SymposiumpaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,NewOrleans,LA.Hadadi,A.,Swanson,D.B.&Luecht,R.M.(1999,April).Practicalissuesinusingautomatedtestassembly(ATA)forlarge‐scaletesting.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Montreal,Quebec,Canada.Iwamoto,C.K.,Nungester,R.J.&Luecht,R.M.(1999,April).Studyofmethodstodetectaberrantresponsepatternsincomputerizedtesting.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Montreal,Quebec,Canada.Luecht,R.M.(1999,April).Trendsincomputerizedtesting‐asynthesis.InvitedpresentationfortheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Montreal,Quebec,Canada.Case,S.M.,Luecht,R.M.,&Swanson,D.B.(1998,April).Designandautomatedassemblyoftestformsfortheusmlestep1fieldtest.SymposiumconductedattheNationalCouncilonMeasurementinEducationAnnualMeeting,SanDiego.Hadadi,A.,&Luecht,R.M.(1998,April).EffectsofResponselatencydatainassessingspeededness/non‐speedednessincomputerizedtesting.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,SanDiego.Hadadi,A.,Luecht,R.M.,Swanson,D.B.,&Case,S.M.(1998,April).Study1:effectsofmodularsubteststructureanditemreviewonexamineeperformance,perceptionsandpacing.SymposiumconductedattheNationalCouncilonMeasurementinEducationAnnualMeeting,SanDiego.Iwamoto,C.K.,Nungester,R.J.,&Luecht,R.M.(1998,April).Useofresponsesimilaritymethodsinmultistagecomputeradaptivetesting.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,SanDiego.Iwamoto,C.K.,Nungester,R.J.,Luecht,R.M.,&Watson,S.A.(1998,April).Effectofanswermiskeysontheestimationofexamineeabilitiesinmultistagecomputeradaptivetesting.

Richard M. Luecht Page 20 PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,SanDiego.Swanson,D.B.,Luecht,R.M.,Gessaroli,M.E.,&Nungester,R.J.(1998,April).Study3:impactofsystematicmanipulationofsubtestdifficultyonexamineeperformance,perceptions,andpacing.SymposiumconductedattheNationalCouncilonMeasurementinEducationAnnualMeeting,SanDiego.Case,S.M.&Luecht,R.M.(1997,April).Computerassemblyoftestssothatcontentreignssupreme.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.Symposium:Outcomesofthe1996USMLEStep2FieldTestusingaComputerAdaptiveSequentialParadigm.Hadadi,A.&Luecht,R.M.(1997,April).Psychometricmodeeffectsandfitissueswithrespecttoitemdifficultyestimates.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.Symposium:Outcomesofthe1996USMLEStep2FieldTestusingaComputerAdaptiveSequentialParadigm.Luecht,R.M.(1998,April).Aframeworkforexploringandcontrollingrisksassociatedwithtestitemexposureovertime.SymposiumconductedattheNationalCouncilonMeasurementinEducationAnnualMeeting,SanDiego.Luecht,R.M.,&DeChamplain,A.F.(1998,April).ApplicationsOfLatentClassAnalysisToMasteryDecisionsUsingComplexPerformanceAssessments.PaperpresentedasaSymposiumattheAnnualMeetingoftheAmericanEducationalResearchAssociation,SanDiego.Luecht,R.M.,Nungester,R.J.,Swanson,D.B.,&Hadadi,A.(1998,April).Study2:examineeperformance,perceptions,andpacingonacomputeradaptivesequentialtest.SymposiumconductedattheNationalCouncilonMeasurementinEducationAnnualMeeting,SanDiego.vanderLinden,W.J.,&Luecht,R.M.(1998,April).Observed‐ScorePre‐Equating:AMethodandSomeEmpiricalResults.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,SanDiego.Watson,S.A.,Iwamoto,C.K.,Nungester,R.J.,&Luecht,R.M.(1998,April).Theuseofresponsesimilaritystatisticstostudyexamineeswhobenefitfromcopying.PaperpresentedattheNationalCouncilonMeasurementinEducationAnnualMeeting,SanDiego.

Richard M. Luecht Page 21 Iwamoto,C.K.,Watson,S.A.Nungester,R.J.&Luecht,R.M.(1997,April).Powerofsimilaritymethodsandpersonfitanalysistodetectcopyingbehavior.PresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.Luecht,R.M.(1997,April).Anadaptivesequentialparadigmformanagingmultidimensionalcontent.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,Chicago,IL.Symposium:TechnicalIssuesinMultidimensionalAdaptiveTestingLuecht,R.M.(1997,April).AdidacticondataanalysisforstandardsettingwithAngoff‐typeratingsinanIRTcontext.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.Symposium:ApplicationsofTechnologyinSettingPerformanceStandards:PracticalSolutionsandResidualProblems.Luecht,R.M.(1997,October).Computer‐adaptivesequentialtesting:aframeworkformassproducinghighqualitycomputeradaptiveandmasterytests.InvitedpaperpresentedattheResults‘97Conference,SanAntonio,TX.Luecht,R.M.&Nungester,R.J.(1997,April).OverviewOfTheUSMLEStep2ComputerizedFieldTest.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.Symposium:Outcomesofthe1996USMLEStep2FieldTestusingaComputerAdaptiveSequentialParadigm.Swanson,D.B.,Featherman,C.F.,Case,S.M.&Luecht,R.M.(1997,April).RelationshipOfResponseLatencyToTestDesign,ExamineeAbilityAndItemDifficultyInComputer‐BasedTestAdministration.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL.VanFan,Y.,Clyman,S.G.&Luecht,R.M.(1997,April).TheApplicabilityOfConjointAnalysisForPerformance‐BasedAssessments.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation.Becker,D.F.,Gessaroli,M.E.,Luecht,R.M.&Folske,J.C.(1996,June).Developingandimplementinguser‐basedscalesandnormsforclinicalclerkshipexaminations.Presentedatthe7thOttawaInternationalConferenceonMedicalEducatonandAssessment,Maastricht,TheNetherlands.Clauser,B.E.,Ross,L.P.,Luecht,R.M.,Nungester,R.J.&Clyman,S.G.(1996,June).UsingtheRaschModeltoequatealternateformsforperformanceassessmentsofphysician’sclinicalskills.PresentedatThe7thOttawaInternationalConferenceonMedicalEducationandAssessment,Maastricht,TheNetherlands.

Richard M. Luecht Page 22 Folske,J.C.,Luecht,R.M.,Subhiyah,R.G.&Becker,D.F.(1996,April).Acomparisonofappliedpredictionmodelsinapass/faillicensurecontext.PresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation.NewYork,NY.Gessaroli,M.E.,Folske,J.C.,Luecht,R.M.&Becker,D.F.(1996,June).Scoresandnormsforbasicsciencecourseandclinicalscienceclerkshipexaminations.Presentedatthe7thOttawaInternationalConferenceonMedicalEducationandAssessment,Maastricht,TheNetherlands.Iwamoto,C.K.,Nungester,R.J.&Luecht,R.M.(1996,April).Powerofsimilaritymethodsandpersonfitanalysistodetectcopyingbehavior.PresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,NewYork,NY.Luecht,R.M.(1996,October).Computer‐adaptivesequentialtesting(CAST):aphilosophyandimplementationframeworkforefficientcomputerizedtesting.InvitedpaperpresentedattheLarge‐ScaleTestingProgramsintheNortheast:ResearchAgendasforthe21stCenturySymposiumattheNortheasternEducationalResearchAssociation,Ellenville,NY.Luecht,R.M.(1996,March).ThepracticalutilityofRaschmeasurementmodels.InvitedpaperpresentedattheIssuesinComputerAdaptiveTestingforAssessingReadingProficiencyConference,UniversityofMinnesotaCenterforAdvancedResearchonLanguageAcquisition,Minneapolis.Luecht,R.M.,Clauser,B.E.&Nungester,R.J.(1996,June).IssuesOfEfficiencyForAdaptivelyAdministeredComputerizedCaseSimulations.PresentedatThe7thOttawaInternationalConferenceonMedicalEducationandAssessment,Maastricht,TheNetherlands.Luecht,R.M.,NungesterR.J.&Hadadi,A.(1996,April).Heuristic‐BasedCat:BalancingItemFormation,ContentAndExposure.PresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,NewYork.Folske,J.C.,Iwamoto,C.K.,Nungester,&R.J.,Luecht,R.M.(April,1995).UsingtheRaschmodeltoinvestigatethefeasibilityofproducingmodel‐basednormsfortheNBMESubjectExaminations.PaperpresentedattheAnnualMeetingoftheAmericanEducationResearchAssociation,SanFrancisco,CA.Iwamoto,C.K.,Nungester,R.,&Luecht,R.M.(1995,April).Astudyofstatisticalmethodstodetectsimilarityofresponses.PaperpresentedattheAnnualMeetingoftheAmericanEducationResearchAssociation,SanFrancisco,CA.

Richard M. Luecht Page 23 Luecht,R.M.(1995,April).Sometechnicalinsightsintoresponse‐basedstandardsettingfordichotomousandpolytomousmodels.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,SanFrancisco,CA.Luecht,R.M.(1995,June).AconceptualtwistontheparameterizationofIRTmodels.PaperpresentedattheannualmeetingofthePsychometricSociety,Minneapolis,MN.Luecht,R.M.(1995,October).Somecriticalissuesincomputerizedadaptivetesting.PaperpresentedattheResearchinMedicalEducationConference/AnnualMeetingoftheAmericanAssociationofMedicalColleges,Washington,D.C.Luecht,RM.(1994,December).Ageneralizedheuristicforautomatedtestassemblywithproblem‐linkeditems.InvitedpaperpresentedattheSocialScienceInformationTechnologyConference,Amsterdam,TheNetherlands.Luecht,R.M.(1994,April).AdemonstrationofaninteractivecomputerprogramtoperformaDIFanalysispolytomousitemresponsedata.Paper&demonstrationsoftwarepresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,NewOrleans,LA.Luecht,R.M.(1994,December).SoftwareProgramsForTeachingAboutIRTAndComputerizedAdaptiveTesting.InvitedaddressattheUniversityofAmsterdam,TheNetherlands.Miller,T.R.,Luecht,R.M.&Welch,C.J.(1994,April).ExtractingCollateralInformationToImproveConditioningInPerformanceAssessmentDIFAnalysis.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,NewOrleans,LA.Thompson,T.&Luecht,R.M.(June,1994).CalibratingOperationalTestFormsContainingPretestItems.PaperpresentedattheAnnualMeetingofthePsychometricSociety,Champaign,Illinois.vanderLinden,W.J.&Luecht,R.M.(1994,April).AnOptimizationModelForTestAssemblyToMatchObserved‐ScoreDistributions.SymposiumpaperpresentedattheAnnualMeetingoftheAmericanEducationResearchAssociation,SanFrancisco,CA.Luecht,R.M.(1993,April).Amarginalmaximumlikelihoodapproachtoderivingmultidimensionalcompositeabilitiesunderthegeneralizedpartialcreditmodel.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,Atlanta,GA.

Richard M. Luecht Page 24 Luecht,R.M.(1993,April).UsingIRTtoimprovethestandardsettingprocessfordichotomousandpolytomousitems.PaperpresentedattheAnnualMeetingsoftheAmericanEducationalResearchAssociationandtheNationalCouncilonMeasurementinEducation(joint),Atlanta,GA.AlsoinvitedpaperattheCCSSOConference,Albuquerque,NM,June,1993.Luecht,R.M.(1993,April).SomeresultsonthestabilityoftheNAEPachievementlevelstandardsinmathematics.PaperpresentedattheAnnualMeetingsoftheAmericanEducationalResearchAssociationandtheNationalCouncilonMeasurementinEducation(joint),Atlanta,GA.AlsoinvitedpaperattheCCSSOConference,Albuquerque,NM,June,1993.Luecht,R.M.(1993,November).ScalingHolistically‐ScoredPerformanceAssessments:CompositesOrCompost.InvitedaddressattheUniversityofCalifornia‐SantaBarbara,GraduateSchoolofEducation,SantaBarbara,CA.Luecht,R.M.&vanderLinden,W.J.(1993,June).GeneratingTargetTestInformationAndCharacteristicFunctionsToMatchObservedScoreDistributions.Paperpresentedatthe1993AnnualMeetingofthePsychometricSociety,Berkeley,CA.vanderLinden,W.J.&Luecht,R.M.(1993,June).OptimizationModelsForTestAssemblyToMatchObserved‐ScoreDistributions.Paperpresentedatthe1993AnnualMeetingofthePsychometricSociety,Berkeley,CA.Luecht,R.M.(1992,April).Generatingtargetinformationfunctionsanditemspecificationsintestdesign.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,SanFrancisco,CA.Luecht,R.M.&Miller,T.M.(1992,April).ConsiderationsOfMultidimensionalityInPolytomousItemResponseModels.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,SanFrancisco,CA.Luecht,R.M.&Hirsch,T.M.(1991,June).ComputerizedTestConstructionOfParallelFormsWithProblem‐LinkedItems.PaperpresentedattheAnnualMeetingofthePsychometricSociety,NewBrunswick,NJ.Luecht,R.M.&Miller,T.R.(1991,April).UnidimensionalCalibrationsAndInterpretationsOfMultidimensionalTests.PaperpresentedattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL. Luecht,R.M.&Hirsch,T.M.(1990,June).ItemSelectionViaAnAverageGrowthApproximationOfTargetInformationFunction.PaperpresentedattheAnnualMeetingofthePsychometricSociety,Princeton,NJ.

Richard M. Luecht Page 25 Luecht,R.M.&Smith,P.L.(1990,April).VarianceComponentEstimationWithUnbalancedData.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,Boston,MA.Smith,P.L.&Luecht,R.M.(1990,April).StatisticalIssuesinGeneralizabilityTheory.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,Boston,MA.Luecht,R.M.,Madsen,M.K.,Taugher,M.P.,Coffey,F.&Petterson,B.(1989,May).AssessingProfessionalPerceptions:DesignAndValidationOfAnInterdisciplinaryEducationPerceptionScale.Posterpresentationatthe11thAnnualAlliedHealthResearchForum,UniversityofIllinoisatChicago,CollegeofAssociatedHealthProfessions.Luecht,R.M.,Madsen,M.K.&Sander,E.(1989,May).AMultidimensionalModelForComputerTrainingOfAlliedHealthFaculty.Paperpresentedatthe11thAnnualAlliedHealthResearchForum,UniversityofIllinoisatChicago,CollegeofAssociatedHealthProfessions.Luecht,R.M.&Smith,P.L.(1989,April).TheEffectsOfBootstrappingStrategiesOnTheEstimationOfVarianceComponents.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,SanFrancisco.Coffey,F.,Petterson,B.J.,Luecht,R.M.,Taugher,M.P.Gresch,A.M.&Madsen,M.K.(1988,May).InterprofessionalperceptioninaninterdisciplinaryrehabilitationclinicusingtheIPS.PosterpresentationattheUniversityofIllinoisMedicalCollegeResearchForum,Chicago.Luecht,R.M.,Madsen,M.K.&Sander,E.(1988,May).AModelForComputerTrainingOfAlliedHealthProfessionals.PanelforumandpaperpresentedattheFirstWorldCongressonAlliedHealth,Elsinore,Denmark.Luecht,R.M.&Pecyna,P.M.(1988,March).MS‐TTR:AComputationAlgorithmForStandardizingType/TokenRatios.PaperpresentedattheAmericanSpeech‐Language‐HearingAssociation,Boston.Petterson,B.J.,Coffey,F.,Madsen,M.K.,Luecht,R.M.,Taugher,M.P.&Gresch,A.M.(1988,May).InterprofessionalPerceptionInAnInterdisciplinaryRehabilitationClinicUsingTheIPS.Paperpresentedatthe21stConferenceoftheAmericanSocietyofAlliedHealthProfessions,NewOrleans.Smith,P.L.,Luecht,R.M.&Anderson,A.J.(1988,April).BootstrappingVarianceComponentEstimates.PaperpresentedattheAnnualMeetingoftheAmericanEducationalResearchAssociation,NewOrleans.

Richard M. Luecht Page 26 D.TEACHINGANDWORKSHOPSANDOTHERPRESENTATIONSCoursesTaughtattheUniversityofNorthCarolinaatGreensboro(1999‐present)ERM‐617 StatisticalMethodsinEducationERM‐667 FoundationsofEducationalMeasurementERM‐668 SurveyResearchMethodsinEducationERM‐669 ItemResponseTheoryERM‐680IntermediateStatisticalMethodsinEducationERM‐681 DesignandAnalysisofEducationalExperimentsERM‐675DataPresentationandReportinginEducation(coursedesigner,too)ERM‐726 SeminarinAdvancedTopicsinMeasurement(Equating,Performance

Assessments,StandardSetting,AssessmentEngineering)ERM‐727 Computer‐BasedTesting:MethodsandApplications(coursedesigner,too)ERM‐728 FactorAnalysisandMultidimensionalScalingEMR‐729 AdvancedItemResponseTheory(coursedesigner,too)ERM‐731 StructuralEquationModelingERM‐734 TestEquatingWorkshopsItemWritingintheSciences.UniversityofNorthCarolinaatGreensboro.GuilfordCountyGenomicMedicineProject,November,2005.AssessmentandAchievement.UniversityofNorthCarolinaSummerInstitute.WithTerryAckerman.June,2001.AssessmentandAchievement.UniversityofNorthCarolinaSummerInstitute.WithTerryAckerman.May,2000.IntroductiontoItemResponseTheory.InvitedworkshoppresentedattheResearchinMedicalEducationConference/AnnualMeetingoftheAmericanAssociationofMedicalColleges,Washington,D.C.,withRajaSuhiyah,andLynnWebb,L.,October,1995.ManagingItemPools,ItemExposureAndTestContentConstraintsInAComputerizedAdaptiveTest.Invitedworkshop/colloquiumattheUniversityofDelaware,Dept.ofEducation,Newark,DE,October,1995.ComputerizedAdaptiveTesting:PhilosophicalIssuesAndPracticalApplications.InvitedtrainingcourseattheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,SanFrancisco,CA,withMarkReckase,April,1992.

Richard M. Luecht Page 27 ComputerizedAdaptiveTesting:PhilosophicalIssuesAndPracticalApplications.InvitedtrainingsessionfortheAnnualMeetingoftheNationalCouncilonMeasurementinEducation,Chicago,IL,,withMarkReckase,April,1992..AnIntroductionToMedicalRecordsDataManagementSystems.InvitedworkshopforhospitaladministratorsandmedicalrecordsadministratorssponsoredtheUniversityofWisconsin‐Milwaukee,May,1988.ADataBaseManagementSystemsInHealthCare.InvitedworkshopformedicalrecordsadministratorssponsoredtheUniversityofWisconsin‐Milwaukee,1987.

Richard M. Luecht Page 28 E.SELECTEDCOMPUTERSOFTWARETITLES(WRITTENBYR.LUECHT) [Note:Unlessotherwisenoted,thesoftwarelistedbelowwaswrittenforpersonalcomputers(PCsusingDOSand/orWindowsoperatingsystems).Manyoftheseprogramsarestillusedoperationallyatvariousuniversitiesandsomeofthemajortestingorganizations.Notallaresimpleprograms;theterm“system”generallyreferstoanintegratedsetofsoftwareprograms(e.g.dataentry,databasemanagement,analysisandreportingmodules).Allofthesoftwareincludeddocumentationandfeatureduser‐friendlyinterfaces.Approximately200additionalsoftwaretitlesofresearch,simulationanddatamanagementutilityprogramsarenotlistedhere.] Luecht,R.M.(1985).FINNHELP.[Computerprogram].MainframestatisticalutilityprogramforsettingupMultivarianceIV(Finn,1979)analysescontrolcardsandcontrastmatrices.UniversityofWisconsin‐Milwaukee. Luecht,R.M.(1985).STATMAN.[Computerprogram].Graphically‐basedstatisticaltutorialandanalysissoftwareprogramforintroductorystatisticscourses.UniversityofWisconsinMilwaukee. Luecht,R.M.(1986).TAXON.[Computerprogram].PCutilitysoftwareprogramforgeneratingoptimaltestspecificationsperBloom’staxonomy,learningobjectiveandothertestfeatures.UniversityofWisconsinMilwaukee. Luecht,R.M.(1986).TESTPAC.[Computerprogram].Computer‐basedclassicalitemanalysisandscoringsoftwaresystemforeducational.Releasedaspublicdomainsoftwarein1987.Version2.0(c)1989releasedin1989.UniversityofWisconsinMilwaukee. Luecht,R.M.(1987).EPI‐D.[Computerprogram].PC‐basedstatisticalandepidemiologicalanalysissoftwaresystem.UniversityofWisconsinMilwaukee.Luecht,R.M.(1987‐9).CompWISE(tm)andInformationWISE(tm).[Computerprograms].Integratedsalaryadministrationandanalysissoftware,copyrightassigned1987,1988,1989toJamesandScottAssociates,Inc.,Milwaukee,WI.Luecht,R.M.(1987‐9).ATTEST.[Computerprograms].Integratedhospitalrecordsmanagementutilityprogramforcreatingphysicianattestationreal‐timereports.Copyrightassigned1989toSt.Mary’sHospital,Milwaukee,WI.Luecht,R.M.(1988).READER‐X.[Computerprogram].Experimentalreadingandcognitiveresearchsoftwaresystem.UniversityofWisconsinMilwaukee.Luecht,R.M.(1989).RATINGS.[Computerprogram].Dataentryandclassicalitemanalysisandscoringsoftwaresystemforpolytomousratingscores.Integratedaspartofthemerit

Richard M. Luecht Page 29 systemforfacultyevaluations.UniversityofMilwaukee‐Wisconsin,SchoolofAlliedHealth.(StillinuseatUWM)Luecht,R.M.(1990).IRT.[Computerprogram].Psychometricutilitysoftwareprogramforcalculatingandgraphingitemresponsetheoryitemandtestinformationandcharacteristicfunctions.IowaCity,IA:ACT.Luecht,R.M.(1990,1991).ITEMSTAT(Versions1.0&1.1).[Computerprogram].PCprogramforclassicalanditemresponsetheoryitemanalysisandexamineescoringoflargesampledata(usesmarginalmaximumlikelihood).AlsoproducesexpectedobservedscoresfromIRTitemstatistics,basedontheLord‐Wingerskyrecursionalgorithm.IowaCity,IA:ACT.Luecht,R.M.(1990).ISEL.[Computerprogram].IntegratedtestconstructionsoftwaresystemusingIRTinformationfunctionsandalgorithmsdevelopedbyLuechtandHirsch(1990).IowaCity,IA:ACT.Luecht,R.M.(1990).ESTI3PL.[Computerprogram].3‐parameterIRTitemcalibrationandscalingsoftwareprogramforsmallsamples,employingmaximummarginalaposterioriestimation.IowaCity,IA:ACT.Luecht,R.M.(1990).MCATSets.[Computerprogram].DatabaseandfilemanagementsystemfortheMedicalSchoolAdmissionsTestpretestcalibrationproject.IowaCity,IA:ACT.Luecht,R.M.(1991).VECTOR‐2D.[Computerprogram].Two‐dimensionalitemvectorgraphingprogramformultidimensionalIRTapplications.IowaCity,IA:ACT.Luecht,R.M.(1991,1994).IRTSTAT.(Versions1.0and2.0).[Computerprogram].UtilitysoftwareprogramforIRTparameterscalingandcomputingclassicalitem/teststatisticsfromIRTparameterestimates.IowaCity,IA:ACT.Luecht,R.M.(1992).NAEP‐DE.[Computerprogram].CompletedataentrysoftwaresystemfortheNationalAssessmentofEducationalProgress(NAEP)AchievementLevelsStandardSettingProject.IowaCity,IA:ACT.Luecht,R.M.(1992).NAEP‐STDS.[Computerprogram].IRTcomputationalsoftwareprogramforintegrated,multipleitempool,multiplejudge(many‐to‐many)mappingsofAngoffratingstoacalibratedproficiencyscaleviatheweightedTCCmethod.SoftwarewasdevelopedaspartoftheNationalAssessmentofEducationalProgress(NAEP)AchievementLevelsStandardSettingProject.IowaCity,IA:ACT.

Richard M. Luecht Page 30 Luecht,R.M.(1992).NAEP‐RPT.[Computerprogram].On‐sitereportingandgraphingsoftwaresystemforstandardsetting.Providedextensivejudge‐anditem‐basedfeedbackreportsforAngoffratingsinanetworkenvironment.DevelopedaspartoftheNationalAssessmentofEducationalProgress(NAEP)AchievementLevelsStandardSettingProject.IowaCity,IA:ACT.Luecht,R.M.(1992).VECTOR‐3D.Three‐dimensionalitemvectorgraphingandrotationprogramformultidimensionalIRTapplications.IowaCity,IA:ACT.Luecht,R.M.(1992).2D‐EAP.[Computerprogram].Bayesianestimationsoftwareprogramforcomputingtwo‐dimensionalexpectedaposterioriIRTproficiencyscores,basedonthemultidimensionalthree‐parameternormalogivemodel.IowaCity,IA:ACT.Luecht,R.M.(1992).CATExam.[Computerprogram].Interactivecomputerizedadaptivetestingdemonstrationsoftwaresystembasedonthe3PLmodel.FullyfunctionalasaCAT.User‐providedtestitemtextanddatacanbeimportedtotheprogram.IowaCity,IA:ACT.Luecht,R.M.(1993,1994).POLYMML.[Computerprogram].Marginalmaximumlikelihooditemcalibrationandabilityestimationprogramforcalibratingpolytomousdataunderamultidimensionalextensionofthegeneralizedpartialcreditmodel(Muraki,1992).BasedonworkdescribedbyLuecht(1993)forscalingperformanceassessmentsviatheGPCM,usingcollateralinformation.IowaCity,IA:ACT.Luecht,R.M.(1993).ITEMSEL.[Computerprogram].DOS‐basedautomatedtestassemblysoftwaresystemusingclassicalitemstatisticsandtestfunctionsandallowingmultipledimensionsforthecontentconstraints.IowaCity,IA:ACT.Luecht,R.M.(1993).Pic&Chuz.[Computerprogram].DOS‐basedautomatedtestassemblysoftwaresystemusingIRTtestinformationfunctionsandtestcharacteristicfunctions,withmultipledimensionsofcontentconstraints.DevelopedfortheNationalCouncilonEvaluationinEngineeringandSurveyingproject.IowaCity,IA:ACT.Luecht,R.M.(1993).LSATATAsoftwareseries.[Computerprogram].AutomatedlargescaletestassemblysoftwareforIRTtestconstructionproblemsinvolvingpassagebasedtestunitsandmultiplecontentconstraints.CopyrightassignmentjointtoAmericanCollegeTestingandtheLawSchoolAdmissionsCouncil.IowaCity,IA:ACT.Luecht,R.M.(1994).Builder2.0,3.0,4.0.[Computerprogram].Automatedtestassemblysoftwareprogramforusewithclassicalteststatisticsandmultiplecontentanditemattributedimensions..IowaCity,IA:ACT.CustomizedversionmodifiedfortheNationalBoardofMedicalExaminers.

Richard M. Luecht Page 31 Luecht,R.M.(1994).Manager.[Computerprogram].AutomatedtestassemblysoftwaredatamanagementandinteractiveitemselectionutilityprogramforuseinconjunctionwithBUILDER(Luecht,1994).IowaCity,IA:ACT.CustomizedversionmodifiedfortheNationalBoardofMedicalExaminers.Luecht,R.M.(1994).POOLANAL.[Computerprogram].ItempoolanalysisutilityprogramforuseinconjunctionwithBUILDER(Luecht,1994).IowaCity,IA:ACT.CustomizedversionmodifiedfortheNationalBoardofMedicalExaminers.Luecht,R.M.(1994).LOGMOMENT.[Computerprogram].SoftwaretocomputeexpectedobservedscoresfromlogisticornormalIRTmodels,usingthecompoundbinomialrecursionformula.Luecht,R.M.(1994).DoBIGSTEPS.[Computerprogram].RaschequatinganalysisDBMSsoftware.ProprietaryNBMEsoftware.Philadelphia,PA:NationalBoardofMedicalExaminers.Luecht,R.M.(1994,1995).EQUATE1PL.[Computerprogram].InteractiveequatingsoftwarefortheRaschmodel.Alsoincorporatesoptimizationheuristicsforautomaticallyselectinganchoritems.Philadelphia,PA:NationalBoardofMedicalExaminers.Luecht,R.M.(1994,1995,1996).SCORE2MLE.[Computerprogram].UnconditionalRaschmodelmaximumlikelihoodestimationsoftwareprogramandDBMS.Thisprogramisthecorescoringengineusedforapproximately100,000NBMESubjectTestadministrationseachyear.Philadelphia,PA:NationalBoardofMedicalExaminers.Luecht,R.M.(1994).CATDEMO.[Computerprogram].Interactivecomputerizedadaptivetestingtutorialanddemonstrationsoftware.Includesitem‐levelperformancegraphicsandisfullyfunctionalasalow‐securityadaptivetestingsoftwaredriverforsingleusers.CurrentlyusedbyseveralgraduateprogramsinmeasurementtoteachaboutCAT.Philadelphia,PA:NationalBoardofMedicalExaminers.Luecht,R.M.(1995).STDSET.[Computerprogram].Dataentry,scalingandanalysissystemformappingAngoffratingstoanIRTscale.Includesextensivejudge‐anditem‐basedreportingoptions.Uses“informationweighting”toproducerobustestimatesofastandard.Philadelphia,PA:NationalBoardofMedicalExaminers.Luecht,R.M.(1995).TRUEQUATE.[Computerprogram].Empiricallinearequatingsoftwareviathetestcharacteristicmethod.Philadelphia,PA:NationalBoardofMedicalExaminers.

Richard M. Luecht Page 32 Luecht,R.M.(1996).TOOLKIT.[Computerprogram].Windows™‐basedautomatedtestassemblysoftwareforusewithclassicalteststatistics.Philadelphia,PA:NationalBoardofMedicalExaminers. Luecht,R.M.(1996).IMPCONT1.[Computerprogram].DBMSconversionutilityforpreparingdatafilesforthecommericalATAsoftware,CONTEST1.0(Timminga,vanderLinden&Schweitzer,1996).Shareware. Luecht,R.M.(1997).MLESCORE.[Computerprogram].Maximumlikelihoodscoringprogramforcomputerizedadaptivetesting.UsedoperationallyattheNBME.Philadelphia,PA:NationalBoardofMedicalExaminers. Luecht,R.M.(1997).ITEMMLE.[Computerprogram].Itemanalysisandfitdetectionprogram,basedonconditionalmaximumlikelihoodscores.ForperformingIRT‐baseditemanalysisinacomputerizedadaptivetestingenvironment.UsedoperationallyattheNBME.Philadelphia,PA:NationalBoardofMedicalExaminers. Luecht,R.M.&Hadadi,A.(1998).ATAENGINE.[Computerprogram].Largescale,coreoperationalNBMEsoftwareforautomatedtestassembly.Basedonanobject‐orientedimplementationoftheNWADHheuristic.ProprietaryNBMEsoftware.Luecht,R.M.(1996,1999,2003).CASTISEL.[Computerprogram].1PLand3PLautomatedtestassemblyforcomputer‐adaptivemultistagetests(ca‐MSTandCAST).Usesmultiple,simultaneousobjectivefunctionsandconstraintsets.Releasedasfreewarein1999,3PLversion.(Version1.5releasein2003.)Luecht,R.M.(2001,2002).ITEMANALYSIS1.0.[Computerprogram].Interactiveitemanalysisformultiple‐choice(MC)andpartial‐credit(PC)classicaltestitemanalysis.CompleteMCdistractorandPC“scoringexpression”analysis.Luecht,R.M.(2001).X‐ScoreWS1.0.[Computerprogram].ComputesobservedscoresandclassicalitemstatisticsfromRaschitemparametersandmomentsoftheabilitydistribution.Worksformultiple‐choice(MC)andpartial‐credit(PC)itemfiles.Determinesnumber‐correctcutscoresforadesignatedtestformatafixedabilitylevel.Luecht,R.M.(2001).ATACOMBINATOR1.0.[Computerprogram].Computescompletecombinatoricitemselectionsolutionsforproblem‐linkeditemsets,usingthenormalizedweightedabsolutedeviation(NWAD,Luecht,1998)heuristic.Outputsare“optionalized”byareliabilitycriteria.Usesclassicaltestobjectivefunctionsandallowsitem‐levelconstraints.

Richard M. Luecht Page 33 Luecht,R.M.(2004).Score3PL‐EAPMLE.[Computerprogram].ComputesIRTexpectedaposterior(EAP)scoreestimatesandmaximumlikelihoodscoreestimatesscoreforthe3PLlogisticmodel.Luecht,R.M.(2005).MIRTGEN2.[Computerprogram].Computesdichotomousresponsedatafromamultidimensional3PLIRTmodel,withupto10correlateddimensions.Luecht,R.M.(2005,2009).CITAN:ClassicalItemAnalysis(Version1.5).[Computerprogram].Computesclassicalitemanalysisstatisticsanddistractoranalysis.Luecht,R.M.(2012).Quik‐TRA:QuickTestandReliabilityAnalysis(Version1.0).[Computerprogram].Computesclassicalitemanalysesandtestscalereliabilityanalysesusingdrag‐and‐dropinterfacesimplicity.Luecht,R.M.(2012).Quik‐SCORE:QuickItemScorig(Version1.0).[Computerprogram].ScoresrawresponsedataforusewithQuik‐TRA.Luecht,R.M.(2013).Build_caMST_Panels_TIF‐NWADH(Version1.0).[Computerprogram].Automatedtestassemblyforca‐MSTmodulesandpanelsbasedonLuecht’sNWADheuristic.Luecht,R.M.(2013).ObsScorStats_IRT(Version1.0).[Computerprogram].SoftwaretocomputeexpectedobservedscoredistributionsfromlogisticornormalIRTmodels,usingthecompoundbinomialrecursionformula,includingconditionaldistributions.Luecht,R.M.&Spray,J.S.(1991).DIF.AnalysissoftwarefordetectingdifferentialitemfunctioningusingMantel‐Hanzellog‐oddsratios. Luecht,R.M.&Spray,J.S.(1993).VISDIF.Graphicanalysissoftwarefordetectingdifferentialitemfunctioningusinglogisticdiscriminantfunctionanalysis.