Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
Prepared by:
DAVID PALMER, MPA & TRICIA CZACHOWSKI
JANUARY 2020
LongitudinalData Systems in Michigan:SLDS Analysis, Stakeholder Input and Recommendations
Table of Contents
1 Acknowledgments
2 ItemsofNote
3 President’sLetter
4-6 ExecutiveSummary
7 GuidingQuestions
8-10 LiteratureReviewandSystemScanofNationalOrganizations
8 WhatisaStateLongitudinalDataSystem?
8 WhatisanIdealDataSystem?
11-20 NotableReportsandActivity
21-34 OverviewofMichiganSLDS
21 GeneralObservations
22 GovernanceandStructure
26 DataSystemFunding
32 DepartmentofLaborandEconomicOpportunity-WorkforceDevelopment
33 RequestingCustomorNon-PublicData
35-43 StakeholderInput:Conveningand1:1Discussions
36 ObservationsfromConveningsinNoviandGrandRapids,Michigan
38 OpinionsofIdentifiedDataSystems
40 AdditionalGeneralStakeholderStatements
41 LaborMarketInformationandStrategicInitiatives
42 1:1Meetings
44-49 BestPracticesfromAcrosstheUnitedStates
44 Washington
46 Virginia
47 Kentucky
48 OtherNoteworthyStates
50-52 Recommendations
54 AbouttheAuthors
55-56 Bibliography
ACKNOWLEDGMENTS | 1
ThisreportwascommissionedbyTalent2025inSeptemberof2019toprovidebetterinsightintothepast
development,currentstate,andfutureopportunityofMichigan’sstatelongitudinaldatasystems(SLDS).
TheauthorswouldliketothanktheleadersoftheWestMichigantalentworkinggroupfortheirtrustand
confidenceinourabilitytodeliverthisresearchinatimelyandeffectivemanner:
•KevinStotts,President,Talent2025
•AlexAndrews,ResearchManager,Talent2025
•JulieParks,ExecutiveDirectorofWorkforceTraining,GrandRapidsCommunityCollege
•JacobMaas,CEO,WestMichiganWorks!
•AndyJohnston,VPofGovernment&CorporateAffairs,GrandRapidsChamberofCommerce
•BillGuest,LeadConvener,TalNet
•RandyLindquist,AssociateSuperintendentforAcademicService,MuskegonAreaIntermediateSchoolDistrict
Talent2025andtheauthorswouldliketoacknowledgeandthanktheDougandMariaDeVosFoundationfor
providingthefundingtoperformthisresearch.
ThanksalsototheMichiganDepartmentsofTechnology,ManagementandBudget,andLaborandEconomic
Opportunity,includingstafffrom:
•MichiganBureauofLaborMarketInformationandStrategicInitiatives
•DepartmentofLaborandEconomicOpportunity-WorkforceDevelopment
•CenterforEducationalPerformanceandInformation
•P-20LongitudinalDataSystemAdvisoryCouncil
Finally,thanksareduetothe41individualswhoinvestedtheirtimein1:1interviewsorattendedin-person
conveningsinNoviandGrandRapids,Michigan.Theseincludedrepresentativesfromthefollowingorganizations:
•CalvinUniversity,CenterforSocialResearch
•CareerlineTechCenter
•CitizensResearchCouncilofMichigan
•ConsumersEnergy
•DetroitRegionalChamberofCommerce
•GrandRapidsAreaChamberofCommerce
•GrandRapidsCommunityCollege
•HamiltonCommunitySchools
•HenryFordCollege
•KentIntermediateSchoolDistrict
•LivingstonEducationalServiceAgency
•MacombIntermediateSchoolDistrict
•MichiganAssociationofSecondarySchoolPrincipals
•MichiganFuture,Inc.
•MichiganStateUniversity,EducationPolicy
InnovationCollaborative(EPIC)
•MichiganTalentArchitecture
Acknowledgments
•MuskegonAreaIntermediateSchoolDistrict
•NorthwestCommunitySchools
•OaklandCommunityCollege
•OaklandSchools
•OceanaCollegeAccessNetwork
•RalphC.WilsonJr.Foundation
•SoutheastMichiganCommunityAlliance(SEMCA)
•TheRightPlace,Inc.
•UniversityofMichigan,InstituteforSocialResearch,
YouthPolicyLab
•U.S.ChamberofCommerceFoundation
•WashtenawIntermediateSchoolDistrict
•WayneRegionalEducationServiceAgency
•WestMichiganWorks!
•WestShoreEducationalServiceDistrict,
CareerTechnicalEducation
•WorkforceIntelligenceNetwork
•WilliamDavidsonFoundation
2 | ITEMS OF NOTE
SLDS
Thetermstatelongitudinaldatasystem(SLDS)iscommonlyusedtorefertoallstatewidesystemsthattrack
studentachievementovertime,encompassingdatafromearlychildhood,education,andworkforcecategories.
Somestateshaveseparatesystemstohandleeachofthesethreecategories,whileotherseitherrefertothethree
systemsasoneorcombineallthreecategoriesintoonesystem.StateofMichiganrepresentativeshaveinformedthe
authorsthatwithinthestatedepartments,SLDSreferstotheMichiganEducationDataSystem.
Forthepurposeofthisreport,theauthorshaveusedSLDSinthegenerallyacceptednationalframing,inan
all-encompassingmanner,includingwhenreferringtoMichigansystems.Occasionally,aspecificMichigan
systemisreferenced:MichiganStateLongitudinalDataSystem(MSLDS)coverseducationdata,whileWorkforce
LongitudinalDataSystem(WLDS)referstoworkforcedata.
Names of State of Michigan Departments
Departmentsatthestatelevelchangeoccasionally.Throughoutthisreport,youmayseereferencestothe
previousnamesofcertaindepartments.Thesenamechangeswereinfluxatthetimeofthereportwriting,
andmanystateemployeeshadnotyetreceivedbusinesscardsorotherclearinstructionsondepartment
reorganizationandnamingconventions.Tohelpclarify:
•LaborMarketInformationandStrategicInitiatives(LMISI)issometimesreferredtoas“LaborMarketInformation”
•DepartmentofLaborandEconomicOpportunity(LEO),whichincludesWorkforceDevelopment(WD)
andUnemploymentInsuranceAgency(UIA)maybereferredtoas“TalentInvestmentAgency,”“TIA,”and
“WorkforceDevelopment.”
Items of Note
PRESIDENT’S LETTER | 3
Moving from Good to Great
Achievinglong-term,sustainable,economicvitalityforregionsandstateshasbecomeincreasinglydependentupon
themixofeducationandskillsattainedbytheirresidents.Wecanseethisintheconsolidationofmetroareaswith
highlyconcentratedpoolsofeducatedandskilledtalentfoundacrosstheUnitedStates.Regionsandlocalitiesare
strivingtoremaincompetitiveina21stcenturytalentlandscape,whereoftenhard-to-quantifyskillsleademployer
demandinthemarketplace.Noteworthyarethedeclinesofcommunitiesandregionswithlaborpoolsofcomparatively
less-educatedandlower-skilledtalent.Theirchallengesareoftencompoundedbydifficultyattractingandretaining
talent,inconjunctionwithaninabilitytoprovidesustainedandscalableupskillingforavailablejobs.
AnumberofrecentnationallyfocusedreportsfromthelikesofMcKinsey,Brookings,theU.S.ChamberofCommerce
Foundationandothersmakeclearthatexistingdisparitiesinthelabormarketareexpectedtobecomeevenmore
pronouncedasartificialintelligenceandautomationtransformtheworkplace.Thenatureandfunctionofworkis
changingbeforeoureyesinfavorofamoresophisticatedmixoftechnicalandsoftskills.
Atthesametime,Michiganfacestwosignificantchallenges:first,anagingpopulationanddecliningbirthrate.
Second,lowerlevelsofeducationandtrainingcomparedtoneighboringstatesandthenation.Thesepointsare
largelyunaddressedinourcivicmarketplaceinanyreasonablysubstantial,identifiableormeasurableway,asidefrom
considerablerhetoric.Michigan’sabilitytoretain,grow,andattractemployerswhoareinneedofaneducatedand
skilledworkforcetocompeteinaglobaleconomyhasbeenandremainsindecline.
Inthiscompetitiveenvironmentanduncertainfuture,Michigan’seducationandworkforcedevelopmentstrategies
needtobeoptimizedwithhigh-qualitydataandinsightstoensurewegrowastalentleadersinthenewdecade.
Talent2025’srecentreport,20/20Vision,reinforcesthispoint,showingthatalignmentofpublicpoliciesand
investmentsinfavorofevidence-basedstrategiesiscriticaltothefuturegrowthofourstate.
Therecommendationsstemmingfromthisnewresearchonlongitudinaldatasystemsarenotcomplicatedor
flashybutarechangesabsolutelycriticaltoimprovingthequalityofeducationandworkforcesystemsforallof
Michigan–individuals,employers,andcommunities–tocompeteinaglobalknowledgeeconomy.Functionality
followsculture.Michigan’spolitical,education,andtrainingculturesdesperatelyneedarefreshforthe21stcentury.
Theserecommendationsinvokeeconomicgardening,transparencyanddata-informeddecisionmaking.Itishard
tomakeacasethatMichigandoesanyofthesethingswelltoday,butTalent2025believesMichiganhasthe
expertise,toolsandthewilltodobetter,andwemustdobetterforthesakeofcurrentandfuturegenerations.
Talent2025looksforwardtoyourfeedbackand,ultimately,collaborationtosolvethesechallenges.
Withrespect,
KevinStotts,President,Talent2025
President’s Letter
4 | EXECUTIVE SUMMARY
Michigan’seconomicfuturewillbedeterminedbytheskillsandeducationofitsworkforce.Competinginthe21st
centurytalentlandscapedemandseducationandworkforcesystemsthataredesignedforaglobal,knowledge-
basedeconomy.
Tobeeffective,thesesystemsmustbebuiltonafoundationofhigh-qualitydatathatmeasurestheeffectivenessof
oureducationandworkforceprogramsindeliveringresultsforMichigan’scitizens,employers,andcommunities.
Thattransformationalreadyisunderway,andnationalstudiespredictittoaccelerate,drivenbythegrowingrolesof
automationandartificialintelligence.Tocompeteinthisenvironment,employersincreasinglydemandworkerqualities–
acombinationofsoftskillsandtechnicalexpertise–thatcanbedifficulttoquantifywithexistingdatasystems.
Meanwhile,Michigan’slagginglevelsofeducationandtraining,adecliningbirthrateandtightlabormarkethave
onlyaddedtoemployerneedformoresophisticatedanddetailededucationandworkforcedata.Toprovidethat
informationandtoguideimprovements,Michiganneedsabest-in-classstatelongitudinaldatasystemtoquantify
educationalandtrainingoutcomesforyouthandadults.
Examining the System
Michigan,alongwithotherstates,begandevelopingstatelongitudinaldatasystems(SLDS)intheearly2000s
totrackstudentprogressthroughthepubliceducationsystem.Thepurposewastoassistlocaleducatorswith
programmingandtoallowpolicymakerstoassessandmakedecisionsregardingtheeducationsystem.
Asthesesystemsdevelopedacrossthecountry,bestpracticesemerged.Manystatesbeganlinkingeducationdata
withadditionalstatesystems,includingworkforceandunemploymentwagedata.Theselinkagesofferedamore
holisticapproachtomeasuringandsupportingprogramchallengesandsuccess.InMichigan,thisresultedina
systemthatwastrifurcated,withoneagencyresponsibleforeducationdata,oneresponsibleforworkforcedata,
andanotherresponsibleforwagedata.Thesystemalsoisfederated,whereeachdepartmentoradministrative
entitycompiles,manages,anddetermineshowandwhenitsdatawillbeshared.
OurresearchoftheMichiganSLDSfoundwhatappearstobeonemajordrawback:Alackofaccesstolongitudinal
connectionsacrossK-12,post-secondaryandworkforcedatainawaythatallowsforresearch,innovationand
evaluationofinstitutionsandindividualprograms.
Why Improvements Are Needed
Michiganhasstruggledtoretain,growandattractemployersthatrelyonaneducatedandskilledworkforce.
Thedemographicchallengesweface,alongwithourcomparativelylowerlevelsofeducation,needtobe
addressedinarationalandmeasurableway.High-qualitydataisessentialtothisdiscussion.
AsofDecember2019,over$20millioninfederalfundinghasbeeninvestedinMichigan’sSLDS.Alongwith
employerdemandformoresophisticateddata,expectationsformorecapabilitieshavebeenrisingforyears
amongschooladministrators,communitycolleges,universityresearchers,theworkforcesystem,andnonprofit
workforceintermediaries.Theseexpectationsrangefromon-demandsystemsleveldata,togranularprogramlevel
data,whichcouldresultinanswerstoawiderangeofquestionsabouteducationandworkforceinvestments.
Executive Summary
EXECUTIVE SUMMARY | 5
Talent2025commissionedthisreportthankstofundingfromtheDougandMariaDeVosFoundationtoshedlight
onMichigan’sSLDS,sostakeholderscanhaveawell-sourceddocumentwithinsightsabouttheuseofthecurrent
SLDSandtoguideimprovementstowardabest-in-classsystem.
Inadditiontoanationalliteraturereview,stakeholderswereconvenedtobetterunderstandexpectations,
frustrations,andrecommendationsfromdiverseperspectives.ThepastandcurrentstateofMichigan’sSLDS
wasdocumentedandcomparedtobest-in-classsystemsaroundthecountry.
Building a Best-in-Class System for Michigan
Basedonourreviewofliterature,stakeholderinputandexaminationofhigh-functioningsystemsacrossthe
country,thecharacteristicsofabest-in-classSLDSinclude:
•WidespreadPolicymakerSupport
•MeaningfulAgencyCollaboration
•HighQualityGovernanceStructure
•RobustPrivacyandSecurityProtocols
Recommendations
ToachievethesecharacteristicsinMichigan’sSLDS,thisreportmakessevenrecommendations.Belowisasummary
ofthoserecommendations,whichareexploredindetailstartingonpage50ofthisreport.
1 Growacultureofdataliteracyandtransparency.
2 DesignandpublishclearrulesforengagementforaccesstoSLDSdata.Makethe“frontdoor”obvious
acrosswebsitesanddashboardsforalldataowners.
3 Addvitalreportingmetricstoemployerunemploymentwagereportingincluding:ONEToccupationcode,
jobtitle,hoursworked,andprimaryjobsite.
4 Addmissingdatafromexistingstatesystems.
5 Implementasystemofassigninguniqueidentifiercodes(UIC)atbirth,oratfirstengagementwithstate
services.IntegrateacommonsystemofUICassignmentacrossallstateagencies,agentsofthestate,
andsubcontractors.
6 Appropriatea“datainnovationandqualityfund.”
7 Revisitsuccessionplansamongkeystateagenciestoidentifyandverifycriticalsystemsandemployees.
Ifconsideredandimplementedwell,theseimprovementswillcatapultMichiganintothetoptierofbest-in-class
systems,providingawiderangeofresearchopportunities.Theyalsowouldprovide(arguablyforthefirsttime)
comprehensiveefficacymeasurestoaccompanybillionsofdollarsineducationandworkforceinvestments.Thisis
howweimprovethequalityofeducationandworkforcesystemsforindividuals,employers,andcommunities.
•StandardizationofData
•AdequateTechnicalInfrastructure
•DedicatedHumanCapital
•SustainableInternalLeadership
6 | EXECUTIVE SUMMARY
How Recommendations Align with Best-in-Class SLDS Characteristics
Recommendations
1 Expand data literacy & transparency.
2 Publish rules for data access.
3 Add vital metrics to wage reporting.
4 Add missing data from existing systems.
5 Assign unique identifier codes.
6 Establish a data innovation & quality fund.
7 Verify critical data systems & employees.
Best-in-Class SLDS Characteristics
Widespread Meaningful High Quality Robust Privacy Standardization Adequate Dedicated Sustainable Policymaker Agency Governance and Security of Data Technical Human InternalSupport Collaboration Structure Protocols Infrastructure Capital Leadership
a a a a a a a
a a a a a a a
a a a a
a a a a a a a a
a a a a a a
a a a a a a
a a a a a a a
$
GUIDING QUESTIONS | 7
Guiding Questions
•HowdoesMichigancomparetothebest-in-classstatelongitudinaldatasystems(SLDS)
acrossthecountry?HowcanMichiganbecomeabest-in-classsystem?
•Whatarethecurrentuserexperiences,needs,andexpectationsofaMichiganSLDS?
Howcanthestatebetterservethesestakeholders?
•WhatfundingandresourceshavebeenexpendedonthecurrentSLDS?Havegrants
andotherfundingresourcesdeliveredonpromises?
•WhoisabletoaccessSLDSdataandtowhatlevel?HowisSLDSdatashared
successfully?Canthisbereplicated?
•Whatdatasharingisdesiredbystakeholdersthathasnotbeenaccomplished?
Howcandatasharingchallengesbeaddressed?
•WhatarethegoalsforafutureSLDSandwhatstakeholdershavebeenidentifiedto
developafeedbackloop?
•DoMichigan’scurrentrulesfordatasharingresultinwell-informedandcoordinated
decision-makingwhileprotectingprivacy?Whatchangescanresultinasystemthatis
confidentlyusedfordecision-making?
•HowistheSLDSfundedandisthatfundingsustainable?
8 | LITERATURE REVIEW AND SYSTEM SCAN OF NATIONAL ORGANIZATIONS
Throughaliteraturereview,13organizationsand15governmentagencieswereidentifiedasplayersinthestatelongitudinalsystemsspace,althoughmanymoreexist.Theseentitiesplayvariousroles,includingconductingresearch,conveningstakeholdersforbestpractices,studyingoractingupontheeconomiccomponentsofthedata,orprovidingsolutionstodata-identifiedworkforcegaps.ResearchandinformationregardingthedevelopmentofSLDSisrobust.
What is a state longitudinal system?Withthetechnologicaladvancementsofthe21stcentury,theabilitytoconnectpeopleandthingshasaccelerated
atanastoundingrate.Anexpectationforimmediate,accessible,easytounderstanddatahasaccompaniedthis
technologicalboom.Acomplementaryexpectationthatinstitutionalandgovernmentdecisionsbemadebasedon
thisdatahasgrownconcurrently.Manystategovernmentsnowstrivetocollectandmanagedatatosupportsmart
decisionmakingasamethodofefficientandaccountablegovernment.Michiganisnoexception.
AccordingtoaHuntInstitutereport,“Thefirstmajorpushforstatewidelongitudinaldatasystems(SLDS)came
throughtheEducationalTechnologyandAssistanceActof2002,whichcreatedthefirstcompetitivefederalgrant
processtosupportstateeducationagenciesinthedevelopmentofthesesystems”(Siddiqi&Goff,2019).This
initialfederalactionhassnowballedintoarushforallstatestodevelopstatelongitudinaldatasystems.
TheNationalCenterforEducationalStatistics(NCES)definesaneducationallongitudinaldatasystemas“adata
systemthatcollectsandmaintainsdetailed,highquality,student-andstaff-leveldatathatarelinkedacrossentities
andovertime,providingacompleteacademicandperformancehistoryforeachstudent;andmakesthesedata
accessiblethroughreportingandanalysistools.”(NationalForumonEducationStatistics,2010,p.7)
AnSLDSisoftenreferredtoasaddressingP-20W–encompassingdatafromprekindergarten(earlychildhood),
K-12,andpost-secondarythroughpost-graduateeducation,alongwithworkforceandotheroutcomesdata
(e.g.,publicassistanceandcorrectionsdata).Thespecificagenciesandotherorganizationsthatparticipatein
aP-20W+initiativevaryfromstatetostate(NationalCenterforEducationStatistics,February2017).
What is an ideal data system?WhilemanystatesreportbuildingandmaintaininganSLDS,nationalstandardshaveonlybeenminimallydeveloped.
Federallyrequireddatasetsprovidesomestructureanduniformity,butthereisalackofstandardsacrossthenation
fordevelopmentofthesesystems.Theintegrateddata,theexistenceofthedatasets,andtheiravailabilityvary
greatly.Mostuniformityacrossstatesisoccurringonavoluntarybasisandonlyinproactivestates.
Literature Review and System Scan of National Organizations
LITERATURE REVIEW AND SYSTEM SCAN OF NATIONAL ORGANIZATIONS | 9
Governmentorganizationsandnationalexpertshavedevelopedrecommendationsfordeveloping,maintaining,and
maximizingtheusefulnessofthesedatasystems.
Government Organizations and National Experts
Center for Regional Economic Competitiveness (CREC)
Researchandtechnicalassistancerelatedtostatedatasharing.AnevaluationofCRECreportswasconducted
inthisresearchpaper.
Child Trends
Nationalresearchorganizationfocusedexclusivelyonimprovingthelivesofvulnerablechildrenandyouth.
Common Education Data Standards (CEDS)
Educationdatamanagementinitiativewhosepurposeistostreamlinetheunderstandingofdatawithinand
acrossP-20Winstitutionsandsectors(https://ceds.ed.gov/whatIsCEDS.aspx).Thisdoesnotcontaindataabout
thestatusofMichigan’sSLDS,butcouldbearesourceforrecommendationsandpossibleassistance.
State of Washington, Education Research and Data Center (ERDC)
Anumberoforganizationsincludethetitle“EducationResearchandDataCenter.”Severalstateshaveasimilar
typeofcenter.Forthepurposeofthisstudy,thisreferenceistotheStateofWashingtonERDC,whichincludes
anextensiveamountofstudiesandresourcesregardingstatelongitudinaldatasystems.
National Governors Association
Hasapublicpolicypositionforworkforcedevelopmentandpost-secondaryeducationthatincludesencouragement
ofSLDS(https://www.nga.org/policy-positions/job-training-and-higher-education/).Anissuesinitiativerelated
todataandaccountabilityidentifiesgovernorsastheonlyofficialsthatoverseetheentirepipelinefrombirth
intotheworkforce.Theinitiativeencouragestheuseofdatatoensurethatoutcomesaremetacrossthe
educationpipeline(https://www.nga.org/center/issues/data-and-accountability/).
National Skills Coalition (NSC)
Extensiveresearchandrecommendationsregardingworkforcedataanddatasystems.IncludestheWorkforce
DataQualityCampaign(WDQC)andaStateWageInterchangeSystem.
The Center for IDEA Early Childhood Data Systems
Abletodeveloporenhancecoordinatedearlychildhoodlongitudinaldatasystems(https://www.sri.com/work/
projects/center-idea-early-childhood-data-systems-dasy).
The Hunt Institute
AnaffiliateoftheDukeUniversitySanfordSchoolofPublicPolicy.Strategiccatalystfortransformingpublic
educationpolicy.
10 | LITERATURE REVIEW AND SYSTEM SCAN OF NATIONAL ORGANIZATIONS
Aspen Institute
Offersmacroeconomicargumentsforextensivestatedatasystems.Reportsindicatethatstatedatasystems
areimportanttoaligningthefutureworkforcetoneededskillsandtraining.
Credential Engine
MaintainstheCredentialRegistry,acloud-basedlibrarythatcollects,maintains,andconnectsinformation
onalltypesofcredentials,fromdiplomastoapprenticeshipsandfromlicensestoPhDs.TheRegistryholds
detailedinformationonmanytypesofcredentialsinaneasilyaccessibleformat.
Workforce Intelligence Network for Southeast Michigan (WIN)
Providesprioritizedreal-timeworkforcedatathroughlabormarketreportsspecifictothe16-county
Detroitlaborregion.Alsoprovidesoccupationorindustryspecificspecializedreports.
Federal Agencies
Department of Labor Employment and Training Administration (DOL ETA)
HoldsWorkforceInformationAdvisoryCouncil.Developingreport“RecommendationstoImprovethe
Nation’sWorkforceandLaborMarketInformationSystem”(2018)
National Center for Education Statistics (NCES)
PrimaryfederalentityforcollectingandanalyzingdatarelatedtoeducationintheU.S.andother
nations.NCESislocatedwithintheU.S.DepartmentofEducationandtheInstituteofEducation
Sciences.NCESfulfillsacongressionalmandatetocollect,collate,analyze,andreportcomplete
statisticsontheconditionofAmericaneducation;conductandpublishreports;andreviewandreport
oneducationactivitiesinternationally.
U.S. Department of Health and Human Services (DHHS)
AdministrativeApproachestoEnhanceAvailabilityofdata(2016)(https://www.hhs.gov/open/2016-plan/
approaches.html)
United States Government Accountability Office (GAO)
BetterDataNeededtoAssessandPlanforEffectsofAdvancedTechnologiesonJobs(March2019)(https://
www.gao.gov/products/GAO-19-257)
Bureau of Labor Statistics (BLS)
AdivisionoftheU.S.DepartmentofLabor,BLSistheprincipalfederalagencyresponsibleformeasuring
labormarketactivity,workingconditions,andpricechangesintheeconomy.Itsmissionistocollect,analyze,
anddisseminateessentialeconomicinformationtosupportpublicandprivatedecisionmaking.Asan
independentstatisticalagency,BLSservesitsdiverseusercommunitiesbyprovidingproductsandservices
thatareaccurate,objective,relevant,timely,andaccessible.
NOTABLE REPORTS AND ACTIVITY | 11
Anationalscanofreportsandresearchrevealspromisinginsightstowarddevelopinghigh-functioningstatelongitudinaldatasystems.Theextentoftheresearchreflectsthestrongdemandforcomprehensive,trustedandaccessibledatathatcanbeusedtooptimizeeducationandworkforcestrategies.Theliteraturesummarizedbelowincludesanalysesofcurrentpractices,legislationandrecommendationsforimprovement.
The National Skills Coalition
TheNationalSkillsCoalition(NSC)engagesinorganizing,advocacy,andcommunicationstoadvancestateand
federalpoliciesthatsupportavisionofanAmericathatgrowsitseconomybyinvestinginitspeoplesothatevery
workerandeveryindustryhastheskillstocompeteandprosper.Itsworkseekstohelpelectedofficialsanswerthe
question:“Areoureducationpoliciesequitablyservingadiverseworkforceandnimblyrespondingtotheevolving
skillneedsofour21stcenturyeconomy?”
NSCiscontinuingworkstartedthroughitsWorkforceDataQualityCampaign(WDQC),andconductedextensive
researchtodevelopsmartdatapolicies,systems,andtoolstoaddressthisneed.WDQCpublishedmultiplebriefings
sharingbestpracticesandrecommendationsregardingthedevelopmentofSLDS:
n Smart Data for a Skilled, Inclusive 21st Century Workforce
This2019NSCreportrecommendsthatsystemsshouldtrackemploymentoutcomesforgraduatesofall
post-secondary,workforcedevelopment,andsupportserviceprograms,anddocumentthepathwayswhereby
peoplecombinethoseprogramstodevelopnewcareers.Thesedatasystemsshouldincludeinformationon
allcredentials,includingcertificates,licenses,andcertifications.Stateandfederalagenciesshouldusethisto
guideinvestmentstosupportprogramswiththegreatestsuccess.NSCrecommendsstatesandfederalagencies
makekeydataavailableinaccessibleformatstohelpstudentsandworkersselecteducationandcareerpaths
thatleadtogoodjobs.Inaddition,theyrecommend(NationalSkillsCoalition,2019):
1.Betterdatatoalignprogramsandmakeiteasierforworkerstomoveacrosssystemsandgetskills
neededthroughouttheircareer.Thisincludesdatareformsacrossworkforcetraining,careerand
technicaleducation(CTE),work-basedlearningandapprenticeship,highereducation,adultliteracy,
safetynetprograms,TradeAdjustmentAssistance(TAA),transportation,energy,andinfrastructure
trainingprograms.
2.Disaggregatedemploymentandearningsoutcomesattheprogramlevelshouldbeusedtoshowthe
publicwhoisbeingwellservedandwhoisnotbyspecificprograms.
NSChelpeddevelopandpasstheCareerExplorationExpansionAct,whichhasbeenpassedineightstates
(notincludingMichigan).Thislegislationhelpsstatesmeasurenon-degreecredentialattainment.NSCalso
advocatesforfederalsupportofstatelongitudinaldatasystemsincludingtheWorkforceDataQualityInitiative
(WDQI).TheagencyadvocatesforsupportoftheCollegeTransparencyAct,whichwouldrequiretheNational
Notable Reports and Activity
12 | NOTABLE REPORTS AND ACTIVITY
CenterforEducationStatisticstodevelopandmaintainasecure,privacy-protectedpost-secondary
student-leveldatasystemto(U.S.Congress,2019):
1.“accuratelyevaluatestudentenrollmentpatterns,progression,completion,andpost-collegiate
outcomes,andhighereducationcostsandfinancialaid;
2.“assistwithtransparency,institutionalimprovement,andanalysisofFederalaidprograms;
3.“providemoreaccurate,complete,andcustomizableinformationforstudentsandfamiliesmaking
decisionsaboutpostsecondaryeducation;and
4.“reducethereportingburdenoninstitutionsofhighereducation,inaccordancewithsection5(b)
oftheCollegeTransparencyAct.”
n Saying ‘Yes’ to SLDS
This2019reportbyNSCrecommendsthatstatelongitudinaldatasystemsshouldcontaindatafromacross
theeducationandworkforcespectrum.SLDSstaffshouldcommunicateinformationaboutthebenefitof
SLDSbysharingtailoredmessagesabouthowstakeholderscanbenefitfromparticipatingintheSLDS.
Examplesofhowotherstakeholdershavebenefitedfromparticipatinginthesystemshouldbeused.
Staffshouldproactivelyprovidedetailedinformationaboutprivacyandsecuritypractices.Statesshould
ensureparticipationindatagovernancebyenablingparticipatingagencyleaderstohaveasenseofownership
overtheSLDSthroughagovernanceoradvisorycouncil.
n Making Wage Data Work
Inthis2018brief,theWorkforceDataQualityCampaignassessedtheneedforSLDSdataatthefederallevel
andthelimitationsofsomeoccupationtypeswithinthesesystems:
“�Congress�has�mandated�that�states�use�UI�(unemployment�insurance)�wage�record�data�to�show�the��
performance�of�some�federally�funded�programs,�such�as�those�supported�by�the�Workforce�Innovation�
and�Opportunity�Act�(WIOA),�which�require�reporting�on�employment�and�earnings�at�quarterly�intervals.�
UI�wage�records�do�not�include�data�on�federal�employees�and�self-employed�individuals�that�are��
important�for�providing�a�complete�picture�of�the�workforce.�The�Office�of�Personnel�Management�
retains�wage�data�on�federal�workers,�although�the�government�holds�military�personnel�and�U.S.�Postal�
employee�records�separately.�The�U.S.�Department�of�the�Treasury�holds�W-2�and�tax�data�on�all�workers.�
Of�note,�the�Internal�Revenue�Service�(IRS)�1099�form�captures�earnings�from�self-employed�individuals.�
The�Social�Security�Administration�also�retains�W-2�and�tax�data.”
ThisreportalsodetailsamajorprojectstartedfromapartnershipbetweentheU.S.CensusBureauandthe
UniversityofTexas(UT)SystemtoprovidemorelongitudinaldataforresearchersaswellastheUTSystem
dashboardsthatprovidepublicinformationontheearningsofgraduatesbyprogramofstudy.Theproject
showsthepotentialformatchingotherhighereducationdatawithLongitudinalEmployer-HouseholdDynamics
(LEHD)earningsdatafromaroundthecountry.LEHDaredatasetsthroughtheU.S.CensusBureauthatmay
beusedtoresearchandcharacterizeworkforcedynamicsforspecificgroups.Formoreinformation,visit
https://lehd.ces.census.gov/data/.
NOTABLE REPORTS AND ACTIVITY | 13
Inthisreport,WDQCrecommends:
“�Whether�or�not�DOL�becomes�the�backbone�of�a�federal�source�of�wage�data,�Congress�should�consider�
amending�WIOA�to�allow�the�Department�to�create�a�database�with�personally�identifiable�information�
on�all�program�participants.�DOL�or�other�authorized�agencies�could�more�easily�match�workforce�
program-participant�data�with�information�from�other�systems,�including�wage�record�data.�The�eventual�
reduction�in�separate�administrative�steps�would�result�in�more�comprehensive�and�timelier�workforce�
program�information.�In�conjunction�with�better�access�to�wage�data,�this�solution�would�also�make��
it�easier�for�DOL�to�create�consumer�reports�for�prospective�workforce�education�participants�and�businesses�
across�the�nation.”�(Pena,�2019,�Making�Wage�Data�Work)
n Workforce Success Relies on Transparent Post-Secondary Data
TheNSCnotedinthis2018paperthat,toreportontrendsinpost-secondaryeducation,theU.S.Department
ofEducation(U.S.DOE)mostlyreliesonsurveysofpost-secondaryinstitutionsforitsIntegratedPost-Secondary
EducationDataSystem(IPEDS).Theinformationdoesnotincludeemploymentandearningsoutcomes.
U.S.DOEalsooverseestheproductionoftheCollegeScorecard,whichincorporatesannualearningsdata
gatheredfromtheU.S.DepartmentoftheTreasury,butthesedataarelimitedtofederallyaidedstudents,
andU.S.DOEonlyrecentlystartedreportingtheresultsforindividualprogramsofstudyormajors.
WDQCisadvocatingheavilyforafederalstudent-leveldatanetworkthatwouldenablethegovernmentto
reportontheemploymentandwageoutcomesofpostsecondarystudentsnationwideandallowforthe
creationofonlinedatatoolsthatincludeindicatorsonemploymentandearnings,sostudentscouldcompare
programswithinandacrossinstitutionstomakemoreinformeddecisionsabouttheireducationandcareers.
(Pena,2018,WorkforceSuccessReliesonTransparentPost-SecondaryData)
n Measuring Non-Degree Credential Attainment (Levantoff, 2019)
ThisNSCreportindicatesthatstatesshouldincorporatedataonnon-degreecredentialsintotheirSLDS
andmatchdataacrosseducationandworkforcetoassessifprogramsarepreparingstudentsandifthose
studentsarefindingemploymentandhowsubpopulationsarebeingserved.Statesystemsappeartovary
widelyregardingtheirdataavailabilityandinclusionofnon-degreecredentials,withpublicfor-creditcertificate
programs,registeredapprenticeshipcertificates,andlicensesmostlikelytobeavailable.Moststatesalsohave
dataavailableforindividual-levelfor-creditcertificatesfrompublicinstitutionsintheirstate,andmorethan
halfofstatesreporthavingregisteredapprenticeshipcertificationdataandlicensingdata.Non-registered
apprenticeshipcertificatesandindustrycertificationsdataarenotwidelyavailable.Moststatescanbreak
downcredentialattainmentbyageandrace/ethnicity.
14 | NOTABLE REPORTS AND ACTIVITY
Data Quality Campaign
n Education Data Legislation Review: 2019 State Activity
AsofAugust1,2019,325billswereintroducedin2019in47states,with83lawsenactedin32states.
NonewlawswereenactedinMichigan.
Billsbeingintroducedacrossthecountrybuildonfoundationalpoliciesthatsupporttheabilityofeveryone
withastakeineducationtousedatatoservestudents.Thesebillsincluded:
•Dataprivacy,security,andconfidentiality(studentprivacybillswerethemostcommon)
•Datagovernance
•Cross-agencylinkages
•Cross-sectordatasharing
•Dataaccessforthoseclosesttostudents
•Toolsforlocaldatause
•Publicreportingandopendata
Educationdatalegislationisaddressingeducationprioritiesthrough:
•Accountabilityorschoolimprovement
•Improvingthequalityofearlychildhoodeducation
•Schoolchoice
•Schoolsafety
•Flexiblepathways,includingcareerandtechnicaledanddualenrollment
•Mentalhealth
•Workforcedevelopment
•Teacherquality
Datarelatedlegislationshouldincludedollars,training,orincentivesthatwouldsupporttheabilityofteachers
andschooladministratorstouseandactonhighqualitydatatoinformpracticetoservestudents.
The Hunt Institute
n Connecting the Continuum: Longitudinal Data Systems in North Carolina This2019reportidentifiedthatsincetheinceptionofSLDSthroughtheEducationalTechnologyandAssistance
Actof2002,federalcompetitivegrantprocesseshavecontributedmorethan$700milliontosupportstate
educationagenciesintheirdevelopment.Thisfundinghasbeendistributedamong47states,theDistrictof
Columbia,PuertoRico,andtheU.S.VirginIslandsthroughSLDSgrants.RacetotheTopfundinghasalsobeen
awardedtohelpwithpolicyreformsthatenhancestandardsandassessments,improvedatacollectionanduse
ofdata,andincreaseteachereffectiveness.SignificantprogressinSLDSwasrequiredtoreceiveRacetothe
Topfunding,servingasanincentiveprogram.(Siddiqi&Goff,2019,ibid)
RegardingSLDSfunding,statesvarygreatlyintheamountoffundingawarded,withTexasreceivingthemost
fundingwithover$33million,andthreestatesreceivingnofunding(Alabama,NewMexico,andWyoming).
NOTABLE REPORTS AND ACTIVITY | 15
Michiganisclosertothemiddleofthepack,receivingslightlyover$19million,including$3,000,000in2006,
$5,517,228in2009,andanadditional$10,624,964in2009aspartofARRAfunding.Michiganranks14th
inSLDSgrantfunding.
Thisreportidentifiedthekeycharacteristicsofahigh-qualitySLDS,including:
•widespreadpolicymakersupport,
•meaningfulagencycollaboration,
•highqualitygovernancestructure,
•robustprivacyandsecurityprotocols,
•standardizationofdata,
•adequatetechnicalinfrastructure,
•dedicatedhumancapital,
•sustainableinternalleadership.
The Aspen Institute
n Aspen Institute Future of Work Report (Aspen Institute, 2019, P. 11-12)
Thisreportincludesanoverviewoftheneedforandbenefitofimprovedlabormarketdata,withalistof
recommendationsforstatepolicymakerstoimprovedatacollectionandusage.Recommendationsinclude:
•AddnewdataelementsinstateUIwagerecords,suchasoccupationaltitle(usingstandardized
occupationalcodes),hoursworked,credentialcompletion,andworksite.
•UsenewlyenrichedUIdataandotheradministrativedatatocreatetrainingprogrameffectiveness
measuresiftheyarematchedwitheducationprogramdatathroughstatelongitudinaldatasystems.
TheagencyrunningtheSLDSshouldhaveacloseworkingrelationshipwiththestateagenciesthatare
providingdata.Ifpresentedsimplyandinastandardizedformat,thissystemcanhelpstudentsmake
informeddecisions.StatesshouldprioritizesharingUIdatawithotherstatesandthefederalgovernment.
•Increasefundingforstatelabormarketinformationsystemsthatproduce,disseminate,andanalyze
stateandlocallaborforcestatisticstoenableinformeddecisionmaking.
•Statesshoulddevelopamoreeffectiveandtransparentskills-basedlabormarket,workingwithemployers
andeducationalinstitutionstomakeskillsacommonlanguageandcurrencyforjobpostingsandeducation
andtrainingprograms.
Early Childhood Data Collaborative
n “2018 State of Early Childhood Data Systems,” Fifty State Survey
Asurveyofthefiftystatesin2018revealedthefollowingnationalneeds:
•Establishandstrengthenstateearlychildhoodeducation(ECE)datagovernancebodiestoguidethe
coordination,security,andappropriateuseofECEdata.
•Strengthenstates’capacitytosecurelylinkdataonyoungchildrenacrossallstateandfederalECE
programs,includingHeadStartandhomevisiting.
•Expandeffortstocollectandlinkdataabouttheearlychildhoodworkforce.
16 | NOTABLE REPORTS AND ACTIVITY
•Communicatewithparentsaboutdataprivacypoliciesandusesofearlychildhooddata.
•Useexistingdatasystemsplanningtoolsandtechnicalassistancetosupportearlychildhooddatasystem
integration.(https://www.ecedata.org/wp-content/uploads/2018/09/ECDC-50-state-survey-9.25.pdf)
The Joyce Foundation
n Using Data to Promote Continuous Improvement of Workforce Programs: Guidance for States
Preparing Applications to the U.S. DOL Workforce Data Quality Initiative
This2010briefing,partofTheJoyceFoundation’sShiftingGearsinitiative,wascreatedtohelppotential
WDQIgrantapplicantswithrequirementsandexpectationsofapplications.ThereportindicatesthatWDQI
minimumrequirementsforSLDSincludedatafrom(p.1):
•WIATitleI;
•Wagner-PeyserAct;
•TradeAdjustmentAssistanceprogram;
•UnemploymentInsurance(UI)wagerecords;
•UIbenefitdata;and
•FederalEmploymentDataExchangeSystem(FEDES)data
Stateapplicantswerealsoencouragedtoinclude:
• VocationalRehabilitation;
• RegisteredApprenticeship;
• TemporaryAssistancetoNeedyFamily(TANF);and
• SupplementalNutritionAssistanceProgram(FoodStamps).
Thereportalsorecommendsthefollowing(p.3):
“��State�agencies�can�help�to�ensure�that�local�workforce�education�and�employment�programs�are��
meeting�labor�market�needs�by�publishing�analyses�of�the�gap�between�projected�job�demand�by��
occupation�and�program�completers�in�related�fields�for�each�region�of�the�state.�This�is�relatively��
easy�to�do�for�postsecondary�career-technical�programs,�since�data�on�credentials�awarded�by�field��
are�available�for�community�colleges�and�other�postsecondary�institutions�through�the�Integrated��
Post-Secondary�Education�Database�System�(IPEDS)�compiled�by�the�U.S.�Department�of�Education.”
U.S. Department of Education
n College Scorecard (U.S. Department of Education, 2019)
TheU.S.DOErecentlyupdatedtheonlineportalthatprovidesinformationaboutcollegeprograms,
costs,admissions,andresults.TheNovember20,2019,updateincludedkeytransparencyfieldofstudy
graduatecount,debt,andearningsdata.Thetoolalsoaddedadifferentiationbetweendegree-granting
andnon-degreegrantingschools.TheCollegeScorecardwasoriginallyreleasedin2015andhasundergone
severaltransformations.
NOTABLE REPORTS AND ACTIVITY | 17
Datapointsincludethetypeofinstitution,location,graduationrate,salaryaftercompleting(onlyoneyear
available),andaverageannualcost.Dataisonlyavailableinaggregateformandisnotavailableforcohorts
oflessthan20individualsduetoprivacyfactors.Averageannualcostisdefinedas,“Theaverageannualnet
pricethatastudentwhoreceivesfederalfinancialaidpaystocoverexpenses(e.g.tuition,livingexpenses,
etc.)toattendaschool.Netpriceistheschool’scostofattendanceminusanygrantsandscholarships
received.Forpublicschools,thisisonlytheaveragecostforin-statestudents.”
Theportalalsoincludestheabilitytodownloaddatafilesinadditiontoadatadictionary,technicaldocumentation
forinstitution-leveldatafiles,andbyfieldofstudy.Thesitealsoincludeslinkstoadditionalresourcessuchas
apprenticeships,O-NETCareerExplorer,andstudentaidinformation.
Thelimitationoftrackingsalarytoonlyone-yearpost-graduationcanbedeceptive.Someoccupationscan
takeseveralyearstoreachthetypicalearningpotential.Graduationratesforcommunitycollegesareskewed,
astheseinstitutionsalsosucceedwhentheyprovidethesteppingstoneforstudentstotransferto4-year
institutionsorprovideworkforcetraining,whichwillnotbereflectedingraduationrates.
National Center for Education Statistics
n Statewide Longitudinal Data Systems (SLDS) Survey Analysis (U.S. Department of Education, 2019)
TheNCESStatsinBriefsurveyedU.S.statesandterritoriestoevaluatedataintegration,linking,andcapabilities.
Surveyfindingsinclude:
•DataelementsavailableinSLDSsincludestudentdemographics,gradelevel,schoolenrollmentand
completion,attendance,andstatewideassessmentdata.K–12studentdataareoperationalin96percent
ofstateandterritoryrespondents’SLDSs.
•Atleast70percentofstatesandterritoriesreportedhavingautomatedinfrastructuretolinkK-12student
datatoK-12teacherdata,post-secondarydata,PerkinsCTEdata,andearlychildhooddata.Halfreported
havingautomatedlinkstoworkforcedata.
•DataarelinkedtoK-12studentdataindifferentwaysdependingonthesector,includingbyanassigned
uniqueidentifieroraSocialSecuritynumber.ThedataelementslinkedtoK–12studentdataalsovary
dependingonthedatasector.
•StatesandterritoriesmostcommonlyreportedusingK-12studentdataforfeedbackreportsforhigh
schoolsandforstatereportsforthelegislature.
•StatesandterritoriesalsoreportedusingK-12teacherdata,post-secondarydata,workforcedata,Perkins
CTEdata,andearlychildhooddataforstatereportsforthelegislature,federalreports(suchasEDFacts),
curriculardecisions,feedbackreports,andpolicyupdates.
18 | NOTABLE REPORTS AND ACTIVITY
National Center for Education Statistics SLDS Grant Program
n P-20W+ Data Governance, Tips from the States-Brief 4
This2017publicationrecommendsthefollowinginitialstepstoestablishaP-20W+datagovernancestructure:
1. P-20W+partnersidentifyeducationpolicies,priorities,challenges,andneedsthatspanmultipleagencies.
2. PartnersdeveloptheinitialdraftoftheP-20W+datagovernancepolicy,usingtheP-20W+education
policiesasafoundationandtheinitialstepforgovernance.AuthorityforP-20W+datagovernanceshould
begrantedviaexecutiveorder,statestatute,oraspartofmemorandaofunderstanding(MOUs).Eithera
singleMOUforallpartnersoraseparateMOUforeachparticipatingagencycanserveastheadministrative
vehicleforrespondingtoP-20W+educationpolicyinitiatives.
3. StateleadershipreviewsandapprovestheP-20W+datagovernancepolicy.
4. StateleadershipincludesleadershipfromthoseagenciesparticipatingintheP-20W+system,alongwith
leadershipfromthegovernor’sofficeandlegislature.
5. Theleadershipdisseminatesthepolicytostaffandtoexecutiveandlegislativeleadership,includinga
referencetowhereitwillbeavailableelectronically.
6. TheleadershipidentifiesP-20W+datagovernanceleads,establishingthemembershipoftheP-20W+
DataGovernanceCommittee.
7. TheP-20W+DataGovernanceCommitteeusesthepolicyasthefoundationforitsP-20W+datagovernance
manual,whichdetailshowthepolicywillbeputintopractice.
Workforce Information Advisory Council
n Recommendations to Improve the Nation’s Workforce and Labor Market Information
System (Workforce Information Advisory Council, 2018)
ThisdraftreportlaysoutnationalrecommendationstotheSecretaryofLaborregardingworkforcedatasystems.
Afinalreporteitherwasnotpublishedorisnoteasilypubliclylocated.Thereportandrecommendationswere
developedthroughtheWorkforceInformationAdvisoryCouncilandincludedstakeholdersfromthe
BureauofLaborStatistics(BLS)andEmploymentandTrainingAdministration(ETA),staterepresentatives,
headsofotherfederalagencies.Therecommendationsinthereportgiveaglimpseofthedirectionofthe
federalgovernmentpertainingtoworkforceinformationsystems.Theserecommendationsinclude:
1. EnhanceUIwagedata:Includeoccupationaltitle,hoursworked,andworksite.
2. ExpandInformationonoccupations,skills,andcredentials:Includesarecommendationtoincrease
investmentsinthisarea,exploreSOCrevisions,andshowoutcomesofcredentials.
3. DevelopanddisseminateaK-12careerawarenesseducationalframework
4. Developinformationonthechangingnatureofwork:pursuearegularcollectionanddevelopmentof
informationthatprovidesanunderstandingofthescopeandvolumeofalternativeworkarrangements
orothercausesforthereductionintraditionalworkforceparticipation.
NOTABLE REPORTS AND ACTIVITY | 19
5. Increasesupportforthestates’rolesintheWLMIsystem:includeintheDOLbudgetarequestforannual
fundingtostatesfromBLSfortheFederal-StateCooperativeStatisticsSystemandfromETAforWorkforce
InformationGrants.
6. Overcomebarrierstodatasharing:enablegreateruseforworkforceinvestmentdecision-making.
7. Improveconsistencyandavailabilityofprogramevaluationdata:establishthestateWLMIunitorother
unitdeterminedbythestateasthedesignatedstateentityforprovisionofWIOA.
8. Createa21stcenturyWLMIsystemusingadvancedtechnologies:UseAIandothertechnology
advancementstoadvancethesystem.
9. InitiatecollaborationamongWLMIsystemagencies:conveneagatheringofrepresentativesfrom
federalandstateprogramstocontributeinformation.
Thereportalsoidentifiesadecliningabilityandresourceavailabilityforstatestoprovidequantityandqualityof
WorkforceLaborMarketInformation(WLMI,Page12):
“In�2017,�total�annual�federal�support�for�state-produced�labor�force�statistics�was�$104.6�million.�In�real�
(inflation�adjusted)�terms,�this�figure�is�45�percent�less�than�total�funding�in�2002�of�$189.5�million.�The��
ongoing�decline�in�real�funding�since�2002�has�led�to�reductions�in�the�quantity�and�quality�of�WLMI��
important�to�the�participants�in�the�workforce�system.�In�response�to�a�request�for�information,�a�significant�
majority�of�25�responding�state�LMI�agencies�indicate�that�they�have�reduced�the�availability�of�state�and�
sub-state�WLMI�products�and�services.�A�number�specifically�note�that,�as�a�result,�their�capacity�to�provide�
information�on�“in-demand�occupations�and�industries,”�as�required�by�WIOA,�is�diminished.”
ThereportidentifiedthatstatestendtoerronthesideofcautionwhenconsideringprovidingaccesstoUI
wagerecords,whichareobtainedbythestatesthroughstateUIprograms.Thisdataisidentifiedasimportant
toevaluatingoutcomesofeducationandtrainingprograms,suchasapprenticeships,andwerecreatedunder
federal-statecooperativeprogramsadministeredbyLabor,Education,andCommerceDepartments.States
avoidusingdataforpurposesotherthanthoseexpresslyrequiredforprogramadministrationduetouncertainty
ofclearauthoritytousethedataforspecifiedpurposesandaresponsibleapprehensionregardingtheirsecurity
whenoutsidetheircontrol.Thiscautionlimitstheavailabilityandusefulnessofthesedatasetsgreatly.
U.S. Chamber of Commerce Foundation
n Job Data Exchange (JDX)
TheJDXisself-describedas“Organiclabormarketdataaboutthejobsthatareavailableandtheskills
requiredtofillthem,deliveredinreal-time.TheJDX™open-datatoolsetwillimproveanemployer’sabilityto
communicatetheirhiringneedstotheireducationandworkforcepartners.”JDXisavehicleforemployersto
movetowardcompetency-basedhiringbybreakingdownajobpostingintoamachine-readableformatand
makingthedataavailabletoeducationandworkforcepartners.Thistooliscurrentlyinapilotphase.The
U.S.ChamberofCommerceFoundationiscurrentlyseekingcollaborationwithlargeHRplatforms.(U.S.
ChamberofCommerceFoundation,JobDataExchange,2019)
20 | NOTABLE REPORTS AND ACTIVITY
n T3 Innovation Network
Inthechamber’sT3InnovationNetwork,organizationsacrossthetalentmarketplaceareworkingtogether
tobuildanopen,public-privatedataandtechnologyinfrastructureforamoreequitablefuture.Thisnetwork
isexploringemergingtechnologiesanddatastandardstobetteraligneducation,workforce,andcredentialing
datawiththeneedsoftheneweconomy.TheT3Networkwill(U.S.ChamberofCommerceFoundation,
T3InnovationNetwork,2019):
• Definewhatacompetency-basedlifelonglearnerrecordshouldbesothatalllearningcounts,
nomatterwhereittakesplace.
• Modernizetechnologyandadvancedatastandardstoachieveseamlesssharingofdatathroughout
aperson’seducationandcareerpathway.
• Empowerindividualswithavalidatedrecordoftheirskillsandcompetenciesinawaythatall
employerscanunderstand.
Thisworkrepresentsanactivenetworkofstakeholdersworkingwithinternationalstandardsbodiesand
enterpriseHRsoftwarevendors.Thecollaborationsareforminginrealtimein2019and2020,andhavea
goaltosetworkforcestandardsanddatapolicytomovecorporateAmericasothatcompaniescanhave
similarincumbentanddemandreportingmetrics.
Additional Data Resources
AdditionaldataresourcesexisttosupportSLDSresearchandintegration,including:
• Brighthive:“ABrighthiveDataTrustallowsnetworksoforganizationstosecurelyandresponsiblyshareand
collaboratewithdata,generatingnewinsightsandincreasingtheircombinedimpact.”(Brighthive,2019)
• LocalEmploymentDynamics(LED)
• LocalAreaUnemploymentStatisticsProgram(LAUS)
• QuarterlyCensusofEmploymentandWages(QCEW)fileMass-LayoffsStatisticsprogram(MLS)
• IntegratedPost-SecondaryEducationDataSystem(IPEDS)fromNCES
OVERVIEW OF MICHIGAN SLDS | 21
Overview of Michigan SLDS
General Observations
•Michiganappearstohaveatrifurcatedsystem,withoneagencyresponsiblefor
educationdata,oneresponsibleforworkforcedata,andanotherresponsiblefor
wagedata.
•Michigan’sSLDSwascreatedthroughExecutiveOrdersanddatagovernanceis
conductedthroughtheP-20AdvisoryCouncil.
•Theprocessofrequestingdataappearsdaunting,withfewsuccessstories.Thestate’s
CenterforEducationalPerformanceandInformation(CEPI)websiteindicatesthat“CEPI
isnotstaffedtohandlemostcustomdatarequests,andmanysuchrequestsmustbe
denied(CEPI,2020).”TheStateLMISIofficeindicatedthatrequestsforinformation
aboutwageswereavailableattheUIwebsite.Evenwhenalinkwasprovided,itwas
difficulttofindandlackanobvious“frontdoor”tomakedatarequests.
•Dataismanagedinafederatedsystem,whereeachdepartment,oradministrative
entitywithinstategovernmentcompiles,manages,anddetermineshowandwhenits
datawillbeshared.Federalandstatelawsregardingprotectionofindividualleveldata
(FERPA,HIPPA,EmploymentSecurityAct,etc)placestrictlimitationsonthesharing
ofdata.
•Inmanyways,Michigan’sSLDSisinlinewithmanyotherstatesandtheircapabilities.
Justifiableprivacyconcernsandlegalframeworkshaverestrictedexternallyidentifiable
optimizationofthesystemforresearchandpolicy-makingdecisions.
•FederalfundingsupportedthedevelopmentofMichigan’sSLDS,butsustainability
andmaintenancefundingsourcesarelessclear.Thispotentiallackoffundingcould
jeopardizetheunderstanding,useandgrowthofthesystem.
22 | OVERVIEW OF MICHIGAN SLDS
Governance and Structure
Michigan’sP-20LongitudinalDataSystemwascreatedwithtwoExecutiveOrders.
Executive Order 2010-15
EnactedbyGovernorJenniferGranholmandcreatedtheP-20LongitudinalDataSystemAdvisoryCouncil.
(Granholm,2010)
Executive Order 2014-6
Thisorder,institutedbyGovernorRickSnyder,laterreorganizedtheAdvisoryCouncil,definesthecouncil
membershipasincluding:
1.ThreerepresentativesnominatedbytheSuperintendentofPublicInstructionfromwithintheDepartmentof
EducationandappointedbythestateBudgetDirectorrepresentingK-12academicaffairs,K-12assessment
andaccountability,andearlychildhood.
2.OnerepresentativenominatedbytheChiefInformationOfficerwithintheDepartmentofTechnology,
Management,andBudgetandappointedbythestateBudgetDirector.
3. OnerepresentativenominatedbytheDirectoroftheWorkforceDevelopmentAgencywithintheMichigan
StrategicFundandappointedbythestateBudgetDirector.
4. OnerepresentativenominatedbythestateTreasurerfromwithintheDepartmentofTreasuryandappointed
bythestateBudgetDirectorrepresentingstudentfinancialaidprograms.
5. OnerepresentativefromwithintheStateBudgetOfficeappointedbythestateBudgetDirectortoserveas
hisorherdesignee.
6. TwelveindividualsappointedbythestateBudgetDirector,includingallofthefollowing:
a. Sixindividualsrepresentingpublicschoolsinthisstate.
b. Threeindividualsrepresentinginstitutionsofhighereducationinthisstatebutnotincluding
communitycolleges.
c. Twoindividualsrepresentingcommunitycollegesinthisstate.
d. Oneotherresidentofthisstate.
Themajordifferencesbetweenthe2010and2014ExecutiveOrdersinclude:
• IncreasedrepresentativesfromSuperintendentofPublicInstructionfromonetothree,
• Movedseveralappointmentstoanominationbythecorrespondingofficewithanappointmentfromthe
stateBudgetDirector,
• EliminatedtherepresentativefromtheEarlyChildhoodInvestmentCorporation,
• Eliminatedfour-yearterms.
P-20,inthisinstance,isdefinedaspre-schoolthroughthefourthyearofpostsecondaryeducation.Somestatesdiffer
inthisdefinition.Additionally,somestatesdefinethisworkusingP-20W+,whichincludesworkforceandbeyond.
OVERVIEW OF MICHIGAN SLDS | 23
Responsibilities of the Advisory Council
ExecutiveOrder2014-6chargedtheP-20AdvisoryCouncilwithactinginanadvisorycapacitytothestateBudget
DirectorandtheDirectoroftheCEPI,anddoingthefollowing:
1. Review,develop,andrecommendpolicies,procedures,andtimelinestobeadoptedbytheCenterfor
EducationalPerformanceandInformationforthedevelopmentandimplementationandmaintenanceofa
comprehensivelongitudinaldatareportingsystemincompliancewithstateandfederallaws.
2. Developandrecommendstateandeducationalentitymodelpoliciesrelatedtodatacollection,maintenance,
andreportingfortheP-20longitudinaldatareportingsystem,including,butnotlimitedto,allofthefollowing:
a. Storinguniquestudentidentifiersandmatchingstudent-leveldatainelementary,secondaryand
post-secondarydatasystems;
b. Reportingstudent-levelremedialcourseworkforinstitutionsofhighereducation;
c. Connectingindividualteacherdatatoteacherpreparationcolleges;
d. Ensuringtheprivacyofindividualstudentdata,includingthatastudent’sSocialSecuritynumberisnot
releasedtothepublicforanypurpose.
3. EnsurethedataintheP-20longitudinaldatareportingsystemismadeavailabletostateandlocalpolicymakers
andresidentsofthisstateinthemostusefulformatpossible.
4. ReporttothestateBudgetDirectoronrecommendedchangesinMichiganlaw.
5. OtherdutiesasrequestedbythestateBudgetDirector.
Between2010to2014,thefollowingchangesoccurred:
• The2014EOaddedmaintenanceofthesystem.
• Eliminated:Developandmaintaindatadefinitions,datatransmissionprotocols,andsystemspecificationsand
proceduresfortheintegrated,efficient,accurate,andcost-effectivetransmission,collection,andreportingof
data,includingthemovementofelectronicstudentrecords,thatarebasedonopenstandards,nonproprietary
formats,andwithoutpreferencetoaparticularmodel.
• Addedelementaryandsecondarydatasystemstotheprocessofstoringuniquestudentidentifiersand
matchingstudent-leveldata.
• ChangedreportingofrecommendedchangesinMichiganlawtothestateBudgetDirector.Thisreportingwas
previouslymadetotheGovernorandLegislature.
• The2014amendmentremovedareportingrequirementdirectlytotheGovernorandaddedtheDirectorof
CEPIasarecipientofadvisement.
ThiseffortisoverseenbythestateBudgetOffice,andthestateBudgetDirectorservesasthechair.
Overall,Michiganhasawell-definedandefficientmethodofprovidingoversightofP-20datasystems,ifall
representativesareappointed,informed,andreplacedwhenaseatisvacated.Thereareopportunitiestoexpand
thisAdvisoryCounciltomakeittruly“longitudinal”byaddingadditionalworkforcerepresentation,addingan
earlychildhoodrepresentativebackintotheappointedrepresentatives,anddefiningthegroupasproviding
oversightforP-20W+.Earlychildhoodinitiativesarecurrentlyrepresentedonthiscouncil,butbyanindividual
servingindualroles.Anappointedseatforearlychildhoodwouldensurerepresentation.
24 | OVERVIEW OF MICHIGAN SLDS
Overview of Michigan School Aid Act of 1979
TheMichiganSchoolAidActof1979isthekeypieceoflawgoverningbothdatathatisrequiredtobesubmittedby
educationalinstitutions,aswellasaccessibilityofstateeducationdatainthestateofMichigan.(MichiganSchool
AidAct,2019)
ThisActlaysoutthestateandfederalcomplianceobligationsrelatedtoeducationdataandenablestheCenter
forEducationalPerformanceandInformation(CEPI)(388.1694a).CEPIiscreatedwithintheDepartmentof
Technology,Management,andBudget(DTMB).Itcoordinatescollectionofdatarequiredbystateandfederallaw
forpreschoolthroughpost-secondaryeducation.Inaddition,thisbodycreates,maintains,andenhancesthestate
P-20longitudinaldatasystemandisresponsiblefortheweb-basedportalthatprovidesaccesstothisdata.
Accordingtothissection,thelongitudinaldatasystemrequired“Includesdataattheindividualstudentlevel
frompreschoolthroughpost-secondaryeducationandintoworkforce.”
TheActalsorequiresthatCEPI“Supportsinteroperabilitybyusingstandarddatastructures,dataformats,anddata
definitionstoensurelinkagesandconnectivityinamannerthatfacilitatestheexchangeofdataamongagencies
andinstitutionswithinthestateandbetweenstates.”
TheActrequiresthatdatabeprovidedbypreschoolthroughpost-secondarypublicinstitutions,andinsome
instances,dataisalsorequiredforprogramsavailablethroughprivatehigheredinstitutions(tuitionincentive
program).Iftheseinstitutionsdonotcomplywithsubmittingthedatarequired,fundingwillbewithheld,including
Section201funds,section236funds,andtuitionincentivefunds(individualstudenttuitionassistancethathigher
educationstudentscanqualifyforthroughqualifyinginstitutions).
AccordingtotheSchoolAidBudget,$16,356,700.00instatefundsand$193,500infederalfundswereallocated
fortheoperationsofCEPIfor2018-2019and$16,457,200instatefundsand$193,500infederalfundswereallocated
for2019-2020.Thisfundingsupportsdatacollection,datamanagement,warehousing,reporting,website,data
portalandpartnershipworkwithuniversities,ISDs,andlocals(LongitudinalSystemsinMichiganReportFeedback,
2020).Determiningprogram-levelspecificline-itemspendingisnotpossiblewithpubliclyavailablebudget
documents.Thesefundscanbecarriedforwardtofutureyears.ThesefundsareinadditiontoSLDS,WDQI,and
RacetotheTopgrantfunds.
AdditionalpointsofinterestregardingtheSLDSwithintheSchoolAidActinclude:
• RequiredtoprovideMichiganwiththeabilitytomeetfederalandstatereportingrequirements,
• Containuniqueidentifiersthatdoesnotpermitastudenttobeindividuallyidentifiedbyusersofthesystem,
exceptasallowedbyfederalandstatelaw,
• Hastheabilitytocommunicatewithhigheredsystems,
• Containsstudent-leveltranscriptinformation,includingcoursescompletedandgradesearned,
OVERVIEW OF MICHIGAN SLDS | 25
• Containsstudent-levelcollegereadinesstestscores,
• CEPImayenterintoagreementstosupplycustomdata,analysis,andreportingtootherprincipalexecutive
departments,stateagencies,localunitsofgovernment,andotherindividualsandorganizations,
• Requirescommunitycollegestoreportthenumberandtypeofassociatedegreesandothercertificates
awardedduringthepreviousacademicyear.
ThefollowingexcerptsareofparticularinterestwhenresearchingtheStateLongitudinalDataSystem:
388.1619, Sec 19 (1):Dataprovidedtothecenter(CEPI),inaformandmannerprescribedbythecenter,
shallbeaggregatedanddisaggregatedasrequiredbystateandfederallaw.Inaddition,adistrictor
intermediatedistrictshallcooperatewithallmeasurestakenbythecentertoestablishandmaintaina
statewideP-20longitudinaldatasystem.
Michigan Employment Security Act
AccordingtotheMichiganEmploymentSecurityAct,datafromtheUIagencycanbesharedincertaincircumstances,
buttheabilitytosharethisdataisrestrictedandmisuseofthedatacomeswithpenalties:
“�The�unemployment�agency�may�also�make�information�that�it�obtains�available�for�use�in�connection��
with�research�projects�of�a�public�service�nature;�for�course,�program,�or�training�program�planning,��
improvement,�or�evaluation;�for�grant�application�or�evaluation;�for�institutional�or�program�accreditation;�
for�economic�development�or�workforce�research;�for�award�eligibility;�or�for�federal�or�state�mandated�
reporting,�to�a�public�official,�eligible�educational�institution,�or�Michigan�works�agency�or�to�an�agency�of�
this�state�that�is�acting�as�a�contractor�or�agent�of�a�public�official�and�conducting�research�that�assists�the�
public�official�in�carrying�out�the�duties�of�the�office.”(MichiganEmploymentSecurityAct421.11,2019)
Thisactgoesontoindicatethatthisdatamayalsobesharedwithindependenteducationalinstitutionsina
similarmanner.
26 | OVERVIEW OF MICHIGAN SLDS
Data System FundingFundingtodevelopandsustaintheSLDSandWLDShasmainlyconsistedoffederalcompetitivegrantdollars.
AccordingtotheEducationCommissionoftheStates(EducationCommissionoftheStates,2019),theMichigan
StatewideLongitudinalDataSystemwascreatedbyExecutiveOrderNo.2010-15.ThisSLDSisacentralized
systemthatconnectsthreeofthefourcoreagencies(earlylearning,K-12,andpostsecondary)butlacksworkforce
data.FederalgrantsassistedincreationoftheMichiganSLDS,includinga2009ARRAgrant($10,624,964),a
NewBridges:BuildingMichigan’sCapacityforaLongitudinalP-20andWorkforceDataDecisionSupportSystem
($5,517,228),a2006grantinpartnershipwithMinnesotaandWisconsin($3,000,000),andaWDQIgrant
(NationalCenterforEducationStatistics,n.d.)
WorkforceDataQualityInitiative(WDQI)Grants(USDepartmentofLabor,2019)
• Funder:U.S.DepartmentofLabor,EmploymentandTrainingAdministration
• Recipient:MichiganWorkforceDevelopmentAdministration(WDA)
• Grantsawardedfordevelopmentofaworkforcelongitudinaldatasystem(WLDS)
•2012:$1,000,000
•2015:$1,088,282
•2019:$998,028
WDQIgrantsprovidedresourcestoWDAtosyncworkforcedatafromOneStopManagementInformation
System(OSMIS)andothersourcestotheUnemploymentInsuranceAgency(UIA)masterfiles.Thematching
processiscompletedusingMichigan’sMasterPersonIndex(MPI)systemtogenerateuniqueidentifiercodes(UIC)
andSocialSecuritynumbermatches,whichlinksthesameindividualinmultiplesystems(LongitudinalSystems
inMichiganReportFeedback,2020).Homeaddressandotheridentifiersforrecordscouldnotbematchedby
SocialSecuritynumbers.InformationregardingtheMPIsystemisnoteasilyaccessibleoutsideofStateoffices.
Additionalfundingmayhavebeenutilizedbythestatetosupportthesefederalawards,buttheStateofMichigan
fiscalyearbudgetsavailabletothepublicdonotcontaindetailsattributabletoindividualprogramlevelactivities.
OVERVIEW OF MICHIGAN SLDS | 27
AccordingtotheCenterforEducationalPerformanceandInformation,thisistheflowchartfortheMichiganState
LongitudinalDataSystem,circa2009.Acurrentsystemmapwasnotdiscoveredinthecourseofthisresearch.
(CenterEducationalforPerformance,October26,2019)
28 | OVERVIEW OF MICHIGAN SLDS
Center for Educational Performance and Information (CEPI)
TheCenterforEducationalPerformanceandInformation(CEPI)housesdataonfinance,testscores,teacher
preparation,genderandethnicity,coursesandgrades,graduationrates,collegeenrollment,freeorreduced-price
luncheligibility,careerandtechprograms,specialeducation,andgiftedprograms.TheCEPIwebsiteclaimsthat
thissystem“canspanfromearlychildhoodintotheworkforce,helpensureMichigan’spubliceducationsystemis
meetingtheneedsofallstudents.”CEPImakesthisinformationpubliclyavailableontheMISchoolDatawebsite
(https://www.mischooldata.org/).CEPIownsandmanagesboththeSLDSwithsecondaryeducationdata,andthe
StudentTranscriptandAcademicRecordRepository(MSLDS:STARR)systemwithpost-secondarydata.TheSLDS
containsrecordsfrom2003totoday,withthepurposeoftrackinghighschoolcompletionandCareerand
TechnicalEducationstatus.MSLDS:STARRcontainsrecordsfrom2009totodaywiththepurposeoftracking
post-secondarycompletions.(CenterforEducationalPerformanceandInformation,October9,2019)
MISchoolDataservesasanexcellentsourceofaggregatestatedataandincludesthecategoriesofearlychildhood,kindergarten-12thgrade,post-secondary,andworkforce.
Early Childhood
•Childcount
•Participationbykindergarten
•EarlychildhoodimpactonK-3absenteeism
•Kindergartenpathway
•Continuityofserviceinspecialeducation:servicepathways
•Continuityofserviceinspecialeducation:servicecomparisons
K-12
•Parentdashboardforschooltransparency
•Schoolindex
•Studentcount
•Studentassessment
•Careerandtechnicaleducation
•Staffinginformation
•Financialinformation
•Englishlearnerdata
•Post-secondaryoutcomesbyhighschool
•Graduation/dropoutrate
•Ourschools-ataglance
•Non-residentstatus
•Thereisanindicationthatadditionalresourcesareavailable
OVERVIEW OF MICHIGAN SLDS | 29
Post-Secondary
•Successrates
•Outcomesbyhighschool
•Collegetransfer
•Collegeundergraduateenrollment
•Datainventory(historicalrecordoffinancialeventsandinstructionalactivity)
•Collegedegreesandcertificatesawarded
•Entitylist
Workforce
•Medianwagesbyeducationalattainment
•Entrylevelwagesovertime
•Medianwagesbyfieldofstudy
•MedianannualwagesbyeducationattainmentandhighschoolCTEstatus
•AdditionalsourcesofdatacitedincludeTalentInvestmentAgency,DepartmentofTechnology,
ManagementandBudget,Pathfinder,MichiganWorks!,andMichiganTrainingConnect.
Thissystemincludes5.3millionuniqueidentificationcodes(UIC)forearlychildhood,EarlyOn(astateintervention
programfordevelopmentaldelays),andK-12datingbackto2002.Italsoincludesapproximately635,000unique
post-secondaryrecordsasfarbackas2009.(StateofMichigan-LEO,2019)Accordingtoitswebsite,MISchool
Dataalsoincludesaback-endloginforK-12personnel,collegeanduniversitypersonnel,andstateofMichigan
employees.Secureloginsallowaccesstostudentleveldatatoallowinstructorstotailorinstructionsandprograms
tobestmeetindividualneeds.(MISchsoolData,2019)
CEPIpossessesindividual-leveldatabuthasstrictlegalconstraintsonthemethodsandprocessesinwhichthis
dataissharedtoprotectprivacyandconfidentiality.Individualscanbetrackedevenpriortoenteringkindergarten
iftheyenterapubliclyfundedearlychildhoodprogram.Education-relatedindividualtrackingdoesnotoccurvia
SocialSecuritynumber.Instead,auniqueidentifiercode(UIC)isassignedandusedthroughouttheindividual’s
educationalcareer.SincetheUICdoesnottranslatetoprogramsoutsideofeducationnordoesitcarryforwardto
thepointintimewhentheindividualenterstheworkforce,SocialSecuritynumbersareusedformostothertracking
needs.AccordingtotheMichiganBureauofLaborMarketInformationandStrategicInitiatives,crosswalkshave
beenconductedusingUIC/SS,withamajorityofindividualrecordslinking.
TheCEPIwebsiteexplains:“Ifyouneednon-aggregatedataforprogramevaluationsorstudies,pleasevisittheMDE
OfficeofEvaluation,StrategicResearchandAccountabilitywebsiteoremailmde-research@michigan.gov.Rigorous
datause,storageanddestructionpoliciesmustbemetbeforedataareprovided.Confidentialdataaremaskedby
researchidentificationcodesandfilelayoutsmodifiedforresearchpurposes.Commonusersincluderesearchers
doingnationalstudiesorperformingprogramevaluationacrossseveralentitiesinMichigan.”
30 | OVERVIEW OF MICHIGAN SLDS
AnextensivelibraryofresourcesaboutthedataavailablethroughMISchoolDataandthemethodsofaccessingand
usingthisdataisavailableat:https://www.mischooldata.org/HelpAndSupport2/DemosAndGuides.aspx
InadditiontotheMISchooldatatool,CEPIdevelopedandsustainsthefollowingapplications(Michigan.gov,2019):
• EducationalEntityMaster
• FinancialInformationDatabase
• GraduationandDropoutApplication
• MichiganStudentDataSystem
• NonpublicSchoolPersonnelReport
• SchoolInfrastructureDatabase
• StudentTranscriptandAcademicRecordRepository
• RegistryofEducationalPersonnel
CEPIoffersacalendarthatidentifiesdatacollectiondeadlinesandevents.Thiscalendaroccasionallyincludestraining
opportunities.Toaccess,visit:https://www.michigan.gov/cepi/0,4546,7-113-72089---,00.html
UndertheSchoolAidBill(MichiganHB4242of2019,p.218-223),CEPIisalsoallowedtoenterintoanyinterlocal
agreementsnecessarytofulfillitsfunctions.
Early Childhood Data (prenatal to age 5) and Career and Technical Education (CTE)
Accordingtothe2018StateofStateEarlyChildhoodDataSystemsreport(King,Perkins,Nugent&Jordan,2018),
Michiganfareswellincomparisonwithotherstatesregardingthedevelopmentandconnectionsofearlychildhood
datasystems.Thesedatasystemshaveaqualityratingandimprovementsystem,workforceregistry,earlychildhood
integrateddatasystem,anddatagovernancebody.ThestatelinkschilddataacrossECE(earlychildhoodeducation)
programs,withK-12datasystemsandECEprogramdata.Thestatedoesnotlinkchilddatawithhealthdata,
socialservices,orworkforcedata,butreportsthatplansareinprogresstoaddressthesethreeareas.
Michiganis1of22statesthatlinkdatabetweenallorsomeearlychildhoodeducationprograms.Michigandoes
notlinkECEprogramsdatawithworkforcedata,while15otherstatesdocreatethislinkage.Accordingtothe
BureauofLaborMarketInformation&StrategicInitiatives,theprioritizationofoutcomesforearlychildhood
programshasbeenlowerthanotheroutcomeareas.OutcomecomparisonsforstudentswithorwithoutCareer
andTechnicalEducationstudieshasbeenprioritized(LongitudinalSystemsinMichiganReportFeedback,2020).
MichiganhasstrengtheneditsearlylearningdatasystemusingaRacetotheTop-EarlyLearningChallenge
grant(RTT-ELC)phase3-2014(U.S.DepartmentHealthandHumanServices,2019).Throughthesefunds,an
EarlyChildhoodIntegratedDataSystem(ECIDS)wasdevelopedandisalignedandinteroperablewiththeMSLDS.
Thistoolwasdeveloped,inpart,withCEPIandconnectsdatawiththeMSLDSandMISchoolDatatools.
OVERVIEW OF MICHIGAN SLDS | 31
DuringtheELCgrant,CEPIscopedadesign,gaugedinterestinamultistatesolution,andinitiatedconversations
withthenationaldatasystemvendorthatmanagesChildPlus,whichisutilizedbyamajorityofHeadStart
programsacrossMichigan.In2018,grantmoneywasallocatedtoKalamazooRegionalEducationalService
Agency(RESA)toexecuteacontractbetweenKalamazooRESAandDoubleLinePartnerstocontinuethiswork.
Datacurrentlyavailablethroughthesystemismainlyfromstateandfederallysupportedprograms(childcare
subsidy,ECSE,EarlyOn,GreatStartReadinessProgram,andHeadStart)andmuchofthedataisvoluntary.Work
hasbeenaccomplishedandprogresshasbeenmadetocreatecommondefinitionsandleveragecommondata
systems,aswellasconnectwithotherstatestoensureinteroperability.
Michigan Community College Data Inventory
AccordingtotheStateSchoolAidAct-Act94of1979,388.1817,Sec.217,CEPIisalsochargedtoestablish,
maintain,andcoordinatetheMichiganCommunityCollegeDataInventory.Thisincludescollectingdataconcerning
communitycollegesandcommunitycollegeprograms,developingmodelpoliciestoensureprivacyofindividual
studentdata,providedatatoallowstatepolicymakersandcommunitycollegeofficialstomakeinformedpolicy
decisions,andworkwithotherstatsdepartmentstodevelopdemographicenrollmentprofiles.Theactalso
indicatesthatacommunitycollegedatainventoryadvisorycommitteebeformedtoprovideadvicetoCEPI.
Amongthecommittee’sresponsibilitiesisachargetoensurethedataaremadeavailabletostatepolicymakers
andresidentsinthemostusefulformatpossible.
32 | OVERVIEW OF MICHIGAN SLDS
Department of Labor and Economic Opportunity-Workforce DevelopmentWorkforce Data
TheMichiganlongitudinaldatasystemsappeartohaveonemajordrawback:Alackofalongitudinalconnectionandincorporationofworkforcedatainamannerthatallowsfortheevaluationofinstitutionsandindividualprograms.
Wage Records – Unemployment Insurance Agency and Workforce Longitudinal Data System
WhileCEPImaintainsandmakesaggregatedworkforceinformationavailablepublicly,individuallevelworkforce
dataisownedbyMichiganDepartmentofLaborandEconomicOpportunityUnemploymentInsuranceAgency(UIA).
U.S.DOLETAawardedMichiganfundsin2012tocreateaconnectionbetweenworkforcedataandMichigan’s
existingeducationalstatelongitudinaldatasystem.Aworkforcelongitudinaldatasystem(WLDS)resultedandthe
stateindicatesthatitconnectsandevaluateseducationalandworkforcedata.Databaserecordsarelinked
toallowanalysisbetweeneducationandtraining,theprovisionofemploymentservices,andemploymentwithin
Michigan(DepartmentofLabor&EconomicOpportunity,October10,2019).TheUnemploymentInsurance
Agencyisrequiredtoretainwagerecordsforfiveyears,afterwhichtheypurgetheserecords.UIwagerecords
areincorporatedintoPathfinder,MichiganTrainingConnect,andMiSchoolData.org.WorkforceDevelopment
(WD)hasaccessedwagerecordssince1998.Beginninginthefirstquarterof2001,WDhasstoredtheentire
yearlywagerecordsetcollectedbyUIandsharedwithWD.Historicaldata(beyondfiveyears)inaggregateis
approvedandsuppliedbyWD.Non-aggregatedwagedatafromoverfiveyearswouldneedtobeapprovedby
WDandUI.DatawithinthemostrecentfiveyearswouldbeapprovedandsuppliedbyUI.(StateofMichigan-LEO,
December9,2019)TheserecordsonlyuseSocialSecuritynumbersfrom2008andbeyond.(StateofMichigan-LEO,
ibid)ThisdataisincorporatedintoPathfinderandMiSchoolData.org,butnotMichiganTrainingConnect.
TheUIAdoeshouseanoptiontorequestdisaggregatedwagedatatospecificindividualsforspecificuses,
butmanyoftheresearchersanddecisionmakerswhoareeligibleeitherarenotawareofthispossibilityorare
requestingdatasetsthatareunavailable.
Additional Systems of Note
One Stop Management Information System (OSMIS)
WhileOSMISappearstolackaninformationalwebsite,itisusedexclusivelybytheMichiganWorks!Agenciesas
astatewidesystemtomanagedata,includingprogramparticipantandawidevarietyofemployeeandjobseeker
data.Systemaccessishighlyrestrictedandincludesindividual-leveldataprotectedbyprivacyandconfidentialitylaws.
Asof2014,therewere3.1millionuniquerecordsinthissystem,whichconsistsofclientsofMichiganWorks!
(enrolleddislocatedworkers,DHSclients,veterans,tradeassistancemembers,migrantseasonalfarmworkers,
adultsandyouth)withdatacollectionextendingbackto1999(WLDS,2014).
OVERVIEW OF MICHIGAN SLDS | 33
Pathfinder
Pathfinderisanonlinecareerexplorationtoolthatmatcheseducationandemploymentoutcomestoprovide
outcomedataforschoolsandfieldsofstudychoices.PathfinderismanagedbytheTalentInvestmentAgency.
AccordingtothePathfinderwebsite,“Thisfreetoolusescurrentlabormarketinformation,longitudinalwage
data,andotherinstitutionaldataandmetrics,allowingimprovedskills-matchingtocareerpathsandjobs.”
(Pathfinder,2019)
Credential Engine
Accordingtoitswebsite,“CredentialEngineisanonprofitwhosemissionistocreatecredentialtransparency,
revealthecredentialmarketplace,increasecredentialliteracy,andempowereveryonetomakemoreinformed
decisionsaboutcredentialsandtheirvalue.SeveralMichiganDepartmentsareworkingwithCredentialEngine.”
(CredentialEngine,2019)
Requesting Custom or Non-Public DataLimited Options Available
Uponreviewofthewebsitesthatcorrespondtothedatasystemslistedaboveandthroughdiscussionswith
stakeholders,ithasbeenfoundthataprocessandabilitytosubmitrequestsfordataareabsentwithonlyafew
exceptions.MichiganTalentInvestmentAgency(TIA)providesafactsheetthatdescribestheprocessofrequesting
informationandrecords.(Michigan.org,2019)Aparentwebpagethatallowsanindividualtoidentifythatthis
requestprocessisavailableisnotapparent.Thisfactsheetwasonlydiscoveredaftersearchingspecificterms
relatedto“UIwagedatarequest.”
TheMichiganTalentInvestmentAgency(nowtheOfficeofLaborandEconomicOpportunity),releasedafactsheet
regardinginformationandrecordsrequestinJuly2018.(TalentInvestmentAgency,2018)Thisfactsheetpertainsto
UnemploymentinsurancedataanddescribesthecircumstancesunderwhichUIdatamaybemadeavailable.
The fact sheet indicates the following (abridged):
• Whocanrequestinformation:UImaymakeconfidentialinformationitcollectsavailabletothefollowingentities:
•Publicofficials
•Eligibleeducationalinstitutions
•MichiganWorks!agency
•ContractororagentofapublicofficialinthestateofMichigan
• Requestingandprocessingdisclosureofinformation:
•FormUIA6439,RequestforDisclosureofInformation,availableatwww.michigan.org/uia,mustbe
completed,signedandreturnedto:DisclosureofInformationCoordinator
3024W.GrandBlvd,Suite12-100
Detroit,MI48202
34 | OVERVIEW OF MICHIGAN SLDS
• Typesofinformationdisclosed:
•UImaydisclose:
-name
-SocialSecuritynumber
-grossquarterlywages
-thename,address,andfederalandstateemployeridentificationnumberoftheindividual’semployer
-otherremunerationinformation
-whetheranindividualisreceiving,hasreceived,orhasappliedforunemploymentbenefits
-theamountofunemploymentbenefitstheindividualisreceivingorisentitledtoreceive
-anindividual’scurrentandmostrecenthomeaddress
-anyotheravailableinformationinUIdatathatisconsistentwiththestatute
• Informationthatisnotavailable:
•Outofstatewagedata
•Quarterlywage/taxreports
•Informationinthestate’sdirectoryofnewhires
•Wagesfromnon-coveredemploymentsuchasindependentcontractors
•Aggregatedatareleasedtoindependenteducationalinstitutionscannotbeofthenature
thatitcouldbereasonablytransparenttorevealpersonallyidentifyinginformation(PII)
•Estimatedreports
•Federaltaxinformation
•StateTreasuryinformation
•Noinvestigativedatathatrevealsinvestigativetechnique
•Informationthatcouldreasonablybeassumedtocauseharmtoanyindividual
Independent Educational InstitutionsUIisunabletoreleaseconfidentialinformationtoanindependenteducationalinstitution.UI,attherequestofan
independenteducationalinstitution,willperformdataanalysisandprovidetheresultstotheinstitution.Before
anyanalysisisperformedaMemorandumofUnderstandingmustbesignedbetweentherequesterandUI.Any
dataanalysismustbeofsuchanaturethatnoconfidentialinformationcanbeidentified.
Thereisnoobviousfunctionorprocessdescribedforanentityorindividualtosubmitorinquireaboutarequest
fordatafromanyoftheothersystems.
AsofAugust2019,theStateLMISIOfficehasreceivedatotalof10datarequests,withfivecomingfrom
MichiganWorks!agenciesandfivefromcollegesanduniversities.Nodatarequestshavebeensubmittedfrom
otherstateagenciesorlegislators.
ConclusionsWhencomparedtootherstates,Michigan’sdatarequestprocessisdaunting.Throughthestatecomparison
process,itwasfoundthatanumberofstatesprovideclearinstructionsandinformationaboutdatalimitations
andtransparentprocesseswithobviousmethodsofsubmittingrequests.
STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS | 35
AsusersandcontributorstoMichigan’sSLDSparticipatedinourstakeholderdiscussions,theyrevealedfrustrationwithdatathatisabundantbutofteninaccessible,notuseful,orincomplete.Theirfamiliaritywiththesystemprovidedinvaluableandpracticalinsights,suchasincludingspecificdatapointsorincludingstakeholdersintheprocessofsystemdevelopment.
In2019,SLDSstakeholdergroupswereconvenedfortwofacilitatedmeetingsinNovi(October11)and
GrandRapids(November8).Morethan120individualswereinvitedtoeachofthesemeetings.Inviteeswere
identifiedbytheauthorsandthoughtleadersfromacrossthestateasindividualsfamiliarwithMichigan’sSLDS
ascontributorsorusers.
Inaddition,eightone-to-onemeetingswereconductedwithsysteminfluencerswhocontributeto,analyze,or
manageMichigan’sSLDS.Individualswhoparticipatedwerepromisedtheywouldnotbeidentifiedbynamein
thisreport,butallacknowledgedandapprovedthattheiremployingorganizationswouldbedisclosed.These
organizationscanbefoundintheacknowledgementsectionofthisreport.Intotal,41individualsprovided
feedbackingroupmeetingsor1:1sessions.
Additional Insights
TheCEPIP-20LongitudinalDataSystemAdvisoryCouncilmeetingwasheldonSeptember26,2019.Duringthis
meeting,attendedbyanauthorofthispaper,systemoverviewswereprovidedbyCEPI,theMichiganLMISIoffice,
andsmallgroupdiscussionstookplacebymeetingparticipantstoprovideCEPIfeedbackonpossibleupdatestoits
missionandvisionstatements.DraftminutesforthismeetingarepostedontheCEPIwebsite.Approximately25
peopleattendedthismeetingbetweenadvisorycouncilmembersandthoseinterestedfromthepublic,at-large.
OnNovember12,2019,theU.S.ChamberofCommerceFoundationhostedtheT3InnovationNetworkannual
meetinginChicago.Thismeetingwasattendedtolearnmoreaboutnationaleffortstoconveneinternational
standards-makingbodieswithenterprisehumanresourcesystemdevelopers.Thegoalofthisconveningworkwillbe
toestablishnationalstandardsforemployerworkforcereporting.TheT3InnovationNetworkiscurrentlyseeking
partnerorganizationsfromacademia,industry,andstategovernmentstocollaborateonresearchandbetaprojects
concerningmappingandmeasuringeducation,certificaterecognition,andworkforceoutcomes.Approximately80
peoplefromaroundtheUnitedStatesparticipatedinthismeetinganddiscussion.
Stakeholder Input: Convening and 1:1 Discussions
36 | STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS
Observations from Convenings in Novi and Grand Rapids, MichiganEmployersandbusinessassociationsareinterestedandactivelyinvolvedintalentpipelinedevelopment,asis
evidencedby45employersparticipatingintheTalentPipelineManagementprogramandheavyinvolvement
inMICareerQuest.Butthesestakeholdersdesirebetterdataabouttheireffortstoensurethebestreturnoninvestment.
Specifically,theywantdatathattrackstheparticipantsoftheprogramstheydevelopandinvestin,togauge
efficacyandevaluateiftheyaremakingprogressregardingtheoccupationstheyemploy.Datacollectionshould
behappeningateach“gate”(variouslogicalmeasurementpointsinprimary,secondary,andpost-secondary
education),andayieldrateshouldbedevelopedtoassesshowmanypeopleendupintheoccupationsemployers
aredemanding.Participantsexpressedinterestinthestateestablishingthisadditionaldatainfrastructure.
Identifying Shortcomings
ThestatehasdescribeditsSLDSas“best-in-class,”butstakeholdersdisagreedwiththisassessment.Themessage
thatcanbegleanedfromMiSchoolDataisthateducationequalsabetterjobwithbetterwages,butthereisvery
littlethatcanbeassertedbeyondthisfactwiththelevelofgranularityofthedata.Thegroupswantedprogrammatic
impactinformationaroundemploymentwagesandtobeabletoassessifprogramsaremeetingthesupplyand
demandneedsacrosstheregionsofthestate.Severalstakeholdersexpressedthattheyaredisappointedsuch
high-stakesdecisionsarebeingmadeusing“incomplete,faulty,andnotcontextualizeddata.”Limitationsofthe
dataneedtobebetterunderstood.Datacollection,definitions,andstandardsvarydrasticallyacrossthehundreds
ofinstitutionsacrossthestatecollectinginformation.
Afewstakeholdersindicatedtheyhavesubmittedrequestsforeducationorworkforcedatatothestatebuthave
notreceivedusefulresponses.Severalindicatedtheyhavebeenmoresuccessfulgettingdatafromworkforce-
focusednonprofitsandotherintermediaries.BothfocusgroupsindicatedthatTalent2025andtheWorkforce
IntelligenceNetworkplaykeyintermediaryrolesforeducation,post-secondaryandeconomicdevelopers.Both
organizationsprovideeasyaccesstodataiftheyhavethemeansandaccess.
ParticipantsinbothgroupsindicateddisappointmentinthedefundingoftheMIBrightFutureprogram,whichis
viewedasakeylinkbetweenemployerneedsandstudentcareerexploration.Ofthosefocusgroupparticipants
engagedwithcareerplanning/developmenttools,onlyafewwerefamiliarwithPathfinder.Mostusedeither
NavianceorXello.
Eachgroupindicatedtheneedforpartners,translators,orsomeformofintermediarytointerpretandprovide
assistance(technicalornavigationfocused)toassistunderstandingandproperlyusingavailabledata.
Therewasacommonchorusthatdataisplentiful,butthosewiththedatahaveadifficulttimesynthesizingitandmakingituseful.
STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS | 37
Iftheendusersofthedataarenotconsideredinthedesignprocessofthedatasystembuildandcollection,
thevalueandusefulnessofthedatadeclinesdrastically.Severalparticipantsusedthephrase“datarich,
informationpoor.”
Withfewexceptions,focusgroupparticipantsindicatedtheleveloftrustinlongitudinaldataisnothigh.Thiswas
explainedasavariationinunderstandingofdatadefinitionsamongthosewhocontributedata.Integrityofthe
informationisimpactedwhenchangesinthedataarerequiredfromyeartoyear.Participantsindicateditwasnot
duetoalackoftrustinthetechnicalwaythedatasystemsoperate.Alackofdataliteracywasidentifiedasa
majorobstacleandtheterm“garbagein,garbageout”wasreferencedinbothconvenings.Recentpositive
progresswascited,butparticipantsfelttremendousopportunityforimprovementexists.Participantsindicated
thatiflongitudinaldataisdevelopedandpastdatapointsareused,theydon’ttrustthedatabecauseitisoften
notanexactmatchforthemeasurethathasbeencreated.
ItwasobservedthatdevelopmentofSLDSisoftendevoidofengagementwithstakeholders.Stakeholdersalso
expresseddisappointmentinthelackofdatatobackupcertainpolicydecisionssuchasthirdgradeliteracylaws.
Theyrecommendedthatpolicychangesshouldnotbemadeusingdatathatisabsentorinvalid.
Expressed Interest of Stakeholders
•Dataformoreoccupationsthanjustthosethatare“highwage.”Participantsspecificallyexpressedaninterest
indatapertainingtoteachersandpointedatthestatewideteachershortageanduseoflong-termsubstitutes
asanimpetusforthisdata.
•Dataforexperientiallearningprogramssuchasapprenticeshipsandjobshadowinginordertoevaluateand
makedecisionsormakethecaseforpost-secondaryeducationpathsoutsideoftraditionalcolleges.
•Moredetailineducationandwagedatatomakeassessmentsaboutwhethereducationwasrelevanttothe
careerspeopleendedupin.
•Projectiondatawithabilitytonarrowtohyper-localgeographies,includingoccupationalopenings,wagedata,
projectednumberofretirementsvs.openings.Thiswouldbeusedtoidentifyemergingindustriesandareasof
focuswherehiringwilllikelybehappening.
•Retentiondata.
•Workforcedemanddataforskilledtrades.
•Completeandaccuratelicensingdatathatcanalsobeusedtomeasureretentionandcompleters.LARAshould
becontributingdatatotheSLDSand1099datashouldbeintegratedintoSLDS.
•Datawithreducedlagtimes,especiallygraduationdata.IfgradeshavetobeinbyJune,whydoesittakeuntil
thefollowingyearforthattobeavailable?
•Communitytrustwasidentifiedasanimportantfactorindatasystemwork.Onestakeholderindicatedwhite
papersareinprogresstoaddressthistopic.Theresearchwillindicatethatsocietyshouldmoveawayfromrigid
modelsandworktowardnetworkdatasharing.
•ConnectpubliclyaccessibledatafeedswithAPIstoopendataplatforms.
38 | STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS
•Transferandlinkageofcredentialsforwork-basedlearningdata.
•Employerrepresentativesindicatedtheywantbetterforecastingofoccupationaldata.Thisincludedarequest
formappingoftheprogramsthataredevelopingknowledge,skillsandabilitiesthatcanfeedemployers.
•Specialeducationprogrammingwithlongitudinalentryandexitinformation.Thestakeholdersindicatedthis
isneeded,buttheyexpressedstrongconcernsforoverburdeningschoolswithreportingrequirements.
•Postgraduatedataat1-and5-yearpoints.Also,longer-termmetrics,10-and15-yearoutcomes.
•2-5yearforecastofpost-graduationtalentandmetricforITskills.
•Analysisofgraduatingstudentsnotgoingtocollege,andwheretheylandintheworkforce.
•Datatouncoverreasonsstudentsdon’tfinishcollege.
•Skillsetsinhigh-demandfields.
•Programoutcomesfor:
•Adultbasiceducation
•Employmentsupportprograms
•Betterdatasharingbetweenstatedepartments.
•Dataforvariouseducationpaths,includingemployerpathways.
•Employmentandwageoutcomesbyprogramandinstitutiontoidentifybestpracticesforfour-year
degreesandcredentials.
•Amarketplaceofdatasources:MatchingoftheMasterPersonIndexwithONET,includingmicro-credentials
availableonanonopenmarketthatcanbelinkedtoanindividual.Suggestedlinkinglibrarieswiththiscapability.
•Achartthatidentifiesalleducationmandatesandwhetherthosemandatesarefunded,andtimetocomplete
mandateswithintheschoolyear.Thiswillalloweducationinstitutionstoassesswhethertimeanddollarsare
availableafterallmandatesaremettosupportliberalartseducation.
Opinions of Identified Data SystemsPathfinder
StakeholdersidentifiedthatPathfinderhasaplethoraofunderlyingdatathatisfedintothistool,butthoughtthe
toolitselfisunderutilizedandnotwellmarketed.Inonesession,onlytwoorthreepeoplewerefamiliarwiththe
tool,andmosthadapooropinion.Thegroupsdidnotbelievethisfitthedefinitionofalongitudinaltool,but
thosefamiliarsawopportunitythathasyettobetapped.Itisdifficultforinstitutionstonegotiateaccesstothe
data.Labormarketoutcomesareneeded,anditwouldbenefitfromanimproveduserinterface.
Uponfollow-upwithLEO-WD,theofficesharedthatanAPIforPathfinderisbeingcreatedbywhichincluded
institutionsandproviderswillbeabletoapplyforakeytodownloadtheirinstitutionaldata(LongitudinalSystems
inMichiganReportFeedback,2020).
STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS | 39
Credential Engine
SomestakeholdersexpressedinterestandexcitementoverthepotentialofwhatCredentialEngineisdoing,but
mostindicatedthatwhatisbeingpromisedisnotsomethingthatcanbedelivered,especiallyfromanational
organizationinafar-reaching,nationalmanner.Thevastnumberofexistingindustrycredentialscausedconcern
amongfocusgroupparticipants,withsomesharingconcernsabouttheefficacyoftheinitiative.Theindustries
thatarebeingaskedforinformationortoprovideinputusuallystrugglethemselveswithidentifyingwhat
credentialstheyshouldrequire.Thiswillleadtomultinationalorganizationshavingsignificantlymoreinfluence
onthetopicbecausetheyaremoreorganized.
FeedbackfromtheStateLEO-WDofficegarneredadditionaldetailsoftheCredentialEnginework.Theoffice
indicated“LEO-WD’sworkoverthelast18monthshasbeenfocusedonstateeffortstoensurequalified
educationandtrainingandtalentdevelopmentthroughassistancetootherfederalandstatedepartmentsthat
offerindividualcredentialsandlicensure.WearepartneringwithUSDOL,LARA,DIF,MDE,DOS,EGLE,andDTMB
intheproject(LongitudinalSystemsinMichiganReportFeedback,2020).”Inthesamecommunication,LEO-WD
sharedthefollowingactivitiesandinformation:
•LEO-WDhaspublishedtheHighSchoolEquivalency(HSE)credentialandisworkingonanAdultEd(AE)
partneroutreachplanfortheuploadsbyindividualAEprovider.
•TheMichiganDepartmentofEducation,OfficeofCareerandTechnicalEducation(OCTE)hasdefined53career
andtechnicaleducationdescriptions.LEO-WDisworkingonasecondaryCTEpartneroutreachplanforthe
uploadsbyindividualprovider.
•MDEwillsoonpublish3+typesofHighSchoolDiplomas–(MME,STEM,CTEendorsements).
•LEO-WDinpartnershipwithDTMBiscreatinganAPIconnectiontouploadcredentialinformationtothe
Registryforsecondaryandpostsecondaryeducationpartners,including:
•Colleges,highschoolsandCTEsubmissionstoMDE/CEPI
•AdultEdsubmissionstoMAERS
•ProprietaryandprivatepostsecondaryinstitutionstoMiTC
•ACredentialEnginesystemadaptationwasrecentlyapprovedtoallowthird-partyaccountcreation,as
LEO-WDisuniquelypoisedtodothemajordataliftforamajorityofitseducationalpartnerswiththischange.
DTMBAgencyServiceshavebeenabletorecentlyassignstafftothisprojectunderCredentialEngineand
WLDSgrantfunding.
•LEO-WDisworkingwiththeUSDOLMichiganOfficeofApprenticeshipandmanyofthelaborunionsto
identifycredentialsthatareimbeddedinRegisteredApprenticeshipprogramsandgetthemlistedonthe
MichiganTrainingConnect,whichmakesthoselearningopportunitieseligibleforfederalfundingandinclusion
intheGoingPROmarketingcampaign.
40 | STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS
Additional General Stakeholder Statements•TheUnitedWay’s“AssetLimited,IncomeConstrained,Employed”(ALICE)reportwasidentifiedasanexample
oftrulylongitudinaldatasystemthatcouldbereplicated.
•Educationiscurrentlydrivenbythewantsanddesiresofstudents,notbythedemandorexpecteddemand
ofthemarketplace.
•Real-timetalentsupplyanddemandinformationislacking.ThereisdataavailablethroughEMSI,butIPEDS
andBLSdatalagsandlacksbroadaccuracy.
•Supplyanddemandinformationprovidedseveralyearsagowasusefulinmakingthecaseaboutdecision
makingineducation,butitisnowoutdated.
•Hands-oneducationhasdeclinedduetotheincreaseinrequirementstoteachothertopics(AlgebraIIwas
cited).TheMichiganMeritCurriculumhassentthemessagethatallstudentsneedtogeta4-yeardegree.
•Somestakeholdersindicatedinterestinfee-for-service data requests,andanestimateoftotalcost,for
supportingdatarequests.Therewassomediscussionofsupportforthesecoststhroughstateappropriations,
third-partyrequestors,orfromfoundationfunders.
•Thereisanimportanteconomic development aspecttotheSLDS.Siteselectorsareinterestedinlaborforce
numbersovertime.Economicdevelopmentandthebusinessestheyarerecruitingandtryingtoretainwantto
knowiftherewillbeenoughpeopleandiftheywillbeadequatelytrained.Thecurrentrecruitmentapproach
istypicallytopoachtalentfromotherbusinessesratherthangrowtalent.
•FocusgroupparticipantscitedtheFamily Educational Rights and Privacy Act (FERPA) asthegreatest
hurdletoaccessingdata,withtheHealth Insurance Portability and Accountability Act (HIPPA)also
protectingsensitivedata.Afeworganizationshavebeenabletoovercometheprivacyissuesbyhavingbeen
retainedasan“agentofthestate.”Buttheseorganizationsareonlyabletoconductresearchinareasthatthey
arespecificallyrequestedtoworkandtheresultinginformationiskeptconfidentialtostayincompliancewith
thefederallaws.Michigan’s Employment Security Actwasalsocitedasprotectingwagedata.
•Employersdesiretransparencyandaccountabilityregardingtheeffectivenessofeducation.Thiswasdescribed
asadesireforoutcomesmeasuresforhighschoolaswellascollegestudentsadecadeaftergraduation,
conductedandreleasedbyathirdparty,independentorganizationorgovernmentaccountabilityoffice.
Outcomesmeasuresarecurrentlycompiledandreleasedbycolleges,whohaveavestedinterestindistributing
datathatpositivelyreflectstheinstitution.Certificationandapprenticeshipsshouldalsobeincludedinthis
outcomesinformation.
•National Student Clearinghousewascitedasanationalsystemthattracksstudentswhohaveleftorentered
thestate.Whilethisisaneffectivedataexchangesystem,statesmayvaryindatadefinitionsormethodsof
datacollection.
•Accordingtoparticipants,thereisno workforce data certification or standards body. Thereisaconcern
aroundthedigitalskillsneededandwhethereducationinstitutionsareprovidingeducationthatmeetsthisneed.
CredentialEnginewasmentionedasanorganizationthestateisstartingtoworkwith,butseveralparticipants
indicateddoubtregardingtheabilityofthisorganizationtofulfillitsscopeofworkinauseablemanner.
STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS | 41
Labor Market Information and Strategic Initiatives Department of Labor and Economic Opportunity-Workforce Development Discussion
Workforce(UIwagedata)isnowaccessibletoeligiblepartners(communitycolleges,universities,MichiganWorks!
agencies),butisnotavailabletothirdpartiesduetoconfidentialityandprivacyregulations.Therehasbeenone
instanceinwhichathirdpartyhasbeenabletoattaintheworkforcedata:thethirdpartywasworkingonbehalf
ofaneligiblepartnerinordertoanalyzethedataontheirbehalf.Theeligiblepartnerwasrequiredtosignoffon
thesharingofthisdataandstrictruleswereputinplaceregardingtheuseofthedata.
TheaccesspointfordatarequestsistheUnemploymentInsuranceAgencywebsite.Becausetheyhavethelargest
numberofrecordsoverthehighestamountofyearsandittechnicallyownsthedata,itistheinitialaccesspoint
forrequests.
Michiganhasafederatedlongitudinaldatasystem.Thedatamustbeprovidedtotheofficeconductingresearch
frommanydifferentagenciesandallagenciesmustapprovetherequestfordata.Dataisnotprovidedunless
researchisrequired.TheLMISIofficehasacrosswalktobeabletomatchamajorityoftheindividualrecords
acrossdatasetsusingSocialSecuritynumbers,UniqueIdentifiersCodes,andotherindicators.Amajorityofrecords
areabletobematched.PotentialpartnersinWLDSprojectsincludeLMISI,CEPI,DepartmentofTreasury,LARA,
DepartmentofStateandMDE.LMISIprovidesresearchserviceswhenneeded.Thisstructureandnational/state
dataregulationslimitinternalstateresearchprojectsandeliminatethepotentialofresearchbynon-stateentities.
SeveraldepartmentsoftheStateofMichiganhaveworkedsince2012todevelopthesystemusingmostly
federalgrantdollars.TheLMISIoffice(partofDTMB)hasreceivedQEWIfunds.TheDepartmentofEducation
hasdevelopedCEPIthroughSLDSgrants(muchlargergrantawards).
Barriers
Barrierstodataaccessinclude:
•Misconceptionsaboutthetypeofdataavailable.
•Slowdevelopmentofthedatarequestprocess.
•HB4545,whichgrantedaccesstotheeligiblehighereducationpartners,requiresthestateLMISIofficeto
signallMOUstoprovideaccess/grantdatarequests.ThelegalprocessforthiswasnotinplacewhenHB4545
passedandhasbeendifficulttoinstitute.
•Staffinglevelsarenotonparwiththeamountofworkrequiredtofulfillspecificandtime-consumingdata
requestsfromrequestors.
•TheLMISIofficedoesnotcurrentlyhaveaccesstodatapertainingtoself-employmentbuthasahighlevelof
interestinincorporating,ifpossible.
42 | STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS
TheLMISIofficeindicatedtherewouldbevalueinconveningorgettingalleligiblepartnerstoagreetoaset
datarequest.Ifallpartiesagreed,theLMISIofficewouldbeabletoproduceanddistributeasetreporttoeach
institutioninatimeliermanner.
TheLMISIofficeindicatedadditionaldatafromemployerswouldbeofhighvalue.Helpfulnewdatacould
include:occupation(perhapstiedtoONETclassifications),jobtitle,andnumberofaverageweeklyhours
thepersonworked.
1:1 MeetingsUniversities
TheUniversityofMichiganandMichiganStateUniversityhavedevelopedinstitutesthatserveasagentsofthe
stateofMichiganforlongitudinaldataresearchcapacity.Stakeholderconversationsrevealedthatbothsystems
encounterchallengesinmatchingdata,asindividual(federated)statedepartmentsarenotequippedwiththe
availablecapacitytodoso.Michiganhasastrongproprietaryrelationshiptodata.Atleastonestakeholderindicated
thestatedoesnothavethecapacitytoconductthedataworkdesired.Stakeholderswouldliketoseethestate
shiftawayfromfear-baseddecision-making,andseekaculturalshifttowardcollaborationandtransparency.
Bothuniversityofficeshavenegotiatedextensivedatasharingagreementswiththestateandareabletoreceive
individuallevelstatedataforsecondaryandpost-secondaryeducation.Theresearchconductedattheseinstitutionsis
directedbytheMichiganDepartmentofEducation,withtopicareaslimitedtoonlythosespecificallyrequestedby
thestateadministratorsthatarepartofthedatasharingagreement.
TheUniversityofMichiganYouthPolicyLab(UMYPL)isanappliedresearchcenterhousedwithintheInstitute
forSocialResearch(ISR),whichstartedin2016.UMYPLispartofadatapartnershipbetweenMichiganState
UniversityEducationPolicyInnovationCollaborativeandCEPI.ISRhasapendingdata-sharingMOUwiththe
MichiganUnemploymentInsuranceAgency(UIA).Themainfocusofthispendingresearchisimpactanalysis
andprogramevaluationforpost-secondaryeducation.
TheMichiganStateUniversityEducationPolicyInnovationCollaborative(EPIC)isastrategicresearchpartnerwith
theMichiganDepartmentofEducation.EPICisanexternal,quasi-independentevaluatorforMDE.Researchtopics
includeteacherpipelineresearchandaReadbyGradeThreepartnership.AnMOUisinplacebetweenEPIC,MDE,
andCEPI,withEPICservingasanagentofthestate.Workisentirelyclientdriven,withresearchrestrictedto
requestsfromthestateagency,theGovernor,ortheLegislature.UnderFERPA,thereisastudyexceptionanda
programevaluationexception,whichallowsuseofdisaggregatedstudentdata.Duetofederalregulations,all
studentleveldatamustcomethroughMDE.CEPIcollectsandholdsthisdata,butMDEisstilltheowneranddata
canonlybereleasedatthedirectionofMDE.EPICisalsoinitsinfancy,withonly3yearsofexistence.Whilethere
isadesirebyEPICpersonneltolinkCEPIdatawithUIandLARA,itwouldrequirearequestfromMDEand
approvalfromtheGovernor’sofficeforthistooccur.
STAKEHOLDER INPUT: CONVENING AND 1:1 DISCUSSIONS | 43
Seeing a Need for Access
Stakeholdersinthe1:1meetingssharedthatinformationabouttheprocesstorequestandattaindataiscloseto
non-existent.TheysaidthatLMISIisthemosttransparent,butarelationshipmustbebuilt,andnoactiveobvious
pointofaccessexists.UIAdataistiedtobothaccessandownershipissuesanditisdifficulttodeterminethe
processandaccesspointofrequestingthisdata.CEPInowhasanaccesspointthroughMISchoolData,butthis
hastaken10yearstodevelopanditstruggleswithmatching/linkingofdatatoanyotherdatasources.
TheUpjohnInstituteistheonlyknownorganizationoutsideofstateagenciestobegrantedaccesstoUIAdata
forresearchpurposes.MOUsarependingwithafewstateuniversities,butarenotyetfinalized.
Agroupofphilanthropyorganizations,includingtheRalphC.WilsonJr.Foundation,TheBallmerGroup,
JPMorganChase,TheSkillmanFoundationandtheMcGregorFundarecurrentlynegotiatingagrantforthe
MichiganDepartmentofTechnology,Management,andBudgetthatwilllinkindividualdatatoUIdatasolabor
marketoutcomescanbetrackedovertime,alongsideotherdatafromeducationandothersources.Thedata
cannotbereportedbackonindividuals,butcanbeaggregateforcohortsizesof10peopleorgreater.Thegrant
ispendingapprovalfromfundersin2020.
The Employer Perspective
Employer-focusedstakeholdersindicatedadesiretoassesstheeffectivenessoftheirtrainingprogramsandtalent
pipelineactivities.Interactionswiththesegroupsalsoindicatedanopennesstodiscussingtheadditionofoccupa-
tionalinformationtoUIforms,especiallyifitisrequestedonavoluntarybasis.
During1:1stakeholderconversations,itwasdiscoveredthattrackingofindividualUIdataisnotonlydifficultto
attainbyexternalorganizationsduetoprivacyrequirements,butthedatacanonlybereceivedonceandcannot
bekept.IfSocialSecuritynumbersareknown,UIdataexistsandisretrievable–ifaccessisgained.Thisincludes
whetherornotapersonworked,andtheamountearnedinthatquarter,byeducationinstitution.Dataforthe
pastfiveyearsisalsoavailableonindividualswhogetmoneyfromMichiganWorks!Agenciesandhighereducation.
Subjectmatterexpertsindicatethat10-yeardatawouldbemuchmoreuseful.Non-stateprogramsdonothave
thistypeofdataavailable,butthereismovementtomakedataavailabletocomplementarygrantees.
Somestakeholdersexpressedadesireforaccurateandwell-constructedforecasting,withanindicationthat10
yearsofpastdatawouldallowformoreaccurateforecastingmodels.Withoutlongtermdata,assessmentscannot
bemadethatincludesecondorlaterjobsovera40-yearcareer.Thiscantellamuchmorecompellingstoryabout
theoutcomesofeducationandprogramsthanaone-yearpostgraduationstatistic.
Stakeholdersalsoexpressedadesireformoretrainingproviderstocontributedatatothesystemandfordatato
beavailablebyprogram,notjustbyinstitution.TheinstitutionsthatcurrentlyprovidedatatotheSLDSareprimarily
formaleducationinstitutions,notprivateintuitionsthatdonotreceivefederalorstatefunding.
44 | BEST PRACTICES FROM ACROSS THE UNITED STATES
Best Practices from Across the United States
WashingtonTheStateofWashingtoncreatedtheEducationResearchandDataCenter(ERDC)in2007throughalegislative
bill.Thesystemwasinitiallyfocusedonlyontrackingstudentprogressandtransitionsthroughschooltoimprove
studentoutcomes.In2009,ERDC’smissionexpandedtoincludeseveraldatagovernanceresponsibilities,
identifycriticalresearchandpolicyquestions,andmonitorandevaluatedatacollectionsystems.Grantsfromthe
DepartmentofEducationandDepartmentofLaborledtoonlinefeedbackreports,improvingthefunctionality
andstandardizationoftheERDCdatawarehouse,andtheinclusionofworkforceprogramsthatallowedfor
trackingworkforceparticipantstoschoolandbacktotheworkforce.ItappearsthatERDConlytracksparticipants
whohavetouchedtheworkforcedevelopmentprograms,andisnotabletoconnectwithworkforcedatasystems.
ERDCalsorunsthreecommittees:
•DataStewardsCommittee
Ensuresthatthedataiscorrectlyunderstoodandusedcorrectly.
•DataCustodiansCommittee
Ensuresthatthedataisdeliveredandprotected.
•ResearchandReportingCoordinationCommittee
Ensuresthattherightquestionsarebeingaskedtoaddresstheimportantpolicyconsiderationsoftoday.
SLDS Data and Process
SLDSdataandinformationisavailablethroughtheEducationResearch&DataCenter(ERDC).ERDCservesasa
portalforeducationdata.
Eachreport,dashboard,orvisualontheERDCincludesan“aboutthisreport”section,whichexplainsthedefinitions,
methodology,andvariablespriortoamemberofthepublicaccessingthereport.Astatewidereportanda
contractorreportareavailable,butthecontractorreportispassword-protected.ERDCinformationoftencites
theexpectedusersofthedataandthequestionsthatcanbeansweredusingthedata.TheERDCincludesarobust
setofreportsusingtheirSLDSdata.Datasetsvaryregardingtheamountofdatalag,butmostdashboardsappear
tobeupdatedin2017orlater.ERDCincludesmentionofanMOUthatissignedbyalleducationandworkforce
datacontributors,whichincludesasetofprinciples.
AlthoughmoststateshaveanSLDSinplace,notallhavedevelopedequally.
Withaminimallevelofnationalstandards,stateshavebeenlefttodevisetheir
ownbestpractices.Severalareacknowledgedtobeleadersinthisarena,due
totheircommitmenttoaccessibility,dataprivacy,soundgovernance,agency
collaborationandotherbest-in-classcharacteristics.
BEST PRACTICES FROM ACROSS THE UNITED STATES | 45
WA
KYVA
ThestatesofWashington, Virginia, andKentuckyareidentifiedasbest practice statesduetotheirabundantreferencesinmultipleliteraturereviewmaterials.
Datarequestprocess:
•Washington’sERDCidentifiesarobustexplanationofthedatarequestprocess,includingtheprocessfordata
requeststhatinvolveredisclosure(individuallyidentifiabledata)vs.noredisclosure(aggregateddata).This
includeslinkstorequestformsande-mailaddressesusedtosubmit.Alistofimportanttermswithdefinitionsis
alsoincluded.Alistofalldatarequestssubmittedincludingrequestorname,datesubmitted,topic,producttype,
authorizationpath,decision,andwhethertherequesthasbeenfulfilledisavailableonthewebsite(https://
erdc.wa.gov/data-resources/data-requests-0).AsofOctober29,2019,twenty-ninerequestshadbeenmadefor
thecalendaryear2019,with5denied,6pending,andtheremainingfulfilledfullyorpartially.
•WashingtonusedanSLDSgranttoadoptamoreeffectiveprocessforcollectingstudent-levelcredential
attainmentdatafromprivatecareerschools(PCS)thatgrantcertificates.WashingtonhasaWorkforce
TrainingandEducationCoordinatingBoard(WTECB)thathasbeenattemptingtocollectthisdatainvoluntary
andnon-standardizedmethodsforyears.PriortotheSLDSgrant,WTECBengagedwiththeNorthwest
FederationofCareerColleges(thePCSregionalTradeAssociation)tosetdatarequirementsandadoptregulations
requiringPCStoannuallytransmitstudent-leveldata.Thisdatawastransmittedinmanydifferentformsand
46 | BEST PRACTICES FROM ACROSS THE UNITED STATES
methods.TheSLDSgranthelpedWashingtondevelopastudentdataportaltocollectdatafromPCS,including
standardizedcodesandprogramtitles.ThisincludesautomaticerrordiscoveryandalinkagebetweenPCSdata
andwagerecordsandotherdatasets.Studentoutcomescanbemeasuredwiththisresource.Theoutcomes
informationistransmittedtotheERDCandincludedinworkforceprogramreports.(Levantoff,2019,p.6)
•WashingtonhasreceivedWDQIandSLDSgrants.InJuly2012,theWashingtonStateERDCusedARRAStatewide
LongitudinalDataSystemsGrantdollarstofundanEmploymentDataHandbookthatprovidesguidancetoother
statesforconnectingeducationandemploymentdata.TheHandbookrecommendsconnectingUIprogram
data.Washingtonemployersarerequiredtoprovideadditionaldatabeyondthefederallyrequireddataset,
includinghoursworked.Alaskaalsoincludesarequirementforoccupationoftheemployeesreported.Additional
workforcedatasystemscanbeusedtocreateamorecompletepicture,includingtheFederalEmploymentData
ExchangeSystem(FEDES),WageRecordInterchangeSystem(WRIS),AdministrativeDataResearchandEvaluation
(ADARE),andLocalEmploymentDynamics(LED).(Education,ResearchDataCenter,2019)
AsofAugust1,2019,Washingtonpassedsevenofthe29billsintroducedinstategovernmentaddressingdata
quality.Thestateconsideredabilltoexpandexistingprivacylawgoverningschoolserviceproviderstocoverall
servicesusedinschools,whetheroriginallyintendedforthatpurposeornot.Thesecoveredplatformsusedforin
classroomsbutnotdesignedforthatpurpose(DQC2019EducationDataLegislationReview).
VirginiaAccordingtotheCommonwealthofVirginia’swebsite:
“�The�Virginia�Longitudinal�Data�System�(VLDS)�is�a�powerful�tool�for�Virginia’s�future,�giving�the��
Commonwealth�an�unprecedented�and�cost-effective�tool�for�extracting�and�analyzing�insightful��
education�and�workforce�development�data�within�a�secure�environment.”�The�VLDS�is�a�federated��
system�and�touts�a�“double�deidentifying�hashing�process�that�leaves�private�data�behind�existing��
firewalls�of�the�participating�agencies.�This�technology�was�developed,�in�partnership�with�VLDS��
participating�agencies,�almost�entirely�with�in-state�resources�including�Virginia�Tech,�Virginia��
Information�Technologies�Agency�(VITA)�and�Center�for�Innovative�Technology�(CIT).”�(VLDS,�2019)
EachparticipatingagencyisavotingmemberoftheVLDSDataGovernanceCouncil,whichmeetsmonthlyto
discussresearch,challenges,andsystemgrowthandtomakedecisionsaboutVLDSpolicyandprocedureona
consensusbasis.(NationalSkillsCoalition,SayingYestoLongitudinalData,2019)
ABookofDataGovernanceisidentifiedasareferenceguideforstakeholders,identifyingstructureanddefiningthe
majorrolesofthedatagovernancecouncilandtechnical,legislative,communications,andresearchsubcommittees.
Whilethestructurefordatagovernanceandresearchprocessappeartobethesameforallagenciesunderthe
VLDS,eachagencyappearstohaveahighlevelofautonomy,includingresearchagendas,andtheirowndatasets.
BEST PRACTICES FROM ACROSS THE UNITED STATES | 47
Virginiadoesnotoperateusingadatawarehouse.Instead,agencydataremainswiththeagencythatcollected
andownsit.ThereisnologincapabilitytoVLDS.Accordingtothewebsite:
“�Data�requests�can�only�be�made�by�vetted�researchers�who�have�completed�an�application�process�and�
whose�research�questions�have�been�reviewed�and�validated�by�VLDS�participating�agencies.�Then,�all��
researchers�within�the�system�are�assigned�a�committee�of�agency�“sponsors”�who�guide�and�oversee��
the�process�—�all�in�the�name�of�accuracy�AND�privacy.�Each�step�along�the�way,�from�access�request�to�
publication�of�results,�must�be�approved�by�the�researcher’s�sponsoring�agency.”
Thereisverylittledescriptionofallofthevariousformsofdatathatmightbeavailable,optinginsteadforexternal
researcherstoalignwithindividualdepartmentresearchprioritiesandbesponsored.
InterestingresearchandfindingsaresharedviaablogontheVLDSwebsite.Thereisnopublic-facingdataother
thanthedatasharedintheseblogs.Thepublicisnotabletolookupaggregateddata,asstakeholdersareableto
doinotherstates,includingMichigan.
Data-contributingstateagenciesincludetheVirginiaDepartmentofEducation(VDOE),theStateCouncilofHigher
EducationforVirginia(SCHEV),theVirginiaEmploymentCommission(VEC),theVirginiaDepartmentofSocialServices
(VDSS),theVirginiaCommunityCollegeSystem(VCCS),theVirginiaDepartmentforAgingandRehabilitative
Services(DARS),andVirginiaDepartmentofHealthProfessions(DHP),VirginiaDepartmentfortheBlindandVision
Impaired,VirginiaDepartmentofJuvenileJustice,andtheOfficeofChildren’sServices.Twonon-governmental
organizations,VirginiaGoodwillNetworkandVirginiaEarlyChildhoodFoundation,arealsomembers.
(NationalSkillsCoalition,SayingYes…,ibid)
Virginiahasarobustprocessforarticulatingapprovedcredentialsforcreditandbuildingstackablecareer
pathways.Credentialsareincorporatedthatmeettheparametersdevelopedorendorsedbyemployers.These
credentialsarewidelyrecognizedandserveasproofofacquiredskillsthroughthirdpartytesting.Thisprocess
isledbytheVirginiaCommunityCollegeSystem(VCCS).(Levantoff,Measuring…,2019)
EstimatedcostsofVirginia’sfederatedsystemnear$7.5milliontoplanandbuildVirginia’sSLDS,with
approximately$6.75milliondedicatedtosoftwaredevelopmentandintegrationservices,$450,000forstaff
services,$300,000forhardware,and$75,000forsoftware.Yearlyoperationsandmaintenancecostsroughly
$475,000,including$325,000onvendorsupport,$100,000onhardwareandhosting,and$50,000on
softwarelicensing(Levantoff,Costs…,2019)
AsofAugust1,2019,Virginiapassedfourofthe6billsintroducedinstategovernmentaddressingdata
quality(Anderson,2019).
48 | BEST PRACTICES FROM ACROSS THE UNITED STATES
KentuckyAccessandinformationforKentucky’sSLDSisavailableatKentuckyCenterforStatistics(KYStats).According
tothesite,it“wascreatedin2012toexpandupontheworkoftheKentuckyP-20DataCollaborative,including
maintainingtheKentuckyLongitudinalDataSystem(KLDS),astatewidelongitudinaldatasystemthatfacilitates
theintegrationofdatafromtheKentuckyDepartmentofEducation(KDE),theCouncilonPostsecondaryEducation
(CPE),theEducationProfessionalStandardsBoard(EPSB),theKentuckyHigherEducationAssistanceAuthority
(KHEAA),andtheKentuckyEducationandWorkforceDevelopmentCabinet.”
Thisisacentralizedsystemthatoriginatedwiththreestateagenciesandgrewtofivethroughexecutiveorders
andlegislation.KYStatsnowhasanindependentofficeandaformalizedgovernancestructure,whichincludes
eachparticipatingagency’srepresentationontheKentuckyLongitudinalDataSystemgoverningboard.Success
ofthissystemisattributedtopersonalrelationship-buildingthroughsharedunderstandingofthevalueagencies
realizebyengaginginthework,tojointpresentationsbyKYStatsstaffandsuccessfuluserswhobringreal-life
examplesoffundingdecisionsandstrategyworktothetable.(KYStats,2019)
KYStatsincludesarobustsetofreportsaddressingfutureskills,post-secondary,highschool,CTE,teacherprep,
andSkillsUfeedback,aswellasanearlychildhoodprofile,andworkreadycommunities.Reportsaresearchable
andfilterable.Manyreportsfeatureinteractiveandcustomizableinfographicsallowingforreportstobeadjusted
bydatasets,geography,timeframeandoccupationorindustrycategories.Kentucky’sLaborMarketInformation
statisticsarealsoembeddedintothissite.
KYStatsincludesa“requestdata”linkonthehomepage.Therequestprocessisinitiatedwhenauserselects
individualoraggregatedleveldata.Restrictionsandprocessinformationisdisplayedtoassisttheuserin
understandingtheirrequestandpotentiallimitationsincludingpotentialtimeframes(3weeksforaggregated/4
monthsforindividual-leveldata).Aquestionnairemustbecompletedtoinitiatetherequestprocess.Policyand
accessinformationissharedonthesite,aswellasinformationaboutprivacylawsandregulations.Thissitealso
housesacareerexplorertool.AlldatarequestfulfillmentdoesnotincludePersonallyIdentifiableInformation.
DataisonlysharedthroughstrictMOUprocedures,whichgovernhowthedataisusedandprovideguidanceon
sharingresearchoutcomesandrestrictfromlinkingtoanyothersystem.Thedatamustalsobedestroyedafter
use.(KYStats,ibid)
KentuckyisabletolinktheirearlychildhooddatasystemswithchildsocialservicesdatasuchasTANF,child
welfare,andSNAP.(King,Perkins,Nugent,Jordan,ibid)
AsofAugust1,2019,Kentuckypassedtwoofthefivebillsintroducedinstategovernmentaddressingdata
quality(DQC2019EducationDataLegislationReview).
BEST PRACTICES FROM ACROSS THE UNITED STATES | 49
Other Noteworthy StatesTexas and the University of Texas
BoththestateofTexasandtheUniversityofTexasemergedasinnovatorsinconversationswithstakeholders,but
wereseldomcitedintheliteraturereviewed.Accordingtoasessionagendafromthe2019Close-ItConference:
“�In�order�to�help�students�make�informed�decisions�about�academic�pathways,�career�choices,�and��
borrowing�practices,�the�University�of�Texas�System�developed�a�partnership�with�the�United�States�Census�
(U.S.�Census)�Bureau�to�merge�UT�System�student�data�with�national�UI�wage�data�that�is�maintained�by�
the�Longitudinal�Employer-Household�Dynamics�(LEHD)�program.�The�LEHD�program�maintains�a�voluntary�
data�agreement�with�49�states�who�submit�individual-level�UI�wage�records�to�a�data�consortium.�The�
U.S.�Census�has�matched�their�records�with�UT�System�student�records.�The�matching�of�records�allows�UT�
System�to�create�a�national-level�earnings�metric�(annual�earnings)�by�major�for�any�graduate�who�has�UI�
wage�records�from�across�the�nation.�The�metric�was�integrated�into�the�UT�System�seekUT™�tool�–�a�free,�
online�tool�that�provides�students�and�parents�information�on�earnings�and�student�debt�by�major.”
TheconferencesessiondescriptionalsoindicatedasharingoftheprocessUTunderwenttobecomeaU.S.Census
BureaupartnerandinferredthattheU.S.CensusBureauisopentoadditionalpartnerships.Additionalinformation
isavailablebyvisiting:https://seekut.utsystem.edu.
Additionally,TexasenactedHB3in2019,whichoverhaulsschoolfundingformulastoincreaseavailabilityofdata
aboutearlychildhoodeducationqualityandrequiresdistrictstosetearlychildhoodliteracyandmathproficiency
goalsandpubliclyreportonprogress.(Andrews,2019)
Other State Activities
•CaliforniapassedanewlawthisyearestablishinganSLDS.Ithasbeenoneoftheonlystatesacrossthenation
withoutasystem(DataQualityCampaign,2019)
•MarylandpassedalawthatwilladdjuveniledelinquencyanddisciplinerecordstoitsSLDSandaddthe
secretaryofjuvenileservicestothestate’spre-existingdatagovernanceboard.(ibid)
•UtahpassedalawtocreateinfrastructureforthesharingofstudentdatabetweendistrictsandtheState
BoardofEducation.Thiscreatesastandardizeddatacollectionandreportingprocess.(ibid)
•AFloridalawestablishedtheFloridaTalentDevelopmentCouncil,whichwillusedatatoaligneducationand
workforceneedsbyassessingwhetherpostsecondarydegreesandcredentialsalignwithemployerneeds.(ibid)
•AccordingtotheAspenInstitute,anumberofstateshavetakenstepstowardamoreskills-basedlabor
market.Forinstance,Colorado,andmorerecentlyIndiana,haveworkedwiththeMarkleFoundation’sSkillful
Initiative–inpartnershipwithMicrosoft,LinkedInandotherpartners–todevelopamoreeffectiveand
transparentskills-basedlabormarket.InFebruary2019,20governorshelpedlaunchtheSkillfulStateNetwork
inanefforttoscalethemodel.Butachievingthatleveloftransparency–andlinkingthetheoryupwithactual
hiringdecisionsinpractice–canbequitedifficultwithouttheunderlyingdataandinformationonskillneeds
andgaps.(AspenInstitute,2019).
50 | RECOMMENDATIONS
Recommendations
1. Grow a culture of data literacy and transparency in Michigan.
Itisevidentthroughthisresearchthattheexecutivebranchandstateagencieshaveakeyrole
toplayinmakingaccesstohigh-qualitydataapriority.Withadditionalresources,andrespectful
stakeholderengagement,CEPI,LEO-WDandLMISIcouldplayatransformativeroleinhow
Michiganleveragesarobustsystemofdatacollectiontodrivepositivesysteminvestmentsand
outcomes.Thereareplentifulopportunitiesforengagementthroughoutthestate,andintermediaries
willingtocollaborateandsharetheworkneededtoclearlyarticulateSLDSandWLDSprograms
andcapabilities.
2. Design and publish clear rules for engagement for access to SLDS data, and
make the “front door” obvious across websites and dashboards for all federated
data owners.
Thereisapalpablesenseoffrustrationamongmanystakeholdersconcerningwhytheyhavenot
beenabletogetaccesstodatathattheyassumeisavailableandaccessible.Concertedefforts
weremadetodiscoverhowtoevenmakerequestsoftheSLDS,whicharedetailedinthisreport.
Otherstateshaveclearlydefinedandpublishedrulesofengagement.Michigancanimprove
currentexternalcommunicationstoalleviatethesefrustrations.
3. Add vital reporting metrics to employer unemployment wage reporting
including: ONET occupation code, job title, hours worked, and primary job site.
TheU.S.DepartmentofLabor2018draftreport,“Recommendationstoimprovethenation’s
workforceandlabormarketinformationsystem,”theAspenInstitute’s2019,“FutureofWork”
ThefollowingrecommendationsshouldbeconsideredbyTalent2025,theWestMichigantalentworkinggroup,
interestedpartiesacrossthestate,andstatepolicymakers.Dedicatedpublicservantsworkinginstategovernment
havecreatedthebackboneofausefulSLDS.Additionalconvening,collaboration,andinvestmentwillberequired
toliftMichigantoabest-in-classstatewhencomparingSLDSsystemsnationally.Withsomanyorganizationsin
thepublic,privateandnonprofitsectorsfocusedoneducatingfor“thefutureofwork,”andonhowtoactivate
long-termunemployedpersonsduringthistimeoffullemployment,SLDSsystemsareanaturalplacetolookto
measureprogramresultsandsystemsperformanceforlifelonglearningamongyouthandadultsinMichigan.
Withasolidfoundationinplace,MichiganhasanopportunitytotakeitsSLDSto
thenextlevel.Theserefinementsarecritical.Forthestatetoremaincompetitive
inamodern,knowledge-basedeconomy,itmusthavearobustdatasystemthat
supportsimprovementstoworkforceandeducationstrategies.
$
RECOMMENDATIONS | 51
report,andstakeholdersinternalandexternaltostategovernmentagreeifthestateistohave
arobustSLDS,itmustincludecriticalpiecesofinformationthataremissingfromwhatiscurrently
collected.Themissinginformationisroutinelydemandedbyemployers,researchers,andeducators
alike,butmostdonotrealizethatthefourdatapointsinthisrecommendationarenotcollected
bylocal,state,orfederalagencies.
4. Add missing data from existing state systems.
ManyhelpfulsourcesofinformationarenotincludedincurrentSLDSsystems,theseincludebut
arenotlimitedto:
•Self-employmentdata(IRS1099)sometimesframedasthegig-economy,
•ProfessionallicensingdatabasesfromtheDepartmentofLicensingandRegulatoryAffairs,
•U.S.DepartmentofLaborApprenticeships,
•WorkforceinvestmentsnotcontainedintheOSMISreportingsystem.
5. Implement a system of assigning unique identifier codes (UIC) at birth, or at first
engagement with state services. Integrate a common system of UIC assignment
across all state agencies, agents of the state, and subcontractors.
TheLEO-WD,stateLMISIoffice,CEPI,andotheragencieshaveinvestedconsiderabletalent,time
andcapitaloverthepastdecadebuildingsystemstomatchindividualrecordsacrossnumerous
databases.ThisprocessinvolvespainstakingworktoassignUICsandtotestandverifycombined
datasets.SettingastandardpolicyforUICassignment,independentofSocialSecuritynumbers,
willstreamlinefutureanalysisopportunities.
6. Appropriate a “data innovation and quality fund.”
Michiganhasamongthebestandbrightestmindsintheworld,focusedonsolvingbigchallenges.
Withaproactiveposition,andadesiretobuildacultureofdataliteracyandtransparency,researchers
fromthepublic,nonprofit,educationandprivatesectorswillposethequestionsanddothework
thatwillleadthenationinSLDSinnovationandimplementation.Evenasmallannualappropriation
wouldbeabletoseedacompetitivefundtoaskthequestionsthatwillmakeMichiganreflect
onitseducationandworkforceinvestmentsthoughthehelpfulandcriticaleyeofresearchersat
colleges,universities,workforceagencies,andintermediarynonprofits.
Anumberoffoundations(referencepage41)havecometogethertosupportadditionalcapacity
forSLDSandrelatedresources.Moredetailsmaybecomeavailableinearly2020,ifandwhena
grantfromtheRalphC.WilsonJr.Foundationboardismadepublic.Foundationfundingdoesnot,
however,replacetheimmediateandlong-termneedforadditionalthoughtfulinvestmentonthe
partoftheStateofMichigantosupportsystemsforthestate.Acompetitivefund,focusedon
52 | RECOMMENDATIONS
innovativeresearchanddataquality,similartorecentstatecompetitionsforworkforceand
educationcollaborations(MarshallPlanforTalent,GoingPro,etc.)wouldprovideapractical
andcreativeoutletforvaluableresearchandprogramdevelopmentaroundthestate.Whilean
assessmentoffunderssupportingeducationandworkforcedataresearchareoutsidethescope
ofthisanalysis,avarietyoffundersandgrantshavebeenidentifiedinthispaper.
7. Revisit succession plans among key state agencies to identify and verify
critical systems and employees.
AsmallnumberofdedicatedpublicservantshavecreatedtheSLDSsystemswehavetoday,andloss
ofinstitutionalmemoryforpositiveortragicreasonscouldnegativelyimpactsystemsmanagement.
RECOMMENDATIONS | 53
54 | ABOUT THE AUTHORS
About the AuthorsDavid PalmerDavidPalmerisamulti-disciplinaryconvener,facilitator,publicspeaker,researcher,entrepreneur,andRealtor,in
privatepractice.HeisprincipalofDCPalmerLLC.Davidspent10yearsworkinginkitchensandmanagingrestaurants.
Anothertenyearsmanagingsuccessfulsmallbusinesses:onefocusedonenvironmentalremediationandtheother
flowdynamicsmeasurementandsoftware/hardwaresystemsintegration.Mostrecently,hehasinvestedsixyears
innonprofitworkforcedevelopmentandinservinghisresidentialrealestateclients.WhiletheSeniorDirectorat
theWorkforceIntelligenceNetwork(2014-2019),hesupportedthedevelopmentofover$40millioninfederal,
stateandfoundationgrantsawardedtosupportworkforcetrainingandcapacitybuildinginthe16countyDetroit
region.Hehasspokenatover100conferencesandmeetingssince2014.HeholdsaMasterofPublicAdministration
degree,withhonors,fromEasternMichiganUniversity.Also,aGraduateCertificateinNonprofitManagementand
aBachelor’sinPoliticalScienceandBusinessfromEMU.DavidisalicensedRealEstateAssociateBroker,a
CertifiedNonprofitProfessional,andaDocumenterforWDET,Detroit’sNationalPublicRadioStation.Heisa
memberoftheAmericanAssociationofPoliticalConsultants,theNationalAssociationofRealtors,theGreatLakes
RenewableEnergyAssociation,andhasservedonnumerousadvisorycommitteesandnonprofitboards.Linkstohis
publicationscanbefoundonhiswebsite:www.dcpalmer.com.DavidlivesintheHubbardRichardneighborhoodin
SouthwestDetroitandtravelstheUnitedStatesandEuropeinsearchofinspirationalmusicandamazingfood.
LinkedInandTwitter:@DavidPalmer76
Email:[email protected]
Tricia CzachowskiTriciaCzachowskiistheownerandoperatorofCZAConsultingLLC.Shedrawsonhereightyearsofexperience
managingfederalandfoundationgrants,aswellasgrantwritingandbusinessoperationssupport.Triciapreviously
servedasaSeniorProjectManager,InterimExecutiveDirector,andResearchandPolicyAnalystwiththeWorkforce
IntelligenceNetworkforSoutheastMichigan.Inthisrole,sheservedastheprojectleadforthe$9.4million
SoutheastMichiganDefenseIndustryAdjustmentgrants(alsoknownastheAdvanceMichiganDefenseCollaborative)
fromtheDepartmentofDefense,spendingbothgrantstowithin95%ofthetotalbudgets,overseeing20projects
intendedtoidentifyanddiversifyMichigan’sdefenseportfolio,expandeducationalandworkforcetrainingfor
emergingmarkets,andprovideopportunitiesforMichigancompaniesengagedinthedefenseeconomy.Tricia
ledeffortstodeveloprequestsforproposalsandcontractspertainingtothisDepartmentofDefenseOfficeof
EconomicAdjustmentgrant.ShealsocoordinatedtheAdvanceMichiganDefenseCollaborativeexecutive
subcommitteeandgrantadministrationmeetings.Shehasextensiveresearchandwritingexperiencerelatingtolabor
marketinformationandwasacontributingauthortoWINlabormarketreports,andseveralspecialreportspertaining
toworkforcedataonhealthcare,cybersecurity,andadvancedmanufacturing.TriciaisalifelongresidentofMichigan
andwasraisedintheThumbarea.Sheholdsabachelor’sdegreefromGrandValleyStateUniversity.
LinkedIn:@CZAconsulting
Email:[email protected]
BIBLIOGRAPHY | 55
Bibliography1. Anderson,Rachel.(2019).2019LegislativeUpdatePartI.AccessedSeptember15,2019.https://dataqualitycampaign.
org/2019-legislative-update-part-one/
2. Andrews,Alex.E-mailcorrespondence,October21,2019.
3. AspenInstitute.2019.FutureofWorkReport.WashingtonD.C.AccessedSeptember18,2019athttps://assets.
aspeninstitute.org/content/uploads/2019/02/Future-of-Work-Initiative-State-Policy-Agenda_February-2019.pdf?_
ga=2.161194621.1525289640.1568816537-374672146.1568816537.
4. Brighthive.AccessedNovember30,2019athttps://brighthive.io/
5. CenterforEducationalPerformanceandInformation,MichiganStateLongitudinalDataSystemFlowchart.
AccessedOctober26,2019athttps://www.michigan.gov/documents/cepi/MSLDS_flow_328441_7.pdf
6. CenterforEducationalPerformanceandInformationwebsite.AccessedOctober9,2019athttps://www.michigan.gov/
cepi/0,4546,7-113-56472---,00.html
7. CenterforEducationalPerformanceandInformationwebsite.AccessedJanuary27,2020athttps://www.michigan.gov/
cepi/0,4546,7-113-21423-55063--,00.html
8. CredentialEngine.AboutUs.AccessedOctober10,2019athttps://credentialengine.org/about/
9. DataQualityCampaign2019EducationDataLegislationReview.October2019.AccessedOctober29,2019.https://dataqualityc-
ampaign.org/education-data-legislation-review/
10. DepartmentofLaborandEconomicOpportunity.MichiganWLDS.AccessedOctober10,2019athttps://www.michigan.gov/
leo/0,5863,7-336-78421_95539_64178_75708---,00.html
11. Education,Research&DataCenter.EmploymentDataHandbookWashingtonERDC.AccessedOctober29,2019.http://www.
erdc.wa.gov/sites/default/files/publications/EmploymentDataHandbook_v1.pdf
12. Granholm,Jennifer.StateofMichigan.(August8,2010).ExecutiveOrder2010-15.Lansing,Michigan:Michigan.gov.Accessed
September17,2019athttp://www.legislature.mi.gov/(S(2lzrxs45l0g0q5mevi3xrl45))/documents/2009-2010/executiveorder/ht-
m/2010-EO-15.htm
13. King,C.,Perkins,V.,Nugent,C.,&Jordan,E.(2018).2018StateofStateEarlyChildhoodDataSystems.Retrieved13September
2019,fromhttps://www.ecedata.org/wp-content/uploads/2018/09/ECDC-50-state-survey-9.25.pdf
14. KYStats.(2019).KYStatsHistory.AccessedOctober29,2019.https://kystats.ky.gov/About/History?AspxAutoDetectCookieSupport=1
15. Levantoff,J.CostsofStateLongitudinalDataSystems.(2019).AccessedSeptember15,2019
https://www.nationalskillscoalition.org/resources/publications/file/Cost-of-State-Longitudinal-Data-Systems_web.pdf
16. Levantoff,J.(2019).MEASURINGNON-DEGREECREDENTIALATTAINMENT.Retrieved15September2019,fromhttps://www.
nationalskillscoalition.org/resources/publications/file/Measuring-Non-Degree-Credential-Attainment-50-State-Scan.pdf
17. MichiganHB4242.AccessedSeptember26,2019athttp://www.legislature.mi.gov/documents/2019-2020/billconcurred/House/
pdf/2019-HCB-4242.pdf
18. Michigan.gov,2019.AccessedSeptember26,2019.https://www.michigan.gov/cepi/.
19. Michigan.gov.AccessedNovember7,2019athttps://www.michigan.gov/documents/uia/170-Information_and_Records_Re-
quest_626775_7.pdf
20. Mischooldata.org.(2019).HomePage.Accessed10Sep.2019:https://www.mischooldata.org/Default.aspx
21. Mischooldata.org.Trifoldbrochure.Accessed10.9.9.2019athttps://www.michigan.gov/documents/cepi/TrifoldBro-
chure_441995_7.pdf
22. MichiganSchoolAidActof1979.(updated2019).Act94of1979.Lansing,Michigan:AccessedOctober2,2019athttp://www.
legislature.mi.gov/documents/mcl/pdf/mcl-act-94-of-1979.pdf
23. MichiganEmploymentSecurityAct(Excerpt)Act1of1936(Ex.Sess.).Lansing,MI:MichiganCompiledLawsCompleteThrough
PA48of2019.AccessedSeptember18,2019athttp://www.legislature.mi.gov/(S(0m2lso31beg0mcs0ygjwp15c))/mileg.aspx-
?page=getobject&objectname=mcl-421-11&query=on&highlight=community%20AND%20college%20AND%20data
56 | BIBLIOGRAPHY
24. NationalCenterforEducationStatistics.(February2017).P-20W+DataGovernance-TipsfromtheStates,Brief4.Accessed
December2,2019athttps://slds.grads360.org/services/PDCService.svc/GetPDCDocumentFile?fileId=25962.
25. NationalForumonEducationStatistics.(2010).TravelingThroughTime:TheForumGuidetoLongitudinalDataSystems.Book
OneofFour:WhatisanLDS?(NFES2010–805).Washington,DC:NationalCenterforEducationStatistics,InstituteofEducation
Sciences,U.S.DepartmentofEducation.AccessedSeptember10.2019https://nces.ed.gov/forum/ldsguide/book1/ch_2_1.asp.
26. NationalSkillsCoalition.“SayingYestoLongitudinalData.”AccessedOctober29,2019.https://www.nationalskillscoalition.org/
resources/publications/saying-yes-to-state-longitudinal-data-systems-building-and-maintaining-cross-agency-relationships
27. NationalSkillsCoalition.(2019).SmartDataforaSkilled,Inclusive21stCenturyWorkforce.AccessedNovember11,2019at
https://www.nationalskillscoalition.org/national-initiatives/body/Smart-Data-for-a-Skilled-Inclusive-21st-century-workforce-4.pdf
28. Pathfinder.AboutPathfinder.AccessedOctober10,2019athttps://pathfinder.mitalent.org/#/about
29. Pena,C.(2019).MakingWageDataWork.Retrieved15September2019,fromhttps://www.nationalskillscoalition.org/resources/
publications/file/WDQC_MakingWageDataWork
30. Pena,C.(2018).WorkforceSuccessReliesonTransparentPostsecondaryData.Retrieved15September2019,fromhttps://www.
nationalskillscoalition.org/resources/publications/file/Workforce-success-relies-on-transparent-postsecondary-data_web.pdf
31. SiddiqiJ.,Sims,P.C.,&Goff,A.L.(2019).ConnectingtheContinuum:LongitudinalDataSystemsinNorthCarolina.Retrieved15
September2019,fromhttp://www.hunt-institute.org/wp-content/uploads/2019/06/Hunt-Institute-Connecting-the-Continuum.pdf
32. StateofMichigan-LEO,E-mailcorrespondence.October14,2019.
33. StateofMichigan-LEO,E-mailcorrespondence.December9,2019.
34. TalentInvestmentAgency.July2018.FactSheet#170:InformationandRecordsRequest.AccessedNovember11,2019at
https://www.michigan.gov/documents/uia/170-Information_and_Records_Request_626775_7.pdf
35. U.S.ChamberofCommerceFoundation.JobDataExchange.AccessedNovember30,2019athttps://www.uschamberfounda-
tion.org/workforce-development/JDX.
36. U.S.ChamberofCommerceFoundation.T3InnovationNetwork.AccessedNovember30,2019athttps://www.uschamberfoun-
dation.org/t3-innovation.
37. U.S.Congress.(2019).S.800CollegeTransparencyActSen.Cassidy.AccessedNovember11,2019athttps://www.congress.gov/
bill/116th-congress/senate-bill/800/text
38. U.S.DepartmentofEducation.CollegeScorecard.AccessedNovember30,2019athttps://collegescorecard.ed.gov/.
39. U.S.DepartmentofEducation.October2019.StatewideLongitudinalDataSystems(SLDS)SurveyAnalysis.Accessed
December1,2019athttps://nces.ed.gov/pubs2020/2020157.pdf
40. U.S.DepartmentofHealth&HumanServices.AccessedOctober28,2019https://www.acf.hhs.gov/ecd/early-learning/race-to-
the-top
41. U.S.DepartmentofLabor.(2019).WorkforceDataQualityInitiativeGrantInformation.AccessedAugust16,2019athttps://
www.doleta.gov/performance/workforcedatagrant09.cfm#MI
42. VLDS.AccessedOctober29,2019.https://vlds.virginia.gov/
43. Westendorf,Vern.August8,2014.WLDSPresentation.AccessedOctober28,2019.https://www.google.com/url?sa=t&rct=-
j&q=&esrc=s&source=web&cd=3&ved=2ahUKEwjRloOVgqzmAhXEct8KHYv4Av0QFjACegQIAhAC&url=http%3A%2F%2Fwww.
michigancc.net%2Fevents%2Finformation%2Fworkshop%2FWLDS.pptx&usg=AOvVaw13eHmugJeaP93a3CGJfqQp
58 | SECTION
833 Kenmoor Avenue SE
Grand Rapids, MI 49546
616.871.2450
talent2025.org