Upload
henry-andrews
View
220
Download
2
Tags:
Embed Size (px)
Citation preview
U.S. Department of LaborU.S. Department of Labor
Employment and Employment and Training AdministrationTraining Administration
1
Data Mining Using Data Mining Using the Federal the Federal
Research and Research and Evaluation Evaluation DatabaseDatabase
Describe
Explain
Predict
2
AgendaAgenda
• Overview of the toolOverview of the tool• The basics of data analysisThe basics of data analysis• TAA and WIA application menusTAA and WIA application menus• Exploring menu optionsExploring menu options• Example scenariosExample scenarios• Questions?Questions?
3
Overview of the ToolOverview of the Tool
The Federal Research and Evaluation Database (FRED) The Federal Research and Evaluation Database (FRED) enables analysis of the Trade Act Participant Report (TAPR) enables analysis of the Trade Act Participant Report (TAPR) and the WIA Standardized Record Data (WIASRD). Both are and the WIA Standardized Record Data (WIASRD). Both are annually submitted by states on exiters' demographic annually submitted by states on exiters' demographic characteristics, the services they received, and the outcomes characteristics, the services they received, and the outcomes they achieved after exit. they achieved after exit.
• Currently contains data on exiters from the PY04 WIASRD and Currently contains data on exiters from the PY04 WIASRD and FY05 TAPRFY05 TAPR
• Examine performance, caseload and program information from the Examine performance, caseload and program information from the national, regional, state and local levelsnational, regional, state and local levels
• Display trends in performance by quarter as well as the Display trends in performance by quarter as well as the characteristics of the exiter cohortcharacteristics of the exiter cohort
• Create comparison groups based on parameters set by the userCreate comparison groups based on parameters set by the user• Create cross-tabulation tables and correlationsCreate cross-tabulation tables and correlations
4
Data Elements or VariablesData Elements or Variables• Dependent variable (end-result or outcome)Dependent variable (end-result or outcome)• Independent variables (causal or predictor)Independent variables (causal or predictor)• Control or intervening variables (confounding)Control or intervening variables (confounding)• Types of variables (levels of measures)Types of variables (levels of measures)
– NominalNominal– OrdinalOrdinal– IntervalInterval– RatioRatio
Remember: The types of variables we choose determines the statistical Remember: The types of variables we choose determines the statistical procedures we use in the analyses.procedures we use in the analyses.
CategoricalCategorical
ScaleScale
The Use of Data Elements in FREDThe Use of Data Elements in FRED
5
Descriptive StatisticsDescriptive Statistics• Summary statistics on key variables
– Number, mean, minimum, maximum, standard deviation, percentiles
• Graphical techniques are often used to display distributions
• Cross-tabulations are used to describe the relationships between two or more variables
6
Go to http://www.fred-info.orgGo to http://www.fred-info.org
Application MenusApplication Menus
7
Accessing the WIA MenuAccessing the WIA Menu
8
Program Program Area Area
SpecificSpecific
Funding Funding Formula Formula SpecificSpecific
Accessing the WIA MenuAccessing the WIA Menu
9
14
Ap
plicati
on
s1
4 A
pp
licati
on
sWIA Program-Specific MenuWIA Program-Specific Menu
10
Accessing the TAA MenuAccessing the TAA Menu
11
10
Ap
plicati
on
s1
0 A
pp
licati
on
sAccessing the TAA MenuAccessing the TAA Menu
12
Drill down-all measuresDrill down-all measures
Drill down by measureDrill down by measure
Benchmark performance against peersBenchmark performance against peers
Create a performance adjustment model and worksheetCreate a performance adjustment model and worksheet
Calculated performance by rolling quartersCalculated performance by rolling quarters
Profiles by program areaProfiles by program area
Find the top performers for a given performance measureFind the top performers for a given performance measure
Ad hoc analysisAd hoc analysis
Commonly Used Menu OptionsCommonly Used Menu Options
13
This tool allows the user to drill down into This tool allows the user to drill down into program year and levels of program program year and levels of program administration to examine performance. administration to examine performance. The The All MeasuresAll Measures selection allows the selection allows the user to examine performance for all user to examine performance for all measurement groups at once. measurement groups at once.
Drill Down: All MeasuresDrill Down: All Measures
14
15
16
17
18
19
20
Focusing on a single measure at a time, this Focusing on a single measure at a time, this tool allows the user to drill down into program tool allows the user to drill down into program year and levels of program administration to year and levels of program administration to examine performance. The examine performance. The By MeasuresBy Measures selection allows the user to selection allows the user to examine the effect of client examine the effect of client characteristics and program characteristics and program services on a performance outcome. services on a performance outcome.
Drill Down: By MeasuresDrill Down: By Measures
21
22
23
24
25
26
27
28
Downloaded file is in a comma Downloaded file is in a comma separated value (CSV) formatseparated value (CSV) format
29
This tool allows the user to benchmark the This tool allows the user to benchmark the performance of a given state or local area performance of a given state or local area against the performance of other areas with against the performance of other areas with similar conditions. similar conditions.
Benchmark PerformanceBenchmark Performance
30
31
32
33
34
35
This tool allows the user to develop a This tool allows the user to develop a performance adjustment model to help in performance adjustment model to help in understanding the impacts of various understanding the impacts of various factors on performance at the state, factors on performance at the state, regional or national level. The model is regional or national level. The model is displayed as a worksheet. The user can displayed as a worksheet. The user can adjust the factors included in the adjust the factors included in the worksheet on-line to explore the worksheet on-line to explore the impacts resulting from changes in customer characteristics, impacts resulting from changes in customer characteristics, program services, and economic conditions. program services, and economic conditions.
Adjustment ModelAdjustment Model
36
37
38
39
40
This link This link provides provides
detailed results detailed results from the from the
regression regression procedure, procedure, including including
correlation correlation coefficients. coefficients.
41
This tool allows the user to analyze This tool allows the user to analyze performance trends that reflect a four quarter performance trends that reflect a four quarter average. Looking at a year’s worth of data average. Looking at a year’s worth of data each quarter removes cyclical quarter each quarter removes cyclical quarter to quarter fluctuations to more clearly to quarter fluctuations to more clearly see overall performance trends.see overall performance trends.
Performance by Rolling QuartersPerformance by Rolling Quarters
42
43
44
45
46
This tool allows the user to display customer This tool allows the user to display customer and program service profiles by funding and program service profiles by funding stream during a given program year. Profiles stream during a given program year. Profiles may also be created to reflect national, may also be created to reflect national, regional, state or LWIA regional, state or LWIA characteristics. characteristics.
Area ProfilesArea Profiles
47
48
49
50
51
This tool allows the user to display the top This tool allows the user to display the top performing state or local area for a given performing state or local area for a given performance measure and a specific customer performance measure and a specific customer characteristic. characteristic.
Top PerformersTop Performers
52
53
54
55
56
This tool allows the user to choose the This tool allows the user to choose the combination of variables of interest to combination of variables of interest to create and display cross-tabulation tables. create and display cross-tabulation tables. The user can also The user can also display the results by a display the results by a third variable of interest.third variable of interest.
Ad Hoc AnalysisAd Hoc Analysis
57
58
59
60
61
ETA’s Performance and Results Web PageETA’s Performance and Results Web Pagehttp://www.doleta.gov/performance/http://www.doleta.gov/performance/
ETA’s Administrative Data Research and ETA’s Administrative Data Research and Evaluation (ADARE) ProjectEvaluation (ADARE) Project
WebsiteWebsitehttp://www.ubalt.edu/jfi/adare/partners/maryland.htmhttp://www.ubalt.edu/jfi/adare/partners/maryland.htm
For More InformationFor More Information