U.S. Department of Labor Employment and Training Administration 1 Data Mining Using the Federal...

U.S. Department of LaborU.S. Department of Labor

Employment and Employment and Training AdministrationTraining Administration

1

Data Mining Using Data Mining Using the Federal the Federal

Research and Research and Evaluation Evaluation DatabaseDatabase

Describe

Explain

Predict

2

AgendaAgenda

• Overview of the toolOverview of the tool• The basics of data analysisThe basics of data analysis• TAA and WIA application menusTAA and WIA application menus• Exploring menu optionsExploring menu options• Example scenariosExample scenarios• Questions?Questions?

3

Overview of the ToolOverview of the Tool

The Federal Research and Evaluation Database (FRED) The Federal Research and Evaluation Database (FRED) enables analysis of the Trade Act Participant Report (TAPR) enables analysis of the Trade Act Participant Report (TAPR) and the WIA Standardized Record Data (WIASRD). Both are and the WIA Standardized Record Data (WIASRD). Both are annually submitted by states on exiters' demographic annually submitted by states on exiters' demographic characteristics, the services they received, and the outcomes characteristics, the services they received, and the outcomes they achieved after exit. they achieved after exit.

• Currently contains data on exiters from the PY04 WIASRD and Currently contains data on exiters from the PY04 WIASRD and FY05 TAPRFY05 TAPR

• Examine performance, caseload and program information from the Examine performance, caseload and program information from the national, regional, state and local levelsnational, regional, state and local levels

• Display trends in performance by quarter as well as the Display trends in performance by quarter as well as the characteristics of the exiter cohortcharacteristics of the exiter cohort

• Create comparison groups based on parameters set by the userCreate comparison groups based on parameters set by the user• Create cross-tabulation tables and correlationsCreate cross-tabulation tables and correlations

4

Data Elements or VariablesData Elements or Variables• Dependent variable (end-result or outcome)Dependent variable (end-result or outcome)• Independent variables (causal or predictor)Independent variables (causal or predictor)• Control or intervening variables (confounding)Control or intervening variables (confounding)• Types of variables (levels of measures)Types of variables (levels of measures)

– NominalNominal– OrdinalOrdinal– IntervalInterval– RatioRatio

Remember: The types of variables we choose determines the statistical Remember: The types of variables we choose determines the statistical procedures we use in the analyses.procedures we use in the analyses.

CategoricalCategorical

ScaleScale

The Use of Data Elements in FREDThe Use of Data Elements in FRED

5

Descriptive StatisticsDescriptive Statistics• Summary statistics on key variables

– Number, mean, minimum, maximum, standard deviation, percentiles

• Graphical techniques are often used to display distributions

• Cross-tabulations are used to describe the relationships between two or more variables

6

Go to http://www.fred-info.orgGo to http://www.fred-info.org

Application MenusApplication Menus

7

Accessing the WIA MenuAccessing the WIA Menu

8

Program Program Area Area

SpecificSpecific

Funding Funding Formula Formula SpecificSpecific

Accessing the WIA MenuAccessing the WIA Menu

9

14

Ap

plicati

on

s1

4 A

pp

licati

on

sWIA Program-Specific MenuWIA Program-Specific Menu

10

Accessing the TAA MenuAccessing the TAA Menu

11

10

Ap

plicati

on

s1

0 A

pp

licati

on

sAccessing the TAA MenuAccessing the TAA Menu

12

Drill down-all measuresDrill down-all measures

Drill down by measureDrill down by measure

Benchmark performance against peersBenchmark performance against peers

Create a performance adjustment model and worksheetCreate a performance adjustment model and worksheet

Calculated performance by rolling quartersCalculated performance by rolling quarters

Profiles by program areaProfiles by program area

Find the top performers for a given performance measureFind the top performers for a given performance measure

Ad hoc analysisAd hoc analysis

Commonly Used Menu OptionsCommonly Used Menu Options

13

This tool allows the user to drill down into This tool allows the user to drill down into program year and levels of program program year and levels of program administration to examine performance. administration to examine performance. The The All MeasuresAll Measures selection allows the selection allows the user to examine performance for all user to examine performance for all measurement groups at once. measurement groups at once.

Drill Down: All MeasuresDrill Down: All Measures

14

15

16

17

18

19

20

Focusing on a single measure at a time, this Focusing on a single measure at a time, this tool allows the user to drill down into program tool allows the user to drill down into program year and levels of program administration to year and levels of program administration to examine performance. The examine performance. The By MeasuresBy Measures selection allows the user to selection allows the user to examine the effect of client examine the effect of client characteristics and program characteristics and program services on a performance outcome. services on a performance outcome.

Drill Down: By MeasuresDrill Down: By Measures

21

22

23

24

25

26

27

28

Downloaded file is in a comma Downloaded file is in a comma separated value (CSV) formatseparated value (CSV) format

29

This tool allows the user to benchmark the This tool allows the user to benchmark the performance of a given state or local area performance of a given state or local area against the performance of other areas with against the performance of other areas with similar conditions. similar conditions.

Benchmark PerformanceBenchmark Performance

30

31

32

33

34

35

This tool allows the user to develop a This tool allows the user to develop a performance adjustment model to help in performance adjustment model to help in understanding the impacts of various understanding the impacts of various factors on performance at the state, factors on performance at the state, regional or national level. The model is regional or national level. The model is displayed as a worksheet. The user can displayed as a worksheet. The user can adjust the factors included in the adjust the factors included in the worksheet on-line to explore the worksheet on-line to explore the impacts resulting from changes in customer characteristics, impacts resulting from changes in customer characteristics, program services, and economic conditions. program services, and economic conditions.

Adjustment ModelAdjustment Model

36

37

38

39

40

This link This link provides provides

detailed results detailed results from the from the

regression regression procedure, procedure, including including

correlation correlation coefficients. coefficients.

41

This tool allows the user to analyze This tool allows the user to analyze performance trends that reflect a four quarter performance trends that reflect a four quarter average. Looking at a year’s worth of data average. Looking at a year’s worth of data each quarter removes cyclical quarter each quarter removes cyclical quarter to quarter fluctuations to more clearly to quarter fluctuations to more clearly see overall performance trends.see overall performance trends.

Performance by Rolling QuartersPerformance by Rolling Quarters

42

43

44

45

46

This tool allows the user to display customer This tool allows the user to display customer and program service profiles by funding and program service profiles by funding stream during a given program year. Profiles stream during a given program year. Profiles may also be created to reflect national, may also be created to reflect national, regional, state or LWIA regional, state or LWIA characteristics. characteristics.

Area ProfilesArea Profiles

47

48

49

50

51

This tool allows the user to display the top This tool allows the user to display the top performing state or local area for a given performing state or local area for a given performance measure and a specific customer performance measure and a specific customer characteristic. characteristic.

Top PerformersTop Performers

52

53

54

55

56

This tool allows the user to choose the This tool allows the user to choose the combination of variables of interest to combination of variables of interest to create and display cross-tabulation tables. create and display cross-tabulation tables. The user can also The user can also display the results by a display the results by a third variable of interest.third variable of interest.

Ad Hoc AnalysisAd Hoc Analysis

57

58

59

60

61

ETA’s Performance and Results Web PageETA’s Performance and Results Web Pagehttp://www.doleta.gov/performance/http://www.doleta.gov/performance/

ETA’s Administrative Data Research and ETA’s Administrative Data Research and Evaluation (ADARE) ProjectEvaluation (ADARE) Project

WebsiteWebsitehttp://www.ubalt.edu/jfi/adare/partners/maryland.htmhttp://www.ubalt.edu/jfi/adare/partners/maryland.htm

For More InformationFor More Information