Florida Education Data Warehouse Project Overview Feb 26th, 2001

Florida Education Data Warehouse

Project Overview Feb 26th , 2001

2

AgendaAgenda

1

2

4

Background

3

Targeted Content

6

5

Technical Aspects

High-Level Plan

Challenges

For more information

1Project Background and Goals

4

A normal day in the education fieldA normal day in the education field

What happened in

previous year ?

Where and how can we

improve Education in Florida?

What’s going to

happen in the future ?

Did we make the right/best decision?

Hi, I’m a researcher looking for infomation

on...

How does that compare to what was expected to happen this year (last year)?

What’s happening right now ?

5

Current EnvironmentCurrent Environment

Operational systems isolated

by business functions

Limited data readily

available

Various data and technical architectures

Users support

Lack of reliable, consistent data across

delivery systems

Technical barriers

No Pre K-20data

integration

6

Proposed K-20 Proposed K-20 Performance/Accountability SystemPerformance/Accountability System

How are individual higher education institutions, school districts and schools performing their responsibility to

educate their students?

How are the major delivery systems

performing (K-12, CC, SUS)?

How is Florida’s K-20 system performing in terms of educating its students?

What is the public getting for the funds invested in Education?

7

The objectivesThe objectives

Complete, timely,

accurate data

Comprehensive data definitions

Data from multiple sources and

organizations

Easy access and

manipulation

Cross-functional data management and support

group

Historical data merged with current in a

structured repository

Integrated technical

environment

Statewide view

8

Our MissionOur Mission

Provide stakeholders in public Provide stakeholders in public education - including, but not limitededucation - including, but not limitedto, administrators, educators, parents,to, administrators, educators, parents,

students, state leadership, and students, state leadership, and professional organizations - professional organizations -

with the capability of receiving with the capability of receivingtimely, efficient, consistent responses to timely, efficient, consistent responses to inquiries into Florida’s pre-kindergarteninquiries into Florida’s pre-kindergarten

through university education system through university education system by December 2002.by December 2002.

9

Collaborative development effort with

Department of Education State Board of Community Colleges State University System DMR Consulting

Built in increments (phases)

Project Unique CharacteristicsProject Unique Characteristics

10

Includes all functional parts of the education delivery system K-20

School districts Community colleges State universities

Statewide picture

Historical and current data

Over a 2 year period…we’re just beginning

Project Unique CharacteristicsProject Unique Characteristics

11

A wide array of usersA wide array of users

School DistrictsState

Universities

Community Colleges

ReportersMediaEducation Community

StudentsTeachersParents

LegislaturePoliticians

Researchers

2Targeted content of the EDW

13

From Pre K-12From Pre K-12

EDW Central Repository and Datamarts (Current year + 5)

- 2,376,128 students (1999)- 10 years of data - Demographic - Course/Program - Funding

Staff source data- 268,983 FTS (1999)- 10 years of data - Demographic - Salary/Benefits - Experience - Degrees - In Service - Job Codes (4 times/ year)

Selection Process

End of Year discipline,retention/ promotion, dropout, graduate/completer Incidents of crime and violence

(6 times/Year)

Students source data

14

Staff source data- 56,400 empl. (1999)- 10 years of data - Demographic - Salary - Benefits - Course Schedule - Employment Activities - Instruction Activities - Reassignments(3 submissions / year)

From Community CollegesFrom Community Colleges

EDW Central Repository and Datamarts (Current year + 5)

Students source data- 717,561 students (1999)- 10 years+ of data - Demographic - Entry/Exit testing - Acceleration placement - Courses/Programs - Programs - Completion - Financial aid ( 5 submissions / Year)

Facilities- 156 Sites- 2,219 Facilities- 64,000 rooms

Selection Process

(+ 1 annual submission)

15

From State University SystemFrom State University System

EDW Central Repository and Datamarts (Current year + 5)

Students Source Data- 234,016 students (1999)- 25 years+ of data - Demographic - Admission - Acceleration placement - Courses/grades/credits - Discipline/ academic history - Stipends/waivers/fellows - Financial aid ( 5 times / Year)

Staff Source Data- 33,552 empl. (1999)- 10 years of data - Demographic - Salary/Benefits… - Classification... - Appointm. period - Employ./ Instruc. Activities -Rank / Tenure(26 times / year)

Facilities- Sites- Facilities- Rooms

Selection Process

16

A complex integration processA complex integration process

EDW Central Repository and Datamarts (Current year + 5)

Identify / MatchReconcile

CleanSynchronize

Integrate

Department ofEducation data

(Pre K-12)

Community Collegedata

State Universitydata

3High level plan

18

High Level High Level Schedule (Schedule (work in progress)work in progress)

Final Design

Release 1Prototype

PreliminaryDesign

Release 2

Release 3

Release 4

Ongoing

June 2001

Dec. 2001

June 2002

Dec. 2002

Target: 1 release every 6 months

4Technical aspects

20

Generic InfrastructureGeneric Infrastructure

DB2, OracleSQL-Server

VSAM, SAM,

Sequential

Access to source dataAccess to source data

Transform& load

Data transformation & integrationData transformation & integration

Data Warehouse

Pre-formatted Query/reports OLAP

Store

Access

Data movementData movement

Metadata & DW

management tools

Extract

Specialized Data Marts

Web tools / portal (Web-DB)

ARDENT TOOLS(Datastage)

ORACLE ToolsStorage & Access

Access,Dbase, Foxpro

21

Technical environmentTechnical environment

MainframeData Source

Ethernet

Internet

Ethernet

Data SourceServers Standard

Users

OC-3100-

155Mbps

Sun 10000Data SourceData Target

199.250.30.78

STO

} DMZEthernet

Outside WorldUsers

DOE

NWRDC

Data SourceServers

DevelopmentApplication

ServerDevelopers

Ethernet

Montreal

Developers

WebUsers

VPN

Cisco Pix 520Novell ICS

v1.2.05

Cisco Pix

HighlightsSun 10000UnixOracle 8i to 9ArdentOr-WebDBOr-DiscovererOr-Express4 terabytes

4Challenges

23

Management ChallengesManagement Challenges

Reconcile various missions and objectives ofagencies involved

Agencies’ involvement,

collaboration,synergy

ManageScope and

Expectations Budget and time boxing

Data Warehouseorganizational

issues

Communication

24

Technical ChallengesTechnical Challenges

Reconcile Current and

Historical Data

Common-ID

Tools Integration

DataQuality

Size of theData Warehouse

Multiplesites/platforms

Privacy and Security

25

Utilization ChallengesUtilization Challenges

Usersupport and

training

Data & DWMastering

Metadata (comprehensive

dictionary)gathering

New Toolsto learn

User Friendliness

Trust theDW results

6Who to contact….

27

Karen Weaver: weaverk@mail.doe.state.fl.us Bernard Sévigny: bernard_sevigny@dmr.ca Kim McDougal: kim.mcdougal@laspbs.state.fl.us Kathy Peck: Peckk@mail.doe.state.fl.us Robert McMullen: robert@flccs.org Shirley Roddenbery: roddens@borfl.org

DOE Internet site: http://www.firn.edu/doe/bin00050/dataweb/database.htm SBCC Internet site: http://www.dcc.firn.edu SUS Internet site: http://www.borfl.org/irm/default.asp Transition Task Force Internet site:

Contact Names and E-mail Contact Names and E-mail AddressesAddresses

http://www.myflorida.com/myflorida/education/learn/egrt_taskforce/index.html