09/12/2003 CCAQS Data Management System 1

Central California Air Quality Studies Central California Air Quality Studies Data Management SystemData Management System

Status Report to the

Study Agency Policy Committee

Sept. 12, 2003

09/12/2003 CCAQS Data Management System 2

Database Contents CCOS Records CRPAQS Records

CCOS 97 % of data available SIP Support

CRPAQS 90 % of data available Data Analysis Support

Outstanding Issues

Current StatusCurrent Status

09/12/2003 CCAQS Data Management System 3

Remote Data Access Very Important

Most Frequently Missing Data… e.g. Documentation & “Supporting Information” Consequences:

Supporting data become unavailable Results in questionable data points

Post Field Study Documentation Difficult Associated Loss of ValueValue $ 0.30-40/ Record

Design Based on Past ExperienceDesign Based on Past Experience

09/12/2003 CCAQS Data Management System 4

System to Store All Valuable Info: “Place” for Everything Collected e.g. Instruments & Methods (Field or Lab)

Rigid Data Submittal Standards Collect Info Up Front in Field Data Submittals Screen Incoming Files Automate Quality Assurance Automate Data Validation from Analysts

Address User Needs Up Front Bring User Input Into Design Phase Limit Standard Output Formats Allow Ad-Hoc Requests via Web Interface

““Value-Based Design”Value-Based Design”

09/12/2003 CCAQS Data Management System 5

“Methods & Instruments”

Example of Relational DatabaseExample of Relational Database

09/12/2003 CCAQS Data Management System 6

File Structures &

Internal Processing

File Structures &

Internal ProcessingData Input

Data Input

Data Output

Data Output

Data ProcessingData Processing

09/12/2003 CCAQS Data Management System 7

CCAQS vs. SARMAP

CCAQS SARMAP

Data Sources 16 11

# Records 130 Million 4-5 Million

# Days 430 60

ChallengesChallenges

09/12/2003 CCAQS Data Management System 8

StandardsStandards Development Required Iterative Process

Input – Data Submittal From Contractors Data Processing

Output – Data Delivery to Clients

More Time and Effort Than Anticipated BenefitBenefit - Sponsors Will Realize Maximum Sponsors Will Realize Maximum

Value for Data Analysis and Modeling Value for Data Analysis and Modeling PurposesPurposes

ChallengesChallenges

09/12/2003 CCAQS Data Management System 9

www.arb.ca.gov/airways/ccaqs.htm