Making Energy Data
Accessible & Interoperable Framing Opportunities and Challenges for Open and Big Data
in Access, Renewables and Efficiency
Rob Bectel
Enabling Open Government
Open Government and Energy
Data Initiatives
Date
DOE issued press release to launch OpenEI
as its Open Government Initiative
12/09
DOE releases Open Government Plan,
which highlights OpenEI
4/10
OpenEI recognized by the White House as a
Flagship Open Government Initiative
4/10
OpenEI featured on White House
Innovations Gallery
1/11
White House Announces Energy Data
Initiative
5/12
OpenEI included in OMB Federal Digital
Strategy
8/12
OSTP Open Access Memo Issued to
Federal Agencies
2/13
Open Government Initiative & DOE Data
Catalog Federation with Data.gov
Today
Open Data Memo 1313
On May 9th, 2013, President Obama issued the executive order making “Open and Machine-Readable” the new default for government information.
Fundamentally transforms the way in which Federal Government creates, aggregates and manages data.
Find a clear set of instructions for what to do posted on the official Project Open Data website on GitHub - http://project-open-data.github.io/
Open Data Public Access Plan
The DOE proposes a model for ensuring public access to unclassified
scholarly publications that provides the public with access to the best
available version of the article via the Public Access Gateway for Energy
and Science (PAGES)
The Office of Energy Efficiency and Renewable Energy (EERE) will
ensure specific research data are submitted to the Open Energy
Information Platform (OpenEI).
This integration will include use of the Project Open
Data metadata schema to describe each dataset
supporting broader use and understanding of
information in private or non-profit sectors.
An Open Data Platform for DOE
Open Data Platform for DOE
Open Data Platform for the
Energy Community too!
An Open Data Platform for DOE
Wiki enables
crowdsourced data
contributions and
information
development
An Open Data Platform for DOE
Community enables
energy data
conversations and builds
the user base
An Open Data Platform for DOE
Datasets allows
open data
uploads, access,
and data
provenance.
Built using:
An Open Data Platform for DOE
Enabling Access & Provenance
DOE Program Data Repositories
Secure data
Open Data Success #1: GDR Data
• Collects, manages, curates, data from
DOE-funded geothermal projects
• Metadata provided to the public
immediately to support transparency
• DOI numbers assigned via
connection with the Office of
Scientific and Technical Information
(OSTI)
• Federates to the National
Geothermal Data System, Data.gov
and others!
1,193 publicly accessible resources
from 322 submissions, downloaded
~1,100 times per year by academia,
industry, labs, researchers and DOE.
Holds data secure until data is
ready to be released
Open Data Success #2 - Utility Rate Database
Who uses the database/API? • ~50% solar industry/consultants
• ~30% researchers
Solar companies/consultants/software
developers pulling URDB data:
• Deloitte
• PSD Consulting
• Conservation
Services Group
• Bluewave Capital
• EcoLogic
• BrightBox
• Energy Periscope
• Lightwave Solar
• CentroSolar
• Renewable Energy
Advisors
System Advisor Model (SAM)
Open Data Success #3: SunShot Catalyst Teams
PVimpact
Clearly Energy
Open Data Success #4: AFDC Station Data
• Alternative Fuel Station Locator:
provides alternative fuels station data in
both human and machine readable
formats.
• Mobile application is available!
• The API is being used by:
• General Motors
• KIA
• Volkswagen
• Chevy Spark
• EPA
• FAST
• MapQuest
• OnStar
• DOT
• National Park Service 2.6M views/web calls annually
Vehicle Technologies Office Sponsored
Open Data Success #5: Green
Button
Three years to go from zero customers with standardized access to 60M customers.
Public-Private partnership with White House, DOE, DOC(NIST), utilities, industry vendors, third party analytics companies and innovators.
About 100 applications and software services for homes and businesses built or compatible with Green Button data. Growing through new industry Green Button Alliance and DOE challenges.
Conclusion
Accessible
Understandable
More data is better
Data use cases will surprise you
Encourage data reuse
Data provenance is important
Transparent
Empower entrepreneurs Web services Contribute yours
Build on others data
Power in numbers