Bradley Evans SPEDDEXES 2014

What is SPEDDEXES?Brad Evans

Housekeeping

Who is a registered NCI user?

http://nci.org.au/access/user-registration/register-new-user/

http://nci.org.au/access/user-registration/connect-to-existing-project/

SPatially Explicit Data Discovery, EXtraction and Evaluation Service

SPATIALLY and temporally EXPLICIT research data infrastructure to interrogate data streams on the National Computing Infrastructure

DATA DISCOVERY for TERN or any datasets which can be read by the platform

EXTRACTION AND EVALUATION drives advances in ecosystem science, impact assessment and land management

Technology?

• It’s a TOOL, a software API • Runs in the cloud

• Open source, community owned

• Connects to OpenDAP, AGDC, AODAAC, ERDDAP ? Whatever we connect it too!• Provides a common API for multiple data streams

• Serves “Extractions” or “Summaries” of data• Spatially and temporally explicit queries

• Data discoverers via map servers• HPC users (i.e. modellers & scientists)

Conceptually…

Example

You are an ecosystem scientist, unashamedly multi-disciplinary, and you have a research question.

What is the impact of a tropical cyclone on a regions carbon cycle?

You need to spatially and temporally analyze several datasets (in this real-life example the entire AusCover MODIS archive!)

Motivation…

Tree damage maps – estimate coarse woody debris

Tree damage maps – estimate coarse woody debris

Monitoring transects

Monica : Impact on productivity?GPP MOD17A2 - Seasonal Trend filter

Stats: R-Project STL package

Monica

SteveHelen

That’s nothing new!

• But without the SPEDDEXES API, you would:• Run on your desktop (most likely)

• Possibly not share the code

• Highly likely you WOULD NOT write your code to connect to n servers or API’s• You would have to write a script/ tool for each server!

• Possibly not share the code

• Possibly explore less data – OR WORSE!• NOT use spatially explicit queries or analysis

• OR Download EVERYTHING first, then analyze 5% of it !• Clog up the HPC with 95% unused data for YEARS

• until you publish your results and share the code

• Who cares?

Somewhat correct…

SCIENTISTSSPEDDEXES = LESS GHG’s

= BETTER, GREENER SCIENCE

Scientists will evolve!

Scientists will evolve!

Scientists will evolve!

Scientists will evolve!

Scientists will evolve!

Scientists will evolve!

Agenda

• Today• Listen to the experts

• Form our community vision on how to make it

• Tuesday, Wednesday, Thursday• Discuss, hack, review, test & commit• Enjoy each others company

• Friday• Publish• Agree on our next steps

• As a community

• Go home

Contemplate, discuss, hack, publish, go home