Some thoughts ondata, software and tools

and who knows how to do what

Rhys Francis

Executive DirectorThe Australian eResearch Infrastructure Council

eResearch capability in 2014…

Dozens of virtualised research tools and applications

- In use and shared by many researchers

A peta scale national research cloud

Labs using digital work flows

Increased connectivity and bandwidth

Single Sign On, High reliance services, High reliability servers

Newdata centres

Peta scale systemsand software

New data products

Five fold growth in computing powerabove Moore’slaw

Datasystems

automated

Data repositories100’s of petabytesof storage capacity

Data publicationmade possible

A corpus of Australian

data

Infrastructure Elements – Push & PullInfrastructure Co-ordination

Better data management,description and access

Extended Bandwidth

Better HPCmodelling

Larger datacollections

Shared Access Methods

Improved research tools,environments and workflows

ResearchIntegration+ $144.5M

NationalCapabilities

+ $246M

NeCTAR

ANDS

Infrastructure – Major ChallengesInfrastructure Co-ordination

Better data management,description and access

Extended Bandwidth

Better HPCmodelling

Larger datacollections

Shared Access Methods

Improved research tools,environments and workflows

Research Outputs

- skills & expertise

- methods & techniques

- findings & results

Software

- Encode new research methods

- Create 'shoulders' for others to stand on

Data

- Allows us to research the real world

- Connects reality to experiment & theory

Expertise

- Operate world class infrastructure

- Provide skills and tools to researchers

To west coastUnited States

To Singapore

The Australian national e-infrastructure platform (2013)

Primary Node15 participants

Additional Node4 participants

Primary Node11 participantsPrimary Node

4 participants

Primary Node8 participants

Primary Node6 participants

Additional Node7 participants

Primary Node6 participants

Data 10-20 PB fast growing

Data 1-2 PB more focused

Network Nx100 Gb/s layer-1

Network 10 Gb/s layer-3

To west coastUnited States

To Singapore

The Australian national e-infrastructure platform (2013)

Primary Node15 participants

Additional Node4 participants

Primary Node11 participantsPrimary Node

4 participants

Primary Node8 participants

Primary Node6 participants

Additional Node7 participants

Primary Node6 participants

Cloud 50,000 concurrent tasks

Data 10-20 PB fast growing

Data 1-2 PB more focused

HPC > 1 Pf/s capability

HPC ~100 Tf/s specialised

Network Nx100 Gb/s layer-1

Network 10 Gb/s layer-3

To west coastUnited States

To Singapore

Primary Node15 participants

Additional Node4 participants

Primary Node11 participantsPrimary Node

4 participants

Primary Node8 participants

Primary Node6 participants

Additional Node7 participants

Primary Node6 participants

40 Software tools and laboratory integration projects250 Data improvement projects engaging all institutionsSingle sign-on for all researchers across the entire infrastructure

40 Software tools and laboratory integration projects250 Data improvement projects engaging all institutionsSingle sign-on for all researchers across the entire infrastructure

AstronomyGeoscienceAstronomyGeoscience

LifeScienceLifeScience

ClimateScienceClimateScience

Cloud 50,000 concurrent tasks

Data 10-20 PB fast growing

Data 1-2 PB more focused

HPC > 1 Pf/s capability

HPC ~100 Tf/s specialised

Network Nx100 Gb/s layer-1

Network 10 Gb/s layer-3

A national Research Data Commonsof published and accessible research data

A national Research Data Commonsof published and accessible research data

Some messages…

• MIND the GAPsvisions of data & tools | <gap> | reality

• Data and software as infrastructuredata => interpretation => people

• Four things to “Send to the Future” (results + expertise) + (data + software)

eResearch Infrastructure

We are here to help

Thank you