36
OpenDreamKit: an introduction Nicolas M. Thi´ ery April 25, 2017 Nicolas M. Thi´ ery: OpenDreamKit: an introduction 1 April 25, 2017

OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

OpenDreamKit: an introduction

Nicolas M. Thiery

April 25, 2017

Nicolas M. Thiery: OpenDreamKit: an introduction 1 April 25, 2017

Page 2: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Some fundamental trends

Nicolas M. Thiery: OpenDreamKit: an introduction 2 April 25, 2017

Page 3: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Long standing and booming role of computers in puremathematics

I Computer exploration to discover and check conjectures

I Assisted, certified, mechanized proofs: CoQ, Isabelle, ...

I Collaborative work: Wikipedia, Polymath, ...

I Mathematical Knowledge Management

I Education

Nicolas M. Thiery: OpenDreamKit: an introduction 3 April 25, 2017

Page 4: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Open Science getting momentum

“Open science is the movement to make scientific research, data anddissemination accessible to all levels of an inquiring society, amateur orprofessional”

I Open Knowledge (Access, Educational Resources)

I Open Source or, better, Free Software

I Open Data

I Open Peer Review, Methodology, ...

I At the heart of the scientific method for centuriesno reproducibility without it

I Finally getting recognition as viable and necessary,even by funding agencies!

Nicolas M. Thiery: OpenDreamKit: an introduction 4 April 25, 2017

Page 5: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Open Science getting momentum

“Open science is the movement to make scientific research, data anddissemination accessible to all levels of an inquiring society, amateur orprofessional”

I Open Knowledge (Access, Educational Resources)

I Open Source or, better, Free Software

I Open Data

I Open Peer Review, Methodology, ...

I At the heart of the scientific method for centuriesno reproducibility without it

I Finally getting recognition as viable and necessary,even by funding agencies!

Nicolas M. Thiery: OpenDreamKit: an introduction 4 April 25, 2017

Page 6: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Emergence of a vibrant ecosystem of free software for puremathematics

I Specialized systems: LinBox, PARI/GP, MPIR, Singular, . . .

I General purpose systems: GAP, SageMath, . . .

I Online databases: OEIS, LMFDB, . . .

I Interactive computing environments:Jupyter, SageMathCloud, . . .

I Together with the wider Scientific Python ecosystem

Viable alternatives to Maple, Mathematica, Matlab,. . .

For research and education (and the industry?)

Nicolas M. Thiery: OpenDreamKit: an introduction 5 April 25, 2017

Page 7: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Emergence of a vibrant ecosystem of free software for puremathematics

I Specialized systems: LinBox, PARI/GP, MPIR, Singular, . . .

I General purpose systems: GAP, SageMath, . . .

I Online databases: OEIS, LMFDB, . . .

I Interactive computing environments:Jupyter, SageMathCloud, . . .

I Together with the wider Scientific Python ecosystem

Viable alternatives to Maple, Mathematica, Matlab,. . .

For research and education (and the industry?)

Nicolas M. Thiery: OpenDreamKit: an introduction 5 April 25, 2017

Page 8: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Virtual Research Environments (VRE): the next frontier?

H2020 European Research Infrastructures Work Programme

“Groups of researchers, typically widely dispersed who are workingtogether through ubiquitous, trusted and easy access to services forscientific data, computing, and networking, in a collaborative virtualenvironment“

A useful VRE for mathematics?

Nicolas M. Thiery: OpenDreamKit: an introduction 6 April 25, 2017

Page 9: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Mathematicians are already immersed in many VREs

Nicolas M. Thiery: OpenDreamKit: an introduction 7 April 25, 2017

Page 10: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

A workflow based VRE?

The Virtual Observatory: a VRE for astronomy

Could cover only a fragment of mathematics

Nicolas M. Thiery: OpenDreamKit: an introduction 8 April 25, 2017

Page 11: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

A workflow based VRE?

The Virtual Observatory: a VRE for astronomy

Could cover only a fragment of mathematicsNicolas M. Thiery: OpenDreamKit: an introduction 8 April 25, 2017

Page 12: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Our requirements

I Support a large area of pure mathematics

I Support a large range of users

I Support best practices for scientific computationsI Support a large range of scales:

I A single person installation on a laptopI A collaborative VRE between three researchers, running on their lab’s serverI A university wide VRE for teachingI A service provided by a grid infrastructure

I Sustainable

I Open Source

Just a dream?

Nicolas M. Thiery: OpenDreamKit: an introduction 9 April 25, 2017

Page 13: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Our requirements

I Support a large area of pure mathematics

I Support a large range of users

I Support best practices for scientific computationsI Support a large range of scales:

I A single person installation on a laptopI A collaborative VRE between three researchers, running on their lab’s serverI A university wide VRE for teachingI A service provided by a grid infrastructure

I Sustainable

I Open Source

Just a dream?

Nicolas M. Thiery: OpenDreamKit: an introduction 9 April 25, 2017

Page 14: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Our requirements

I Support a large area of pure mathematics

I Support a large range of users

I Support best practices for scientific computations

I Support a large range of scales:I A single person installation on a laptopI A collaborative VRE between three researchers, running on their lab’s serverI A university wide VRE for teachingI A service provided by a grid infrastructure

I Sustainable

I Open Source

Just a dream?

Nicolas M. Thiery: OpenDreamKit: an introduction 9 April 25, 2017

Page 15: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Our requirements

I Support a large area of pure mathematics

I Support a large range of users

I Support best practices for scientific computationsI Support a large range of scales:

I A single person installation on a laptopI A collaborative VRE between three researchers, running on their lab’s serverI A university wide VRE for teachingI A service provided by a grid infrastructure

I Sustainable

I Open Source

Just a dream?

Nicolas M. Thiery: OpenDreamKit: an introduction 9 April 25, 2017

Page 16: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Our requirements

I Support a large area of pure mathematics

I Support a large range of users

I Support best practices for scientific computationsI Support a large range of scales:

I A single person installation on a laptopI A collaborative VRE between three researchers, running on their lab’s serverI A university wide VRE for teachingI A service provided by a grid infrastructure

I Sustainable

I Open Source

Just a dream?

Nicolas M. Thiery: OpenDreamKit: an introduction 9 April 25, 2017

Page 17: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Our requirements

I Support a large area of pure mathematics

I Support a large range of users

I Support best practices for scientific computationsI Support a large range of scales:

I A single person installation on a laptopI A collaborative VRE between three researchers, running on their lab’s serverI A university wide VRE for teachingI A service provided by a grid infrastructure

I Sustainable

I Open Source

Just a dream?

Nicolas M. Thiery: OpenDreamKit: an introduction 9 April 25, 2017

Page 18: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Our requirements

I Support a large area of pure mathematics

I Support a large range of users

I Support best practices for scientific computationsI Support a large range of scales:

I A single person installation on a laptopI A collaborative VRE between three researchers, running on their lab’s serverI A university wide VRE for teachingI A service provided by a grid infrastructure

I Sustainable

I Open Source

Just a dream?

Nicolas M. Thiery: OpenDreamKit: an introduction 9 April 25, 2017

Page 19: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

OpenDreamKit’s proposal

Nicolas M. Thiery: OpenDreamKit: an introduction 10 April 25, 2017

Page 20: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

OpenDreamKit’s proposal

I Deliver a VRE Toolkit for Mathematics

I From the ecosystem of open source software for mathematics

I And the Jupyter interactive computing environment

Nicolas M. Thiery: OpenDreamKit: an introduction 11 April 25, 2017

Page 21: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

The Jupyter interactive computing environment

Nicolas M. Thiery: OpenDreamKit: an introduction 12 April 25, 2017

Page 22: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Proof of concepts VREs built from the same ecosystem

SageMathCloud

I A web service launched in 2013

I Widely adopted

I For teaching, for research

Simulagora, tmpnb, mybinder, ...

Prove that

I The ecosystem is mature

I This kind of VRE fulfills a strong need

Nicolas M. Thiery: OpenDreamKit: an introduction 13 April 25, 2017

Page 23: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Proof of concepts VREs built from the same ecosystem

SageMathCloud

I A web service launched in 2013

I Widely adopted

I For teaching, for research

Simulagora, tmpnb, mybinder, ...

Prove that

I The ecosystem is mature

I This kind of VRE fulfills a strong need

Nicolas M. Thiery: OpenDreamKit: an introduction 13 April 25, 2017

Page 24: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Proof of concepts VREs built from the same ecosystem

SageMathCloud

I A web service launched in 2013

I Widely adopted

I For teaching, for research

Simulagora, tmpnb, mybinder, ...

Prove that

I The ecosystem is mature

I This kind of VRE fulfills a strong need

Nicolas M. Thiery: OpenDreamKit: an introduction 13 April 25, 2017

Page 25: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Added values of our approach

I Modular

I Joining forces with the wider scientific computing community

I Sustainable

I Lowers the software barrier between pure and applied maths

I Impact way beyond pure maths

Nicolas M. Thiery: OpenDreamKit: an introduction 14 April 25, 2017

Page 26: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Added values of our approach

I Modular

I Joining forces with the wider scientific computing community

I Sustainable

I Lowers the software barrier between pure and applied maths

I Impact way beyond pure maths

Nicolas M. Thiery: OpenDreamKit: an introduction 14 April 25, 2017

Page 27: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Added values of our approach

I Modular

I Joining forces with the wider scientific computing community

I Sustainable

I Lowers the software barrier between pure and applied maths

I Impact way beyond pure maths

Nicolas M. Thiery: OpenDreamKit: an introduction 14 April 25, 2017

Page 28: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Added values of our approach

I Modular

I Joining forces with the wider scientific computing community

I Sustainable

I Lowers the software barrier between pure and applied maths

I Impact way beyond pure maths

Nicolas M. Thiery: OpenDreamKit: an introduction 14 April 25, 2017

Page 29: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Added values of our approach

I Modular

I Joining forces with the wider scientific computing community

I Sustainable

I Lowers the software barrier between pure and applied maths

I Impact way beyond pure maths

Nicolas M. Thiery: OpenDreamKit: an introduction 14 April 25, 2017

Page 30: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Open Digital Research Environment Toolkit for theAdvancement of Mathematics

I OpenDreamKit.org

I H2020 European Research Infrastructures Work ProgrammeCall: Virtual Research Environments

I Budget: 7.6Me

I 18 sites, 50 participants

I In close collaboration with the international community!

Nicolas M. Thiery: OpenDreamKit: an introduction 15 April 25, 2017

Page 31: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

A user-driven consortiumEuropean power users and core developers of the ecosystem of open source software forMathematics:

I GAP (St Andrews, Oxford)I Linbox (Grenoble)I PARI/GP (Bordeaux, Versailles)I SageMath (Bordeaux, Grenoble, Paris Sud, Oxford, Versailles)I Singular (Kaiserslautern)I LMFDB (Warwick, Zurich)I MathHub, MMT/OpenMath (Bremen)I Jupyter (Simula)I Scientific Python (SouthHampton, Sheffield, Silesia)

Supported by:

I Research Software Engineers

I An open source based company (Logilab)

Nicolas M. Thiery: OpenDreamKit: an introduction 16 April 25, 2017

Page 32: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

A user-driven consortiumEuropean power users and core developers of the ecosystem of open source software forMathematics:

I GAP (St Andrews, Oxford)I Linbox (Grenoble)I PARI/GP (Bordeaux, Versailles)I SageMath (Bordeaux, Grenoble, Paris Sud, Oxford, Versailles)I Singular (Kaiserslautern)I LMFDB (Warwick, Zurich)I MathHub, MMT/OpenMath (Bremen)I Jupyter (Simula)I Scientific Python (SouthHampton, Sheffield, Silesia)

Supported by:

I Research Software Engineers

I An open source based company (Logilab)

Nicolas M. Thiery: OpenDreamKit: an introduction 16 April 25, 2017

Page 33: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Open from the ground up

I Free software

I Open data

I Open source publications

I Open proposal!

Nicolas M. Thiery: OpenDreamKit: an introduction 17 April 25, 2017

Page 34: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

Open from the ground up

I Free software

I Open data

I Open source publications

I Open proposal!

Nicolas M. Thiery: OpenDreamKit: an introduction 17 April 25, 2017

Page 35: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

OpenDreamKit’s aims

I Improve the productivity of researchers in pure mathematics andapplications by further promoting collaborations on Data, Knowledge,and Software

I Make it easy for teams of researchers of any size to set up custom,collaborative Virtual Research Environments tailored to their specificneeds, resources and workflows

I Support the entire life-cycle of computational work in mathematicalresearch, from initial exploration to publication, teaching, andoutreach

Nicolas M. Thiery: OpenDreamKit: an introduction 18 April 25, 2017

Page 36: OpenDreamKit: an introduction · OpenDreamKit: an introduction Nicolas M. Thi ery April 25, 2017 Nicolas M. Thi ery: OpenDreamKit: an introduction 1 April 25, 2017

How to get there?

Nicolas M. Thiery: OpenDreamKit: an introduction 19 April 25, 2017