Reproducible Computational Science: Difference between revisions
From Modelado Foundation
imported>Wpinfold (Created page with "Computational science hes enable some of the greatest breakthroughs in science and engineering, but the uniqueness of some of the systems used in this work has lead to dificul...") |
imported>Wpinfold No edit summary |
||
(15 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
Computational science | Computational science has enable significant breakthroughs in science and engineering but, a number of factors make this work dificulty to reproduce. Reproducibility is a foundation of the scientific method so we must to redouble our efforts to make this work easy to reproduce. | ||
=Papers= | |||
*[https://www.nsf.gov/sbe/AC_Materials/SBE_Robust_and_Reliable_Research_Report.pdf Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science, Report of the Subcommittee on Replicability in Science Advisory Committee to the National Science Foundation Directorate for Social, Behavioral, and Economic Sciences] | |||
=Topics= | |||
{| class="wikitable" style="color:darkblue;background-color:lightgrey;width: 100%;height: 200px" cellpadding="20" | |||
! scope="col" | Topic | |||
! scope="col" | Presentation | |||
! scope="col" | Discussion | |||
! scope="col" | Action | |||
|- | |||
|Professional Societies | |||
|TBD | |||
|ACM, IEEE, Other | |||
|Move societies and their key conferences towards delivering for free the full package of scientific discovery so the work can be easily reproduced. | |||
|- | |||
|Vocabulary | |||
|TBD | |||
|NSF | |||
|Remove the ambiguity in terminology e.g. Reproducibility, Replicability | |||
|- | |||
|Conferences | |||
|TBD | |||
|SC, SIAM, CLSAC | |||
|Support conferences in developing best known methods for review and documentation. | |||
|- | |||
|Tools | |||
|TBD | |||
|Notebooks, Runtimes, Portability, Productivity, reproducibility. | |||
|Document best tools to inform communities and support the development of tools that are missing | |||
|- | |||
|Analytics | |||
|TBD | |||
|Support analytics communities e.g. combustion, CFD, Astrophysics, etc. | |||
|Raise awareness of what is possible | |||
|} | |||
=Events= | |||
{| class="wikitable" style="color:darkblue;background-color:lightgrey;width: 100%;height: 200px" cellpadding="20" | |||
! scope="col" | Date | |||
! scope="col" | Event | |||
! scope="col" | Location | |||
|- | |||
|March 8-10th, 2017 | |||
|[http://www.nasonline.org/programs/sackler-colloquia/completed_colloquia/Reproducibility_of_Research.html National Academy of Sciences Sackler Colloquium Reproducibility of Research: Issues and Proposed Remedies] | |||
|Washington D.C | |||
|- | |||
|February 25 – 26, 2017 | |||
|[http://www.mrsec.harvard.edu/2017NSFReliability/index.html Platform SuperCluster Workshop] | |||
|Beckman Center of the National Academies of Sciences & Engineering University of California at Irvine | |||
|} | |||
=Tools= | |||
*[http://jupyter.org/ Project Jupyter] | |||
*[http://mybinder.org/ binder] | |||
*[http://everware.xyz/ everware] | |||
*[https://occam.cs.pitt.edu/ Occam] | |||
*[https://github.com/systemslab/popper Popper Project] | |||
*[http://www.taverna.org.uk Taverna Workflow Management System] | |||
*[http://www.myexperiment.org myExperiment] with a good example of use [http://f1000research.com/articles/3-110/v1 here] | |||
*[http://onlinehpc.com OnlineHPC] | |||
*[https://kepler-project.org Kepler Project] | |||
*[http://vistrails.org VisTrails] | |||
*[http://www.reproducibility.org Madagascar] | |||
*[https://easybuild.readthedocs.io/en/latest/ EasyBuilder] | |||
*[https://spack.readthedocs.io/en/latest/ Spack] | |||
*[http://www.nersc.gov/research-and-development/user-defined-images/ Shifter] | |||
=Speakers= | |||
*[http://people.cs.pitt.edu/~childers/ Bruce Childers] | |||
*[http://toddharris.net/ Todd Harris] | |||
*[https://www.janelia.org/our-research/former-labs/freeman-lab Jeremy Freeman] | |||
*[https://en.wikipedia.org/wiki/Ward_Cunningham Ward Cummingham] and his [http://fed.wiki.org/view/welcome-visitors Federated wiki] | |||
*[http://awards.acm.org/award_winners/rous_3286291.cfm Bernard Rous] |
Latest revision as of 20:15, September 12, 2017
Computational science has enable significant breakthroughs in science and engineering but, a number of factors make this work dificulty to reproduce. Reproducibility is a foundation of the scientific method so we must to redouble our efforts to make this work easy to reproduce.
Papers
Topics
Topic | Presentation | Discussion | Action |
---|---|---|---|
Professional Societies | TBD | ACM, IEEE, Other | Move societies and their key conferences towards delivering for free the full package of scientific discovery so the work can be easily reproduced. |
Vocabulary | TBD | NSF | Remove the ambiguity in terminology e.g. Reproducibility, Replicability |
Conferences | TBD | SC, SIAM, CLSAC | Support conferences in developing best known methods for review and documentation. |
Tools | TBD | Notebooks, Runtimes, Portability, Productivity, reproducibility. | Document best tools to inform communities and support the development of tools that are missing |
Analytics | TBD | Support analytics communities e.g. combustion, CFD, Astrophysics, etc. | Raise awareness of what is possible |
Events
Date | Event | Location |
---|---|---|
March 8-10th, 2017 | National Academy of Sciences Sackler Colloquium Reproducibility of Research: Issues and Proposed Remedies | Washington D.C |
February 25 – 26, 2017 | Platform SuperCluster Workshop | Beckman Center of the National Academies of Sciences & Engineering University of California at Irvine
|
Tools
- Project Jupyter
- binder
- everware
- Occam
- Popper Project
- Taverna Workflow Management System
- myExperiment with a good example of use here
- OnlineHPC
- Kepler Project
- VisTrails
- Madagascar
- EasyBuilder
- Spack
- Shifter