Extreme Scale Software Stack: Difference between revisions
From Modelado Foundation
imported>Sonia |
No edit summary |
||
| (114 intermediate revisions by 12 users not shown) | |||
| Line 1: | Line 1: | ||
== | <!--__NOEDITSECTION__ --> | ||
<!--{{DISPLAYTITLE:<span style="position: absolute; clip: rect(1px 1px 1px 1px); clip: rect(1px, 1px, 1px, 1px);">{{FULLPAGENAME}}</span>}}--> | |||
{|style="text-align:center;" | |||
* | | style="width: 20%"|[[About|<div class="navButton">About</div>]] | ||
| style="width: 20%"|[[Team|<div class="navButton">Team</div>]] | |||
| style="width: 20%"|[[Groups|<div class="navButton">Groups</div>]] | |||
| style="width: 20%"|[[Extreme Scale Software Stack|<div class="navButton">ESS Content</div>]] | |||
| style="width: 20%"|[[File:modeladoZ.jpg|100px|link=https://modelado.org|center]] | |||
|} | |||
== X-Stack Program and Projects == | |||
* [[X-Stack Program Description|X-Stack Program Description]] | |||
* [[D-TEC|D-TEC: DSL Technology for Exascale Computing]] | |||
* [[ | * [[DEGAS|DEGAS: Dynamic Exascale Global Address Space]] | ||
* [[Traleika Glacier|Traleika Glacier]] | * [[Traleika Glacier|Traleika Glacier]] | ||
* [[XPRESS|XPRESS: eXascale Programming Environment and System Software]] | * [[XPRESS|XPRESS: eXascale Programming Environment and System Software]] | ||
* [[ | * [[PIPER|PIPER: Performance Insight For Programmers and Exascale Runtimes]] | ||
* [[SLEEC|SLEEC: Semantics-rich Libraries for Effective Exascale Computation]] | |||
* [[X-TUNE|X-TUNE: Autotuning for Exascale]] | * [[X-TUNE|X-TUNE: Autotuning for Exascale]] | ||
* [[GVR|GVR: Exploiting Global View for Resilience]] | * [[GVR|GVR: Exploiting Global View for Resilience]] | ||
* [[CORVETTE|CORVETTE: Program Correctness Verification and Testing for Exascale]] | * [[CORVETTE|CORVETTE: Program Correctness Verification and Testing for Exascale]] | ||
* [[ | * [[DynAX|DynAX: Dynamic Adaptive X-Stack]] | ||
* [[PIPER | * [https://ft.ornl.gov/trac/vancouver Vancouver: Designing a Next-Generation Software Infrastructure for Productive Heterogeneous Exascale Computing] | ||
* [[ARES: | * [http://ft.ornl.gov/research/ares ARES: Abstract Representations for Extreme Scale Stack] | ||
== X-Stack Program Impact == | |||
* [https://modelado.org/images/b/ba/X-Stack_Impact_Summary_-_September_2016.pdf X-Stack Program Impact] | |||
== X-Stack Program Products == | |||
* [https://modelado.org/D-%C2%ADTEC#D-.C2.ADTEC_Products_and_Publications D-TEC Project Software and Publications] | |||
* [https://modelado.org/DEGAS#Products_from_DEGAS_research_.28as_of_04.2F2016.29 DEGAS Project Software and Publications] | |||
* [https://modelado.org/Traleika_Glacier#Traleika_Glacier_products Traleika Glacier Project Software and Publications] | |||
* [https://modelado.org/images/4/40/XPRESS-Products-2015.pdf XPRESS Project Software and Publications] | |||
* [https://modelado.org/PIPER#Released_Software PIPER Project Software] | |||
* [https://modelado.org/SLEEC#Products SLEEC Project Software and Publications] | |||
* [https://modelado.org/X-TUNE#Products X-TUNE Project Software and Publications] | |||
* [https://modelado.org/images/a/a2/Gvr-research-products.pdf GRV Project Software and Publications] | |||
* [https://modelado.org/CORVETTE#List_of_Products Corvette Project Software and Publications] | |||
* [https://ft.ornl.gov/trac/vancouver Vancouver 2 Project Software and Publications] | |||
* [http://ft.ornl.gov/research/ares ARES Project Publications] | |||
* All open source software produced with DOE funding should go through a DOE copyright process so that DOE can track the source code and make it available at http://www.osti.gov/moved/estsc/ | |||
* [https://www.nersc.gov/news-publications/nersc-news/nersc-center-news/2016/berkeley-lab-hosts-fourth-x-stack-pi-meeting/ NERSC News about X-Stack Software Demonstrations] | |||
* [https://www.olcf.ornl.gov/2016/05/31/x-stack-projects-use-titans-gpus-for-demos/ OLCF News about X-Stack Software Demonstrations] | |||
== X-Stack Technology Readiness == | |||
* [https://modelado.org/images/a/a9/DEGAS_Software_Readiness.pdf DEGAS Software Technology Readiness] | |||
* [https://modelado.org/images/5/53/XPRESS_ProdSoft.pdf XPRESS Software Technology Readiness] | |||
* [https://modelado.org/images/f/fa/Traleika_Glacier_Product_Readiness.pdf Traleika Glacier Software Technology Readiness] | |||
* [https://modelado.org/images/6/62/DTEC_Software_Readiness.pdf D-TEC Software Technology Readiness] | |||
* [https://modelado.org/images/0/08/X-TUNE_Software_Readiness.pdf X-TUNE Software Technology Readiness] | |||
* [ SLEEC Software Technology Readiness - waiting input from PIs] | |||
* [ Corvette Software Technology Readiness - waiting input from PIs] | |||
* [https://modelado.org/images/1/14/Vancouver-software-readiness-v02.pdf Vancouver 2 Software Technology Readiness] | |||
* [https://modelado.org/images/d/df/Ares-software-readiness-v02.pdf ARES Software Technology Readiness] | |||
* [https://modelado.org/images/4/43/GVR_TRL_Progress9-2016.pdf GVR Software Technology Readiness] | |||
== X-Stack and Related Meetings == | |||
* [[9/17/12: X-Stack Portfolio Kickoff Meeting]], ported from [https://sites.google.com/site/xstackprogramreview/home 9/17/12: X-Stack Portfolio Kickoff Meeting] | |||
* [http://exascaleresearch.labworks.org/oct2012/ 10/4/12: Exascale Research Conference] | |||
* [[3/20/13 - X-Stack PI Meeting]], ported from [https://sites.google.com/site/xstackpimeetingmarch2013 March 2013 X-Stack PI Meeting]] | |||
** [[March_20_2013_Panel_Sessions| Panel Sessions]] | |||
** [[March_20_2013_Technology_Marketplace|Technology Marketplace]] | |||
** [[March_20_2013_Technology_Users|Technology Users]] | |||
* [[02/05/2014 - Programming Models & Environments Summit]] | |||
* [[April_16_2014_OSR|4/16/14: OS/R Program Semi-Annual Meeting]] | |||
* [[05/28/14: X-Stack PI Meeting]] | |||
** [[Agenda May 28]] | |||
** [[Agenda May 29]] | |||
** [[May 28-29_Panel_Sessions | Panel Sessions]] | |||
** [[May 28-29_Meeting Presentations | Meeting Presentations]] | |||
** [[May 28-29_Technology Marketplace Sessions | Technology Marketplace Sessions]] | |||
* [[04/09/2014 Runtime Systems Summit]] | |||
* [http://www.orau.gov/programming2015/ March 9-11, 2015 - DOE/ASCR Programming Environments Workshop] | |||
* [http://www.orau.gov/runtimesys2015/ March 11-13, 2015 - DOE/ASCR Runtime Systems Workshop] | |||
* [[December 7-8, 2015 X-Stack and OS/R PI meeting]] | |||
* [[April 6-7, 2016 - X-Stack PI Meeting]] | |||
* [[May 23, 2016 - OS/R PI Meeting]] | |||
== X-Stack Software Components == | |||
* [[Open Community Runtime|Open Community Runtime]] | |||
* [[HPX-5]] | |||
== DOE Mini-Apps and Benchmarks== | |||
* [http://www.exmatex.org/proxy-over.html ExMatEx mini-apps] | |||
* [http://cesar.mcs.anl.gov/content/software CESAR mini-apps] | |||
* [http://exactcodesign.org/proxy-app-software/ Exact mini-apps] | |||
* [http://portal.nersc.gov/project/CAL/designforward.htm Design Forward mini-apps] | |||
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of the DOE mini-apps] | |||
* [https://hpgmg.org HPGMG mini-app] | |||
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of the DOE mini-apps] | |||
* [http://www.nas.nasa.gov/publications/npb.html NAS Benchmarks] | |||
== Operating System and Runtime Software (OS/R) Program == | == Operating System and Runtime Software (OS/R) Program == | ||
| Line 24: | Line 99: | ||
* [[Hobbes|Hobbes]] | * [[Hobbes|Hobbes]] | ||
* [[X-ARCC|X-ARCC]] | * [[X-ARCC|X-ARCC]] | ||
* [[SC15 BOF|SC15 OS/R BOF]] | |||
* [[media:SC16-BOF.pdf|SC16 BOF - Multi-Kernel OSes for Extreme-Scale HPC]] | |||
* [[OS/R mailing list]] | * [[OS/R mailing list]] | ||
| Line 37: | Line 114: | ||
* [[ExMatEX|ExMatEx: Exascale Co-Design Center for Materials in Extreme Environments]] | * [[ExMatEX|ExMatEx: Exascale Co-Design Center for Materials in Extreme Environments]] | ||
* [[NWChem|NWChem: Self Consistent Field Module]] | * [[NWChem|NWChem: Self Consistent Field Module]] | ||
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of DOE Mini-Apps] | |||
* [[DOE ASCR 2009 Early Career Projects]] | * [[DOE ASCR 2009 Early Career Projects]] | ||
* [[DOE ASCR 2010 Early Career Projects]] | * [[DOE ASCR 2010 Early Career Projects]] | ||
| Line 47: | Line 125: | ||
* [http://science.energy.gov/ascr/research/computer-science/research-in-computer-architecture-modeling--and--evolving-mpi-for-exascale/ FY12 Unsolicited Portfolio] | * [http://science.energy.gov/ascr/research/computer-science/research-in-computer-architecture-modeling--and--evolving-mpi-for-exascale/ FY12 Unsolicited Portfolio] | ||
== | == Related DOE programs == | ||
* [http://www.exascaleinitiative.org: Fast Forward and Design Forward] | |||
* [http:// | |||
== Software Stack | == Software Stack Taxonomy == | ||
We agreed at our Mar'13 PI meeting to generate tables of technology/issues for the various software stack components, as we did for the Languages component below. Please coordinate with your co-PIs and with other projects working on the various software stack components to generate tables for the topics below. If the lead shown below is incorrect, please correct. | We agreed at our Mar'13 PI meeting to generate tables of technology/issues for the various software stack components, as we did for the Languages component below. Please coordinate with your co-PIs and with other projects working on the various software stack components to generate tables for the topics below. If the lead shown below is incorrect, please correct. | ||
* [[Communications|Communications]] - Costin Iancu | |||
* [[Correctness Tools|Correctness Tools]] - Koushik Sen | |||
* [[Compilers|Compilers]] - Dan Quinlan | |||
* [[DSL's|DSLs]] - Saman Amarasinghe and Dan Quinlan | * [[DSL's|DSLs]] - Saman Amarasinghe and Dan Quinlan | ||
* [https://docs.google.com/a/lbl.gov/spreadsheet/ccc?key=0AnxagJH-lElndDE5OFF3YkVqUFQtOHY3alZveGlYTFE#gid=0 Languages] - Katherine Yelick | * [https://docs.google.com/a/lbl.gov/spreadsheet/ccc?key=0AnxagJH-lElndDE5OFF3YkVqUFQtOHY3alZveGlYTFE#gid=0 Languages] - Katherine Yelick | ||
* [https://docs.google.com/spreadsheets/d/1WXRkzwZMfvpNJFz7Jaue5W3PzA30AtVUn0Vif-h0Afg/edit?usp=drive_web Libraries] - Sanjay Kale | * [https://docs.google.com/spreadsheets/d/1WXRkzwZMfvpNJFz7Jaue5W3PzA30AtVUn0Vif-h0Afg/edit?usp=drive_web Libraries] - Sanjay Kale | ||
* [[Operating Systems|Operating Systems]] - Pete Beckman | * [[Operating Systems|Operating Systems]] - Pete Beckman | ||
* [[Performance Tools|Performance Tools]] - John Mellor-Crummey | * [[Performance Tools|Performance Tools]] - John Mellor-Crummey | ||
* [[Resilience|Resilience]] - Andrew Chien | * [[Resilience|Resilience]] - Andrew Chien | ||
* [[Runtimes (application-facing)]] - Shekhar Borkar | |||
* [[Runtimes (os/hardware-facing)|Runtimes (os/hardware-facing)]] - Ron Brightwell | |||
* [[Scientific Libraries|Scientific Libraries]] - Milind Kulkarni | |||
==Other Announcements== | |||
* 3.9.2015: IEEE special issue on [http://online.qmags.com/ISW0315 Release Engineering was published]. See [http://delivery.qmags.com/d/?pub=ISW&upid=19277&s=OL&fl=others%2fISW%2fISW_20150301_Mar_2015.pdf here] for pdf of issue. | |||
* 10.13.2014: Upcoming workshop at [https://www.orau.gov/machinelearning2015/ Machine Learning, Jan -7, 2015] | |||
* 8.26.2014:[[media:Exascale_Software_Stack_Present_and_Future_-_PACT2014_-_pdf_version.pdf|"Exascale Software Stack: Present, Future"]], Sonia R. Sachs, presentation at PACT'2014 | |||
*8.26.2014:[[media:Exascale_Software_Stack_Present_and_Future_-_PACT2014_-_presentation_story.pdf|"Exascale Software Stack: Present, Future"]], presentation story | |||
* 5.28.2014: [[05/28/14:_X-Stack_PI_Meeting|May 28-29, 2014 PI Meeting]] | |||
* 5.20.2014: Some interesting TED talks on [http://www.npr.org/2013/07/13/197986218/why-we-collaborate Why we collaborate]. | |||
* 4.20.2014: '''Modelado Foundation transitions wiki content'''. All the xstackwiki content previously hosted at com has been transitioned to this wiki. Please update your browser bookmarks appropriately. | |||
* 7.9.2023: '''Modelado Foundation transitions wiki content'''. All the xstackwiki content previously hosted at https://xstackwiki.modelado.org has now been moved to this wiki. Please update your browser bookmarks appropriately. If you find any links that says 'not found ', just remove xstackwiki from the URL. | |||
Latest revision as of 23:15, July 9, 2023
 |
X-Stack Program and Projects
- D-TEC: DSL Technology for Exascale Computing
- DEGAS: Dynamic Exascale Global Address Space
- Traleika Glacier
- XPRESS: eXascale Programming Environment and System Software
- PIPER: Performance Insight For Programmers and Exascale Runtimes
- SLEEC: Semantics-rich Libraries for Effective Exascale Computation
- X-TUNE: Autotuning for Exascale
- GVR: Exploiting Global View for Resilience
- CORVETTE: Program Correctness Verification and Testing for Exascale
- DynAX: Dynamic Adaptive X-Stack
- Vancouver: Designing a Next-Generation Software Infrastructure for Productive Heterogeneous Exascale Computing
- ARES: Abstract Representations for Extreme Scale Stack
X-Stack Program Impact
X-Stack Program Products
- D-TEC Project Software and Publications
- DEGAS Project Software and Publications
- Traleika Glacier Project Software and Publications
- XPRESS Project Software and Publications
- PIPER Project Software
- SLEEC Project Software and Publications
- X-TUNE Project Software and Publications
- GRV Project Software and Publications
- Corvette Project Software and Publications
- Vancouver 2 Project Software and Publications
- ARES Project Publications
- All open source software produced with DOE funding should go through a DOE copyright process so that DOE can track the source code and make it available at http://www.osti.gov/moved/estsc/
- NERSC News about X-Stack Software Demonstrations
- OLCF News about X-Stack Software Demonstrations
X-Stack Technology Readiness
- DEGAS Software Technology Readiness
- XPRESS Software Technology Readiness
- Traleika Glacier Software Technology Readiness
- D-TEC Software Technology Readiness
- X-TUNE Software Technology Readiness
- [ SLEEC Software Technology Readiness - waiting input from PIs]
- [ Corvette Software Technology Readiness - waiting input from PIs]
- Vancouver 2 Software Technology Readiness
- ARES Software Technology Readiness
- GVR Software Technology Readiness
X-Stack and Related Meetings
- 9/17/12: X-Stack Portfolio Kickoff Meeting, ported from 9/17/12: X-Stack Portfolio Kickoff Meeting
- 10/4/12: Exascale Research Conference
- 3/20/13 - X-Stack PI Meeting, ported from March 2013 X-Stack PI Meeting]
- 02/05/2014 - Programming Models & Environments Summit
- 4/16/14: OS/R Program Semi-Annual Meeting
- 05/28/14: X-Stack PI Meeting
- 04/09/2014 Runtime Systems Summit
- March 9-11, 2015 - DOE/ASCR Programming Environments Workshop
- March 11-13, 2015 - DOE/ASCR Runtime Systems Workshop
- December 7-8, 2015 X-Stack and OS/R PI meeting
- April 6-7, 2016 - X-Stack PI Meeting
- May 23, 2016 - OS/R PI Meeting
X-Stack Software Components
DOE Mini-Apps and Benchmarks
- ExMatEx mini-apps
- CESAR mini-apps
- Exact mini-apps
- Design Forward mini-apps
- Characterization of the DOE mini-apps
- HPGMG mini-app
- Characterization of the DOE mini-apps
- NAS Benchmarks
Operating System and Runtime Software (OS/R) Program
- OS/R Program Description
- ARGO
- Hobbes
- X-ARCC
- SC15 OS/R BOF
- SC16 BOF - Multi-Kernel OSes for Extreme-Scale HPC
- OS/R mailing list
Coordinating Projects or Centers
- CoDEx: CoDesign for Exascale
- Computer Architecture Laboratory (CAL) for Design Space Exploration
- Hardware Architecture Nexus: DOE Fast Forward and Design Forward Projects
- Data Movement Dominates
- Blackcomb: Hardware-Software Co-design for Non-Volatile Memory in Exascale Systems
- MPI for Exascale
- ExaCT: Center for Exascale Simulations of Combustion in Turbulence
- CESAR: Center for Exascale Simulations of Advanced Reactors
- ExMatEx: Exascale Co-Design Center for Materials in Extreme Environments
- NWChem: Self Consistent Field Module
- Characterization of DOE Mini-Apps
- DOE ASCR 2009 Early Career Projects
- DOE ASCR 2010 Early Career Projects
- DOE ASCR 2011 Early Career Projects
- DOE ASCR 2012 Early Career Projects
- DOE ASCR 2013 Early Career Projects
- FY10-13 X-Stack Portfolio
- FY10-13 Advanced Architectures Portfolio
- FY11 Unsolicited Portfolio
- FY12 Unsolicited Portfolio
Related DOE programs
Software Stack Taxonomy
We agreed at our Mar'13 PI meeting to generate tables of technology/issues for the various software stack components, as we did for the Languages component below. Please coordinate with your co-PIs and with other projects working on the various software stack components to generate tables for the topics below. If the lead shown below is incorrect, please correct.
- Communications - Costin Iancu
- Correctness Tools - Koushik Sen
- Compilers - Dan Quinlan
- DSLs - Saman Amarasinghe and Dan Quinlan
- Languages - Katherine Yelick
- Libraries - Sanjay Kale
- Operating Systems - Pete Beckman
- Performance Tools - John Mellor-Crummey
- Resilience - Andrew Chien
- Runtimes (application-facing) - Shekhar Borkar
- Runtimes (os/hardware-facing) - Ron Brightwell
- Scientific Libraries - Milind Kulkarni
Other Announcements
- 3.9.2015: IEEE special issue on Release Engineering was published. See here for pdf of issue.
- 10.13.2014: Upcoming workshop at Machine Learning, Jan -7, 2015
- 8.26.2014:"Exascale Software Stack: Present, Future", Sonia R. Sachs, presentation at PACT'2014
- 8.26.2014:"Exascale Software Stack: Present, Future", presentation story
- 5.28.2014: May 28-29, 2014 PI Meeting
- 5.20.2014: Some interesting TED talks on Why we collaborate.
- 4.20.2014: Modelado Foundation transitions wiki content. All the xstackwiki content previously hosted at com has been transitioned to this wiki. Please update your browser bookmarks appropriately.
- 7.9.2023: Modelado Foundation transitions wiki content. All the xstackwiki content previously hosted at https://xstackwiki.modelado.org has now been moved to this wiki. Please update your browser bookmarks appropriately. If you find any links that says 'not found ', just remove xstackwiki from the URL.