Actions

Extreme Scale Software Stack: Difference between revisions

From Modelado Foundation

imported>Jsstone1
No edit summary
 
(177 intermediate revisions by 21 users not shown)
Line 1: Line 1:
== X-Stack Program ==
<!--__NOEDITSECTION__ -->
<!--{{DISPLAYTITLE:<span style="position: absolute; clip: rect(1px 1px 1px 1px); clip: rect(1px, 1px, 1px, 1px);">{{FULLPAGENAME}}</span>}}-->
{|style="text-align:center;"
| style="width: 20%"|[[About|<div class="navButton">About</div>]]
| style="width: 20%"|[[Team|<div class="navButton">Team</div>]]
| style="width: 20%"|[[Groups|<div class="navButton">Groups</div>]]
| style="width: 20%"|[[Extreme Scale Software Stack|<div class="navButton">ESS Content</div>]]
| style="width: 20%"|[[File:modeladoZ.jpg|100px|link=https://modelado.org|center]]
|}
== X-Stack Program and Projects ==
* [[X-Stack Program Description|X-Stack Program Description]]
* [[X-Stack Program Description|X-Stack Program Description]]
* [[D-­TEC|D-­TEC: DSL Technology for Exascale Computing]]
* [[DEGAS|DEGAS: Dynamic Exascale Global Address Space]]
* [[Traleika Glacier|Traleika Glacier]]
* [[Traleika Glacier|Traleika Glacier]]
* [[DEGAS|DEGAS: Dynamic Exascale Global Address Space]]
* [[D-­TEC|D-­TEC: DSL Technology for Exascale Computing]]
* [[XPRESS|XPRESS: eXascale Programming Environment and System Software]]
* [[XPRESS|XPRESS: eXascale Programming Environment and System Software]]
* [[DynAX|DynAX: Dynamic Adaptive X-Stack]]
* [[PIPER|PIPER: Performance Insight For Programmers and Exascale Runtimes]]
* [[SLEEC|SLEEC: Semantics-rich Libraries for Effective Exascale Computation]]
* [[X-TUNE|X-TUNE: Autotuning for Exascale]]
* [[X-TUNE|X-TUNE: Autotuning for Exascale]]
* [[GVR|GVR: Exploiting Global View for Resilience]]
* [[GVR|GVR: Exploiting Global View for Resilience]]
* [[CORVETTE|CORVETTE: Program Correctness Verification and Testing for Exascale]]
* [[CORVETTE|CORVETTE: Program Correctness Verification and Testing for Exascale]]
* [[SLEEC|SLEEC: Semantics-rich Libraries for Effective Exascale Computation]]
* [[DynAX|DynAX: Dynamic Adaptive X-Stack]]
* [[PIPER|PIPER: Performance Insight For Programmers and Exascale Runtimes]]
* [https://ft.ornl.gov/trac/vancouver Vancouver: Designing a Next-Generation Software Infrastructure for Productive Heterogeneous Exascale Computing]
* [http://ft.ornl.gov/research/ares ARES: Abstract Representations for Extreme Scale Stack]
 
== X-Stack Program Impact ==
* [https://modelado.org/images/b/ba/X-Stack_Impact_Summary_-_September_2016.pdf X-Stack Program Impact]
 
 
== X-Stack Program Products ==
 
* [https://modelado.org/D-%C2%ADTEC#D-.C2.ADTEC_Products_and_Publications D-TEC Project Software and Publications]
* [https://modelado.org/DEGAS#Products_from_DEGAS_research_.28as_of_04.2F2016.29 DEGAS Project Software and Publications]
* [https://modelado.org/Traleika_Glacier#Traleika_Glacier_products Traleika Glacier Project Software and Publications]
* [https://modelado.org/images/4/40/XPRESS-Products-2015.pdf XPRESS Project Software and Publications]
* [https://modelado.org/PIPER#Released_Software PIPER Project Software]
* [https://modelado.org/SLEEC#Products SLEEC Project Software and Publications]
* [https://modelado.org/X-TUNE#Products X-TUNE Project Software and Publications]
* [https://modelado.org/images/a/a2/Gvr-research-products.pdf GRV Project Software and Publications]
* [https://modelado.org/CORVETTE#List_of_Products Corvette Project Software and Publications]
* [https://ft.ornl.gov/trac/vancouver Vancouver 2 Project Software and Publications]
* [http://ft.ornl.gov/research/ares ARES Project Publications]
* All open source software produced with DOE funding should go through a DOE copyright process so that DOE can track the source code and make it available at http://www.osti.gov/moved/estsc/ 
* [https://www.nersc.gov/news-publications/nersc-news/nersc-center-news/2016/berkeley-lab-hosts-fourth-x-stack-pi-meeting/ NERSC News about X-Stack Software Demonstrations]
* [https://www.olcf.ornl.gov/2016/05/31/x-stack-projects-use-titans-gpus-for-demos/ OLCF News about X-Stack Software Demonstrations]
 
== X-Stack Technology Readiness ==
 
* [https://modelado.org/images/a/a9/DEGAS_Software_Readiness.pdf DEGAS Software Technology Readiness]
* [https://modelado.org/images/5/53/XPRESS_ProdSoft.pdf XPRESS Software Technology Readiness]
* [https://modelado.org/images/f/fa/Traleika_Glacier_Product_Readiness.pdf Traleika Glacier Software Technology Readiness]
* [https://modelado.org/images/6/62/DTEC_Software_Readiness.pdf D-TEC Software Technology Readiness]
* [https://modelado.org/images/0/08/X-TUNE_Software_Readiness.pdf X-TUNE Software Technology Readiness]
* [ SLEEC Software Technology Readiness - waiting input from PIs]
* [ Corvette Software Technology Readiness - waiting input from PIs]
* [https://modelado.org/images/1/14/Vancouver-software-readiness-v02.pdf Vancouver 2 Software Technology Readiness]
* [https://modelado.org/images/d/df/Ares-software-readiness-v02.pdf ARES Software Technology Readiness]
* [https://modelado.org/images/4/43/GVR_TRL_Progress9-2016.pdf GVR Software Technology Readiness]
 
== X-Stack and Related Meetings ==
* [[9/17/12: X-Stack Portfolio Kickoff Meeting]], ported from [https://sites.google.com/site/xstackprogramreview/home 9/17/12: X-Stack Portfolio Kickoff Meeting]
* [http://exascaleresearch.labworks.org/oct2012/ 10/4/12: Exascale Research Conference]
* [[3/20/13 - X-Stack PI Meeting]], ported from [https://sites.google.com/site/xstackpimeetingmarch2013 March 2013 X-Stack PI Meeting]]
** [[March_20_2013_Panel_Sessions| Panel Sessions]]
** [[March_20_2013_Technology_Marketplace|Technology Marketplace]]
** [[March_20_2013_Technology_Users|Technology Users]]
* [[02/05/2014 - Programming Models & Environments Summit]]
* [[April_16_2014_OSR|4/16/14: OS/R Program Semi-Annual Meeting]]
* [[05/28/14:  X-Stack PI Meeting]]
** [[Agenda May 28]]
** [[Agenda May 29]]
** [[May 28-29_Panel_Sessions | Panel Sessions]]
** [[May 28-29_Meeting Presentations | Meeting Presentations]]
** [[May 28-29_Technology Marketplace Sessions | Technology Marketplace Sessions]]
* [[04/09/2014 Runtime Systems Summit]]
* [http://www.orau.gov/programming2015/ March 9-11, 2015 - DOE/ASCR Programming Environments Workshop]
* [http://www.orau.gov/runtimesys2015/ March 11-13, 2015 - DOE/ASCR Runtime Systems Workshop]
* [[December 7-8, 2015 X-Stack and OS/R PI meeting]]
* [[April 6-7, 2016 - X-Stack PI Meeting]]
* [[May 23, 2016 - OS/R PI Meeting]]
 
== X-Stack Software Components ==
* [[Open Community Runtime|Open Community Runtime]]
* [[HPX-5]]
 
== DOE Mini-Apps and Benchmarks==
* [http://www.exmatex.org/proxy-over.html ExMatEx mini-apps]
* [http://cesar.mcs.anl.gov/content/software CESAR mini-apps]
* [http://exactcodesign.org/proxy-app-software/ Exact mini-apps]
* [http://portal.nersc.gov/project/CAL/designforward.htm Design Forward mini-apps]
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of the DOE mini-apps]
* [https://hpgmg.org HPGMG mini-app]
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of the DOE mini-apps]
* [http://www.nas.nasa.gov/publications/npb.html NAS Benchmarks]


== Operating System and Runtime Software (OS/R) Program ==
== Operating System and Runtime Software (OS/R) Program ==
Line 17: Line 99:
* [[Hobbes|Hobbes]]
* [[Hobbes|Hobbes]]
* [[X-ARCC|X-ARCC]]
* [[X-ARCC|X-ARCC]]
* [[SC15 BOF|SC15 OS/R BOF]]
* [[media:SC16-BOF.pdf|SC16 BOF - Multi-Kernel OSes for Extreme-Scale HPC]]
* [[OS/R mailing list]]


== Coordinating Projects or Centers ==
== Coordinating Projects or Centers ==
* [http://sites.google.com/a/lbl.gov/codex/ CoDEx: CoDesign for Exascale]
* [http://www.cal-design.org/ Computer Architecture Laboratory (CAL) for Design Space Exploration]
* [http://www.exascaleinitiative.org/ Hardware Architecture Nexus: DOE Fast Forward and Design Forward Projects]
* [[Data Movement Dominates]]
* [https://ft.ornl.gov/trac/blackcomb Blackcomb: Hardware-Software Co-design for Non-Volatile Memory in Exascale Systems]
* [[MPI for Exascale|MPI for Exascale]]
* [[ExaCT|ExaCT: Center for Exascale Simulations of Combustion in Turbulence]]
* [[ExaCT|ExaCT: Center for Exascale Simulations of Combustion in Turbulence]]
* [[CESAR|CESAR: Center for Exascale Simulations of Advanced Reactors]]
* [[CESAR|CESAR: Center for Exascale Simulations of Advanced Reactors]]
* [[ExMatEX|ExMatEx: Exascale Co-Design Center for Materials in Extreme Environments]]
* [[ExMatEX|ExMatEx: Exascale Co-Design Center for Materials in Extreme Environments]]
* [[NWChem|NWChem: Self Consistent Field Module]]
* [[NWChem|NWChem: Self Consistent Field Module]]
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of DOE Mini-Apps]
* [[DOE ASCR 2009 Early Career Projects]]
* [[DOE ASCR 2010 Early Career Projects]]
* [[DOE ASCR 2011 Early Career Projects]]
* [[DOE ASCR 2012 Early Career Projects]]
* [[DOE ASCR 2013 Early Career Projects]]
* [http://science.energy.gov/ascr/research/computer-science/xstack/ FY10-13 X-Stack Portfolio]
* [http://science.energy.gov/ascr/research/computer-science/xstack/ FY10-13 X-Stack Portfolio]
* [http://science.energy.gov/ascr/research/computer-science/aa/ FY10-13 Advanced Architectures Portfolio]
* [http://science.energy.gov/ascr/research/computer-science/aa/ FY10-13 Advanced Architectures Portfolio]
Line 28: Line 125:
* [http://science.energy.gov/ascr/research/computer-science/research-in-computer-architecture-modeling--and--evolving-mpi-for-exascale/ FY12 Unsolicited Portfolio]
* [http://science.energy.gov/ascr/research/computer-science/research-in-computer-architecture-modeling--and--evolving-mpi-for-exascale/ FY12 Unsolicited Portfolio]


== Meetings ==
== Related DOE programs ==
* [[9/17/12: X-Stack Portfolio Kickoff Meeting]], ported from [https://sites.google.com/site/xstackprogramreview/home 9/17/12: X-Stack Portfolio Kickoff Meeting]
* [http://www.exascaleinitiative.org: Fast Forward and Design Forward]
* [http://exascaleresearch.labworks.org/oct2012/ 10/4/12: Exascale Research Conference]
 
* [[3/20/13: X-Stack 6-Month PI Meeting]], ported from [https://sites.google.com/site/xstackpimeetingmarch2013/ 3/20/13: XStack 6-month PI meeting]
== Software Stack Taxonomy ==
** [[March_20_2013_Panel_Sessions| Panel Sessions]]
We agreed at our Mar'13 PI meeting to generate tables of technology/issues for the various software stack components, as we did for the Languages component below. Please coordinate with your co-PIs and with other projects working on the various software stack components to generate tables for the topics below. If the lead shown below is incorrect, please correct. 
** [[March_20_2013_Technology_Marketplace|Technology Marketplace]]
 
** [[March_20_2013_Technology_Users|Technology Users]]
* [[Communications|Communications]] - Costin Iancu
* [[Correctness Tools|Correctness Tools]] - Koushik Sen
* [[Compilers|Compilers]] - Dan Quinlan
* [[DSL's|DSLs]] - Saman Amarasinghe and Dan Quinlan
* [https://docs.google.com/a/lbl.gov/spreadsheet/ccc?key=0AnxagJH-lElndDE5OFF3YkVqUFQtOHY3alZveGlYTFE#gid=0 Languages] - Katherine Yelick
* [https://docs.google.com/spreadsheets/d/1WXRkzwZMfvpNJFz7Jaue5W3PzA30AtVUn0Vif-h0Afg/edit?usp=drive_web Libraries] - Sanjay Kale
* [[Operating Systems|Operating Systems]] - Pete Beckman
* [[Performance Tools|Performance Tools]] - John Mellor-Crummey
* [[Resilience|Resilience]] - Andrew Chien
* [[Runtimes (application-facing)]] - Shekhar Borkar
* [[Runtimes (os/hardware-facing)|Runtimes (os/hardware-facing)]] - Ron Brightwell
* [[Scientific Libraries|Scientific Libraries]] - Milind Kulkarni


== Software Stack Components ==
==Other Announcements==
* [[DSL's|DSLs]]
* 3.9.2015:  IEEE special issue on [http://online.qmags.com/ISW0315 Release Engineering was published].  See [http://delivery.qmags.com/d/?pub=ISW&upid=19277&s=OL&fl=others%2fISW%2fISW_20150301_Mar_2015.pdf here] for pdf of issue.
* [[Scientific Libraries|Scientific Libraries]]
* 10.13.2014:  Upcoming workshop at [https://www.orau.gov/machinelearning2015/ Machine Learning, Jan -7, 2015]
* [https://docs.google.com/a/lbl.gov/spreadsheet/ccc?key=0AnxagJH-lElndDE5OFF3YkVqUFQtOHY3alZveGlYTFE#gid=0 Languages]
* 8.26.2014:[[media:Exascale_Software_Stack_Present_and_Future_-_PACT2014_-_pdf_version.pdf|"Exascale Software Stack: Present, Future"]], Sonia R. Sachs, presentation at PACT'2014
* [[Compilers|Compilers]]
*8.26.2014:[[media:Exascale_Software_Stack_Present_and_Future_-_PACT2014_-_presentation_story.pdf|"Exascale Software Stack: Present, Future"]], presentation story
* [[Programming Libraries|Programming Libraries]]
* 5.28.2014:  [[05/28/14:_X-Stack_PI_Meeting|May 28-29, 2014 PI Meeting]]
* [https://docs.google.com/spreadsheet/ccc?key=0Am4qMU5swbHIdE9ZZDBQbUlrREtoYVo1aFhUa3FBZXc#gid=0 Runtimes (application-facing)]
* 5.20.2014:  Some interesting TED talks on [http://www.npr.org/2013/07/13/197986218/why-we-collaborate Why we collaborate].
* [[Runtimes (machine-facing)|Runtimes (machine-facing)]]
* 4.20.2014:  '''Modelado Foundation transitions wiki content'''.  All the xstackwiki content previously hosted at com has been transitioned to this wiki.  Please update your browser bookmarks appropriately.
* [[Operating Systems|Operating Systems]]
* 7.9.2023: '''Modelado Foundation transitions wiki content'''.  All the xstackwiki content previously hosted at https://xstackwiki.modelado.org has now been moved to this wiki.  Please update your browser bookmarks appropriately. If you find any links that says 'not found ', just remove xstackwiki from the URL.
* [[Communications|Communications]]
* [[Correctness Tools|Correctness Tools]]
* [[Performance Tools|Performance Tools]]
* [[Resilience|Resilience]]

Latest revision as of 23:15, July 9, 2023

ModeladoZ.jpg

X-Stack Program and Projects

X-Stack Program Impact


X-Stack Program Products

X-Stack Technology Readiness

X-Stack and Related Meetings

X-Stack Software Components

DOE Mini-Apps and Benchmarks

Operating System and Runtime Software (OS/R) Program

Coordinating Projects or Centers

Related DOE programs

Software Stack Taxonomy

We agreed at our Mar'13 PI meeting to generate tables of technology/issues for the various software stack components, as we did for the Languages component below. Please coordinate with your co-PIs and with other projects working on the various software stack components to generate tables for the topics below. If the lead shown below is incorrect, please correct.

Other Announcements