Actions

Extreme Scale Software Stack: Difference between revisions

From Modelado Foundation

imported>NikhilJain
m (→‎Software Stack Components: Add google doc for programming libraries)
No edit summary
 
(144 intermediate revisions by 17 users not shown)
Line 1: Line 1:
==What's New==
<!--__NOEDITSECTION__ -->
<!--{{DISPLAYTITLE:<span style="position: absolute; clip: rect(1px 1px 1px 1px); clip: rect(1px, 1px, 1px, 1px);">{{FULLPAGENAME}}</span>}}-->
{|style="text-align:center;"
| style="width: 20%"|[[About|<div class="navButton">About</div>]]
| style="width: 20%"|[[Team|<div class="navButton">Team</div>]]
| style="width: 20%"|[[Groups|<div class="navButton">Groups</div>]]
| style="width: 20%"|[[Extreme Scale Software Stack|<div class="navButton">ESS Content</div>]]
| style="width: 20%"|[[File:modeladoZ.jpg|100px|link=https://modelado.org|center]]
|}
== X-Stack Program and Projects ==
* [[X-Stack Program Description|X-Stack Program Description]]


* 4.20.2014: '''Modelado Foundation transitions wiki content'''.  All the xstackwiki content previously hosted at xstackwiki.com has been transitioned to this wiki.  Please update your browser bookmarks appropriately.  Please notify Scott Lewis (slewis at modelado.org) if there is any content or wiki functionality missing, corrupted, or otherwise unavailable.
* [[D-­TEC|D-­TEC: DSL Technology for Exascale Computing]]
 
* [[DEGAS|DEGAS: Dynamic Exascale Global Address Space]]
== X-Stack Program ==
* [[X-Stack Program Description|X-Stack Program Description]]
* [[Traleika Glacier|Traleika Glacier]]
* [[Traleika Glacier|Traleika Glacier]]
* [[DEGAS|DEGAS: Dynamic Exascale Global Address Space]]
* [[D-­TEC|D-­TEC: DSL Technology for Exascale Computing]]
* [[XPRESS|XPRESS: eXascale Programming Environment and System Software]]
* [[XPRESS|XPRESS: eXascale Programming Environment and System Software]]
* [[DynAX|DynAX: Dynamic Adaptive X-Stack]]
* [[PIPER|PIPER: Performance Insight For Programmers and Exascale Runtimes]]
* [[SLEEC|SLEEC: Semantics-rich Libraries for Effective Exascale Computation]]
* [[X-TUNE|X-TUNE: Autotuning for Exascale]]
* [[X-TUNE|X-TUNE: Autotuning for Exascale]]
* [[GVR|GVR: Exploiting Global View for Resilience]]
* [[GVR|GVR: Exploiting Global View for Resilience]]
* [[CORVETTE|CORVETTE: Program Correctness Verification and Testing for Exascale]]
* [[CORVETTE|CORVETTE: Program Correctness Verification and Testing for Exascale]]
* [[SLEEC|SLEEC: Semantics-rich Libraries for Effective Exascale Computation]]
* [[DynAX|DynAX: Dynamic Adaptive X-Stack]]
* [[PIPER|PIPER: Performance Insight For Programmers and Exascale Runtimes]]
* [https://ft.ornl.gov/trac/vancouver Vancouver: Designing a Next-Generation Software Infrastructure for Productive Heterogeneous Exascale Computing]
* [http://ft.ornl.gov/research/ares ARES: Abstract Representations for Extreme Scale Stack]
 
== X-Stack Program Impact ==
* [https://modelado.org/images/b/ba/X-Stack_Impact_Summary_-_September_2016.pdf X-Stack Program Impact]
 
 
== X-Stack Program Products ==
 
* [https://modelado.org/D-%C2%ADTEC#D-.C2.ADTEC_Products_and_Publications D-TEC Project Software and Publications]
* [https://modelado.org/DEGAS#Products_from_DEGAS_research_.28as_of_04.2F2016.29 DEGAS Project Software and Publications]
* [https://modelado.org/Traleika_Glacier#Traleika_Glacier_products Traleika Glacier Project Software and Publications]
* [https://modelado.org/images/4/40/XPRESS-Products-2015.pdf XPRESS Project Software and Publications]
* [https://modelado.org/PIPER#Released_Software PIPER Project Software]
* [https://modelado.org/SLEEC#Products SLEEC Project Software and Publications]
* [https://modelado.org/X-TUNE#Products X-TUNE Project Software and Publications]
* [https://modelado.org/images/a/a2/Gvr-research-products.pdf GRV Project Software and Publications]
* [https://modelado.org/CORVETTE#List_of_Products Corvette Project Software and Publications]
* [https://ft.ornl.gov/trac/vancouver Vancouver 2 Project Software and Publications]
* [http://ft.ornl.gov/research/ares ARES Project Publications]
* All open source software produced with DOE funding should go through a DOE copyright process so that DOE can track the source code and make it available at http://www.osti.gov/moved/estsc/ 
* [https://www.nersc.gov/news-publications/nersc-news/nersc-center-news/2016/berkeley-lab-hosts-fourth-x-stack-pi-meeting/ NERSC News about X-Stack Software Demonstrations]
* [https://www.olcf.ornl.gov/2016/05/31/x-stack-projects-use-titans-gpus-for-demos/ OLCF News about X-Stack Software Demonstrations]
 
== X-Stack Technology Readiness ==
 
* [https://modelado.org/images/a/a9/DEGAS_Software_Readiness.pdf DEGAS Software Technology Readiness]
* [https://modelado.org/images/5/53/XPRESS_ProdSoft.pdf XPRESS Software Technology Readiness]
* [https://modelado.org/images/f/fa/Traleika_Glacier_Product_Readiness.pdf Traleika Glacier Software Technology Readiness]
* [https://modelado.org/images/6/62/DTEC_Software_Readiness.pdf D-TEC Software Technology Readiness]
* [https://modelado.org/images/0/08/X-TUNE_Software_Readiness.pdf X-TUNE Software Technology Readiness]
* [ SLEEC Software Technology Readiness - waiting input from PIs]
* [ Corvette Software Technology Readiness - waiting input from PIs]
* [https://modelado.org/images/1/14/Vancouver-software-readiness-v02.pdf Vancouver 2 Software Technology Readiness]
* [https://modelado.org/images/d/df/Ares-software-readiness-v02.pdf ARES Software Technology Readiness]
* [https://modelado.org/images/4/43/GVR_TRL_Progress9-2016.pdf GVR Software Technology Readiness]
 
== X-Stack and Related Meetings ==
* [[9/17/12: X-Stack Portfolio Kickoff Meeting]], ported from [https://sites.google.com/site/xstackprogramreview/home 9/17/12: X-Stack Portfolio Kickoff Meeting]
* [http://exascaleresearch.labworks.org/oct2012/ 10/4/12: Exascale Research Conference]
* [[3/20/13 - X-Stack PI Meeting]], ported from [https://sites.google.com/site/xstackpimeetingmarch2013 March 2013 X-Stack PI Meeting]]
** [[March_20_2013_Panel_Sessions| Panel Sessions]]
** [[March_20_2013_Technology_Marketplace|Technology Marketplace]]
** [[March_20_2013_Technology_Users|Technology Users]]
* [[02/05/2014 - Programming Models & Environments Summit]]
* [[April_16_2014_OSR|4/16/14: OS/R Program Semi-Annual Meeting]]
* [[05/28/14:  X-Stack PI Meeting]]
** [[Agenda May 28]]
** [[Agenda May 29]]
** [[May 28-29_Panel_Sessions | Panel Sessions]]
** [[May 28-29_Meeting Presentations | Meeting Presentations]]
** [[May 28-29_Technology Marketplace Sessions | Technology Marketplace Sessions]]
* [[04/09/2014 Runtime Systems Summit]]
* [http://www.orau.gov/programming2015/ March 9-11, 2015 - DOE/ASCR Programming Environments Workshop]
* [http://www.orau.gov/runtimesys2015/ March 11-13, 2015 - DOE/ASCR Runtime Systems Workshop]
* [[December 7-8, 2015 X-Stack and OS/R PI meeting]]
* [[April 6-7, 2016 - X-Stack PI Meeting]]
* [[May 23, 2016 - OS/R PI Meeting]]
 
== X-Stack Software Components ==
* [[Open Community Runtime|Open Community Runtime]]
* [[HPX-5]]
 
== DOE Mini-Apps and Benchmarks==
* [http://www.exmatex.org/proxy-over.html ExMatEx mini-apps]
* [http://cesar.mcs.anl.gov/content/software CESAR mini-apps]
* [http://exactcodesign.org/proxy-app-software/ Exact mini-apps]
* [http://portal.nersc.gov/project/CAL/designforward.htm Design Forward mini-apps]
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of the DOE mini-apps]
* [https://hpgmg.org HPGMG mini-app]
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of the DOE mini-apps]
* [http://www.nas.nasa.gov/publications/npb.html NAS Benchmarks]


== Operating System and Runtime Software (OS/R) Program ==
== Operating System and Runtime Software (OS/R) Program ==
Line 21: Line 99:
* [[Hobbes|Hobbes]]
* [[Hobbes|Hobbes]]
* [[X-ARCC|X-ARCC]]
* [[X-ARCC|X-ARCC]]
* [[SC15 BOF|SC15 OS/R BOF]]
* [[media:SC16-BOF.pdf|SC16 BOF - Multi-Kernel OSes for Extreme-Scale HPC]]
* [[OS/R mailing list]]
* [[OS/R mailing list]]


== Coordinating Projects or Centers ==
== Coordinating Projects or Centers ==
* [http://sites.google.com/a/lbl.gov/codex/ CoDEx: CoDesign for Exascale]
* [http://www.cal-design.org/ Computer Architecture Laboratory (CAL) for Design Space Exploration]
* [http://www.exascaleinitiative.org/ Hardware Architecture Nexus: DOE Fast Forward and Design Forward Projects]
* [[Data Movement Dominates]]
* [https://ft.ornl.gov/trac/blackcomb Blackcomb: Hardware-Software Co-design for Non-Volatile Memory in Exascale Systems]
* [[MPI for Exascale|MPI for Exascale]]
* [[ExaCT|ExaCT: Center for Exascale Simulations of Combustion in Turbulence]]
* [[ExaCT|ExaCT: Center for Exascale Simulations of Combustion in Turbulence]]
* [[CESAR|CESAR: Center for Exascale Simulations of Advanced Reactors]]
* [[CESAR|CESAR: Center for Exascale Simulations of Advanced Reactors]]
* [[ExMatEX|ExMatEx: Exascale Co-Design Center for Materials in Extreme Environments]]
* [[ExMatEX|ExMatEx: Exascale Co-Design Center for Materials in Extreme Environments]]
* [[NWChem|NWChem: Self Consistent Field Module]]
* [[NWChem|NWChem: Self Consistent Field Module]]
* [http://portal.nersc.gov/project/CAL/doe-miniapps.htm Characterization of DOE Mini-Apps]
* [[DOE ASCR 2009 Early Career Projects]]
* [[DOE ASCR 2009 Early Career Projects]]
* [[DOE ASCR 2010 Early Career Projects]]
* [[DOE ASCR 2010 Early Career Projects]]
* [[DOE ASCR 2011 Early Career Projects]]
* [[DOE ASCR 2011 Early Career Projects]]
* [[DOE ASCR 2012 Early Career Projects]]
* [[DOE ASCR 2012 Early Career Projects]]
* [[DOE ASCR 2013 Early Career Projects]]
* [http://science.energy.gov/ascr/research/computer-science/xstack/ FY10-13 X-Stack Portfolio]
* [http://science.energy.gov/ascr/research/computer-science/xstack/ FY10-13 X-Stack Portfolio]
* [http://science.energy.gov/ascr/research/computer-science/aa/ FY10-13 Advanced Architectures Portfolio]
* [http://science.energy.gov/ascr/research/computer-science/aa/ FY10-13 Advanced Architectures Portfolio]
Line 37: Line 125:
* [http://science.energy.gov/ascr/research/computer-science/research-in-computer-architecture-modeling--and--evolving-mpi-for-exascale/ FY12 Unsolicited Portfolio]
* [http://science.energy.gov/ascr/research/computer-science/research-in-computer-architecture-modeling--and--evolving-mpi-for-exascale/ FY12 Unsolicited Portfolio]


== Meetings ==
== Related DOE programs ==
* [[9/17/12: X-Stack Portfolio Kickoff Meeting]], ported from [https://sites.google.com/site/xstackprogramreview/home 9/17/12: X-Stack Portfolio Kickoff Meeting]
* [http://www.exascaleinitiative.org: Fast Forward and Design Forward]
* [http://exascaleresearch.labworks.org/oct2012/ 10/4/12: Exascale Research Conference]
* [[3/20/13: X-Stack 6-Month PI Meeting]], ported from [https://sites.google.com/site/xstackpimeetingmarch2013/ 3/20/13: XStack 6-month PI meeting]
** [[March_20_2013_Panel_Sessions| Panel Sessions]]
** [[March_20_2013_Technology_Marketplace|Technology Marketplace]]
** [[March_20_2013_Technology_Users|Technology Users]]
* [[April_16_2014_OSR|4/16/14: OS/R Program Semi-Annual Meeting]]
* [[05/28/14:  X-Stack PI Meeting]]
** [[May 28-29_Panel_Sessions | Panel Sessions]]
** [[May 28-29_Meeting Presentations | Meeting Presentations]]
** [[May 28-29_Technology Marketplace Sessions | Technology Marketplace Sessions]]
 


== Software Stack Components ==
== Software Stack Taxonomy ==
We agreed at our Mar'13 PI meeting to generate tables of technology/issues for the various software stack components, as we did for the Languages component below. Please coordinate with your co-PIs and with other projects working on the various software stack components to generate tables for the topics below. If the lead shown below is incorrect, please correct.   
We agreed at our Mar'13 PI meeting to generate tables of technology/issues for the various software stack components, as we did for the Languages component below. Please coordinate with your co-PIs and with other projects working on the various software stack components to generate tables for the topics below. If the lead shown below is incorrect, please correct.   


* [[Communications|Communications]] - Costin Iancu
* [[Correctness Tools|Correctness Tools]] - Koushik Sen
* [[Compilers|Compilers]] - Dan Quinlan
* [[DSL's|DSLs]] - Saman Amarasinghe and Dan Quinlan
* [[DSL's|DSLs]] - Saman Amarasinghe and Dan Quinlan
* [[Scientific Libraries|Scientific Libraries]] - Milind Kulkarni
* [https://docs.google.com/a/lbl.gov/spreadsheet/ccc?key=0AnxagJH-lElndDE5OFF3YkVqUFQtOHY3alZveGlYTFE#gid=0 Languages] - Katherine Yelick
* [https://docs.google.com/a/lbl.gov/spreadsheet/ccc?key=0AnxagJH-lElndDE5OFF3YkVqUFQtOHY3alZveGlYTFE#gid=0 Languages] - Katherine Yelick
* [[Compilers|Compilers]] - Dan Quinlan
* [https://docs.google.com/spreadsheets/d/1WXRkzwZMfvpNJFz7Jaue5W3PzA30AtVUn0Vif-h0Afg/edit?usp=drive_web Libraries] - Sanjay Kale
* [https://docs.google.com/spreadsheets/d/1WXRkzwZMfvpNJFz7Jaue5W3PzA30AtVUn0Vif-h0Afg/edit#gid=0 Programming Libraries] - Sanjay Kale
* [[Runtimes (application-facing)]] - Shekhar Borkar
* [[Runtimes (os/hardware-facing)|Runtimes (os/hardware-facing)]] - Ron Brightwell
* [[Operating Systems|Operating Systems]] - Pete Beckman
* [[Operating Systems|Operating Systems]] - Pete Beckman
* [[Communications|Communications]] - Costin Iancu
* [[Correctness Tools|Correctness Tools]] - Koushik Sen
* [[Performance Tools|Performance Tools]] - John Mellor-Crummey
* [[Performance Tools|Performance Tools]] - John Mellor-Crummey
* [[Resilience|Resilience]] - Andrew Chien
* [[Resilience|Resilience]] - Andrew Chien
* [[Runtimes (application-facing)]] - Shekhar Borkar
* [[Runtimes (os/hardware-facing)|Runtimes (os/hardware-facing)]] - Ron Brightwell
* [[Scientific Libraries|Scientific Libraries]] - Milind Kulkarni
==Other Announcements==
* 3.9.2015:  IEEE special issue on [http://online.qmags.com/ISW0315 Release Engineering was published].  See [http://delivery.qmags.com/d/?pub=ISW&upid=19277&s=OL&fl=others%2fISW%2fISW_20150301_Mar_2015.pdf here] for pdf of issue.
* 10.13.2014:  Upcoming workshop at [https://www.orau.gov/machinelearning2015/ Machine Learning, Jan -7, 2015]
* 8.26.2014:[[media:Exascale_Software_Stack_Present_and_Future_-_PACT2014_-_pdf_version.pdf|"Exascale Software Stack: Present, Future"]], Sonia R. Sachs, presentation at PACT'2014
*8.26.2014:[[media:Exascale_Software_Stack_Present_and_Future_-_PACT2014_-_presentation_story.pdf|"Exascale Software Stack: Present, Future"]], presentation story
* 5.28.2014:  [[05/28/14:_X-Stack_PI_Meeting|May 28-29, 2014 PI Meeting]]
* 5.20.2014:  Some interesting TED talks on [http://www.npr.org/2013/07/13/197986218/why-we-collaborate Why we collaborate].
* 4.20.2014:  '''Modelado Foundation transitions wiki content'''.  All the xstackwiki content previously hosted at com has been transitioned to this wiki.  Please update your browser bookmarks appropriately.
* 7.9.2023: '''Modelado Foundation transitions wiki content'''.  All the xstackwiki content previously hosted at https://xstackwiki.modelado.org has now been moved to this wiki.  Please update your browser bookmarks appropriately. If you find any links that says 'not found ', just remove xstackwiki from the URL.

Latest revision as of 23:15, July 9, 2023

ModeladoZ.jpg

X-Stack Program and Projects

X-Stack Program Impact


X-Stack Program Products

X-Stack Technology Readiness

X-Stack and Related Meetings

X-Stack Software Components

DOE Mini-Apps and Benchmarks

Operating System and Runtime Software (OS/R) Program

Coordinating Projects or Centers

Related DOE programs

Software Stack Taxonomy

We agreed at our Mar'13 PI meeting to generate tables of technology/issues for the various software stack components, as we did for the Languages component below. Please coordinate with your co-PIs and with other projects working on the various software stack components to generate tables for the topics below. If the lead shown below is incorrect, please correct.

Other Announcements