Actions

Open Community Runtime: Difference between revisions

From Modelado Foundation

imported>VivekSarkar
No edit summary
imported>Mjacobsen
 
(31 intermediate revisions by 5 users not shown)
Line 1: Line 1:
== Announcement ==
* OCR v1.1.0 released ! [[Open_Community_Runtime#Links|Links]]
== Goal ==
== Goal ==
The goal of the Open Community Runtime (OCR) project is to propose, implement, and evaluate a runtime framework and API that:
The goal of the Open Community Runtime (OCR) project is to propose, implement, and evaluate a runtime framework and API that:
Line 9: Line 12:
   
   
== Audience ==  
== Audience ==  
In its current state, the project aims to release a '''prototype implementation''' of a reference API by September 2015, while making work-in-pogress transparently visible at the github location mentioned below.  As such, the project is mostly geared towards early adopters among application developers who would like to provide feedback on the runtime model and API,  higher-level language/models implementers who are interested in determining if their model can map to OCR, hardware developers who would like to experiment with OCR as a proxy for an exascale runtime, and runtime developers who are interested in using and/or contributing to OCR.
In its current state, the project aims to release a '''prototype implementation''' of a reference API by September 2015, while making work-in-pogress transparently visible at the git location mentioned below.  As such, the project is mostly geared towards early adopters among application developers who would like to provide feedback on the runtime model and API,  higher-level language/models implementers who are interested in determining if their model can map to OCR, hardware developers who would like to experiment with OCR as a proxy for an exascale runtime, and runtime developers who are interested in using and/or contributing to OCR.
   
   
== Value of the OCR project ==
== Value of the OCR project ==
Line 18: Line 21:
* Resiliency: how can a runtime system deal with failures in an exascale system?
* Resiliency: how can a runtime system deal with failures in an exascale system?


The OCR project aims to propose a low-level API to address the challenges of exascale programming and is meant to be targeted by higher-level abstractions.  Early implementations of higher-level abstractions that target OCR include the CnC programming model, the Habanero-C library, and the Habanero-UPC++ library.
The OCR project aims to propose a low-level API to address the challenges of exascale programming and is meant to be targeted by higher-level abstractions.  Early implementations of higher-level abstractions that target OCR include the CnC programming model, the HTA programming model, the RStream compiler, the Habanero-C library, and the Habanero-UPC++ library.


== Timeline ==
== Timeline ==
Line 25: Line 28:
* v0.8 was introduced at SC 2013 with a significant rewrite to increase modularity and enable more community participation
* v0.8 was introduced at SC 2013 with a significant rewrite to increase modularity and enable more community participation
* v0.9 will be presented at SC 2014 with several updates (including support for execution on distributed-memory clusters)
* v0.9 will be presented at SC 2014 with several updates (including support for execution on distributed-memory clusters)
* v1.0 released on May 31, 2015
== Links ==
* v1.0.2 released on April 5, 2016
* The source code is available on [https://github.com/01org/ocr GitHub]
* v1.1.0 released on April 5, 2016
* Mailing lists are available [https://lists.01.org/mailman/listinfo/ocr-discuss here]


== Install Instructions for Distributed-OCR ==
== Quick Start Instructions ==
The 'sc14' github branch contains the most recent OCR implementation publicly available.
Things will be streamlined along the way.


== Checking out the code ==
To get the OCR v1.1.0 release:
 
<ol>
<pre>
<li> Download the [https://xstack.exascale-tech.com/git/public?p=ocr.git;a=blob;f=ocr/spec/ocr-1.1.0.pdf;h=c99da3076b6126714c63753295de82cf13c16e77;hb=HEAD OCR v1.1.0 Specification]  </li>
git clone https://github.com/01org/ocr.git
<li> Clone the repository using git <pre>
git clone https://xstack.exascale-tech.com/git/public/ocr.git ocr
git clone https://xstack.exascale-tech.com/git/public/apps.git apps
</pre>
</li>
<li> Follow OCR installation instructions located under ocr/INSTALL.make </li>
</ol>
To get the latest, in development, version of OCR:
<ol>
<li> Clone the repository using git
<pre>git clone https://xstack.exascale-tech.com/git/public/ocr.git
cd ocr
cd ocr
git branch sc14 --track origin/sc14
git checkout dev/master
git checkout sc14
</pre>
</pre>
</li>
<li> Follow OCR installation instructions located under ocr/INSTALL.make </li>
</ol>


== Environment setup ==
== Links ==
 
* [https://xstg.modelado.org/xstack-wiki/Quick_Start Quick-start] web page to download, build, and run the OCR code on some sample applications
From the checked-out ocr folder setup the following environment variable.
* [https://xstg.modelado.org/xstack-wiki/Getting_Started Getting started] with OCR
 
* [https://xstg.modelado.org/git/public?p=ocr.git;a=blob;f=ocr/spec/ocr-1.1.0.pdf;h=c99da3076b6126714c63753295de82cf13c16e77;hb=HEAD OCR v1.1.0 Specification]
<pre>
* [https://xstg.modelado.org/xstack-wiki/Main_Page OCR Documentation]: Specification and guides/how-to documents are online, along with best-practices information
export OCR_INSTALL_ROOT=$PWD/install
* [https://xstg.modelado.org/git/public/ocr.git OCR Source Code]: The OCR source code is available as a git repository to be cloned
export OCR_SRC=$PWD
* [https://xstg.modelado.org/git/public?p=apps.git;a=tree;f=apps;hb=refs/heads/dev/master Applications]: Many applications and common HPC kernels are included in the git code repository
export OCR_BUILD_ROOT=$PWD/build
* [https://xstg.modelado.org/git/public?p=apps.git;a=tree;f=hll;hb=refs/heads/dev/master Productivity Environments]: Support for productivity environments, including CNC, RStream, Habanero C, and HTA
export APPS_ROOT=$PWD/ocr-apps
* [https://xstg.modelado.org/git/public?p=apps.git;a=tree;f=apps/libs/src/mpilite Legacy Support]: Legacy C environment support and an MPI implementation are included for easier code migration
</pre>
* Mailing lists are available [https://xstg.modelado.org/xstack-wiki/Main_Page#Code_Repositories_and_Mailing_Lists here]
 
== Compiling and Running Applications ==
 
The ocr-apps folder contains various applications. Those applications
relies on pre-defined makefiles to ease compiling and linking against the OCR
interface.
 
The general pattern to get an OCR application to run is as follow:
* Select a target platform
* Invoke the corresponding Makefile to build the application
* Select an OCR configuration file
* Invoke the corresponding Makefile to run the application
 
For instance, the npbCG application defines Makefiles for the following targets:
* x86-pthread-x86: for shared-memory OCR
* x86-pthread-mpi: for distributed-memory OCR relying on MPI for communications.
 
Hence to build npbCG for distributed, one executes the following command:
 
<pre>
make -f Makefile.x86-pthread-mpi prerun install
</pre>
 
Note that the Makefile checks if the runtime needs to be built too.
 
Once the application is built for distributed a configuration file must be provided. OCR relies on text-based configuration files to setup runtime instances. Some sample configuration files are available under machine-configs/
 
<pre>
export OCR_CONFIG=/path/to/configfile
</pre>
 
Additionally, one can point to file containing hostname to use for the the distributed run
 
<pre>
export OCR_NODEFILE=/path/to/nodefile
</pre>
 
Running the application can be done through the Makefile system as well:
 
<pre>
make -f Makefile.x86-pthread-mpi run WORKLOAD_ARGS"-t B -b 1000"
</pre>

Latest revision as of 01:04, August 9, 2018

Announcement

  • OCR v1.1.0 released ! Links

Goal

The goal of the Open Community Runtime (OCR) project is to propose, implement, and evaluate a runtime framework and API that:

  • Is representative of future execution models
  • Can express large amounts of parallelism in a task-based model
  • Can explicitly capture logical dependences and data movements
  • Can be targeted by multiple high-level programming systems
  • Can be mapped efficiently on to future extreme scale platforms
  • Is available as an open-source testbed

Audience

In its current state, the project aims to release a prototype implementation of a reference API by September 2015, while making work-in-pogress transparently visible at the git location mentioned below. As such, the project is mostly geared towards early adopters among application developers who would like to provide feedback on the runtime model and API, higher-level language/models implementers who are interested in determining if their model can map to OCR, hardware developers who would like to experiment with OCR as a proxy for an exascale runtime, and runtime developers who are interested in using and/or contributing to OCR.

Value of the OCR project

The OCR project is creating an application building framework that explores new methods of high-core-count programming with an initial focus on HPC applications. The project aims to explore, among other things:

  • Expressiveness: how can application programmers express their applications in a hardware-agnostic manner; i.e.: how can they express the intrinsic parallelism and locality in an application as opposed to the mapping on to a particular kind of hardware?
  • Scheduling and data placement: what tuning hints and adaptive heuristics can enable locality-aware scheduling and data-placement on an exascale system?
  • Introspection: how can a runtime system improve its execution characteristics by monitoring itself?
  • Resiliency: how can a runtime system deal with failures in an exascale system?

The OCR project aims to propose a low-level API to address the challenges of exascale programming and is meant to be targeted by higher-level abstractions. Early implementations of higher-level abstractions that target OCR include the CnC programming model, the HTA programming model, the RStream compiler, the Habanero-C library, and the Habanero-UPC++ library.

Timeline

The OCR software is available under the BSD open source license.

  • Initial unveiling at SC 2012
  • v0.8 was introduced at SC 2013 with a significant rewrite to increase modularity and enable more community participation
  • v0.9 will be presented at SC 2014 with several updates (including support for execution on distributed-memory clusters)
  • v1.0 released on May 31, 2015
  • v1.0.2 released on April 5, 2016
  • v1.1.0 released on April 5, 2016

Quick Start Instructions

To get the OCR v1.1.0 release:

  1. Download the OCR v1.1.0 Specification
  2. Clone the repository using git 
    git clone https://xstack.exascale-tech.com/git/public/ocr.git ocr
git clone https://xstack.exascale-tech.com/git/public/apps.git apps
  3. Follow OCR installation instructions located under ocr/INSTALL.make

To get the latest, in development, version of OCR:

  1. Clone the repository using git 
    git clone https://xstack.exascale-tech.com/git/public/ocr.git
cd ocr
git checkout dev/master
  2. Follow OCR installation instructions located under ocr/INSTALL.make

Links

Retrieved from "https://modelado.org/index.php?title=Open_Community_Runtime&oldid=4220"