Performance Tools
From Modelado Foundation
| QUESTIONS | XPRESS | TG X-Stack | DEGAS | D-TEC | DynAX | X-TUNE | GVR | CORVETTE | SLEEC | PIPER | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| What performance information would an application developer need to know about software developed in your X-Stack project? | ||||||||||||||||||||||||||||||||
| What performance information would a code developer in your project need to know about your software? | ||||||||||||||||||||||||||||||||
| What information should a performance tool use to gather from each level in your software stack? What information should each level of your software stack maintain for inspection by performance tools? | ||||||||||||||||||||||||||||||||
| What types of performance problems do you want tools to measure and diagnose? Insufficient parallelism? Serialization? Load-imbalance? Task dependences? |
- style="vertical-align:top;" |
What kinds of performance problems do you foresee analyzing using post-mortem analysis? |
- style="vertical-align:top;" |
What kinds of performance problems do you foresee analyzing using on-the-fly analysis? What interfaces will be needed to gather the necessary information? What control interfaces will be necessary to enable runtime adaptation based on performance measurements? | ||||||||||||||||||||||||||||
| Current auto-tuning and performance/precision debugging tools treat the program as a black-box. What kind of white-box program analysis techniques can help in auto-tuning your application with floating-point precision and alternative algorithms? | ||||||||||||||||||||||||||||||||
| What kind of testing strategy do you normally apply while developing your software component? Do you write tests before or after the development process? What kind of coverage do you try to achieve? Do you write small unit tests or large systems tests to achieve coverage? Are your tests non-deterministic? | ||||||||||||||||||||||||||||||||
| After a bug is discovered, do you want automated support to create a simplified test that will reproduce the bug? | ||||||||||||||||||||||||||||||||
| What is your strategy to debug a DSL and its runtime? What kind of multi-level debugging support do you want for DSLs? | ||||||||||||||||||||||||||||||||
| What kind of visualization and presentation support for bugs do you want from correctness tools? What kind of IDE integration do you want for the correctness tools? | ||||||||||||||||||||||||||||||||
| When combining various languages/runtimes, can your language/runtime be debugged in isolation from the rest of the system? | ||||||||||||||||||||||||||||||||
| List the performance challenges that you think the next generation programming languages and models would face? | ||||||||||||||||||||||||||||||||
| How can performance tools help with reasoning about energy? How can performance tools help with resilience? |