Submitted by webmaster on
| Title | Hierarchical DAG scheduling for Hybrid Distributed Systems |
| Publication Type | Conference Paper |
| Year of Publication | 2015 |
| Authors | Wu, W., A. Bouteiller, G. Bosilca, M. Faverge, and J. Dongarra |
| Conference Name | 29th IEEE International Parallel & Distributed Processing Symposium (IPDPS) |
| Date Published | 2015-05 |
| Publisher | IEEE |
| Conference Location | Hyderabad, India |
| Keywords | dense linear algebra, gpu, heterogeneous architecture, PaRSEC runtime |
| Abstract | Accelerator-enhanced computing platforms have drawn a lot of attention due to their massive peak com-putational capacity. Despite significant advances in the pro-gramming interfaces to such hybrid architectures, traditional programming paradigms struggle mapping the resulting multi-dimensional heterogeneity and the expression of algorithm parallelism, resulting in sub-optimal effective performance. Task-based programming paradigms have the capability to alleviate some of the programming challenges on distributed hybrid many-core architectures. In this paper we take this concept a step further by showing that the potential of task-based programming paradigms can be greatly increased with minimal modification of the underlying runtime combined with the right algorithmic changes. We propose two novel recursive algorithmic variants for one-sided factorizations and describe the changes to the PaRSEC task-scheduling runtime to build a framework where the task granularity is dynamically adjusted to adapt the degree of available parallelism and kernel effi-ciency according to runtime conditions. Based on an extensive set of results we show that, with one-sided factorizations, i.e. Cholesky and QR, a carefully written algorithm, supported by an adaptive tasks-based runtime, is capable of reaching a degree of performance and scalability never achieved before in distributed hybrid environments. |
File:
External Publication Flag:
