Complexity Results for Throughput and Latency Optimization of Replicated and Data-parallel Workflows

被引:12
作者
Benoit, Anne [1 ]
Robert, Yves [1 ]
机构
[1] Ecole Normale Super Lyon, LIP, F-69364 Lyon 07, France
关键词
Pipeline graphs; Fork graphs; Scheduling algorithms; Throughput maximization; Latency minimization; Bi-criteria optimization; Heterogeneous platforms; Complexity results; EFFICIENT COLLECTIVE COMMUNICATION; PARTITIONING PROBLEMS; ALGORITHMS; PERFORMANCE; SKELETONS;
D O I
10.1007/s00453-008-9229-4
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Mapping applications onto parallel platforms is a challenging problem, even for simple application patterns such as pipeline or fork graphs. Several antagonist criteria should be optimized for workflow applications, such as throughput and latency (or a combination). In this paper, we consider a simplified model with no communication cost, and we provide an exhaustive list of complexity results for different problem instances. Pipeline or fork stages can be replicated in order to increase the throughput by sending consecutive data sets onto different processors. In some cases, stages can also be data-parallelized, i.e. the computation of one single data set is shared between several processors. This leads to a decrease of the latency and an increase of the throughput. Some instances of this simple model are shown to be NP-hard, thereby exposing the inherent complexity of the mapping problem. We provide polynomial algorithms for other problem instances. Altogether, we provide solid theoretical foundations for the study of mono-criterion or bi-criteria mapping optimization problems.
引用
收藏
页码:689 / 724
页数:36
相关论文
共 32 条
[1]   On exploiting task duplication in parallel program scheduling [J].
Ahmad, I ;
Kwok, YK .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1998, 9 (09) :872-892
[2]  
Amdahl, 1967, AFIPS C P, P483, DOI DOI 10.1145/1465482.1465560
[3]  
[Anonymous], 1979, Computers and Intractablity: A Guide to the Theory of NP-Completeness
[4]  
Beaumont O, 2004, ISPDC 2004: THIRD INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED COMPUTING/HETEROPAR '04: THIRD INTERNATIONAL WORKSHOP ON ALGORITHMS, MODELS AND TOOLS FOR PARALLEL COMPUTING ON HETEROGENEOUS NETWORKS, PROCEEDINGS, P296
[5]   Mapping pipeline skeletons onto heterogeneous platforms [J].
Benoit, Anne ;
Robert, Yves .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2008, 68 (06) :790-808
[6]   Optimizing execution of component-based applications using group instances [J].
Beynon, MD ;
Kurc, T ;
Sussman, A ;
Saltz, J .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2002, 18 (04) :435-448
[7]   Efficient collective communication in distributed heterogeneous systems [J].
Bhat, PB ;
Raghavendra, CS ;
Prasanna, VK .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2003, 63 (03) :251-263
[8]   Efficient collective communication in distributed heterogeneous systems [J].
Bhat, PB ;
Raghavendra, CS ;
Prasanna, VK .
19TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, PROCEEDINGS, 1999, :15-24
[9]   PARTITIONING PROBLEMS IN PARALLEL, PIPELINED, AND DISTRIBUTED COMPUTING [J].
BOKHARI, SH .
IEEE TRANSACTIONS ON COMPUTERS, 1988, 37 (01) :48-57
[10]   Honeycomb rectangular disks [J].
Teng, YH ;
Tan, JJM ;
Hsu, LH .
PARALLEL COMPUTING, 2005, 31 (3-4) :371-388