Hypergraph-partitioning-based decomposition for parallel sparse-matrix vector multiplication

被引:301
作者
Çatalyürek, ÜV [1 ]
Aykanat, C [1 ]
机构
[1] Bilkent Univ, Dept Comp Engn, TR-06533 Ankara, Turkey
关键词
sparse matrices; matrix multiplication; parallel processing; matrix decomposition; computational graph model; graph partitioning; computational hypergraph model; hypergraph partitioning;
D O I
10.1109/71.780863
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this work, we show that the standard graph-partitioning-based decomposition of sparse matrices does not reflect the actual communication volume requirement for parallel matrix-vector multiplication. We propose two computational hypergraph models which avoid this crucial deficiency of the graph model. The proposed models reduce the decomposition problem to the well-known hypergraph partitioning problem. The recently proposed successful multilevel framework is exploited to develop a multilevel hypergraph partitioning tool PaToH for the experimental verification of our proposed hypergraph models. Experimental results on a wide range of realistic sparse test matrices confirm the validity of the proposed hypergraph models. In the decomposition of the test matrices, the hypergraph models using PaToH and hMeTiS result in up to 63 percent less communication volume (30 to 38 percent less on the average) than the graph model using MeTiS, while PaToH is only 1.3-2.3 times slower than MeTiS on the average.
引用
收藏
页码:673 / 693
页数:21
相关论文
共 40 条
[1]   RECENT DIRECTIONS IN NETLIST PARTITIONING - A SURVEY [J].
ALPERT, CJ ;
KAHNG, AB .
INTEGRATION-THE VLSI JOURNAL, 1995, 19 (1-2) :1-81
[2]  
ALPERT CJ, 1996, HYBRID MULTILEVEL GE
[3]  
[Anonymous], 1970, BELL SYST TECH J, DOI [10.1002/j.1538-7305.1970.tb01770.x, DOI 10.1002/J.1538-7305.1970.TB01770.X]
[4]  
[Anonymous], 1993, MULTILEVEL ALGORITHM
[5]   ITERATIVE ALGORITHMS FOR SOLUTION OF LARGE SPARSE SYSTEMS OF LINEAR-EQUATIONS ON HYPERCUBES [J].
AYKANAT, C ;
OZGUNER, F ;
ERCAL, F ;
SADAYAPPAN, P .
IEEE TRANSACTIONS ON COMPUTERS, 1988, 37 (12) :1554-1568
[6]  
BUI TN, 1993, PROCEEDINGS OF THE SIXTH SIAM CONFERENCE ON PARALLEL PROCESSING FOR SCIENTIFIC COMPUTING, VOLS 1 AND 2, P445
[7]   A NEW MAPPING HEURISTIC BASED ON MEAN FIELD ANNEALING [J].
BULTAN, T ;
AYKANAT, C .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 1992, 16 (04) :292-305
[8]   MASSIVELY-PARALLEL METHODS FOR ENGINEERING AND SCIENCE PROBLEMS [J].
CAMP, WJ ;
PLIMPTON, SJ ;
HENDRICKSON, BA ;
LELAND, RW .
COMMUNICATIONS OF THE ACM, 1994, 37 (04) :31-41
[9]   AN EMPIRICAL-EVALUATION OF THE KORBX ALGORITHMS FOR MILITARY AIRLIFT APPLICATIONS [J].
CAROLAN, WJ ;
HILL, JE ;
KENNINGTON, JL ;
NIEMI, S ;
WICHMANN, SJ .
OPERATIONS RESEARCH, 1990, 38 (02) :240-248
[10]  
CATALYUREK UV, 1996, P 3 INT WORKSH PAR A, P175