A complex network approach to text summarization

被引:90
作者
Antiqueira, Lucas [1 ]
Oliveira, Osvaldo N., Jr. [1 ]
Costa, Luciano da Fontoura [1 ]
Volpe Nunes, Maria das Gracas [2 ]
机构
[1] Univ Sao Paulo, Inst Fis Sao Carlos, BR-13560970 Sao Paulo, Brazil
[2] Univ Sao Paulo, Inst Ciencias Matemat & Computacao, BR-13560970 Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Automatic summarization; Complex networks; Network measurements; Sentence extraction; Summary informativeness; LANGUAGE; TOOL;
D O I
10.1016/j.ins.2008.10.032
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Automatic summarization of texts is now crucial for several information retrieval tasks owing to the huge amount of information available in digital media, which has increased the demand for simple, language-independent extractive summarization strategies. In this paper, we employ concepts and metrics of complex networks to select sentences for an extractive summary. The graph or network representing one piece of text consists of nodes corresponding to sentences, while edges connect sentences that share common meaningful nouns. Because various metrics could be used, we developed a set of 14 summarizers, generically referred to as CN-Summ, employing network concepts such as node degree, length of shortest paths, d-rings and k-cores. An additional summarizer was created which selects the highest ranked sentences in the 14 systems, as in a voting system. When applied to a corpus of Brazilian Portuguese texts, some CN-Summ versions performed better than summarizers that do not employ deep linguistic knowledge, with results comparable to state-of-the-art summarizers based on expensive linguistic resources. The use of complex networks to represent texts appears therefore as suitable for automatic summarization, consistent with the belief that the metrics of such networks may capture important text features. (c) 2008 Elsevier Inc. All rights reserved.
引用
收藏
页码:584 / 599
页数:16
相关论文
共 69 条
[1]   Statistical mechanics of complex networks [J].
Albert, R ;
Barabási, AL .
REVIEWS OF MODERN PHYSICS, 2002, 74 (01) :47-97
[2]  
ALUISIO SM, 2000, NILCTR002
[3]   Complex networks analysis of manual and machine translations [J].
Amancio, Diego R. ;
Antiqueira, Lucas ;
Pardo, Thiago A. S. ;
Costa, Luciano da F. ;
Oliveira, Osvaldo N., Jr. ;
Nunes, Maria G. V. .
INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 2008, 19 (04) :583-598
[4]  
[Anonymous], P 4 BRAZ M ART INT E
[5]   Strong correlations between text quality and complex networks features [J].
Antiqueira, L. ;
Nunes, M. G. V. ;
Oliveira, O. N., Jr. ;
Costa, L. da F. .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2007, 373 :811-820
[6]  
ANTIQUEIRA L, 2006, P 4 WORKSH INF HUM L
[7]   Emergence of scaling in random networks [J].
Barabási, AL ;
Albert, R .
SCIENCE, 1999, 286 (5439) :509-512
[8]  
Barzilay R, 1999, ADVANCES IN AUTOMATIC TEXT SUMMARIZATION, P111
[9]  
Batagelj V, 1999, LECT NOTES COMPUT SC, V1731, P90
[10]   Complex networks: Structure and dynamics [J].
Boccaletti, S. ;
Latora, V. ;
Moreno, Y. ;
Chavez, M. ;
Hwang, D. -U. .
PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS, 2006, 424 (4-5) :175-308