The story picturing engine-A system for automatic text illustration

被引：55

作者：

Joshi, Dhiraj ^{[1
]}

Wang, James Z. ^{[1
]}

Li, Jia ^{[1
]}

机构：

[1] Penn State Univ, University Pk, PA 16802 USA

来源：

ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS | 2006年 / 2卷 / 01期

关键词：

algorithms; design; experimentation; human factors; story picturing; lexical referencing; image retrieval; mutual reinforcement; Markov chain;

D O I：

10.1145/1126004.1126008

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We present an unsupervised approach to automated story picturing. Semantic keywords are extracted from the story, an annotated image database is searched. Thereafter, a novel image ranking scheme automatically determines the importance of each image. Both lexical annotations and visual content play a role in determining the ranks. Annotations are processed using the Wordnet. A mutual reinforcement-based rank is calculated for each image. We have implemented the methods in our Story Picturing Engine (SPE) system. Experiments on large-scale image databases are reported. A user study has been performed and statistical analysis of the results has been presented.

引用

页码：68 / 89

页数：22

共 29 条

[1]

AGOSTI M, 2000, LECT NOTES COMPUTER, V1980

[2]

[Anonymous], 1998, Proceedings of the 7th international conference on World Wide Web (WWW), DOI [10.1016/S0169-7552(98)00110-X, DOI 10.1016/S0169-7552(98)00110-X]

[3] Matching words and pictures [J].

Barnard, K ;

Duygulu, P ;

Forsyth, D ;

de Freitas, N ;

Blei, DM ;

Jordan, MI .

JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (06) :1107-1135

[4]

Barnard K, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, P408, DOI 10.1109/ICCV.2001.937654

[5]

Blei D., 2003, P 26 ANN INT ACM SIG, P127, DOI DOI 10.1145/860435.860460

[6]

BROWN DC, 1981, ACM SIGGRAPH COMPUT, V15, P174

[7]

BUDANTSKY A, 2001, NAACL WORKSH WORDNET

[8]

Carneiro G., 2005, SIGIR 2005. Proceedings of the Twenty-Eighth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P559, DOI 10.1145/1076034.1076129

[9] Blobworld: Image segmentation using expectation-maximization and its application to image querying [J].

Carson, C ;

Belongie, S ;

Greenspan, H ;

Malik, J .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (08) :1026-1038

[10]

Chen CC, 2005, INT J DIGIT LIBRARIE, V5, P275, DOI 10.1007/s00799-004-0097-5

← 1 2 3 →