Design principles for developing stream processing applications

被引：15

作者：

Turaga, Deepak ^{[1
]}

Andrade, Henrique ^{[1
]}

Gedik, Bugra ^{[1
]}

Venkatramani, Chitra ^{[1
]}

Verscheure, Olivier ^{[1
]}

Harris, Jeffrey David ^{[2
]}

Cox, John ^{[2
]}

Szewczyk, William ^{[2
]}

Jones, Paul ^{[3
]}

机构：

[1] IBM Res Corp, Hawthorne, NY 10532 USA

[2] US Govt, Washington, DC USA

[3] HM Govt, London, England

来源：

SOFTWARE-PRACTICE & EXPERIENCE | 2010年 / 40卷 / 12期

关键词：

design principles; stream processing applications; System S; Spade;

D O I：

10.1002/spe.993

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

Stream processing applications are used to ingest, process, and analyze continuous data streams from heterogeneous sources of live and stored data, generating streams of output results. These applications are, in many cases, complex, large- scale, low- latency, and distributed in nature. In this paper, we describe the design principles and architectural underpinnings for stream processing applications. These principles are distilled from our experience in building real- world applications both for internal use as well as with customers from several industrial and academic domains. We provide principles, guidelines, as well as appropriate implementation examples to highlight the different aspects of stream processing application design and development. Copyright (C) 2010 John Wiley & Sons, Ltd.

引用

页码：1073 / 1104

页数：32

共 59 条

[1]

Abadi DJ., 2005, CIDR, V5, P277

[2]

AGGARWAL C, 2006, DATA STREAMS MODELS, pCH9

[3]

AMINI L, 2006, P WORKSH DAT MIN STA

[4] Scale-up Strategies for Processing High-Rate Data Streams in System S [J].

Andrade, Henrique ;

Gedik, Bugra ;

Wu, Kun-Lung ;

Yu, Philip S. .

ICDE: 2009 IEEE 25TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, VOLS 1-3, 2009, :1375-+

[5]

[Anonymous], 2006, P 15 INT C WORLD WID, DOI DOI 10.1145/1135777.1135794

[6]

[Anonymous], 2006, Data Streams: Models and Algorithms (Advances in Database Systems)

[7]

[Anonymous], 2009, INTEL OPEN SOURCE CO

[8]

[Anonymous], 2004, Feedback Control of Computing Systems

[9]

Arasu A., 2003, IEEE Data Engineering Bulletin, V26

[10]

BABCOCK B, 2007, DATA STREAMS MODELS, pCH7

← 1 2 3 4 5 6 →