An orchestrated survey of methodologies for automated software test case generation

被引:416
作者
Anand, Saswat [1 ]
Burke, Edmund K. [2 ]
Chen, Tsong Yueh [3 ]
Clark, John [4 ]
Cohen, Myra B. [5 ]
Grieskamp, Wolfgang [6 ]
Harman, Mark [7 ]
Harrold, Mary Jean [8 ]
McMinn, Phil [9 ]
Bertolino, Antonia [10 ]
Li, J. Jenny [11 ]
Zhu, Hong [12 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[2] Univ Stirling, Stirling FK9 4LA, Scotland
[3] Swinburne Univ Technol, Hawthorn, Vic 3122, Australia
[4] Univ York, York YO10 5DD, N Yorkshire, England
[5] Univ Nebraska Lincoln, Dept Comp Sci & Engn, Lincoln, NE USA
[6] Microsoft Res, Redmond, WA USA
[7] UCL, Dept Comp Sci, London WC1E 6BT, England
[8] Georgia Inst Technol, Sch Comp Sci, Atlanta, GA 30332 USA
[9] Univ Sheffield, Sheffield S10 2TN, S Yorkshire, England
[10] CNR, ISTI, I-00185 Rome, Italy
[11] Avaya Labs Res, Basking Ridge, NJ USA
[12] Oxford Brookes Univ, Oxford OX3 0BP, England
基金
美国国家科学基金会; 英国工程与自然科学研究理事会;
关键词
Adaptive random testing; Combinatorial testing; Model-based testing; Orchestrated survey; Search-based software testing; Software testing; Symbolic execution; Test automation; Test case generation; REAL-TIME SYSTEMS; MODEL-CHECKING; EVOLUTIONARY APPROACH; COVERING ARRAYS; TEST SUITES; SEARCH; COVERAGE; DESIGN; STRATEGY; ARCHITECTURE;
D O I
10.1016/j.jss.2013.02.061
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Test case generation is among the most labour-intensive tasks in software testing. It also has a strong impact on the effectiveness and efficiency of software testing. For these reasons, it has been one of the most active research topics in software testing for several decades, resulting in many different approaches and tools. This paper presents an orchestrated survey of the most prominent techniques for automatic generation of software test cases, reviewed in self-standing sections. The techniques presented include: (a) structural testing using symbolic execution, (b) model-based testing, (c) combinatorial testing, (d) random testing and its variant of adaptive random testing, and (e) search-based testing. Each section is contributed by world-renowned active researchers on the technique, and briefly covers the basic ideas underlying the method, the current state of the art, a discussion of the open research problems, and a perspective of the future development of the approach. As a whole, the paper aims at giving an introductory, up-to-date and (relatively) short overview of research in automatic test case generation, while ensuring a comprehensive and authoritative treatment. (c) 2013 Elsevier Inc. All rights reserved.
引用
收藏
页码:1978 / 2001
页数:24
相关论文
共 243 条
[1]  
Aarts F, 2010, LECT NOTES COMPUT SC, V6269, P71, DOI 10.1007/978-3-642-15375-4_6
[2]  
Abrial Jean-Raymond, 1996, The B-Book - Assigning Programs to Meanings
[3]  
Adamopoulos K, 2004, LECT NOTES COMPUT SC, V3103, P1338
[4]   A systematic review of search-based testing for non-functional system properties [J].
Afzal, Wasif ;
Torkar, Richard ;
Feldt, Robert .
INFORMATION AND SOFTWARE TECHNOLOGY, 2009, 51 (06) :957-976
[5]  
Aho A.V., 1988, P IEEE 8 INT S PROT, P75
[6]   A Systematic Review of the Application and Empirical Investigation of Search-Based Test Case Generation [J].
Ali, Shaukat ;
Briand, Lionel C. ;
Hemmati, Hadi ;
Panesar-Walawege, Rajwinder K. .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2010, 36 (06) :742-762
[7]  
Alshahwan N., 2011, 2011 26th IEEE/ACM International Conference on Automated Software Engineering, P3, DOI 10.1109/ASE.2011.6100082
[8]  
Alur R, 1998, LECT NOTES COMPUT SC, V1466, P163, DOI 10.1007/BFb0055622
[9]  
Anand S., 2011, 2011 26th IEEE/ACM International Conference on Automated Software Engineering, P33, DOI 10.1109/ASE.2011.6100071
[10]   Symbolic execution with abstraction [J].
Anand S. ;
Pǎsǎreanu C.S. ;
Visser W. .
International Journal on Software Tools for Technology Transfer, 2009, 11 (01) :53-67