A backtracking search tool for constructing combinatorial test suites

被引:33
作者
Yan, Jun [1 ]
Zhang, Jian [1 ]
机构
[1] Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, 4 South 4th St,POB 8718, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
software testing; combinatorial testing; optimal test set; covering array; orthogonal array;
D O I
10.1016/j.jss.2008.02.034
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Combinatorial testing is an important testing method. It requires the test cases to cover various combinations of parameters of the system under test. The test generation problem for combinatorial testing can be modeled as constructing a matrix which has certain properties. This paper first discusses two combinatorial testing criteria: covering array and orthogonal array, and then proposes a backtracking search algorithm to construct matrices satisfying them. Several search heuristics and symmetry breaking techniques are used to reduce the search time. This paper also introduces some techniques to generate large covering array instances from smaller ones. All the techniques have been implemented in a tool called EXACT (EXhaustive seArch of Combinatorial Test suites). A new optimal covering array is found by this tool. (C) 2008 Elsevier Inc. All rights reserved.
引用
收藏
页码:1681 / 1693
页数:13
相关论文
共 35 条
[1]   Orthogonal arrays of strength 3 and small run sizes [J].
Brouwer, Andries E. ;
Cohen, Arjeh M. ;
Nguyen, Man V. M. .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2006, 136 (09) :3268-3280
[2]   On the state of strength-three covering arrays [J].
Chateauneuf, M ;
Kreher, DL .
JOURNAL OF COMBINATORIAL DESIGNS, 2002, 10 (04) :217-238
[3]   Covering arrays of strength three [J].
Chateauneuf, MA ;
Colbourn, CJ ;
Kreher, DL .
DESIGNS CODES AND CRYPTOGRAPHY, 1999, 16 (03) :235-242
[4]   Gaseous nitrogen oxides stimulate cell cycle progression by rubidium phosphorylation via activation of cyclins/Cdks [J].
Chen, JH ;
Tseng, TH ;
Ho, YC ;
Lin, HH ;
Lin, WL ;
Wang, CJ .
TOXICOLOGICAL SCIENCES, 2003, 76 (01) :83-90
[5]   The AETG system: An approach to testing based on combinatorial design [J].
Cohen, DM ;
Dalal, SR ;
Fredman, ML ;
Patton, GC .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 1997, 23 (07) :437-444
[6]   Constructing test suites for interaction testing [J].
Cohen, MB ;
Gibbons, PB ;
Mugridge, WB ;
Colbourn, CJ .
25TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, PROCEEDINGS, 2003, :38-48
[7]  
Colbourn C. J., 2006, HDB COMBINATORIAL DE
[8]  
Colbourn Charles J, 2004, Le Matematiche, V59, P125
[9]   Products of mixed covering arrays of strength two [J].
Colbourn, CJ ;
Martirosyan, SS ;
Mullen, GL ;
Shasha, D ;
Sherwood, GB ;
Yucas, JL .
JOURNAL OF COMBINATORIAL DESIGNS, 2006, 14 (02) :124-138
[10]  
COLBOURN CJ, 2007, CA TABLES T 2 3 4 5