An approximate entropy test for randomness

被引:8
作者
Chatterjee, S
Yilmaz, MR
Habibullah, M
Laudato, M
机构
[1] Northeastern Univ, Coll Business Adm, Boston, MA 02115 USA
[2] Software Com, Lexington, MA 02173 USA
关键词
approximate entropy; dependent binary data; runs test; power;
D O I
10.1080/03610920008832508
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We develop an entropy-based test for randomness of binary time series of finite length. The test uses the frequencies of contiguous blocks of different lengths. A simple condition on the block lengths and the length of the time series enables one to estimate the entropy rate for the data, and this information is used to develop a statistic to test the hypothesis of randomness. This statistic measures the deviation of the estimated entropy of the observed data from the theoretical maximum under the randomness hypothesis. This test offers a real alternative to the conventional runs test. Critical percentage points, based on simulations, are provided for testing the hypothesis of randomness. Power calculations using dependent data show that the proposed test has higher power against the runs test for short series, and it is similar to the runs test for long series. The test is applied to two published data sets that were investigated by others with respect to their randomness.
引用
收藏
页码:655 / 675
页数:21
相关论文
共 23 条
[1]  
[Anonymous], 1998, Randomness
[2]   A sampler of randomness [J].
Bassein, S .
AMERICAN MATHEMATICAL MONTHLY, 1996, 103 (06) :483-490
[3]  
Bloom D M., 1998, The College Mathematics Journal, V29, P120, DOI DOI 10.2307/2687703
[4]   THEORY OF PROGRAM SIZE FORMALLY IDENTICAL TO INFORMATION-THEORY [J].
CHAITIN, GJ .
JOURNAL OF THE ACM, 1975, 22 (03) :329-340
[5]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
[6]   THE HOT HAND IN BASKETBALL - ON THE MISPERCEPTION OF RANDOM SEQUENCES [J].
GILOVICH, T ;
VALLONE, R ;
TVERSKY, A .
COGNITIVE PSYCHOLOGY, 1985, 17 (03) :295-314
[7]   ALGORITHMS AND RANDOMNESS [J].
KOLMOGOROV, AN ;
USPENSKII, VA .
THEORY OF PROBABILITY AND ITS APPLICATIONS, 1988, 32 (03) :389-412
[8]  
KULLBACK S, 1958, INFORMATION THEORY S
[9]   The covariance matrix of runs up and down [J].
Levene, H ;
Wolfowitz, JN .
ANNALS OF MATHEMATICAL STATISTICS, 1944, 15 :58-69
[10]   DEFINITION OF RANDOM SEQUENCES [J].
MARTINLOF, P .
INFORMATION AND CONTROL, 1966, 9 (06) :602-+