Prior distribution assessment for a multivariate normal distribution: an experimental study

A variety of methods of eliciting a prior distribution for a multivariate normal (MVN) distribution have recently been proposed. This paper reports an experiment in which 16 meteorologists used the methods to quantify their opinions about climatology variables. Our results compare prior models and show, in particular, that it can be better to assume the mean and variance of an MVN distribution are independent a priori, rather than to model opinion by the conjugate prior distribution. Using a proper scoring rule, different forms of assessment task are examined and alternative ways of estimating parameters are compared. To quantify opinion about means, it proved preferable to ask directly about the means rather than individual observations while, to quantify opinion about the variance matrix, it was best to ask about deviations from the mean. Further results include recommendations for the way parameters of the prior distribution are estimated.