A comparison of methods for evaluating the performance of a trained sensory panel

Cluster analysis, consonance analysis, principal component analysis (PCA) and the GRAPES program (Schlich 1994) were compared for the evaluation of panel performance. Ten judges evaluated 25 Merlot wines for 24 color, aroma and flavor attributes. Cluster analysis grouped similar judges. PCA identified judges according to their attribute use. Consonance analysis determined a numerical index for attribute agreement and the GRAPES program compared judges in their use of the scale, reliability, discrimination and disagreement. Three of the four techniques provided a graphical representation of similarities and differences between judges. Methodologies were best used in conjunction with one another. Ultimately the application of these tools will serve to improve the quality of sensory evaluations.