Another potential shortcoming of AHP

In the last twenty years many features of Saaty's Analytical Hierarchy Process (AHP) have been criticised, especially the additive hierarchical composition of conventional AHP, which leads to the possibility of occurrence of the Rank Reversal phenomenon (adding an irrelevant alternative may cause a reversal in the ranking at the top). In this paper we show another feature of AHP which may be, and in many application contexts will indeed be, an even stronger shortcoming of the method. It consists in the fact that the addition of indifferent criteria (for which all alternatives perform equally) causes a significant alteration of the aggregated priorities of alternatives, with important consequences. In hierarchies with four or more levels, rank reversal may happen. Since in almost all applications of AHP the set of criteria is not fixed ex-ante but is variable and is constructed in accordance with reasons of relevance and simplicity, almost all applications of AHP are potentially flawed.