PREDICTING FAULT-DIAGNOSIS PERFORMANCE - WHY ARE SOME BUGS HARD TO FIND

In some fault diagnosis situations, troubleshooters may not have a diagram of system structure or may misunderstand system structure and functioning. An experiment was designed to examine how a trou-bleshooter's mental model of a logic network might prejudice his or her ability to diagnose previously unseen faults. Subjects first inferred the structure of a logic network by viewing it in different states. Most subjects ended up with mental models of the network that were almost, but not completely, correct. Then, in a fault diagnosis phase, subjects diagnosed novel faults placed in the network by the experimenter. Faults involved the addition of new links or the deletion of existing links. In generating faults for subjects, two factors were varied in a 2 X 2 design: 1) whether a subject believed a link existed or not and 2) whether that belief was true or false. It was harder for subjects to detect that something was wrong with the network if the fault involved a network link they believed did not exist. However the ability to detect the symptoms of the fault was not always a guarantee of correct fault diagnosis. Subjects had difficulty diagnosing faults to do with links they believed did not exist, and found it impossible to diagnose faults that influenced parts of the network about which they had false beliefs. These results are discussed in the light of models of fault diagnosis latency and computer aiding of fault diagnosis. © 1990 IEEE