An overlap criterion is defined that connects the identification of core orbitals in a molecular system, which can be problematic, to that in isolated atoms, which is well defined. This approach has been tested on a variety of troublesome systems that have been identified in the literature, including molecules containing third-row main-group elements, and is shown to remove errors of up to 100 kcal/mol arising from an inconsistent treatment of core orbitals at different locations on a potential-energy surface. For some systems and choices of core orbitals, errors as large as 19 kcal/mol can be introduced even when consistent sets of orbitals are frozen, and the new method is shown to identify these cases of substantial core-valence mixing. Finally, even when there is limited core-valence mixing, the frozen-core approximation can introduce errors of more than 5 kcal/mol, which is much larger than the presumed accuracy of models such as G2 and CBS-QB3. The source of these errors includes interatomic core-core and core-valence dispersion forces.