Measuring CAMD technique performance: A virtual screening case study in the design of validation experiments

The dynamic nature and comparatively young age of computational chemistry is such that novel algorithms continue to be developed at a rapid pace. Such efforts are often wrought at the expense of extensive experimental validations of said techniques, preventing a deeper understanding of their potential utility and limitations. Here we address this issue for ligand-based virtual screening descriptors through design of validation experiments that better reflect the aims of real world application. Applying the newly defined chemotype enrichment approach, a variety of two- and three-dimensional (2D/3D) similarity descriptors have been compared extensively across data sets from four diverse target types. The inhibitors within said data sets contain molecules exhibiting a wide array of substructure functionality, size and flexibility, permitting descriptor comparison in myriad settings. Relative descriptor performance under these conditions is examined, including results obtained using more typical virtual screening validation experiments. Guidelines for optimal application of said descriptors are also discussed in the context of the results obtained, as is the potential utility of fingerprint filtering.