From the PubChem BioAssay database ¹⁶ , 437,257 compounds were pre-selected that were tested in both primary and confirmatory assays, representing extensively assayed screening compounds ²³ . Approximately 95% of these compounds were evaluated in more than 50 primary and/or confirmatory assays ²³ . Primary PubChem assays report compound activity (e.g., percentage activity) for a single dose, while confirmatory assays are dose-response assays yielding titration curves and IC ₅₀ values. Our current analysis focused on primary assays, for which much larger data volumes were available than for confirmatory assay. Primary assays also included assays for which no target was specified (such as cell-based assays). For pre-selected compounds, hit rate statistics were determined.

A matched molecular pair (MMP) is a pair of compounds that are only distinguished by a chemical change at a single site ²⁴ , termed a chemical transformation ²⁵ . As an extension of the MMP concept, a matched molecular series (MMS) was defined as the union of all MMP compounds that are only distinguished by chemical modifications at a given site ²⁶ . Accordingly, an MMS represents a series of analogs sharing a single substitution site. To generate MMPs, exocyclic single bonds in screening compounds were systematically fragmented ²⁵ following retrosynthetic fragmentation rules ²⁷ , yielding so-called RECAP-MMPs ²⁸ . These MMPs were subject to transformation size restrictions in order to limit chemical changes to modifications typically observed in series of analogs ²⁹ . An MMS was designated as redundant if it was a subset of a larger MMS or if there was another MMS representing the same series of analogs but having a larger MMP core. For screening compounds with high hit rates, non-redundant MMS were systematically determined.

For each MMS, three parameters were calculated. First, the MMS hit rate (HR) was obtained from the union of all assays (i.e., the number of unique assays in which one or more analogs were tested in) and assays with activity signals (active assays, i.e., the number of unique assays in which one or more analogs were found to be active). Second, assay overlap was determined as the proportion of assays in which all MMS compounds were tested in (shared assays, i.e., the intersection of assays) relative to the union of assays. Third, from assay overlap, assays with inconsistent activity were calculated as the proportion of shared assays in which different MMS compounds were active or inactive.

A statistical analysis of hit rates of extensively tested screening compounds is presented taking assay frequency into account. On the basis of the hit rate distribution, ranges of unusually high hit rates were determined. From compounds with high hit rates, analog series with single substitution sites (MMSs), i.e., “minimal” chemical modifications within series, were systematically extracted, which provided structural context information and hit rate controls for closely related compounds. For MMSs, different parameters were calculated, making it possible to compare and prioritize these series. The collection of MMSs with high hit rates provides a basis for investigating assay interference candidates, as well as chemical entities with potential multi-target activities.

Figure 1 (boxplot on the left) shows the global distribution of primary assays for 437,257 extensively tested PubChem compounds, with a median value of 347 assays per compound. From these, a subset of 327,532 compounds was selected that were tested in more than 257 primary assays, corresponding to the lower quartile boundary of the global distribution. For this subset, the assay distribution was separately monitored ( Figure 1, boxplot on the right), yielding a median of 426 (and a maximum of 626) assays per compound. Hence, half of these compounds were tested in more than 426 primary assays.

For 327,532 compounds tested in more than 257 assays, hit rates were determined. The distribution is reported in Figure 2 (boxplot on the left), resulting in a median hit rate of 0.4%. The lower quartile boundary and lower whisker of the boxplot were identical and represented consistently inactive compounds, which were not of interest for our current analysis. On the basis of the distribution, the interval of “bulk hit rates” (b_hr) for these extensively assayed PubChem compounds was defined as 0% < b_hr ≤ 1.0%, covering the lower quartile, median, and upper quartile (and hence the “bulk” of the distribution). There were 80,495 compounds with hit rates ≥ 1.0%. The hit rate distribution of this compound subset is shown in Figure 2 (middle), yielding a median of 1.8%. This value was set as the hit rate threshold for most active screening compounds. The threshold was exceeded by 41,609 compounds, representing 12.7% of the initial compound pool. The hit rate distribution of these compounds is reported in Figure 2 (right), resulting in a median of 2.9%. We determined that 93.1% of the compounds with hit rates greater than 1.8% in primary assays were also active in confirmatory assays (yielding IC ₅₀ values). Hence, their activity was not confined to primary assays.

From the 41,609 compounds with highest hit rates, MMSs were systematically extracted on the basis of RECAP-MMPs. After removal of redundant MMSs (see Methods), 6941 unique MMSs were obtained comprising 14,646 compounds, which represented our final hit rate- and series-based selection set. Table 1 reports the size distribution of the MMSs, ranging from two to 17 analogs per series. With 6111 instances, compound pairs and triplets dominated the distribution, but more than 800 larger MMSs were also obtained. As further discussed below, compound pairs and triplets already provide informative controls for activity analysis and enable a more confident assessment compared to the analysis of individual compounds. This was a major motivation for focusing the analysis on MMSs.

Figure 3a illustrates the derivation of three parameters for the characterization and comparison of MMSs (rationalized in the Methods section). The cumulative MMS hit rate is a direct measure for the activity of a series. In addition, assay overlap represents a confidence criterion for MMS assessment, i.e., large assay overlap of compounds comprising a series assigns high confidence to hit rate comparisons. By contrast, the proportion of assays with inconsistent activity should best be minimal to draw firm conclusions. Figure 3b reports the distribution of these three parameters for the 6941 MMSs. Assay overlap (upper left plot) and MMS hit rates (lower left) were generally high, with median values of 79.3% and 5.8%, respectively. By contrast, the proportion of inconsistent assays (upper right) was overall low, with a median of only 3.7%. Thus, the distributions of MMS parameters indicated that the set of MMSs was suitable for the analysis of series-based hit rates and hit rate comparison of compounds comprising individual MMSs. We note that MMSs can be ranked in the order of decreasing assay overlap and MMS hit rates and increasing inconsistent assays and prioritized, for example, on the basis of rank fusion calculations.

Our analysis was intentionally focused on hit rates over assays (i.e., assay promiscuity) to take as many activity readouts as possible into account. Therefore, as a control, assay- and target-based hit rates were also compared. Compounds forming the 6941 MMS were evaluated in a total of 1213 assays. For 255 of these assays, no individual target was specified. The remaining 958 assays covered 426 different targets. Figure 3b reports the distributions of MMS hit rates over assays (lower left plot) and targets (lower right). The distributions were overall similar, with median values of assay- and target-based hit rates of 5.8% and 4.9%, respectively. Hence, despite the presence of multiple assays for a subset of targets, assay-based hit rates were only slightly higher than target-based rates, indicating that corresponding conclusions would be drawn from the analysis of these distributions.

The computational aggregation advisor ⁴ and compound strings taken from PAINS filters ^{30, 31} ( http://www.rdkit.org) were used to search the MMSs for known assay interference candidates. The 14,646 MMS compounds contained 783 aggregators (on the basis of 100% similarity) and 2381 compounds with PAINS substructures. There were 611 MMSs with one or more aggregators, 1139 MMSs with one or more PAINS, and 126 MMSs including aggregators and PAINS. However, 5065 MMSs with high hit rates did not contain known compounds with aggregation potential or PAINS substructures. Thus, the MMSs provide a large source of analogs for the exploration of other interference candidates, as well as compounds with true multi-assay/target activities.

Figure 4 shows exemplary compound pairs and triplets with high assay promiscuity. The two analogs in Figure 4a were tested in more than 380 assays with 93.5% assay overlap and only 1.6% inconsistent assays, yielding comparable hit rates of 2.8% and 3.2%, respectively, resulting in an MMS hit rate of 4.5%. These analogs contained a classical PAINS substructure (ene_rhodanine) ^{8, 9} . Furthermore, compounds in Figure 4b were analogs of a molecule with aggregation potential ⁴ . They were tested in more than 300 and 400 assays, respectively, yielding a relatively low assay overlap of 59%, and had hit rates of 2.2% and 2.6%, respectively, resulting in a low MMS hit rate of 2.9%. Thus, these analogs were far from being consistently active, as one might assume for strong aggregators. In Figure 4c, a pair of thieno[2,3-d]pyrimidine-2-acetic acid ethyl ester analogs is shown that were tested in 442 assays with large overlap. These compounds had high hit rates of 5.9% and 7.9%, respectively, resulting in a high MMS hit rate of 9.8%. Moreover, Figure 4d shows a triplet of sulfonylpyrimidines that were tested in 357–361 assays with 89.7% overlap, having very high hit rates of 8.7% (one analog) and more than 13% (two analogs). Compounds forming each of the MMSs in Figure 4 displayed consistent hit rate characteristics, hence assigning confidence to their observed activity phenotype. The analogs in Figure 4c and Figure 4d have previously not been classified as interference candidates. However, they might well be reactive under assay conditions. Taken together, these examples of analog pairs and triplets (i.e., minimally sized MMSs) are indicative of the potential of well characterized MMSs for follow-up investigations focusing on assay interference and multi-target activities.