ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Research Article
Revised

Transcription factor binding site clusters identify target genes with similar tissue-wide expression and buffer against mutations

[version 2; peer review: 2 approved]
PUBLISHED 08 Apr 2019
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Artificial Intelligence and Machine Learning gateway.

Abstract

Background: The distribution and composition of cis-regulatory modules composed of transcription factor (TF) binding site (TFBS) clusters in promoters substantially determine gene expression patterns and TF targets. TF knockdown experiments have revealed that TF binding profiles and gene expression levels are correlated. We use TFBS features within accessible promoter intervals to predict genes with similar tissue-wide expression patterns and TF targets using Machine Learning (ML).
Methods: Bray-Curtis Similarity was used to identify genes with correlated expression patterns across 53 tissues. TF targets from knockdown experiments were also analyzed by this approach to set up the ML framework. TFBSs were selected within DNase I-accessible intervals of corresponding promoter sequences using information theory-based position weight matrices (iPWMs) for each TF. Features from information-dense clusters of TFBSs were input to ML classifiers which predict these gene targets along with their accuracy, specificity and sensitivity. Mutations in TFBSs were analyzed in silico to examine their impact on TFBS clustering and predict changes in gene regulation.
Results: The glucocorticoid receptor gene (NR3C1), whose regulation has been extensively studied, was selected to test this approach. SLC25A32 and TANK exhibited the most similar expression patterns to NR3C1. A Decision Tree classifier exhibited the best performance in detecting such genes, based on Area Under the Receiver Operating Characteristic curve (ROC). TF target gene prediction was confirmed using siRNA knockdown, which was more accurate than CRISPR/CAS9 inactivation. TFBS mutation analyses revealed that accurate target gene prediction required  at least 1  information-dense TFBS cluster. 
Conclusions: ML based on TFBS information density, organization, and chromatin accessibility accurately identifies gene targets with comparable tissue-wide expression patterns. Multiple information-dense TFBS clusters in promoters appear to protect promoters from effects of deleterious binding site mutations in a single TFBS that would otherwise alter regulation of these genes.

Keywords

Transcription factors, position-specific scoring matrices, chromatin, binding sites, gene expression profiles, Bray-Curtis similarity, mutation, machine learning, information theory

Revised Amendments from Version 1

The manuscript has been extensively edited to improve clarity of the presentation. Sentence lengths were reduced. Duplicate terms and text were eliminated. The titles of the subsections of Results were revised to indicate the primary conclusions. Two paragraphs were moved to the Supplementary Methods. The revised manuscript is shortened by 400 words and approximately 2 pages.

We addressed the impact of covariance between expression levels of developmentally related tissues from the same organ, by sequentially removing 12 of 13 brain tissues from the GTEx dataset prior to recomputing the Bray-Curtis Similarity index. We found multiple covarying brain tissue expression values to not significantly influence the set of most similar genes seen with all 53 tissues in this analysis.

For the Decision Tree classifiers predicting transcription factor target genes, Gini importance values were computed to assess the relative contribution of the six ML features to their predictive power. For the CRISPR-perturbed TFs in the K562 cell line, clustering Features 1-3, particularly the TFBS cluster information densities (Feature 3), were most important. The TFBS-level Feature 5 comprising the distribution of strong binding sites accounts for the largest contribution to classifier performance for the 11 siRNA-perturbed TFs in the GM19238 cell line.

Additional file 1 now contains text from v1 of the manuscript as requested by a reviewer. Additional file 5 now contains the Gini scores for the machine learning features and the accuracy value of each individual round of 10-fold cross validation.

We now cite:

See the authors' detailed response to the review by Nicolae Radu Zabet
See the authors' detailed response to the review by Daphne Ezer

Introduction

The distinctive organization and combination of TFBSs and regulatory modules in promoters dictates specific expression patterns within a set of genes1. Clustering of multiple adjacent binding sites for the same TF (homotypic clusters) and for different TFs (heterotypic clusters) defines cis-regulatory modules (CRMs) in human gene promoters. Experimental studies have shown that these clusters can reinforce (and in some instances, amplify) the impact of individual TFBSs on gene expression through increasing binding affinities, facilitated diffusion mechanisms and funnel effects2. Because tissue-specific TF-TF interactions in TFBS clusters are prevalent, these features can assist in identifying correct target genes by altering binding specificities of individual TFs3. Previously, we derived iPWMs from ChIP-seq data that can accurately detect TFBSs and quantify their strengths by determining the associated Ri values (Rate of Shannon information transmission for an individual sequence4). Rsequence (the area under the sequence logo) is the average of Ri values of all binding site sequences and represents the average binding strength of the TF3. Neighboring, likely coregulatory TFBSs were identified by information density-based clustering (IDBC), which takes into account both the spatial organization (i.e. intersite distances) and information density (i.e. Ri values) of TFBSs5.

TF binding profiles, either derived from in vivo ChIP-seq peaks68 or computationally detected binding sites and CRMs9, have been shown to be predictive of absolute gene expression levels using a variety of tissue-specific ML classifiers and regression models. Because signal strengths of ChIP-seq peaks are not strictly proportional to strengths of the contained strongest TFBSs and are instead controlled by TFBS counts3,10, representing TF binding strengths by ChIP-seq signals may not be appropriate; nevertheless, both achieved similar accuracy11. CRMs have been formed by combining two or three adjacent TFBSs9, which is inflexible, as it arbitrarily limits the number of binding sites contained in a module, and does not consider differences between information densities of different CRMs. Chromatin structure (e.g. histone modification (HM) and DNase I hypersensitive sites (DHSs)) were also found to be statistically redundant with TF binding in explaining tissue-specific mRNA transcript abundance at a genome-wide level7,8,12,13, which was attributed to the heterogeneous distribution of HMs across chromatin domains8. Combining these two types of data explained the largest fraction of variance in gene expression levels in multiple cell lines7,8, suggesting that either contributes unique information to gene expression that cannot be compensated for by the other.

Previous studies have shown that a small subset of target genes bound by TFs were differentially expressed (DE) in the GM19238 cell line, upon knockdown with small interfering RNAs (siRNAs)14. TFBS counts were defined as the number of ChIP-seq peaks overlapping the promoter, with the caveat that the number and strengths of the TFBSs in each peak were not known15. Correlation between total TFBS counts and gene expression levels across 10 different cell lines was more predictive of which were DE than by setting a minimum threshold count of TFBSs15. This has also been addressed by perturbing gene expression with CAS9-directed clustered regularly interspaced short palindromic repeats (CRISPR) of 10 different TF genes in K562 cells16. The regulatory effects of each TF were dissected by single cell RNA sequencing with a regularized linear computational model16 . This revealed DE targets and new functions of individual TFs, some of which were likely regulated through direct interactions at TFBSs in their corresponding promoters. ML classifiers have also been applied to predict targets of a single TF using features extracted from n-grams derived from consensus binding sequences17, or from TFBSs and homotypic binding site clusters5.

We investigated whether the predicted TFBS strengths, distribution and CRM composition in promoters substantially determines gene expression profiles of direct TF targets. A general ML framework was developed by combining information theory-based TF binding profiles with DHSs. The approach predicts which genes have similar tissue-wide expression profiles, and conversely, DE direct TF targets. Upon selecting DHSs to define accessible promoter intervals, ML features that captured the spatial distribution and information theory-based TFBS compositions of CRMs were extracted from IDBC clusters. The intent of this framework was to provide insight into the transcriptional program of genes with similar profiles by dissecting shared properties of their cis-regulatory element organization, without imposing strict constraints on the strengths and distributions of TFBSs. We first identify genes with comparable tissue-wide expression profiles by application of Bray-Curtis similarity18. Using transcriptome data generated by CRISPR-16 and siRNA-based14 TF knockdowns, we predicted DE target genes with promoters that contain ChIP-seq peaks for these same TFs.

Methods

To identify genes with similar tissue-wide expression patterns, we formally define tissue-wide gene expression profiles and pairwise similarity measures between profiles of different genes. A general ML framework relates features extracted from the organization of TFBSs in these genes to their tissue-wide expression patterns. Since protein-coding (PC) sequences represent the most widely studied and best understood component of the human genome19, positives and negatives for deriving ML classifiers of predicted DE direct TF target genes encoding proteins (TF targets, below) were obtained from CRISPR- and siRNA-generated knockdown data.

Similarity between GTEx tissue-wide expression profiles of genes

We used data from the Genotype-Tissue Expression (GTEx, version 6p) project which measured expression levels for each gene in 53 tissues, in different numbers of individuals (5 to 564). For each tissue population, the median expression value is given in RPKM (Reads Per Kilobase of transcript per Million mapped reads) for each gene20. Data are available on Zenodo21. To capture the tissue-wide overall expression pattern of a gene instead of within a single tissue, the tissue-wide expression profile of a gene was defined as its median RPKM across GTEx tissues, which is described by a 53-element vector (Equation 1). Note that different isoforms whose expression patterns may significantly differ from each other cannot be distinguished by this approach.

EPA=[MEV1A,MEV2A,,MEV53A](inRPKM)(1)

where EPA is the tissue-wide expression profile of Gene A, MEV1A is the median expression value of Gene A in Tissue 1, MEV2A is the median expression value of Gene A in Tissue 2, etc.

To discover other genes whose tissue-wide expression profiles are similar to a given gene, we computed the Bray-Curtis Similarity (Equation 2) between the tissue-wide expression profiles of all gene pairs. Relative to other similarity measures (Table 1, Additional file 122), this function exhibits desirable properties, including: 1) being bounded between 0 and 1, 2) achieving maximal similarity of 1, if and only if two vectors are identical, and 3) larger values having a larger impact on the resultant similarity value.

Table 1. Comparison between metrics in measurement of similarity between GTEx tissue-wide expression profiles of genes.

Similarity metricProperty 1,Property 2Property 3
Bray-Curtis√; [0,1]
Euclidean√; (0,1]×
Cosine√; [0,1]×
Pearson correlation25×; [-1,1]××
Spearman correlation26×; [-1,1]××

†The symbols √ and ×, respectively, indicate that the similarity metric satisfies and does not satisfy the property. ‡The interval in each cell indicates the range in which the result computed by the similarity metric lies.

simBrayCurtis(EPA,EPB)={1,ifi=153MEViA=i=153MEViB=01i=153|MEViAMEViB|i=153(MEViA+MEViB),otherwise(2)

Prediction of genes with similar tissue-wide expression profiles

The framework for predicting whether the tissue-wide expression profile of a gene resembles a particular gene is indicated in Figure 1 (panels A and B). The genomic locations of all DHSs in 95 cell types from the ENCODE project[23; hg38 assembly] were filtered for known promoters24; these sequences were then scanned for TFBSs using 94 iPWMs corresponding to the primary binding motifs for 82 TFs3. Data are available on Zenodo21. Heterotypic TFBS clusters were detected with the IDBC algorithm by specifying a minimum threshold of 0.1*Rsequence for the Ri values of individual TFBS elements in potential clusters; this eliminated weak binding sites detected with iPWMs corresponding to false positive, non-functional TFBSs3.

e5dbc865-e55d-42fa-b393-8c465f55a13c_figure1.gif

Figure 1. The general framework for predicting genes with similar tissue-wide expression profiles and TF targets.

Red and blue contents are respectively specific to prediction of genes with similar tissue-wide expression profiles and prediction of TF targets. (A) An overview of the ML framework. The steps enclosed in the dashed rectangle vary across prediction of genes with similar tissue-wide expression profiles and TF targets. The step with a dash-dotted border that intersects promoters with DHSs is a variant of the primary approach. In the IDBC algorithm (Additional file 122), the parameter I is the minimum threshold on the total information contents of TFBS clusters. In prediction of genes with similar tissue-wide expression profiles, the minimum value was 939, which was the sum of mean information contents (Rsequence values) of all 94 iPWMs; in prediction of direct targets, this value was the Rsequence value of the single iPWM used to detect TFBSs. The parameter d is the radius of initial clusters in base pairs, whose value, 25, was determined empirically. The seven ML features derived from TFBS clusters are described in the Methods section. The performance of seven different classifiers was evaluated with ROC curves and 10-fold cross validation (Additional file 122). (B) Obtaining the positives and negatives for identifying genes with similar tissue-wide expression profiles to a given gene (Additional file 222). (C) Obtaining the positives and negatives for predicting target genes of seven TFs using the CRISPR-generated perturbation data in K562 cells (Additional file 322). (D) Obtaining the positives and negatives for predicting target genes of 11 TFs using the siRNA-generated knockdown data in GM19238 cells (Additional file 422).

The seven information density-related ML features (Additional file 122) derived from each TFBS cluster included: 1) The distance between this cluster and the transcription start site (TSS), 2) The length of this cluster, 3) The information content of this cluster (i.e. the sum of Ri values of all TFBSs in this cluster), 4) The number of binding sites of each TF within this cluster, 5) The number of strong binding sites (Ri > Rsequence) of each TF within this cluster, 6) The sum of Ri values of binding sites of each TF within this cluster, and 7) The sum of Ri values of strong binding sites (Ri > Rsequence) of each TF within this cluster.

Each of the Features 1–3 was defined in a gene as a vector, whose size equalled the number of clusters in the gene promoter; each cluster was mapped to a single value in the vector. In Features 4–7, each cluster itself was mapped to a vector corresponding to binding sites for 82 TFs (Additional file 122). If two genes contained different numbers of clusters, the maximum number of clusters among all instances was determined, and null clusters were added to the 5’ end of promoters with the smaller numbers of clusters; this enabled all genes to exhibit the same cluster counts. This allowed all genes to be used as training data for ML classifiers. Default parameter values for these classifiers were used to generate ROC curves with a built-in MATLAB function (Additional file 122).

Prediction of TF targets

Perturbed target gene expression after CRISPR-based mutation of TF genes. Dixit et al. performed CRISPR-based perturbation experiments using multiple guide RNAs for each of ten TFs in K562 cells, resulting in a matrix of coefficients indicating the effect of each guide RNA on each of 22,046 genes16. Data are available on Zenodo21. The coefficient of a guide RNA is defined as the log10 fold change in gene expression level16. We previously derived iPWMs for the primary binding motifs of 7 of the ten TFs (EGR1, ELF1, ELK1, ETS1, GABPA, IRF1, YY1)3. The framework for predicting TF targets (Figure 1A and 1C) was applied to these TFs. We defined a positive TF target gene in a cell line as :

  • 1) The fold change in the expression level of this gene for each of the guide RNAs of the TF was consistently greater than (or is less than) 1, which eliminated genes exhibiting both increased and decreased expression levels for different guide RNAs, and increased the possibility that the gene was downregulated (or upregulated) by the TF (Additional file 122). and

  • 2) The average fold change in the expression level of this gene for all guide RNAs of the TF was greater than the threshold 𝜀 (or is less than 1/𝜀), and

  • 3) The promoter interval (10 kb) upstream of a TSS of this gene overlapped a ChIP-seq peak of the TF in the cell line.

If the coefficients for all guide RNAs of the TF for a gene were zero, the gene was defined as a negative (i.e. a non-target gene). As the threshold ε increases, the number of positives strictly decreases. As ε decreases, we have lower confidence that the positives were DE as a result of the TF perturbation. We balanced the number of positives obtained against our confidence that they were DE by evaluating different values of ε (i.e. 1.01, 1.05 and 1.1; Additional file 122). For each TF, all ENCODE ChIP-seq peak datasets from the K562 cell line were merged to determine positives. Data are available on Zenodo21. To avoid imbalanced datasets that significantly compromised the classifier performance27, the Bray-Curtis function was applied to compute the similarity values in the tissue-wide expression profile between all negatives and the positive gene with the largest average coefficient, and then negatives with the smallest values were selected, resulting in the same number of positive and negative genes (Figure 1C).

Because TFs may exhibit tissue-specific sequence preferences due to different sets of target genes3, the K562 cell line-derived iPWMs of EGR1, ELK1, ELF1, GABPA, IRF1, YY1 were used to detect binding sites in DHS-intersected intervals; for ETS1, we used the only available iPWM from GM128783. Six features (Features 1-5 and 7) were derived from each homotypic cluster (i.e. Feature 6 became identical to Feature 3, because only binding sites from a single TF were used) (Figure 1A). The results of 10 rounds of 10-fold cross validation were averaged to evaluate the accuracy of the classifier.

Target gene expression changes after siRNA-based knockdown of TFs. Significant changes in expression of target genes upon knockdown of 59 TFs in the GM19238 line were identified from the probability of differences in expression level (P-value) relative to the null hypothesis of no change14. Data are available on Zenodo21. DE genes with larger changes exhibited smaller P-values. The distribution of ChIP-seq peaks were considered to be evidence of TF binding to the promoters of these genes14. Among these 59 TFs, we have previously derived iPWMs exhibiting primary binding motifs for 11 (BATF, JUND, NFE2L1, PAX5, POU2F2, RELA, RXRA, SP1, TCF12, USF1, YY1)3. For this reason, transcription targets of these TFs were predicted in the GM19238 cell line (Figure 1A, D).

For ML training, we defined a positive (i.e. a target gene) for a TF, if the P-value of this gene was ≤ 0.01, and the promoter interval up to 10 kb upstream of a TSS overlapped one or more ChIP-seq peaks of the TF in GM12878. Other genes with P-values > 0.01 exhibited insufficient support for being TF targets and were labeled as negatives.

The iPWMs from GM19238 were used to detect binding sites for all TFs except for RELA, RXRA and NFE2L1. The iPWM from the GM19099 line was used for RELA, and for RXRA and NFE2L1, the only available iPWMs were derived from HepG2 and K562 cells, respectively. The DHSs in GM19238 were first remapped to the hg38 assembly using liftOver, prior to being intersected with known promoters28. Data are available on Zenodo21. Although the knockdowns were performed in GM19238, GM12878 and GM19099 are also lymphoblastic cell lines, with GM19099 and GM19238 both being derived from the Yoruban population. For this analysis, the iPWMs derived in GM12878 and GM19099 were more appropriate sources of accessible TFBSs than those from HepG2 and K562, since GM12878 and GM19099 are more likely comparable to GM19238 than HepG2 and K562. ML results were evaluated by averaging cross validation, as described above.

Mutation analyses on promoters of TF targets

To understand the significance of individual binding sites on the regulatory state of TF targets, we evaluated the effects of sequence changes in TFBSs that altered the Ri values of these sites, the definition of TF clusters, and whether consequential IDBC-related changes impacted the prediction of TF target genes. For example, mutations were sequentially introduced into the strongest binding sites in TFBS clusters of the EGR1 target gene, MCM7, to determine the threshold for cluster formation and whether disappearing clusters disabled MCM7 expression. For one target gene of each TF from the CRISPR-generated perturbation data, effects of naturally occurring TFBS variants present in dbSNP29 were also evaluated to explore aspects of TFBS organization that enabled both clusters and promoter activity to be resilient to binding site mutations. This was done by analyzing whether the occurrence of individual or multiple single nucleotide polymorphisms (SNPs) lead to the loss of binding sites and the corresponding clusters, and resulted in changes in the predictions for these targets.

Results

The Bray-Curtis Function can accurately quantify the similarity between tissue-wide gene expression profiles

We computed the similarity values (Equation 2) between the tissue-wide expression profiles of the glucocorticoid receptor (GR or NR3C1) gene and all other 18,812 PC genes to find genes with related profiles. NR3C1 is an extensively characterized TF with many known direct target genes30. As a constitutively expressed TF activated by glucocorticoid ligands, the protein mediates up-regulation of anti-inflammatory genes by binding as homodimers to glucocorticoid response elements. Transcription of proinflammatory genes is down-regulated by complexing with other activating TFs (e.g. NFKB and AP1), thereby eliminating their ability to bind and activate targets30. NR3C1 can bind its own promoter forming an auto-regulatory loop, which also contains functional binding sites of 11 other TFs (e.g. SP1, YY1, IRF1, NFKB) whose iPWMs have been developed and/or mutual interactions have been described previously3,30. The tissue-wide expression profile of NR3C1 comprises all different splicing and translational isoforms (GRα-A, GRα-B, GRα-C, GRα-D, GRβ, GRγ, GRδ). However, the profile averages out tissue-specific preferences of some isoforms, for example, GRα-C isoforms are significantly higher in the pancreas and colon, whereas levels of GRα-D are highest in spleen and lungs30. We found that SLC25A32 and TANK have the greatest similarity in expression to NR3C1 (0.880 and 0.877 respectively), based on their overall similar expression patterns across the 53 tissues (Figure 2).

e5dbc865-e55d-42fa-b393-8c465f55a13c_figure2.gif

Figure 2. GTEx tissue-wide expression profiles of NR3C1, SLC25A32 and TANK.

Visualization of the expression values (in RPKM) of these genes across 53 tissues from GTEx. For each gene, the colored rectangle belonging to each tissue indicates the valid RPKM of all samples in the tissue, the black horizontal bar in the rectangle indicates the median RPKM, the hollow circles indicate the RPKM of the samples considered as outliers, and the grey vertical bar indicates the sampling error. A comparison of the panels shows that the overall expression patterns of the three genes across the 53 tissues resemble each other (e.g. all three genes exhibit the highest expression levels in lymphocytes and the lowest levels in brain tissues).

The Decision Tree classifier performed best in prediction of genes with similar tissue-wide expression profiles

Several ML classifiers (Naïve Bayes, Decision Tree (DT), Random Forest and Support Vector Machines (SVM) with four different kernels) were evaluated to determine how well TFBS-related features could predict genes with tissue-wide expression profiles similar to NR3C1. Their performance were compared using ROC curves, for complete promoters or for accessible promoter sequences that were first intersected with DHSs (Figure 3). DT exhibited the largest AUC (area under the curve) under both scenarios, and was one of two most stable classifiers (i.e. ΔAUC < 0.01), with the other being the SVM with RBF kernel. Consistent with previous findings10,31,32, inclusion of DHS information significantly improved AUC values of the other classifiers with the exception of Naïve Bayes. In many instances, all TFBSs in a contiguous DHS interval formed a single binding site cluster.

e5dbc865-e55d-42fa-b393-8c465f55a13c_figure3.gif

Figure 3. Comparison between the performance of different classifiers in prediction of genes with similar tissue-wide expression profiles to NR3C1.

(A) ROC curves and AUC of seven classifiers without intersecting promoters with DHSs. (B) ROC curves and AUC of seven classifiers after intersecting promoters with DHSs. The Decision Tree classifier exhibited the largest AUC under both scenarios, and inclusion of DHS information significantly improved other classifiers’ AUC except for Naïve Bayes.

The Decision Tree classifier was predictive of TF target genes

Based on its performance in distinguishing genes with NR3C1-like tissue-wide expression profiles, the DT classifier was used to predict TF targets respectively based on the CRISPR-16 and siRNA-generated14 perturbation data. Performance was assessed with 10 rounds of 10-fold cross validation (Tables 2 & Table 3). Gini importance values were also used to assess the relative contribution of the six ML features to the predictive power of the classifier (Additional file 522). For the CRISPR-perturbed TFs in the K562 cell line, clustering Features 1-3, particularly the TFBS cluster information densities (Feature 3), were most important. The TFBS-level Feature 5 comprising the distribution of strong binding sites accounts for the largest contribution to classifier performance for the 11 siRNA-perturbed TFs in the GM19238 cell line. To assess the value of all ML features in capturing the distribution and composition of CRMs in promoters, all but one (TFBS counts) were sequentially removed, and the impact on accuracy of the classifier was determined. In each instance, classifier performance decreased, except for CRISPR-perturbed GABPA, IRF1 and YY1 upon inclusion of DHS information (Additional file 522).

Table 2. The Decision Tree classifier performance for predicting TF targets using the CRISPR-generated knockdown data.

TFExcluding DHS informationIncluding DHS information
SensitivitySpecificityAccuracySensitivitySpecificityAccuracy
EGR10.580.620.600.780.810.80
ELF10.590.650.620.830.870.85
ELK10.590.590.590.800.810.81
ETS10.590.60.590.810.810.81
GABPA0.550.570.560.720.750.74
IRF10.540.550.540.760.640.70
YY10.500.510.510.450.690.57

†The average performance of 10 rounds of 10-fold cross validation when setting ε to 1.05 is indicated. The accuracy of each individual round is indicated in Additional file 522. The CRISPR-generated knockdown data were obtained from Dixit et al.16.

Table 3. The Decision Tree classifier performance for predicting TF targets using the siRNA-generated knockdown data.

TFExcluding DHS informationIncluding DHS information
SensitivitySpecificityAccuracySensitivitySpecificityAccuracy
BATF0.960.970.960.8510.93
JUND0.860.900.880.8010.90
NFE2L10.920.950.940.710.930.82
PAX50.960.970.960.880.980.93
POU2F20.970.970.970.890.990.94
RELA0.95 0.960.960.830.970.90
RXRA0.930.910.920.840.950.89
SP10.980.980.980.890.990.94
TCF120.980.980.980.860.990.93
USF10.970.980.970.830.980.90
YY11110.550.990.77

†The average performance of 10 rounds of 10-fold cross validation is indicated. The accuracy of each individual round is shown in Additional file 522. The siRNA-generated knockdown data were obtained from Cusanovich et al.13.

The DT classifier predicted TF targets with greater sensitivity and specificity, after eliminating TFBSs in inaccessible promoter intervals in the CRISPR-generated knockdown data (Table 2). Specifically, predictions for EGR1, ELK1, ELF1, ETS1, GABPA, and IRF1 were more accurate than for YY1, which itself represses or activates a wide range of promoters by binding to sites overlapping the TSS (Table 2). Accordingly, perturbation results showed that YY1 has ~4-22 fold more PC targets in the K562 cell line than the other TFs (ε = 1.05). Binding of YY1 more significantly impacts the expression levels of target genes. The ratio of the PC targets at ε = 1.1 vs ε = 1.01 was 0.334, which significantly exceeded those of other TFs in this study (0.017-0.082; Additional file 322). This is consistent with the extensive interactions of this factor with many other TF cofactors in K562 cells, and its central role in specifying erythroid-specific lineage development3.

We found that promoters of most TF targets contain accessible, likely functional binding sites that are significantly correlated with changes in gene expression levels. Despite a high accuracy of target recognition, sensitivity did not exceed specificity, except for IRF1 (Table 2), due to a relatively large number of false negative genes. Promoters of non-targets are either devoid of accessible binding sites, or these sites are non-functional. In these instances, the classifier was unable to distinguish between likely functional binding sites in targets and non-functional sites in non-targets. In vivo co-regulation mediated by interacting cofactors, which was excluded by the classifier, assisted in distinguishing these non-functional sites that do not significantly affect gene expression14.

As the minimum differential expression threshold ε increased, the accuracy of the classifier for all the TFs monotonically increased, as expected (Figure 4). In general, more significantly DE genes have been associated with a higher number of TFBSs in their promoters14. Thus, at greater ε, there are larger differences in the values of ML features derived from TFBS clusters between direct targets and non-targets.

e5dbc865-e55d-42fa-b393-8c465f55a13c_figure4.gif

Figure 4. Accuracy of the Decision Tree classifier when using three different values for.

Each accuracy value was averaged from 10 rounds of 10-fold cross validation. The minimum threshold ε of the average fold change in gene expression levels (for all guide RNAs) of the TF was determined for fold changes: 1.01, 1.05 and 1.1. The accuracy value of each individual round is indicated in Additional file 522. As ε increased, accuracy for all seven TFs monotonically increased.

Some TF target genes also display similar tissue-wide expression profiles to the TFs, themselves

To determine how many TF targets have similar tissue-wide expression profiles, we intersected the set of targets with the set of 500 PC genes with the most similar tissue-wide expression profiles for each TF (Table 4, Additional file 622). For example, the B lymphocyte expression profiles of TFs PAX5 and POU2F2 are similar to their respective targets, IL21R and CD86. The intersected targets for YY1 include 21 and 7 nuclear mitochondrial genes (e.g. MRPL9 and MRPS10, which are subunits of mitochondrial ribosomes), respectively, in the K562 and GM19238 cell lines33. YY1 is known to upregulates a large number of mitochondrial genes by complexing with PGC-1α in C2C12 cells34, and genes involved in the mitochondrial respiratory chain in K562 cells16. Our results are consistent with the idea that YY1 may broadly regulate mitochondrial function within all 53 tissues, in addition to the erythrocyte, lymphocyte and skeletal muscle cell lines.

Table 4. Intersection of TF targets and 500 protein-coding genes with the most similar tissue-wide expression profiles.

TFCell lineNumber of
targets
Size of
intersection
Targets among the most similar 10 genes§
EGR1K56216912None
ELF1785None
ELK11124GNL1(8th)
ETS126715None
GABPA51325TAF1(1st)
IRF145710None
YY11752127MRPL9(2nd), BAZ1B(6th), ENY2(7th), NUB1(8th),
USP1(9th), HNRNPR(10th)
GM19238104061MED4(1st), SURF6(3rd), BAZ1B(6th)
BATF18621None
JUND442None
NFE2L1584None
RELA24713HMG20B(9th)
RXRA1813None
SP1159581None
TCF1265520None
USF130121None
PAX591886IL21R(8th)
POU2F253226CD86(3rd)

§The rank of each target in the list of similar genes in the descending order of Bray-Curtis similarity values is shown in the brackets immediately following the target.

Between 0.4%–25% of genes with similar tissue-wide expression profiles to the TFs are actually their targets (Table 4). The majority are non-targets whose promoters contain non-functional binding sites that lack co-regulation by corresponding cofactors. For YY1 and EGR1, we contrasted the flanking cofactor binding site distributions and strengths in the promoters of the most similarly expressed target genes (YY1: MRPL9, BAZ1B; EGR1: CANX, NPM1) with non-target genes (YY1: ADNP, RNF25; EGR1: GUCY2F, AWAT1). In these target gene promoters, strong and intermediate TFBSs recognized by SP1, KLF1, CEBPB formed heterotypic clusters with adjacent YY1 sites. Additionally, TFBSs of SP1, KLF1, and NFY tended to be present adjacent to EGR1 binding sites (Additional file 722). These patterns contrasted with enrichment of CTCF and ETV6 binding sites in gene promoters of YY1 and EGR1 non-targets (Additional file 722). Previous studies have reported that KLF1 is essential for terminal erythroid differentiation and maturation35. Direct physical interactions between YY1 and the constitutive activator SP1 synergistically induce transcription36, through activating CEBPB which promotes differentiation and suppresses proliferation of K562 cells by binding the promoter of the G-CSFR gene encoding a hematopoietin receptor37. EGR1 and SP1 synergistically cooperate at adjacent non-overlapping sites on EGR1 promoter but compete for binding at overlapping sites38, whereas occupied CTCF binding sites often function as an insulator blocking the effects of cis-acting elements and preventing gene activation by mediating long-range DNA loops to alter topological chromatin structure39,40. ETV6, a member of the ETS family, is a transcriptional repressor required for bone marrow hematopoiesis and associated with leukemia development41.

Transcription factor binding site clusters buffer against expression changes from mutations in single sites

These results and previous studies indicate that the promoters of direct target genes contain multiple binding site clusters. We used our ML models of TFBS organization to investigate the effects of mutations in individual binding sites on the predicted expression of TF targets. We hypothesized that alternative TF clusters in the same promoter might stabilize and compensate for the loss of a mutated TF cluster, enabling mutated promoters to retain some capacity to regulate gene transcription upon TF binding. First, we introduced artificial variants into binding sites in silico in the promoter of the target gene MCM7 of EGR1 and examined the effect on the output of the ML classifier (Figure 5). In the K562 line, MCM7 is upregulated by EGR1. Knockdown of MCM7 has an anti-proliferative and pro-apoptotic effect on K562 cells42 and the loss of EGR1 increases leukemia initiating cells43, which suggests that EGR1 may act as a tumor suppressor in K562 cells through the MCM7 pathway.

e5dbc865-e55d-42fa-b393-8c465f55a13c_figure5.gif

Figure 5. Mutation analyses on the target MCM7 of EGR1.

This figure depicts the effect of a mutation in each EGR1 binding site cluster of the MCM7 promoter on the expression level of MCM7, which is a target of the TF EGR1. The strongest binding site in each cluster were abolished by a single nucleotide variant. Upon loss of all three clusters, only weak binding sites remained and EGR1 was predicted to no longer be able to effectively regulate MCM7 expression. Multiple clusters in the promoters of TF targets confer robustness against mutations within individual binding sites that define these clusters.

The strongest binding site (at position chr7:100103347[hg38], - strand, Ri = 12.0 bits) in the promoter was eliminated by a G->A mutation, resulting in the loss of Cluster 1 (Figure 5), which consists of two sites (the other site at chr7:100103339, -, 4.3 bits). The other two clusters comprising weaker binding sites of intermediate strength (chr7:100102252, +, 7.0 bits; chr7:100102244, +, 1.3 bits; chr7:100101980, +, 8.9 bits; chr7:100101977, +, 2.2 bits; chr7:100101984, +, 1.9 bits) were still predicted to compensate for this mutation, so that the promoter maintains the capacity to induce MCM7 expression (Figure 5). Adjacent sites within the same TFBS cluster, which may individually not have sufficient affinity to strongly bind TFs and activate transcription, are capable of stabilizing binding to adjacent sites2. Weaker sites can direct TF molecules to strong sites and extend the duration of physical association, termed the funnel effect2. Binding stabilization between adjacent sites and the funnel effect enable CRMs comprised of information-dense clusters to be robust to mutations in individual binding sites2,44. In this example, Clusters 2 and 3 were also respectively removed by G->T and C->G mutations abolishing the strongest site in either cluster, altering the prediction of the classifier, that is, EGR1 is expected to fail to induce MCM7 transcription (Figure 5). The remaining four sparse weak sites do not form a cluster and cannot completely supplant the disrupted strong sites.

We then examined the predicted impacts of natural SNPs on binding site strengths, clusters and predicted the regulatory state of the promoter for a direct target of each of the seven TFs from the CRISPR-generated perturbation data (Table 5). We found that a single SNP (e.g. rs996639427 of EGR1) could affect the strengths of multiple binding sites within a cluster (Table 5). Apart from SNPs that are predicted to abolish binding (Figure 5), leaky variants that are expected to merely weaken TF binding are also common (Table 5). Neither mutations that abolish TFBSs nor leaky SNPs in flanking weak binding sites would be expected to inactivate TFBS clusters (e.g. rs1030185383 and rs5874306 of IRF1), whereas SNPs with large reductions in Ri values of strong sites are more likely to abolish clusters (e.g. rs865922947, rs946037930, rs917218063 and rs928017336 of YY1) (Table 5). Multiple TF clusters enable promoters to be resilient to the effects of these mutations; only the complete inactivation of all clusters by concurrent effects of multiple SNPs within TFBSs would be capable of making a promoter to be unresponsive to TF binding (e.g. rs997328042, rs1020720126 and rs185306857 of GABPA) (Table 5). Conversely, a small number of SNPs capable of strengthening TF binding and reinforcing the regulatory effect of the TF were also observed (e.g. rs887888062 of EGR1 and rs751263172 of ELF1) (Table 5). In addition to deleterious mutations, potentially benign variants may also be found in promoters, consistent with the expectations of neutral theory45.

Table 5. Mutation analyses on promoters of TF targets.

TFTargetNormal clusterNormal binding site§ SNP ID§ Variant binding site§ Variant
cluster
Classifier
output
Variant Wild-
type
EGR1
(Rsequence =
12.2899 bits)
EID2BCluster 1
of 2
GAGGGGGCATC
(chr19:39540296, -,
7.22 bits)
rs538610162
(chr19:39540296C>G)
CAGGGGGCATC
(chr19:39540286, -,
4.84 bits)
Abolished×
rs759233998
(chr19:39540294C>T)
GAAGGGGCATC
(chr19:39540286, -,
0.06 bit)
Abolished
rs974735901
(chr19:39540288T>A)
GAGGGGGCTTC
(chr19:39540286, -,
6.90 bits)
Cluster 1
of 2
rs978230260
(chr19:39540287A>T)
GAGGGGGCAAC
(chr19:39540286, -,
5.31 bits)
Abolished
Cluster 2
of 2
GCGTGCGTGGG
(chr19:39540162,
+, 1.59 bits)
rs764734511
(chr19:39540162G>A)
(chr19:39540162G>C)
ACGTGCGTGGG
(chr19:39540162,
+, -0.72 bit)
Cluster 2
of 2
CCGTGCGTGGG
(chr19:39540162,
+, -0.79 bit)
Cluster 2
of 2
rs996639427
(chr19:39540170G>C)
GCGTGCGTCGG
(chr19:39540162,
+, -5.21 bits)
Abolished
GCGTGGGCGCT
(chr19:39540166,
+, 9.72 bits)
GCGTCGGCGCT
(chr19:39540165,
+, -0.85 bit)
rs1027751538
(chr19:39540174G>A)
GCGTGGGCACT
(chr19:39540166,
+, 5.16 bits)
Abolished
rs887888062
(chr19:39540176T>A)
GCGTGGGCGCA
(chr19:39540166,
+, 10.94 bits)
Cluster 2
of 2
ELF1
(Rsequence =
11.2057 bits)
HIST1H4HCluster 1
of 2
GCGGAAGCGTG
(chr6:26286540, +,
9.92 bits)
rs760968937
(chr6:26286547C>T)
(chr6:26286547C>A)
GCGGAAGTGTG
(chr6:26286540, +,
10.71 bits)
Cluster 1
of 2
GCGGAAGAGTG
(chr6:26286540, +,
8.84 bits)
Cluster 1
of 2
×
rs1000196206
(chr6:26286542G>C)
GCCGAAGCGTG
(chr6:26286540, +,
-6.26 bits)
Abolished
rs144759258
(chr6:26286543G>A)
GCGAAAGCGTG
(chr6:26286540, +,
-3.60 bits)
Abolished
rs966435996
(chr6:26286544A>G)
GCGGGAGCGTG
(chr6:26286540, +,
5.28 bits)
Abolished
rs950986427
(chr6:26286548G>A)
GCGGAAGCATG
(chr6:26286540, +,
8.28 bits)
Cluster 1
of 2
Cluster 2
of 2
CAGGAGATGCG
(chr6:26286483, -,
6.98 bits)
rs373649904
(chr6:26286483G>A)
TAGGAGATGCG
(chr6:26286473, -,
0.61 bit)
Abolished
rs926919149
(chr6:26286480C>T)
CAGAAGATGCG
(chr6:26286473, -,
-6.53 bits)
Abolished
rs751263172
(chr6:26286479T>G)
CAGGCGATGCG
(chr6:26286473, -,
1.24 bits)
Abolished
rs369076253
(chr6:26286473C>G)
CAGGAGATGCC
(chr6:26286473, -,
6.92 bits)
Cluster 2
of 2
rs751263172
(chr6:1044474314C>T)
CAGGAAATGCG
(chr6:26286473, -,
11.43 bits)
Cluster 2
of 2
ELK1
(Rsequence =
11.9041 bits)
G0S2Cluster 1
of 2
CAGGGAAGACC
(chr1:209667969, -,
1.92 bits)
rs146048477
(chr1:209667961T>A)
CAGGGAAGTCC
(chr1:209667959, -,
2.24 bits)
Cluster 1
of 2
rs887606802
(chr1:209667968T>C)
CGGGGAAGACC
(chr1:209667959, -,
-3.35 bits)
Cluster 1
of 2
×
rs1021034916
(chr1:209667967C>T)
CAAGGAAGACC
(chr1:209667959, -,
-3.57 bits)
Cluster 1
of 2
GAGGAAATGAG
(chr1:209667969, +,
8.14 bits)
rs941962117
(chr1:209667974A>G)
GAGGAGATGAG
(chr1:209667969, +,
4.11 bits)
Abolished
Cluster 2
of 2
CTGGAAGAGCA
(chr1:209673554, -,
5.91 bits)
rs896117033
(chr1:209673545G>A)
CTGGAAGAGTA
(chr1:209673544, -,
3.95 bits)
Cluster 2
of 2
rs971962577
(chr1:209673546C>T)
CTGGAAGAACA
(chr1:209673544, -,
3.49 bits)
Cluster 2
of 2
rs1011969709
(chr1:209673554G>C)
GTGGAAGAGCA
(chr1:209673544, -,
3.92 bits)
Abolished
CCAGAAGTCAA
(chr1:209673551, +, 7.44 bits)
CCACAAGTCAA
(chr1:209673551, +,
-5.50 bits)
rs1023312090
(chr1:209673561A>G)
CCAGAAGTCAG
(chr1:209673551, +,
8.40 bits)
Cluster 2
of 2
ETS1
(Rsequence =
10.0788 bits)
TTC19Cluster 1
of 1
GCAGGGAAAGG
(chr17:16022293, +,
7.92 bits)
rs1022234223
(chr17:16022296G>C)
GCACGGAAAGG
(chr17:16022293, +,
-4.98 bits)
Abolished××
rs968299415
(chr17:16022301A>T)
GCAGGGAATGG
(chr17:16022293, +,
10.01 bits)
Cluster 1
of 1
GABPA
(Rsequence =
10.8567 bits)
PLEKHB2Cluster 1
of 1
ACAGGAAAGGG
(chr2:131112770, +,
10.36 bits)
rs997328042
(chr2:131112771C>T)
ATAGGAAAGGG
(chr2:131112770, +,
-3.68 bits)
Abolished××
rs1020720126
(chr2:131112773G>C)
ACACGAAAGGG
(chr2:131112770, +,
-4.16 bits)
Abolished×
TCTGGAAACTA
(chr2:131112760,
+, 1.53 bits)
rs185306857
(chr2:131112761C>A)
TATGGAAACTA
(chr2:131112760,
+, -2.86 bits)
Cluster 1
of 1
rs772728699
(chr2:131112762T>A)
TCAGGAAACTA
(chr2:131112760,
+, 5.23 bits)
Cluster 1
of 1
rs965753671
(chr2:131112769T>C)
TCTGGAAACCA
(chr2:131112760,
+, 2.13 bits)
Cluster 1
of 1
IRF1
(Rsequence =
13.5544 bits)
SMIM13Cluster 1
of 1
GAGAATGAAAGCA
(chr6:11093663, +,
12.56 bits)
rs950528541
(chr6:11093663G>C)
CAGAATGAAAGCA
(chr6:11093663,
+, 8.97 bits)
Cluster 1
of 1
×
rs886259573
(chr6:11093664A>G)
GGGAATGAAAGCA
(chr6:11093663, +,
9.65 bits)
Cluster 1
of 1
rs982931728
(chr6:11093666A>G)
GAGGATGAAAGCA
(chr6:11093663, +,
8.09 bits)
Cluster 1
of 1
rs1020218811
(chr6:11093668T>G)
GAGAAGGAAAGCA
(chr6:11093663, +,
9.36 bits)
Cluster 1
of 1
rs570723026
(chr6:11093672A>G)
GAGAATGAAGGCA
(chr6:11093663, +,
8.01 bits)
Cluster 1
of 1
rs1004825794
(chr6:11093675A>C)
(chr6:11093675A>T)
GAGAATGAAAGCC
(chr6:11093663, +,
10.47 bits)
Cluster 1
of 1
GAGAATGAAAGCA
(chr6:11093663, +,
10.42 bits)
Cluster 1
of 1
AAGACCAAAGGCA
(chr6:11093641, +,
2.43 bits)
rs1030185383
(chr6:11093649A>C)
AAGACCAACGGCA
(chr6:11093641, +,
-3.39 bits)
Cluster 1
of 1
rs5874306
(chr6:11093650delG)
AAGACCAAAGCAG
(chr6:11093641, +,
0.90 bit)
Cluster 1
of 1
rs558896490
(chr6:11093643G>A)
AAAACCAAAGGCA
(chr6:11093641, +,
7.06 bits)
Cluster 1
of 1
YY1
(Rsequence =
12.8554 bits)
CKLFCluster 1 of 1GCGGCCATCGGC
(chr16:66549797, -,
10.06 bits)
rs865922947
(chr16:66549791G>A)
CCGGCCATCGGC
(chr16:66549785, -,
6.80 bits)
Cluster 1×
rs946037930
(chr16:66549794C>A)
GCTGCCATCGGC
(chr16:66549785, -,
8.02 bits)
Cluster 1
rs917218063
(chr16:66549793C>T)
GCGACCATCGGC
(chr16:66549785, -,
5.41 bits)
Abolished×
rs928017336
(chr16:66549791G>A)
GCGGCTATCGGC
(chr16:66549785, -,
-3.62 bits)
Abolished×
GCCGCCCCCGTC
(chr16:66549792,
+, 1.34 bits)

§All coordinates are based on the hg38 genome assembly. A bold italic letter in a binding site sequence indicates the base where a SNP occurs. For each normal and variant binding site sequence, the genome coordinate of its most 5’-end base and its Ri value are indicated. The negative Ri value of a variant binding site sequence implies this site is abolished. The SNPs strengthening binding sites and corresponding variant binding site sequences are underlined.

The impact on whether the occurrence of a single SNP resulted in the disappearance of the cluster containing it is shown; ‘Abolished’ indicates that the cluster is eliminated by the existence of the variant allele.

After a single SNP occurred or multiple SNPs simultaneously occurred, the classifier produced a new prediction on whether the TF is still capable of significantly affecting gene expression via the variant promoter.

Discussion

In this study, the Bray-Curtis similarity function was initially shown (for the NR3C1 gene) to measure the relatedness of overall expression patterns between genes across a diverse set of tissues (Figure 2). A ML framework distinguished similar from dissimilar genes based on the distribution, strengths and compositions of TFBS clusters in accessible promoters, which can substantially account for the corresponding gene expression patterns (Figure 1 & Figure 3). Using gene expression knockdown data, the combinatorial use of TF binding profiles and chromatin accessibility was also demonstrated to be predictive of TF targets (Figure 4, Table 2 & Table 3). A binding site comparison confirmed that coregulatory cofactors can be used to distinguish between functional sites in targets and non-functional ones in non-targets. Furthermore, in silico mutation analyses on binding sites of targets suggested that the existence of both multiple TFBSs in a cluster and multiple information-dense clusters in the same promoter enables both the cluster and the promoter to be resilient to mutations in individual TFBSs (Figure 5, Table 5).

The DT classifier improved after intersecting promoters with DHSs in prediction of TF targets with the CRISPR-generated knockdown data (Table 2). This intersection eliminated noisy binding sites that are inaccessible to TF proteins in promoters10,31,32; specifically, it widened discrepancies in feature vectors between positives and negatives. If the 10 kb promoter of a gene instance does not overlap DHSs, its feature vector will only consist of 0; the percentages of negatives whose promoters do not overlap DHSs considerably exceeded those of positives (Additional file 822), which led to an excess of negatives with feature vectors containing only 0 after intersection. This explains why these negatives are not DE targets of the TFs in the K562 and GM19238 cell lines, because their entire promoters are not open to TF molecules; other regulatory regions besides the proximal promoters (e.g. intronic enhancers46) still enable the TFs to effectively control the expression of the positives with inaccessible promoters. Compared to the other six TFs, the poorer performance of the classifier on YY1 (Table 2) is attributable to its smaller percentage of negatives with inaccessible promoters (Additional file 822) and the larger number of functional binding sites in the K562 cell line.

Mutation analyses revealed that some deleterious TFBS mutations could be compensated for by other information-dense clusters in the same promoter (Figure 5, Table 5)2,47; thus, predicting the effects of mutations in individual binding sites might not be sufficient to interpret downstream effects without considering their context. Though other TFBS clusters may compensate and maintain gene expression, the promoter will likely exhibit lower levels of activity than the wild-type promoter, which is a recipe for achieving natural phenotypic diversity44. Few published studies in molecular diagnostics have specifically examined the effects of naturally occurring variants within clustered TFBSs. IDBC-based ML provides an alternative approach to predict deleterious mutations that impact (i.e. repress or abolish) transcription of target genes and result in abnormal phenotypes, and to minimize false positive calls of TFBS variants that alone would be expected to have little or no impact.

Apart from these TFs, the Bray-Curtis Similarity metric can be directly applied to identify the ground-truth genes with overall similar tissue-wide expression patterns to any other gene whose expression profile is known. Previous applications of this index include: a) measurement of the ecological transfer of species abundance from dense to sparse plots48, b) comparative difference analyses of species quantities between reference and algorithm-derived metagenomic sample mixtures (https://precision.fda.gov/challenges/3/view/results) and c) improvement of friend recommendations in geosocial networks by using it to compare users’ movement history49,50.

These results stimulate questions about the biological significance of genes sharing a common expression pattern, including the similarity between other regulatory regions besides proximal promoters in terms of TFBSs and epigenetic markers. This ML framework can also be applied to predict target genes for other TFs and in other cell lines, depending on the availability of corresponding knockdown data.

There are a number of limitations of our approach. The Bray-Curtis function seems unable to accurately measure the similarity between the tissue-wide expression profiles of a gene (e.g. MIR23A) without any detectable mRNA in any tissues and genes that are expressed in at least one tissue (e.g. ubiquitously expressed NR3C1 and stomach-specific PGA3). Intuitively, PGA3 is more similar to MIR23A than NR3C1; however, the Bray-Curtis similarity indicates that both PGA3 and NR3C1 are equally dissimilar to MIR23A. The finite number of TFs analyzed is another possible limitation in the prediction of genes with similar expression profiles. This was due to a lack of iPWMs for other TFs that were knocked down. Given that 2000-3000 sequence-specific DNA-binding TFs are estimated to be encoded in the human genome51, the CRMs of many genes under concerted regulation by different TFs will likely reveal complex circuitry that is currently unknown. For example, the iPWMs for several TFs (CREB, MYB, NF1, GRF1) that bind to the NR3C1 gene promoter to activate or repress its expression could not be successfully derived from ChIP-seq data3,30. Regarding the CRISPR-generated knockdown data, positives were inferred to be direct targets by intersecting their promoters with corresponding ChIP-seq peaks. This may not be completely accurate, due to the presence of noise peaks that do not contain true TFBSs3,52,53. Small fold changes in the expression levels of DE targets could arise from inefficient knockdown due to suboptimal guide RNAs or to limitations of perturbing only a single allele encoding the TF54. Finally, the framework presented considers only the 10 kb interval proximal to the TSS. This could not capture long range enhancer effects beyond this point; a potential way of remediating this would be to incorporate correlation-based approaches that have successfully incorporated multiple definitions of promoter length15.

Conclusions

We have developed a ML framework with a combination of information theory-based TF binding profiles of the spatial distribution and information contents of TFBS clusters, ChIP-seq and chromatin accessibility data. This framework distinguishes tissue-wide expression profiles of similar vs dissimilar genes (originally defined by the Bray Curtis function) and identified TF targets. Functional binding sites in target genes that significantly alter expression levels upon direct binding are at least partially distinguished by TF-cofactor coregulation from non-functional sites in non-targets. Finally, in-silico mutation analyses suggested that the presence of multiple information-dense clusters in a target gene promoter is capable of mitigating the effects of deleterious mutations that can significantly alter TF-regulated expression levels.

bioRxiv

An earlier version this article is available from bioRxiv: https://doi.org/10.1101/28326755.

Data availability

Underlying data

The median RPKM, TSS coordinate, DNase I hypersensitivity and ChIP-seq data were respectively obtained from the GTEx Analysis V6p release (www.gtexportal.org), Ensembl Biomart (www.ensembl.org) and ENCODE (www.encodeproject.org). The CRISPR- and siRNA-generated knockdown data were obtained from the supplementary information files of Dixit et al.16 and Cusanovich et al.14. The source datasets generated and/or analysed by this framework, along with sample results and compiled software are available from Zenodo. DOI: https://doi.org/10.5281/zenodo.170742321.

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).

Extended data

Additional files are available from Zenodo. DOI: https://doi.org/10.5281/zenodo.261195322.

Additional file 1. The mathematical definitions of the four other similarity metrics, the workflow of the IDBC algorithm, an example feature vector, the mathematical definitions of five statistical variables to measure classifier performance, the default parameter values of classifiers in MATLAB, and histograms visualizing the first two criteria for selecting positives from the CRISPR-generated knockdown data.

Additional file 2: The lists of positives and negatives in the ML classifiers to predict genes with similar tissue-wide expression profiles to NR3C1.

Additional file 3: The lists of positives and negatives in the DT classifier to predict TF targets based on the CRISPR-generated knockdown data.

Additional file 4: The lists of positives and negatives in the DT classifier to predict DE direct targets based on the siRNA-generated knockdown data.

Additional file 5: The performance of the DT classifier using only TFBS counts, accuracy of each round of 10-fold cross validation, and Gini importance values of the ML features.

Additional file 6: The list of the most similar 500 PC genes to each TF in terms of tissue-wide expression profiles, and the intersection of these 500 genes and target genes of the TF.

Additional file 7: Cofactor binding sites adjacent to YY1 and EGR1 sites in the promoters of their targets and non-targets.

Additional file 8: The percentages of positives and negatives whose promoters do not overlap DHSs for the CRISPR-perturbed TFs.

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).

Software availability

Source code implementing the ML framework, including generating the figures in this article, is available at: https://bitbucket.org/cytognomix/information-dense-transcription-factor-binding-site-clusters/.

Archived source code at time of publication: https://doi.org/10.5281/zenodo.189205156.

License: GNU General Public License 3.0.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 14 Dec 2018
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Lu R and Rogan PK. Transcription factor binding site clusters identify target genes with similar tissue-wide expression and buffer against mutations [version 2; peer review: 2 approved]. F1000Research 2019, 7:1933 (https://doi.org/10.12688/f1000research.17363.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 08 Apr 2019
Revised
Views
10
Cite
Reviewer Report 11 Apr 2019
Daphne Ezer, The Alan Turing Institute for Data Science,  London, UK 
Approved
VIEWS 10
Most of the comments were addressed. I still have reservations about point #2 from my previous report - the authors just repeated that their approach fits the definition of a distance metric (which is true), but I think that many biologists ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Ezer D. Reviewer Report For: Transcription factor binding site clusters identify target genes with similar tissue-wide expression and buffer against mutations [version 2; peer review: 2 approved]. F1000Research 2019, 7:1933 (https://doi.org/10.5256/f1000research.20525.r46854)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
8
Cite
Reviewer Report 09 Apr 2019
Nicolae Radu Zabet, School of Biological Sciences, University of Essex, Colchester, UK 
Approved
VIEWS 8
The authors have ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Zabet NR. Reviewer Report For: Transcription factor binding site clusters identify target genes with similar tissue-wide expression and buffer against mutations [version 2; peer review: 2 approved]. F1000Research 2019, 7:1933 (https://doi.org/10.5256/f1000research.20525.r46855)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Version 1
VERSION 1
PUBLISHED 14 Dec 2018
Views
21
Cite
Reviewer Report 08 Feb 2019
Nicolae Radu Zabet, School of Biological Sciences, University of Essex, Colchester, UK 
Approved with Reservations
VIEWS 21
In this manuscript, Ru and Rogan use Bray-Curtis Similarity and several machine-learning algorithms to identify genes that have similar expression patterns. They use transcription factor binding sites within promoter regions and DNA accessibility data to train their models. This is ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Zabet NR. Reviewer Report For: Transcription factor binding site clusters identify target genes with similar tissue-wide expression and buffer against mutations [version 2; peer review: 2 approved]. F1000Research 2019, 7:1933 (https://doi.org/10.5256/f1000research.18988.r42457)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 08 Apr 2019
    Peter Rogan, Biochemistry, University of Western Ontario, London, N6A 5C1, Canada
    08 Apr 2019
    Author Response
    Comment 1: While the grammar is at a good level, the way the information is presented makes the text very difficult to read. Some sentences are very long and there ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 08 Apr 2019
    Peter Rogan, Biochemistry, University of Western Ontario, London, N6A 5C1, Canada
    08 Apr 2019
    Author Response
    Comment 1: While the grammar is at a good level, the way the information is presented makes the text very difficult to read. Some sentences are very long and there ... Continue reading
Views
25
Cite
Reviewer Report 09 Jan 2019
Daphne Ezer, The Alan Turing Institute for Data Science,  London, UK 
Approved with Reservations
VIEWS 25
I think that this is an interesting paper that should be published. Often, gene expression patterns are clustered and TF binding sites are used as features to build a classifier for identifying the cluster to which those genes belong or ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Ezer D. Reviewer Report For: Transcription factor binding site clusters identify target genes with similar tissue-wide expression and buffer against mutations [version 2; peer review: 2 approved]. F1000Research 2019, 7:1933 (https://doi.org/10.5256/f1000research.18988.r42458)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 08 Apr 2019
    Peter Rogan, Biochemistry, University of Western Ontario, London, N6A 5C1, Canada
    08 Apr 2019
    Author Response
    Comment 1: One of the main things that bothers me about the Bray-Curtis Similarity metric is that it seems to assume that tissues are independently sampled. However. we see from ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 08 Apr 2019
    Peter Rogan, Biochemistry, University of Western Ontario, London, N6A 5C1, Canada
    08 Apr 2019
    Author Response
    Comment 1: One of the main things that bothers me about the Bray-Curtis Similarity metric is that it seems to assume that tissues are independently sampled. However. we see from ... Continue reading

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 14 Dec 2018
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.