# Chapter 12 Cell type annotation

## 12.1 Motivation

The most challenging task in scRNA-seq data analysis is arguably the interpretation of the results. Obtaining clusters of cells is fairly straightforward, but it is more difficult to determine what biological state is represented by each of those clusters. Doing so requires us to bridge the gap between the current dataset and prior biological knowledge, and the latter is not always available in a consistent and quantitative manner3. Indeed, even the concept of a “cell type” is not clearly defined, with most practitioners possessing a “I’ll know it when I see it” intuition that is not amenable to computational analysis. As such, intepretation of scRNA-seq data is often manual and a common bottleneck in the analysis workflow.

To expedite this step, we can use various computational approaches that exploit prior information to assign meaning to an uncharacterized scRNA-seq dataset. The most obvious sources of prior information are the curated gene sets associated with particular biological processes, e.g., from the Gene Ontology (GO) or the Kyoto Encyclopedia of Genes and Genomes (KEGG) collections. Alternatively, we can directly compare our expression profiles to published reference datasets where each sample or cell has already been annotated with its putative biological state by domain experts. Here, we will demonstrate both approaches with several different scRNA-seq datasets.

## 12.2 Assigning cell labels from reference data

### 12.2.1 Overview

A conceptually straightforward annotation approach is to compare the single-cell expression profiles with previously annotated reference datasets. Labels can then be assigned to each cell in our uncharacterized test dataset based on the most similar reference sample(s), for some definition of “similar”. This is a standard classification challenge that can be tackled by standard machine learning techniques such as random forests and support vector machines. Any published and labelled RNA-seq dataset (bulk or single-cell) can be used as a reference, though its reliability depends greatly on the expertise of the original authors who assigned the labels in the first place.

In this section, we will demonstrate the use of the SingleR method (Aran et al. 2019) for cell type annotation. This method assigns labels to cells based on the reference samples with the highest Spearman rank correlations, and thus can be considered a rank-based variant of $$k$$-nearest-neighbor classification. To reduce noise, SingleR identifies marker genes between pairs of labels and computes the correlation using only those markers. It also performs a fine-tuning step for each cell where calculation of the correlations is repeated with just the marker genes for the top-scoring labels. This aims to resolve any ambiguity between those labels by removing noise from irrelevant markers for other labels.

### 12.2.2 Using the in-built references

SingleR contains a number of built-in reference datasets, mostly assembled from bulk RNA-seq or microarray data of sorted cell types. These built-in references are often good enough for most applications, provided that they contain the cell types that are expected in the test population. We will demonstrate on the 10X PBMC dataset using a reference constructed from Blueprint and ENCODE data (Martens and Stunnenberg 2013; The ENCODE Project Consortium 2012).

## class: SingleCellExperiment
## dim: 33694 3922
## assays(2): counts logcounts
## rownames(33694): RP11-34P13.3 FAM138A ... AC213203.1 FAM231B
## rowData names(2): ID Symbol
## colnames(3922): AAACCTGAGAAGGCCT-1 AAACCTGAGACAGACC-1 ...
##   TTTGTCACAGGTCCAC-1 TTTGTCATCCCAAGAT-1
## colData names(3): Sample Barcode cluster
## reducedDimNames(3): PCA TSNE UMAP
## spikeNames(0):
## altExpNames(0):

We label our PBMCs using the SingleR() function with the main cell type labels in the reference. This returns a DataFrame where each row corresponds to a cell in the test dataset and contains its label assignments. Alternatively, we could use the labels in ref\$label.fine, which provide more resolution at the cost of speed and increased ambiguity in the assignments.

##
##      B-cells CD4+ T-cells CD8+ T-cells           DC  Eosinophils
##          527          750         1257            1            1
## Erythrocytes          HSC    Monocytes     NK cells
##            4           15         1112          255

We inspect the results using a heatmap of the per-cell and label scores (Figure 12.1). Ideally, each cell should exhibit a high score in one label relative to all of the others, indicating that the assignment to that label was unambiguous. This is largely the case for monocytes and B cells, whereas we see more ambiguity between CD4+ and CD8+ T cells (and to a lesser extent, NK cells).

SingleR() will attempt to prune out low-quality assignments by marking them as NA. This is done based on the difference $$\Delta_{med}$$ of the assigned label’s score from the median score within each cell. Small $$\Delta_{med}$$ values indicate that the cell assignment was so uncertain that the reported label is not much better than the bulk of other labels in the reference. We set a minimum threshold on the acceptable $$\Delta_{med}$$ using an outlier-based approach for each label, where labels with $$\Delta_{med}$$ that are substantially lower than the majority of values for a given label are marked as NA (Figure 12.2). If necessary, more control over the pruning can be achieved by supplying custom parameters to the pruneScores() function.

## [1] 81

We compare the assignments with the clustering results to determine the identity of each cluster. Ideally, clusters and labels would have a 1:1 relationship, though some nesting is likely depending on the resolution of the clustering algorithm. For example, several clusters are nested within the monocyte and B cell labels (Figure 12.3), suggesting the the former represent finer subdivisions within the latter. Interestingly, our clustering does not effectively distinguish between CD4+ and CD8+ T cell labels. We attribute this to the presence of other factors of heterogeneity within the T cell subpopulation that have a stronger influence on unsupervised methods than the a priori expected CD4/CD8 distinction.

This episode highlights some of the differences between reference-based annotation and unsupervised clustering. The former explicitly focuses on aspects of the data that are known to be interesting, simplifying the process of biological interpretation. However, the cost is that the downstream analysis is restricted by the diversity and resolution of the available labels. We suggest applying both strategies and, if major disagreements are present between reference label and cluster assignments, using those discrepancies as the basis for further investigation to discover novel effects.

### 12.2.3 Using custom references

It is also straightforward to apply SingleR to user-supplied reference datasets. For bulk references, the same code shown above can be used, while some additional work is required for single-cell references. To illustrate, we will use the Muraro et al. (2016) human pancreas dataset as our reference.

## class: SingleCellExperiment
## dim: 16940 2346
## assays(2): counts logcounts
## rownames(16940): ENSG00000268895 ENSG00000121410 ...
##   ENSG00000159840 ENSG00000074755
## rowData names(2): symbol chr
## colnames(2346): D28-1_1 D28-1_2 ... D30-8_93 D30-8_94
## colData names(3): label donor plate
## reducedDimNames(0):
## spikeNames(0):
## altExpNames(1): ERCC
##
##      acinar       alpha        beta       delta        duct endothelial
##         218         803         446         191         242          20
##     epsilon mesenchymal          pp
##           3          80          99

We use methods from scran to generate marker sets for every reference label (Chapter ??). Here, we use the pairwiseWilcox() and getTopMarkers() functions to take the top 10 upregulated genes from each pairwise comparison between reference labels, using the Wilcoxon test with a log-fold change threshold of 1. This enables us to select a custom set of marker genes that is both discriminative and concise, which is faster to run and often more effective for single-cell references than the default marker set that is auto-generated inside SingleR(). (We could also use this custom approach for our bulk references, but the default is more convenient and often works well enough.)

## List of length 9
## names(9): acinar alpha beta delta duct endothelial epsilon mesenchymal pp

We use these newly identified markers in SingleR() to assign labels to our test dataset from Segerstolpe et al. (2016). As it so happens, we are in the fortunate position where our test dataset also contains independently defined labels. We see strong consistency between the two sets of labels (Figure 12.4), indicating that our automatic annotation is comparable to that generated manually by domain experts.

##
##      acinar       alpha        beta       delta        duct endothelial
##         189         898         300         110         395          17
##     epsilon mesenchymal          pp
##           8          54         198

An interesting question is - given a single-cell reference dataset, is it better to use it directly or convert it to pseudo-bulk values? A single-cell reference preserves the “shape” of the subpopulation in high-dimensional expression space, potentially yielding more accurate predictions when the differences between labels are subtle (or at least capturing ambiguity more accurately to avoid grossly incorrect predictions). However, it also requires more computational work to assign each cell in the test dataset. We tend to prefer using a single-cell reference directly when one is available, though it is unlikely to make much difference when the labels are well-separated.

## 12.3 Assigning cell labels from gene sets

A related strategy is to explicitly identify sets of marker genes that are highly expressed in each individual cell. This does not require matching of individual cells to the expression values of the reference dataset, which is faster and more convenient when only the identities of the markers are available. We demonstrate this approach using neuronal cell type markers derived from the Zeisel et al. (2015) study.

## astrocytes_ependymal    endothelial-mural         interneurons
##                   79                   83                  118
##            microglia     oligodendrocytes        pyramidal CA1
##                   69                   81                  125
##         pyramidal SS
##                  149

Our test dataset will be another brain scRNA-seq experiment from Tasic et al. (2016).

## class: SingleCellExperiment
## dim: 24058 1809
## assays(1): counts
## rownames(24058): 0610005C13Rik 0610007C21Rik ... mt_X57780
##   tdTomato
## rowData names(0):
## colnames(1809): Calb2_tdTpositive_cell_1 Calb2_tdTpositive_cell_2
##   ... Rbp4_CTX_250ng_2 Trib2_CTX_250ng_1
## colData names(13): sample_title mouse_line ... secondary_type
##   aibs_vignette_id
## reducedDimNames(0):
## spikeNames(0):
## altExpNames(1): ERCC

We use the AUCell package to identify marker sets that are highly expressed in each cell. This method ranks genes by their expression values within each cell and constructs a response curve of the number of genes from each marker set that are present with increasing rank. It then computes the area under the curve (AUC) for each marker set, quantifying the enrichment of those markers among the most highly expressed genes in that cell. This is roughly similar to performing a Wilcoxon rank sum test between genes in and outside of the set, but involving only the top ranking genes by expression in each cell.

##                           gene sets
## cells                      astrocytes_ependymal endothelial-mural
##   Calb2_tdTpositive_cell_1               0.1387           0.04264
##   Calb2_tdTpositive_cell_2               0.1366           0.04885
##   Calb2_tdTpositive_cell_3               0.1087           0.07270
##   Calb2_tdTpositive_cell_4               0.1322           0.04993
##   Calb2_tdTpositive_cell_5               0.1513           0.07161
##   Calb2_tdTpositive_cell_6               0.1342           0.09161
##                           gene sets
## cells                      interneurons microglia oligodendrocytes
##   Calb2_tdTpositive_cell_1       0.5306   0.04845           0.1318
##   Calb2_tdTpositive_cell_2       0.4538   0.02683           0.1211
##   Calb2_tdTpositive_cell_3       0.3459   0.03583           0.1567
##   Calb2_tdTpositive_cell_4       0.5113   0.05388           0.1481
##   Calb2_tdTpositive_cell_5       0.4930   0.06656           0.1386
##   Calb2_tdTpositive_cell_6       0.3378   0.03201           0.1553
##                           gene sets
## cells                      pyramidal CA1 pyramidal SS
##   Calb2_tdTpositive_cell_1        0.2318       0.3477
##   Calb2_tdTpositive_cell_2        0.2063       0.2762
##   Calb2_tdTpositive_cell_3        0.3219       0.5244
##   Calb2_tdTpositive_cell_4        0.2547       0.3506
##   Calb2_tdTpositive_cell_5        0.2088       0.3010
##   Calb2_tdTpositive_cell_6        0.4011       0.5393

We assign cell type identity to each cell in the test dataset by taking the marker set with the top AUC as the label for that cell. Our new labels mostly agree with the original annotation from Tasic et al. (2016), which is encouraging. The only exception involves misassignment of oligodendrocyte precursors to astrocytes, which may be understandable given that they are derived from a common lineage. In the absence of prior annotation, a more general diagnostic check is to compare the assigned labels to cluster identities, under the expectation that most cells of a single cluster would have the same label (or, if multiple labels are present, they should at least represent closely related cell states).

##
## new.labels             Astrocyte Endothelial Cell GABA-ergic Neuron
##   astrocytes_ependymal        43                2                 0
##   endothelial-mural            0               27                 0
##   interneurons                 0                0               759
##   microglia                    0                0                 0
##   oligodendrocytes             0                0                 1
##   pyramidal SS                 0                0                 1
##
## new.labels             Glutamatergic Neuron Microglia Oligodendrocyte
##   astrocytes_ependymal                    0         0               0
##   endothelial-mural                       0         0               0
##   interneurons                            2         0               0
##   microglia                               0        22               0
##   oligodendrocytes                        0         0              38
##   pyramidal SS                          810         0               0
##
## new.labels             Oligodendrocyte Precursor Cell Unclassified
##   astrocytes_ependymal                             20            4
##   endothelial-mural                                 0            2
##   interneurons                                      0           15
##   microglia                                         0            1
##   oligodendrocytes                                  2            0
##   pyramidal SS                                      0           60

Another simple diagnostic metric is the difference $$\Delta_{AUC}$$ between the maximum and median AUCs for each cell. An umambiguous assignment should manifest as a large $$\Delta_{AUC}$$ for that cell (Figure 12.5), while small differences indicate that the assignment is uncertain. If necessary, we can remove uncertain assignments by applying a minimum threshold on the $$\Delta_{AUC}$$, e.g., to achieve greater agreement with the clustering results or prior annotation. The example below identifies small outlier $$\Delta_{AUC}$$ values under the assumption that most cells are correctly assigned and that there is only modest heterogeneity within each label.

##
## astrocytes_ependymal    endothelial-mural         interneurons
##                   24                    1                    7
##     oligodendrocytes         pyramidal SS
##                   10                   16

Interpretation of the AUCell results is most straightforward when the marker sets are mutually exclusive, as shown above for the cell type markers. In other applications, one might consider computing AUCs for gene sets associated with signalling or metabolic pathways. It is likely that multiple pathways will be active in any given cell, and it is tempting to use the AUCs to quantify this activity for comparison across cells. However, such comparisons must be interpreted with much caution as the AUCs are competitive values - any increase in one pathway’s activity will naturally reduce the AUCs for all other pathways, potentially resulting in spurious differences across the population.

As we mentioned previously, the advantage of the AUCell approach is that it does not require reference expression values. This is particularly useful when dealing with gene sets derived from the literature or other qualitative forms of biological knowledge. (In this particular example, we do have the original expression values, so we could have used SingleR directly. However, this may not always be the case.) The flipside is that information on relative expression is lost when only the marker identities are used. The net effect of ignoring expression values is difficult to predict - it may reduce performance for resolving more subtle cell types, but may also improve performance if the per-cell expression was too noisy to be useful.

## 12.4 Assigning cluster labels from markers

Yet another strategy for annotation is to perform a gene set enrichment analysis on the marker genes defining each cluster. This identifies the pathways and processes that are (relatively) active in each cluster based on upregulation of the associated genes compared to other clusters. We demonstrate on the mouse mammary dataset from Bach et al. (2017), using markers that are identified by findMarkers() as being upregulated at a log-fold change threshold of 1.

As an example, we obtain annotations for the marker genes that define cluster 2. We will use gene sets defined by the Gene Ontology (GO) project, which describe a comprehensive range of biological processes and functions. We define our subset of relevant marker genes at a FDR of 5% and apply the goana() function from the limma package. This performs a hypergeometric test to identify GO terms that are overrepresented in our marker subset. (The log-fold change threshold mentioned above is useful here, as it avoids including an excessive number of genes from the overpowered nature of per-cell DE comparisons.)

##    Mode   FALSE    TRUE
## logical   27819     179
##                                                                      Term
## GO:0006641                                 triglyceride metabolic process
## GO:0006119                                      oxidative phosphorylation
## GO:0006639                                 acylglycerol metabolic process
## GO:0006638                                neutral lipid metabolic process
## GO:0042775         mitochondrial ATP synthesis coupled electron transport
## GO:0042773                       ATP synthesis coupled electron transport
## GO:0022408                      negative regulation of cell-cell adhesion
## GO:0035148                                                 tube formation
## GO:0050729                   positive regulation of inflammatory response
## GO:0022904                           respiratory electron transport chain
## GO:0022900                                       electron transport chain
## GO:0045333                                           cellular respiration
## GO:0071404 cellular response to low-density lipoprotein particle stimulus
## GO:0019432                              triglyceride biosynthetic process
## GO:0046460                             neutral lipid biosynthetic process
## GO:0046463                              acylglycerol biosynthetic process
## GO:1903707                             negative regulation of hemopoiesis
## GO:0019915                                                  lipid storage
## GO:2001198                   regulation of dendritic cell differentiation
## GO:0042098                                           T cell proliferation
##            Ont   N DE      P.DE
## GO:0006641  BP  96 10 1.954e-09
## GO:0006119  BP  86  9 1.233e-08
## GO:0006639  BP 119 10 1.598e-08
## GO:0006638  BP 121 10 1.877e-08
## GO:0042775  BP  51  7 8.011e-08
## GO:0042773  BP  52  7 9.202e-08
## GO:0022408  BP 184 11 1.037e-07
## GO:0035148  BP 173 10 5.460e-07
## GO:0050729  BP 134  9 5.819e-07
## GO:0022904  BP  71  7 8.152e-07
## GO:0022900  BP  75  7 1.188e-06
## GO:0045333  BP 151  9 1.585e-06
## GO:0071404  BP  15  4 3.364e-06
## GO:0019432  BP  34  5 4.344e-06
## GO:0046460  BP  37  5 6.687e-06
## GO:0046463  BP  37  5 6.687e-06
## GO:1903707  BP 145  8 1.078e-05
## GO:0019915  BP  70  6 1.160e-05
## GO:2001198  BP   7  3 1.267e-05
## GO:0042098  BP 197  9 1.385e-05

We see an enrichment for genes involved in lipid synthesis, cell adhesion and tube formation. Given that this is a mammary gland experiment, we might guess that cluster 2 contains luminal epithelial cells responsible for milk production and secretion. Indeed, a closer examination of the marker list indicates that this cluster upregulates milk proteins Csn2 and Csn3 (Figure ??).

Further inspection of interesting GO terms is achieved by extracting the relevant genes. This is usually desirable to confirm that the interpretation of the annotated biological process is appropriate. Many terms have overlapping gene sets, so a term may only be highly ranked because it shares genes with a more relevant term that represents the active pathway.

## DataFrame with 10 rows and 3 columns
##               Top              p.value                  FDR
##         <integer>            <numeric>            <numeric>
## Spint2         11 3.28233813558062e-34 1.37162541970129e-31
## Epcam          17 8.86977570468839e-94 7.09531371942468e-91
## Cebpb          21 6.76956758443314e-16 2.03800379816085e-13
## Cd24a          21 3.24195320872789e-33 1.29668865625663e-30
## Btn1a1         24 2.16573706354308e-13 6.12487942475547e-11
## Cd9            51 1.41373288514262e-11 3.56591831695704e-09
## Ceacam1        52 1.66947885489071e-38 7.79034482987171e-36
## Sdc4           59 9.15001361375816e-07 0.000175467178875343
## Anxa1          68 2.58840427382504e-06 0.000476777255648379
## Cdh1           69 1.73658368720693e-07 3.54896861857078e-05

Gene set testing of marker lists is a reliable approach for determining if pathways are up- or down-regulated between clusters. As the top marker genes are simply DEGs, we can directly apply well-established procedures for testing gene enrichment in DEG lists (see here for relevant packages). This contrasts with the AUCell approach where scores are not easily comparable across cells. The downside is that all conclusions are made relative to the other clusters, making it more difficult to determine cell identity if an “outgroup” is not present in the same study.

## 12.5 Computing gene set activities

For the sake of completeness, we should mention that we can also quantify gene set activity on a per-cell level and test for differences in activity. This inverts the standard gene set testing procedure by combining information across genes first and then testing for differences afterwards. To avoid the pitfalls mentioned previously for the AUCs, we simply compute the average of the log-expression values across all genes in the set for each cell. This is less sensitive to the behavior of other genes in that cell (aside from composition biases, as discussed in Chapter 7).

## [1] 22547  2772
## 10 x 5 sparse Matrix of class "dgCMatrix"
##
## GO:0000002 0.39077 0.2717 0.09952 0.2353 0.2875
## GO:0000003 0.26368 0.2700 0.21232 0.1856 0.2140
## GO:0000009 .       .      .       .      .
## GO:0000010 .       .      .       .      .
## GO:0000012 0.36291 0.4778 0.18489 .      0.3582
## GO:0000014 0.07068 0.3256 0.11094 0.3550 0.3539
## GO:0000015 0.53680 0.3006 0.33281 0.3550 0.5630
## GO:0000016 .       .      .       .      .
## GO:0000018 0.26146 0.2756 0.06163 0.1353 0.1520
## GO:0000019 .       0.2220 .       0.1613 0.2413

We can then identify “differential gene set activity” between clusters by looking for significant differences in the per-set averages of the relevant cells. For example, we observe that cluster 2 has the highest average expression for the triacylglycerol biosynthesis GO term (Figure 12.6), consistent with the proposed identity of those cells.

The obvious disadvantage of this approach is that not all genes in the set may exhibit the same pattern of differences. Non-DE genes will add noise to the per-set average, “diluting” the strength of any differences compared to an analysis that focuses directly on the DE genes (Figure ??). At worst, a gene set may contain subsets of DE genes that change in opposite directions, cancelling out any differences in the per-set average. This is not uncommon for gene sets that contain both positive and negative regulators of a particular biological process or pathway.

We could attempt to use the per-set averages to identify gene sets of interest via differential testing across all possible sets, e.g., with findMarkers(). However, the highest ranking gene sets in this approach tend to be very small and uninteresting because - by definition - the pitfalls mentioned above are avoided when there is only one gene in the set. This is compounded by the fact that the log-fold changes in the per-set averages are difficult to interpret. For these reasons, we generally reserve the use of this gene set summary statistic for visualization rather than any real statistical analysis.

## Session Info

R version 3.6.1 (2019-07-05)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Ubuntu 14.04.5 LTS

Matrix products: default
BLAS:   /home/ramezqui/Rbuild/danbuild/R-3.6.1/lib/libRblas.so
LAPACK: /home/ramezqui/Rbuild/danbuild/R-3.6.1/lib/libRlapack.so

locale:
[1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C
[3] LC_TIME=en_US.UTF-8        LC_COLLATE=C
[5] LC_MONETARY=en_US.UTF-8    LC_MESSAGES=en_US.UTF-8
[7] LC_PAPER=en_US.UTF-8       LC_NAME=C
[11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C

attached base packages:
[1] parallel  stats4    stats     graphics  grDevices utils     datasets
[8] methods   base

other attached packages:
[1] limma_3.42.0                org.Mm.eg.db_3.10.0
[3] DelayedMatrixStats_1.8.0    scater_1.14.0
[5] ggplot2_3.2.1               AUCell_1.8.0
[7] GSEABase_1.48.0             graph_1.64.0
[9] annotate_1.64.0             XML_3.98-1.20
[11] AnnotationDbi_1.48.0        scRNAseq_1.99.8
[13] fossil_0.3.7                shapefiles_0.7
[15] foreign_0.8-72              maps_3.3.0
[17] sp_1.3-1                    scran_1.14.0
[19] pheatmap_1.0.12             SingleR_1.0.0
[21] SingleCellExperiment_1.8.0  SummarizedExperiment_1.16.0
[23] DelayedArray_0.12.0         BiocParallel_1.20.0
[25] matrixStats_0.55.0          Biobase_2.46.0
[27] GenomicRanges_1.38.0        GenomeInfoDb_1.22.0
[29] IRanges_2.20.0              S4Vectors_0.24.0
[31] BiocGenerics_0.32.0         Cairo_1.5-10
[33] BiocStyle_2.14.0            OSCAUtils_0.0.1

loaded via a namespace (and not attached):
[1] ggbeeswarm_0.6.0              colorspace_1.4-1
[3] XVector_0.26.0                BiocNeighbors_1.4.0
[5] bit64_0.9-7                   interactiveDisplayBase_1.24.0
[7] R.methodsS3_1.7.1             knitr_1.25
[9] zeallot_0.1.0                 GO.db_3.10.0
[11] dbplyr_1.4.2                  R.oo_1.22.0
[13] shiny_1.4.0                   BiocManager_1.30.9
[15] compiler_3.6.1                httr_1.4.1
[17] dqrng_0.2.1                   backports_1.1.5
[19] assertthat_0.2.1              Matrix_1.2-17
[21] fastmap_1.0.1                 lazyeval_0.2.2
[23] later_1.0.0                   BiocSingular_1.2.0
[25] htmltools_0.4.0               tools_3.6.1
[27] rsvd_1.0.2                    igraph_1.2.4.1
[29] gtable_0.3.0                  glue_1.3.1
[31] GenomeInfoDbData_1.2.2        dplyr_0.8.3
[33] rappdirs_0.3.1                Rcpp_1.0.2
[35] vctrs_0.2.0                   ExperimentHub_1.12.0
[37] xfun_0.10                     stringr_1.4.0
[39] mime_0.7                      irlba_2.3.3
[41] statmod_1.4.32                AnnotationHub_2.18.0
[43] edgeR_3.28.0                  zlibbioc_1.32.0
[45] scales_1.0.0                  promises_1.1.0
[47] RColorBrewer_1.1-2            yaml_2.2.0
[49] curl_4.2                      memoise_1.1.0
[51] gridExtra_2.3                 stringi_1.4.3
[53] RSQLite_2.1.2                 BiocVersion_3.10.1
[55] highr_0.8                     rlang_0.4.1
[57] pkgconfig_2.0.3               bitops_1.0-6
[59] evaluate_0.14                 lattice_0.20-38
[61] purrr_0.3.3                   labeling_0.3
[63] cowplot_1.0.0                 bit_1.1-14
[65] tidyselect_0.2.5              magrittr_1.5
[67] bookdown_0.14                 R6_2.4.0
[69] DBI_1.0.0                     pillar_1.4.2
[71] withr_2.1.2                   RCurl_1.95-4.12
[73] tibble_2.1.3                  crayon_1.3.4
[75] BiocFileCache_1.10.0          rmarkdown_1.16
[77] viridis_0.5.1                 locfit_1.5-9.1
[79] grid_3.6.1                    data.table_1.12.6
[81] blob_1.2.0                    digest_0.6.22
[83] xtable_1.8-4                  httpuv_1.5.2
[85] R.utils_2.9.0                 munsell_0.5.0
[87] beeswarm_0.2.3                viridisLite_0.3.0
[89] vipor_0.4.5

### Bibliography

Aran, D., A. P. Looney, L. Liu, E. Wu, V. Fong, A. Hsu, S. Chak, et al. 2019. “Reference-based analysis of lung single-cell sequencing reveals a transitional profibrotic macrophage.” Nat. Immunol. 20 (2):163–72.

Bach, K., S. Pensa, M. Grzelak, J. Hadfield, D. J. Adams, J. C. Marioni, and W. T. Khaled. 2017. “Differentiation dynamics of mammary epithelial cells revealed by single-cell RNA sequencing.” Nat Commun 8 (1):2128.

Martens, J. H., and H. G. Stunnenberg. 2013. “BLUEPRINT: mapping human blood cell epigenomes.” Haematologica 98 (10):1487–9.

Muraro, M. J., G. Dharmadhikari, D. Grun, N. Groen, T. Dielen, E. Jansen, L. van Gurp, et al. 2016. “A Single-Cell Transcriptome Atlas of the Human Pancreas.” Cell Syst 3 (4):385–94.

Segerstolpe, A., A. Palasantza, P. Eliasson, E. M. Andersson, A. C. Andreasson, X. Sun, S. Picelli, et al. 2016. “Single-Cell Transcriptome Profiling of Human Pancreatic Islets in Health and Type 2 Diabetes.” Cell Metab. 24 (4):593–607.

Tasic, B., V. Menon, T. N. Nguyen, T. K. Kim, T. Jarsky, Z. Yao, B. Levi, et al. 2016. “Adult mouse cortical cell taxonomy revealed by single cell transcriptomics.” Nat. Neurosci. 19 (2):335–46.

The ENCODE Project Consortium. 2012. “An integrated encyclopedia of DNA elements in the human genome.” Nature 489 (7414):57–74.

Zeisel, A., A. B. Munoz-Manchado, S. Codeluppi, P. Lonnerberg, G. La Manno, A. Jureus, S. Marques, et al. 2015. “Brain structure. Cell types in the mouse cortex and hippocampus revealed by single-cell RNA-seq.” Science 347 (6226):1138–42.

1. For example, it may be somewhere in your bench collaborator’s head. Try sshing into that.