Skip to main content
Frontiers in Oncology logoLink to Frontiers in Oncology
. 2022 Jul 29;12:918900. doi: 10.3389/fonc.2022.918900

Next-Generation Pathology Using Multiplexed Immunohistochemistry: Mapping Tissue Architecture at Single-Cell Level

Francesca Maria Bosisio 1,*, Yannick Van Herck 2, Julie Messiaen 1,3,4, Maddalena Maria Bolognesi 5,6, Lukas Marcelis 1, Matthias Van Haele 1, Giorgio Cattoretti 5,6, Asier Antoranz 1,3, Frederik De Smet 1,3,*
PMCID: PMC9389457  PMID: 35992810

Abstract

Single-cell omics aim at charting the different types and properties of all cells in the human body in health and disease. Over the past years, myriads of cellular phenotypes have been defined by methods that mostly required cells to be dissociated and removed from their original microenvironment, thus destroying valuable information about their location and interactions. Growing insights, however, are showing that such information is crucial to understand complex disease states. For decades, pathologists have interpreted cells in the context of their tissue using low-plex antibody- and morphology-based methods. Novel technologies for multiplexed immunohistochemistry are now rendering it possible to perform extended single-cell expression profiling using dozens of protein markers in the spatial context of a single tissue section. The combination of these novel technologies with extended data analysis tools allows us now to study cell-cell interactions, define cellular sociology, and describe detailed aberrations in tissue architecture, as such gaining much deeper insights in disease states. In this review, we provide a comprehensive overview of the available technologies for multiplexed immunohistochemistry, their advantages and challenges. We also provide the principles on how to interpret high-dimensional data in a spatial context. Similar to the fact that no one can just “read” a genome, pathological assessments are in dire need of extended digital data repositories to bring diagnostics and tissue interpretation to the next level.

Keywords: multiplexed immunofluorescencence and immunohistochemistry, spatial profiling, single-cell ‘omics, tissue architecture analysis, methods for spatial profiling

Introduction

For centuries, medical sciences have tried to achieve a deep understanding of the human body, both in health and disease. Twenty years ago, a major hurdle was crossed with the mapping of the human genome (1). However, it is now becoming clear that one cannot just “read” a genome and subsequently understand or predict the principles that underlie human biology or disease. The sole true interpreters of the genome are cells, and understanding how the genome functions within cells, how cells form tissues and dynamically remodel their activities when they progress towards disease, is among the greatest scientific and technological challenges of our era. The goal is no longer to find differences in “bulk” genomic readouts but rather to see explicit changes in a specific set of cells and to predict their behavior. In this light, multiple human cell atlas initiatives are working towards describing every cell of the human body, as a reference map to accelerate progress in biomedical science (25). These ambitious projects – similar in scale to the human genome project – aim to chart the different types and molecular properties of all human cells in health and disease, for which a multitude of organ-oriented working groups are mapping the single-cell composition and their spatial architectures. Technological advances in the field of single-cell ‘omics’ such as single cell genomics, epigenomics, transcriptomics, and proteomics, and even their combinations in a multi-omic setting (6, 7) are now rendering it possible to map physiological features of each individual cell in an organ as a functional unit. However, current methods still mostly require that cells are dissociated and removed from their original microenvironment, thus destroying valuable information about their location and interactions – information that is crucial to understand many disease patho-physiologies. The next, ongoing step is aimed at describing single-cell features in their natural microenvironment (8).

At the moment, understanding cellular functions at single-cell level within the context of a tissue is primarily done by expression profiling, using either transcriptional (9) or protein-based multiplex methods in pathological tissue sections (10), even though the realm of spatial omics keeps on growing fast (11, 12). While methods for enhanced spatial omics are only now starting to become available, pathologists have been evaluating cells in tissue sections using classical antibody- and morphology-based (i.e. H&E staining) methods for decades (13). Daily clinical practice is mostly performed using classical (chromogenic) immunohistochemical (IHC) methods that allow the simultaneous assessment of one or two proteins in a single tissue slide, which are mostly evaluated in a visual, semi-quantitative way by a pathologist (14). Novel technologies and methods, that will be discussed in this review, are now making it possible to perform quantitative spatial, antibody-based expression profiling of dozens of protein markers in a single tissue section. This will, when carefully selected, provide deeper insights in disease states while offering the ability to study cell-cell interactions, precisely define disease-related niches, all within the original context of the tissue (see below).

Such technology also comes along with multiple challenges as well. First, a careful selection of the right technology to answer the biological question is crucial: as we will discuss below, this is defined by the type and size of a tissue, the number of samples that need to be processed, and the number of markers that need to be interrogated. Second, besides the technical hurdles that need to be overcome to collect high quality, pathology-grade images in which each marker is carefully monitored, storing and processing the large volumes of image data also pose a significant logistic and infrastructural challenge. Finally, the plethora of information that is obtained from these analyses is also becoming of such magnitude and complexity that mere eyeballing of a tissue by a pathologist or researcher is no longer sufficient to properly extract information and interpret expression patterns. Similar to the fact that mutations in a genome need to be interpreted for biological and clinical relevance, pathological assessments also need the installation of suitable analysis algorithms and extended digital data repositories to bring diagnostics and tissue interpretation to the next level.

In this review, we provide a comprehensive overview of the available technologies for multiplexed immunohistochemistry, their advantages and challenges, and provide the basic principles on how to interpret high-dimensional data in a spatial context.

Methods for multiplexed immunohistochemistry

Lately, the armamentarium of technologies for antibody-based multiplexed IHC is rapidly growing. While several technologies have been described in literature performing manual IHC protocols, there is a clear trend of seemingly ‘plug-and-play’ instruments entering the market that automated the same principles to some extent. Importantly, however, since all these technologies depend on an antibody-based detection of proteins in a large variety of tissue types, the selection, validation and performance of the used antibodies have to be done with sufficient care. Adequate minimal validation guidelines need to be set, including the use of appropriate positive and negative controls (e.g. based on classical chromogenic stains (15)), to guarantee sensitivity, specificity and warrant the collection of biologically relevant data. Indeed, the performance of an antibody can vary enormously depending on the tissue type, the experimental conditions in which the antibody is applied, and whether formalin-fixed paraffin embedded (FFPE) or frozen materials are used (1618). As such, the development and optimization of suitable antibody panels for multiplexed IHC still requires a significant amount of time, although externally validated reagents to detect commonly used markers are becoming more routinely available, for instance thanks to large scale initiatives such as the Protein Atlas consortium (19) or NIH initiatives (20).

The first step, even before exploring different multiplex staining methods, is figuring out if and/or how spatial analysis can help in answering your biological question. Spatial analysis can provide additional information on proximity-based cell-cell interactions, such as the infiltration of immune cells in a tissue, their proximity to tumor cells (see below). Subsequently, once it has been decided that spatial analysis will be needed to answer a particular biological question, the selection of the method becomes key ( Figure 1 , Table 1 ). As indicated above, the selection of the most appropriate method is largely defined by several parameters. First, the type (i.e. frozen vs FFPE) and size (i.e. needle biopsy vs tissue microarray (TMA) vs whole tissue slide) of a tissue, in addition to the number of samples that need to be analyzed (from 1 sample at the time to cohorts of hundreds of patients), will already define the first selection. As we will describe below, not all methods are compatible with FFPE/Frozen or large tissue samples, or can be easily scaled up to analyse hundreds of slides in a practical timeframe and with minimal variance induced by batch-effects. A second important parameter is linked to the number of markers that needs to be interrogated, a feature that is commonly highly project specific (e.g. 5 vs 50 markers). Finally, understanding how the currently available methods for multiplexed IHC work will be crucial to select the most appropriate one. ( Figure 1 , Table 1 )

Figure 1.

Figure 1

Schematic overview of the currently available methods for multiplexed immunohistochemistry (IHC). (A) Currently, the most common approach for multiplexed IHC makes use of fluorescently labelled probes, which are either directly coupled to the primary antibody or indirectly provided by a secondary antibody, that are detected in a cyclic fashion consisting of a staining protocol, followed by tissue imaging and signal removal. (B) In contrast to cyclic methods, single-step spectral methods detect all dyes in the tissue simultaneously: these can either be provided by directly labelled antibodies that are all simultaneously present in the tissue section or by the cyclic generation of TSA precipitates which are subsequently spectrally unmixed in a single imaging step. (C) Antibodies can also be detected by covalently linked nucleotide labels to which fluorescently labelled probes are hybridized in a cyclic fashion for which each cycle gets imaged. (D) Non-fluorescent mIHC methods involve the cyclic generation of chromogenic substrates that are washed away following an imaging step in between each cycle. (E) For imaging mass cytometry (IMC), antibodies are labelled with metal isotopes which are detected by the local vaporization of the metal ions by a UV laser, following which the present isotopes are resolved using atomic spectrometry. (F) Finally, nucleotide labelled antibodies can be detected by removing the nucleotide labels from the antibodies using a laser beam, following which the nucleotides that were collected from a precise region of interest are sequenced to quantify the amount of available proteins in that region.

Table 1.

Technical overview of multiplex IHC staining methodologies.

Method Name Commercial Name Sample Max. n of Markers Flexibility to implement new markers¥ Primary Ab Ab tag Signal removal technique Tissue size Automation n of slides/experiment Time (for 40-plex staining of 1 large slide) Resolution Tissue preservation Current Scientific use+ Refs
MILAN NA FFPE 82 High Unconj. and Conj. FL sec ab Ab stripping WS/TMA Partially automated 30+ 2-3 weeks subcellular Yes Mature (2123)
CycIF NA FFPE 60 High Conj. FL bleaching WS/TMA Partially automated 30+ 2-3 weeks subcellular Yes Mature (24)
MICS MacSima™ FFPE/Frozen 400 Limited Conj. FL bleaching/ fluorochrome release WS/TMA Fully automated 2 <1 week subcellular No Limited (25)
seqIF™ COMET™/
Labsat™
FFPE 40 High Unconj. and
Conj.
FL sec ab Ab stripping TMA/up to 2.2x2.2cm section fully automated 1-4 1-2 days subcellular Yes Limited (26)
Chipcytometry CellScape™ / ZellScanner ONE™ Frozen (FFPE not recommended) 65 High Conj. FL bleaching TMA/2x1 cm section Service/Fully automated NA <1 week subcellular Yes Mature (27)
IMC™ Hyperion FFPE/Frozen/Liquid biopsies 37 Limited Conj. Metal None WS+ROI TMA/slow Service/automated detection 1 2 weeks subcellular, 1 µm/px No Mature (28)
MIBI™ IONpath/
MIBIscope™
Frozen 40+ Limited Conj. Metal None TMA/slow (ROIs 800 x 800 µm²) automated detection 1 2 weeks subcellular, 650 nm/px No Mature (29)
NA CODEX® Frozen/FFPE 40+ Limited Conj. NUC None WS/TMA automated detection 1 <1 week subcellular No Mature (3032)
DSP  NanoString’s GeoMx® Digital Spatial Profiler (DSP) FFPE 96 Limited Conj. NUC None ROI automated, sequencing still required 1 <1 day Subcellular/
grid
No Mature (33)
OPAL Akoya’s Opal™ Multiplex IHC +/- Vectra® Polaris™ spectral scanner FFPE 9 High Conj. HRP-TSA Heat based Ab stripping (ER) WS/TMA Partially automated 30+ <1 day (for 9-plex) subcellular No Mature (34)
MxIF Cell Dive (Leica) FFPE 61 High Conj. and unconj. FL Chemical inactivation WS/TMA Partially automated 30+ 2-3 weeks subcellular Yes Method published (35)
cmIF NA FFPE 60 High Conj. FL Chemical inactivation WS/TMA Partially automated 30+ 2-3 weeks subcellular Yes (36)
MELC NA Frozen 50+ High Conj. FL bleaching WS/TMA Partially automated 1 2-3 weeks subcellular Yes Mature (37)
IBEX NA Frozen/FFPE 65+ High Conj. FL Chemical inactivation WS/TMA Partially automated 30+ 1-2 weeks subcellular Yes Method published (38)
NA Orion RareCyte® platform Frozen/FFPE 21 High Conj. FL None WS/TMA Fully automated NR <1 day (for 6-plex) subcellular No Method published (39)
SABER ImmunoSABER FFPE/Frozen/Liquid biopsies 10 Limited Conj. NUC None WS/TMA Partially automated 1 <1 day (for 10-plex) subcellular No Method published (40)
Ultivue NA FFPE/Frozen 8 Limited Conj. NUC None WS/TMA partially automated 30+ <1 day (for 10-plex) subcellular Yes Mature (41)
SIMPLE NA FFPE 5+ High Unconj. HRP Chemical Ab stripping WS/TMA Partially automated 30+ <1 day (for 5-plex) subcellular Yes Method published (42)
MICSSS NA FFPE 10 High Unconj. HRP Chemical destaining + Ab blocking WS/TMA Partially automated 30+ <1 week (for 10-plex) subcellular Yes Method published (4344)

NA, Not applicable; WS, whole slide; TMA, tissue microarray; FL, fluorescent; FFPE, formalin fixed paraffin embedded; Conj., conjugated; Ab, antibody; ROI, region of interest.

Overall, technologies for multiplexed IHC can be classified by the way the antibodies are administered and detected. Indeed, depending on the technology, large mixtures of antibodies (+20) can be administered simultaneously to a slide, following which a dedicated instrument is able to image, resolve and unmix the location of each antibody in the tissue. Alternatively, various methods also use cyclic procedures through which smaller amounts of antibodies (24) are used for staining and imaging, following which the detected signal is removed. By repeating this cycle multiple times, large numbers of markers can be detected in the same tissue section. Finally, several hybrid methods are available that combine both approaches or even use other technologies (e.g. NGS analysis) to resolve the complex mixtures of markers. In the first part of the review, we provide an extended overview of several of the currently available technologies for multiplexed IHC analysis on tissue sections, including their compatibility with materials, antibodies, throughput, plex level, timing, and compatibility with standard or dedicated instrumentation. Methods are grouped by the type of modification that is used to detect the various antibodies.

Fluorescence-Based Detection of Antibody Mixtures

The largest group of methods for multiplexed IHC depends on the detection of mixtures of antibodies using fluorescent signals. Indeed, because fluorophores harbor specific excitation and emission spectra, they can be resolved using commonly used or more advanced microscopy tools, depending on how many fluorophores require resolving and their spectral overlap. In addition, most imaging instruments achieve a resolution below 0.6µm and are therefore perfectly compatible with single cell measurements [the average human nucleus is approximately 10 micrometers in diameter (45)]. A common issue with these methods is however the presence of autofluorescence in tissue: upon excitation with specific wavelengths, naturally occurring substances in tissue [for example extracellular matrix components, lipo-pigments, aromatic amino acids and flavins (46)] will emit light which overlaps with the fluorescence of the measured fluorophore, and needs to be considered and dealt with while processing images. Some chemical treatments (e.g. using bleach, sudan black or borohydrate) have been suggested to remove autofluorescence, but need to be used carefully and typically only solve the problem partially, while computational methods often offer better solutions, although in that case sufficient control images that capture autofluorescence need to be collected.

Cyclic Methods Using Fluorescent Antibody Detection

These methods make use of a cyclic procedure in which several steps ( Figure 1A ), including (i) the staining of small numbers of antibodies (2 to 4; typically defined by the microscope settings), (ii) the imaging of the sample and (iii) the removal of the stain, are repeated multiple times until all markers are detected. While cyclic methods are in general more time consuming, this approach allows to perform interim evaluations (allowing the researcher to validate every individual step and if needed repeat them), refine the composition of the panel during the procedure and adapt to unforeseen problems/results since cyclic methods conserve the tissue during analysis.

In these procedures, either directly labelled primary antibodies or labelled secondary antibodies are used to detect the markers. The former approach is used in the multi-epitope-ligand cartography (MELC) (37), multiplexed immunofluorescence (MxIF) (35), cyclic immunofluorescence (CyCIF) (24), Cyclic Multiplexed-Immunofluorescence (cmIF) (36), MACSima Imaging Cyclic staining (MICS) (25) and Iterative Bleaching Extends multi-pleXity (IBEX) (38) procedures. Indeed, MELC, MxIF, CmIF, IBEX and CyCIF make use of directly labelled antibodies which are usually combined in a triple/quadruple staining using 3/4 distinct fluorophores with non-overlapping spectra. Following staining and imaging, the fluorescent signal is removed using a photo-induced or chemical bleaching step before probing for the next markers (24, 3538). This is different for the MICS technology, which makes use of recombinant antibodies from which the fluorescent label can be removed using a proprietary enzymatic cleavage reaction (25). In either case, antibodies [or the Fab fragments which are left after cleavage (20)] remain in the tissue when the next round of markers are added to the tissue slide. The latter is different in the MILAN approach (2123), which makes use of fluorescently labelled secondary antibodies that bind to the specific primary antibodies. This has the advantage that signals can be amplified making it easier to detect weakly expressed markers, which might be an issue when using directly labeled antibodies without amplification. Another difference is that in the MILAN procedure, antibodies are entirely removed using an SDS/ßMercaptoethanol washing step to denature, inactivate, and remove the antibodies from the tissue (15), avoiding potential issues with antibody crowding or steric hindrance which could theoretically arise in methods that do not remove the antibodies (even though there is no formal evidence for such issues at the moment). The downside, however, is that the usage of secondary antibodies in MILAN forces users to make combinations of primary antibodies that were raised in different hosts or harbor different isotypes to avoid cross-reactivity during primary antibody detection (e.g. combinations of Mouse IgG1, Mouse IgG2, rat, goat and/or rabbit need to be made). On the other hand, directly labelled procedures depend on the direct labelling of antibodies, which requires careful selection of color combinations and carrier-free formulations of the primary antibody solutions (which may require custom made formulations), but, once available and validated, can be combined independent of the species where the antibody was raised.

In either of these methods, antibodies are commonly administered to the tissue in small batches (2 to 4) after which the tissue is imaged. Importantly, this setting allows the usage of regular microscopy and imaging tools using common fluorescent channels that are typically available in laboratories across the world. Moreover, automation of these procedures is gradually increasing, including the use of autostainers and automated slide scanners with regular fluorescent settings, and novel technologies using microfluidics (such as incorporated in the LABSAT and COMET system from Lunaphore, the CODEX system from Akoya (see below), or the MACSima instrument for MICS) are rendering it possible to further speed up the acquisition for small numbers of slides (26). The MICS method, on the other hand, has been optimized on a proprietary instrument, which allows unassisted, automatic processing of a small number of tissue sections (25). Similarly, chipcytometry (27) makes use of highly specialized equipment in which microchambers containing attached cells or (frozen) tissue can be mounted, and subsequently subjected to large multiplex analysis, which is primarily done in a cyclic way, one antibody at the time.

Finally, these methods are primarily compatible with FFPE tissue sections, while the MELC and MICS method have also been described to be compatible with frozen materials (15, 25, 47, 48). Overall, using these technologies, large numbers of markers can be analyzed (50+ have been reported (see Table 1 ), and the number of analytes keeps on rising constantly. Here, we added a new example of a melanoma tissue sample that was stained for 82 markers using the MILAN method (23) over the course of 50 rounds ( Supplement Figure 1 ), while the MACSima technology was used to stain 327 markers in tonsil tissue over 160+ rounds (25). Overall, the primary limitation of the number of markers mainly comes from the compatibility of the tissue with the antibody removal procedure: methods involving chemical bleaching steps (such as in CyCIF and MxIF) eventually lead to tissue destruction, loss of antigenicity and/or tissue loss, and are therefore limited in the number of cycles that can be performed (47, 49). Also, cover slips that have to be added/removed repeatedly between the staining/imaging cycles, may cause tissue damage. Finally, the tissue type and how it was preserved prior to the start of the mIHC largely determines the plex level that can be achieved and needs to be defined experimentally.

Next to tissue damage, also the scalability of methods needs attention: while some methods (e.g. MELC, CyCIF and MILAN) allow the simultaneous processing of multiple slides, others (e.g. MICS, COMET) are limited to 2-4 slides at the time, although robotic systems that allow automated slide loading are in development. Also, the area that can be imaged/scanned can differ greatly among systems (from a few mm (2) to whole slide). Scaling can be further enhanced by compiling tissue microarrays (TMA), in which carefully selected tissue subsamples (also referred to as ‘cores’) from large tissue blocks are assembled on a single slide (typically 60 cores of 2mm diameter can be put on the same slide). Considering there is more heterogeneity observed across the dimensions of a single section than between different sections in tumors (50), one should deliberately design the TMA to capture this potential heterogeneity, by taking a smaller number of cores from small and homogeneous samples and a larger number in big and heterogeneous specimens. The role of the pathologist in selecting the different regions of interest and design of the TMA remains key. In this manner, it has been shown that different tumor biomarkers are accurately reported through the assessment of TMAs (5153). As such, cohorts of 50-150 patients can be analyzed within the timeframe of a couple of weeks. This workflow is highly compatible within the research context, for instance in performing retrospective analyses simultaneously on big patient groups avoiding batch effects. However, within the daily clinical routine, implementation of TMAs in the workflow is less obvious, even though there may be a role for them when scan areas of more automated (faster) mIHC systems are too small to cover the entire tissue section as a whole and the analysis of multiple regions of interest is still needed.

Batch Methods Using Fluorescent Antibody Detection

In addition to cyclic procedures, novel methods are appearing that allow more extended, single-step multiplexing ( Figure 1B ). This is currently achieved by labelling antibodies with specific fluorophores which can subsequently be resolved using spectral unmixing methods, such as used in the RareCyte Orion system (39). The advantage of this approach is that a maximum of currently 21 antibodies are applied simultaneously in a single staining procedure, as such offering a fast staining of the sample. However, the generation of antibody panels containing 20+ different fluorescent dyes can be challenging, and requires dedicated instrumentation for spectral unmixing. Moreover, a significant amount of time (i.e. multiple hours) is required to collect high-resolution images from a small number of whole slides for each included channel. Finally, the simultaneous addition of all markers limits the flexibility to modify the panel after it has been validated, and the generation of the labelled antibodies remains cumbersome and requires a careful selection and validation of the multicolor panel. On the other hand, for routine purposes where the same panel has to be applied repeatedly, this method may offer excellent options, although this has not been investigated yet. Another recent approach enabling higher level multiplexing involves the UltraPlex, hapten-based technology, which adds labels to primary antibodies, which are subsequently detected by anti-hapten antibodies coupled to various fluorophores. While so far only lower plex panels (4-8-plex) were tested, it bears the potential to scale to routine assays of 12 or more markers (54).

Hybrid Approaches Using Fluorescent Marker Detection

In addition to cyclic and batch procedures, other methods use a hybrid approach to achieve extended multiplexing ( Figure 1C ). This is currently achieved by labelling antibodies with unique nucleotide barcodes which are subsequently detected using either direct hybridization of fluorescently labelled complementary nucleotide probes (as in the CODEX system (3032)), or by using an in-situ amplification system (as used in the immunoSABER system (40) or the InSituPlex system (Ultivue) (41)). The hybrid nature of these approaches comes from the batch application of all antibodies simultaneously in a first step, while their subsequent detection using the detector probes is subsequently done in a cyclic fashion where hybridization/denaturation steps are alternated with imaging, with the latter needing to be repeated for each cycle (as such leading to a time scale comparable to the cyclic methods). An alternative approach was recently described in the SeqStain procedure (55), where antibodies labelled with fluorescently-labelled DNA (either primary or secondary) are used to detect protein markers, following which the DNA is removed by an enzymatic reaction using a nuclease. By repeating these cycles, multiple markers could be visualized.

These approaches require that antibodies are labelled with nucleotide probes, which reduces flexibility and speed to design novel panels. Moreover, the nucleotide sequence composition of the probes still requires significant optimization to avoid nonspecific binding. On the other hand, unlimited numbers of antibodies could theoretically be labelled with unique barcodes, and as such be combined in large quantities. It remains to be seen, however, how feasible such extended approach will be, whether and when steric hindrance/overcrowding will become an issue, and how destructive multiple rounds of hybridization/denaturation will be for the tissue structure, a step that will probably define the plex level. The cyclic application of the probes also requires specific instrumentation containing microfluidic devices and temperature control or repeated manual work, currently complicating the scalability of this approach to large batches of slides. Finally, while the CODEX was initially optimized for frozen materials, both methods are now compatible with either FFPE or frozen tissue sections (32, 40).

Detection Using Fluorescent Precipitates

Finally, while all the above-mentioned technologies allow the measurements of large numbers of protein markers, in many cases, researchers don’t need such complicated systems. Alternatively, a limited number of markers can be detected by using fluorescent precipitates ( Figure 1D ), for example by using tyramide signal amplifications (TSA) reagents, an enzyme-mediated detection method (34). The detection of antibodies in this system is based on a cyclic procedure, where each primary antibody is stained separately, probed with a Horse Radish peroxidase (HRP) secondary antibody, and then a specific fluorescent precipitate of the TSA reagent is generated. At the end of each cycle, the primary and secondary antibodies are removed while leaving the fluorescent precipitate before probing with the next antibody. Because all precipitates harbor a different fluorescent spectrum, imaging is only done once at the end, after which antibodies are spectrally unmixed. This concept is used in for example the OPAL system (34), allowing to perform 6-plex staining of FFPE tissue in an automated fashion using commonly available autostainers (typically present in pathology labs) and a dedicated spectral scanner. This technology is compatible with FFPE materials, and tens of slides can be stained simultaneously depending on the autostainer instruments used. In addition, it has to be said that some fluorescence-based detection systems are using directly linked primary antibodies. Therefore, it could be suggested that sensitivity is lower compared to the generally used chromogenic staining, which is often used with an amplification (frequently a polymer with several HRP enzymes) of the signal (56). Currently, there is a lack of good comparative studies which investigate this question. Some studies even suggest a comparable sensitivity (57, 58). A proper evaluation of the advantages and disadvantages of each technology regarding specific research/clinical question should be done.

2. Chromogenic Detection of Antibody Mixtures

Next to fluorescent detection methods, the use of more classical chromogens has been employed to develop methods for multiplexed IHC ( Figure 1E ). The Sequential immunoperoxidase labeling and erasing (SIMPLE (42)) or the multiplexed immunohistochemical consecutive staining on single slide (MICSSS (43, 44)), are methods that use the alcohol-soluble peroxidase substrate 3-amino-9-ethylcarbazole, a reagent that in the presence of the commonly used HRP and H2O2, generates a chromogenic, red precipitate that can be imaged using regular white light, brightfield microscopy. Once the image is collected, the red precipitate is washed out using ethanol following which the antibody is eluted using acidified permanganate. As such, 5 to 10-plex stains have been described (42, 43). While this method is largely compatible with standard equipment and procedures in pathology laboratories, it remains to be seen whether the tissue can withstand increased rounds of the low pH antibody washout buffer. Another recent approach using chromogenic multiplexing involves the UltraPlex, hapten-based technology, allowing to generate low-plex analyses (54). So far mainly FFPE tissues were processed, while frozen samples were not analyzed yet. Finally, while easy to assess whether markers are highly expressed or completely absent, the quantification of chromogens is far less quantitative than fluorescent dyes.

3. Mass-Cytometry Based Detection of Antibody Mixtures

As an alternative for chromophore/fluorescence-based imaging, imaging mass cytometry (IMC) makes use of metal-labelled antibodies, which are resolved using mass-spectrometry, an approach that is currently used in the Hyperion (28) or the multiplexed ion beam imaging (MIBI/IONPath) (29) systems ( Figure 1F ). At the moment, 42 purified metal isotopes, mostly from the lanthanide series, are commercially available for labelling purposes, although the theoretical amount could be 135 based on the possible isotopes, a number that is mostly limited by the excavation of these metal isotopes in sufficient amounts and purity. The analysis of tissues using IMC involves the staining of the tissue with the mixture of all pre-titrated antibodies together, following which laser-assisted ionization allows the analysis of the generated cloud containing the metal ions in a connected mass cytometer. The batch application of antibodies also makes it compatible with both frozen and FFPE materials. The resolution is currently 0.3-1µm, dependent on the system and settings, but imaging is rather slow at a rate of 2h/mm (2), which puts some constraints on the analysis of whole tissue slides or large cohorts of patients. Finally, similar to several other methods, labelling of antibodies is required, although commercial kits are available that are sufficiently easy to use (59).

4. Sequencing-Based Detection of Antibody Mixtures

A final approach to perform high-dimensional multiplexed IHC involves the combination of nucleotide-labelled antibodies and next-generation sequencing (NGS) ( Figure 1G ). Indeed, the Digital Spatial Profiling platform (DSP) makes use of photo-cleavable probes to label primary antibodies (33). By staining tissues with these antibodies, precise illumination of specific regions of interest in the tissue using a dedicated platform allows the isolation of the cleaved nucleotides which are subsequently quantified using NGS. As such, multiplexing of up to 40 proteins (or 5,000 mRNA probes) has been described (33), but this technology allows up to 800- of 80-plex profiling of either mRNA or protein, respectively, using an optical barcode readout and has the potential for even greater multiplexing using an NGS readout. This method is also compatible with both FFPE and frozen materials. However a minimum of (non-adjacent) cells (10-20 cells for protein, 50-200 cells for RNA (60)) is required to obtain sufficient probes to achieve high quality NGS data. As such, this technology does not yet achieve true single cell analysis, although specific cell populations could be profiled in depth. The selection of the cells to study, a critical step in this technology, can still be done by performing a lowplex IHC staining prior to probe isolation, but the isolation of specific, more complex, rare phenotypes could be hampered by this low-plex staining procedure.

Data analysis tools for pathological interpretation

As described above, a multitude of technologies are currently available to measure dozens of protein markers using multiplexed IHC at single-cell level in a tissue slide. Most technologies make use of automated slide scanners, which are able to image a wide range of tissue areas, from pre-selected (small) regions of interest (ROIs) to entire slides/tissue samples. Such output is subsequently subject to a detailed analysis process. Indeed, while the ‘wet lab’ procedures may still be adopted relatively quickly and easily by laboratories, the subsequent image analysis and interpretation of the resulting high-dimensional data still faces enormous challenges. In the second part, we therefore describe a general workflow of methods to perform data-analysis and extract the most relevant information ( Figure 2 ). Also, while methods for imaging-based cellular analysis are well described (61) (e.g. as used in high content screening approaches of in vitro cultured cells), analysing images from tissue samples typically comes along with various additional challenges. Overall, analysing images from multiplexed IHC consists of 2 major steps, including (i) image-analysis and (ii) high-dimensional, spatially resolved data analysis. Image analysis refers to the extraction of quantitative and meaningful information from the image by means of digital processing techniques and can be further divided in two fractions: low-level and high-level processing. In low-level image processing, a digital image is used as input and another digital image is obtained as output (e.g., a corrected image for improved visualization/analysis), while high-level processing involves functions whose outcome is a description of the content of the input image such as cell edges or tissue regions. The reader should note that upstream steps such as image-acquisition fall outside the scope of this review and are not covered here.

Figure 2.

Figure 2

Schematic overview of the required steps for downstream image analysis using the most commonly used fluorescent, cyclic methods for multiplexed IHC. Images are collected across multiple cycles but still need to be cleaned (QC), corrected (PP), registered/aligned (REG), autofluorescence removed (AF), segmented (SEG), feature extracted (FE), phenotypically annotated (PI), and spatially resolved (SA).

Low-Level Image Analysis

During low-level image analysis, all collected images are prepared for data extraction. While the procedures can be different between the various technology platforms, it generally shares a common strategy. Considering that the majority of technologies make use of fluorescent detection, we will primarily focus on these procedures.

When dealing with immunofluorescent images of tissue sections, these are often affected by aberrations which are critical to the quality of the results (62). Examples of these aberrations include out-of-focus regions (blurriness), vignetting effects, saturation debris, and artifacts due to e.g. air bubbles and tissue folds. Various methods have been described to tackle some of these aberrations. Examples include ConvFocus (63) from Google AI or FQPath (64) for blurriness detection (focus), CIDRE (65) that uses an energy minimization model and a flat-field correction method developed by Kask and colleagues which uses an additive and a multiplicative component to correct for field-of-view artifacts (vignetting) (66), a protocol implemented in CellProfiler (67) which uses supervised machine learning for automatic quality control of image-based measurements, and HistoQC (62) which implements an automated, quantifiable, quality control process for identifying artifacts and measuring slide quality.

On top of undesired impurities, IF images are also subject to other sources of fluorescent signals such as background and tissue autofluorescence that need to be tackled before quantifying true signals. Examples of methods addressing this issue include dark pixel intensity identification (68) which estimates background signals by acquiring images at a different set of exposure times, and an autofluorescence removal method that uses non-negative matrix factorization that separates the signal into true signal and autofluorescence components (69). Moreover, high-throughput experiments can be subject to batch effects, that is, part of the acquired signal is described by undesired technical variation (for example, sample manipulation) rather than biological sources (61). An example of a method to tackle this issue is RESTORE (70) which identifies negative control cells for each marker and uses their expression levels to normalize and remove sample-to-sample variation. Local/grid-based normalization tools (71) have also been developed, although their general implementation still requires a broader implementation.

In cyclic methods where images are acquired in consecutive rounds, the next step consists of the exact super-positioning of images acquired from consecutive imaging rounds (commonly referred to as ‘image registration (54)). Registration of medical images is a need that has been around for a while and thus a large number of methods are available. These methods can be broadly classified as rigid (image transformation is limited to translation, rotation, and scaling) (72, 73) and plastic (the moving image can be elastically deformed to best match the fixed image) (74). Historically, image registration was meeting a macroscopic need (for example, overlapping of MRI and Xray images). For multiplexing however, microscopic precision is required as a shift of a few pixels can overlap completely different cells. Therefore, recently, new registration methods have been published in the literature which aim to reach the required precision for exact-cell overlapping (7578). While usually not required in “batch” methods (see above), this seemingly trivial step can be extremely computationally ‘expensive’ for large images (>100 million pixels) when applying plastic methods. Therefore, the latest algorithms come with GPU implementation. Also, depending on how images are acquired in the imager (e.g. some imagers scan all fluorescent channels at each step, while others scan the entire sample for each channel separately), additional registration of the acquired fluorescent channels may be required.

Image pre-processing requires a very systematic approach and should be robust and identical across all samples/images of the same project to avoid the loss of biological information and a potentially biased interpretation of the results. While computational tools exist tackling the individual issues, their implementation for non-expert users is challenging and requires some level of computational knowledge. Moreover, linking the inputs and outputs of consecutive steps is far from trivial and integrated workflows are still missing. All of this together makes that to date, image pre-processing is mainly done by manual/visual inspection in the routine setting, thus largely limiting the throughput of these techniques.

High-Level Image Analysis

During high-level image analysis, the output of the different functions is a description of the content of the input image(s) such as cell edges, cell features or tissue regions. Once a set of images is properly aligned and ‘cleaned’, cells need to be precisely delineated (commonly described as ‘cell segmentation’). The quality of this step is very important for proper cell identification (see below). In tissue sections, this step is commonly done using nuclear segmentation. Historically nuclear segmentation has been tackled mechanistically (watershed algorithm and variations (79, 80). However, the introduction of deep learning algorithms (specifically convolutional neural networks (CNNs) like uNets) have outperformed all the mechanistic algorithms and now represent the state-of-the-art (81, 82). The main drawback of deep-learning based algorithms is the need for large training datasets. However, current efforts are ongoing to implement machine learning approaches (83), which are gradually becoming more efficient at recognizing and splitting cells requiring minimal hands-on image training (84, 85). While a few algorithms have explored the possibility of segmenting full cells (including cytoplasm and membrane) (86, 87) cell nuclei are far less heterogeneous making nuclear segmentation more robust. Regarding the clinical implementation of cell segmentation approaches, deep-learning based methods will require to fine-tune existing algorithms to optimize the accuracy of the predictions and adjust it to the specific acquisition instrument and sample material. To the best of our knowledge, such an ambitious comparison in immunofluorescent images and in a multi-center setting with a variety of acquisition instruments is not available in the literature. However, a similar study has been carried out for Ki-67 expression, a prognostic marker in breast cancer, which has shown excellent accuracy and reproducibility in different analysis platforms performed by multiple operators (88). Accuracy and reproducibility are well known issues in state-of-the-art histopathology where the sample readouts are extracted by the subjective eye-rolling of an expert pathologist which causes intra- and inter-observer variability (89, 90). In fact, the main limitation for the automation (human or computational) of pathological evaluations is the lack of standardization (91). However, we believe that with the right standardized roadmaps to histopathological analysis integrated computational pipelines will become state-of-the-art and that the future of pathology is mainly digital (92).

Finally, the acquired signals, such as fluorescence intensity, amount of metal isotopes, read-counts, etc., are quantified in every cell together with morphological features of the nucleus (nuclear size, shape, etc.) and topological features (X/Y coordinates) in a step called ‘feature extraction’, and collected in a structured data matrix.

Overall image pre-processing is highly dependent on the technology that was used to acquire the images – each of them will still require significant tweaks and adaptations to translate the procedures of one technology to another. While most vendors of the above described instruments provide accompanying software, these commonly don’t extend beyond mere viewing of images, a step that is crucial for quality assessments of the stains, but don’t allow quantitative and extended analysis. More dedicated (commercial) image analysis platforms are also gradually becoming available (e.g. Halo (Indica labs) or Visiopharm software packages for digital pathology, and the open source tools such as QuPath (93), CellProfiler (94), or HistoCat (95), are continuously updated, but considering the enormous amounts of biological questions that still require downstream analysis of the spatially resolved cell types, such packages typically remain constricted to initial groundwork, or highly dedicated to one particular type of analysis. Some more integrative pipelines are also gradually being released, such as MCMIRCO (96) or SIMPLI (97), although these still require a high level of bioinformatics skills.

High-Dimensional, Spatially Resolved Data Analysis

Next, the obtained data matrix containing the high-dimensional data still requires further analysis and interpretation. A first step in this process involves the identification of the various cellular (pheno)types (i.e. epithelial cells, particular T cell subtypes, tumor cells, blood vessels, etc), a step that is usually done using clustering analysis and manual interpretation according to methods that resemble many other single cell methodologies. More automated algorithms that can be trained to assign labels to each cell (e.g. using convolutional neural networks (43)), and pretrained templates (98) do exist, but still require significant training, as cellular phenotypes can vary extensively between organs and/or disease conditions. In addition, this step is commonly further complicated by imperfect cell segmentation, as markers of adjacent cells can “pollute” neighboring cells, making interpretation difficult. This can require an interactive iteration of the settings for cell segmentation, next to a step-wise approach in clustering, where in a first step the major cell types are defined, after which the different subtypes of these cells can be defined. The latter is mainly used to avoid that large populations outcompete small/rare populations.

Regarding clustering, there are several methods publicly available without any single method proving to perform better than the others. While many studies have used one or another clustering algorithm (49, 99101), our group implemented a consensus clustering procedure (31, 35) following a “Wisdom of the crowds” type of approach, where three independent algorithms (to choose between Phenograph, K-means, FlowSom, ClusterX, Clara, Hierarchical clustering, among various others) were used to cluster the identified cells. Each of the identified clusters is then annotated manually by an expert pathologist/immunologist, and only cells that remain in the same annotated cell type across minimal 2 methods are retained for further analysis. Since multiplexing datasets can identify millions of cells, clustering is done in a subset of these cells. There are different sampling strategies available, including random sampling, stratified random sampling, stratified proportional random sampling, etc. The annotated subset is then projected on the entire dataset using cell-type-specific fingerprints. The above-described methodology, however, still requires significant manual work from expert pathologists/immunologists, a step that could still largely benefit from properly curated databases, which will allow for machine learning tools to automatically recognize and annotate cell types.

Once this information has been gathered, data is subsequently projected against the spatial context of the tissue. Indeed, each cell is composed of a precise subset of pixels with specific coordinates that span a specific surface in the image. This information therefore allows the analysis the spatial distribution of the cells that can be used to model cell-cell interactions (32) (typically referred to as ‘neighborhood analysis’) and any other spatial measurement (e.g. distance measurements to structures of interest, nearest-neighbor analysis, etc), but also the definition of larger cell communities and tissue architectures (102). For any of these analysis subtypes, in spite of the presence of several methods implemented in papers published in literature (102106), there are currently very few software packages available, mostly requiring specific and specialized bioinformatics skills. However, from a biological point of view, this step is the most crucial as it will allow researchers to explore complex biological systems in a quantitative way, so sufficient efforts will still be required in the coming years to develop standardized methods. Moreover, the high complexity of these analyses, together with the relatively small scanned areas or amount of slides/patients (which cannot capture the full heterogeneity of a tissue or disease group), typically results in large patient-to-patient variation, which will require that significantly large cohorts are interrogated to come to statistically robust conclusions. Whether sufficiently large cohorts can be analyzed will in great part be defined by the used platform (see above). Also, diagnostic tools using mIHC/IF have shown their benefits for the treatment of the patient. Standardized methods to perform image analysis will have to be developed and properly validated before their clinical implementation can even be considered.

Finally, each described method will eventually generate terabytes of images containing expression profiles of each included marker. The size of such data sets poses an additional challenge to store, label, transfer, computationally process and interpret the data in a reasonable amount of time. Current methods for big data processing, however, should be easy to adopt, but are only now becoming available in most institutes. In line with this, over the coming years, this “next-generation” pathology field will also need extended digital data repositories and standardized analysis methods to bring diagnostics and tissue interpretation to the next level. Implementing the required safety measures in line with the current General Data Protection Regulation (GDPR) regulations will also be of primary importance (107).

Making the difference with spatial IHC profiling

In the last part of this review, we provide an overview on how multiplexed IHC has been used and implemented in research over the past years. Considering the growing number of papers (all to which we can unfortunately not refer), we chose to focus on the most important concepts and provide examples of how researchers have used (some) of the above described methods together with dedicated bioinformatics analysis pipelines to gain additional insights in complex biological processes.

The General use of Multiplexed IHC Across Research

First, to get a top-level view on how multiplexed IHC has been used over the past years, we have performed an in-depth literature search, for which keywords and co-occurring terms were extracted from ~1000 papers from PUBMED using a query related to “multiplexed immunohistochemistry” (see Methods), and generated scientific networks. Based on the most occurring terms in the titles and abstracts of these papers, we can draw two main conclusions ( Figure 3 ):

Figure 3.

Figure 3

The bibliometric map of multiplexed IHC over the years. Using VOS Viewer, a software tool for constructing and visualizing the bibliometric network related to “multiplexed immunohistochemistry” on PUBMED (see Methods), we observed a shift from 2010 where technology development started (blue circles), to its use to unravel complex cellular networks in 2020 (yellow areas) with a strong focus on immuno-oncology and T-cell biology.

First, considering the topics of research, we identified 3 main topics: (i) technology/methodology development for multiplexed IHC using antibodies in tissue sections with the majority of methods focused on the usage of immunofluorescence; (ii) a strong focus on cancer research, with the aim to better predict prognosis, outcome and survival of patients based on the analysis of tissue sections; (iii) the vast majority of research papers used multiplexed IHC for the analysis of immune infiltrates, with a primary focus on T cell biology, checkpoint inhibition, macrophages and B cells. In addition, a more detailed density map also shows several prominent biological markers (e.g. CD3, CD4, CD8, CD68, CD163, CD20, PD1/PDL1, CTLA4, etc) that are generally used for T cell profiling, checkpoint analysis, and the investigation of macrophages and B-cells.

Second, when overlaying the generated network with the dates of when the papers containing the indicated terms were published, we identify a trend where research was initially focused on technology development (before 2016), while gradually moving to its implementation in the research community to study immune infiltrates related to cancer development and its treatment using immunotherapy (2016-2020).

Using multiplexed IHC to answer complex biological questions

Considering the rise in available technologies for multiplexed IHC over the past few years and their gradual implementation, only the tip of the iceberg has been uncovered. Indeed, next to the revolution in single cell profiling, for which single-cell RNA (scRNA) sequencing is still the primary method for cellular phenotype exploration (108), the implementation of spatial technologies is becoming increasingly important to precisely locate the identified cell types and phenotypes in the context of a tissue and across a patient cohort. In this way, accurate atlases of healthy and disease-specific microenvironments can be compiled, both for human and mouse tissues (109, 110). For instance, the myeloid compartment of glioblastoma brain tumors was recently described using the combination of scRNAseq, CITEseq and multiplexed IHC through which the various ontologies of the infiltrating macrophages and resident microglial cells could be identified, while their distributions were spatially separated over various niches, which, moreover, evolved from the newly diagnosed to the recurrent setting (111). The distribution of the various cells across a tissue section was determined by computationally breaking up the tissue in smaller “tiles” in which the relative distributions of the identified cell types were determined. The same approach is directly applicable to define tumoral, peritumoral, perivascular and non-tumoral areas (112), and, while these insights are key to define the macrostructure of a tissue, such analysis still remains on the level of one cell type at the time. Once macro-level areas are defined, it becomes key to understand local cellular distributions, an analysis type that is done by performing neighborhood or nearest neighbor analyses. In this analysis, the local neighborhood from each individual cell is defined by assessing which other cell types are present within a certain radius or distance. We and others have used this approach to define local cell-cell interactions between all identified immune cell populations in melanoma samples (23, 96). As such, it was found that exhausted cytotoxic CD8+ T cells were typically residing in close vicinity to TIM3- or PDL1-positive macrophages (23, 113, 114). Similarly, it was found that the CD8+/TCF7+ double positive T cells that were residing in the tumor could be reactivated and showed a positive correlation to responsiveness to checkpoint blockers in melanoma (115).

Such inference could only be achieved by performing multiplex analysis in tissue sections, allowing researchers to simultaneously define the phenotypic and functional status of each identified cell type but also define the spatial distribution of each cell and how they relate to each other. A similar cellular sociology was identified in breast tumors using IMC through which communities and local niches could be determined which typically consisted of a dominant tumor clone in combination with a variety of immune cells (102). Cellular neighborhoods could also be identified in colorectal tumors (116). Moreover, by measuring such neighborhoods, the presence of particular CD4+ T cells in cellular neighborhoods that were also enriched for granulocytes was identified as a positive markers for survival in CRC, while the presence of macrophages in breast tumor communities rather correlated with poor prognosis (102, 116). Also in lung, ovarian, liver, kidney and various other cancer types, the presence of specific immune cell infiltrates were shown to correlate with good or poor outcomes (117119) or with response to immunotherapy (120). The number of research papers using this type of analysis keeps on rising steeply (and we apologize to all the authors of papers we have not mentioned here), even though the scale at which such projects can be performed should become even larger to achieve the next clinical revolution.

Multiplexed IHC vs. spatial transcriptomics: a complementary duo

In this review, we have mainly focused on methods for multiplexed IHC. The main advantage of these methods resides in their prompt translatability to the clinical setting: indeed, pathology labs have been performing antibody-based assessments for decades and adding mIHC should be more easily adoptable in such setting, even though a transition towards digital pathology will be required. Recently, methods for spatial transcriptomics are being developed at rapid pace: the main advantage of the latter methods (for which a plethora of technical approaches is currently available (121)) is their more universal character, whereby complementary detection probes can be developed in a more generic and species independent way, while mIHC largely depends on the availability of specific, high quality antibodies, which are not always available and often not cross-reactive over species (e.g. mouse vs human). While such approach enables researchers to uncover unknown pathways and patterns, RNA-based methods also harbor some pitfalls as well. Indeed, for the majority of (archival) samples, the currently available standard quality of materials (as they are mostly available as FFPE materials in biobanks across the world, and less often in the form of fresh frozen tissue blocks) is typically directly amenable for antibody-based approaches leading to robust insights. The quality of samples for RNA based analyses will, on the other hand, require very close monitoring of sample/RNA quality, as the stability and longevity of RNA molecules is much less compared to proteins. The translational character of RNA-based methods will therefore still require proper benchmarking to ensure robust pathology grade readouts. The coming months and years will have to show how this exciting field keeps on evolving.

Finally, both protein and RNA-based methods are gaining more and more traction to unravel complex cellular networks and architectures. However, the main setting currently still relies on the “discrete” utilization of one method at the time. Indeed, while each method can already provide highly valuable insights at single-cell resolution, each approach also harbors various downsides as well. For instance, while transcriptome analysis is excellent at unravelling transcription factor networks or identify the source of cytokine expression in complex tissues (122), signal-transduction events, protein-protein interactions or particular immune cell states can be measured more reliably at the protein level (123). As such, combining multiple methodologies in an orchestrated fashion can produce highly synergistic insights that cannot be achieved by either method alone. This evolution towards multi-omics approaches is a very active domain, where various challenges will have to be overcome as well. Not only will methods have to be adapted in such way that capturing RNA and protein based features will remain possible, also data integration will require further evolution, even though steps are being put in that direction (121, 122).

Conclusion

A large variety of technologies for multiplexed immunohistochemistry has been developed over the past years, each with their own advantages and downsides, and it is expected that these will keep on improving over the coming years. Moreover, combinations with other spatial omics, such spatial transcriptomics, genomics, chromatin accessibility, lipidomics or metabolomics, are underway which bring yet another level of technological and computational challenges. Regardless of the approach, each technology has the goal to interrogate increasing numbers of analytes in pathological tissue samples at single-cell and spatial resolution. This revolution allows us now to investigate complex patho-biological processes at unseen resolution- insights that bear the potential of becoming the next generation of higher order biomarkers. This can, however, only be achieved if appropriate computational tools and infrastructure – the hallmark of a true shift towards digital pathology – are implemented that can deal with this approach and complexity. Moreover, considering the number of parameters that will be measured, it will be paramount to investigate sufficiently large populations of patients so that we can evolve from anecdotical case reports to more fundamental, robust and clinically useful insights. The latter will require the combination of highly standardized methodological processes and concurrent validated analysis pipelines. Finally, such next-generation pathology will also require standardized digital data repositories to set appropriate standards and benchmarks to bring the field to the next level.

Methods

Digital Literature Analysis

The VOSViewer tool and algorithms (Visualizing scientific landscapes; https://www.vosviewer.com (124);) were used to analyse extracted publication data from a PubMed search using the following search criteria:

(multiplex immunohistochemistry[Title/Abstract]) OR

(multiplexed immunohistochemistry[Title/Abstract]) OR

(multiplexed immunofluorescence[Title/Abstract]) OR

(multiplexed immunophenotyping[Title/Abstract]) OR

(multiplex immunofluorescence[Title/Abstract]) OR

(multiplex immunophenotyping[Title/Abstract])

Multiplexed Analysis using MILAN

A 3µm thick tissue section of a melanoma tissue microarray was subjected to multiplexed immunohistochemistry according to the MILAN protocol as previously described (21). Overall 83 antibodies were succesfully used as have been described here (23, 125).

Author Contributions

FS and FB conceptualized the manuscript. All authors contributed to the writing of the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by KULeuven funding (C3/19/053, C1/17/084), the Opening the Future foundation, the Kom op tegen Kanker (Stand up to Cancer) foundation, FWO infrastructure grant (I005920N) and an FWO Fundamenteel Klinisch Mandaat (EMH-D8972-FKM/20) to FB.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2022.918900/full#supplementary-material

Supplementary Figure 1

GIF representation covering an 82-plex of a melanoma tissue sample stained with 52 consecutive rounds of MILAN staining.

References

  • 1. Lander ES, Linton LM, Birren B, Nusbaum C, Zody MC, Baldwin J, et al. Initial Sequencing and Analysis of the Human Genome. Nature (2001) 409:860–921. doi: 10.1038/35057062 [DOI] [PubMed] [Google Scholar]
  • 2. Regev A, Teichmann SA, Lander ES, Amit I, Benoist C, Birney E, et al. The Human Cell Atlas. Elife (2017) 6:e27041. doi: 10.7554/eLife.27041 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Rajewsky N, Almouzni G, Gorski SA, Aerts S, Amit I, Bertero MG, et al. LifeTime and Improving European Healthcare Through Cell-Based Interceptive Medicine. Nature (2020) 587:377–86. doi: 10.1038/s41586-020-2715-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Rozenblatt-Rosen O, Regev A, Oberdoerffer P, Nawy T, Hupalowska A, Rood JE, et al. The Human Tumor Atlas Network: Charting Tumor Transitions Across Space and Time at Single-Cell Resolution. Cell (2020) 181:236–49. doi: 10.1016/j.cell.2020.03.053 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. HuBMAP Consortium . The Human Body at Cellular Resolution: The NIH Human Biomolecular Atlas Program. Nature (2019) 574:187–92. doi: 10.1038/s41586-019-1629-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Lee J, Hyeon DY, Hwang D. Single-Cell Multiomics: Technologies and Data Analysis Methods. Exp Mol Med (2020) 52:1428–42. doi: 10.1038/s12276-020-0420-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Stuart T, Satija R. Integrative Single-Cell Analysis. Nat Rev Genet (2019) 20:257–72. doi: 10.1038/s41576-019-0093-7 [DOI] [PubMed] [Google Scholar]
  • 8. Allam M, Cai S, Coskun AF. Multiplex Bioimaging of Single-Cell Spatial Profiles for Precision Cancer Diagnostics and Therapeutics. NPJ Precis Oncol (2020) 4:1–14. doi: 10.1038/s41698-020-0114-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Liao J, Lu X, Shao X, Zhu L, Fan X. Uncovering an Organ’s Molecular Architecture at Single-Cell Resolution by Spatially Resolved Transcriptomics. Trends Biotechnol (2021) 39:43–58. doi: 10.1016/j.tibtech.2020.05.006 [DOI] [PubMed] [Google Scholar]
  • 10. Blom S, Paavolainen L, Bychkov D, Turkki R, Mäki-Teeri P, Hemmes A, et al. Systems Pathology by Multiplexed Immunohistochemistry and Whole- Slide Digital Image Analysis. Sci Rep (2017) 7(1):15580. doi: 10.1038/s41598-017-15798-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Thornton CA, Mulqueen RM, Torkenczy KA, Nishida A, Lowenstein EG, Fields AJ, et al. Spatially Mapped Single-Cell Chromatin Accessibility. Nat Commun 2021 121 (2021) 12:1–16. doi: 10.1038/s41467-021-21515-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Zhao T, Chiang ZD, Morriss JW, LaFave LM, Murray EM, Del Priore I, et al. Spatial Genomics Enables Multi-Modal Study of Clonal Heterogeneity in Tissues. Nat 2021 6017891 (2021) 601:85–91. doi:  10.1038/s41586-021-04217-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Van Den Tweel JG, Taylor CR. A Brief History of Pathology Preface to a Forthcoming Series That Highlights Milestones in the Evolution of Pathology as a Discipline. Virchows Arch (2010) 457:3–10. doi: 10.1007/s00428-010-0934-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Kim SW, Roh J, Park CS. Immunohistochemistry for Pathologists: Protocols, Pitfalls, and Tips. J Pathol Transl Med (2016) 50:411–8. doi: 10.4132/jptm.2016.08.08 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Bolognesi MM, Manzoni M, Scalia CR, Zannella S, Bosisio FM, Faretta M, et al. Multiplex Staining by Sequential Immunostaining and Antibody Removal on Routine Tissue Sections. J Histochem Cytochem (2017) 65:431–44. doi: 10.1369/0022155417719419 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Nielsen S. External Quality Assessment for Immunohistochemistry: Experiences From NordiQC. Biotech Histochem (2015) 90:331–40. doi: 10.3109/10520295.2015.1033462 [DOI] [PubMed] [Google Scholar]
  • 17. Mascadri F, Bolognesi MM, Pilla D, Cattoretti G. Rejuvenated Vintage Tissue Sections Highlight Individual Antigen Fate During Processing and Long-Term Storage. J Histochem Cytochem (2021) 69:659. doi: 10.1369/00221554211047287 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. MM B, FM B. & G, C. Unidentified Variables May Account for Variability in Multiplexing Results. J Histochem Cytochem (2020) 68:351–3. doi: 10.1369/0022155420911050 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Uhlén M, Fagerberg L, Hallström BM, Lindskog C, Oksvold P, Mardinoglu A, et al. Tissue-Based Map of the Human Proteome. Sci (2015) 347(6220):1260419. doi:  10.1126/science.1260419 [DOI] [PubMed] [Google Scholar]
  • 20. Hickey JW, Neumann EK, Radtke AJ, Camarillo JM, Beuschel RT, Albanese A, et al. Spatial Mapping of Protein Composition and Tissue Organization: A Primer for Multiplexed Antibody-Based Imaging. Nat Methods (2022) 19:284–95. doi: 10.1038/s41592-021-01316-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Cattoretti C, Bosisio FM, Marcelis L, Bolognesi MM. Multiple Iterative Labeling by Antibody Neodeposition (MILAN) PROTOCOL (Version 5) available at Research Square. (2018). doi:  10.21203/rs.2.1646/v5 [DOI] [Google Scholar]
  • 22. De Smet F, Antoranz Martinez A, Bosisio FM. Next-Generation Pathology by Multiplexed Immunohistochemistry. Trends Biochem Sci (2021) 46:80–2. doi: 10.1016/j.tibs.2020.09.009 [DOI] [PubMed] [Google Scholar]
  • 23. Bosisio FM, Antoranz A, van Herck Y, Bolognesi MM, Marcelis L, Chinello C, et al. Functional Heterogeneity of Lymphocytic Patterns in Primary Melanoma Dissected Through Single-Cell Multiplexing. Elife (2020) 9:e53008. doi: 10.7554/eLife.53008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Lin J-R, Fallahi-Sichani M, Sorger PK. Highly Multiplexed Imaging of Single Cells Using a High-Throughput Cyclic Immunofluorescence Method. Nat Commun (2015) 6:8390. doi: 10.1038/ncomms9390 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Kinkhabwala A, Herbel C, Pankratz J, Yushchenko DA, Rüberg S, Praveen P, et al. MACSima Imaging Cyclic Staining (MICS) Technology Reveals Combinatorial Target Pairs for CAR T Treatment of Solid Tumors. Sci Rep (2022) 12(1):1911. doi:  10.1038/s41598-022-05841-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Migliozzi D, Pelz B, Dupouy DG, Leblond AL, Soltermann A, Gijs MAM. Microfluidics-Assisted Multiplexed Biomarker Detection for in Situ Mapping of Immune Cells in Tumor Sections. Microsystems Nanoeng (2019) 5:1–12. doi: 10.1038/s41378-019-0104-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Consentius C, Mirenska A, Jurisch A, Reinke S, Scharm M, Zenclussen AC, et al. In Situ Detection of CD73+ CD90+ CD105+ Lineage: Mesenchymal Stromal Cells in Human Placenta and Bone Marrow Specimens by Chipcytometry. Cytom Part A (2018) 93:889–93. doi: 10.1002/cyto.a.23509 [DOI] [PubMed] [Google Scholar]
  • 28. Giesen C, Wang HA, Schapiro D, Zivanovic N, Jacobs A, Hattendorf B, et al. Highly Multiplexed Imaging of Tumor Tissues With Subcellular Resolution by Mass Cytometry. Nat Methods (2014) 11:417–22. doi: 10.1038/nmeth.2869 [DOI] [PubMed] [Google Scholar]
  • 29. Baharlou H, Canete NP, Cunningham AL, Harman AN, Patrick E. Mass Cytometry Imaging for the Study of Human Diseases-Applications and Data Analysis Strategies. Front Immunol (2019) 10:2657. doi: 10.3389/fimmu.2019.02657 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Dakshinamoorthy G, Singh J, Kim J, Nikulina N, Bashier R, Mistry S, et al. Abstract 490: Highly Multiplexed Single-Cell Spatial Analysis of Tissue Specimens Using CODEX. Cancer Res (2019) 79(13_Supplement):490. doi: 10.1158/1538-7445.AM2019-490 [DOI] [Google Scholar]
  • 31. Goltsev Y, Samusik N, Kennedy-Darling J, Bhate S, Hale M, Vazquez G, et al. Deep Profiling of Mouse Splenic Architecture With CODEX Multiplexed Imaging. Cell (2018) 174:968–981.e15. doi:  10.1016/j.cell.2018.07.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Black S, Phillips D, Hickey JW, Kennedy-Darling J, Venkataraaman VG, Samusik N, et al. CODEX Multiplexed Tissue Imaging With DNA-Conjugated Antibodies. Nat Protoc (2021) 16:3802–35. doi: 10.1038/s41596-021-00556-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Merritt CR, Ong GT, Church SE, Barker K, Danaher P, Geiss G, et al. Multiplex Digital Spatial Profiling of Proteins and RNA in Fixed Tissue. Nat Biotechnol (2020) 38:586–99. doi: 10.1038/s41587-020-0472-9 [DOI] [PubMed] [Google Scholar]
  • 34. Parra ER, Uraoka N, Jiang M, Cook P, Gibbons D, Forget MA, et al. Validation of Multiplex Immunofluorescence Panels Using Multispectral Microscopy for Immune-Profiling of Formalin-Fixed and Paraffin-Embedded Human Tumor Tissues. Sci Rep (2017) 7:1–11. doi: 10.1038/s41598-017-13942-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Gerdes MJ, et al. Highly Multiplexed Single-Cell Analysis of Formalinfixed, Paraffin-Embedded Cancer Tissue. Proc Natl Acad Sci U. S. A. (2013) 110:11982–7. doi:  10.1073/pnas.1300136110 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Eng J, et al. Cyclic Multiplexed-Immunofluorescence (cmIF), a Highly Multiplexed Method for Single-Cell Analysis. Methods Mol Biol (2020) 2055:521–62. doi: 10.1007/978-1-4939-9773-2_24 [DOI] [PubMed] [Google Scholar]
  • 37. Schubert W, et al. Analyzing Proteome Topology and Function by Automated Multidimensional Fluorescence Microscopy. Nat Biotechnol (2006) 24:1270–8. doi: 10.1038/nbt1250 [DOI] [PubMed] [Google Scholar]
  • 38. Radtke AJ, Kandov E, Lowekamp B, Speranza E, Chu CJ, Gola A, et al. IBEX-A Versatile Multi-Plex Optical Imaging Approach for Deep Phenotyping and Spatial 2 Analysis of Cells in Complex Tissues 3 High Dimensional Imaging, Immune System, Quantitative Microscopy, Tissue Immunity. Proc Natl Acad Sci U S A (2020) 117(52):33455–33465. doi:  10.1073/pnas.2018488117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. EP K, et al. The RareCyte® Platform for Next-Generation Analysis of Circulating Tumor Cells. Cytometry A (2018) 93:1220–5. doi: 10.1002/cyto.a.23619 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Saka SK, et al. Immuno-SABER Enables Highly Multiplexed and Amplified Protein Imaging in Tissues. Nat Biotechnol (2019) 37:1080–90. doi: 10.1038/s41587-019-0207-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Manesse M, Patel KK, Bobrow M, Downing SR. The InSituPlex ® Staining Method for Multiplexed Immunofluorescence Cell Phenotyping and Spatial Profiling of Tumor FFPE Samples. Methods Mol Biol (2020) 2055:585–92. doi: 10.1007/978-1-4939-9773-2_26 [DOI] [PubMed] [Google Scholar]
  • 42. Glass G, Papin JA, Mandell JW. SIMPLE: A Sequential Immunoperoxidase Labeling and Erasing Method. J Histochem Cytochem (2009) 57:899–905. doi: 10.1369/jhc.2009.953612 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Remark R, Merghoub T, Grabe N, Litjens G, Damotte D, Wolchok JD, et al. In-Depth Tissue Profiling Using Multiplexed Immunohistochemical Consecutive Staining on Single Slide. Sci Immunol (2016) 1(1):aaf6925. doi: 10.1126/sciimmunol.aaf6925 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Akturk G, Sweeney R, Remark R, Merad M, Gnjatic S. Multiplexed Immunohistochemical Consecutive Staining on Single Slide (MICSSS): Multiplexed Chromogenic IHC Assay for High-Dimensional Tissue Analysis. Methods Mol Biol (2020) 2055:497–519. doi: 10.1007/978-1-4939-9773-2_23 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Sun H, Shen J. & Yokota, H. Size-Dependent Positioning of Human Chromosomes in Interphase Nuclei. Biophys J (2000) 79:184–90. doi: 10.1016/S0006-3495(00)76282-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Monici M. Cell and Tissue Autofluorescence Research and Diagnostic Applications. Biotechnol Annu Rev (2005) 11:227–56. doi: 10.1016/S1387-2656(05)11007-2 [DOI] [PubMed] [Google Scholar]
  • 47. Lin JR, Izar B, Wang S, Yapp C, Mei S, Shah PM, et al. Highly Multiplexed Immunofluorescence Imaging of Human Tissues and Tumors Using T-CyCIF and Conventional Optical Microscopes. Elife (2018) 7:e31657. doi: 10.7554/eLife.31657 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Pascual-Reguant A, et al. Multiplexed Histology Analyses for the Phenotypic and Spatial Characterization of Human Innate Lymphoid Cells. Nat Commun (2021) 12:1–15. doi: 10.1038/s41467-021-21994-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Sood A, et al. Multiplexed Immunofluorescence Delineates Proteomic Cancer Cell States Associated With Metabolism. JCI Insight (2016) 1:87030. doi: 10.1172/jci.insight.87030 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Mani NL, et al. Quantitative Assessment of the Spatial Heterogeneity of Tumor-Infiltrating Lymphocytes in Breast Cancer. Breast Cancer Res 2016 181 (2016) 18:1–10. doi: 10.1186/s13058-016-0737-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Rubin MA, Dunn R, Strawderman M, Pienta KJ. Tissue Microarray Sampling Strategy for Prostate Cancer Biomarker Analysis. Am J Surg Pathol (2002) 26:312–9. doi: 10.1097/00000478-200203000-00004 [DOI] [PubMed] [Google Scholar]
  • 52. RL C, LA C, DL R. Validation of Tissue Microarray Technology in Breast Carcinoma. Lab Invest (2000) 80:1943–9. doi: 10.1038/labinvest.3780204 [DOI] [PubMed] [Google Scholar]
  • 53. RL C. V, N. & DL, R. A Decade of Tissue Microarrays: Progress in the Discovery and Validation of Cancer Biomarkers. J Clin Oncol (2008) 26:5630–7. doi: 10.1200/JCO.2008.17.3567 [DOI] [PubMed] [Google Scholar]
  • 54. Levin M, Flor AC, Snyder H, Kron SJ, Schwartz D. UltraPlex Hapten-Based Multiplexed Fluorescent Immunohistochemistry. Methods Mol Biol (2021) 2350:267–87. doi: 10.1007/978-1-0716-1593-5_17 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55. Rajagopalan A, Venkatesh I, Aslam R, Kirchenbuechler D, Khanna S, Cimbaluk D, et al. SeqStain Using Fluorescent-DNA Conjugated Antibodies Allows Efficient, Multiplexed, Spatialomic Profiling of Human and Murine Tissues. Cell Rep Methods. (2021) 1(2):100006. doi:  10.1016/j.crmeth.2021.100006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Taube JM, et al. The Society for Immunotherapy in Cancer Statement on Best Practices for Multiplex Immunohistochemistry (IHC) and Immunofluorescence (IF) Staining and Validation. J Immunother Cancer (2020) 8:155. doi: 10.1136/jitc-2019-000155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Molne J, Breimer ME, Svalander CT. Immunoperoxidase Versus Immunofluorescence in the Assessment of Human Renal Biopsies. Am J Kidney Dis (2005) 45:674–83. doi: 10.1053/j.ajkd.2004.12.019 [DOI] [PubMed] [Google Scholar]
  • 58. LL W, et al. Comparison of C3d Immunohistochemical Staining to Enzyme-Linked Immunosorbent Assay and Immunofluorescence for Diagnosis of Bullous Pemphigoid. J Am Acad Dermatol (2020) 83:172–8. doi: 10.1016/j.jaad.2020.02.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Hartmann FJ, et al. Scalable Conjugation and Characterization of Immunoglobulins With Stable Mass Isotope Reporters for Single-Cell Mass Cytometry Analysis. in. Methods Mol Biol (2019) 1989:55–81. doi: 10.1007/978-1-4939-9454-0_5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60. Bergholtz H, Carter JM, Cesano A, Cheang MCU, Church SE, Divakar P, et al. Best Practices for Spatial Profiling for Breast Cancer Research With the GeoMx ® Digital Spatial Profiler. Cancers (Basel) (2021) 13(17):4456. doi: 10.3390/cancers13174456 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61. Caicedo JC, et al. Data-Analysis Strategies for Image-Based Cell Profiling. Nat Methods (2017) 14:849–63. doi: 10.1038/nmeth.4397 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62. Janowczyk A, Zuo R, Gilmore H, Feldman M, Madabhushi A. HistoQC: An Open-Source Quality Control Tool for Digital Pathology Slides. JCO Clin Cancer Inf (2019) 3:1–7. doi: 10.1200/CCI.18.00157 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63. Kohlberger T, Liu Y, Moran M, Chen PC, Brown T, Hipp JD, et al. Whole-Slide Image Focus Quality: Automatic Assessment and Impact on AI Cancer Detection. J Pathol Inform (2019) 10:39. doi: 10.4103/jpi.jpi_11_19 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64. Hosseini MS, Brawley-Hayes JAZ, Zhang Y, Chan L, Plataniotis K, Damaskinos S. Focus Quality Assessment of High-Throughput Whole Slide Imaging in Digital Pathology. IEEE Trans Med Imaging (2020) 39(1):62–74. doi:  10.1109/TMI.2019.2919722. [DOI] [PubMed] [Google Scholar]
  • 65. Smith K, et al. CIDRE: An Illumination-Correction Method for Optical Microscopy. Nat Methods (2015) 12:404–6. doi: 10.1038/nmeth.3323 [DOI] [PubMed] [Google Scholar]
  • 66. Kask P, Palo K, Hinnah C, Pommerencke T. Flat Field Correction for High-Throughput Imaging of Fluorescent Samples. J Microsc (2016) 263:328–40. doi: 10.1111/jmi.12404 [DOI] [PubMed] [Google Scholar]
  • 67. Bray M-A, Carpenter AE. Quality Control for High-Throughput Imaging Experiments Using Machine Learning in Cellprofiler. Methods Mol Biol (2018) 1683:89–112. doi: 10.1007/978-1-4939-7357-6_7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68. Pang Z, Laplante NE, Filkins RJ. Dark Pixel Intensity Determination and its Applications in Normalizing Different Exposure Time and Autofluorescence Removal. J Microsc (2012) 246:1–10. doi: 10.1111/j.1365-2818.2011.03581.x [DOI] [PubMed] [Google Scholar]
  • 69. Woolfe F, Gerdes M, Bello M, Tao X, Can A. Autofluorescence Removal by non-Negative Matrix Factorization. IEEE Trans Image Process (2011) 20:1085–93. doi: 10.1109/TIP.2010.2079810 [DOI] [PubMed] [Google Scholar]
  • 70. Chang YH, et al. RESTORE: Robust Intensity Normalization Method for Multiplexed Imaging. Commun Biol (2020) 3:1–9. doi: 10.1038/s42003-020-0828-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71. Graf J, et al. FLINO: A New Method for Immunofluorescence Bioimage Normalization. Bioinformatics (2022) 38:520–6. doi: 10.1093/bioinformatics/btab686 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72. Srinivasa Reddy B, Chatterji BN. An FFT-Based Technique for Translation, Rotation, and Scale-Invariant Image Registration. IEEE Trans Image Process (1996) 5:1266–71. doi: 10.1109/83.506761 [DOI] [PubMed] [Google Scholar]
  • 73. Matungka R, Zheng YF, Ewing RL. Image Registration Using Adaptive Polar Transform. IEEE Trans Image Process (2009) 18:2340–54. doi: 10.1109/TIP.2009.2025010 [DOI] [PubMed] [Google Scholar]
  • 74. Maintz JBA, Viergever MA. An Overview of Medical Image Registration Methods. Imaging Science Department, Imaging Center Utrecht, Technical Report (1996). UU-CS-1998–22 [Google Scholar]
  • 75. Ri Y, Fujimoto H. Drift-Free Motion Estimation From Video Images Using Phase Correlation and Linear Optimization. Proc - 2018 IEEE 15th Int Work. Adv Motion Control (AMC) (2018), 295–300. doi:  10.1109/AMC.2019.8371106 [DOI] [Google Scholar]
  • 76. Muhlich J, Chen Y-A, Russell D, Sorger PK. Stitching and Registering Highly Multiplexed Whole Slide Images of Tissues and Tumors Using ASHLAR Software. bioRxiv (2021), 440625. doi:  10.1101/2021.04.20.440625 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77. Beroiz M, Cabral JB, Sanchez B. Astroalign: A Python Module for Astronomical Image Registration. Astron Comput (2020) 32:100384. doi: 10.1016/j.ascom.2020.100384 [DOI] [Google Scholar]
  • 78. Sandkühler R, Jud C, Andermatt S, Cattin PC. AirLab: Autograd Image Registration Laboratory. arXiv (2018) preprint arXiv:1806.09907. [Google Scholar]
  • 79. Beucher S, Meyer F. 79. p. (2018). doi:  10.1201/9781482277234-12 [DOI] [Google Scholar]
  • 80. Gamarra M, Zurek E, Escalante HJ, Hurtado L, San-Juan-Vergara H. Split and Merge Watershed: A Two-Step Method for Cell Segmentation in Fluorescence Microscopy Images. Biomed Signal Process Control (2019) 53:101575. doi: 10.1016/j.bspc.2019.101575 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81. Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) (2015) 9351:234–41. doi: 10.1007/978-3-319-24574-4_28 [DOI] [Google Scholar]
  • 82. Schmidt U, Weigert M, Broaddus C, Myers G. Cell Detection With Star-Convex Polygons. In: Frangi A, Schnabel J, Davatzikos C, Alberola-López C, Fichtinger G. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI (2018). MICCAI 2018. Lecture Notes in Computer Science(), vol 11071. Springer, Cham. doi:  10.1007/978-3-030-00934-2_30 [DOI] [Google Scholar]
  • 83. Korfhage N, Mühling M, Ringshandl S, Becker A, Schmeck B, Freisleben B. Detection and Segmentation of Morphologically Complex Eukaryotic Cells in Fluorescence Microscopy Images via Feature Pyramid Fusion. PloS Comput Biol (2020) 16(9):e1008179. doi: 10.1371/journal.pcbi.1008179 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84. Schwendy M, Unger RE, Parekh SH. EVICAN—a Balanced Dataset for Algorithm Development in Cell and Nucleus Segmentation. Bioinformatics (2020) 36:3863–70. doi: 10.1093/bioinformatics/btaa225 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85. Kumar N, et al. A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology. IEEE Trans Med Imaging (2017) 36:1550–60. doi: 10.1109/TMI.2017.2677499 [DOI] [PubMed] [Google Scholar]
  • 86. Al-Kofahi Y, Zaltsman A, Graves R, Marshall W, Rusu M. A Deep Learning-Based Algorithm for 2-D Cell Segmentation in Microscopy Images. BMC Bioinf (2018) 19:365. doi: 10.1186/s12859-018-2375-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87. Greenwald NF, Miller G, Moen E, Kong A, Kagel A, Dougherty T, et al. Whole-Cell Segmentation of Tissue Images With Human-Level Performance Using Large-Scale Data Annotation and Deep Learning. Nat Biotechnol (2022) 40(4):555–565. doi:  10.1038/s41587-021-01094-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88. Acs B, et al. Ki67 Reproducibility Using Digital Image Analysis: An Inter-Platform and Inter-Operator Study. Lab Investig (2018) 99:107–17. doi: 10.1038/s41374-018-0123-7 [DOI] [PubMed] [Google Scholar]
  • 89. Franc B, et al. Interobserver and Intraobserver Reproducibility in the Histopathology of Follicular Thyroid Carcinoma. Hum Pathol (2003) 34:1092–100. doi: 10.1016/S0046-8177(03)00403-9 [DOI] [PubMed] [Google Scholar]
  • 90. Pearson RG, Kurien T, Shu KSS, Scammell BE. Histopathology Grading Systems for Characterisation of Human Knee Osteoarthritis – Reproducibility, Variability, Reliability, Correlation, and Validity. Osteoarthr Cartil (2011) 19:324–31. doi: 10.1016/j.joca.2010.12.005 [DOI] [PubMed] [Google Scholar]
  • 91. Beaton C, Twine CP, Williams GL, Radcliffe AG. Systematic Review and Meta-Analysis of Histopathological Factors Influencing the Risk of Lymph Node Metastasis in Early Colorectal Cancer. Color Dis (2013) 15:788–97. doi: 10.1111/codi.12129 [DOI] [PubMed] [Google Scholar]
  • 92. Pallua JD, Brunner A, Zelger B, Schirmer M, Haybaeck J. The Future of Pathology is Digital. Pathol - Res Pract (2020) 216:153040. doi: 10.1016/j.prp.2020.153040 [DOI] [PubMed] [Google Scholar]
  • 93. Bankhead P, et al. QuPath: Open Source Software for Digital Pathology Image Analysis. Sci Rep (2017) 7:16878. doi: 10.1038/s41598-017-17204-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94. Stirling DR, Carpenter AE, Cimini BA. CellProfiler Analyst 3.0: Accessible Data Exploration and Machine Learning for Image Analysis. Bioinformatics (2021) 37:3992–4. doi: 10.1093/bioinformatics/btab634 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95. Schapiro D, et al. histoCAT: Analysis of Cell Phenotypes and Interactions in Multiplex Image Cytometry Data. Nat Methods (2017) 14:873–6. doi: 10.1038/nmeth.4391 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96. Schapiro D, et al. MCMICRO: A Scalable, Modular Image-Processing Pipeline for Multiplexed Tissue Imaging. Nat Methods (2021) 19:311–5. doi: 10.1038/s41592-021-01308-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97. Bortolomeazzi M, et al. A SIMPLI (Single-Cell Identification From MultiPLexed Images) Approach for Spatially-Resolved Tissue Phenotyping at Single-Cell Resolution. Nat Commun (2022) 13:1–14. doi: 10.1038/s41467-022-28470-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98. Hoshida Y. Nearest Template Prediction: A Single-Sample-Based Flexible Class Prediction With Confidence Assessment. PloS One (2010) 5:e15543. doi: 10.1371/journal.pone.0015543 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99. Hickey JW, Tan Y, Nolan GP, Goltsev Y. Strategies for Accurate Cell Type Identification in CODEX Multiplexed Imaging Data. Front Immunol (2021) 12. doi: 10.3389/fimmu.2021.727626 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 100. Berens ME, Sood A, Barnholtz-Sloan JS, Graf JF, Cho S, Kim S, et al. Multiscale, Multimodal Analysis of Tumor Heterogeneity in IDH1 Mutant vs Wild-Type Diffuse Gliomas. PloS One (2019) 14(12):e0219724. doi: 10.1371/journal.pone.0219724 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101. Badve SS, et al. Multi-Protein Spatial Signatures in Ductal Carcinoma in Situ (DCIS) of Breast. Br J Cancer (2021) 124:1150–9. doi: 10.1038/s41416-020-01216-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 102. Jackson HW, et al. The Single-Cell Pathology Landscape of Breast Cancer. Nature (2020) 578:615–20. doi: 10.1038/s41586-019-1876-x [DOI] [PubMed] [Google Scholar]
  • 103. Arnol D, Schapiro D, Bodenmiller B, Saez.-Rodriguez J, Stegle O. Modeling Cell-Cell Interactions From Spatial Molecular Data With Spatial Variance Component Analysis. Cell Rep (2019) 29:202–211.e6. doi: 10.1016/j.celrep.2019.08.077 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104. Tanevski J, Flores ROR, Gabor A, Schapiro D, Saez-Rodriguez J. Explainable Multi-View Framework for Dissecting Intercellular Signaling From Highly Multiplexed Spatial Data. Genome Biol (2022) 23(1):97. doi:  10.1186/s13059-022-02663-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105. Schapiro D, Sokolov A, Yapp C, Chen YA, Muhlich JL, Hess J, et al. MCMICRO: A Scalable, Modular Image-Processing Pipeline for Multiplexed Tissue Imaging. Nat Methods (2022) 19(3):311–315. doi:  10.1038/s41592-021-01308-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 106. Nirmal AJ, Maliga Z, Vallius T, Quattrochi B, Chen AA, Jacobson CA, et al. The Spatial Landscape of Progression and Immunoediting in Primary Melanoma at Single Cell Resolution. Cancer Discov (2022) 12(6):1518–1541. doi:  10.1158/2159-8290 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 107. Pell R, et al. The Use of Digital Pathology and Image Analysis in Clinical Trials. J Pathol Clin Res (2019) 5:81–90. doi: 10.1002/cjp2.127 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108. Chen G, Ning B, Shi T. Single-Cell RNA-Seq Technologies and Related Computational Data Analysis. Front Genet (2019) 10:317. doi: 10.3389/fgene.2019.00317 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 109. Guillot A, Kohlhepp MS, Bruneau A, Heymann F, Tacke F. Deciphering the Immune Microenvironment on A Single Archival Formalin-Fixed Paraffin-Embedded Tissue Section by An Immediately Implementable Multiplex Fluorescence Immunostaining Protocol. Cancers (Basel) (2020) 12:1–18. doi: 10.3390/cancers12092449 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 110. van Maldegem F, Valand K, Cole M, Patel H, Angelova M, Rana S, et al. Characterisation of Tumour Microenvironment Remodelling Following Oncogene Inhibition in Preclinical Studies With Imaging Mass Cytometry. Nat Commun (2021) 12(1):5906. doi:  10.1038/s41467-021-26214-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 111. Pombo Antunes AR, Scheyltjens I, Lodi F, Messiaen J, Antoranz A, Duerinck J, et al. Single-cell profiling of myeloid cells in glioblastoma across species and disease stage reveals macrophage competition and specialization. Nat Neurosci. (2021) 24(4):595–610. doi:  10.1038/s41593-020-00789-y [DOI] [PubMed] [Google Scholar]
  • 112. Naulaerts S, Borras DM, Martinez AA, Messiaen J, Van Herck Y, Gelens L, et al. Immunogenomic, Single-Cell and Spatial Dissection of CD8+T Cell Exhaustion Reveals Critical Determinants of Cancer Immunotherapy. bioRxiv (2021), 468617. doi:  10.1101/2021.11.22.468617 [DOI] [Google Scholar]
  • 113. Halse H, et al. Multiplex Immunohistochemistry Accurately Defines the Immune Context of Metastatic Melanoma. Sci Rep (2018) 8:11158. doi: 10.1038/s41598-018-28944-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 114. Bosisio F, Antoranz A, Herck YV, et al. Mapping the Immune Landscape in Metastatic Melanoma Reveals Localized Cell-Cell Interactions Correlating to Immunotherapy Responsiveness. Research Square (2022). doi:  10.21203/RS.3.RS-1236531/V1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115. Sade-Feldman M, et al. Defining T Cell States Associated With Response to Checkpoint Immunotherapy in Melanoma. Cell (2018) 175:998–1013.e20. doi: 10.1016/j.cell.2018.10.038 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 116. Schürch CM, et al. Coordinated Cellular Neighborhoods Orchestrate Antitumoral Immunity at the Colorectal Cancer Invasive Front. Cell (2020) 182:1341–1359.e19. doi:  10.1016/j.cell.2020.07.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 117. Rakaee M, et al. Prognostic Value of Macrophage Phenotypes in Resectable Non–Small Cell Lung Cancer Assessed by Multiplex Immunohistochemistry. Neoplasia (United States) (2019) 21:282–93. doi: 10.1016/j.neo.2019.01.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 118. Hofman P, Badoual C, Henderson F, Berland L, Hamila M, Long-Mira E, et al. Multiplexed Immunohistochemistry for Molecular and Immune Profiling in Lung Cancer—Just About Ready for Prime-Time? Cancers (Basel) (2019) 11(3):283. doi: 10.3390/cancers11030283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 119. Färkkilä A, et al. Immunogenomic Profiling Determines Responses to Combined PARP and PD-1 Inhibition in Ovarian Cancer. Nat Commun (2020) 11:1459. doi: 10.1038/s41467-020-15315-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 120. Patil NS, et al. Intratumoral Plasma Cells Predict Outcomes to PD-L1 Blockade in non-Small Cell Lung Cancer. Cancer Cell (2022) 40:289–300.e4. doi: 10.1016/j.ccell.2022.02.002 [DOI] [PubMed] [Google Scholar]
  • 121. Lewis SM, Asselin-Labat ML, Nguyen Q, Berthelet J, Tan X, Wimmer VC, et al. Spatial Omics and Multiplexed Imaging to Explore Cancer Biology. Nat Methods. 18(9):997–1012. doi:  10.1038/s41592-021-01203-6. [DOI] [PubMed] [Google Scholar]
  • 122. Hoch T, Schulz D, Eling N, Gómez JM, Levesque MP, Bodenmiller B. Multiplexed Imaging Mass Cytometry of the Chemokine Milieus in Melanoma Characterizes Features of the Response to Immunotherapy. Sci Immunol (2022) 7(70):eabk1692. doi: 10.1126/sciimmunol.abk1692 [DOI] [PubMed] [Google Scholar]
  • 123. Hao Y, et al. Integrated Analysis of Multimodal Single-Cell Data. Cell (2021) 184:3573–3587.e29. doi: 10.1016/j.cell.2021.04.048 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 124. van Eck NJ, Waltman L. Software Survey: VOSviewer, a Computer Program for Bibliometric Mapping. Scientometrics (2010) 84:523–38. doi: 10.1007/s11192-009-0146-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 125. Bolognesi MM, Manzoni M, Scalia CR, Zannella S, Bosisio FM, Faretta M, et al. Multiplex Staining by Sequential Immunostaining and Antibody Removal on Routine Tissue Sections. J Histochem Cytochem. (2017). 65(8):431–444. doi:  10.1369/0022155417719419 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Figure 1

GIF representation covering an 82-plex of a melanoma tissue sample stained with 52 consecutive rounds of MILAN staining.


Articles from Frontiers in Oncology are provided here courtesy of Frontiers Media SA

RESOURCES