In Situ Hybridization vs. Immunohistochemistry: A Comparison

In situ hybridization (ISH) and immunohistochemistry (IHC) are the two workhorses of tissue-based detection in pathology labs, and the core difference between them is simple: IHC targets proteins, while ISH targets nucleic acids like DNA or RNA.{” “} Both techniques preserve the spatial layout of cells in a tissue section so you can see exactly where a molecule is expressed, but because one reads the message (mRNA) and the other reads the finished product (protein), they can tell different stories about the same tissue.¹ Understanding when the two methods agree, when they diverge, and why a pathologist might choose one over the other matters for everything from cancer treatment decisions to infection diagnosis.

What Each Technique Actually Detects

IHC works by using antibodies that bind to a specific protein in a tissue section. Once the antibody locks onto its target antigen, a detection system produces a visible signal, usually a colored stain you can see under a standard microscope. The technique is intuitive: if the protein is there, the stain lights up. Because proteins are the functional molecules that drive most cellular behavior, IHC gives you a direct readout of what the cell is actually producing and deploying.

ISH takes a step back in the molecular chain. Instead of looking at the protein itself, it uses a complementary nucleic acid probe that binds to a specific DNA or RNA sequence inside the cell. The most common clinical version, fluorescence in situ hybridization (FISH), uses fluorescent probes to detect gene copies, deletions, or rearrangements at the DNA level. RNA ISH methods detect messenger RNA transcripts, revealing which genes are actively being read out. Newer platforms like RNAscope use a branched signal-amplification design that can detect individual mRNA molecules with standard microscopy, a significant leap in sensitivity over older ISH approaches.²

This difference matters because mRNA levels and protein levels do not always track together. A gene can be transcribed into mRNA but the protein may be degraded, modified, or never translated efficiently. Conversely, a stable protein can linger in a cell long after its mRNA has been broken down. So the two techniques sometimes give complementary rather than redundant information about the same biological process.

How Tissue Fixation Shapes Both Methods

Both ISH and IHC are performed on tissue that has been chemically fixed, usually with formaldehyde, to preserve cell structure. But fixation is a double-edged sword for both techniques, and the problems it creates are different for each one. IHC relies on antibodies recognizing the three-dimensional shape of a protein. Excessive fixation can chemically cross-link proteins in ways that mask the very sites the antibody needs to bind, a problem pathologists call epitope masking. Labs routinely use antigen retrieval techniques, such as heating the tissue in a buffer or applying a protease enzyme, to reverse some of that cross-linking and restore the antibody’s ability to find its target.³

ISH faces a related but distinct problem. Formaldehyde cross-links nucleic acids to surrounding proteins and to each other, which can physically block the probe from reaching its target sequence. Prolonged formalin fixation has been shown to reduce ISH sensitivity, likely because of this extensive cross-linking between RNA, DNA, and proteins.⁴ The practical consequence is that older archived tissue blocks, which may have sat in formalin for weeks before processing, are harder to stain reliably with ISH than fresher specimens.

Getting the enzymatic pretreatment right is also tricky. For ISH, proteinase K digestion is commonly used to strip away proteins that obstruct probe access, but the concentration has to be carefully dialed in. Too little digestion leaves the target inaccessible; too much destroys the tissue architecture and washes away the very RNA you are trying to detect. For IHC on certain tissue types like bone, enzymatic retrieval with proteinase K can actually give more consistent results than the heat-based retrieval methods that work well on soft tissues.⁵

HER2 Testing in Breast Cancer, Where the Two Methods Meet Head-On

The most clinically high-stakes comparison of IHC and ISH happens in breast cancer, specifically in testing for HER2, a protein whose overexpression drives aggressive tumor growth. Patients whose tumors are HER2-positive benefit from targeted therapies, so getting this call right directly affects treatment. Standard practice uses IHC as the initial screen: tumors scoring 0 or 1+ are considered negative, 3+ is positive, and the ambiguous 2+ category gets reflex-tested by FISH to look for actual gene amplification.

A meta-analysis covering thousands of breast cancer cases found that IHC and FISH agreed about 96% of the time when IHC scored tumors as 0 or 1+, and about 91% of the time when IHC scored tumors as 3+. The gray zone was the IHC 2+ group, where only about 36% turned out to be FISH-amplified.⁶ That means roughly two-thirds of 2+ cases would be misclassified as positive if labs relied on IHC alone without FISH confirmation.

Even among cases scored at the extremes, agreement is not perfect. A large study of over 6,600 tumors demonstrated that the way pathologists apply their IHC scoring criteria makes a dramatic difference. Using a standard scoring system, about 31% of tumors called IHC 3+ turned out to be FISH non-amplified, an alarmingly high false-positive rate. When the researchers applied a more strictly normalized scoring system, that false-positive rate dropped to roughly 5%, and the concordance between IHC 3+ and FISH-amplified cases rose from about 69% to nearly 95%.⁷

A review of over 43,000 breast cancer cases with both IHC and ISH performed found an overall discordance rate of about 4%. The pattern was asymmetric: cases that were IHC-positive but ISH-negative were significantly more common than the reverse, at roughly 14% versus 3% of their respective categories. The researchers noted that these discordances likely reflect genuine biological complexity in how the HER2 gene and its protein behave, rather than simple technical error.⁸ Their recommendation: performing both tests routinely could catch cases that a single method would miss, preventing patients from being denied a therapy that could help.

Scoring Variability and the Human Factor

One underappreciated difference between IHC and ISH is how consistently pathologists can read the results. IHC scoring for HER2 relies on the pathologist’s visual assessment of staining intensity and the percentage of cells staining, which introduces subjectivity. A multi-institutional study had 18 pathologists independently score 170 HER2 IHC cases using the standard four-category system (0, 1+, 2+, 3+). The overall agreement was just 29%. Even when the scoring was simplified to a three-tier system, agreement only climbed to about 46%. Distinguishing 3+ from everything else was the most reliable task, plateauing at about 87% agreement among six or more raters, but telling 0 from non-zero topped out around 59%.⁹

FISH scoring, by contrast, involves counting discrete fluorescent signals under a fluorescence microscope, which is more objective in principle. You count the number of HER2 gene copies relative to a reference chromosome probe, calculate a ratio, and the result is a number rather than a visual impression. That is not to say FISH is immune to variability: signal quality, tissue thickness, and counting methodology all introduce noise. But the numerical basis of FISH scoring tends to produce better inter-observer agreement than the subjective grading that IHC requires, at least in the critical borderline range. This is one of the reasons FISH serves as the confirmatory test for ambiguous IHC results rather than the other way around.

Detecting Infections, the Epstein-Barr Virus Example

Beyond cancer, the ISH-versus-IHC comparison plays out in infectious disease pathology, and Epstein-Barr virus (EBV) is a revealing case study. EBV is linked to several lymphomas, and pathologists need to determine whether the virus is present in tumor cells. IHC detects a viral protein called LMP (latent membrane protein), while ISH detects small viral RNAs called EBERs that are abundantly expressed in EBV-infected cells.

In a study of Hodgkin lymphoma cases, IHC detected EBV in about 46% of cases while ISH detected it in about 58%, and none of the ISH-negative cases were IHC-positive. The three extra cases caught by ISH but missed by IHC represented patients whose tumors expressed viral RNA without detectable levels of the LMP protein.¹⁰ This happens because EBV has different latency programs, and not all of them produce the LMP protein that IHC targets. EBER ISH has become the accepted gold standard for EBV detection in tissue precisely because the EBER RNAs are expressed across all latency types.

Newer RNA ISH platforms push sensitivity further. A comparison of RNA ISH (RISH) against traditional ISH and IHC found that RISH was concordant with all ISH-positive EBV cases but also picked up positivity in 25% of cases that traditional ISH had called negative. For cytomegalovirus (CMV), the gains were even more dramatic: RISH detected virus in half the cases that IHC had missed entirely, yielding an overall concordance between RISH and IHC of just 67%.¹¹ The takeaway is that for certain pathogens, ISH-based approaches outperform IHC in sensitivity by a meaningful margin.

Lung Cancer and ALK Rearrangements

Another revealing comparison comes from testing for ALK gene rearrangements in non-small cell lung cancer, which determines eligibility for ALK-targeted drugs. A study of 312 lung cancer patients in Taiwan compared IHC, FISH, and RT-PCR for detecting ALK rearrangements. Using RT-PCR as the reference standard, IHC had a sensitivity of about 92% and a specificity of about 80%. FISH was much less sensitive at around 58%, but its specificity was extremely high at over 99%.¹²

This result flips the typical narrative. In HER2 testing, FISH is the arbiter of truth. In ALK testing, IHC turns out to be the more sensitive screen, while FISH’s strength lies in ruling out false positives. The lesson is that neither technique is universally superior: which one performs better depends entirely on the biology of the target being tested, the quality of the available antibodies and probes, and the clinical question being asked.

The Problem of Difficult Tissues

Some tissue types challenge both methods in ways that require specialized processing. Bone is the classic example. Before bony tissue can be sectioned and stained, the mineral component has to be dissolved through decalcification. The choice of decalcification agent has a profound effect on downstream staining quality for both IHC and ISH. Hydrochloric acid-based protocols and prolonged formic acid treatment were found to induce false-negative results for both IHC and molecular analyses. EDTA-based decalcification and short-term formic acid treatment preserved antigenicity and allowed reliable molecular testing, with EDTA showing particular superiority for ISH techniques.¹³

For breast cancer that has metastasized to bone, where HER2 status still needs to be determined, this is not an academic concern. A study examining EDTA decalcification on breast cancer samples found no significant differences in estrogen receptor IHC, progesterone receptor IHC, or HER2 FISH results between EDTA-treated bony tissue and matched non-decalcified controls.¹⁴ EDTA is gentler and slower than acid-based methods, but it preserves both proteins and nucleic acids well enough for reliable testing. Labs that handle bone biopsies need to standardize on gentle protocols if they want both IHC and ISH to be trustworthy.

Boosting Sensitivity With Signal Amplification

Both techniques have benefited from amplification methods that push detection limits lower. On the IHC side, tyramide signal amplification (TSA) uses an enzymatic reaction to deposit large numbers of fluorescent molecules at the antibody binding site, dramatically increasing the visible signal. For ISH, branched-DNA methods like RNAscope achieve amplification by building a molecular “tree” at each probe binding site. These amplification strategies have made it possible to use both methods together on challenging tissues like formalin-fixed, paraffin-embedded (FFPE) human fetal brain, where target molecules may be sparse and tissue preservation suboptimal.¹⁵

One common pitfall in IHC that amplification can inadvertently worsen is background staining. The standard explanation has been that non-specific antibody binding to Fc receptors or through ionic and hydrophobic interactions creates false signals, which is why labs include blocking steps with serum or albumin before applying the primary antibody. Interestingly, one study found that none of their tested antibodies showed non-specific binding even without a blocking step, suggesting that standard formalin fixation already disables endogenous Fc receptors.¹⁶ The actual sources of background staining may be more complex than the textbook explanation suggests, and amplification methods can magnify whatever non-specific signal exists, making careful optimization essential.

Quantifying Results With Digital Tools

Interpreting staining patterns under a microscope is inherently subjective, which is why both ISH and IHC are increasingly paired with digital image analysis. For RNA ISH specifically, the discrete dot-like signals produced by methods like RNAscope lend themselves well to automated counting. A comparison of four image analysis tools for quantifying RNAscope signals in colorectal cancer tissue found that the tools varied in how well they agreed with manual counts, with one machine-learning-based tool showing the best concordance.¹⁷ The digital approach promises to reduce the inter-observer variability that plagues manual IHC scoring, though it introduces its own challenges around tissue segmentation and artifact handling.

Deep learning models are also being applied to FISH image analysis. One AI system trained to evaluate HER2 FISH images achieved about 85% accuracy on a test set of 184 images, which is reasonable but still fell short of expert pathologists on difficult cases.¹⁸ The technology is moving quickly, but for now, automated analysis works best as a second opinion rather than a replacement for trained human interpretation.

Multiplexing and Combining Both Techniques

One of the most exciting developments in tissue diagnostics is multiplexing: detecting many targets simultaneously on a single tissue section. Highly multiplexed platforms now exist for both IHC and ISH, and some enable multi-omic interrogation by correlating RNA and protein expression profiles in the same sample with single-cell resolution.¹⁹ Traditional single-marker IHC and ISH require separate tissue sections for each target, which uses up precious biopsy material and makes it impossible to see how multiple markers co-localize in the same cell. Multiplexed approaches solve both problems.

Combining ISH and IHC on the same tissue section has been achieved in several systems. Protocols now exist for simultaneously detecting RNA by fluorescent ISH and protein by IHC in thick brain sections, retinal tissue, and plant specimens.²⁰²¹ A combined approach using hybridization chain reaction (HCR) RNA-FISH with IHC was recently shown to work in whole-mount plant tissue, confirming that both mRNA and its corresponding protein can be visualized at the same time.²² Being able to see both the message and the product in the same cell opens up questions that neither technique could answer alone, like whether a cell that is actively transcribing a gene is also translating it into functional protein, or whether protein is accumulating from transcription that happened earlier and has since stopped.

Choosing One, the Other, or Both

For routine clinical work, the choice between ISH and IHC usually comes down to what question you need answered. IHC is faster, cheaper, and available in virtually every pathology lab. It uses standard bright-field microscopy and well-established antibody panels, and turnaround time can be as short as a day. ISH generally costs more per slide, requires more specialized reagents and often fluorescence microscopy, and takes longer to perform. But it answers questions that IHC simply cannot: whether a gene is amplified, rearranged, or deleted at the DNA level, or whether a particular mRNA is being transcribed in a cell that may not be making detectable protein.

In practice, the two methods are not competitors but partners. The HER2 testing pathway illustrates this perfectly: IHC serves as the efficient initial screen, and ISH resolves the ambiguous cases. For EBV detection, ISH is the primary method because it catches latency patterns that IHC misses. For ALK in lung cancer, IHC is the more sensitive screen, while FISH provides definitive confirmation. The biology of each target dictates which technique leads and which confirms. Labs that have the infrastructure for both are better positioned to give clinicians the complete picture than those relying on a single method.