Skip to main content
Journal of Veterinary Diagnostic Investigation: Official Publication of the American Association of Veterinary Laboratory Diagnosticians, Inc logoLink to Journal of Veterinary Diagnostic Investigation: Official Publication of the American Association of Veterinary Laboratory Diagnosticians, Inc
. 2023 Nov 2;36(1):78–85. doi: 10.1177/10406387231206080

Normalizing real-time PCR results in routine testing

Betsy Armenta-Leyva 1,1, Berenice Munguía-Ramírez 2, Ting-Yu Cheng 3, Fangshu Ye 4, Alexandra Henao-Díaz 5, Luis G Giménez-Lirola 6, Jeffrey Zimmerman 7
PMCID: PMC10734596  PMID: 37919959

Abstract

Normalization, the process of controlling for normal variation in sampling and testing, can be achieved in real-time PCR assays by converting sample quantification cycles (Cqs) to “efficiency standardized Cqs” (ECqs). We calculated ECqs as E−ΔCq, where E is amplification efficiency and ΔCq is the difference between sample and reference standard Cqs. To apply this approach to a commercial porcine reproductive and respiratory syndrome virus (PRRSV) RT-qPCR assay, we created reference standards by rehydrating and then diluting (1 × 10−4) a PRRSV modified-live vaccine (PRRS MLV; Ingelvac) with serum or oral fluid (OF) to match the sample matrix to be tested. Sample ECqs were calculated using the mean E and reference standard Cq calculated from the 4 reference standards on each plate. Serum (n = 132) and OF (n = 130) samples were collected from each of 12 pigs vaccinated with a PRRSV MLV from −7 to 42 d post-vaccination, tested, and sample Cqs converted to ECqs. Mean plate Es were 1.75–2.6 for serum and 1.7–2.3 for OF. Mean plate reference standard Cqs were 29.1–31.3 for serum and 29.2–31.5 for OFs. Receiver operating characteristic analysis calculated the area under the curve for serum and OF sample ECqs as 0.999 (95% CI: 0.997, 1.000) and 0.947 (0.890, 1.000), respectively. For serum, diagnostic sensitivity and specificity of the commercial PRRSV RT-qPCR assay were estimated as 97.9% and 100% at an ECq cutoff ≥ 0.20, and for OF, 82.6% and 100%, respectively, at an ECq cutoff ≥ 0.45.

Keywords: amplification efficiency, ECq, normalization, real-time PCR, run-to-run variation


According to the minimum information for publication of quantitative real-time PCR experiments (MIQE) guidelines, 7 publications on quantitative real-time PCR (qPCR) technology should include estimates of analytical sensitivity and specificity, accuracy, precision within (repeatability) and between (reproducibility) laboratories, and the criteria for generating reportable results. To these can be added other crucial test performance parameters (e.g., diagnostic sensitivity, diagnostic specificity, and limits of detection).

Less celebrated, but vital to consistent performance as tests move from the research laboratory to routine diagnostic use, are assay standardization and data normalization. 29 “Standardization” means using test protocols and procedures that reliably produce results that meet agreed-upon specifications. 64 Simply put, “the results of laboratory tests must be uniform to inspire confidence, and uniform results can only be obtained by uniform methods.” 65

Standardization per se will improve laboratory repeatability and reproducibility, 60 but “normalization” is necessary to produce results that are directly comparable among laboratories. Normalization is typically achieved by re-expressing results in the context of an agreed-upon reference standard.11,32,40 Normalization has been described as the means “to distinguish between real (biological) variation and deviations resulting from measurement processes such as run-to-run variation, disparities in mRNA quantity and quality among samples, pipetting errors, and efficiencies of the enzymes used for the reverse transcription and amplification steps.” 1

In veterinary testing, the widespread use of commercial PCR kits has achieved de facto assay standardization for major pathogens. In contrast, normalization in routine PCR testing remains uncommon. A robust normalization method that re-expresses the quantification cycle (Cq) as a function of plate-specific amplification efficiency (i.e., efficiency standardized Cqs [ECqs]) has been proposed.10,43 Our objective was to adapt and apply the ECq methodology to routine PCR testing of serum and oral fluid (OF) using a commercial porcine reproductive and respiratory syndrome virus (PRRSV; Betaarterivirus suid 2) reverse-transcription qPCR (RT-qPCR) assay.

Materials and methods

Experimental design

To adapt the ECq methodology to routine PRRSV RT-qPCR testing, target- and matrix-specific (serum or OF) reference standards were created by rehydrating and then diluting (1 × 10−4) a PRRSV modified-live virus (MLV) vaccine (Ingelvac PRRS MLV, serial 2451416A; Boehringer Ingelheim) with PRRSV-free serum or OF. Serum or OF reference standards (n = 4) were included on each plate to match the sample matrix to be tested. Technically, the process does not use plates, but for practical convenience, a “plate” will be defined as a block of ≤ 48 reactions loaded and tested in 1 qPCR program. Reference standards were used to calculate the mean plate amplification efficiency (E) and mean reference standard Cq, which were then used to calculate the individual sample ECqs:

EfficiencystandardizedCq=ECq=EΔCq=E(sampleCqmeanreferencestandardCq) (1)

To illustrate the use of ECqs, 132 serum and 130 OF samples collected over time from a group of 12 pigs vaccinated with a PRRSV MLV vaccine (Ingelvac PRRS MLV) 26 were tested with a PRRSV RT-qPCR assay. Sample Cqs were first converted to ECqs and then analyzed by receiver operating characteristics (ROC) analysis to obtain diagnostic sensitivity and specificity estimates for the PRRSV RT-qPCR assay.

Reference standards

Target-specific (PRRSV) and matrix-specific (serum or OF) reference standards were generated by rehydrating a lyophilized PRRSV MLV vaccine with serum or OF known to be free of PRRSV. In brief, 45 mL of PRRSV-free serum or OF were centrifuged in 50-mL centrifuge tubes (Nunc; Thermo Scientific) at 3,300 × g for 3 h (IEC Centra CL3 centrifuge; Thermo Fisher). The supernatant was used to rehydrate a 10-dose vial of PRRSV MLV vaccine (Ingelvac PRRS MLV) to a final volume of 20 mL. Thereafter, this solution was 10-fold serially diluted (1 × 10−1 to 1 × 10−6) using the appropriate matrix, and all dilutions were tested in triplicate with the RT-qPCR assay; the dilution that achieved a consistent Cq of 30 for each matrix was chosen (1 × 10−4). Matrix-specific PRRSV reference standards at the selected dilution were included in the extraction and amplification processes such that each plate (40 serum plates; 28 OF plates) included 4 reference standards.

Serum and oral fluid samples

A panel of matched OF and serum samples was created by collecting samples from a study conducted with the approval of the Iowa State University Office of Research Ethics, Institutional Animal Care and Use Committee (IACUC, Log 3-16-8214-S) involving 12 pigs over a period of 50 d (i.e., before and after vaccination with a PRRSV-2 MLV vaccine). 26 In brief, 12 individually housed 14-wk-old PRRSV-naïve pigs were intramuscularly administered a PRRSV-2 MLV vaccine (2 mL, Ingelvac PRRS MLV) at day post-vaccination (dpv) 0. Individual serum samples (n = 132) were collected weekly at dpv −7, 0, 14, 17, 21, 28, 35, and 42. Subsets of pigs (n = 4) were rotated through the sampling schedule to obtain daily serum samples for dpv 3–11. Individual OF samples (n = 130) were collected daily from dpv −7 to 42 by providing each pig access to a 3-strand twisted 100% cotton rope for 30 min. OFs were recovered from the rope and then aliquoted into 5-mL tubes (Corning; Fisher). Serum and OF samples were stored at −80°C until tested. Matrix-specific PRRSV reference standards (n = 4 per plate) were included in each serum and OF plate (n = 8 plates per sample type).

Nucleic acid extraction

Total nucleic acid extraction was performed (RealPCR DNA/RNA spin column kit; Idexx) following the instructions of the manufacturer for the alternative protocol for all sample types. For OFs, 200 µL of OFs were added to 200 µL of a lysis working solution consisting of 190 µL of lysis buffer, 5 µL of carrier RNA, and 5 µL of proteinase K. For sera, 200 µL of serum were mixed with 5 µL of proteinase K, and then 200 µL of a lysis working solution consisting of 195 µL of lysis buffer and 5 µL of carrier RNA. Binding conditions were adjusted with 200 µL of 96% ethanol solution (Thermo Fisher). Thereafter, 600 µL of lysate was transferred to a spin column and washed. Nucleic acids were eluted with 50 µL of elution water pre-heated to 70°C. Every nucleic acid extraction run included 1 positive and 1 negative extraction control and 4 replicates of matrix-specific PRRSV reference standards. All extracts were directly subjected to qPCR.

RT-qPCR

All qPCRs were performed using RealPCR RNA master mix and RealPCR PRRS types 1-2 RNA mix (Idexx). The target mix for PRRSV detects pathogen-specific RNA by a cyanine (Cy) 5 probe and an endogenous pig-specific RNA internal sample control (ISC) by a hexachlorofluorescein (HEX) probe. All RT-qPCRs were performed with 5 µL of nucleic acid extract using tubes compatible with the Mic qPCR system (Bio Molecular Systems) and a magnetic induction cycler (Mic qPCR cycler; Bio Molecular Systems) programmed as: 50°C (15 min) for reverse transcription, denaturation at 95°C (1 min), 45 cycles at 95°C (15 s), followed by 60°C (30 s) for amplification. In addition to extraction controls, every run included an amplification control. Results were analyzed using the Mic qPCR cycler software v.2.10.4 (Bio Molecular Systems).

Amplification efficiency estimates

Estimates of E were calculated using the Mic PCR software (Bio Molecular Systems). Initially, the dynamic analysis feature was applied to the amplification data of the reference standards (n = 4) run on each plate. In brief, the “dynamic” analysis performed a baseline correction by 1) determining the reaction-specific average fluorescence values measured before the start of the exponential phase; 2) defining the linear phase by iteratively searching a fixed number of data points to determine which of these showed exponential growth; and 3) subtracting the values from (1) and (2) to baseline-correct each sample. Thereafter, the software determined the window-of-linearity (WoL) in the exponential phase using the LinRegPCR method.47,49 This process involved setting the upper limit of the WoL at the mean fluorescence level found at the maximum of the second derivative (i.e., the beginning of the linear phase) and downward selecting 4–6 data points from the baseline-corrected fluorescence of each reaction to set the lower limit. Then, an iterative modification was applied to this initial WoL by systematically lowering the data points by half per cycle. For each window, the CV was calculated from the x̄ and the SD of the amplification efficiencies. The minimum CV marked the WoL in which the individual sample amplification efficiencies showed the least variation relative to the mean E. Individual Es were then calculated from the slope of the regression line within the WoL:

E=101/slope1 (2)

These values were displayed in the output for each reference standard as a ratio of 1 (or 100%). Likewise, a cycle threshold was automatically established at 75% of the WoL. The rest of the plate dataset (i.e., samples and controls) were baseline-corrected under the dynamic analysis feature, and the previously obtained cycle threshold was manually set to obtain samples and reference standard Cqs.

Efficiency standardized Cqs

Sample Cqs were converted to ECqs (equation 1) to account for plate-specific Es and to normalize the results relative to matrix-specific reference standards.10,43 E can be expressed either as a ratio (number of target amplicons at the end of a PCR cycle divided by the number at the beginning) or as a percentage. Thus, a doubling at each cycle would represent an E of 2 or 100%. Equation 1 requires that E be expressed as a ratio, which was done by first calculating the plate E (%) from the 4 reference standards and then adding 1 to the arithmetic mean of the 4 reference standards run on each plate. E estimates > 100% were truncated at 100%. ΔCq (sample Cq – mean reference standards Cq) was calculated using the arithmetic mean from the individual Cqs of the plate reference standards (n = 4). For example, a sample with a Cq of 28, run on a plate with a reference standard with mean E of 85% (E = 1.85) and mean Cq of 31, would have an ECq of 6.33 (ECq = E–ΔCq = 1.85–(28–31) = 6.33). ECqs for samples with indeterminate Cqs were assigned a Cq of 45 (i.e., the total number of cycles in the PCR program).

Analysis

All ECq values were transformed to their cube root for the analysis. For illustrative purposes, ROC analyses were conducted (R v.4.2.1., package pROC, https://www.r-project.org/) for each specimen (serum and OF) to estimate the area under the curve (AUC) and the diagnostic specificities and sensitivities for a range of ECq cutoffs. The ROC analyses of the PRRSV RT-qPCR results were based on ECq results for 72 sera and 70 OFs. Samples collected before vaccination (≤ 0 dpv; 24 sera; 24 OFs) were assigned PRRSV-negative status. Samples collected at dpv 3–14 (48 sera; 46 OFs) were assigned PRRSV-positive status. To account for the correlated nature of the data, the nonparametric DeLong method was used to estimate 95% CIs for the AUC. 15 Estimation of 95% CIs for diagnostic sensitivities and specificities was performed using the nonparametric stratified bootstrapping method with 10,000 iterations, in which lower and upper bounds were computed as the 5th and 95th percentiles of the sensitivities or specificities derived from 10,000 iterations. 8

Results

Reference standards

Mean reference standard plate Es were 1.8–2.6 for 40 serum plates and 1.7–2.3 for 28 OF plates. Mean reference standard Cqs were 29.1–31.3 for serum and 29.2–31.5 for OF (Fig. 1).

Figure 1.

Figure 1.

PRRSV RT-qPCR testing results for matrix-specific (serum or oral fluid [OF]) reference standards. Standards were created by rehydrating and diluting (1 × 10−4) a PRRSV modified-live virus vaccine (Ingelvac PRRS MLV; Boehringer Ingelheim) with serum or OF. A. Distribution of mean plate amplification efficiency for serum and OFs. B. Distribution of mean Cqs for serum and OFs. In each case, the means were calculated from the 4 reference standards run on each plate.

PRRSV RT-qPCR

ECqs represent target concentrations of PRRSV RNA in a sample relative to the target concentration in the reference standards included on each qPCR plate. We detected PRRSV RT-qPCR positives on dpv 3–5 in serum (x̄ ECq: 1.39) and OF (x̄ ECq: 1.32) in all pigs. That is, in both serum and OF, the concentration of virus was approximately the same as in the reference standards (Table 1). Thereafter, PRRSV positivity peaked on dpv 7 in serum (x̄ ECq: 2.24) and on dpv 9 in OF (x̄ ECq: 2.00) in all pigs (Fig. 2).

Table 1.

PRRSV RT-qPCR response (geometric mean of 12 pigs) expressed in ECqs and Cqs by day post-vaccination and specimen.

Days post-vaccination Serum Oral fluid
x̄ ECq (SE) x̄ Cq (SE) x̄ ECq (SE) x̄ Cq (SE)
−7 0.05 (0.01) 44.5 (0.50) 0.13 (0.02) 44.6 (0.39)
0 0.03 (0) 45.0 (0) 0.11 (0.02) 44.6 (0.33)
3, 4, 5 1.39 (0.32) 28.9 (0.85) 1.32 (0.21) 33.2 (0.65)
6, 7, 8 2.49 (0.44) 27.3 (0.85) 1.29 (0.19) 31.5 (1.44)
9, 10, 11 1.78 (0.43) 28.0 (0.90) 1.35 (0.47) 32.2 (1.05)
14 1.06 (0.26) 30.2 (0.70) 1.03 (0.18) 33.6 (0.81)
17 0.90 (0.15) 31.0 (0.70) 0.92 (0.26) 33.8 (1.02)
21 0.88 (0.19) 31.0 (0.70) 0.97 (0.14) 33.7 (0.91)
28 0.69 (0.15) 32.6 (0.80) 0.96 (0.17) 33.5 (0.74)
35 0.51 (0.08) 33.6 (1.00) 0.71 (0.10) 35.9 (0.90)
42 0.31 (0.04) 36.9 (0.20) 0.59 (0.05) 37.5 (0.33)

ECq = E–ΔCq, where E is the mean reference standard amplification efficiency (by plate), and ΔCq is the difference in raw Cq values between sample Cq and mean reference standard Cq (E estimates > 100% were truncated at 100% before calculation of ECqs). PRRSV = porcine reproductive and respiratory syndrome virus; RT-qPCR = reverse-transcription quantitative real-time PCR.

Figure 2.

Figure 2.

PRRSV RT-qPCR performance by day post-vaccination (n = 12 pigs). Left y-axis denotes positivity rate (%) based on serum- and oral fluid–specific cutoffs derived from a receiver operating characteristic analysis. Right y-axis denotes numeric response (efficiency standardized Cq [ECq]) based on geometric means of 12 pigs.

The AUCs estimated for serum and OF samples were 0.999 (95% CI: 0.997, 1.000) and 0.947 (0.890, 1.000), respectively. The optimal ECq cutoff for serum (ECq ≥ 0.20) provided a diagnostic sensitivity of 97.9% (95% CI: 93.8%, 100%) and diagnostic specificity of 100% (95% CI: 100%, 100%). For OF, a cutoff of ECq ≥ 0.45 provided a diagnostic sensitivity of 82.6% (95% CI: 71.7%, 93.5%) and diagnostic specificity of 100% (95% CI: 100%, 100%; Table 2).

Table 2.

PRRSV RT-qPCR (RealPCR PRRS Types 1-2 RNA mix; Idexx) diagnostic sensitivity (%) and specificity (%) by specimen and ECq cutoff.

Cutoff (ECq) Serum Oral fluid
Diagnostic sensitivity (95% CI) Diagnostic specificity (95% CI) Diagnostic sensitivity (95% CI) Diagnostic specificity (95% CI)
0.20 97.9 (93.8, 100) 100 (100, 100) 93.5 (84.8, 100) 70.8 (50.0, 87.5)
0.25 97.9 (93.8, 100) 100 (100, 100) 93.5 (84.8, 100) 91.7 (79.2, 100)
0.30 95.8 (89.6, 100) 100 (100, 100) 89.1 (80.4, 97.8) 95.8 (87.5, 100)
0.35 95.8 (89.6, 100) 100 (100, 100) 89.1 (80.4, 97.8) 95.8 (87.5, 100)
0.40 93.8 (85.4, 100) 100 (100, 100) 87.0 (76.1, 95.7) 95.8 (87.5, 100)
0.45 91.7 (83.3, 97.9) 100 (100, 100) 82.6 (71.7, 93.5) 100 (100, 100)
0.50 91.7 (83.3, 97.9) 100 (100, 100) 80.4 (69.6, 91.3) 100 (100, 100)

Diagnostic sensitivity and specificity point estimates derived from ROC analysis (R v.4.2.1, package pROC). ECq = efficiency standardized Cq = Cq values re-expressed as a function of plate amplification efficiency that represent target concentration relative to matrix-specific PRRSV reference standards (ECq values were transformed to their cube root). PRRSV = porcine reproductive and respiratory syndrome virus; RT-qPCR = reverse-transcription quantitative real-time PCR.

Discussion

The introduction of a new diagnostic platform is typically followed by a period of mixed success as researchers explore its capabilities, but over time, the procedures that reliably produce accurate results are identified and adopted. 65 The ELISA is a case in point. Development of ELISA technology was followed by its wholesale application to a variety of infectious diseases and an exploration of the boundaries of the technology. 17 For example, in developing a rubella virus serum antibody ELISA, the response was affected by the type of plastic used in the ELISA plate, conjugate dilutions, and incubation times. 3 This led to a focus on ELISA optimization and standardization. 5

Standardization of qPCR technology has followed a similar path. For example, in an inter-laboratory comparison of 13 influenza A virus RT-qPCR assays using samples of known status, a 100-fold difference was found between the most sensitive and least sensitive assays. 22 However, as predicted, time and the adoption of standardized reagents and protocols have improved qPCR assay consistency. 65 Thus, in a 2022 comparison of 12 African swine fever virus commercial PCRs, mean Cq values were in general agreement. 45

Standardization is crucial to reliable test performance, but normalization is needed to control for the run-to-run variation arising from differences in samples19,61,66,68 and in sample handling and processing,9,24,25,67 as well as from differences among technicians 20 and among manufacturing lots. 6 For ELISAs, normalization was achieved by expressing the sample response (i.e., absorbance values) relative to positive and/or negative reference sera run on the same plate (i.e., sample:positive or sample:negative ratios).14,56 Likewise, methods for normalizing PCR results were developed in the 2000s and are now used routinely in gene expression research.2,12,33,42 We explored a practical method to normalize routine PCR test results.

Normalization of PCR results is necessary to control for variation and produce results that are comparable within and between laboratories. However, unique to PCR, the rate of the reaction (E) is also an important source of variation that must be accounted for in routine testing. In general terms, efficiency is a measure of the performance of a system. 16 In equation 3 of PCR kinetics:

(Nc=N0×Ec), (3)

the relationship between N0 (initial target concentration) and Nc (final target concentration) is a function of E to the power of the number of the cycle (c). 53

It follows that the measure of efficiency is the fraction of target molecules copied in one PCR cycle (i.e., the ratio of Nc:N0, where 2 = 100% efficiency). 31 When PCR results are reported as raw Cqs, it is assumed that E is 100%, but there are both technical and theoretical reasons why this cannot be true. From the laboratory perspective, E is affected by elements specific to the test procedure, including amplicon size, 13 probe chemistry,4,30 plate color, 48 and thermocycler. 58 Further, reaction kinetics modeling has shown that efficiency is not a constant, but varies throughout the amplification phase giving a sigmoidal shape to the process (i.e., ~100% efficiency during the exponential phase and then decreasing until it reaches zero at the plateau phase).21,28,35,36,53,54 Finally, from the perspective of thermodynamics, a PCR reaction is an isolated and irreversible system that tends towards equilibrium when a single-stranded target is denatured, hybridized, and polymerized to the double-stranded state.39,52 Throughout the PCR reaction, energy is released to the environment, which means that efficiency must be < 100%.41,70 Ultimately, failure to account for E is a critical oversight because of the impact of E on Nc. For example, based on equation 3 and under ceteris paribus conditions, a test sample with an initial concentration of 1 × 102 (= 100) copies (N0) amplified with an efficiency of 100% (E = 2) will produce 1 × 106.52 = 3,276,800 copies (Nc) after 15 cycles of amplification (c = 15). However, if efficiency is 80% (E = 1.80), Nc = 1 × 105.38 = 674,664 copies. That is, a 0.2 reduction in E would result in ~79% reduction in the number of target copies.

In qPCR assays, normalization can be done using either absolute or relative quantification. Absolute quantification is done by constructing a calibration curve using a reference standard of known concentration and then estimating the concentration of the target in the sample by interpolation. 50 Because differences in PCR efficiency result in calibration curves with different slopes, for absolute quantification to be reliable, a calibration curve must be generated concurrently with the sample, thereby making it unmanageable for most service laboratories.7,50,55,59 Alternatively, relative quantification is achieved by expressing the sample Cq as the fold difference relative to the Cq of the reference standard run on the same plate. 23 Unlike absolute quantification, it is not necessary to establish the target concentration in the reference standard, which makes it a practical option for routine qPCR testing in service laboratories.

For both absolute and relative quantification, specific criteria for reference standards have been described23,44,69:

  1. The standard should be pure, stable, and reproducible.

  2. Inherent Es in the sample and the standard should be equivalent.

  3. The amplification characteristics of the matrix in which the standard is suspended should resemble the sample matrix.

  4. The reference standard should be amplified concurrently with the test samples.

We generated reference standards by rehydrating a commercial PRRSV vaccine with the matrix corresponding to the specimens to be tested (i.e., serum or OF free of PRRSV), and including the reference standard on each plate in quadruplicate. This approach was a practical solution to the problem of identifying a reference standard that met the requirements listed above and was likewise widely available to service laboratories performing PRRSV RT-qPCR assays:

  1. Each commercial vaccine manufacturing serial produced in the United States and the European Union must meet sterility, purity, safety, and potency standards given in Title 9 §113.6 of the U.S. Code of Federal Regulations and the European Union Regulation (EU) 2019/6.18,63,69

  2. The requirement for equivalent inherent E was satisfied by using the same target (PRRSV RNA) in both the sample and the reference standard.

  3. Requirement 3 was addressed by rehydrating the vaccine with the specimen matrix (i.e., serum or OF, as recommended by others 11 ).

  4. Concurrent amplification of reference standards and test samples was done by including 4 technical replicates of the reference standard on each qPCR plate.

Notably, positive extraction controls and positive amplification controls consisting of non-native target suspended in a synthetic matrix do not meet the criteria and, therefore, are not appropriate reference standards.

The 2 most common approaches to relative quantification are the double-delta Cq (ΔΔCq) 38 and ECqs.10,43 These 2 approaches differ most importantly in that the ΔΔCq method assumes that E is 100%, whereas the ECq adjusts for actual E. Given the impact of E on Nc (final target concentration), the ECq methodology is preferable and was used in our study. E may be calculated by linear regression analysis of the exponential phase fluorescence data,47,49 from the slope of the standard curve,50,57 or through mathematical model-fitting.37,51,62 We obtained plate-specific estimates of E from the exponential phase of the amplification curve of the plate reference standards using the LinRegPCR method. 47 This approach did not include data from the initial or terminal ends of the amplification curve and, therefore, could produce E estimates > 100%.21,23 Following the fundamentals of E described earlier, E cannot be > 100% and thus, plate E estimates > 100% were truncated at 100% prior to the calculation of ECqs.

ECqs represent a semiquantitative measure of target concentration relative to the reference standards, and their interpretation is simple: the larger the ECq value, the more nucleic acid there is in the sample relative to the reference standard (e.g., an ECq of 13.5 means that the target concentration in the sample was 13.5 times the concentration of target in the reference standard). Further, accounting for E produces values with distinct differences that would be otherwise unnoticeable as Cqs. For example, the serum response at dpv 17 and dpv 21 produced the same raw Cq of 31, whereas when converted to ECq, dpv 17 and dpv 21 ECqs were 0.90 and 0.88, respectively. In practice, these differences could be of significance for classifying sample results as positive or negative based on a statistically valid cutoff. Thus, our PRRSV ECq estimates were consistent with the reported dynamics of PRRSV over time (i.e., high RT-qPCR positivity rates in serum and OF in the first week post–PRRSV-inoculation or -vaccination, followed by a gradual decline thereafter).27,34,46

There are several benefits to converting Cqs to ECqs. ECqs produce test results that are normalized by accounting for differences in Es among plates. Thus, results obtained within one laboratory or between several laboratories using the same reference standard are comparable. Strictly speaking, this general approach to test data normalization is already in use (e.g., ELISAs, with reference standards provided by the manufacturers and normalization calculations automated within the testing software). Additionally, ECqs also provide a solution to the problem of estimating qPCR test performance. That is, when converted to ECqs, all samples (including samples with Cq values greater than the cutoff) have a numeric value. Thus, test performance can be evaluated using well-established statistical techniques (e.g., ROC analysis, as was done in our illustration). Overall, we demonstrated that PCR normalization could be achieved using a simple, practical method and with immediate benefits to our clients.

Acknowledgments

PCR reagents were kindly provided by Idexx Laboratories.

Footnotes

The authors declared no conflicts of interest with respect to their authorship and/or the publication of this manuscript, with the exception that Jeffrey Zimmerman, who serves as a consultant to Idexx Laboratories. The terms of the consulting arrangement have been reviewed and approved by Iowa State University in accordance with its conflict-of-interest policies.

Funding: Betsy Armenta-Leyva received financial support from Consejo Nacional de Ciencia y Tecnología (México), Becas CONACYT-Regional Noroeste 2020.

Contributor Information

Betsy Armenta-Leyva, Department of Veterinary Diagnostic and Production Animal Medicine, College of Veterinary Medicine, Lloyd Veterinary Medical Center, Iowa State University, Ames, IA, USA.

Berenice Munguía-Ramírez, Department of Veterinary Diagnostic and Production Animal Medicine, College of Veterinary Medicine, Lloyd Veterinary Medical Center, Iowa State University, Ames, IA, USA.

Ting-Yu Cheng, Department of Veterinary Preventive Medicine, College of Veterinary Medicine, the Ohio State University, Columbus, OH, USA.

Fangshu Ye, Department of Statistics, College of Liberal Arts and Sciences, Iowa State University, Ames, IA, USA.

Alexandra Henao-Díaz, Pig Improvement México, Santiago de Querétaro, Querétaro, México.

Luis G. Giménez-Lirola, Department of Veterinary Diagnostic and Production Animal Medicine, College of Veterinary Medicine, Lloyd Veterinary Medical Center, Iowa State University, Ames, IA, USA

Jeffrey Zimmerman, Department of Veterinary Diagnostic and Production Animal Medicine, College of Veterinary Medicine, Lloyd Veterinary Medical Center, Iowa State University, Ames, IA, USA.

References

  • 1. Banda M, et al. Evaluation and validation of housekeeping genes in response to ionizing radiation and chemical exposure for normalizing RNA expression in real-time PCR. Mutat Res 2008;649:126–134. [DOI] [PubMed] [Google Scholar]
  • 2. Bas A, et al. Utility of the housekeeping genes 18s rRNA, β-actin and glyceraldehyde-3-phosphate-dehydrogenase for normalization in real-time quantitative reverse transcriptase-polymerase chain reaction analysis of gene expression in human T lymphocytes. Scand J Immunol 2004;59:566–573. [DOI] [PubMed] [Google Scholar]
  • 3. Bidwell DE, et al. Enzyme immunoassays for viral diseases. J Infect Dis 1977;136(Suppl 2):S274–S278. [DOI] [PubMed] [Google Scholar]
  • 4. Buh Gašparič M, et al. Comparison of nine different real-time PCR chemistries for qualitative and quantitative applications in GMO detection. Anal Bioanal Chem 2010;396:2023–2029. [DOI] [PubMed] [Google Scholar]
  • 5. Bullock SL, Walls KW. Evaluation of some of the parameters of the enzyme-linked immunospecific assay. J Infect Dis 1977;136(Suppl):S279–S285. [DOI] [PubMed] [Google Scholar]
  • 6. Bushon RN, et al. Statistical assessment of DNA extraction reagent lot variability in real-time quantitative PCR. Lett Appl Microbiol 2010;50:276–282. [DOI] [PubMed] [Google Scholar]
  • 7. Bustin SA, et al. The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem 2009;55:611–622. [DOI] [PubMed] [Google Scholar]
  • 8. Carpenter J, Bithell J. Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat Med 2000;19:1141–1164. [DOI] [PubMed] [Google Scholar]
  • 9. Cassidy H, et al. The importance of set up time and temperature in real-time PCR; an essential reminder. J Virol Methods 2017;243:138–141. [DOI] [PubMed] [Google Scholar]
  • 10. Cheng T-Y, et al. Pseudorabies (Aujeszky’s disease) virus DNA detection in swine nasal swab and oral fluid specimens using a gB-based real-time quantitative PCR. Prev Vet Med 2021;189:105308. [DOI] [PubMed] [Google Scholar]
  • 11. Colling A, Gardner I. Principles of validation of diagnostic assay for infectious diseases, chapter 1.1.6. In: Manual of Diagnostic Tests and Vaccines for Terrestrial Animals. 12th ed. World Organisation for Animal Health, 2023:1–27. [Google Scholar]
  • 12. de Kok JB, et al. Normalization of gene expression measurements in tumor tissues: comparison of 13 endogenous control genes. Lab Invest 2005;85:154–159. [DOI] [PubMed] [Google Scholar]
  • 13. Debode F, et al. The influence of amplicon length of real-time PCR results. Biotechnol Agron Soc Environ 2017;21:3–11. [Google Scholar]
  • 14. Decker RH, et al. Diagnosis of acute hepatitis A by HAVAB-M, a direct radioimmunoassay for IgM anti-HAV. Am J Clin Pathol 1981;76:140–147. [DOI] [PubMed] [Google Scholar]
  • 15. DeLong ER, et al. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988;44:837–845. [PubMed] [Google Scholar]
  • 16. Dincer I, Bicer Y. Integrated Energy Systems for Multigeneration. Elsevier, 2019:33–83. [Google Scholar]
  • 17. Engvall E, Perlmann P. Enzyme-linked immunosorbent assay (ELISA). Quantitative assay of immunoglobulin G. Immunochemistry 1971;8:871–874. [DOI] [PubMed] [Google Scholar]
  • 18. European Parliament and Council of the European Union. Regulation (EU) 2019/6 of the European Parliament and of the council of 11 December 2018 on veterinary medicinal products and repealing directive 2008/82/EC. Off J Eur Union, 2022. [cited 2023 Apr 10]. http://data.europa.eu/eli/reg/2019/6/2022-01-28
  • 19. Fleige S, et al. Comparison of relative mRNA quantification models and the impact of RNA integrity in quantitative real-time RT-PCR. Biotechnol Lett 2006;28:1601–1613. [DOI] [PubMed] [Google Scholar]
  • 20. Garver KA, et al. Development and validation of a reverse transcription quantitative PCR for universal detection of viral hemorrhagic septicemia virus. Dis Aquat Organ 2011;95:97–112. [DOI] [PubMed] [Google Scholar]
  • 21. Gevertz JL, et al. Mathematical model of real-time PCR kinetics. Biotechnol Bioeng 2005;92:346–355. [DOI] [PubMed] [Google Scholar]
  • 22. Goodell CK, et al. Ring test evaluation of the detection of influenza A virus in swine oral fluids by real-time reverse-transcription polymerase chain reaction and virus isolation. Can J Vet Res 2016;80:12–20. [PMC free article] [PubMed] [Google Scholar]
  • 23. Green MR, Sambrook J. Molecular Cloning: A Laboratory Manual. 4th ed. Vol. 1. Cold Spring Harbor Laboratory Press, 2012:455–540. [Google Scholar]
  • 24. Griffiths LJ, et al. Comparison of DNA extraction methods for Aspergillus fumigatus using real-time PCR. J Med Microbiol 2006;55:1187–1191. [DOI] [PubMed] [Google Scholar]
  • 25. Hayden RT, et al. Factors contributing to variability of quantitative viral PCR results in proficiency testing samples: a multivariate analysis. J Clin Microbiol 2012;50:337–345. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Henao-Diaz A, et al. Evaluation of three commercial porcine reproductive and respiratory syndrome virus (PRRSV) oral fluid antibody ELISAs using samples of known status. Res Vet Sci 2019;125:113–118. [DOI] [PubMed] [Google Scholar]
  • 27. Henao-Diaz A, et al. Understanding and interpreting PRRSV diagnostics in the context of “disease transition stages”. Res Vet Sci 2020;131:173–176. [DOI] [PubMed] [Google Scholar]
  • 28. Jagers P, Klebaner F. Random variation and concentration effects in PCR. J Theor Biol 2003;224:299–304. [DOI] [PubMed] [Google Scholar]
  • 29. Jeggo MH. An international approach to laboratory diagnosis of animal diseases. Ann N Y Acad Sci 2000;916:213–221. [DOI] [PubMed] [Google Scholar]
  • 30. Josefsen MH, et al. Diagnostic PCR: comparative sensitivity of four probe chemistries. Mol Cell Probes 2009;23:201–203. [DOI] [PubMed] [Google Scholar]
  • 31. Kalle E, et al. Multi-template polymerase chain reaction. Biomol Detect Quantif 2014;2:11–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Karvanen J. The statistical basis of laboratory data normalization. Drug Inf J 2003;37:101–107. [Google Scholar]
  • 33. Kim B-R, et al. Normalization of reverse transcription quantitative-PCR with housekeeping genes in rice. Biotechnol Lett 2003;25:1869–1872. [DOI] [PubMed] [Google Scholar]
  • 34. Kittawornrat A, et al. Porcine reproductive and respiratory syndrome virus (PRRSV) in serum and oral fluid samples from individual boars: will oral fluid replace serum for PRRSV surveillance? Virus Res 2010;154:170–176. [DOI] [PubMed] [Google Scholar]
  • 35. Lalam N, et al. Estimation of the PCR efficiency based on a size-dependent modelling of the amplification process. C R Acad Sci Paris Ser I 2005;341:631–634. [Google Scholar]
  • 36. Lalam N, et al. Modelling the PCR amplification process by a size-dependent branching process and estimation of the efficiency. Adv Appl Prob 2004;36:602–615. [Google Scholar]
  • 37. Liu W, Saint DA. A new quantitative method of real time reverse transcription polymerase chain reaction based on simulation of polymerase chain reaction kinetics. Anal Biochem 2002;302:52–59. [DOI] [PubMed] [Google Scholar]
  • 38. Livak KJ, Schmittgen TD. Analysis of relative gene expression data using real-time quantitative PCR and the 2-ΔΔCT method. Methods 2001;25:402–408. [DOI] [PubMed] [Google Scholar]
  • 39. Mann T, et al. A thermodynamic approach to PCR primer design. Nucleic Acids Res 2009;37:e95. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Mar JC, et al. Data-driven normalization strategies for high-throughput quantitative RT-PCR. BMC Bioinformatics 2009;10:110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. Michaelian K. Non-equilibrium thermodynamic foundations of the origin of life. Foundations 2022;2:308–337. [Google Scholar]
  • 42. Ohl F, et al. Gene expression studies in prostate cancer tissue: which reference gene should be selected for normalization? J Mol Med (Berl) 2005;83:1014–1024. [DOI] [PubMed] [Google Scholar]
  • 43. Pfaffl MW. A new mathematical model for relative quantification in real-time RT-PCR. Nucleic Acids Res 2001;29:e45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44. Pfaffl MW. Quantification strategies in real-time PCR. In: Bustin SA, ed. A-Z of Quantitative PCR. IUL, 2004:87–112. [Google Scholar]
  • 45. Pikalo J, et al. Performance characteristics of real-time PCRs for African swine fever virus genome detection—comparison of twelve kits to an OIE-recommended method. Viruses 2022;14:220. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46. Prickett J, et al. Detection of porcine reproductive and respiratory syndrome virus infection in porcine oral fluid samples: a longitudinal study under experimental conditions. J Vet Diagn Invest 2008;20:156–163. [DOI] [PubMed] [Google Scholar]
  • 47. Ramakers C, et al. Assumption-free analysis of quantitative real-time polymerase chain reaction (PCR) data. Neurosci Lett 2003;339:62–66. [DOI] [PubMed] [Google Scholar]
  • 48. Reiter M, Pfaffl MW. Effects of plate position, plate type and sealing systems on real-time PCR results. Biotechnol Biotechnol Equip 2008;22:824–828. [Google Scholar]
  • 49. Ruijter JM, et al. Amplification efficiency: linking baseline and bias in the analysis of quantitative PCR data. Nucleic Acids Res 2009;37:e45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Rutledge RG, Côté C. Mathematics of quantitative kinetic PCR and the application of standard curves. Nucleic Acids Res 2003;31:e93. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Rutledge RG, Stewart D. A kinetic-based sigmoidal model for the polymerase chain reaction and its application to high-capacity absolute quantitative real-time PCR. BMC Biotechnol 2008;8:47. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. SantaLucia J., Jr. Physical principles and visual-OMP software for optimal PCR design. Methods Mol Biol 2007;402:3–34. [DOI] [PubMed] [Google Scholar]
  • 53. Schnell S, Mendoza C. Enzymological considerations for a theoretical description of the quantitative competitive polymerase chain reaction (QC-PCR). J Theor Biol 1997;184:433–440. [DOI] [PubMed] [Google Scholar]
  • 54. Schnell S, Mendoza C. Theoretical description of the polymerase chain reaction. J Theor Biol 1997;188:313–318. [DOI] [PubMed] [Google Scholar]
  • 55. Sivaganesan M, et al. Improved strategies and optimization of calibration models for real-time PCR absolute quantification. Water Res 2010;44:4726–4735. [DOI] [PubMed] [Google Scholar]
  • 56. Snyder ML, et al. An improved enzyme-linked immunosorbent assay for the serodiagnosis of pseudorabies infection. In: Proc 28th Annual Amer Assoc Vet Lab Diagn; Milwaukee, WI; 1985:383–395. [Google Scholar]
  • 57. Ståhlberg A, et al. Quantitative real-time PCR method for detection of B-lymphocyte monoclonality by comparison of κ and λ immunoglobulin light chain expression. Clin Chem 2003;49:51–59. [DOI] [PubMed] [Google Scholar]
  • 58. Svec D, et al. How good is a PCR efficiency estimate: recommendations for precise and robust qPCR efficiency assessments. Biomol Detect Quantif 2015;3:9–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59. Tani H, et al. Calibration-curve-free quantitative PCR: a quantitative method for specific nucleic acid sequences without using calibration curves. Anal Biochem 2007;369:105–111. [DOI] [PubMed] [Google Scholar]
  • 60. Tate JR, et al. Harmonization of laboratory testing—current achievements and future strategies. Clin Chim Acta 2014;432:4–7. [DOI] [PubMed] [Google Scholar]
  • 61. Taylor SC, et al. The ultimate qPCR experiment: producing publication quality, reproducible data the first time. Trends Biotechnol 2019;37:761–774. [DOI] [PubMed] [Google Scholar]
  • 62. Tichopad A, et al. Standardized determination of real-time PCR efficiency from a single reaction set-up. Nucleic Acids Res 2003;31:e122. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63. U.S. Department of Agriculture. Animal and plant health inspection service testing, 9 CFR part 113.6, 1991 Dec 26. [cited 2023 Apr 10]. https://www.ecfr.gov/current/title-9/section-113.6
  • 64. Vesper HW, et al. Current practices and challenges in the standardization and harmonization of clinical laboratory tests. Am J Clin Nutr 2016;104(Suppl 3):907S–912S. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65. Wadsworth AB. Standardization of laboratory methods. Am J Public Health (N Y) 1920;10:932–935. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66. Whale AS, et al. Digital PCR can augment the interpretation of RT-qPCR Cq values for SARS-CoV-2 diagnostics. Methods 2022;201:5–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67. White PL, et al. Aspergillus PCR: one step closer to standardization. J Clin Microbiol 2010;48:1231–1240. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68. Willems E, et al. Standardization of real-time PCR gene expression data from independent biological replicates. Anal Biochem 2008;379:127–129. [DOI] [PubMed] [Google Scholar]
  • 69. WOAH ad hoc group on Validation of Diagnostic Assays. Selection and use of reference samples and panels. In: Manual of Diagnostic Tests and Vaccines for Terrestrial Animals. 8th ed. World Organisation for Animal Health, 2018:222–230. [Google Scholar]
  • 70. Zhang Y. The efficiency of molecular motors. J Stat Phys 2009;134:669–679. [Google Scholar]

Articles from Journal of Veterinary Diagnostic Investigation : Official Publication of the American Association of Veterinary Laboratory Diagnosticians, Inc are provided here courtesy of SAGE Publications

RESOURCES