Skip to main content
Springer logoLink to Springer
. 2023 May 26;415(16):3265–3274. doi: 10.1007/s00216-023-04705-8

Estimation of measurement uncertainty for the quantification of protein by ID-LC–MS/MS

Ashley Beasley-Green 1,, N Alan Heckert 2
PMCID: PMC10287794  PMID: 37231301

Abstract

The emergence of mass spectrometry (MS)-based methods to quantify proteins for clinical applications has led to the need for accurate and consistent measurements. To meet the clinical needs of MS-based protein results, it is important that the results are traceable to higher-order standards and methods and have defined uncertainty values. Therefore, we outline a comprehensive approach for the estimation of measurement uncertainty of a MS-based procedure for the quantification of a protein biomarker. Using a bottom-up approach, which is the model outlined in the “Guide to the Expression of Uncertainty of Measurement” (GUM), we evaluated the uncertainty components of a MS-based measurement procedure for a protein biomarker in a complex matrix. The cause-and-effect diagram of the procedure is used to identify each uncertainty component, and statistical equations are derived to determine the overall combined uncertainty. Evaluation of the uncertainty components not only enables the calculation of the measurement uncertainty but can also be used to determine if the procedure needs improvement. To demonstrate the use of the bottom-up approach, the overall combined uncertainty is estimated for the National Institute of Standards and Technology (NIST) candidate reference measurement procedure for albumin in human urine. The results of the uncertainty approach are applied to the determination of uncertainty for the certified value for albumin in candidate NIST Standard Reference Material® (SRM) 3666. This study provides a framework for measurement uncertainty estimation of a MS-based protein procedure by identifying the uncertainty components of the procedure to derive the overall combined uncertainty.

Graphical Abstract

graphic file with name 216_2023_4705_Figa_HTML.jpg

Supplementary Information

The online version contains supplementary material available at 10.1007/s00216-023-04705-8.

Keywords: Measurement uncertainty, Isotope-dilution liquid chromatography-tandem mass spectrometry (ID-LC–MS/MS), Albumin, Design of experiments (DOE), Reference measurement procedure (RMP), Standard Reference Material® (SRM)

Introduction

Mass spectrometry (MS)–based quantitative proteomics has emerged as an important tool used in clinical laboratories for the evaluation of clinical protein biomarkers for disease diagnosis and management. Therefore, the accuracy and comparability of these MS-based protein results are essential for healthcare practitioners to provide precise and consistent clinical decisions for patient care. To anchor the clinical utility of MS-based protein measurements, it is of utmost importance that protein results are traceable to higher-order standards and methods and have defined uncertainty values. Measurement uncertainty as defined in the International Vocabulary of Metrology (VIM) is a “parameter, associated with the result of a measurement, that characterizes the dispersion of the values that could reasonably be attributed to the measurand” [1]. Estimating the measurement uncertainty of MS-based protein results is essential to understand the impact of uncertainty on (1) the measurement results and (2) the suitability of the results for clinical decisions. The objective of this study is to provide a comprehensive assessment of measurement uncertainty for a procedure that applies isotope dilution-liquid chromatography-tandem MS (ID-LC–MS/MS) for the quantification of a protein biomarker in a clinical matrix. This is the first paper to outline, in detail, the individual uncertainty components that contribute to the overall combined uncertainty of a MS-based measurement procedure for protein quantification. The “Guide to the Expression of Uncertainty of Measurement” (GUM) [2], which establishes the guidelines for evaluating and expressing measurement uncertainty, is applied to identify and quantify the individual uncertainty sources of a MS-based protein procedure that contribute to the overall combined uncertainty. The model proposed in the GUM is termed, in application, the bottom-up approach [3, 4]. In this study, we evaluate the measurement uncertainty of the NIST candidate reference measurement procedure (RMP), which incorporates ID-LC–MS/MS for the quantification of albumin in human urine [5]. The NIST candidate RMP is based on the detection and measurement of signature proteotypic (typically trypsin) peptides that uniquely and stoichiometrically represent albumin [5]. An intact, full-length isotopically labeled (15N-labeled) recombinant albumin protein is incorporated in the measurement procedure as an internal standard (IS) for the absolute quantification of albumin in urine [5]. The procedure couples ID-LC–MS/MS with the multiple reaction monitoring (MRM) MS scan mode to selectively target signature tryptic albumin peptides. The ratio of unlabeled analyte to 15N-labeled IS is used to generate a calibration curve for the determination of albumin in a urine sample. In accordance with the bottom-up approach [24], a cause-and-effect diagram of the NIST candidate RMP is used to identify the sources of uncertainty and statistical models are applied to estimate the overall combined uncertainty. The results of the measurement uncertainty assessment are used to determine the overall combined uncertainty of the certified value for albumin content in candidate NIST Standard Reference Material® (SRM) 3666, which will be used to establish metrological traceability for routine clinical results of albumin in urine and enhance the accuracy and confidence of clinical decisions for kidney disease.

This study provides a framework for the comprehensive assessment of the individual uncertainty components that contribute to the measurement uncertainty of a MS-based protein quantitative procedure.

Materials and methods

Chemicals

NIST SRM 2925 Recombinant Human Serum Albumin Solution (Primary Reference Calibrator for Urine Albumin) (Frozen), candidate SRM 3666 Albumin and Creatinine in Frozen Human Urine, full-length 15N-labeled recombinant human serum albumin (rHSA) IS (Albumin Biosciences; Huntsville, AL), 99% label incorporation determined via LC–MS/MS analysis (see Electronic Supplementary Material, Table S1 and Fig. S1), Trypsin-Gold MS-grade (Promega, Madison, WI, USA), Dithiothreitol (DTT, Pierce), Iodoacetamide (IAM, Pierce), high-purity LC–MS-grade water/0.1% (volume fraction), formic acid and acetonitrile (ACN)/0.1% (volume fraction) formic acid (Honeywell Burdick and Jackson).

Sample preparation

Preparation of the calibration solutions, quality control material, and candidate SRM 3666 samples is outlined in detail in ref. [5] and illustrated in Fig. 1a. To prepare the calibration and quality control (QC) solutions, stock and working solutions are gravimetrically prepared using SRM 2925 (unlabeled analyte) and an isotopically labeled IS (15N-labeled recombinant HSA). Multiple vials of candidate SRM 3666 (level 1 to level 4) are randomly selected from the material lot. Prior to trypsin digestion, the IS is added to each process sample and each analysis set consists of calibrants, QCs, and candidate SRM 3666 process samples for each level. The process samples are allowed to solubilize overnight at 4°C prior to trypsin digestion.

Fig. 1.

Fig. 1

Detailed protocol for NIST candidate RMP [5] (a) (see “Methods” section for more details) and the cause-and-effect diagram of measurement procedure (b)

Protein digestion

The enzymatic (trypsin) protein digestion protocol is outlined in ref. [5]. Each analysis set (calibrants, QCs, and candidate SRM 3666 samples) is incubated at 97°C for 10 min to denature albumin and cooled to room temperature (RT; ≈25°C). The samples are reduced with 5 mmol/L dithiothreitol at 60°C for 30 min, followed by alkylation with 15 mmol/L iodoacetamide at RT for 30 min in the dark. An approximate 1:30 mass ratio of trypsin-to-total protein is used for digestion, and the digestion reaction is conducted at 37°C for 24 h. Following digestion, the pH of the samples is reduced with 50 mL/L formic acid in water and incubated for 45 min at 37°C to quench the digestion reaction. The samples are concentrated (no heat) overnight and resuspended in 100 µL of 0.1% (volume fraction) formic acid in water the next day for tandem MS analysis.

LC–MS/MS analysis

Analysis of the digested samples is performed on an Agilent 6460 triple quadrupole mass spectrometer in positive ion mode equipped with an Agilent 1290 Series LC system utilizing an Agilent Zorbax 300 SB-C18 column (2.1 mm × 150 mm, 3.5 μm). The column temperature is maintained at 45°C, and the peptides were loaded onto the column at a flow rate of 200 μL/min in 97% (volume fraction) mobile phase A (water with 1 mL/L formic acid) and 3% (volume fraction) mobile phase B (ACN with 1 mL/L formic acid). General mass spectrometric conditions: gas temperature of 300°C; gas flow of 7 L/min; nebulizer of 20 psi (1.4 × 105 Pa); sheath gas temperature of 300°C; sheath gas flow of 6 L/min; capillary voltage of 4000 V; and a nozzle voltage of 1500 V. Analysis of the process samples is conducted in a randomized sequence with replicate measurements to reduce influence of systematic bias on the output measurements.

Quantitative method

Integration of chromatographic peaks for both the unlabeled albumin and IS is performed using the Agilent MassHunter Quantitative Analysis software (Version B.10.00). All peak integrations were manually confirmed and corrected, as needed. A total of 46 measurements (11 peptides with 2 or 3 MRM transitions per peptide) are collected for the 23 MRM transitions in each sample. Peak areas from MassHunter integration are imported to Microsoft Excel for manual quantitative assessment of the raw data. The peak area and concentration ratios of the calibration solutions are used to generate a linear calibration curve for each transition and the albumin content of the quality control and candidate SRM 3666 samples is determined from the calibration curves.

Design of experiments (DOE) assessment

The DOE optimization study is applied to statistically determine the optimal trypsin digestion conditions for albumin, to reduce the uncertainty of the candidate RMP. In addition to reducing the uncertainty, the study is used to minimize the number of MRM transitions used for quantitative assessment of albumin in urine. The central composite design (CCD) of the DOE optimization study is composed of a full-factorial matrix with the following parameters: a three-factor design (23; X1, trypsin-to-protein ratio; X2, digestion reaction time; X3, digestion reaction temperature), five (5) levels per factor, two (2) center points with six (6) replicates, and six (6) star points (± α) (see Experimental Supplemental Material, Table S2). The value for α in the three-factor design is 1.684, using α = [2 k]1/4, where k is 3 for the number of factors. The raw peak area measurements of the MRM transitions from the DOE optimization study are used to generate the z-score maps for SRM 2925 (unlabeled) and the IS (15N-labeled) (Fig. 2).

Fig. 2.

Fig. 2

Z-score map of the DOE optimization study results (n = 8) for 23 MRM transitions (unlabeled SRM 2925 (a) and 15N-labeled IS (b)) for trypsin digestion process in NIST candidate RMP [5] for quantification of albumin in urine (*denotes the qt-MRM transitions)

Measurement uncertainty

Estimation of measurement uncertainty is performed in accordance with the GUM [2]. Of the six steps involved in calculating measurement uncertainty, the following steps are applied: specification of the measurand; identification of uncertainty components; quantifying uncertainty; calculating the combined uncertainty; and calculating the expanded uncertainty. The measurand is expressed as a mathematical equation based on the experimental measurement procedure and the cause-and-effect diagram is used to identify the uncertainty sources. The uncertainties of individual components are evaluated and quantified using analytical data. The NIST DATAPLOT [6, 7] software, a public-domain statistical analysis software package, is used for the consensus means analysis and calculation of the type A uncertainty (DSL-HHD and DSL-bootstrap).

Results and discussion

The NIST candidate RMP, a MS-based quantitative procedure for albumin in urine, is used to illustrate how the bottom-up approach [24] can be applied for the determination of overall combined uncertainty for a MS-based measurement procedure.

Specification of measurand

A total of 23 MRM transitions (11 MRM peptides with 2 to 3 MRM transitions/peptide) are used in the NIST candidate RMP for albumin quantification in urine [5] (Table 1). The measurand for the candidate RMP is the consensus mass concentration (X¯¯mg/L) value of albumin in urine determined by combining replicate measurements of each MRM transition. Calculation of X¯¯mg/L is a multistep process, with the first step being the determination of the mass fraction (Xmg/g) for each MRM transition. The following equation is used to calculate the albumin mass fraction (Xmg/g) result for a given MRM transition (t1-MRM transition, Xt1mg/g):

Xt1mg/g=c0,tWt 1

where c0,t is the t1-MRM transition concentration ratio (mass of urine sample to mass of 15N-labeled IS) derived from the linear calibration curve of t1-MRM transition. Wt is the mass fraction of the IS to urine material mass. The density and concentration of the IS are used for mass unit conversion. The Wt component in Eq. 1 is derived from:

Wt=mISdIS×CISmU×1000, 2

where mIS is the mass of the IS, dIS is the density of the IS, CIS is the mass concentration of the IS, and mU is the mass of the unknown urine sample. Because the concentration ratio (c0,t) is derived from the calibration curve of t1-MRM transition, Xt1mg/g (mass fraction) is also given as:

Xt1mg/g=PARt-B0,tB1,t×1Wt, 3

where PARt is the t1-MRM transition peak area ratio (unlabeled t1-MRM transition in urine sample to IS t1-MRM transition, 15N-labeled IS) and B0,t and B1,t represent the y-intercept and the slope of the linear calibration curve for T1, respectively. The consensus mass fraction value (X¯¯mg/g) is calculated by combining the Xt,mg/g values for the MRM transitions using consensus mean analysis via the DerSimonian-Laird (DSL) model (random-effects model) [8, 9]:

yij=μ+mi+εiji=1,2,nmm;j=1,2,,ni 4

where i indexes the MRM peptide, j indexes the number of replicates within a given MRM peptide, nmm represents the number of MRM peptides, ni represents the number of replicates within a given MRM peptide, μ represents the grand mean for all MRM peptides/transitions, mi represents the mean of given MRM peptide (relative to grand mean), and εij represents variance between the MRM peptides. The final step in the determination of albumin in urine is the calculation of the consensus mass concentration (X¯¯mg/L) from X¯¯mg/g and the density of the urine material (durine×1000):

X¯¯mg/L=X¯¯mg/g×durine×1000 5

Table 1.

MRM transition list for quantification of albumin in urine using NIST candidate RMP [5]

Peptide type—Qt or Qaa MRM transition number Peptide Precursor m/z Product m/z IS precursor m/z IS product m/z
Qt Transition 3 TYETTLEK 492.75 720.30 497.23 727.40
Qt Transition 7 VFDEFKPLVEEPQNLIK 682.37 900.00 689.35 909.50
Qt Transition 9 FQNALLVR 480.78 685.40 487.27 695.40
Qt Transition 18 LCTVATLR 467.26 660.40 472.75 669.40
Qt Transition 20 YLYEIAR 464.25 651.30 469.24 659.30
Qa Transition 1 DLGEENFK 476.22 723.3 481.21 731.30
Qa Transition 2 DLGEENFK 476.22 229.07 481.21 231.07
Qa Transition 4 TYETTLEK 492.75 265.10 497.23 279.20
Qa Transition 5 VFDEFKPLVEEPQNLIK 682.37 970.50 689.35 981.50
Qa Transition 6 VFDEFKPLVEEPQNLIK 682.37 712.40 689.35 721.37
Qa Transition 8 FQNALLVR 480.78 276.09 487.27 279.09
Qa Transition 10 QTALVELVK 500.81 488.27 506.29 493.25
Qa Transition 11 QTALVELVK 500.81 587.30 506.29 593.40
Qa Transition 12 RPCFSALEVDETYVPK 637.65 961.50 644.30 972.40
Qa Transition 13 RPCFSALEVDETYVPK 637.65 244.17 644.30 247.16
Qa Transition 14 LVAASQAALGL 507.30 189.08 513.29 191.08
Qa Transition 15 LVAASQAALGL 507.30 712.40 513.29 721.40
Qa Transition 16 LVNEVTEFAK 575.31 937.40 581.29 947.40
Qa Transition 17 LVNEVTEFAK 575.31 694.40 581.29 701.40
Qa Transition 19 LCTVATLR 467.26 274.12 472.75 276.12
Qa Transition 21 YLYEIAR 464.25 277.2 469.24 279.10
Qa Transition 22 AEFAEVSK 440.72 201.05 445.21 203.04
Qa Transition 23 AEFAEVSK 440.72 680.32 445.21 687.30

m/z mass-to-charge ratio, IS internal standard

aThe “Peptide type” differentiates the quantitative (Qt) and qualitative (Qa) MRM transitions and the five Qt-MRM transitions are in bold

Identification of uncertainty components

The individual uncertainty components relevant to the candidate RMP are depicted in the cause-and-effect diagram in Fig. 1b. The uncertainty components are divided into four categories: sample preparation, method precision, method measurement, and consensus value calculation. The uncertainty associated with the concentration value of the certified reference material (NIST SRM 2925), the unlabeled calibrant, is obtained from the certificate of analysis [10, 11].

Quantification of uncertainty

The uncertainty evaluation is based on the information derived from the cause-and-effect diagram (Fig. 1b), and the four sources of uncertainty are categorized into two types: type A and type B. The type A uncertainty component is represented by the method precision component. Type A uncertainty is established by statistical analysis of the albumin mass fraction values (Xmg/g) of the MRM transitions and is represented by the within and between MRM peptide variance [1, 1215]. The DSL random-effects model (Eq. 4), in conjunction with either the Horn-Horn-Duncan (HHD) variance method [15] or the parametric bootstrap variance method [1622], is applied to determine the type A uncertainty (uTypeA) for X¯¯mg/g [6, 7]. The more conservative uncertainty value of the two methods (DSL-HHD or DSL-bootstrap) is selected as the X¯¯mg/g type A uncertainty.

Type B uncertainty is established by non-statistical analysis of the factors associated with calculation of the urine albumin consensus values: X¯¯mg/g and X¯¯mg/L [1, 1215]. The type B uncertainty sources that contribute to the X¯¯mg/g combined uncertainty (umg/g) are sample preparation, method measurement, and consensus value calculation (Fig. 1b). The sample preparation source represents the uncertainty of the certified concentration value of NIST SRM 2925 (uSRM2925) and the uncertainty associated with the analytical balance (uMass) for the gravimetric preparations of the calibration, QC, and urine samples. SRM 2925 is the unlabeled material used, in conjunction with the labeled IS, to generate the linear calibration curve and there is a 1.1% contribution from uSRM2925 to umg/g [10, 11]. The gravimetric measurements using an analytical balance (uMass) represents 0.1% contribution to umg/g (Fig. 1b). The method measurement component represents uncertainty of PAR (uPAR) for each MRM peptide, which is the ratio of the raw peak area output of the unlabeled (calibrant solution or urine sample) to the 15N-labeled IS, and the uncertainty for the linear calibration curve (uccur). As shown in Eq. 3, PAR is used to generate the linear calibration curve; therefore, uccur is combined with uPAR. Uncertainty of PAR (uPAR) is established by consensus means analysis of the PAR results for the MRM transitions (DSL-HHD or DSL-bootstrap), which is the same method used to determine uTypeA for X¯¯mg/g (Eq. 4). As performed in the uTypeA estimate for X¯¯mg/g, the more conservative uncertainty value of the DSL-HHD [15] and DSL-bootstrap [22] methods is selected as the type A uncertainty for PAR (uPAR,TypeA). PAR is a key component of the procedure because it is used to construct the calibration curve for each MRM transition, which is used to determine the albumin content of the unknown sample (Eq. 3). The dependence of the calibration curve on PAR supports incorporating uccur with uPAR (total uncertainty of PAR).

Variability in PAR can impact both the precision of the calibration curve and the accuracy of X¯¯mg/g and, ultimately, X¯¯mg/L. Therefore, the digestion procedure should be optimized to enhance the quality of the injected material, to improve the precision of the instrument output measurements (raw peak area), and to reduce the impact of PAR (uPAR) on the overall combined uncertainty. The DOE optimization approach is applied to determine the optimal enzymatic digestion conditions of the measurement procedure (Fig. 2) [5]. A detailed description of the DOE optimization approach is outlined in the Electronic supplemental material. By applying the DOE optimization approach, we are able to access a wide range of digestion conditions in a single experiment. The output data (raw peak area) for the DOE optimization study for each MRM transition of both the unlabeled (SRM 2925) and labeled IS material are used to generate a z-score map (Fig. 2). As illustrated in Fig. 2, the highest z-score, or highest peak area output value, across the 23 MRM transitions for both unlabeled and labeled IS material are observed in Digestion Condition #12 (Fig. 2), which represents the following parameter settings: enzyme-to-protein mass ratio of 1:30; digestion reaction time of 23 h; and digestion reaction temperature of 37.0°C. In addition to determining the optimal digestion condition, using the data from the DOE optimization approach, we are also able to determine the optimal MRM transitions for quantification of albumin in urine. By selecting the MRM transitions with consistently high peak area measurements, the total number of MRM transitions used to quantify albumin is reduced from 23 to 5. The 23 MRM transitions are divided into two groups: quantitative (qt-) and qualitative (qa-) MRM transitions. The consensus values (X¯¯mg/g and X¯¯mg/L) and associated uncertainties (umg/g and umg/L) represent the combined results of the 5 qt-MRM transitions (Table 1). Optimizing the digestion conditions and reducing the qt-MRM transitions decrease the measurement uncertainty by improving the precision of the peak area results and decreasing the number of measurements used to calculate the consensus values (X¯¯mg/g and X¯¯mg/L) and uncertainties (umg/g and umg/L).

Calculation of overall combined uncertainty

The uncertainty components associated with the NIST candidate RMP are combined to derive X¯¯mg/g combined uncertainty (umg/g) using:

umg/g=u2TypeA+u2TypeB, 6

where uTypeA represents the type A uncertainty of X¯¯mg/g determined via the DSL-HHD or DSL-bootstrap methods and the uTypeB represents the combined type B uncertainties [6, 7]. The utypeB component is determined from the quantified uncertainty sources (uSRM2925, uMass, uPAR) using the following:

uTypeB=u2Massi+u2SRM2925i+u2PARi, 7

The uPAR represents the combined uncertainty for uPAR,TypeA and u¯ccur for the 5 qt-MRM transitions:

uPAR=u2PAR,TypeA+u¯2ccur, 8

where u¯ccur represents the mean calibration curve uncertainty (u¯ccur) of the 5 qt-MRM transitions. The uccur value for each of the five (5) qt-MRM transitions is calculated using [2325]:

uccur=Sx/yB11k+1n+yj-y¯i2B12xi-x¯i2, 9

where B1 is the slope of the linear equation (Eq. 3), k represents the number of replicate measurements of the unknown urine sample, n represents the total number of data points on calibration curve, xi is the individual x-value (x-axis) on the calibration curve, x¯i represents the mean value of the xi values, and y¯i represents the mean value of the yi values (PAR values). The value represents the PAR value of the analyte (albumin) measured in the unknown urine sample. The Sx/y value represents the standard error of the linear calibration curve, which is derived from [2325]:

Sx/y=yi-y^2n-2. 10

To determine the X¯¯mg/L combined uncertainty (umg/L), the density of the urine material (durine) and the density uncertainty (ud) are combined with X¯¯mg/g and umg/g. The final combined standard uncertainty (umg/L) of the consensus mass concentration value (X¯¯mg/L) for the 5 qt-MRM transitions is calculated using:

umg/L=d2u2mg/g+X¯¯mg/gu2d, 11

Calculating the expanded uncertainty

The umg/g and umg/L values are expressed as expanded uncertainties (U), which are obtained by multiplying the combined standard uncertainty (umg/g or umg/L) by a coverage factor (k) [1, 1215]:

Umg/g=k×umg/gorUmg/L=k×umg/L, 12

where k=2 is used for calculation of the expanded uncertainty (approximately 95% confidence level) of the NIST candidate RMP.

Application of measurement uncertainty evaluation

The NIST candidate RMP [5] is used to certify the mass fraction and mass concentration content of albumin in candidate SRM 3666. SRM 3666 is a four-level material composed of pooled human urine with endogenous albumin levels within the clinical ranges for urine albumin (normal: 0 to 30 mg/L; microalbumin: 30 to 150 mg/L; microalbumin: ≥ 150 mg/L) [26]. Using the NIST candidate RMP, the consensus values (X¯¯mg/g, X¯¯mg/L) are determined for each level of candidate SRM 3666 (level 1 to level 4). The overall combined standard uncertainty (umg/g and umg/L) for each level is determined using Eq. 6 (umg/g) and Eq. 10 (umg/L) and the associated expanded uncertainty (Umg/g and Umg/L) for each level is determined using Eq. 12. The concentration of endogenous albumin in candidate SRM 3666 (level 1 to level 4) with the associated expanded uncertainties (k = 2) are level 1—8.28 mg/L ± 1.12 mg/L, level 2—31.11 mg/L ± 2.64 mg/L, level 3—112.77 mg/L ± 10.78 mg/L, and level 4–360.50 mg/L ± 31.11 mg/L, so that 13.53% (L1), 8.49% (L2), 9.56% (L3), and 8.63% (L4) of the respective concentration gave an estimated expanded uncertainty. The X¯¯mg/g and X¯¯mg/L values with the associated measurement uncertainties, in detail, for candidate SRM 3666 (level 1 to level 4) are shown in Tables 2 and 3, respectively.

Table 2.

Combined uncertainty results for urine albumin consensus mass fraction values (X¯¯mg/g) for level 1 to level 4 of candidate NIST SRM 3666

SRM 3666 level number Urine albumin mass fraction consensus value (X¯¯mg/g) Type A uncertainty (mg/g) (uTypeA) Mass-analytical balance uncertainty (uMass) SRM 2925 concentration value uncertainty (uSRM2925) PAR Uncertainty (uPAR) Standard combined uncertainty (umg/g) of urine albumin mass fraction consensus value Expanded combined uncertainty (Umg/g) of urine albumin mass fraction consensus value
Level 1 0.00816 0.00027 0.00001 0.00009 0.00047 0.00055 0.00110
Level 2 0.03068 0.00062 0.00003 0.00035 0.00109 0.00130 0.00260
Level 3 0.11079 0.00314 0.00011 0.00126 0.00407 0.00529 0.01059
Level 4 0.35500 0.00242 0.00036 0.00404 0.01457 0.01532 0.03064

Table 3.

Combined uncertainty results for urine albumin consensus mass concentration values (X¯¯mg/L) for level 1 to level 4 of candidate NIST SRM 3666

SRM 3666 level number Urine albumin mass fraction consensus value (X¯¯mg/g) Standard combined uncertainty (umg/g) of urine albumin mass fraction consensus value SRM 3666 density value (g/mL) SRM 3666 density value standard uncertainty (g/mL) Urine albumin mass concentration consensus value (X¯¯mg/L) Standard combined uncertainty (umg/L)—urine albumin mass concentration consensus value Expanded combined uncertainty (Umg/L)—urine albumin mass concentration consensus value
Level 1 0.00816 0.00055 1015.19 0.00029 8.28395 0.55870 1.11739
Level 2 0.03068 0.00130 1013.97 0.00024 31.10860 1.31985 2.63970
Level 3 0.11079 0.00529 1017.84 0.00029 112.76649 5.38884 10.77770
Level 4 0.35500 0.01532 1015.49 0.00035 360.49895 15.55610 31.11230

Figure 3 illustrates the relative contribution of the uncertainty components on the overall combined standard uncertainty (umg/g and umg/L) for the four levels of candidate SRM 3666. The percent contribution of the X¯¯mg/g combined uncertainty (umg/g) across the four levels revealed that type B uncertainty is considerably higher than type A uncertainty using the NIST candidate RMP. The influence of the analytical balance source (uMass) on umg/g is insignificant, as shown by the low relative uncertainty for uMass. According to Fig. 3, of the four uncertainty components (sample preparation, method measurement, method precision and consensus value calculation), the method precision (uPAR) represents a major source of uncertainty for the measurement procedure. This suggests that the calibration curve (u¯ccur included in uPAR calculation), instrument precision, and protein digestion have a significant contribution on the measurement uncertainty of a MS-based protein quantification procedure. The impact of PAR on the combined uncertainty (umg/g) estimate supports the use of the DOE optimization approach to reduce the measurement uncertainty by establishing the optimal enzymatic digestion conditions and by condensing the number of qt-MRM transitions used to calculate X¯¯mg/g and X¯¯mg/L.

Fig. 3.

Fig. 3

Contribution of the different uncertainty sources to the overall combined uncertainty of the consensus mass concentration value (umg/L) of albumin in urine using the NIST candidate RMP [5]. The method factors and associated uncertainty components: PAR—uPAR, type A—uTypeA, Certified material (NIST SRM 2925)—uSRM2925, Analytical balance—uMass, and density of NIST SRM 3666—ud)

Conclusion

The use of MS-based methods for clinical measurements of protein biomarkers has heightened the need for accurate and comparable results for healthcare practitioners to provide precise and consistent patient care. Estimation of the measurement uncertainty of MS-based clinical procedures is essential to better understand the influence of the procedure parameters on the final measurement result and to, ultimately, determine the clinical suitability of the clinical result. Therefore, in this study, we provide a comprehensive assessment of measurement uncertainty of a MS-based measurement procedure for the quantification of a protein biomarker in a clinical matrix. To our knowledge, this is the first study that applies the bottom-up approach [3, 4], which is the model outlined in the GUM [2], to identify and quantify the individual uncertainty components that contribute to the combined uncertainty for a measurement procedure that incorporates ID-LC–MS/MS for the absolute quantification of a protein biomarker. The bottom-up approach is applied to determine the combined uncertainty for the NIST candidate RMP used for the determination of albumin in human urine [5]. The cause-and-effect diagram is used to identify the uncertainty components of the candidate RMP, and mathematical equations are derived to quantify the contribution of each component toward the combined uncertainty of the procedure. The results of the measurement uncertainty assessment for the candidate RMP are applied to certify albumin in NIST candidate SRM 3666, which is intended as a matrix-based (human urine) certified reference material to validate the accuracy of routine methods used in clinical laboratories and to, ultimately, establish metrological traceability of clinical urine albumin results to the International System of Units (SI). In summary, this study provides a framework for the estimation of measurement uncertainty for a MS-based procedure validated for the purpose of quantifying protein.

Supplementary Information

Below is the link to the electronic supplementary material.

Funding

This research was conducted as part of the authors’ duties as employees of the National Institute of Standards and Technology, an agency of the federal government of the United States of America, under the U.S. Department of Commerce.

Declarations

Human subjects ethics

The National Institute of Standards and Technology Research Protections Office reviewed the protocol for this project and determined it is “not human subjects research” as defined in 15 CFR 27, the Common Rule for the Protection of Human Subjects.

Conflict of interest

The authors declare no competing interests.

Source of biological material

Not applicable.

Statement of animal welfare

Not applicable.

Disclaimer

Certain commercial equipment, instruments, and materials are identified in this paper in order to specify the experimental procedure adequately. Such identification is not intended to imply recommendation or endorsement by NIST, nor is it intended imply that the materials or equipment are necessarily the best available for the purpose.

Footnotes

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.BIPM, IEC, IFCC, ILAC, ISO, IUPAC, IUPAP, and OIML. International vocabulary of metrology - basic and general concepts and associated terms (VIM). Joint Committee for Guides in Metrology, JCGM 200:2012. (3rd edition). URL: https://www.bipm.org/documents/20126/2071204/JCGM_\200_2012.pdf/f0e1ad45-d337-bbeb-53a6-15fe649d0ff1. Accessed 04 Feb 2023.
  • 2.BIPM, IEC, IFCC, ILAC, ISO, IUPAC, IUPAP, and OIML. Evaluation of measurement data - guide to the expression of uncertainty in measurement. Joint Committee for Guides in Metrology, JCGM 100:2008. URL: https://www.bipm.org/documents/20126/2071204/JCGM_100_2008_E.pdf/cb0ef43f-baa5-11cf-3f85-4dcd86f77bd6. Accessed 04 Feb 2023.
  • 3.Magnusson B, Ossowicki H, Rienitz O, Theodorsson E. Routine internal- and external-quality control data in clinical laboratories for estimating measurement and diagnostic uncertainty using GUM principles. Scand J Clin Lab Invest. 2012; 10.3109/00365513.2011.649015. [DOI] [PubMed]
  • 4.Lee JH, Choi JH, Youn JS, Cha YJ, Song W, Park AJ. Comparison between bottom-up and top-down approaches in the estimation of measurement uncertainty. Clin Chem Lab Med. 2015 doi: 10.1515/cclm-2014-0801. [DOI] [PubMed] [Google Scholar]
  • 5.Beasley-Green A, Burris N, Bunk DM, Phinney KW. Multiplexed LC-MS/MS assay for urine albumin. J Proteome Res. 2014 doi: 10.1021/pr500204c. [DOI] [PubMed] [Google Scholar]
  • 6.Filliben JJ, Heckert NA. DATAPLOT: a statistical data analysis software system. A Public Domain Software Released by NIST, Gaithersburg, MD. 2002;20899. https://www.itl.nist.gov/div898/software/dataplot/refman1/auxillar/consmean.htm. Accessed 10 Feb 2023.
  • 7.Filliben J J. DATAPLOT - Introduction and overview. National Bureau of Standards (NBS) Special Publication 667. 1984. 10.6028/NBS.SP.667. Accessed 10 Feb 2023.
  • 8.DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986 doi: 10.1016/0197-2456(86)90046-2. [DOI] [PubMed] [Google Scholar]
  • 9.Rukhin A. Weighted studies means statistics in interlaboratory. Metrologia. 2009 doi: 10.1088/0026-1394/46/3/021. [DOI] [Google Scholar]
  • 10.NIST Certificate of Analysis, SRM 2925 Recombinant human serum albumin solution (primary reference calibrator for urine albumin) (frozen). 2022. https://tsapps.nist.gov/srmext/certificates/2925.pdf. Accessed 04 Feb 2023.
  • 11.Beasley-Green A, Bunk DM, Alejo W, Zhang NF. Certification of Standard Reference Material 2925 recombinant human serum albumin solution (Primary Reference Calibrator for Urine Albumin) (Frozen). NIST Special Publication 260–199. 2020. 10.6028/NIST.SP.260-199. Accessed 04 Feb 2023.
  • 12.Farrance I, Frenkel R. Uncertainty of measurement: a review of the rules for calculating components through functional relationships. Clin Biochem Rev. 2012 doi: 10.1016/j.PLABM.2018.e00097. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Taylor BN, Kuyatt CE. Guidelines for evaluating and expressing the uncertainty of NIST measurement results. Technical Note (NIST TN), National Institute of Standards and Technology, Gaithersburg, MD. 1993. 10.6028/NIST.TN.1297-1993. Accessed 04 Feb 2023.
  • 14.Possolo A. Simple guide for evaluating and expressing the uncertainty of NIST measurement results. Technical Note (NIST TN), National Institute of Standards and Technology, Gaithersburg, MD, 2015. 10.6028/NIST.TN.1900. Accessed 04 Feb 2023.
  • 15.Horn RA, Horn SA, Duncan DB. Estimating heteroscedastic variance in linear models. J Am Stat Assoc. 1975; 10.1080/01621459.1975.10479877.
  • 16.Efron B, Tibshirani RJ. An introduction to the bootstrap. CRC Press; 1994. 10.1201/9780429246593
  • 17.Mandel J, Paule R. Interlaboratory evaluation of a material with unequal number of replicates. Anal Chem. 1970 doi: 10.1021/ac60293a019. [DOI] [Google Scholar]
  • 18.Paule R, Mandel J. Consensus values and weighting factors. J Res Natl Bur Stand. 1982 doi: 10.6028/jres.087.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Ruhkin A, Vangel M. Estimation of a common mean and weighted means statistics. J Am Stat Assoc. 1998 doi: 10.2307/2669626. [DOI] [Google Scholar]
  • 20.Vangel M, Ruhkin A. Maximum likelihood analysis for heteroscedastic one-way random effects ANOVA in interlaboratory studies. Biom. 1999 doi: 10.1111/j.0006-341x.1999.00129.x. [DOI] [PubMed] [Google Scholar]
  • 21.Rao, C. Radhakrishna. Estimation of heteroscedastic variances in linear models. J Am Stat Assoc. 1970; 10.2307/2283583.
  • 22.Koepke A, Lafarge T, Possolo A, Toman B. Consensus building for interlaboratory studies, key comparisons, and meta-analysis. Metrologia. 2017 doi: 10.1088/1681-7575/aa6c0e. [DOI] [Google Scholar]
  • 23.Meyer VR. Measurement uncertainty. J Chromatogr A. 2007 doi: 10.1016/j.chroma.2007.02.082. [DOI] [PubMed] [Google Scholar]
  • 24.NIST/SEMATECH e-Handbook of statistical methods. 10.18434/M32189. Accessed 10 June 2022.
  • 25.Kim Jy, Kwon W, Kim HS, Suh S, In MK. Estimation of measurement for the quantification of 11-nor-delta-9-tetrahydrocannabinol-9-carboxylic acid and its glucuronide in urine using liquid chromatography-tandem mass spectrometry. J Anal Toxicol. 2014; 10.1093/jat/bku008. [DOI] [PubMed]
  • 26.de Jong PE, Curhan GC. Screening, monitoring, and treatment of albuminuria: public health perspectives. J Am Soc Nephrol. 2006 doi: 10.1681/asn.2006010097. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials


Articles from Analytical and Bioanalytical Chemistry are provided here courtesy of Springer

RESOURCES