Skip to main content
. 2014 Jun 17;7:93. doi: 10.1186/1754-6834-7-93

Table 2.

Comparison of PLS calibration models using vibrational spectroscopy and pyrolysis molecular beam mass spectrometry

Method SEL calibration 1,a RMSEC 2,a RM- SECV 3,a R 2 Cal 4 R 2 CV 5 F 6 Outliers 7
Raman 2 nd deriv (19 pt) + SNV 32 scans
0.05
0.13
0.14
0.83 ± 0.02
0.81 ± 0.02
4-5
2
Raman 1 st deriv (7 pt) + EMSC 32 scans
0.05
0.13
0.14
0.845 ± 0.003
0.82 ± 0.01
4-5
3
Raman EMSC + 2 nd deriv (15 pt) 96 scans
0.05
0.13
0.14
0.83 ± 0.01
0.81 ± 0.01
5-6
2-3
Raman 2 nd deriv (15 pt) + SNV 96 scans
0.05
0.13
0.13
0.84 ± 0.01
0.82 ± 0.01
4-5
4-5
MIR EMSC + 2 nd deriv (15 pt)
0.05
0.13
0.14
0.84 ± 0.03
0.81 ± 0.03
3-4
1-2
MIR 2 nd deriv (17 pt) + MSC
0.05
0.13
0.14
0.82 ± 0.01
0.78 ± 0.01
3-4
1-2
MIR 2 nd deriv (17 pt) + SNV
0.05
0.13
0.14
0.85 ± 0.02
0.82 ± 0.03
3-4
2-3
NIR EMSC + 2 nd deriv (25 pt)
0.05
0.17
0.18
0.73 ± 0.01
0.681 ± 0.004
4-5
4-7
NIR 2 nd deriv (25 pt) + MSC
0.05
0.17
0.18
0.72 ± 0.02
0.68 ± 0.02
4-6
1-5
NIR 2 nd deriv (25 pt) + SNV 0.05 0.16 0.17 0.74 ± 0.01 0.70 ± 0.02 4-5 2-3

1Standard Error of the Laboratory for the calibration data.

2Root Mean Standard Error of Calibration.

3Root Mean Standard Error of Cross-Validation.

4Coefficient of determination for calibration set.

5Coefficient of determination for full cross-validation.

6Average number of factors used in model construction.

7Number of outliers removed from calibration models.

aAverage errors of 3 randomly generated models using data provided. Models were not statistically different.

The numbers listed parenthetically reflect the degree of Savitzky-Golay spectral smoothing.

Statistical values are the average of 3 independent models.

MIR = mid-infrared spectroscopy, NIR = near-infrared spectroscopy, EMSC = extended multiplicative scatter correction, MSC = multiplicative scatter correction, SNV = standard normal variate.