Abstract
Species identification—of importance for most biological disciplines—is not always straightforward as cryptic species hamper traditional identification. Fibre-optic near-infrared spectroscopy (NIRS) is a rapid and inexpensive method of use in various applications, including the identification of species. Despite its efficiency, NIRS has never been tested on a group of more than two cryptic species, and a working routine is still missing. Hence, we tested if the four morphologically highly similar, but genetically distinct ant species Tetramorium alpestre, T. caespitum, T. impurum, and T. sp. B, all four co-occurring above 1,300 m above sea level in the Alps, can be identified unambiguously using NIRS. Furthermore, we evaluated which of our implementations of the three analysis approaches, partial least squares regression (PLS), artificial neural networks (ANN), and random forests (RF), is most efficient in species identification with our data set. We opted for a 100% classification certainty, i.e., a residual risk of misidentification of zero within the available data, at the cost of excluding specimens from identification. Additionally, we examined which strategy among our implementations, one-vs-all, i.e., one species compared with the pooled set of the remaining species, or binary-decision strategies, worked best with our data to reduce a multi-class system to a two-class system, as is necessary for PLS. Our NIRS identification routine, based on a 100% identification certainty, was successful with up to 66.7% of unambiguously identified specimens of a species. In detail, PLS scored best over all species (36.7% of specimens), while RF was much less effective (10.0%) and ANN failed completely (0.0%) with our data and our implementations of the analyses. Moreover, we showed that the one-vs-all strategy is the only acceptable option to reduce multi-class systems because of a minimum expenditure of time. We emphasise our classification routine using fibre-optic NIRS in combination with PLS and the one-vs-all strategy as a highly efficient pre-screening identification method for cryptic ant species and possibly beyond.
Keywords: Cryptic-species complex, Ants, Formicidae, Neural networks, One-vs-all strategy, Partial least squares regression, Random forests, Species identification tool, Tetramorium
Introduction
Correct species identification is crucial for most fields of biology, including biodiversity research, conservation biology, invasion biology, and the understanding of evolution (Bickford et al., 2007; Pfenninger & Schwenk, 2007). Species with very subtle morphological differences relative to other species, termed cryptic species (Bickford et al., 2007), pose a challenge for classical taxonomy and species identification. Cryptic species are known from all biogeographical regions and from all major metazoan taxa (Pfenninger & Schwenk, 2007). Estimation of crypsis across the animal kingdom is difficult, but in some groups more than 50% of species are morphologically hardly discriminable (Seifert, 2009). Moreover, complexes of cryptic species, i.e., more than two species not differentiable, are not a rarity in insects (Hebert et al., 2004; Smith et al., 2008; Seifert, 2009), in other arthropods (Wilcox et al., 1997; Arthofer et al., 2013), and even in vertebrates (Oliver et al., 2009). One major problem for the in-depth investigation of cryptic species is the high effort needed for correct species identification.
Misidentifications are not a rarity in ecological studies and can lead to error cascades in biology. Far-reaching consequences are, for example, wrong interpretations of biological studies, inaccurate environmental management, and loss in biodiversity (Bortolus, 2008). Moreover, errors in species identification can produce high costs in economy, such as, when imported goods are discarded because of the presence of organisms erroneously identified as pest species (Boykin et al., 2011). Thus, a 100% identification certainty, i.e., a residual risk of misidentification of zero within the available data, is highly desirable for a species identification routine to allow correct downstream investigations and to avoid unwanted consequences (Bortolus, 2008).
Near-infrared spectroscopy (NIRS) is, among other applications, a technique for species identification (Rodriguez-Fernandez et al., 2011). The efficiency of NIRS as a fast and inexpensive method for the classification of substances differing in chemical composition has been shown in numerous studies (e.g., Foley et al., 1998; Rodriguez-Fernandez et al., 2011), and it has been applied to medicine (Quaresima, Lepanto & Ferrari, 2003), pharmacology (Reich, 2005), soil science (Chang et al., 2001), landscape ecology (Youngentob et al., 2012), biotechnology (Balabin & Safieva, 2011), vector control (Sikulu et al., 2010), and the agriculture and food industry (Williams & Norris, 2001). NIRS analysis of chemical compounds from insect surfaces, which comprise mainly a variety of cuticular hydrocarbons (CHCs), has been multiply used to discriminate sex, age, infection status with certain bacteria, and population of origin (Newey, Robson & Crozier, 2008; Aw, Dowell & Ballard, 2012) as well as to identify species (Cole et al., 2003; Fischnaller et al., 2012).
NIRS generates large sets of raw data, and a critical selection of the most appropriate analysis approach is essential to extract data subsets informative for a specific purpose, e.g., for classification problems (Pasquini, 2003). One prominent method for the analysis of NIR spectra is partial least squares regression (PLS), a combination of principal component analysis and multiple linear regression (Abdi, 2010). It has been used for the analysis of NIR spectra for species identification (e.g., Jia et al., 2007; Fischnaller et al., 2012) because of its capability to handle data with many more variables than observations (Pasquini, 2003).
The use of machine learning algorithms is an alternative in resolving species identification problems (Clark, 2003; Gaston & O’Neill, 2004). Characteristics of artificial neural networks (ANN) are their capability to learn from observations and to perform non-linear multivariate data mining for pattern recognition (Clark, 2003). Dowell et al. (1999) and Aldrich et al. (2007) showed that ANN are suitable for species discrimination using NIRS data. However, ANN cannot efficiently handle data sets with many variables and few observations, and thus a prior reduction of variables is necessary (Svetnik et al., 2003; Liu et al., 2013).
Another category of machine learning algorithms is random forests (RF). This method uses ensembles of decision trees for classification, regression, or unsupervised analysis (Breiman, 2001). Some of the major advantages of RF are the handling of data sets with large variable and small observation numbers and the avoidance of model overfitting (Breiman, 2001). RF has been shown to be very efficient for classification problems, giving more accurate results than other methods (Svetnik et al., 2003; Liu et al., 2013) and for tackling biological questions, including via spectral data (Menze et al., 2009; Lee et al., 2012).
ANN and RF are able to handle data consisting of more than two classes, but PLS is not, and thus the reduction of multi-class problems into two-class problems is necessary. This can simply be achieved by using either the one-vs-all strategy (Rifkin & Klautau, 2004) (Fig. 1a) or binary decision trees (Figs. 1b and 1c). By applying the one-vs-all strategy, one group (Class 1) is compared with the pooled set of the remaining groups (Class 2), each group alternately being Class 1 (Fig. 1a). Binary decision trees can be applied either as sequential classification of one group versus all others with a decreased number of groups after every step (Fig. 1b, here named binary-decision type A), or by first comparing two subclasses and then classifying the groups of each subclass in pair-wise comparisons (Fig. 1c, here named binary-decision type B). The optimisation of the chronology of class separation, i.e., the order in which classes are split off to gain maximum identification success, requires exhaustive testing of all possible combinations.
To test NIRS reliability, we have chosen the four species of the cryptic Tetramorium caespitum/impurum species complex (Hymenoptera: Formicidae) that co-occur above 1,300 m above sea level (a.s.l.) in the Alps. In total, the cryptic-species complex consists of at least seven species in Central Europe (Schlick-Steiner et al., 2006); the three species not included here are restricted to lower altitudes. All species are morphologically highly similar, but are known to vary in their CHC profiles, a fact which has already been used for species delimitation and discrimination (Schlick-Steiner et al., 2006; Klarica et al., 2011).
For an unambiguous identification of groups containing more than two cryptic species, the efficiency of NIRS as an alternative to conventional identification methods and the performance of PLS, ANN, and RF have not been investigated yet. Hence, we tested whether a complex of more than two cryptic species with similar ecological requirements can be identified with 100% certainty using fibre-optic NIRS. Additionally, we examined which of the three strategies, one-vs-all or binary-decision type A, or B, is best to address multi-class problems when not more than two classes can be analysed in parallel (e.g., using PLS).
Materials and Methods
Study system
Four of the seven cryptic ant species from the Tetramorium caespitum/impurum complex (T. alpestre Steiner, Schlick-Steiner & Seifert, 2010, T. caespitum (Linnaeus, 1758), T. impurum (Foerster, 1850), and T. sp. B sensu Schlick-Steiner et al. (2006)) were selected for this study because of their occurrence in the same habitat above 1,300 m a.s.l. in the Alps (Steiner et al., 2010) and their similar ecological requirements. Specimens were collected from nests in a large geographic area, from Spain to Armenia and from Finland to Greece (Table 1 and Table S1) between 1993 and 2012. Individuals were submerged in absolute ethanol at the collection site and afterwards stored at 4 °C or −20 °C. The number of specimens stored at each of the two temperatures was balanced among the species. Nests in spatial vicinity of less than 1 km were treated as belonging to the same population.
Table 1. Sample information of the four species with number of populations, longitudinal, latitudinal, and altitudinal extensions.
Pop | Lon | Lat | Alt | ||||
---|---|---|---|---|---|---|---|
min | max | min | max | min | max | ||
T. alpestre | 29 | 6.40 | 13.95 | 41.69 | 47.22 | 1,300 | 2,400 |
T. caespitum | 45 | −2.38 | 27.27 | 41.81 | 59.83 | 2 | 1,400 |
T. impurum | 45 | −3.28 | 26.35 | 40.10 | 50.99 | 7 | 2,000 |
T. sp. B | 45 | 9.80 | 44.02 | 37.95 | 50.92 | 100 | 1,950 |
Notes.
- Pop
- Number of populations. Nests in spatial vicinity of less than one kilometre from each other were treatd as one population
- Lon
- Minimum and maximum longitudinal position in decimal format, positive values indicate position east of Greenwich, negative values indicate position west of Greenwich
- Lat
- Minimum and maximum latitudinal position in decimal format
- Alt
- Minimum and maximum altitudinal position in m above sea level
Workers were dry-mounted by first removing the ant’s gaster (abdomen behind the waist) for subsequent genetic analysis and then gluing the tibiae and tarsi on a white paper card using customary wallpaper adhesive, so that a specimen’s dorsal and lateral surface was accessible for NIRS measurements. Dry-mounted specimens were stored at room temperature in glass-covered insect boxes avoiding intensive exposure to light, dust, and moisture for at least one month before NIRS measurements.
DNA extraction from the gaster of one individual per nest and PCR amplification of a mitochondrial cytochrome c oxidase subunit I (COI) gene stretch for species identification followed the protocol of Steiner et al. (2005) with one slight modification, i.e., addition of 2.25 µl bovine serum albumin (0.2 µg/µl) to the PCR reaction mix. Additionally, out of the 176 nests analysed by NIRS, each two individuals from 108 nests and one individual from 22 nests were identified using traditional morphometrics applying the method of Steiner, Schlick-Steiner & Moder (2006) and Steiner et al. (2010). Morphometric analysis of individuals from all nests would have required prohibitive amounts of time (see Discussion). In none of those instances where the species ID had been determined by more than one independent method did we obtain conflicting results, as would be expected from, for example, hybridisation. Detailed information on the specimens used in this study is given in Table S1. New sequences have been submitted to GenBank under the accession numbers KT248392–KT248508.
NIR data collection
Spectral data were collected using a Labspec® 5000 Portable VIS/NIR Spectrometer (ASD inc., Boulder, Colorado, USA) with a wavelength range from 350 to 2,500 nm and 1 nm resolution. Before each measurement session, a reference baseline was created by positioning the 3 mm diameter bifurcated fibre-optic probe uprightly 2.2 mm above a white Spectralon® plate; this distance for optimum baseline acquisition was determined empirically by measuring the reflectance at increasing plate-probe distances starting from 0.1 mm until the reflectance reached maximum intensity.
For measurements, mounted ants were placed above a Spectralon® plate using a goniometer-style pin-holding stage. The probe was positioned uprightly 2.2 mm above the dorsal surface with focus on the head and mesosoma. For T. caespitum, T. impurum, and T. sp. B, 135 workers from 45 nests (three specimens per nest), and for T. alpestre, 123 workers from 41 nests were measured, resulting in spectra from a total of 528 insects. All measurements were performed in the same laboratory under constant artificial illumination (4,000 K, 2.9 µmol m−2 s−1). Relative humidity and air temperature were kept at 36% and 22.5 °C, respectively. To increase the signal-to-noise ratio, the average spectrum of 50 measurement replicas was collected for each specimen.
NIR data analysis
Spectra were converted to the Galactic Spectrum file format (.spc) and automatically mean-centred using ASDtoSPC version 5.6 (ASD Inc.). Regions below 500 nm and above 2,300 nm were removed because of high noise levels caused by sensor and lighting limitations (Dowell, Noutcha & Michel, 2011).
For each of T. caespitum, T. impurum, and T. sp. B, 30 nests were selected randomly for the computation of the calibration model; for T. alpestre, 26 nests were used for calibration. The remaining 15 nests were used as an independent validation set for testing the models. All nests of a population were assigned either to the calibration or to the validation set to assure the independency of the validation set.
The inability of PLS to handle more than two groups necessitated the reduction of the multi-class system to a two-class system. The three possibilities of doing so, one-vs-all strategy, binary-decision type A, and binary-decision type B, were compared by estimating the times needed for elaborating the PLS calibration models. In doing so, we calculated the overall times needed for an exhaustive search under each strategy; an exhaustive search is the only approach by which the optimal calibration model for every decision step in the species identification process can be identified. For every possible combination of species, we used the empirical value of 1.33 h for calibration-model elaboration, which in our experience is realistic after initial training. This time estimation includes the evaluation of, on average, 13 different PLS factors.
For the one-vs-all strategy, given c classes, the number of model-elaboration steps s is calculated as
(1) |
For the binary-decision type A, the number of computation steps follows
(2) |
The calculation for binary-decision type B is more complex, as the calculation of the number of combinations requires different equations for odd and even numbers of classes. First, the number of levels nl to repeatedly halve c classes is calculated by nl = int(log2(c)). At each level, a number of groups ni, containing all classes, exists. Now let xi,k be the number of classes at level i in group k and define the auxiliary variables v1,k = int((xi,k + 1)/2) and v2,k = xi,k − v1,k. The total number of computation steps then calculates by the sum of the binomial coefficients
(3) |
Due to the fact that the model-elaboration times for the binary decision strategies were higher than for the one-vs-all strategy (see Results), we used exclusively the one-vs-all strategy for further analyses by comparing the calibration set of one species (Class 1, Fig. 2) with the pooled calibration set spectra of the remaining three species (Class 2). In testing the model, each specimen of the independent validation set received a prediction value from PLS, ANN, and RF. Individuals with a value ≤1.5 with PLS or ≤0.5 with ANN and RF were assigned to Class 1 and ones with a value >1.5 with PLS or >0.5 with ANN and RF to Class 2.
For the 100% correct classification of Class 1 validation-set specimens, we sought models which resulted in the correct classification of all Class 2 validation-set specimens, i.e., in the elimination of all Class 2 validation specimens incorrectly predicted as Class 1 (false positives). Hence, individuals with a prediction value in an interval around 1.5 with PLS or 0.5 with ANN and RF were excluded by augmenting this interval in 0.1 incremental steps (1.45–1.55, 1.4–1.6, etc.) until no false-positive specimens from validation set Class 2 remained (Fig. 3). At that point, the Class 1 prediction pool was without Class 2 individuals and as a consequence, all retained individuals predicted as Class 1 were correctly classified. Finally, based on the assumption that nests contain only specimens of one species, individuals excluded during this procedure were treated as identified if at least one nestmate was among the correctly classified Class 1 specimens. This procedure was repeated for all species, alternately treating each of them as Class 1. All individuals not identified during this approach were considered as unclassifiable using NIRS; an alternative discipline would be necessary for species discrimination.
Principal component analysis (PCA) was calculated with PAST version 2.17 (Hammer, Harper & Ryan, 2001) using the reflectance values for 1,801 wavelengths as variables. PLS regression was performed using the software Grams AI and PLSplus/IQ version 8.0 (Thermo Electron Corporation, Salem, New Hampshire, USA) for the classification of species. The number of factors used for the computation of the model and the quality of the calibration model were determined by visual evaluation of the regression coefficient and the correct classification rate of the validation set (i.e., the prediction values).
ANN were built as backpropagation feed-forward networks using the software NeuroShell Classifier version 3.0 (Ward Systems Group Inc., Frederick, Maryland, USA). Due to the fact that ANN were not able to use all 1,801 variables, 150 were randomly selected, starting from 500 nm with 12 nm increments, similar to the procedure of Aldrich et al. (2007). The NeuroShell Classifier calculated the optimum number of hidden neurons for each model.
The RF analysis was performed using the software package randomForest version 4.6–7 in R (Liaw & Wiener, 2002) with 1,000 bootstrapping specimens (ntree) and default settings for the number of variables used for searching the best split at each node (mtry) for 1,801 and 150 variables, in analogy to the PLS and ANN analyses, respectively. The selection of the optimum parameters was done by exhaustively evaluating parameter combinations. Although ANN and RF are able to handle more than two classes in parallel, their performance in doing so was insufficient for our aim of unambiguous identification (Table S2). Thus, we only refer to the one-vs-all strategy in the following.
All computations were performed on a personal computer equipped with an AMD A6-3400M processor with 1.40 GHz and 8 GB RAM using 64-bit Microsoft® Windows® 7 as operating system. Computation time estimations refer to this system configuration.
Results
The four cryptic species largely overlapped in the individual spectra. In the mean spectra, some offset was discernible across species (Fig. 4), but no species-specific regions were found by visual inspection. The PCA plot showed no distinct clustering of the spectral data according to species (Fig. 5).
The model-elaboration times differed across the three strategies of reducing a multi-class system to a two-class system (Fig. 6). For the four-class system, as used in this study, the estimated elaboration times were 5.3 h for one-vs-all, 29.3 h for binary-decision type A, and 12 h for binary-decision type B. These differences increased with increasing number of classes, e.g., for a seven-class system as represented by all Central European species of the Tetramorium caespitum/impurum complex, one-vs-all would take 9.3 h, binary-decision type A 560.0 h (ca. 14 weeks), and binary-decision type B 354.7 h (ca. 9 weeks). Hence, exclusively the one-vs-all strategy was used for further analyses in this study.
Prior to the exclusion of prediction values, specimens were classified with an average error rate across all species of 58.3% using PLS (min. 42.2%, max. 80.0%, Table 2), 42.8% using ANN (min. 22.2%, max. 57.8%), and 92.2% (min. 91.1%, max. 93.3%) and 78.9% (min. 68.9%, max. 95.6%) using RF with 150 and 1,801 variables, respectively. After the exclusion of specimens within the excluded prediction-value range, i.e., eliminating all false positives and thus reaching 100% certainty, PLS unambiguously identified 21 T. alpestre workers (46.7% of 45 workers), three T. caespitum workers (6.7%), eight T. impurum workers (17.8%), and two T. sp. B workers (4.4%). After including the nestmates of the correctly identified specimens in the pool of correct classifications, the portion of unambiguously identified specimens increased to 66.7% (T. alpestre), 20.0% (T. caespitum), 46.7% (T. impurum), and 13.3% (T. sp. B). Across all species, 22 nests (66 individuals, 36.7%) were correctly identified without uncertainty.
Table 2. Species classification results for the classification of the validation set using different analysis methods and the one-vs-all approach.
Class 1 | Class 2 | Number of variables | Settings | Individuals correct prior to exclusion | Individuals incorrect prior to exclusion | Exclusion range | Individuals correct after exclusion | Individuals incorrect after exclusion | Nests correct after exclusion | |
---|---|---|---|---|---|---|---|---|---|---|
PLS | T. alpestre | T. caespitum/impurum/sp. B | 1,801 | 12 | 26 (57.8%) | 19 (42.2%) | 1.25–1.75 | 21 (46.7%) | 0 (0.0%) | 10 (66.7%) |
T. caespitum | T. alpestre/impurum/sp. B | 1,801 | 10 | 20 (43.4%) | 25 (56.6%) | 1.20–1.80 | 3 (6.7%) | 0 (0.0%) | 3 (20.0%) | |
T. impurum | T. alpestre/caespitum/sp. B | 1,801 | 15 | 20 (43.4%) | 25 (56.6%) | 1.20–1.80 | 8 (17.8%) | 0 (0.0%) | 7 (46.7%) | |
T. sp. B | T. alpestre/caespitum/impurum | 1,801 | 10 | 9 (20.0%) | 36 (80.0%) | 1.35–1.65 | 2 (4.4%) | 0 (0.0%) | 2 (13.3%) | |
Total | 75 (41.7%) | 105 (58.3%) | 34 (18.9%) | 0 (0.0%) | 22 (36.7%) | |||||
ANN | T. alpestre | T. caespitum/impurum/sp. B | 150 | 5 | 35 (77.8%) | 10 (22.2%) | – | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) |
T. caespitum | T. alpestre/impurum/sp. B | 150 | 23 | 19 (42.2%) | 26 (57.8%) | – | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | |
T. impurum | T. alpestre/caespitum/sp. B | 150 | 34 | 25 (55.6%) | 20 (44.4%) | – | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | |
T. sp. B | T. alpestre/caespitum/impurum | 150 | 18 | 24 (53.3%) | 21 (46.7%) | – | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | |
Total | 103 (57.2%) | 77 (42.8%) | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | |||||
RF | T. alpestre | T. caespitum/impurum/sp. B | 150 | 12 | 3 (6.7%) | 42 (93.3%) | 0.35–0.65 | 2 (4.4%) | 0 (0.0%) | 2 (13.3%) |
T. caespitum | T. alpestre/impurum/sp. B | 150 | 12 | 4 (8.9%) | 41 (91.1%) | 0.10–0.90 | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | |
T. impurum | T. alpestre/caespitum/sp. B | 150 | 12 | 3 (6.7%) | 42 (93.3%) | – | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | |
T. sp. B | T. alpestre/caespitum/impurum | 150 | 12 | 4 (8.9%) | 41 (91.1%) | 0.20–0.80 | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | |
Total | 14 (7.8%) | 166 (92.2%) | 2 (1.1%) | 0 (0.0%) | 2 (3.3%) | |||||
T. alpestre | T. caespitum/impurum/sp. B | 1,801 | 42 | 2 (4.4%) | 43 (95.6%) | 0.30–0.70 | 2 (4.4%) | 0 (0.0%) | 2 (13.3%) | |
T. caespitum | T. alpestre/impurum/sp. B | 1,801 | 42 | 13 (28.9%) | 32 (71.1%) | 0.15–0.85 | 2 (4.4%) | 0 (0.0%) | 2 (13.3%) | |
T. impurum | T. alpestre/caespitum/sp. B | 1,801 | 42 | 14 (31.1%) | 31 (68.9%) | – | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) | |
T. sp. B | T. alpestre/caespitum/impurum | 1,801 | 42 | 9 (20.0%) | 36 (80.0%) | 0.25–0.75 | 2 (4.4%) | 0 (0.0%) | 2 (13.3%) | |
Total | 38 (21.1%) | 142 (78.9%) | 6 (3.3%) | 0 (0.0%) | 6 (10.0%) |
Notes.
- PLS
- Partial least squares regression
- ANN
- Artificial neural networks
- RF
- Random forests
- Settings
- Number of factors (for PLS), number of hidden neurons (for ANN), and optimum mtry, i.e., number of variables used for searching the best split at each node (for RF)
– Indicates that the model never reached the 100% correct classification for the Class 2 validation-set individuals at any range of prediction values.
ANN never resulted in the correct classification of all Class 2 validation-set specimens (Table 2). Unambiguous identification of specimens thus was not possible.
RF identified two individuals as T. alpestre (4.4%) using 150 variables, and two individuals (4.4%) each as T. alpestre, T. caespitum, and T. sp. B using 1,801 variables, but none of the workers of T. impurum using either variable number. The inclusion of nestmates resulted in an identification success of 13.3% (T. alpestre, T. caespitum, T. sp. B) and a total of six identified nests (18 individuals, 10.0%) using 1,801 variables. The reduction of variables to 150 resulted in two identified nests (6 individuals, 3.3%).
Discussion
We showed that an unsupervised method (PCA) was not suitable for pattern recognition in our fibre-optic NIRS data, necessitating supervised approaches such as PLS (Fig. 5). Referring to the major questions of this study, we demonstrated that fibre-optic NIRS can be used as a fast pre-screening method for the unambiguous identification of more than two cryptic ant species despite their morphological and ecological similarities. We also showed that with our implementation of data analysis, PLS is most efficient in predicting the correct species, followed by RF and ANN. Moreover, we demonstrated that the one-vs-all strategy is the only practical possibility of multi-class reduction.
The choice of the most appropriate technique to reduce the multi-class system to a two-class system, as is necessary for PLS, is crucial for the time management of a project. The differences of time expenditure across the three strategies tested increased with increasing number of classes to be investigated (Fig. 6). Considering our ultimate intention to apply the NIRS routine not just to the four species, but to evaluate the applicability of a NIRS-based identification routine to any conceivable multi-class system, the one-vs-all strategy was the only acceptable option. We suggest it as the general approach to reducing multi-class to two-class systems for NIRS identification purposes.
NIRS identification using PLS was able to identify 66.7% of T. alpestre and 46.7% of T. impurum workers (Table 2) without uncertainty but was less efficient for the discrimination of T. caespitum and T. sp. B with 20.0% and 13.3% of workers unambiguously identified, respectively. This may be explicable by the high similarity of the CHC profiles of T. caespitum and T. sp. B, whereas T. impurum differs in its CHC profile from all other species (Schlick-Steiner et al., 2006). The PLS regression coefficients showed a few wavelength regions important for species classification that can be found in all four PLS models (for examples, see Fig. S1). Several other regions were shared only by two or three models, or are unique to a model underlining the possible differentiation of the species. Some of these regions were either in a visible range, indicating colour differences, or correspond to CH2 and CH3 first, second, and combination overtones (Shenk, Workman & Westerhaus, 2008). CH2 and CH3 are part of insect cuticular hydrocarbons and other lipids (Lockey, 1988) and are important for species recognition (Blomquist & Bagnères, 2010). The analysis of the cuticular hydrocarbon profile of T. alpestre using gas chromatography-mass spectrometry and a critical comparison with the profiles of the other Tetramorium species has not been done to date and would be required for a final assessment.
ANN were not able to identify any specimen with 100% certainty (Table 2), at least in our implementation of the analysis. In contrast, two other studies that used NIRS showed high success for species identification using ANN: Aldrich et al. (2007) recommended ANN as preferable tool, which performed better than PLS in their study on the NIRS identification of termite species and subspecies, and Dowell et al. (1999) reported both ANN and PLS as very efficient methods for the identification of different genera or groups of species. However, none of the studies investigated a group of cryptic species. The limited ability of ANN to handle efficiently data sets with many variables and few observations is a major disadvantage in comparison to PLS and RF (Svetnik et al., 2003; Liu et al., 2013) and may provide a reasonable explanation for the unsatisfactory results in our study. Similar to Aldrich et al. (2007), we selected 150 variables by stepwise increments of 12 nm, and it is possible that spectral regions important for species discrimination were lost by chance in this process. As the aim of our study was to evaluate the classification performance of each method separately and without intensive pre-processing, we did not select regions based on the PLS regression coefficients to increase the identification success of the ANN analysis. However, it may be possible indeed that this approach would increase the identification success of ANN.
Until now, RF have rarely been used for classification of NIRS data, but Lee et al. (2012) were able to discriminate agricultural products of different geographical origin with up to 100% accuracy. In contrast, our maximum identification success was 13.3% in T. alpestre, T. caespitum, and T. sp. B workers, while none of T. impurum were identified in our implementation of the analysis (Table 2). Neither altered variable numbers nor higher numbers of trees (ntree) nor altered numbers of variables used for searching the best split at each node (mtry) increased the number of identified specimens using RF (data not shown). Menze et al. (2009) evaluated the performance of RF and other chemometric methods on NIRS data and concluded to use not just one method but to combine RF for feature selection with PLS for classification. We did not follow this approach because our goal was to evaluate each analysis method separately. Thus, we conclude that raw NIRS data of the Tetramorium species investigated in this study, and possibly for other cryptic species, are not suitable for classification analysis using RF.
Compared with other studies, the number of misclassifications by PLS when no prediction values were excluded was high (42.2–80.0%). Jia et al. (2007) and Aldrich et al. (2007) were able to differentiate species with up to 100% classification success without excluding specimens. Examples for intermediate error rates are Dowell et al. (1999) with up to 45% of some stored-grain species combinations and Mayagaya et al. (2009) with 35% for the classification of gravid mosquitoes. This indicates that the efficiency of NIRS depends, among others, on the taxa under investigation, i.e., that not all species can be discriminated with the same classification success. This may explain why the four cryptic species of the Tetramorium caespitum/impurum complex used in our study were not identified with higher success prior to the exclusion of prediction values. Nevertheless, crypsis is an anthropocentric point of view, and many animals recognise conspecifics by other than visual signals (Bickford et al., 2007). Recognition by chemical profiles is widespread among insects and probably more important than other signals (Blomquist & Bagnères, 2010). Consequently, surface-chemical discrimination of morphologically difficult species is often simple (Seppä et al., 2011; Berville et al., 2013), stressing the relevance of NIRS in species identification. Klarica et al. (2011) assumed interspecific hybridisation as one possible reason for the misidentification of two T. impurum samples using NIRS data. However, given the lack of conflict between the mtDNA-based and the morphometrics-based identification results, we do not expect hybridisation in the current data set. Therefore, the high misclassification rate prior to the exclusion of prediction values cannot be explained by hybridisation, even though hybridisation cannot be ruled out ultimately.
To bring the identification method as close as possible to common practice, all specimens used in this study were stored in absolute ethanol before mounting. Aldrich et al. (2007) successfully identified termite species and subspecies using ethanol-preserved specimens, and Rodriguez-Fernandez et al. (2011) identified several fly species. Furthermore, Klarica et al. (2011) used ethanol-stored specimens for Tetramorium identification with near-infrared imaging spectroscopy, and Perez-Mendoza et al. (2002) predicted the age of ethanol-stored specimens with similar success as when using fresh ones. It is true that Dowell, Noutcha & Michel (2011) showed in their comparison of different storage media for mosquito age prediction that various media are better than ethanol in their prediction performance. However, our aim was to test whether working with a very widely used (even if suboptimal for NIRS data generation) killing and preserving agent would still allow for correct species identification. Our results suggest that when excluding specimens with intermediate prediction values, satisfying identification results can be achieved. Moreover, no clustering of specimens with identical ethanol storage periods was detectable in a PCA, indicating little influence of the time spent in ethanol (Fig. S2).
To achieve unambiguous identifications, i.e., a residual risk of misidentification of zero within the available data, with our NIRS routine, the exclusion of all false-positive results is necessary. In doing so, individuals in a particular, ambiguous prediction-value range need to be excluded and thus remain unidentified. The pool of excluded individuals can also contain correctly identified individuals if their prediction values fall into the ambiguous range. This loss of individuals is the most distressing cost of achieving unambiguous classification. Based on our results, we go beyond the approach of just excluding ambiguous prediction values and additionally suggest the one-vs-all strategy as a novel standard for the analysis of groups of more than two species using NIRS. Multi-class problems are not limited to complexes of cryptic species but are frequent in biology and other disciplines, e.g., in the classification of age cohorts, crop pests, or food origin (Dowell et al., 1999; Aw, Dowell & Ballard, 2012; Liu et al., 2013). We showed that the approach presented here is a useful pre-screening identification tool for a group of cryptic ant species. Moreover, it may be suitable for any kind of multi-class problem where NIRS can be applied including ones for which, to our knowledge, NIRS has not been applied to date, such as identifying the geographic origin of invasive species or the infection status of target organisms when multiple pathogen strains are involved.
Fibre-optic NIRS is, with a measurement time of one minute per specimen, much faster than other methods. The whole procedure for the identification of 96 specimens takes in total 2.3 h of turn-around time including 1.8 h of hands-on time using our NIRS routine with PLS and the one-vs-all strategy, 65.6 h of turn-around and hands-on time using the morphometric character set established by Steiner et al. (2010), and 23.2 h of turn-around time including 13.3 h of hands-on time using mtDNA for genetic identification as applied in this study (Table S3). This time efficiency, the low running costs, and the absence of lab consumables, sometimes including toxic components, make fibre-optic NIRS an attractive identification tool.
Conclusions
Fibre-optic NIRS in combination with PLS proved to be an appropriate tool for the unambiguous identification of data on cryptic ant species, albeit at the cost of excluding specimens from identification. Furthermore, the one-vs-all strategy turned out to be a very handy possibility to study groups containing more than two species. We conclude that our NIRS classification routine provides a fast and inexpensive tool for multi-class species identification.
Supplemental Information
Acknowledgments
To numerous persons contributing Tetramorium ants (Table S1); to Clemens Folterbauer for technical assistance in the laboratory; to Thomas Dejaco, Magdalena Tratter, Nigel Andrew, Stephen Martin, Ben Aldrich, and Norman MacLeod for their helpful comments on earlier versions of the manuscript.
Funding Statement
This research was supported by the University of Innsbruck and the Austrian Science Fund (FWF, http://www.fwf.ac.at/) under grant P23409 awarded to BCSS. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Additional Information and Declarations
Competing Interests
The authors declare there are no competing interests.
Author Contributions
Martin-Carl Kinzner conceived and designed the experiments, performed the experiments, analyzed the data, contributed reagents/materials/analysis tools, wrote the paper, prepared figures and/or tables, reviewed drafts of the paper.
Herbert C. Wagner and Andrea Peskoller performed the experiments, analyzed the data, contributed reagents/materials/analysis tools, reviewed drafts of the paper.
Karl Moder analyzed the data, contributed reagents/materials/analysis tools, reviewed drafts of the paper.
Floyd E. Dowell conceived and designed the experiments, reviewed drafts of the paper.
Wolfgang Arthofer conceived and designed the experiments, wrote the paper, prepared figures and/or tables, reviewed drafts of the paper.
Birgit C. Schlick-Steiner and Florian M. Steiner conceived and designed the experiments, contributed reagents/materials/analysis tools, wrote the paper, prepared figures and/or tables, reviewed drafts of the paper.
DNA Deposition
References
- Abdi (2010).Abdi H. Partial least squares regression and projection on latent structure regression (PLS regression) Wiley Interdisciplinary Reviews. Computational Statistics. 2010;2:97–106. doi: 10.1002/wics.51. [DOI] [Google Scholar]
- Aldrich et al. (2007).Aldrich BT, Maghirang EB, Dowell FE, Kambhampati S. Identification of termite species and subspecies of the genus Zootermopsis using near-infrared reflectance spectroscopy. Journal of Insect Science. 2007;7:1–7. doi: 10.1673/031.007.1801. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Arthofer et al. (2013).Arthofer W, Rauch H, Thaler-Knoflach B, Moder K, Muster C, Schlick-Steiner BC, Steiner FM. How diverse is Mitopus morio? Integrative taxonomy detects cryptic species in a small-scale sample of a widespread harvestman. Molecular Ecology. 2013;22:3850–3863. doi: 10.1111/mec.12340. [DOI] [PubMed] [Google Scholar]
- Aw, Dowell & Ballard (2012).Aw WC, Dowell FE, Ballard JWO. Using near-infrared spectroscopy to resolve the species, gender, age, and the presence of Wolbachia infection in laboratory-reared Drosophila. G3. 2012;2:1057–1065. doi: 10.1534/g3.112.003103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balabin & Safieva (2011).Balabin RM, Safieva RZ. Biodiesel classification by base stock type (vegetable oil) using near infrared spectroscopy data. Analytica Chimica Acta. 2011;689:190–197. doi: 10.1016/j.aca.2011.01.041. [DOI] [PubMed] [Google Scholar]
- Berville et al. (2013).Berville L, Hefetz A, Espadaler X, Lenoir A, Renucci M, Blight O, Provost E. Differentiation of the ant genus Tapinoma (Hymenoptera: Formicidae) from the Mediterranean Basin by species-specific cuticular hydrocarbon profiles. Myrmecological News. 2013;18:77–92. [Google Scholar]
- Bickford et al. (2007).Bickford D, Lohman DJ, Sodhi NS, Ng PKL, Meier R, Winker K, Ingram KK, Das I. Cryptic species as a window on diversity and conservation. Trends in Ecology & Evolution. 2007;22:148–155. doi: 10.1016/j.tree.2006.11.004. [DOI] [PubMed] [Google Scholar]
- Blomquist & Bagnères (2010).Blomquist GJ, Bagnères A-G, editors. Insect hydrocarbons: biology, biochemistry, and chemical ecology. Cambridge: Cambridge University Press; 2010. [Google Scholar]
- Bortolus (2008).Bortolus A. Error cascades in the biological sciences: the unwanted consequences of using bad taxonomy in ecology. AMBIO. 2008;37:114–118. doi: 10.1579/0044-7447(2008)37[114:ECITBS]2.0.CO;2. [DOI] [PubMed] [Google Scholar]
- Boykin et al. (2011).Boykin LM, Armstrong KF, Kubatko L, De Barro P. Species delimitation and global biosecurity. Evolutionary Bioinformatics Online. 2011;8:1–37. doi: 10.4137/EBO.S8532. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breiman (2001).Breiman L. Random forests. Machine Learning. 2001;45:5–32. doi: 10.1023/A:1010933404324. [DOI] [Google Scholar]
- Chang et al. (2001).Chang C-W, Laird DA, Mausbach MJ, Hurburgh CR. Near-infrared reflectance spectroscopy–principal components regression analyses of soil properties. Soil Science Society of America Journal. 2001;65:480–490. doi: 10.2136/sssaj2001.652480x. [DOI] [Google Scholar]
- Clark (2003).Clark JY. Artificial neural networks for species identification by taxonomists. Bio Systems. 2003;72:131–147. doi: 10.1016/S0303-2647(03)00139-4. [DOI] [PubMed] [Google Scholar]
- Cole et al. (2003).Cole TJ, Ram MS, Dowell FE, Omwega CO, Overholt WA, Ramaswamy SB. Near-infrared spectroscopic method to identify Cotesia flavipes and Cotesia sesamiae (Hymenoptera: Braconidae) Annals of the Entomological Society of America. 2003;96:865–869. doi: 10.1603/0013-8746(2003)096[0865:NSMTIC]2.0.CO;2. [DOI] [Google Scholar]
- Dowell, Noutcha & Michel (2011).Dowell FE, Noutcha AEM, Michel K. The effect of preservation methods on predicting mosquito age by near infrared spectroscopy. American Journal of Tropical Medicine and Hygiene. 2011;85:1093–1096. doi: 10.4269/ajtmh.2011.11-0438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dowell et al. (1999).Dowell FE, Throne JE, Wang D, Baker JE. Identifying stored-grain insects using near-infrared spectroscopy. Journal of Economic Entomology. 1999;92:165–169. doi: 10.1093/jee/92.1.165. [DOI] [Google Scholar]
- Fischnaller et al. (2012).Fischnaller S, Dowell FE, Lusser A, Schlick-Steiner BC, Steiner FM. Non-destructive species identification of Drosophila obscura and D. subobscura (Diptera) using near-infrared spectroscopy. Fly. 2012;6:284–289. doi: 10.4161/fly.21535. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foley et al. (1998).Foley WJ, McIlwee A, Lawler I, Aragones L, Woolnough AP, Berding N. Ecological applications of near infrared reflectance spectroscopy—a tool for rapid, cost-effective prediction of the composition of plant and animal tissues and aspects of animal performance. Oecologia. 1998;116:293–305. doi: 10.1007/s004420050591. [DOI] [PubMed] [Google Scholar]
- Gaston & O’Neill (2004).Gaston KJ, O’Neill MA. Automated species identification: why not? Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 2004;359:655–667. doi: 10.1098/rstb.2003.1442. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hammer, Harper & Ryan (2001).Hammer O, Harper DAT, Ryan PD. PAST: paleontological statistics software package for education and data analysis. Palaeontologia Electronica. 2001;4:1–9. [Google Scholar]
- Hebert et al. (2004).Hebert PDN, Penton EH, Burns JM, Janzen DH, Hallwachs W. Ten species in one: DNA barcoding reveals cryptic species in the neotropical skipper butterfly Astraptes fulgerator. Proceedings of the National Academy of Sciences of the United States of America. 2004;101:14812–14817. doi: 10.1073/pnas.0406166101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jia et al. (2007).Jia F, Maghirang E, Dowell F, Abel C, Ramaswamy S. Differentiating tobacco budworm and corn earworm using near-infrared spectroscopy. Journal of Economic Entomology. 2007;100:759–764. doi: 10.1093/jee/100.3.759. [DOI] [PubMed] [Google Scholar]
- Klarica et al. (2011).Klarica J, Bittner L, Pallua J, Pezzei C, Huck-Pezzei V, Dowell F, Schied J, Bonn GK, Huck C, Schlick-Steiner BC, Steiner FM. Near-infrared imaging spectroscopy as a tool to discriminate two cryptic Tetramorium ant species. Journal of Chemical Ecology. 2011;37:549–552. doi: 10.1007/s10886-011-9956-x. [DOI] [PubMed] [Google Scholar]
- Lee et al. (2012).Lee S, Choi H, Cha K, Kim M-K, Kim J-S, Youn CH, Lee S-H, Chung H. Random Forest as a non-parametric algorithm for near-infrared (NIR) spectroscopic discrimination for geographical origin of agricultural samples. Bulletin of the Korean Chemical Society. 2012;33:4267–4270. doi: 10.5012/bkcs.2012.33.12.4267. [DOI] [Google Scholar]
- Liaw & Wiener (2002).Liaw A, Wiener M. Classification and regression by randomForest. R News. 2002;2:18–22. [Google Scholar]
- Liu et al. (2013).Liu M, Wang M, Wang J, Li D. Comparison of random forest, support vector machine and back propagation neural network for electronic tongue data classification: application to the recognition of orange beverage and Chinese vinegar. Sensors and Actuators B: Chemical. 2013;177:970–980. doi: 10.1016/j.snb.2012.11.071. [DOI] [Google Scholar]
- Lockey (1988).Lockey KH. Lipids of the insect cuticle: origin, composition and function. Comparative Biochemistry and Physiology Part B: Comparative Biochemistry. 1988;89:595–645. doi: 10.1016/0305-0491(88)90305-7. [DOI] [Google Scholar]
- Mayagaya et al. (2009).Mayagaya VS, Michel K, Benedict MQ, Killeen GF, Wirtz RA, Ferguson HM, Dowell FE. Non-destructive determination of age and species of Anopheles gambiae s.l. using near-infrared spectroscopy. The American Journal of Tropical Medicine and Hygiene. 2009;81:622–630. doi: 10.4269/ajtmh.2009.09-0192. [DOI] [PubMed] [Google Scholar]
- Menze et al. (2009).Menze BH, Kelm BM, Masuch R, Himmelreich U, Bachert P, Petrich W, Hamprecht FA. A comparison of random forest and its Gini importance with standard chemometric methods for the feature selection and classification of spectral data. BMC Bioinformatics. 2009;10:213. doi: 10.1186/1471-2105-10-213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Newey, Robson & Crozier (2008).Newey PS, Robson SKA, Crozier RH. Near-infrared spectroscopy identifies the colony and nest of origin of weaver ants, Oecophylla smaragdina. Insectes Sociaux. 2008;55:171–175. doi: 10.1007/s00040-008-0985-6. [DOI] [Google Scholar]
- Oliver et al. (2009).Oliver PM, Adams M, Lee MSY, Hutchinson MN, Doughty P. Cryptic diversity in vertebrates: molecular data double estimates of species diversity in a radiation of Australian lizards (Diplodactylus, Gekkota) Proceedings of the Royal Society B: Biological Sciences. 2009;276:2001–2007. doi: 10.1098/rspb.2008.1881. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pasquini (2003).Pasquini C. Near infrared spectroscopy: fundamentals, practical aspects and analytical applications. Journal of the Brazilian Chemical Society. 2003;14:198–219. doi: 10.1590/S0103-50532003000200006. [DOI] [Google Scholar]
- Perez-Mendoza et al. (2002).Perez-Mendoza J, Dowell FE, Broce AB, Throne JE, Wirtz RA, Xie F, Fabrick JA, Baker JE. Chronological age-grading of house flies by using near-infrared spectroscopy. Journal of Medical Entomology. 2002;39:499–508. doi: 10.1603/0022-2585-39.3.499. [DOI] [PubMed] [Google Scholar]
- Pfenninger & Schwenk (2007).Pfenninger M, Schwenk K. Cryptic animal species are homogeneously distributed among taxa and biogeographical regions. BMC Evolutionary Biology. 2007;7:121. doi: 10.1186/1471-2148-7-121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Quaresima, Lepanto & Ferrari (2003).Quaresima V, Lepanto R, Ferrari M. The use of near infrared spectroscopy in sports medicine. The Journal of Sports Medicine and Physical Fitness. 2003;43:1–13. [PubMed] [Google Scholar]
- Reich (2005).Reich G. Near-infrared spectroscopy and imaging: basic principles and pharmaceutical applications. Advanced Drug Delivery Reviews. 2005;57:1109–1143. doi: 10.1016/j.addr.2005.01.020. [DOI] [PubMed] [Google Scholar]
- Rifkin & Klautau (2004).Rifkin R, Klautau A. In defense of one-vs-all classification. The Journal of Machine Learning Research. 2004;5:101–141. [Google Scholar]
- Rodriguez-Fernandez et al. (2011).Rodriguez-Fernandez JI, de Carvalho CJB, Pasquini C, de Lima KMG, Moura MO, Carbajal Arizaga GG. Barcoding without DNA? Species identification using near infrared spectroscopy. Zootaxa. 2011;2933:46–54. [Google Scholar]
- Schlick-Steiner et al. (2006).Schlick-Steiner BC, Steiner FM, Moder K, Seifert B, Sanetra M, Dyreson E, Stauffer C, Christian E. A multidisciplinary approach reveals cryptic diversity in western palearctic Tetramorium ants (Hymenoptera: Formicidae) Molecular Phylogenetics and Evolution. 2006;40:259–273. doi: 10.1016/j.ympev.2006.03.005. [DOI] [PubMed] [Google Scholar]
- Seifert (2009).Seifert B. Cryptic species in ants (Hymenoptera: Formicidae) revisited: we need a change in the alpha-taxonomic approach. Myrmecological News. 2009;12:149–166. [Google Scholar]
- Seppä et al. (2011).Seppä P, Helanterä H, Trontti K, Punttila P, Chernenko A, Martin SJ, Sundström L. The many ways to delimit species: hairs, genes and surface chemistry. Myrmecological News. 2011;15:31–41. [Google Scholar]
- Shenk, Workman & Westerhaus (2008).Shenk JS, Workman JJ, Westerhaus MO. Application of NIR spectroscopy to agricultural products. In: Burns Ciurczak, DA EW., editors. Handbook of near-infrared analysis. Boca Raton: CRC Press; 2008. pp. 347–386. [Google Scholar]
- Sikulu et al. (2010).Sikulu M, Killeen GF, Hugo LE, Ryan PA, Dowell KM, Wirtz RA, Moore SJ, Dowell FE. Near-infrared spectroscopy as a complementary age grading and species identification tool for African malaria vectors. Parasites & Vectors. 2010;3:49. doi: 10.1186/1756-3305-3-49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith et al. (2008).Smith MA, Rodriguez JJ, Whitfield JB, Deans AR, Janzen DH, Hallwachs W, Hebert PDN. Extreme diversity of tropical parasitoid wasps exposed by iterative integration of natural history, DNA barcoding, morphology, and collections. Proceedings of the National Academy of Sciences of the United States of America. 2008;105:12359–12364. doi: 10.1073/pnas.0805319105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Steiner, Schlick-Steiner & Moder (2006).Steiner FM, Schlick-Steiner BC, Moder K. Morphology-based cyber identification engine to identify ants of the Tetramorium caespitum/impurum complex (Hymenoptera: Formicidae) Myrmecological News. 2006;8:175–180. [Google Scholar]
- Steiner et al. (2005).Steiner FM, Schlick-Steiner BC, Sanetra M, Ljubomirov T, Antonova V, Christian E, Stauffer C. Towards DNA-aided biogeography: an example from Tetramorium ants (Hymenoptera, Formicidae) Annales Zoologici Fennici. 2005;42:23–35. [Google Scholar]
- Steiner et al. (2010).Steiner FM, Seifert B, Moder K, Schlick-Steiner BC. A multisource solution for a complex problem in biodiversity research: description of the cryptic ant species Tetramorium alpestre sp.n. (Hymenoptera: Formicidae) Zoologischer Anzeiger. 2010;249:223–254. doi: 10.1016/j.jcz.2010.09.003. [DOI] [Google Scholar]
- Svetnik et al. (2003).Svetnik V, Liaw A, Tong C, Culberson JC, Sheridan RP, Feuston BP. Random forest: a classification and regression tool for compound classification and QSAR modeling. Journal of Chemical Information and Computer Sciences. 2003;43:1947–1958. doi: 10.1021/ci034160g. [DOI] [PubMed] [Google Scholar]
- Wilcox et al. (1997).Wilcox TP, Hugg L, Zeh JA, Zeh DW. Mitochondrial DNA sequencing reveals extreme genetic differentiation in a cryptic species complex of neotropical pseudoscorpions. Molecular Phylogenetics and Evolution. 1997;7:208–216. doi: 10.1006/mpev.1996.0388. [DOI] [PubMed] [Google Scholar]
- Williams & Norris (2001).Williams P, Norris K, editors. Near-infrared technology in the agricultural and food industries. St. Paul: American Association of Cereal Chemists; 2001. [Google Scholar]
- Youngentob et al. (2012).Youngentob KN, Renzullo LJ, Held AA, Jia X, Lindenmayer DB, Foley WJ. Using imaging spectroscopy to estimate integrated measures of foliage nutritional quality. Methods in Ecology and Evolution. 2012;3:416–426. doi: 10.1111/j.2041-210X.2011.00149.x. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.