Abstract
Legislation on the quality of water intended for human consumption requires routine taste and odour controls. So far, no procedures or technical documents exist which can be used as a reference in the training of sensory assessors for tap water. This work presents the procedure for the development of a trained panel and it describes all the steps carried out: the recruitment, pre-selection, selection and training phase considering the different odours and flavours that tap water may contain. In order to analyse the performance of the assessors in the training phase, 6 parameters and 15 criteria are proposed. The assessors who fulfilled the criteria, will integrate a qualified panel to carry out tap water sensory controls. This process has shown to be suitable and strict enough to train assessors on tap water evaluation, and can therefore function as a reference for other laboratories on which to base their training and qualification of assessor panels on tap water quality control.
Keywords: Drinking water, Quality control, Sensory assessor, Panel training, Chemical references, Sensory thresholds
Graphical abstract
Highlights
-
•
A method for setting up a trained panel for water sensory control was developed.
-
•
Proposal of chemical compounds and its concentrations to set up a sensory panel.
-
•
Proposal of parameters and criteria to select sensory assessors for water control.
-
•
Determination of threshold of chemical compounds that may be present in tap water.
1. Introduction
By definition, water is a clear liquid, without colour, odour or taste. However, water dissolves substances that can give it odour, taste, flavour and/or colour. Odour and taste compounds in tap water may have several origins, such as natural sources (for example biological activities of algae and heterotrophic microorganisms), anthropogenic contamination, or the treatment or distribution of tap water (Cees et al., 1974; Lin et al., 2019). Consumers mainly judge the quality of water by its taste and odour. They expect it to “taste good” and often associate off-flavours with possible health risks, which often leads to a lack of trust in water supply companies (Suffet et al., 2004). The odours and flavours are produced by substances that can be in very low concentrations that, although perceptible by humans, cannot be measured by instrumental methods (Sancho et al., 1999; Widen et al., 2005; Burlingame et al., 2017). Therefore, in the case of the European Union, the quality of water for human consumption compels water supply companies to carry out routine sensory controls in order to ensure that waters' taste and odour are acceptable to consumer and without abnormal changes (European Commission, 2020). The World Health Organization (WHO) also emphasises the sensory control of organoleptic characteristics of drinking water (WHO, 2022). Thus, in the guidelines for the quality of tap water, it was reported that it must be free of odours and tastes that can be unpleasant for consumers (WHO, 2022). Routine controls with consumers are unfeasible; therefore, to comply with these guidelines and with the previously cited directive (European Commission, 2020), laboratories could apply standardized methods for the determination of waters' flavour and odour by dilution number tests (European Standard, 2006; ASTM, 2021; American Public Health Association, American Water Works Association and Water Environment Federation, 2017) as indicated in previous directives (European Commission, 1980). To comply with goal trained assessors are needed (European Standard, 2006; ASTM, 2021; American Public Health Association, American Water Works Association and Water Environment Federation, 2017).
To set up a trained panel, specific selection and training processes need to be developed. Although there are several general standards for guidance on how to develop assessor selection and training processes (ISO, 2006; ISO, 2011; ISO, 2012), and also specific procedures for some products (ISO, 2023; International Olive Council, 2020; Pérez-Elortondo et al., 2007; Etaio et al., 2010; Callejo et al., 2015; Gutiérrez and Barrera, 2015; González-Casado et al., 2019), there are not procedures for water. A standard guide exists entitled “Standard methods for the examination of water and wastewater”, where compounds responsible for odour and taste are proposed for the training of tap water assessors (American Public Health Association, American Water Works Association and Water Environment Federation, 2017). There is also an article dedicated to the training and validation of a trained panel for mineral waters (Rey-Salgueiro et al., 2013) it does not detail any procedure (the training process, the description of the sessions or the tests, etc.). In addition, since its aim is the evaluation of bottled mineral waters and carbonated waters, it focuses on the characteristics of these products and the odour compounds used are not compounds previously detected in tap water.
This work aims to describe SUSPAW, a process to create a trained panel for the sensory evaluation of tap water, which includes describing the recruitment, selection, training, and final selection, and also the indicators and criteria that the assessors have to pass. SUSPAW constitutes a guide to design and carry out the creation of a sensory panel for water control that can be very useful for other laboratories working on this field.
2. Materials and methods
2.1. Facilities, apparatus, reference water and chemical compounds (CC)
2.1.1. Facilities
All tests were carried out in sensory evaluation booths designed according to ISO 8589 (ISO, 2007) in the sensory analysis laboratory at the University of the Basque Country (LASEHU), except for general training tests (first phase of the training) which were carried out in another room due to the COVID-19 pandemic (to ensure greater distances between assessors and also better air circulation).
2.1.2. Apparatus
Odour and flavour samples were presented as aqueous solutions. For odour evaluations, 50 mL of sample was served in covered transparent glasses (ISO, 1977). For flavour 40 mL of sample was served in 50 mL glasses to enable candidates to test samples several times before deciding on their answer and to taste the sample again once the exercise had been corrected. Samples were codified with 3-digit random numbers.
2.1.3. Reference water (RW)
RW is a water described as odourless and tasteless by the assessors' panel (European Standard, 2006). It was used to compare with the samples and determine if differences in odour/flavour intensity were detected; it was also used to prepare dilutions (the successive dilutions of drinking water samples and the dilutions of chemical references). The European Standard 1622 (European Standard, 2006) proposes different types of water that can be used for this purpose: tap water, bottled mineral water, or water prepared using activated carbon, but it does not indicate how to choose between these different options. Experience has shown us that not all waters are useful for these purposes: i) bottled mineral waters can provide different flavour depending on the mineral content; ii) tap water can have both odours and flavour and its organoleptic properties are not constant throughout the year; iii) water obtained by activated carbon requires a more laborious and expensive procedure.
After a preselection phase involving several waters (milliQ, distilled and tap water, and three bottled waters [Aquabona by Santolín spring, Fontecelta and Evian]) carried out by five members from the research team, it was determined that bottled mineral waters had lower levels of odours and flavour.
To select the RW among the mineral waters, the three mineral waters were compared using unforced triangular tests by 34 assessors (who had previously passed the preselection and selection phases). The test was carried out twice (n = 68). In each session, assessors monadically evaluated six sample triads for odour and six sample triads for flavour. If assessors detected differences in the odour/flavour intensity among the samples of the triad, they had to indicate which sample was different and why by choosing either: "smells/tastes more" or "smells/tastes less". The six possible sample presentation orders were presented the same number of times.
According to the results of the odour tests, there were no statistically significant differences between the three waters (α = 0.05). For flavour, the differences were statistically significant between Evian and Fontecelta (Evian has a higher intensity of flavour) and between Aquabona and Fontecelta (it was not possible to know which water had a higher intensity of flavour). Therefore, Evian was excluded as a possible RW, and Aquabona (Santolín spring, by Coca-Cola) was selected for availability reasons. Aquabona has weak mineralization and low sodium content. Its chemical composition is the following, expressed as mg/L: dry residue (180 °C): 271; bicarbonates: 276; sulphates: 6.5; chlorides: 4.4; calcium: 92.2; magnesium: 2.8; sodium: 2.0.
2.1.4. Chemical compounds (CC)
For the specific training, odour and flavour compounds reported as present in water and recommended for the specific training of drinking water panels (American Public Health Association, American Water Works Association and Water Environment Federation, 2017) were used. Some of them are also included in general assessors' selection and training standards (ISO, 2006; ISO, 2011; ISO, 2012). The concentration of the references prepared with these CC was adjusted throughout the different phases of the study, according to the objective of each test.
Odour and flavour CC and concentrations used during all the process are shown in Table 1, Table 2.
Table 1.
Tests, CC and concentrations used in the selection of sensory assessors.
CC: chemical compounds; [C]: concentration; RW: reference water. In the “CC” and “[C]” columns: grey lines indicate odour and white lines flavour. aTests/CC/[C] proposed by ISO 8586 (ISO, 2012). CC/[C] proposed by: bAPHA, AWWA and WEF (American Public Health Association, American Water Works Association and Water Environment Federation, 2017); cInternal criterion; dISO 5496 (ISO, 2006); fISO 3972 (ISO, 2011). eAt the first time, CC nº 1, 2, 3 and 4 were presented and in the repetition of the test CC nº 1, 2, 3 and 5. gAt the first time, all CC except nº 9 were presented and in the repetition all CC except nº8. hTwo CC were presented twice: At the first time, CC nº 1 and 6 were presented twice and in the repetition CC nº 2 and 4.
Table 2.
Training phase tests, chemical compound and concentrations.
CC: chemical compounds; [C]: concentration; RW: reference water; S: session; CP: Control pairs. The series were made up of three samples. In the “CC” and “[C]” columns: grey lines indicate odour and white lines flavour. aTest/CC/[C] proposed by ISO 8586 (ISO, 2012); CC/[C] proposed by: bAPHA, AWWA and WEF (Pérez-Elortondo et al., 2007); cInternal criterion; dISO 5496 (ISO, 2006); eISO 3972 (ISO, 2011). All flavour CC were proposed by ISO (ISO, 2011; ISO, 2012) and APHA, AWWA and WEF (American Public Health Association, American Water Works Association and Water Environment Federation, 2017).
2.2. Phases for sensory panel development
The process of panel development was carried out in the four different phases described below.
2.2.1. Recruitment
To recruit the candidates a message was distributed using different means: emails to consumers included in the laboratory's database, internal dissemination through the university, social media, etc. The interested candidates had to complete a questionnaire with their data (name and surname, place of residence, employment status, and smoking habits), and their availability during the week.
On the basis of an estimate of 40 samples to be evaluated per month in four sessions for the future routine quality control, the objective was to form a panel of 20 assessors.
According to ISO 8586 (ISO, 2012), at least two or three times the number of assessors needed should be recruited. Teillet reported recruiting 74 candidates to form a panel of 15 water assessors (Teillet, 2009). As a result, in the present study, 91 candidates were recruited (out of a total of 135 interested people) to begin the preselection phase (Table 3).
Table 3.
Number of candidates who started, completed and passed each phase.
| Phase | Starting candidates | Candidates who passed the criteria (n and %) | |
|---|---|---|---|
| Recruitment | 135 (71/64) | 91 (50/41) | 67 |
| Preselection | 78 (45/33) | 61 (37/24) | 78 |
| Selection | 46a (30/16) | 36 (26/10) | 78 |
| Training | 35b (25/9) | 22 (17/5) | 61 |
Numbers in brackets: women/men.
49 candidates started the selection phase, but 3 of them did not complete it.
36 candidates started the training phase but, one of them did not complete it.
The criteria used to preselect candidates from those interested people included the following: under 60 years old, place of residence in Vitoria-Gasteiz, non-smokers, and non-students.
2.2.2. Preselection
The aim was to detect and exclude those candidates who were significantly unable to detect odours in water.
A triangle test (ISO, 2021) was used to accomplish the objective: 10 odour triads were presented, which consisted of two samples of an odorous CC diluted in water and one sample of milli Q water (odourless sample), or one sample of an odorous CC diluted in water and two samples of milli Q water. Each sample (S) was presented in the two types of triads (1RW – 2S: 1 RW samples and 2 CC dilution sample; 2RW – 1S: 2 RW sample and 1 CC dilution samples).
The odorous CC used were those that frequently appear in tap water (Lin et al., 2019; Zhang et al., 2022): a mixture of geosmin and 2-methylisoborneol (5 and 10 ng/L, respectively) (Piriou et al., 2009; Kakimoto et al., 2014; Zamyadi et al., 2015; Shawwa et al., 2022), 4-chlorophenol (4 μg/L) and 2,4-dichlorophenol (8 and 16 μg/L) (Zhang et al., 2022; Jiang et al., 2023; Bruchet et al., 2008). All concentrations were determined based on preliminary tests carried out by the research team. A commercial mixture of geosmine and 2-methylisoborneol (AccuStandard) was used because the two compounds belong to the same family of odours: earthy/musty/mouldy (American Public Health Association, American Water Works Association and Water Environment Federation, 2017).
All candidates evaluated the triads in the same order. The samples were presented to the candidates in two groups of five triads. Between the groups, the candidates took a 5 min rest.
The preselection test was considered passed if the following criteria were fulfilled: at least one correct answer for each compound used in the test (as the main aim of the criteria was to make sure that the candidates perceived the CC as they appear commonly in tap water) and at least 60% of correct answers (to pre-select those candidates with the higher acuity, also taking into account that the used concentrations were a bit higher than the threshold).
2.2.2.1. Selection
Before initiating the selection phase, an e-mail was sent to each candidate with information about the basic guidelines for carrying out the sensory analysis tests.
The aim of the selection tests were to detect smelling and tasting problems, to check the sensory acuity of the candidates and to evaluate their ability to describe and communicate sensory perceptions (ISO, 2012). In order to achieve this, the tests described in Table 1 were carried out twice through four sessions of 90 min each. All candidates conducted the same tests in the same order.
The criteria to overcome the selection phase was to respond correctly to no less than 60% of the trials in at least six of the eight tests.
2.2.3. Training
Training was carried out in three phases organised according to the objective to be achieved in each one (Fig. 1).
Fig. 1.
Phases of the training. TTS: Taste and trigeminal sensations; Odour/TTS paired comparison I: samples prepared with chemical compounds; Odour/TTS paired comparison II: samples were tap water from different municipalities and its dilutions. aA Phase designed according to ISO standards (ISO, 2006; ISO, 2011; ISO, 2012) and the methodology that the panel would use in the future routine controls. bTest proposed by ISO 8586 (ISO, 2012); cTest proposed by internal criterion; dTest proposed by ISO 5495 (ISO, 2005). eUnforced-choice paired comparison tests.
At the beginning of the training phase, high concentrations were used so that assessors could clearly identify and perceive the odour or flavour emitted by each CC and to learn to recognise and differentiate among them. As the sessions progressed, the concentrations were gradually decreased until they were perceived by three-quarters of the panel (Table 2).
A total of 22 training sessions of approximately 90 min were held over seven months. Assessors did not attend more than one session per week.
2.2.3.1. First phase: familiarization with sensory tests and CC
The aim of this first phase was to develop the ability to recognise, describe, and distinguish sensory stimuli that may appear in tap water, and to train assessors to detect very low concentrations.
In all sessions, after carrying out the tests individually, the answers were checked and assessors smelled or tasted the samples again, and discussed the difficulties. To avoid sensory fatigue, odour and flavour tests were alternated and, where it was not possible, breaks of 10 min were established between consecutive tests.
The paired comparison odour tests were based on those described in the ISO standard (ISO, 2005), but with the following variations: unforced selection, sample pairs where both were RW, pairs with the same concentration of the same compound, pairs with different concentrations of the same compound, and, in some cases, questions about intensity and descriptors. WR pairs or pairs with samples with the same concentration were used as controls to detect assessors who tended to answer even when there were no differences between samples.
Besides training in detecting odour compounds that may appear in tap water, assessors began to familiarise themselves with evaluating tap water samples. Therefore, in some sessions samples prepared with odour CC were used, while in other sessions samples prepared from tap water and its dilutions were used.
Concentrations of the CC were adjusted according to the correct answer percentage of the previous session, and based on the results for each pair (S - RW), until about three-quarters of the panel perceived the odour.
In the sessions focused on evaluating tap water samples and its dilutions, tap water samples from several municipalities were used. The samples were presented as a series of three concentrations: the sample (FD1), half-diluted sample (FD2) and quarter-diluted sample (FD4). The series were always presented in order of increasing concentrations, starting with the most diluted (FD4). One of the series was presented twice to check the repeatability of the assessors.
2.2.3.2. Second phase: familiarization with the routine control method
The second phase aimed to train and familiarise the assessors with the method. These sessions reproduced what would later be performed in routine tap water control sessions, once the panel had been formed. The method was based on the determination of the TON and TFN (European Standard, 2006).
2.2.3.3. Third phase: determination of the individual odour threshold
The third phase aimed to determine the individual odour thresholds for the four compounds most frequently found in water (Lin et al., 2019) in order to calculate the panel thresholds (Piriou et al., 2009). Different concentrations of each compound were presented (Table 2) at increasing concentrations. A maximum of 15 pairs of samples were evaluated in each session. To avoid sensory fatigue, assessors had to rest for a minute between pairs of samples, and 5 min between the 5th and 6th and 10th and 11th pairs.
If there were any inconsistencies in the assessor’s responses (they perceived a stimulus at lower concentrations and did not perceive it at higher concentrations), the evaluation of the sample in question was repeated. If in the second evaluation this incoherence in perception was repeated, the lowest concentration detected without any incoherence was recorded as the detection threshold.
From the individual thresholds determined in these tests, a panel threshold was calculated according to the method described by Lawless (2010). The panel threshold was the concentration in which 75% of the assessors perceived differences between the sample and the RW (International Olive Council, 2020).
2.2.4. Final selection
In order to evaluate the competence of the assessors in the training process, six parameters and 15 criteria were established (Table 3). Studied parameters were established based on the results of the three training phases: familiarization with sensory analysis tests and CC (7th to 15th sessions); familiarization with the method of these familiarity tests (16th to 20th sessions), and individual odour threshold determination tests (21st to 22nd sessions).
To pass the training phase and be incorporated into the panel, assessors had to overcome at least 10 of the 15 criteria (66%) (Table 3). When an assessor passed the final selection, her/his attitude during the training (sessions' attendance, responsibility …) was also taken into consideration.
3. Results and discussion
3.1. Assessor preselection, selection and panel training
Table 3 shows the number of assessors who started, finished and passed each training phase, and the final selection. From the 91 recruited candidates, 78 began the process. Not all candidates who passed the recruitment began the preselection, and the same happened in the selection, for various reasons: unavailability, lack of interest in evaluating always the same product, illness and change of residence. After the entire process, a panel of 22 assessors was formed. Table 3 also shows the ratio of women and men who started and finished each phases. Although recruited women/men ratio was 1.2, the women/men ratio for assessors making up the final panel was 3.4. These results may suggest that women have greater sensory acuity than men, a fact that has also been reported by other authors (Pepino and Mennella, 2007). Regarding the influence of age on sensory abilities, the literature reports that capacity decreases with age (Burlingame et al., 2017; Doty et al., 2001). Fot this reason, people over sixty years were excluded in the recruitment process. In this study, 20 candidates aged 18–35 started the pre-selection tests, 32 candidates aged 36–50 and 26 candidates aged 51–59 and became panel members 9 (45.0%), 10 (31.3%) and 3 (11.5%), respectively. Thus, the candidates with the highest pass rate were the youngest.
3.1.1. Preselection
Table 5 shows the concentrations detected by approximately 75% of participants.
Table 5.
Preselection phase results: correct answers for each chemical compound, concentration and triad type used in the triangle test.
| CC and [C] | Correct answersa |
||
|---|---|---|---|
| Triad type |
Total |
||
| 1RW – 2S | 2RW – 1S | ||
| 4-Chlorophenol (4 μg/L) | 65 (83.3%) | 50 (64.1%) | 115 (73.1%) |
| 2,4-Dichlorophenol (8 μg/L) | 49 (62.8%) | 56 (71.8%) | 105 (67.2%) |
| 2,4-Diclorophenol (16 μg/L) | 57 (73.1%) | 61 (78.2%) | 118 (75.6%) |
| Geosmin/2-methylisoborneol (5 ng/L) | 54 (69.2%) | 57 (73.1%) | 111 (71.1%) |
| Geosmin/2-methylisoborneol (10 ng/L) | 57 (73.1%) | 66 (84.6%) | 123 (78.6%) |
| Total correct answers | 282 (72.3%) | 290 (74.4%) | 572 (73.3%) |
CC: chemical compound; [C]: concentration; RW: reference water; S: sample = chemical compound (CC) dilution. 1RW – 2S = 1 RW sample and 2 CC dilution sample; 2RW – 1S = 2 WR samples and 1 CC dilution sample.
156 triads were evaluated for each CC concentration, 78 triads for each triad type. Total presented triads = 780 (390 1RW-2S and 390 2RW-1S).
There was little difference in the number of correct answers among the different compounds (between 67% and 78% correct answers). The triad with the greatest difficulty to obtain correct answers was that containing low concentration of 2,4-dichlorophenol.
3.1.2. Selection
The results of the selection tests are shown in Table 6. From the 49 candidates who started the selection phase, 46 completed the entire process. All tests were passed by at least 31 assessors (67.4%), except for the odour stimulus description test, which was only passed by 17 assessors (37.0%). That test proved to be the most difficult, since candidates, in addition to detecting and arranging different intensities, also had to assign descriptors. Another factor that could have influenced the results was that participants were not used to these kinds of odour compounds.
Table 6.
Selection phase results: Average of the correct answers for each test and number and percentage of assessors passing each test.
| Test | Average of correct answers (%) | Assessors passing the test (% in brackets) |
|---|---|---|
| Pairing test | 82.4 | 41 (89.1) |
| 84.5 | 42 (91.3) | |
| Triangle | 73.2 | 39 (84.8) |
| 71.2 | 42 (91.3) | |
| Ranking | 67.3 | 33 (71.7) |
| 94.6 | 46 (100) | |
| Stimulus description/identification | 51.5 | 17 (37.0) |
| 65.6 | 31 (67.4) | |
In the second and third columns: grey lines: odour; white lines: flavour.
3.1.3. Training
In order to evaluate the results of the first phase, two parameters and three criteria were established (Table 4). 72.7% and 93.9% of the assessors fulfilled these criteria.
Table 4.
Studied parameters and criteria established for the final selection of the assessors. This table also includes the number (and percentage) of candidates who passed each criterion.
CC: chemical compound; CP: control pairs; RW: reference water; [C]: concentration; NPD: I do not perceive any difference. In the “criteria” and “candidates who passed the criteria” columns: grey lines indicate odour and white lines flavour.
In the second phase, five parameter were established (Table 4). The results for the parameter “control pair” (CP) were better in the first phase than in the second, which may be because only tap water samples were evaluated in the 2nd phase, as it is easier to detect a sample without odour/flavour in pairs where one of them has a fairly clear odour/flavour than in pairs with tap water where the odour/flavour difference was very subtle. Hence, the importance of the training to reduce the predisposition of some assessors to mark one of the samples as the most intense in odour/flavour even when clear differences are not perceived, and also considering that method applies an unforced selection. Furthermore, in the second phase, the parameter which the lowest rate of assessors passed (42.4% in odour and 39.4% in flavour), was repeatability. This could have been caused by several factors, such as fatigue (since the three repeated pairs were presented at the beginning and at the end of the evaluation session) or the random response (marking a sample as more intense in odour/flavour without being sure of it), which provided different results between the two evaluations. Regarding the parameter “agreement” in odour tests, 87.9% of the assessors perceived odour at the panel threshold concentration. For flavour, the percentage of assessors perceiving them at panel threshold concentrations was reduced to 45.5%.
Finally, to evaluate the results of the third phase, two parameters related to the individual threshold were established (Table 4) with the aim to ensure a minimum threshold and to obtain a homogeneous threshold panel. The results for those two parameters were positive: 87.9% detects the greatest concentration of at least three of five CC and 60.6% detects the panel threshold concentration.
To overcome the training phase and become part of the panel, assessors had to overcome at least 10 of the 15 criteria included in Table 4. Twenty-three assessors achieved but one of them did not become part of the panel because she reported that she would not be available for several months, so the panel was made up of 22 assessors: 17 women (77,3%) and five men (22,7%) between 30 and 55 years old.
Although there were no references to guide the definition of passing criteria, all the criteria established (Table 4) were shown to be appropriate for the purposes they were designed for, so the recommendation is to maintain all of them. In fact, the parameters and criteria used have allowed to select the assessors and discard those assessors with the worst results, also allowing to select an appropriate number to constitute the panel. It might be interesting to detect those assessors who perceive some of the CC at lower concentrations (lower individual thresholds) than the majority of the assessors with the purpose of removing them from the final panel, in order to avoid non-concordance in results in the systematic evaluations of samples.
Table 7 shows the data obtained from the paired comparison tests carried out during the last sessions of the first phase of the training. This table displays the concentrations of odorous CC for which, at the end of the training, at least 75% of the assessors perceive differences between the sample and the RW. Dimethyl trisulphide was excluded due to the marked inconsistency in the responses.
Table 7.
The odour/flavour produced by the CC used in the procedure according to the literature and the concentrations for which nearly 70% of the assessors perceived odour differences with respect to reference water in the last sessions of the first phase of training.
| CC | Odour/flavour characteristics |
[C] |
% of assessors who perceived |
|
|---|---|---|---|---|
| Family | Specific | |||
| Geosmin∗a | Earthy/Musty/Mouldya | Earthy, red beetsa | 2,5 ng/L | 76.7 |
| 2-Methylisoborneol∗a | Musty, earthy, peat-like, Brazil nut, soila | 4 ng/L | 77.4 | |
| 2-Isopropyl-3-methoxypyrazine | Earthy, potato bina | 0,25 ng/L | 93.9 | |
| Hexanala | – | Lettuce heart, pumpkin, Green pistachioa | 8 μg/L | 78.8 |
| Decanala | Fragant/vegetable/fruity/flowerya | Fruity, orange likea | 30 μg/L | 77.4 |
| trans-2,cis-6-Nonadienal∗ | Cucumber, green vegetationa | 2 μg/L | 71.9 | |
| cis-3-Hexen-1-ol∗a | Grassy/hay/straw/woodya | Grassy (green, Sharp), green applea | 4 μg/L | 75.0 |
| cis-3-Hexenyl acetate∗a | Grassy (fresh, sweeta | 5 μg/L | 70.0 | |
| β-cyclocitral∗a | hay/woodya | 60 μg/L | 82.1 | |
| Dimethyl disulphide∗a | Marshy/Swampy/Septic/sulphurousa | Decaying vegetation, septica | 4 μg/L | 77.4 |
| Hydrogen sulphide∗a | Rotten eggs a | 85 μg/L | 82.1 | |
| Isopropyl mercaptan∗a | Onion | 15 μg/L | 73.3 | |
| MtBE∗a | Chemical/Hydrocarbon miscellaneousa | Sweet solvena | 40 μg/L | 74.2 |
| trans, trans-2,4-Heptadienal∗a | Fishy/rancida | Rancid fisha | 10 μg/L | 75.0 |
| Octanala | – | 8 μg/L | 78.8 | |
| 4-Chlorophenol∗a | Medicinal/Phenolic a | Medicinal a | 10 μg/L | 90.9 |
| 2,4-Dichlorophenol∗a | Medicinal a | 0,55 μg/L | 80.0 | |
| Iodomethane∗a | – | 2 mg/L | 93.9 | |
| 2,3-Dichloroanisoleb | – | Leather, earthya | 3 μg/L | 86.7 |
| Phenola | – | – | 200 μg/L | 78.8 |
| 1-Dodecanola | 0,1 μg/L | 70.0 | ||
| Flavour | ||||
| Caffeinea,c | Bittera | Bittera,c | 0,14 g/L | 77.4 |
| Sodium chloridea,c | Saltya | Saltya,c | 0,35 g/L | 73.5 |
| Ferrous sulphate heptahydratea,c | Mouth/nose feela | Metalica,c | 0,001 g/L | 79.4 |
| Tannic acidc | – | Astringentc | 0,08 g/L | 77.4 |
Confirmed in drinking water∗. CC: chemical compound; [C]: concentration.
APHA, AWWA and WEF (American Public Health Association, American Water Works Association and Water Environment Federation, 2017).
Based on 2,3,6-Trichloroanisole proposed by APHA, AWWA and WEF (American Public Health Association, American Water Works Association and Water Environment Federation, 2017).
ISO 8586 (ISO, 2012).
Regarding the panel odour detection thresholds (calculated from the data of individual odour thresholds) for four of the most common compounds in tap water (geosmine, 2-methylisoborneol, 2,4-dichlorophenol and 4-chlorophenol), obtained threshold for geosmine (3.9 ng/L) and 2-methylisoborneol (6.4 ng/L) were similar to the concentration range found in the literature: 5–10 ng/L (Wang and Suffet, 2006; Mallevialle and Suffet, 1987; Suffet et al., 1995). In the case of 2,4-dichlorophenol, the threshold concentration (3.6 μg/L) was similar to the concentration specified in another study: 1.4 μg/L (Czerny et al., 2008). For 4-chlorophenol, the calculated threshold was 12.4 μg/L, similar to that obtained in another study: 20 μg/L (Young et al., 1996); although the temperature used was considerably higher (40 °C).
3.2. Validation of the procedure after training
Test were conducted after all training to evaluate the performance of the panel resulting from the selection and training procedure. For that, the five parameters evaluated during the training phase (Table 4) were monitored. The mean percentage of correct answers provided by this panel one year after starting the routine water controls (a total of 44 sessions; 6–8 sessions per assessor) for odour and flavour, respectively, were the following: CP = 69.0% and 70.0%; agreement = 83.2% and 83.7%; incoherences = 8.4% and 6.6%; wrong answers = 9.1% and 11.2% and panel repeatability = 72.2% and 81.9%. The authors consider these data to be satisfactory and they demonstrate the validity of SUSPAW.
3.3. Difficulties observed and recommendations
3.3.1. Overlapping of similar sensations
In the description of odour stimuli, difficulty in recognizing and distinguishing among CC that produce odours classified in the same family (family classification by American Public Health Association [APHA], American Water Works Association [AWWA] and Water Environment Federation [WEF] (American Public Health Association, American Water Works Association and Water Environment Federation, 2017)) was observed: 4-clorophenol and 2,4-diclorophenol for medicinal odour; geosmin and 2-methylisoborneol for earthy/musty/mouldy odour; dimethyl disulphide, dimethyl trisulphide, hydrogen sulphide and isopropyl mercaptan for marshy/swampy/septic/sulphurous odour; octanal, decanal and hexanal for vegetable/fruity/flowery odour, and cis-3-hexenyl acetate and cis-3-hexen-1-ol for grassy odour. There were also difficulties in recognizing and distinguishing between CC from different odour families, such as vegetable/fruity and grassy. Human variability in odour detection has been described by several authors (Dietrich et al., 2014; Dietrich and Burlingame, 2020; Phetxumphou et al., 2017; Yeshurun and Sobel, 2010). Such variability may be due to different factors like genetic (Doty et al., 2011), intricate biochemical reactions that can lead to differences in perceptions and descriptors (Dietrich and Burlingame, 2020) and also by the previous personal experience and memory (Köster et al., 2014).
As far as flavour compounds are concerned, the greatest difficulty was the identification of caffeine and ferrous sulphate heptahydrate, since the assessors did not know which sensation was perceived in each case. With caffeine, they doubted between bitter and metallic. With ferrous sulphate heptahydrate, although at higher concentrations metallic sensation was clearly perceived, at low concentrations it was confused with a sensation of bitterness. This observation has been reported by other authors who have reported ferrous iron as metallic, bitter and also astringent (Omur-Ozbek and Dietrich, 2011; Glindemann et al., 2006; Lim and Lawless, 2006; Yang and Lawless, 2005).
Therefore, it is important to begin the training with high concentrations of odourous and flavour CC in order to allow clear perception and identification of the sensation that each compound produces, and continue to reduce it gradually. It is also important to correct the tests and return the results to the assessors so they can evaluate the samples again once they know the result.
3.3.2. Concentrations to initiate training
For some odour CC, it is recommendable to begin training with higher concentrations, since the concentrations used in the first sessions of this training process did not permit a clear recognition of the associated odour. Thus, for phenol, hexanal and cis-3-hexen-1-ol, concentrations used in the second session are recommended; for the decanal, with the concentration used in the third session; and for MtBE and 4-chlorophenol, with the concentration used in the fourth session (Table 2).
As far as iodomethane goes, the use of very high concentrations is not recommended since its odour quality varies depending on the concentration: in water-related literature it is classified in the family of medicinal compounds (American Public Health Association, American Water Works Association and Water Environment Federation, 2017; Richardson, 2003), but, in this training, at high concentrations (500 mg/L) its odour was garlic-like. However, at lower concentrations (75 mg/L), it was described as medicine-like. Since it is highly unlikely to find these high concentrations in tap water, the concentration used in the second session would be suitable for initiating training (Table 2).
Regarding flavour compounds, the concentrations proposed for ferrous sulphate heptahydrate by the ISO standard (0.0036 g/L) (ISO, 2011) is too low for use in the first sessions, so slightly higher concentrations (approximately 0.01 g/L) are proposed for the initiation of training.
On the contrary, the concentration proposed by for tannic acid (1 g/L) was considered to be too high, so initiating training with lower concentrations (such as 0.7–0.8 g/L) is recommended. In addition, it was observed that tannic acid left a permanent residual sensation in the mouth, so, when the concentrations of tannic acid are high, it is proposed to evaluate these samples the last, so as not to affect the evaluation of the next samples.
3.3.3. Avoiding highly volatile CC for evaluating assessors' aptitudes
Dimethyl disulphide and trimethyl disulphide are highly volatile CC and they caused incoherent results (higher concentrations did not always elicit greater intensity of sensation). For dimethyl disulphide, the problem was solved by preparing the solution immediately prior to the evaluation and evaluating those samples first at the beginning of the session or after the rest. Nevertheless, for trimethyl disulphide the problem was not resolved. We therefore recommend using it in the training phase as it can be present in tap water, but not considering it in the final selection of assessors.
3.3.4. Feedback of test results to the assessors
Throughout the selection and training sessions, it is important to correct the results of each test just after doing them and give the assessors some minutes to smell/taste samples again, in order to improve their training.
4. Conclusions
The procedures described in this article have been demonstrated to be valid, complete, and rigorous enough for the preselection, selection, and training of assessors for tap water evaluation and also to recommend a series of parameters and criteria to be used in the process. SUSPAW is a useful tool for other laboratories in the process of forming tap water assessors' panels, as they could use the same procedure (phases, tests, CC and concentrations, and criteria for overcoming each phase) in order to design their own training process and optimise their time. In addition, the results of this present work facilitate the selection of concentrations for many compounds, which will help to reduce the number of sessions and previous tests necessary to design the process and/or the number of samples presented during training.
Since water is a product which requires high sensory acuity, the selection processes must be very rigorous. Therefore, in contrast to what was stipulated in the ISO 8586 (ISO, 2012) for this product, and based on the laboratory experience, the recruitment of at least four or five times the number of assessors required to form the final panel is recommended.
CRediT authorship contribution statement
Garazi de la Fuente Aldazabal: Conceptualization, Methodology, Data curation, Formal analysis, Writing – original draft. Iñaki Etaio Alonso: Conceptualization, Methodology, Writing – review & editing. Maria del Pilar Fernández Gil: Conceptualization, Methodology, Data curation. Mónica Ojeda Atxiaga: Conceptualization, Methodology, Data curation. Wendy Alicia Rivera Ramos: Conceptualization, Data curation. Francisco José Pérez-Elortondo: Conceptualization, Methodology, Supervision, Writing – review & editing, Resources, Project administration, Funding acquisition.
Funding source
This work was supported by Consorcio de Aguas Bilbao Bizkaia/Bilbao Bizkaia Ur Partzuergoa (CABB/BBUP). It only had financial sponsor role.
Declaration of competing interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgements
The authors thank all those involved in the process, especially assessors and Consorcio de Aguas Bilbao Bizkaia/Bilbao Bizkaia Ur Partzuergoa (CABB/BBUP) for their collaboration.
Contributor Information
Garazi de la Fuente Aldazabal, Email: garazi.delafuente@ehu.eus.
Iñaki Etaio Alonso, Email: inaki.etaio@ehu.eus.
Maria del Pilar Fernández Gil, Email: mariadelpilar.fernandez@ehu.eus.
Mónica Ojeda Atxiaga, Email: monica.ojeda@ehu.eus.
Wendy Alicia Rivera Ramos, Email: wendyalicia.rivera@ehu.eus.
Francisco José Pérez-Elortondo, Email: franciscojose.perez@ehu.eus.
Data availability
No data was used for the research described in the article.
References
- American Public Health Association, American Water Works Association and Water Environment Federation . Standard Methods for the Examination of Water and Wastewater. 23rd ed. American Public Health Association; Washington: 2017. [Google Scholar]
- ASTM . American Society for testing and Materials Committee; 2021. Standard D1292-15(2021)e1. Standard Test Method for Odor in Water. [Google Scholar]
- Bruchet A., Prolongeau C., Esperanza M., Coquery M. Where do the odorous halogenated phenols in drinking water resources come from? Water Sci. Technol. Water Supply. 2008;8(3):263–269. doi: 10.2166/ws.2008.070. [DOI] [Google Scholar]
- Burlingame G.A., Doty R.L., Dietrich A.M. Humans as sensors to evaluate drinking water taste and odor: a Review. J. - Am. Water Works Assoc. 2017;109(11):13–24. doi: 10.5942/jawwa.2017.109.0118. [DOI] [Google Scholar]
- Callejo M.J., Vargas-Kostiuk M.E., Rodríguez-Quijano M. Selection, training and validation process of a sensory panel for bread analysis: influence of cultivar on the quality of breads made from common wheat and spelt wheat. J. Cereal. Sci. 2015;61:55–62. doi: 10.1016/j.jcs.2014.09.008. [DOI] [Google Scholar]
- Cees B., Zoeteman J., Piet G.J. Cause and identification of taste and odour compounds in water. Sci. Total Environ. 1974;3(1):103–115. doi: 10.1016/0048-9697(74)90042-4. [DOI] [PubMed] [Google Scholar]
- Czerny M., Christlbauer M., Christlbauer M., Fischer A., Granvogl M., Hammer M., Hartl C., Moran Hernandez N., Schieberle P. Re-investigation on odour thresholds of key food aroma compounds and development of an aroma language based on odour qualities of defined aqueous odorant solutions. Eur. Food Res. Technol. 2008;228:265–273. doi: 10.1007/s00217-008-0931-x. [DOI] [Google Scholar]
- Dietrich A.M., Burlingame G.A. A Review: the challenge, consensus, and confusion of describing odors and tastes in drinking water. Sci. Total Environ. 2020;713 doi: 10.1016/j.scitotenv.2019.135061. [DOI] [PubMed] [Google Scholar]
- Dietrich A.M., Phetxumphou K., Gallagher D.L. Systematic tracking, visualizing, and interpreting of consumer feedback for drinking water quality. Water Res. 2014;66:63. doi: 10.1016/j.watres.2014.08.007. [DOI] [PubMed] [Google Scholar]
- Doty R.L. In: Functional Neurobiology of Aging. Hof P.R., Mobbs C.V., editors. Academic Press; San Diego, California: 2001. Olfaction and gustation in normal aging and alzheimer's disease. [Google Scholar]
- Doty R.L., Petersen I., Mensah N., Christensen K. Genetic and environmental influences on odor identification ability in the very old. Psychol. Aging. 2011;26(4):864. doi: 10.1037/a0023263. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Etaio I., Albisu M., Ojeda M., Fernández-Gil M.P., Salmerón J., Pérez-Elortondo F.J. Sensory quality control for food certification: a case study on wine. Panel training and qualification, method validation and monitoring. Food Control. 2010;21(4):542–548. doi: 10.1016/j.foodcont.2009.08.011. [DOI] [Google Scholar]
- European Commission . Official Journal of European Communities; 1980. Council Directive (EU) 80/778/EEC of 15 July 1980 Relating to the Quality of Water Intended for Human Consumption.https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=celex%3A31980L0778 [Google Scholar]
- European Commission Directive (EU) 2020/2184 of the European Parliament and of the Council of 16 December 2020 on the quality of water intended for human consumption. Off. J. Eur. Union. 2020;L 435/1 https://eur-lex.europa.eu [Google Scholar]
- European Standard . European Committee for Standardization; 2006. Standard 1622. Water Quality - Determination of the Threshold Odour Number (TON) and Threshold Flavour Number (TFN) [Google Scholar]
- Glindemann D., Dietrich A., Staerk H.J., Kuschk P. The two odors of iron when touched or pickled: (skin) carbonyl compounds and organophosphines. Angew. Chem., Int. Ed. 2006;45(42):7006–7009. doi: 10.1002/anie.200602100. [DOI] [PubMed] [Google Scholar]
- González-Casado A., Jiménez-Carvelo A.M., Cuadros-Rodríguez L. Sensory quality control of dry-cured ham: a comprehensive methodology for sensory panel qualification and method validation. Meat Sci. 2019;149:149–155. doi: 10.1016/j.meatsci.2018.11.021. [DOI] [PubMed] [Google Scholar]
- Gutiérrez N., Barrera O.M. Panel selection and training in the sensory analysis of coffee Coffea Arabica L. Rev. Cienc. Agr. 2015;32(2):77–87. doi: 10.22267/rcia.153202.15. [DOI] [Google Scholar]
- International Olive Council Sensory analysis of olive oil. Standard. Guide for the selection, training and quality control of virgin olive oil tasters - qualification of tasters. 2020. https://www.internationaloliveoil.org/wp-content/uploads/2022/10/COI-T.20-Doc-14-REV-6-2020-EN-.pdf panel leaders and trainers. COI/T.20/Doc. No 14/Rev. 7. Madrid.
- ISO . International Organization for Standardization; 1977. Sensory Analysis. Apparatus. Wine-Tasting Glass (ISO 3591) [Google Scholar]
- ISO . International Organization for Standardization; 2005. Sensory Analysis. Methodology. Paired Comparison Test (ISO 5495) [Google Scholar]
- ISO . International Organization for Standardization; 2006. Sensory Analysis. Methodology. Initiation and Training of Assessors in the Detection and Recognition of Odours (ISO 5496) [Google Scholar]
- ISO . International Organization for Standardization; 2007. Sensory Analysis. General Guidance for the Design of Test Rooms (ISO 8589) [Google Scholar]
- ISO . International Organization for Standardization; 2011. Sensory Analysis. Methodology. Method of Investigating Sensitivity of Taste (ISO 3972) [Google Scholar]
- ISO . International Organization for Standardization; 2012. Sensory Analysis. General Guidelines for the Selection, Training and Monitoring of Selected Assessors and Expert Sensory Assessors (ISO 8586) [Google Scholar]
- ISO . International Organization for Standardization; 2021. Sensory Analysis. Methodology. Triangle Test (ISO 4120) [Google Scholar]
- ISO . International Organization for Standardization; 2023. Milk and Milk Products - Sensory Analysis - Part 1: General Guidance for the Recruitment, Selection, Training and Monitoring of Assessors (ISO 22935-1) [Google Scholar]
- Jiang S., Li Z., Yang X., Li M., Wang C., Wang Z., Wu Q. Sustainable and green synthesis of porous organic polymer for solid-phase extraction of four chlorophenols in water and honey. Food Chem. 2023;404 doi: 10.1016/j.foodchem.2022.134652. [DOI] [PubMed] [Google Scholar]
- Kakimoto M., Ishikawa T., Miyagi A., Saito K., Miyazaki M., Asaeda T., et al. Culture temperature affects gene expression and metabolic pathways in the 2-methylisoborneol producing cyanobacterium Pseudanabaena galeata. J. Plant Physiol. 2014;171(3–4):292–300. doi: 10.1016/j.jplph.2013.09.005. [DOI] [PubMed] [Google Scholar]
- Köster E.P., Møller P., Mojet J. A “Misfit” Theory of Spontaneous Conscious Odor Perception (MITSCOP): reflections on the role and function of odor memory in everyday life. Front. Psychol. 2014;5:64. doi: 10.3389/fpsyg.2014.00064. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lawless H.T. A simple alternative analysis for threshold data determined by ascending forced‐choice methods of limits. J. Sensory Stud. 2010;25(3):332–346. doi: 10.1111/j.1745-459X.2009.00262.x. [DOI] [Google Scholar]
- Lim J., Lawless H.T. Detection thresholds and taste qualities of iron salts. Food Qual. Prefer. 2006;17(6):513–521. doi: 10.1016/j.foodqual.2005.06.006. [DOI] [Google Scholar]
- Lin T.F., Watson S., Dietrich A.M., Suffet I.H. first ed. IWA Publishing; London: 2019. Taste and Odour in Source and Drinking Water: Causes, Controls, and Consequences. [Google Scholar]
- Mallevialle J., Suffet I.H. American Water Works Association Research Foundation; Denver: 1987. Identification and Treatment of Tastes and Odors in Drinking Water. [Google Scholar]
- Omur-Ozbek P., Dietrich A.M. Retronasal perception and flavour thresholds of iron and copper in drinking water. J. Water Health. 2011;9(1):1–9. doi: 10.2166/wh.2011.157b. [DOI] [PubMed] [Google Scholar]
- Pepino M.Y., Mennella J.A. Effects of cigarette smoking and family history of alcoholism on sweet taste perception and food cravings in women. Alcohol Clin. Exp. Res. 2007;31(11):1891–1899. doi: 10.1111/j.1530-0277.2007.00519.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pérez-Elortondo F.J., Ojeda M., Albisu M., Salmerón J., Etaio I., Molina I.M. Food quality certification: an approach for the development of accredited sensory evaluation methods. Food Qual. Prefer. 2007;18(2):425–439. doi: 10.1016/j.foodqual.2006.05.002. [DOI] [Google Scholar]
- Phetxumphou K., Raghuraman A., Dietrich A.M. Implementing the drinking water taste‐and‐odor wheel to improve the consumer Lexicon. J. - Am. Water Works Assoc. 2017;109(11):E453–E463. doi: 10.5942/jawwa.2017.109.0122. [DOI] [Google Scholar]
- Piriou P., Devesa R., De Lalande M., Glucina K. European reassessment of MIB and geosmin perception in drinking water. J. Water Supply Res. Technol. - Aqua. 2009;58(8):532–538. doi: 10.2166/aqua.2009.124. [DOI] [Google Scholar]
- Rey-Salgueiro L., Gosálbez-García A., Pérez-Lamela C., Simal-Gándara J., Falqué-López E. Training of panellists for the sensory control of bottled natural mineral water in connection with water chemical properties. Food Chem. 2013;141(1):625–636. doi: 10.1016/j.foodchem.2013.02.093. [DOI] [PubMed] [Google Scholar]
- Richardson S.D. Disinfection by-products and other emerging contaminants in drinking water. Trends Anal. Chem. 2003;22(10):666–684. doi: 10.1016/S0165-9936(03)01003-3. [DOI] [Google Scholar]
- Sancho J., Bota E., de Castro J.J. first ed. Edicions Universitat Barcelona; Barcelona: 1999. Introducción al análisis sensorial de los alimentos. 1999. [Google Scholar]
- Shawwa A., Sebastiani E., Tran M., Reggio D., Dietrich A.M. Screening and training analysts to detect geosmin. Opflow. 2022;48(7):20–23. doi: 10.1002/opfl.1715. [DOI] [Google Scholar]
- Suffet I.H., Corado A., Khiari D. Brominated organic compounds and taste and odors in water supplies. Water Supply: Rev. J. Int. Water Supply Assoc. 1995;13(1):85–99. [Google Scholar]
- Suffet I.H., Schweitze L., Khiari D. Olfactory and chemical analysis of taste and odor episodes in drinking water supplies. Rev. Environ. Sci. Biotechnol. 2004;3:3–13. doi: 10.1023/B:RESB.0000040012.94870.48. [DOI] [Google Scholar]
- Teillet E. vol. 2009. Université de Bourgogne; Dijon: 2009. (Perception, préférence et comportement des consommateurs vis-à-vis d’eaux embouteillées et d’eaux du robinet. Sciences de l'Alimentation). [Google Scholar]
- Wang Z., Suffet I.H. Sensory and chemical analysis methods for earthy and musty odours in drinking water caused by geosmin and 2-methylisoborneol. Water Sci. Technol. Water Supply. 2006;6(3):147–155. doi: 10.2166/ws.2006.732. [DOI] [Google Scholar]
- WHO . World Health Organization; Geneva: 2022. Guidelines for Drinking-Water Quality: Fourth Edition Incorporating the First Addendum.https://www.who.int/publications/i/item/9789240045064 2022. [PubMed] [Google Scholar]
- Widen H., Leufven A., Nielsen T. Identification of chemicals, possibly originating from misuse of refillable PET bottles, responsible for consumer complaints about off-odours in water and soft drinks. Food Addit. Contam. 2005;22:681–692. doi: 10.1080/02652030500159987. [DOI] [PubMed] [Google Scholar]
- Yang H.H., Lawless H.T. Descriptive analysis of divalent salts. J. Sensory Stud. 2005;20(2):97–186. doi: 10.1111/j.1745-459X.2005.00005.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yeshurun Y., Sobel N. An odor is not worth a thousand words: from multidimensional odors to unidimensional odor objects. Annu. Rev. Psychol. 2010;61(1):219–241. doi: 10.1146/annurev.psych.60.110707.163639. [DOI] [PubMed] [Google Scholar]
- Young W.F., Horth H., Crane R., Ogden T., Arnott M. Taste and odour threshold concentrations of potential potable water contaminants. Water Res. 1996;30(2):331–340. doi: 10.1016/0043-1354(95)00173-5. [DOI] [Google Scholar]
- Zamyadi A., Henderson R., Stuetz R., Hofmann R., Ho L., Newcombe G. Fate of geosmin and 2-methylisoborneol in full-scale water treatment plants. Water Res. 2015;83:171–183. doi: 10.1016/j.watres.2015.06.038. [DOI] [PubMed] [Google Scholar]
- Zhang J., Chen Y., Liao Y., Wang Q., Yu J. Studies on the degradation of trace phenol and indole odorants by chlorine and permanganate in drinking water treatment. Chemosphere. 2022;286 doi: 10.1016/j.chemosphere.2021.131551. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
No data was used for the research described in the article.







