Abstract
The concept of green chemistry is widely recognized in chemical laboratories. To properly measure an environmental impact of chemical processes, dedicated assessment tools are required. This paper summarizes the current state of knowledge in the field of development of green chemistry and green analytical chemistry metrics. The diverse methods used for evaluation of the greenness of organic synthesis, such as eco-footprint, E-Factor, EATOS, and Eco-Scale are described. Both the well-established and recently developed green analytical chemistry metrics, including NEMI labeling and analytical Eco-scale, are presented. Additionally, this paper focuses on the possibility of the use of multivariate statistics in evaluation of environmental impact of analytical procedures. All the above metrics are compared and discussed in terms of their advantages and disadvantages. The current needs and future perspectives in green chemistry metrics are also discussed.
Keywords: green chemistry metrics, green analytical chemistry metrics, environmental impact, E-Factor, atom economy, eco-footprint, Eco-Scale, EATOS
1. Introduction
The concept of green chemistry [1] has become a tool for promoting sustainable development in laboratories and industry. The twelve principles of green chemistry [2] are the basis of guidelines addressed to those who want to follow the green chemistry trend. They provide a framework for actions that can be taken to make chemical products and processes more environmentally benign. These actions are developed by chemists representing different areas of chemistry, for example, organic synthesis, chemical engineering, or analytical chemistry.
Most efforts in making chemical processes greener emphasize the need for using safer, less toxic, and more benign solvents, or the elimination of solvents, and reduction in the use of reagents and auxiliaries. Other actions include lowering energy consumption through the use of milder reaction conditions [3], avoiding derivatization and a preference for substrates based on renewable sources [4]. In order to improve atom economy, highly selective catalytic processes should be performed instead of using additional substrates. These solutions are well-defined and have been intentionally put into practice since 1998 and were known even before their introduction.
One of the challenges in green chemistry is the evaluation of the greenness of chemical processes. It is well known that the processes that cannot be measured cannot be controlled. Control in green chemistry should be understood as a possibility to select the greenest option. The development and application of measurement procedures allows us to compare the greenness of existing solutions with newly developed ones. Different factors characterized by a different level of complexity are currently used in evaluation of environmental impact of chemical processes.
The aim of this article is to critically review different approaches to measuring the environmental impact of chemical processes. The principles, areas of application, advantages and disadvantages of different semi-quantitative, quantitative and comparative assessment procedures will be discussed.
2. Green Metrics Commonly Applied throughout the Industry
2.1. Eco-Footprint
At the beginning of the 1990s, Rees and Wackernagel introduced and characterized an accounting tool known as Ecological Footprint (EF) or Ecological Footprint Analysis (EFA), which measures the demand on certain resources (ecosystem services) necessary for a defined level of consumption for an industrial process or for a certain building project. Moreover, the EF defines the ability of the ecosystem to absorb the post-consumer waste and to compensate for all the resources used for production of goods and services in a particular area. Global hectare (gha) per person is the unit of the EF measurement. The lower the EF value is, the more environmentally friendly the industrial processes or population’s consumption in the area will be. In the evaluation of the EF six main ecological land-use categories are considered, i.e., forest land, fishing ground, arable land, built-up land, grazing land and land used for energy production [5,6,7,8,9,10,11,12,13,14,15]. Currently, aside from general EF, specific EF for individual factors influencing ecosystems are becoming more popular. The examples of specific EF are: Chemical Footprint (Sala and Goralczyky, 2013) [16], Material Footprint (Laakso and Lettenmeier, 2015) [17], Energy Footprint (Vujanovic et al., 2014) [18], Land Footprint (Hsien H. Khoo, 2015) [19], Water Footprint (Mansardo et al., 2014) [20], Carbon Footprint (Rodriguez-Caballero et al., 2015) [21], Nitrogen Footprint (Singh and Bakshil, 2015) [22], Phosphorus Footprint (Wang et al., 2011) [23].
A novel approach for calculating the general EF parameter has been proposed by Fu et al., 2015 [15]. This method considers three main factors, namely Biological Resource Footprint, Energy Footprint and Build-up land Footprint. A scheme showing the EF evaluation procedure developed by Fu et al. is presented in Figure 1. This method was used to assess the technological advancement and economic development in China during a period of 1997–2011.
Another interesting approach to the EF assessment and visualization of individual factors having impact on the environment in a given area has been developed by Leseurre et al., 2014 [7]. This method was applied by the Chimex company for evaluation and visualization of environmental impact of industrial-scale production of an active anti-ageing substance Pro-Xylane™ and a UV-A filter Mexoryl® SX. The tool proposed and described by Leseurre et al., focuses on two main areas, i.e., manufacturing footprint and eco-design footprint. Each of these two groups is influenced by five basic indicators assigned on a 0–4 scale. The higher the value, the greater the impact on the environment in a particular area. Factors that are critical for manufacturing footprint values are: (i) water consumption (H2O); (ii) raw materials’ geographical origin (iL); (iii) aqueous waste valorization (eFA); (iv) used organic solvents valorization (slOS); and (v) process carbon footprint (eC). The eco-design footprint is mostly affected by: (i) synthetic pathway efficiency (eVS); (ii) raw materials of renewable origin (rMP); (iii) E-Factor (eF); (iv) potential environmental impact of raw materials (ieMP); and (v) potential environmental impact of waste (ieD). Evaluation of all 10 indicators allows drawing a specific type of a radar chart presenting an environmental impact of the industrial process. This method enables the company to estimate how a change in technology of production will affect its environmental impact [7].
The main advantage of the use of ecological footprint as a measure of impact assessment is that it provides a simple, comprehensible and effective tool for evaluation of the environmental impact of production and consumption. Moreover, this metric can be used to evaluate the effect of industrial activity on any scale—from a local environment (on a district or regional scale) to the whole country or even a continent.
2.2. E-Factor
Considering the fact that the simplest solutions are the best, Sheldon has developed a simple and fast metric for evaluation of environmental impact of industrial processes, referred to as E-Factor (environmental factor). According to its definition, the E-Factor is calculated as a total weight of all waste generated in technological or industrial process (in kilograms) per kilogram of a product. The closer to zero the value of E-Factor (E-Factor ~0) is, the less waste generated and more sustainable and greener the process will be. However, it should be realized that, depending on its potential application, the E-Factor can be calculated including or excluding water used in the process [24,25,26,27,28]. Table 1 presents the published values of E-Factor calculated for selected chemical industry sectors. This parameter can also be used for evaluation of environmental impact of a specific industrial process, for example production of a certain electronic device [29].
Table 1.
Industry Sector | Product Tonnage | E-Factor (kg Waste/kg Product) |
---|---|---|
Oil refining | 106–108 | <0.1 |
Bulk chemicals | 104–106 | <1.0 to 5.0 |
Fine chemicals industry | 102–104 | 5.0 to > 50 |
Pharmaceutical industry | 10–103 | 25 to > 100 (25 to >200 *) |
* data proposed by Dunn associated with a so-called ‘chiral era’ of pharmaceuticals [29].
Higher E-Factor values reported for pharmaceutical industry compared with these values for other sectors of chemical industry result from a necessity to obtain a very high-purity product in the multi-stage reactions during which many by-products (waste) are generated. Additionally, production of pharmaceuticals requires the use of high-purity reagents [30].
A major limitation of the E-Factor as a metric of environmental impact of technologic process is that it neither considers the hazards nor the environmental risk of the produced waste. The two examples of successful application of the E-Factor to evaluation of the greenness of technologic process in pharmaceutical industry are: synthesis of sildenafil citrate (Viagra™) [30] and synthesis of antidepressant sertraline hydrochloride (Zoloft®) [27,31]. In the case of sildenafil citrate synthesis, introduction of toluene and ethyl acetate recovery as well as total elimination of highly volatile solvents (e.g., acetone, diethyl ether) from the synthetic pathway, resulted in lowering of the E-Factor value from 105 (in the time of drug discovery) to 7 in the production stage. The pharmaceutical company that produces Viagra™ has established a future target of lowering the E-Factor value to 4, which would be possible to achieve through elimination of titanium chloride, toluene and hexane [30]. By re-designing the chemical process the manufacturers of sertraline hydrochloride (Zoloft®) achieved the E-Factor value of 8 [27,31].
The E-factor is a versatile metric that can be used in various chemical industry sectors, such as inorganic synthesis. For example, Demirci and Miele used the E-Factor to evaluate the greenness of 11 methods of hydrogen production. The calculated E-Factor values were in the range of 5.5 (for steam reformation from natural gas—methane) to 16.5 (for thermolysis/gasification process in which coal was the main hydrogen source) [32].
In some cases, more than one green metric is used for evaluation of environmental impact of an industrial process. E-Factor and the Product Mass Intensity (PMI) can be given as an example of such multi-metrics approach. The PMI has found its widest application in pharmaceutical industry. A relation between E-Factor and PMI can be described by the following formula: E-Factor = PMI − 1. It is easier to calculate the PMI than E-Factor because it only requires the knowledge about inputs into a reaction [33,34].
The E-Factor value is necessary for calculation of another popular green chemistry metric, the Environmental Quotient (EQ). It is a product of E-Factor and a Q value. The Q value is defined as Environmental Hazard Quotient. It is related to ecotoxicity of waste generated during an industrial process or organic synthesis. For example, the Q value for sodium chloride is 1 whereas this value for heavy metals and their salts is in the range of 100–1000 [35].
3. Green Metrics Applied to Organic Synthesis
The principles of green chemistry have the highest impact on organic synthesis performed in laboratory and in industry. An ideal synthesis should have as little steps as possible, be characterized by a high selectivity and be based on using easily available and inexpensive substrates [36]. For implementation of the green chemistry principles it is important to modify and improve known synthesis pathways in order to make these syntheses more environmentally friendly and sustainable. Designing synthesis of new compounds requires the use of green substrates, green reagents and green reaction conditions. In general, green chemistry in organic synthesis aims at: (i) reduction of the volume of waste and by-products that are generated during each step of synthesis; (ii) elimination of toxic reagents and solvents; (iii) replacement of the solvents by their green alternatives such as water, supercritical fluids, ionic liquids etc.; (iv) the use of catalysts, such as photocatalysts [37,38]. An important issue in green organic synthesis is reduction of energy use, which is possible through replacing traditional heating of the reaction mixture with alternative energy sources such as microwave irradiation, ultrasonication or irradiation under specific light wavelengths. This approach often leads to additional benefits such as an improvement of the reaction efficiency, an increase of reaction rate, and a reduction of the waste volume.
Since the beginning of the 1990s, a new trend in green organic synthesis has emerged. This concerned developing metrics for evaluation of environmental impact of the whole process or its individual steps. The main purpose of these metrics is to obtain clear, simple and fast information about the greenness of organic synthesis or its specific steps. They also enable to predict how a certain change in a synthesis path, such as elimination or replacement of a solvent, would influence its environmental impact [26]. Table 2 summarizes several metrics used for evaluation of the greenness of organic syntheses with their short characteristics.
Table 2.
Parameter | Formula | Short Characteristics | Comments | Ref. |
---|---|---|---|---|
Carbon Efficiency (CE) | It is used to estimate the percentage of carbon in the reagents used in organic synthesis that remain in the final desired product | This parameter is dedicated to evaluation of the greenness of organic synthesis based solely on carbon accounting | [26,39] | |
Effective Mass Yield (EMY) | This parameter quantifies a percentage of the final product in all reagents and materials used in organic synthesis | Reagents having low or very low environmental impact (e.g., sodium chloride or acetic acid) are excluded from calculation of EMY | [40,41] | |
Mass Intensity (MI) | The MI takes into account reaction efficiency, stoichiometry, amount of solvents, all reagents and auxiliary substances used in synthesis. | This parameter has a value of 1 for an ideal synthesis, in which the total mass of input is equal to the mass of product | [26,39] | |
Reaction Mass Efficiency (RME) |
where Em is a value of E-factor based on mass |
The RME factor is inversely related to the overall E-factor described by Sheldon. The RME offers a better and easy way of identification of the best or the worst reactions that have influence on whole industrial process or synthesis. | This parameter was described very precisely by Andraos and Sayed (2007). The final version of RME equation depends on conditions of reaction or process (recovery of reaction solvents or post-reaction materials). This parameter is most effective in efforts to reduce waste at the intrinsic and global level | [39,42,43,44,45,46] |
where: —reaction yield; AE—atom economy; SF—stoichiometric factor; c—the mass of reaction catalyst; s—the mass of reaction solvent; w—the masses of all other post-reaction materials; mcp—the mass of the collected target product | ||||
Atom Utilization (AU) | This parameter defines percentage ratio of the mass of final product to the mass of all products (final product and byproducts) obtained in synthesis. The solvents are excluded from calculations | It provides fast and simple evaluation of the greenness of a process or individual reaction in terms of produced waste. Nowadays it is seldom used | [39,47] | |
Solvent and catalyst environmental impact parameter (f) | Evaluation of this parameter takes into account actual masses of materials used in the process | This parameter has a value of 0 only if all materials (solvents, catalysts etc.) used in the process or in individual step of synthesis are recycled, recovered or eliminated. In every other case, f > 0 | [42,43,44,48] | |
Stoichiometric Factor (SF) | This parameter is calculated in case of syntheses in which one or more reagents are used in excessive amount | The SF has a value of 1 for stoichiometric reactions. If the reaction is nonstoichiometric the SF > 1 |
One of the most important tool which can be considered as a fundamental green chemistry metric that forms the basis for all of the other metrics is Atom Economy. This measure was introduced in 1991 by Trost and it is the simplest, fundamental and the most popular parameter used in drug synthesis. Atom Economy calculation (Equation (1)) estimates the amount of reagents (substrates, solvents, catalysts) that will be incorporated into the final desired product [26,49]:
(1) |
One of the tools for measuring the greenness of synthesis is reaction mass efficiency (RME). It is a comprehensive tool in terms of mass balance of a chemical process [42]. Reaction yield, atom economy and stoichiometric factor taking into account the excess of reagents, are included in calculation of RME. Amounts of auxiliary compounds, solvents, catalysts, as well as a recovery of these compounds after reaction are also considered. The calculation can easily be carried out by using the Excel spreadsheet. The results of analysis can be visualized to facilitate the actions to improve the greenness of chemical process [43]. The RME value is usually significantly influenced by the treatment of solvents and auxiliaries that are used during the reaction [48]. Another drawback is a difficulty in proper identification of all by-products, which is a prerequisite of RME analysis [44]. For multi-stage reactions it would be advisable to apply a tree analysis for making a comparison easier or even for ranking of synthesis plans [50]. Eissen and Metzger proposed another tool referred to as Environmental Assessment Tool for Organic Syntheses (EATOS) for an assessment of the greenness of a laboratory-scale organic synthesis. It is a software capable of comparison of different methods of the same product synthesis in terms of their environmental impact, the use of resources, identification of the least environmentally friendly steps etc. The EATOS tool provides a comprehensive analysis of the greenness of all the chemicals used in synthesis, i.e., solvents, sewage/water, impurities, catalysis, auxiliary materials, byproducts, coupled products and substrates [51]. Information needed for performing EATOS analysis can easily be found in the substance specification sheets. More details about this tool and examples of its use have been presented by many authors [52,53,54,55].
The EATOS software has been used for comparison of the greenness and environmental impact of six different methods of synthesis (including thermal and photochemical processes) of a mixture of four diastereoisomers: cis- and trans-4-methyl-2-(2-methylprop-1-en-1-yl)tetrahydro-2H-pyran) commonly known under the name ‘rose oxide’. The lowest EATOS value (in PEI kg−1, where PEI is Potential Environmental Impact per kg of product), 29.24 was obtained for Dragoco protocol. The highest EATOS value of 467.81 PEI kg−1 was found for synthesis conducted with oxidants [53]. Similarly, Protti et al. evaluated the environmental impact of photochemical and thermal synthesis of methyl cyclohexylpropanoate, alkynylbenzoxazole and β-hydroxyl ketone using EATOS [56]. It is interesting to note that this software has also found its application in the field of inorganic synthesis. For example, Pini et al. used EATOS to evaluate the greenness of TiO2 nanoparticle synthesis [54].
In 2006 Van Aken et al., introduced the EcoScale, which is a semiquantitative tool to evaluate the quality of the organic preparation on a laboratory scale. This approach is focused on several parameters that characterize organic synthesis, such as yield, cost, safety, conditions and ease of workup/purification. The highest rank in the EcoScale (100 points) refers to ‘ideal’ reaction that has a 100% yield, uses inexpensive reagents and is conducted at room temperature, is safe for both the operator and for the environment. If the parameters of a real synthesis differ from ‘the ideal value’, the penalty points are assigned, lowering the total score by certain values that have been proposed by Van Aken et al. [57]. The EcoScale value allows to select different preparations according not only to their greenness, but also to their costs. The main disadvantage of the EcoScale evaluation is that it does not provide information about the type of hazards, it only gives a score.
4. Green Analytical Chemistry
Green analytical chemistry has its own achievements in measuring an environmental impact of analytical processes. The analytical process refers to determination of certain substances, it differs from the industrial processes mostly by its scale. In contrary to industrial emissions, analytical processes cause a dispersed pollution. The emissions from analytical laboratories are on one hand low, but on the other hand, are more dispersed than industrial emissions, which makes them more difficult to control.
The main goal of an industrial chemical process is to obtain a certain product. All the inputs to the process, which do not form the final product are considered as waste. Analytical processes lead to obtaining a very specific product, namely results of analyses. Therefore, all the material and energetic inputs to the analytical process contribute to generation of waste. Analytical waste cannot be fully eliminated, but its volume can be reduced. The environmental impact of analytical methods/procedures and their alternatives has to be appropriately measured.
One of the oldest tools to assess the greenness of analytical procedures is NEMI labeling [58]. The NEMI label is a circle consisting of four fields. Each field reflects different aspect of the described analytical methodology and the field is filled green if certain requirements are met (the reader is kindly referred to Figure 2). The first requirement is that none of the chemicals is present on the persistent, bioaccumulative and toxic chemicals list. The second of the requirements is that none of the chemicals applied in the procedure is listed on D, F, P or U hazardous wastes lists. The third requirement is that the pH of the sample is within 2–12 range to avoid a highly corrosive environment during the whole analytical process. The fourth and last requirement is that during the procedure less than 50 g of waste is produced.
The main advantage of the NEMI as a greenness assessment tool is that it is easy to read by potential procedure users. One glance at the NEMI symbol is enough to have a general information about an environmental impact of a procedure. The two main disadvantages of NEMI labeling are that the obtained information is rather general and that filling the NEMI symbol is time consuming. NEMI symbol shows that each threat is below or above a certain value. Therefore it cannot be regarded as being semi-quantitative. The second disadvantage is connected with a tedious preparation of a symbol, especially if many, non-typical chemicals are used in the procedure. Every chemical has to be checked if it is present on at least one of the few lists.
An improvement to the NEMI pictogram was proposed by de la Guardia and Armenta [59]. These authors suggested that each of the fields should be colored using a three degree scale—red for non-environmentally friendly analysis, yellow for moderate and green for environmentally benign analysis. This modification makes the NEMI procedure assessment more quantitative.
The analytical Eco-Scale is another approach to the assessment of environmental impact of analytical methods [60]. The result of analytical Eco-Scale analysis is the score that is calculated by subtracting penalty points from the basis of 100 points. The penalty points are assigned for high amounts and high hazards connected with utilization of chemicals, high energy consumption, occupational hazards and generation of wastes. The summary of the procedural penalties is presented in Table 3. A final result of analytical Eco-Scale assessment is a number differing from 100 (“ideal green analysis”) by a number of penalty points. The higher the value (closer to 100) is, the greener analysis will be.
Table 3.
Sub-Total Penalty Points | Total Penalty Points | ||
---|---|---|---|
Reagents | |||
Amount | <10 mL (<10 g) | 1 | Amount penalty points × hazard penalty points |
10–100 mL (10–100 g) | 2 | ||
>100 mL (>100 g) | 3 | ||
Hazard | None | 0 | |
Less severe hazard | 1 | ||
More severe hazard | 2 | ||
Instruments | |||
Energy | <0.1 kWh per sample | 0 | |
<1.5 kWh per sample | 1 | ||
>1.5 kWh per sample | 2 | ||
Occupational hazard | Hermetization of analytical process | 0 | |
Emission of vapors to the atmosphere | 3 | ||
Waste | None | 0 | |
<1 mL (<1 g) | 1 | ||
1–10 mL (1–10 g) | 3 | ||
>10 mL (>10 g) | 5 | ||
Recycling | 0 | ||
Degradation | 1 | ||
Passivation | 2 | ||
No treatment | 3 |
The penalty points for each reagent are calculated by multiplying number of GHS hazard pictograms by degree of hazard (‘warning’ multiplication by 1 and ‘danger’ multiplication by 2). Because the GHS hazard pictograms are placed on the reagent containers, the hazard related to utilization of chemicals is easy to calculate. The examples of penalty points calculations for solvent and reagent use are presented in Table 4.
Table 4.
Solvents/Reagents | Pictograms | Signal | Penalty Points |
---|---|---|---|
dichloromethane | warning | 2 | |
hexane | danger | 8 | |
diethyl ether | danger | 4 | |
methanol | danger | 6 | |
ethyl acetate | danger | 4 | |
MTBE | danger | 4 | |
acetone | danger | 4 | |
benzene | danger | 6 | |
isooctane | danger | 8 | |
acetonitrile | danger | 4 | |
isopropanol | danger | 4 | |
toluene | danger | 6 | |
chloroform | danger | 2 | |
elemental mercury | danger | 8 |
The advantages of the analytical Eco-Scale are: ease of its score calculation, ease of comparison of analytical procedures and including different aspects of environmental impact in its assessment procedure. On the other hand, no information about the structure of the hazards is obtained. The final result of Eco-Scale calculation does not inform about the cause of environmental impact of analytical procedure such as the use of solvents, other reagents, occupational hazard or generation of wastes. Compared to NEMI labeling, analytical Eco-Scale provides information about environmental impact of analytical procedures in a more quantitative way. The amounts of reagents and wastes are considered, not only the certain threat occurrence or its lack.
A tool dedicated to identification of hazards related to the use of liquid chromatographic mobile phases is the high performance liquid chromatography—environmental assessment tool (HPLC-EAT) [61]. Evaluation of HPLC-EAT includes safety, health and environmental factors (SHE approach) and a weight of every chemical that is used in the liquid chromatographic run and during sample preparation. An assessment algorithm involves diverse parameters and hazards of solvents used as mobile phases, which makes the procedure comprehensive. The disadvantage is that a result is a single number that gives the general view, but does not provide any information about a character of threat. On the other hand, the software is easily available and easy to use.
Metrological parameters such as a time of analysis, are usually considered for comparison of different analytical procedures. Environmental aspects represent an added value when comparing analytical methods. Ruiz-de-Cenzano et al., [62] compared two analytical procedures of mercury determination in mushroom samples. The comparison of direct thermal degradation with atomic absorption spectroscopy and microwave-assisted mineralization with cold-vapor atomic fluorescence spectroscopy showed that the two procedures did not differ much in terms of metrology, but they showed significant differences in environmental impact. Analysis of their greenness with Eco-Scale procedure revealed that the score for the former procedure is 92, while for the latter one is only 59. It is not unusual that for a given analyte determination in certain sample matrix there are dozens of analytical procedures developed and available for the analyst. In this case a pair-wise comparison can be very difficult and application of extra tools may be required. There is a set of techniques, called multivariate statistics, which allows us to group objects and variables that describe the objects according to their similarity [63]. For example, the self-organizing maps [64], representing one of the most beneficial multivariate statistics tools [65] were used for grouping analytical procedures for determination of benzene (26 procedures) and phenol (21 procedures) in water samples [66]. These datasets were characterized by: limit of detection, sample volume, injection volume, number of analytes determined in a single run, amount of organic solvents used, amount of solid waste generated and NEMI as well as Eco-Scale scores as the variables. The analysis has shown that the main discriminators are those related to environmental impact of the methodologies. Another finding of that study is that the results of methodologies assessment with NEMI and Eco-Scale tools are well correlated. The self-organizing maps procedure was also applied to investigation of the dataset consisting of 43 procedures for the aldrin determination in water samples [67]. The findings were similar and they showed that the factors responsible for a negative environmental impact are those that make the statistical difference among the procedures. The other important conclusion was that the standard procedures were categorized as causing serious environmental problems and that the less controversial substitutes were available. The main advantage of multivariate statistics as an assessment tool is a possibility to apply complex description of a dataset by selecting several important variables relevant to the problem. Environmental variables and other parameters can be included in the assessment, making grouping of the procedures more comprehensive. An advanced multivariate statistics user may find many interesting relations between variables and objects included in the dataset. The main disadvantage is a tedious preparation of the dataset and an advanced assessment procedure. Another drawback is that the analytical procedures are only grouped according to their similarity, so exhaustive interpretation of the results is still required. In contrary to NEMI labels and Eco-Scale, it cannot be considered as a routine assessment procedure.
Multivariate statistics only allow for analytical procedures to be grouped according to their similarity, while multicriteria decision analysis (MCDA) tools allow ranking of the procedures. The assessment procedure with MCDA involves finding the possible alternative solutions to a certain problem, setting the criteria, assigning them weights (usually this step needs a survey among experts) and running the algorithm. As a result, the ranking of the solutions is formed, so the procedures are listed according to the analyst preferences. What is more, apart from ranking, the numerical values are given for each alternative analytical procedure, so an additional information can be obtained in the form of “similarity to ideal solution”. There are several basic techniques developed—TOPSIS [68], AHP [69], ELECTRE [70] and PROMETHEE [71], but so far only the last mentioned has been applied to an assessment of analytical procedures [72]. One of the crucial steps in MCDA techniques is weighting the criteria, so it depends on expert’s preferences whether the environmental criteria are considered as important or not. The results of procedures ranking may vary from expert (analyst) to expert (analyst). If MCDA techniques are seriously considered as a routine greenness assessment tool, some improvements in terms of unifying the criteria and assigning them weights should be elaborated. The main advantage of PROMETHEE as a green analytical chemistry metrics tool is the ability to obtain the full ranking of the procedures. The disadvantages are similar to those of multivariate statistics. The dataset preparation is rather difficult and requires some analytical knowledge and experience.
5. Education in Green Chemistry
Green chemistry is not the branch of science itself but it is an added value to organic chemistry, technology or analytical chemistry [73]. Nowadays it is more often included in university courses and programs. Students should know the greenness assessment tools described to properly assess the environmental impact of chemical processes [74]. Green chemistry teaching in student laboratories means incorporation of environmental factors into optimization of chemical processes. Students should be aware how to describe the environmental impact of the reactions and how try to find greener alternatives [75,76,77]. Even the complex ideas, like LCA, are introduced to teaching students on how to assess the greenness of syntheses [78] and a novel approach to this field has recently been proposed [79].
There is also a special tool dedicated to green chemistry education. The “Green Star” tool is used to describe the greenness of organic synthesis in student laboratories. With this approach, the students can get information on how to improve the greenness of the existing reactions. The assessment tool is used to measure the greenness of both the initial and improved reaction. The basic concept of the Green Star is presentation of the twelve green chemistry principles, each as an arm of the star, with the arm’s length corresponding to the fulfillment of the principle [80]. To obtain the length of the arms, semi-quantitative scores are calculated for each of the twelve principles (sometimes less than twelve if the criteria are not applicable). Green Star allows easy identification of the weak points of the synthesis to compare two or more procedures with each other. The drawback is that some information, such as degradability or hazards, is not easily available. For further information about teaching green chemistry, including green chemistry metrics, please refer to the excellent review by Andraos and Dicks [81].
6. Conclusions
Together with the development of green chemistry, new green chemistry metrics are and should be introduced. Two future trends in the green chemistry metrics development can be predicted. The first one is an introduction of assessment methods that are very simple, easy to apply and easy to interpret. The second one is establishing the greenness models, in which large input datasets are used. At the same time, it is expected that the new software and other tools that make calculation of greenness parameters easier, will be developed. There is a need for introduction of new tools to evaluate the greenness of different processes and on different scales. There is also a need for popularization of the existing green chemistry metrics. Thus, groups of professionals such as organic chemists, chemical process engineers, analytical chemists and educators should contribute to this field in order to establish universally applied greenness assessment procedures.
Acknowledgments
M.T. is grateful for the support from the programme “The Center for Advanced Studies—the development of interdisciplinary doctoral studies at the Gdansk University of Technology in the key areas of the Europe 2020 Strategy” (POKL04.03.00-00-238/12).
Author Contributions
M. T., M. M., A. G. and J. N. wrote and edited the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Anastas P.T., Warner J. Green Chemistry Theory and Practice. Oxford University Press; Oxford, UK: 1998. [Google Scholar]
- 2.Poliakoff M., Fitzpatrick J.M., Farren T.R., Anastas P.T. Green Chemistry: Science and Politics of Change. Science. 2002;297:807–810. doi: 10.1126/science.297.5582.807. [DOI] [PubMed] [Google Scholar]
- 3.Kirchoff M.M. Promoting Green Engineering through Green Chemistry. Environ. Sci. Technol. 2003;37:5349–5353. doi: 10.1021/es0346072. [DOI] [PubMed] [Google Scholar]
- 4.Horvath I.T., Anastas P.T. Innovations and Green Chemistry. Chem. Rev. 2007;107:2169–2173. doi: 10.1021/cr078380v. [DOI] [PubMed] [Google Scholar]
- 5.Jamali-Zghal N., Amponsah N.Y., Lacarriere B., le Corre O., Feidt M. Carbon footprint and emergy combination for eco-environmental assessment of cleaner heat production. J. Clean. Prod. 2013;47:446–456. doi: 10.1016/j.jclepro.2012.09.025. [DOI] [Google Scholar]
- 6.Wu L., Jiang Q., Yang X.M. Carbon Footprint Incorporation into Least-cost Planning of Eco-city Schemes: Practices in Coastal China. Procedia Environ. Sci. 2012;13:582–589. doi: 10.1016/j.proenv.2012.01.049. [DOI] [Google Scholar]
- 7.Leseurre L., Merea C., Duprat de Paule S., Pinchart A. Eco-footprint: A new tool for the ‘Made in Chimex’ considered approach. Green Chem. 2014;16:1139–1148. doi: 10.1039/c3gc42201a. [DOI] [Google Scholar]
- 8.Teng J., Wu X. Eco-footprint-based life-cycle eco-efficiency assessment of building projects. Ecol. Indic. 2014;39:160–168. doi: 10.1016/j.ecolind.2013.12.018. [DOI] [Google Scholar]
- 9.Cerutti A.K., Beccaro G.L., Bagliani M., Donno D., Bounous G. Multifunctional Ecological Footprint Analysis for assessing eco-efficiency: A case study of fruit production systems in Northern Italy. J. Clean. Prod. 2013;40:108–117. doi: 10.1016/j.jclepro.2012.09.028. [DOI] [Google Scholar]
- 10.Galli A. On the rationale and policy usefulness of Ecological Footprint Accounting: The case of Morocco. Environ. Sci. Policy. 2015;48:210–224. doi: 10.1016/j.envsci.2015.01.008. [DOI] [Google Scholar]
- 11.Egilmez G., Park Y.S. Transportation related carbon, energy and water footprint analysis of U.S. manufacturing: An eco-efficiency assessment. Transportat. Res. D-Tr E. 2014;32:143–159. doi: 10.1016/j.trd.2014.07.001. [DOI] [Google Scholar]
- 12.Kratena K. From ecological footprint to ecological rent: An economic indicator for resource constraints. Ecol. Econ. 2008;64:507–516. doi: 10.1016/j.ecolecon.2007.09.019. [DOI] [Google Scholar]
- 13.Bagliani M., Galli A., Niccolucci V., Marchettini N. Ecological footprint analysis applied to a sub-national area: The case of the Province of Siena (Italy) J. Environ. Manag. 2008;86:354–364. doi: 10.1016/j.jenvman.2006.04.015. [DOI] [PubMed] [Google Scholar]
- 14.Agostinho F., Pereira L. Support area as an indicator of environmental load: Comparison between Embodied Energy, Ecological Footprint, and Emergy Accounting methods. Ecol. Indic. 2013;24:494–503. doi: 10.1016/j.ecolind.2012.08.006. [DOI] [Google Scholar]
- 15.Fu W., Turner J.C., Zhao J., Du G. Ecological footprint (EF): An expanded role in calculating resource productivity (RP) using China and the G20 member countries as examples. Ecol. Indic. 2015;48:464–471. doi: 10.1016/j.ecolind.2014.09.023. [DOI] [Google Scholar]
- 16.Sala S., Goralczyky M. Chemical footprint: A methodological framework for bridging life cycle assessment and planetary boundaries for chemical pollution. Integr. Environ. Assess. Manag. 2013;9:623–632. doi: 10.1002/ieam.1471. [DOI] [PubMed] [Google Scholar]
- 17.Laakso S., Lettenmeier M. Household-level transition methodology towards sustainable material footprints. J. Clean. Prod. 2015 doi: 10.1016/j.jclepro.2015.03.009. [DOI] [Google Scholar]
- 18.Vujanovic A., Cucek L., Pahor B., Kravanja Z. Multi-objective synthesis of a company’s supply network by accounting for several environmental footprints. Process Saf. Environ. 2014;92:456–466. doi: 10.1016/j.psep.2014.03.004. [DOI] [Google Scholar]
- 19.Khoo H.H. Review of bio-conversion pathways of lignocellulose-to-ethanol: Sustainability assessment based on land footprint projections. Renew. Sustain. Ener. Rev. 2015;46:100–119. doi: 10.1016/j.rser.2015.02.027. [DOI] [Google Scholar]
- 20.Manzardo A., Ren J., Piantella A., Mazzi A., Fedele A., Scipioni A. Integration of water footprint accounting and costs for optimal chemical pulp supply mix in paper industry. J. Clean. Prod. 2014;72:167–173. doi: 10.1016/j.jclepro.2014.03.014. [DOI] [Google Scholar]
- 21.Rodriguez-Caballero A., Aymerich I., Marques R., Poch M., Pijuan M. Minimizing N2O emissions and carbon footprint on a full-scale activated sludge sequencing batch reactor. Water Res. 2015;71:1–10. doi: 10.1016/j.watres.2014.12.032. [DOI] [PubMed] [Google Scholar]
- 22.Singh S., Bakshi B.R. Footprints of carbon and nitrogen: Revisiting the paradigm and exploring their nexus for decision making. Ecol. Indic. 2015;53:49–60. doi: 10.1016/j.ecolind.2015.01.001. [DOI] [Google Scholar]
- 23.Wang F., Sims J.T., Ma L., Ma W., Dou Z., Zhang F. The phosphorus footprint of China’s food chain: Implications for food security, natural resource management, and environmental quality. J. Environ. Qual. 2011;40:1081–1089. doi: 10.2134/jeq2010.0444. [DOI] [PubMed] [Google Scholar]
- 24.Sheldon R.A. Utilisation of biomass for sustainable fuels and chemicals: Molecules, methods and metrics. Catal. Today. 2011;167:3–13. doi: 10.1016/j.cattod.2010.10.100. [DOI] [Google Scholar]
- 25.Sheldon R.A. Atom efficiency and catalysis in organic synthesis. Pure Appl. Chem. 2000;72:1233–1246. doi: 10.1351/pac200072071233. [DOI] [Google Scholar]
- 26.Constable D.J.C., Curzons A.D., Cunningham V.L. Metrics to ‘green’ chemistry—Which are the best? Green Chem. 2002;4:521–527. doi: 10.1039/b206169b. [DOI] [Google Scholar]
- 27.Manley J.B., Anastas P.T., Cue B.W., Jr. Frontiers in Green Chemistry: meeting the grand challenges for sustainability in R&D and manufacturing. J. Clean. Prod. 2008;16:743–750. [Google Scholar]
- 28.Sheldon R.A. The E Factor: fifteen years on. Green Chem. 2007;9:1273–1283. doi: 10.1039/b713736m. [DOI] [Google Scholar]
- 29.Dunn P.J. The importance of Green Chemistry in Process Research and Development. Chem. Soc. Rev. 2012;41:1452–1461. doi: 10.1039/C1CS15041C. [DOI] [PubMed] [Google Scholar]
- 30.Dunn P.J., Galvin S., Hettenbach K. The development of an environmentally benign synthesis of sildenafil citrate (Viagra™) and its assessment by Green Chemistry metrics. Green Chem. 2004;6:43–48. doi: 10.1039/b312329d. [DOI] [Google Scholar]
- 31.Quallich G.J. Development of the Commercial Process for ZoloftR/Sertraline. Chirality. 2005;17:S120–S126. doi: 10.1002/chir.20113. [DOI] [PubMed] [Google Scholar]
- 32.Demirci U.B., Miele P. Overview of the relative greenness of the main hydrogen production processes. J. Clean. Prod. 2013;52:1–10. doi: 10.1016/j.jclepro.2013.03.025. [DOI] [Google Scholar]
- 33.Tony Phan T.V., Gallardo C., Mane J. Green motion: A New and Easy to Use Green Chemistry Metric from Laboratories to Industry. Green Chem. 2015 doi: 10.1039/c4gc02169j. [DOI] [Google Scholar]
- 34.Jimenez-Gonzalez C., Ponder C.S., Broxterman Q.B., Manley J.B. Using the Right Green Yardstick: Why Process Mass Intensity Is Used in the Pharmaceutical Industry to Drive More Sustainable Processes. Org. Process Res. Dev. 2011;15:912–917. doi: 10.1021/op200097d. [DOI] [Google Scholar]
- 35.Heinzle E., Weirich D., Brogli F., Hoffmann V., Koller G., Verduyn M.A., Hungerbühler K. Ecological and Economics Objective Functions for Screening in Integrated Development of Fine Chemical Processes. 1. Flexible and Expandable Framework Using Indicates. Ind. Eng. Chem. Res. 1998;37:3395–3407. doi: 10.1021/ie9708539. [DOI] [Google Scholar]
- 36.Schafer H.J. Contributions of organic electrosynthesis to green chemistry. C. R. Chim. 2011;14:745–765. doi: 10.1016/j.crci.2011.01.002. [DOI] [Google Scholar]
- 37.Banitaba S.H., Safari J., Khalili S.D. Ultrasound promoted one-pot synthesis of 2-amino-4,8-dihydropyrano [3,2-b]pyran-3-carbonitrile scaffolds in aqueous media: A complementary ‘green chemistry’ tool to organic synthesis. Ultrason. Sonochem. 2013;20:401–407. doi: 10.1016/j.ultsonch.2012.07.007. [DOI] [PubMed] [Google Scholar]
- 38.Loupy A. Solvent-free microwave organic synthesis as an efficient procedure for green chemistry. C. R. Chim. 2004;7:103–112. doi: 10.1016/j.crci.2003.10.015. [DOI] [Google Scholar]
- 39.Curzons A.D., Constable D.J.C., Mortimer D.N., Cunningham V.L. So you think your process is green, how do you know?—Using principles of sustainability to determine what is green—A corporate perspective. Green Chem. 2001;3:1–6. doi: 10.1039/b007871i. [DOI] [Google Scholar]
- 40.Hudlicky T., Frey D.A., Koroniak L., Claebole C.D., Barammer L.E., Jr. Toward a ‘reagent-free’ synthesis. Green Chem. 1999;1:57–59. doi: 10.1039/a901397k. [DOI] [Google Scholar]
- 41.Sheldon R.A., Arends I., Hanefeld U. Green Chemistry and Catalysis. WILEY-VCH Verlag GmbH & Co. KGaA; Weinheim, Germany: 2007. pp. 1–47. [Google Scholar]
- 42.Andraos J., Sayed M. On the use of “green” metrics in the undergraduate organic chemistry lecture and lab to assess the mass efficiency of organic reactions. J. Chem. Ed. 2007;84:1004–1010. doi: 10.1021/ed084p1004. [DOI] [Google Scholar]
- 43.Andraos J. Global green chemistry metrics analysis algorithm and spreadsheets: evaluation of the material efficiency performances of synthesis plans for oseltamivir phosphate (tamiflu) as a test case. Org. Proc. Res. Dev. 2009;13:161–185. doi: 10.1021/op800157z. [DOI] [Google Scholar]
- 44.Andraos J. Unification of reaction metrics for green chemistry ii: Evaluation of named organic reactions and application to reaction discovery. Org. Process Res. Dev. 2005;9:404–431. doi: 10.1021/op050014v. [DOI] [Google Scholar]
- 45.Ribeiro M.G.T.C., Machado A.A.S.C. Greenness of chemical reactions—Limitations of mass metrics. Green Chem. Lett. Rev. 2013;6:1–18. doi: 10.1080/17518253.2012.669798. [DOI] [Google Scholar]
- 46.Niemczyk H.J., van Arnum S.D. A green synthetic process for the preparation of water-soluble drugs: pegylation of menadiol and podophyllotoxin. Green Chem. Lett. Rev. 2008;1:165–171. doi: 10.1080/17518250802401273. [DOI] [Google Scholar]
- 47.Sheldon R.A. Atom utilisation, E factors and the catalytic solution. C. R. Acad. Sci. Ser. IIC Chem. 2000;3:541–551. doi: 10.1016/S1387-1609(00)01174-9. [DOI] [Google Scholar]
- 48.Andraos J. Unification of reaction metrics for green chemistry: Applications to reaction analysis. Org. Process Res. Dev. 2005;9:149–163. doi: 10.1021/op049803n. [DOI] [Google Scholar]
- 49.Patel K.R., Sen D.J., Jatakiya V.P. Atom Economy in Drug Synthesis is a Playground of Functional Groups. Am. J. Adv. Drug Deliv. 2013;1:73–83. [Google Scholar]
- 50.Andraos J. On using tree analysis to quantify the material, input energy, and cost throughput efficiencies of simple and complex synthesis plans and networks: Towards a blueprint for quantitative total synthesis and green chemistry. Org. Process Res. Dev. 2006;10:212–240. doi: 10.1021/op0501904. [DOI] [Google Scholar]
- 51.Eissen M., Metzger J.O. Environmental Performance Metrics for Daily Use in Synthetic Chemistry. Chem. Eur. J. 2002;8:3580–3585. doi: 10.1002/1521-3765(20020816)8:16<3580::AID-CHEM3580>3.0.CO;2-J. [DOI] [PubMed] [Google Scholar]
- 52.Simbera J., Sevcik R., Pazdera P. New One-Pot Methods for Preparation of Cyclohexanecarbonitrile—Green Chemistry Metrics Evaluation for One-Pot and Similar Multi-Step Syntheses. Green Sustain. Chem. 2014;4:70–79. doi: 10.4236/gsc.2014.42011. [DOI] [Google Scholar]
- 53.Ravelli D., Protti S., Neri P., Fagnoni M., Albini A. Photochemical technologies assessed: The case of rose oxide. Green Chem. 2011;13:1876–1884. doi: 10.1039/c0gc00507j. [DOI] [Google Scholar]
- 54.Pini M., Rosa R., Neri P., Bondioli F., Ferrari A.M. Environmental assessment of a bottom-up hydrolytic synthesis of TiO2 nanoparticles. Green Chem. 2015;17:518–531. doi: 10.1039/C4GC00919C. [DOI] [Google Scholar]
- 55.EATOS. [(accessed on 22 April 2015)]. Available online: http://www.metzger.chemie.uni-oldenburg.de/eatos/english.htm.
- 56.Protti S., Dondi D., Fagnoni M., Albini A. Photochemistry in synthesis: Where, when, and why. Pure Appl. Chem. 2007;79:1929–1938. doi: 10.1351/pac200779111929. [DOI] [Google Scholar]
- 57.Van Aken K., Strekowski L., Patiny L. EcoScale, a semiquantitative tool to select an organic preparation based on economical and ecological parameters. Beilstein J. Org. Chem. 2006;2 doi: 10.1186/1860-5397-2-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Keith L.H., Gron L.U., Young J.L. Green Analytical Methodologies. Chem. Rev. 2007;107:2695–2708. doi: 10.1021/cr068359e. [DOI] [PubMed] [Google Scholar]
- 59.De la Guardia M., Armenta S. Green Analytical Chemistry: Theory and Practise. Elsevier; Amsterdam, The Netherlands: 2011. [Google Scholar]
- 60.Gałuszka A., Migaszewski Z.M., Konieczka P., Namieśnik J. Analytical Eco-Scale for assessing the greenness of analytical procedures. TRAC Trend. Anal. Chem. 2012;37:61–72. doi: 10.1016/j.trac.2012.03.013. [DOI] [Google Scholar]
- 61.Gaber Y., Tornvall U., Kumar M.A., Amin M.A., Hatti-Kaul R. HPLC-EAT (Environmental Assessment Tool): A tool for profiling safety, health and environmental impacts of liquid chromatography methods. Green Chem. 2011;13:2021–2025. doi: 10.1039/c0gc00667j. [DOI] [Google Scholar]
- 62.Ruiz-de-Cenzano M., Cervera M.L., de la Guardia M. Evaluation of Greenness of Methods for the Determination of Mercury in Mushrooms. Curr. Green Chem. 2014;1:232–238. doi: 10.2174/2213346101666140319233119. [DOI] [Google Scholar]
- 63.Mostert M.M.R., Ayoko G.A., Kokot S. Application of chemometrics to analysis of soil pollutants. TRAC Trend. Anal. Chem. 2010;29:430–445. doi: 10.1016/j.trac.2010.02.009. [DOI] [Google Scholar]
- 64.Kohonen T. Self-organizing Maps. 3rd ed. Springer; Berlin, Germany: 2001. [Google Scholar]
- 65.Astel A., Tsakovski S., Barbieri P., Simeonov V. Comparison of self-organizing maps classification approach with cluster and principal components analysis for large environmental data sets. Water Res. 2007;41:4566–4578. doi: 10.1016/j.watres.2007.06.030. [DOI] [PubMed] [Google Scholar]
- 66.Tobiszewski M., Tsakovski S., Simeonov V., Namieśnik J. Multivariate statistical comparison of analytical procedures for benzene and phenol determination with respect to their environmental impact. Talanta. 2014;130:449–455. doi: 10.1016/j.talanta.2014.07.039. [DOI] [PubMed] [Google Scholar]
- 67.Tobiszewski M., Tsakovski S., Simeonov V., Namieśnik J. Application of multivariate statistics in assessment of green analytical chemistry parameters of analytical methodologies. Green Chem. 2013;15:1615–1623. doi: 10.1039/c3gc36976e. [DOI] [Google Scholar]
- 68.Behzadian M., Khanmohammadi Otaghsara S., Yazdani M., Ignatius J. A state-of the-art survey of TOPSIS applications. Expert Sys. Appl. 2012;39:13051–13069. doi: 10.1016/j.eswa.2012.05.056. [DOI] [Google Scholar]
- 69.Georgievski I., Aiello M. HTN planning: Overview, comparison, and beyond. Artif. Intell. 2015;222:124–156. doi: 10.1016/j.artint.2015.02.002. [DOI] [Google Scholar]
- 70.Jun D., Tian-tian F., Yi-sheng Y., Yu M. Macro-site selection of wind/solar hybrid power station based on ELECTRE-II. Renew. Sustain. Ener. Rev. 2014;35:194–204. doi: 10.1016/j.rser.2014.04.005. [DOI] [Google Scholar]
- 71.Troldborg M., Heslop S., Hough R.L. Assessing the sustainability of renewable energy technologies using multi-criteria analysis: Suitability of approach for national-scale assessments and associated uncertainties. Renew. Sustain. Energy Rev. 2014;39:1173–1184. doi: 10.1016/j.rser.2014.07.160. [DOI] [Google Scholar]
- 72.Tobiszewski M., Orłowski A. Multicriteria decision analysis in ranking of analytical procedures for aldrin determination in water. J. Chromatogr. A. 2015;1387:116–122. doi: 10.1016/j.chroma.2015.02.009. [DOI] [PubMed] [Google Scholar]
- 73.Braun B., Charney R., Clarens A., Farrugia J., Kitchens C., Lisowski C., Naistat D., O’Neil A. Completing Our Education Green Chemistry in the Curriculum. J. Chem. Edu. 2006;83:1126–1129. [Google Scholar]
- 74.Song Y., Wang Y., Geng Z. Some Exercises Reflecting Green Chemistry Concepts. J. Chem. Educ. 2004;81:691–692. doi: 10.1021/ed081p691. [DOI] [Google Scholar]
- 75.McKenzie L.C., Huffman L.M., Hutchison J.E. The evolution of a green chemistry laboratory experiment: greener brominations of stilbene. J. Chem. Educ. 2005;82:306–310. doi: 10.1021/ed082p306. [DOI] [Google Scholar]
- 76.Esteb J.J., Hohman J.N., Schlamadinger D.E., Wilson A.M. A solvent-free Baeyer-villiger lactonization for the undergraduate organic laboratory: synthesis of γ-t-butyl-ε-caprolactone. J. Chem. Educ. 2005;82:1837–1838. doi: 10.1021/ed082p1837. [DOI] [Google Scholar]
- 77.Cave G.W.V., Raston C.L. Green chemistry laboratory: benign synthesis of 4,6-diphenyl[2,2′]bipyridine via sequential solventless aldol and michael addition reactions. J. Chem. Educ. 2005;82:468–469. [Google Scholar]
- 78.Mercer S.M., Andraos J., Jessop P.G. Choosing the greenest synthesis: A multivariate metric green chemistry exercise. J. Chem. Educ. 2012;89:215–220. doi: 10.1021/ed200249v. [DOI] [Google Scholar]
- 79.Dicks A.P., Hent A. An Introduction to Life Cycle Assessment. Springer International Publishing; New York, NY, USA: 2015. pp. 81–90. [Google Scholar]
- 80.Ribeiro M.G.T.C., Costa D.A., Machado A.A.S.C. “Green Star”: A holistic Green Chemistry metric for evaluation of teaching laboratory experiments. Green Chem. Lett. Rev. 2010;3:149–159. doi: 10.1080/17518251003623376. [DOI] [Google Scholar]
- 81.Andraos J., Dicks A.P. Green chemistry teaching in higher education: A review of effective practices. Chem. Educ. Res. Pract. 2012;13:69–79. doi: 10.1039/C1RP90065J. [DOI] [Google Scholar]