Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2017 Jun 15;14(6):643. doi: 10.3390/ijerph14060643

Urban Ecological Security Simulation and Prediction Using an Improved Cellular Automata (CA) Approach—A Case Study for the City of Wuhan in China

Yuan Gao 1, Chuanrong Zhang 2, Qingsong He 1,*, Yaolin Liu 1,3,4,*
PMCID: PMC5486329  PMID: 28617348

Abstract

Ecological security is an important research topic, especially urban ecological security. As highly populated eco-systems, cities always have more fragile ecological environments. However, most of the research on urban ecological security in literature has focused on evaluating current or past status of the ecological environment. Very little literature has carried out simulation or prediction of future ecological security. In addition, there is even less literature exploring the urban ecological environment at a fine scale. To fill-in the literature gap, in this study we simulated and predicted urban ecological security at a fine scale (district level) using an improved Cellular Automata (CA) approach. First we used the pressure-state-response (PSR) method based on grid-scale data to evaluate urban ecological security. Then, based on the evaluation results, we imported the geographically weighted regression (GWR) concept into the CA model to simulate and predict urban ecological security. We applied the improved CA approach in a case study—simulating and predicting urban ecological security for the city of Wuhan in Central China. By comparing the simulated ecological security values from 2010 using the improved CA model to the actual ecological security values of 2010, we got a relatively high value of the kappa coefficient, which indicates that this CA model can simulate or predict well future development of ecological security in Wuhan. Based on the prediction results for 2020, we made some policy recommendations for each district in Wuhan.

Keywords: urban ecological security, simulation and prediction, pressure-state-response (PSR), cellular automata (CA), geographically weighted regression (GWA)

1. Introduction

Ecological security refers to a non-threatened state [1,2,3], which may include the state of human life, health, well-being, basic rights, livelihood resources, necessary resources, social order, and human ability to adapt to environmental changes. Ecological security reflects the degree of ecosystem integrity and health [1], and it may provide guarantee for sustainability of an eco-economic system [4]. Ecological security research began in the last century [5,6,7]. Important literature on this concept includes the “Ecological risk assessment outline” published by the United States Environmental Protection [8] and the “Global vulnerability assessment framework for environmental risk” proposed by Clark et al. [9]. Ecological security is a concept opposite to ecological risk. Ecological security measures the safeguard of ecological systems while ecological risk assesses the danger or destruction of ecological systems. However ecological security and ecological risk are related. In fact, parts of the concept of ecological security come from ecological risk [10,11,12]. Because many ecological disasters or degradation are caused by human activities, measurement of ecological security should represent the capability of human activities. Ecological security may be assessed using an indicator system for environmental pressures or degradation.

Urban ecological security is an important research topic [13]. The urban area, as the center of socio-economic development, is a highly populated ecological system and is more fragile in terms of ecological security [2,4,14]. It is, therefore, imperative to study urban ecological security. In addition, studying urban ecological security may benefit for carrying out efficient environmental management [15]. With increasing concerns over urban ecological security, many methods have been proposed in the literature for assessing urban ecological security. These methods mainly include mathematical models, system dynamics methods, ecological footprint methods [16], and landscape ecology methods [15,17,18]. The commonly used mathematical model methods include the pressure-state-response (PSR) model, the comprehensive index method [19], the analytic hierarchy process method [20,21], the gray correlation degree method [22], the matter element evaluation method, and the principal component projection method. However, some of these methods, such as the comprehensive index methods and ecological footprint methods have limitations in the study of urban ecological security. These methods may be good at evaluating the status of an administrative region, but they cannot reflect the dynamic process of the ecological security change, especially at a fine scale. Among these mathematical methods, the PSR model for human and environmental systems [23,24,25,26], which was jointly developed by the United Nations Economic Cooperation and Development (OECD) and the United Nations Environment Program (UNEP), and the comprehensive evaluation index system established by U.S. Environmental Protection Agency (USEPA) [27] are particularly important.

However, most of the research on urban ecological security using the aforementioned methods focused on evaluating current or past status of the ecological environment. Very few studies in the literature have been carried out to simulate or predict future changes in urban ecological security. Nevertheless, predicting future changes in urban ecological security is important [28,29]. The predicted change of urban ecological security could be used to make reasonable environmental policies for urban sustainability development [30,31,32]. The predicted change of urban ecological security could also be useful for urban planners to develop more realistic urban development plans. However, there is a lack of literature in simulating or predicting future changes of urban ecological security. Based on our best knowledge, we only found a couple of publications in literature for forecasting urban ecological security. For example, Gong et al. [28] and Yang et al. [29] forecasted urban ecological security using the classical cellular automata (CA) models. However, the classical CA models consider only short-range spatial dependence and do not consider long-range spatial dependence (e.g., not immediately connected neighbor cells but located far away cells) [33]. Therefore, it is difficult to make an accurate simulation or prediction of the dynamic urban ecological security changes among the neighborhoods.

In addition, there is little literature exploring the urban ecological environment at a fine scale. In most existing literature, urban ecological security was studied at coarse scales (global, regional, city, or county levels) [34,35]. In those studies, a whole city or a county was given only one security value [21,36]. It is, therefore, impossible to figure out how things are going on inside the city [33]. Nevertheless, urban areas are heterogeneous [37]. Urban ecological security may be different at different locations in the fine scales such as district level. It is, therefore, improper to treat the city as homogeneous and give the whole city one urban ecological security value. One security value cannot represent the uneven status of ecological security inside a city. Different districts or neighborhoods in a city may have different ecological security values. Therefore, we need to simulate urban ecological security values at a fine scale to give us more information about the heterogeneity of a city. This may be used for better ecological understanding of integrated human-natural urban systems and undertake wise urban planning. Compared to the coarse scales such as city scale, a fine scale could help to find out the uneven status of ecological security inside a city and could give more information about the heterogeneous ecological security inside a city.

To overcome these limitations and fill-in the literature gaps, in this study, we simulated and predicted urban ecological security at a fine scale (district level) using an improved CA approach to better understand spatial heterogeneity of urban ecosystems. There are two major new contributions of the improved CA approach. First, we used the pressure-state-response (PSR) method based on grid-scale data to evaluate urban ecological security. We considered urbanization as the most significant driving force causing ecological and environmental problems. We carefully quantified the ecological status of the urbanization areas, because the biggest impetus to the ecological security problem is the increased urbanization processes. To better quantify urban ecological security, we used three dimensions to characterize urban growth. The three dimensions include urban growth degree (UGD), urban growth capacity (UGC), and urban growth pattern (UGP). We evaluated ecological security states from the view of environmental structure, ecological function value, and resilience of the ecosystem.

Second, in simulating and predicting the urban ecological security process, we extended the classical CA model by introducing the geographic weighting regression (GWR) concept into the transformation rules of the classical CA model. GWR can take into account spatial variation of the sampling unit [38], therefore, it may make simulation of the dynamic urban ecological security changes among different neighborhoods more accurate.

We applied the improved CA approach in a case study—simulating and predicting urban ecological security for the city of Wuhan of Central China. Through the case study, we aimed to verify the potential of the improved CA method for more accurately simulating and predicting urban ecological security.

2. Materials and Methods

2.1. Study Area

The city of Wuhan is one of the fastest growing cities in central China, located in the middle reaches of the Yangtze River (see Figure 1). It is the capital of Hubei Province. Wuhan city constitutes seven districts and has a total area of 8549 km2, of which 39.27% consists of plains and 18.17% is hilly and mountainous regions. Wuhan has experienced rapid urbanization and a significant economic growth since last century. From 2005 to 2010, the urban area expanded to 552.61 km2 (Wuhan Municipal Bureau of Statistics 2005, 2010). Its population grew from 8.58 million to 10.61 million and its economy expanded from 226.12 billion to 1090.56 billion yuan. The city has been witnessed an obvious and rapid urbanization.

Figure 1.

Figure 1

Location of the study area.

2.2. Data Sources

Land use data were mainly derived from remotely sensed images. The remotely sensed images include two multi-spectral Landsat MSS/TM/ETM+ images in the years 2005 and 2010. The resolution of the Landsat MSS/TM/ETM+ images is 30 m. The images were downloaded from the U.S. Geological Survey (USGS). To ensure accuracy of the image classification results, all the selected images are cloudless and with thick vegetation coverage. Before classification, all the images and other Geographic Information System (GIS) data were geometrically rectified to the World Geodetic System-1984 Coordinate System (WGS-84) and the Universal Transverse Mercator coordinate system. In total, 90 ground control points were selected as supplementary data. We did the classification using the maximum likelihood method. According to natural ecological and land use attributes, land uses/covers from remotely sensed images were always classified into six types. However, grassland has a very small proportion in Wuhan. The images were, therefore, classified into other five types of land use/cover, namely construction land, forest, farmland, water, and bare land. Meanwhile, we randomly selected 200 training samples with sufficient information on the spectral characteristics for each land use type. In addition, we selected 100 field points for checking classification accuracy. The overall classification accuracy values for the images are from 81.41% to 88.00%, and the kappa coefficient values are from 0.77 to 0.85, which indicate a high classification accuracy [39,40]. Based on the classification results, the proportions of construction land, forest, farmland, water, and bare land in Wuhan in 2010 are 7.78%, 8.34%, 61.99%, 21.40%, and 0.49%, respectively. Population data were collected from the fifth census and the sixth census in China at the street level. Socio-economic data mainly include national and regional planning documents and policies, which were downloaded from the government website [41].

2.3. Methods

2.3.1. The Flow Chart of the Methods

The methods include two main components: evaluation of urban ecological security using the PSR model and simulation and prediction of ecological security using the CA model with the GWR concept. Figure 2 illustrates the flow chart of the methods. The procedure of the methods is introduced as follows:

  • Step 1: We evaluated the ecological security classes of 2005 and 2010 using the PSR model.

  • Step 2: We used the data of 2005 to conduct a five-year simulation based on the CA rules. We obtained the simulated result of 2010 based on the five-year simulation.

  • Step 3: We compared the simulated result of 2010 and the evaluated result of 2010 to verify the simulation accuracy in the second step.

  • Step 4: We repeated step 2 and step 3 until a satisfactory level of accuracy was obtained in step 3. Then we recorded the CA rules of the simulation. The total number of the iterations of the 5-year simulation was recorded as N.

  • Step 5: We then obtained the predicted result for 2020, which is a 15-year simulation, by using the rules obtained in step 4. We took 3N as the total number of iterations in this 15-year simulation.

Figure 2.

Figure 2

The flow chart of the methods. CA: cellular automata; PSR: pressure-state-response.

2.3.2. PSR Evaluation Model

PSR model is a comprehensive evaluation model for environmental problems proposed by the United Nations Economic Cooperation and Development (OECD). It is composed of the pressure index for ecological environment problems, state index for eco-environment status, and response index for social and economic measures that quantify human’s response to ecological problems. The pressure index consists of three indicators: urban growth degree (UGD) [29], urban growth capacity (UGC) [42,43,44,45,46,47,48], and urban growth pattern (UGP) [49,50,51]. The ecological security status of an ecosystem was considered from three aspects: ecological function, ecological structure, and ecological resilience [52]. In order to make the research scale more refined and better reflect ecological state of the administrative units, the indicators of these three aspects were chosen at landscape scale [53]. The landscape ecological function (LEF) was assessed mainly based on the ecological service values. The most frequently used method proposed by Costanza et al. [54] and Xie et al. [55] was used to measure the ecological service values for different land use types in this study. The landscape ecological structure (LES) was measured using (1) Shannon’s diversity index (SHDI), which measures the number of different land cover classes present; (2) the area-weighted plots fractal dimension index that reflects shape complexity across a range of spatial scales; and (3) modified Simpson’s evenness index, which ensures an even distribution of areas among patch types [51].

Landscape ecological resilience (LER) is an important factor for sustainability of regional ecology. LER measures the disturbance that an ecosystem can bear until its characteristics change [56]. In this study, we used the fragility index to measure this disturbance. It is calculated by the inverse of number of patches per unit area (PD). The 8-way neighbors method was used to define patches that can well represent the ecological resilience of a region [52].

The ecological security responses were interpreted by policy measures such as ecological zoning and environmental plans. From 2005 to 2010, the specific ecological responses of Wuhan City included “ecological bottom line”, “ecological development area”, “prospective ecological area”, “tricyclic rectification area”, and “urban concentrated construction area”.

All of the aforementioned landscape indices were calculated using the software Fragstats [57,58]. Delphi method was used to assign the weight for each index. Compared to the objective weight allocation methods, Delphi method can better reflect the regional differences, and is more in line with the objective of this study so this method was employed. Considering the mechanism of the PSR model and the richness of the data, we assigned the state a weight of 0.5, which can better display the ecological security of Wuhan city. Since both the UGD and UGC in the pressure part and LEF and LES in the state part played important roles in the evaluation of urban ecological security, they were assigned higher weights. Table 1 lists the specific PSR evaluation indices and their weights.

Table 1.

PSR evaluation indices and their weights. UGD: urban growth degree; UGC: urban growth capacity; UGP: urban growth pattern; LEF: landscape ecological function; LES: landscape ecological structure; LER: landscape ecological resilience; P: ecological pressure; S: ecological state; R: ecological response.

P-S-R Criteria Indices
Names Weights Names Weights Names Weights
Pressure 0.3 UGD 0.5 Proportion of construction land 1.0
UGC 0.3 Population Density 0.4
Shortest distances to traffic (road/railway/airport) 0.2 (0.6/0.2/0.2)
Distances to geometric centers 0.1
Distances to commercial centers 0.3
UGP 0.2 Aggregated/linear growth 0.25
Leapfrog growth 0.75
State 0.5 LEF 0.4 Ecological service values 1.0
LES 0.4 Shannon diversity 0.2
Area-weighted plots fractal dimension index 0.4
Patch density 0.4
LER 0.2 The fragility index 1.0
Response 0.2 R 1.0 Ecological zoning and environmental plans 1.0

Before performing the evaluation, the original data of different dimensions were standardized. The extremum standardization method was used for this purpose.

2.3.3. GWR-Based Cellular Automata (CA) Model

Cellular automata (CA) was a commonly used model for simulating and predicting urban growth [42,58,59]. CA models can take into account dynamic changes of a city caused by complex factors such as nature and socio-economy, and use simple rules to simulate the complicated temporal and spatial dynamic processes [60,61,62]. In addition, it has the advantage of easily integrating itself with high-resolution remotely sensed images and geographic information systems [63]. This makes it popular for simulating urban dynamic changes. Like general urban dynamic change processes, urban ecological security could be described as a synthesis of components of coupled human and natural ecosystems. Urban ecological security exhibits complex spatial and temporal processes. Therefore, urban ecological security could be simulated using CA models.

The CA simulation model used in this paper is based on the concept of GWR. The cellular automata is composed of five basic elements: cell, cell space, neighbor, transformation rules, and time sets. The neighborhood function is the core component of CA’s conversion rules, which embody the essence of CA’s “bottom-up” self-organization evolution. The classical CA algorithms usually employ the traditional global regression statistics such as a logistics regression model to calculate the conversion rules. There is, however, a limitation in using the global regression: the estimated parameters using the global logistics regression model are just mean values of the explanatory variables. The global parameters cannot reflect spatial heterogeneity of the relationships between the dependent variable and the explanatory spatial variables. Based on the first law of geography, near objects are more related than distant objects. Therefore, the explanatory variables may have different degrees of influence on conversion rules for different geographical locations. The conversion rules may not be a trend distribution with a single spatial structure. They may have spatial instability.

To reflect spatial instability in conversion among different land use types, we employed a local regression model—GWR—instead of the global logistics regression model to calculate the conversion rules. GWR is an extension of the traditional multiple linear regression toward a local regression. The regression coefficients of GWR are specific to a location rather than being global estimates [64,65]. The local estimation of the regression coefficients of GWR is expressed by the following equation:

yi=β0(mi,ni)+j=1nβj(mi,ni)xij+εi (1)

where (mi,ni) is the spatial location of the ith observation and βj(mi,ni) is the value of the jth parameter at point location i. The regression parameters of this equation are estimated at each location i(mi,ni).

GWR was specifically designed to deal with the spatial non-stationarity of regression coefficients between the dependent variable and explanatory variables by measuring those coefficients locally using local data [66,67,68]. GWR has capability of incorporating various auxiliary variables with spatially varied correlation coefficients. The GWR concept, therefore, may more accurately reflect the characteristics of spatial heterogeneity of ecological dynamic processes. Hence, in the processes of deciding conversion rules, we used GWR instead of global logistics regression to obtain cell conversion probability. We applied the GWR in the CA rules mainly for calculating the probability from one assigned class to other classes. We first used the GWR models to find out relationships between a cell state value and each explanatory variable over space. Based on the relationships we then calculated the conversion probability of each cell to one specified type at each spatial position using the following formula:

pi=eyi1.0+eyi (2)

where pi represents the transition probability to one cell state value at position i, and yi is the regression coefficient equation for position i that was obtained by GWR.

In order to combine with the CA model, it is necessary to give one specific probability for each spatial location. We used the concept of roulette wheel to decide which class would be selected substantially based on the aforementioned calculated probability values. At the same time, we also considered whether or not the selected class values would satisfy the pre-set cell transition probability values.

We forecasted the ecological security status and patterns of 2020 based on the ecological security levels of 2005 and 2010 using the GWR tool in ArcGIS 10.2 software (Environmental Systems Research Institute, Inc., Redlands, CA, USA) [69]. We took the ecological security level as the dependent variable and the indicators calculated in the aforementioned PSR evaluation as the independent variables to obtain the regression coefficients of each variable. Taking simulation of the urban ecological security of 2005–2010 for example, to simulate ecological security status in 2010, we used the number of ecological evaluation classes in 2010 as the termination condition based on the ecological security patterns of 2005. In the process of cell conversion iterations, we first estimated the probability of the currently iterated cell that would turn to each ecological security class. We then determined a class by the method of roulette wheel and the judgement about whether or not the conversion probability of the class satisfied the pre-set cell transition probability. If it satisfied, then the cell would be turned to that class. We stopped the iteration after all of the ecological security classes were satisfied. The total number of iterations was recorded as N. For forecasting the urban ecological security of 2020, we took 3N as the total number of iterations from the ecological security patterns of 2005.

3. Results and Discussion

3.1. PSR Evaluation

The PSR evaluation results of ecological security values were taken into account of ecological pressure, ecological state, and ecological response. The evaluated ecological security values are distributed in the range of 0–0.7. For a better view, we divided the range into five levels, from Class 1 to Class 5. If a value is less than 0.15, the grid cell will be classified into Class 1. Class 1 means a location with the lowest security. If a value belongs to the range from 0.15 to 0.3, the location will be classified into Class 2. Similarly, Class 3 has values ranging from 0.3 to 0.4. A cell location with Class 3 indicates that it is located at the area with the mid-security level. Class 4 has values ranging from 0.4 to 0.5. The highest level of the urban ecological security is Class 5, which has values greater than 0.5.

3.1.1. Evaluation Results of 2005 and 2010

Table 2 and Figure 3 show the evaluation results of ecological security in 2005 and 2010. From these results, it can be seen that the ecological security in 2010 has an obvious improvement compared to that in 2005. Class 1 and Class 2 in 2010 represent decreased percentages compared to those in 2005, and there is increase in areas of Class 4 and Class 5 in 2010 compared to 2005.

Table 2.

The evaluation results of ecological security in 2005 and 2010.

Evaluation Results of 2005 Evaluation Results of 2010
Areas (km2) Percentages (%) Areas (km2) Percentages (%)
CLASS 1 141.90 1.68 47.46 0.56
CLASS 2 854.46 10.09 581.47 6.87
CLASS 3 4753.35 56.11 4568.95 53.98
CLASS 4 1603.92 18.93 1849.09 21.85
CLASS 5 1117.71 13.19 1416.83 16.74
Figure 3.

Figure 3

Evaluation results of ecological security in 2005 and 2010 using the PSR model.

For the administrative areas, in Figure 4, the ecological conditions in 2005 are similar in the districts of Huangpi, Jiangxia, Xinzhou, Dongxihu, Caidian and Hannan: they all have the largest proportion of Class 3, then followed by Class 4 and Class 5. This indicates good ecological conditions in the administrative areas. Hanyang, Jiangan, Jianghan, Qiaokou, and Qingshan Districts belong to the poor ecological security areas, because of the larger proportions of Class 2 and Class 1. Wuchang District also has a large proportion of Class 2 and Class 1, but the areas belonging to Class 4 and Class 5 in Wuchang are not small. Wuchang District is therefore noted as a district with internal heterogeneity. The areas of Class 1, which indicates the worst ecological security, are mainly distributed in Hongshan, Jianghan, Jiangan, and Qingshan Districts. There have been great changes in overall ecological conditions in 2010 compared to those in 2005. However, the ecological conditions in each administration district have not shown great changes. The ecological conditions in Huangpi, Jiangxia, Xinzhou, Dongxihu, Caidian and Hannan Districts improved. These districts have ecological security levels above the average. Jianghan, Qiaokou, and Qingshan Districts have poor ecological security conditions. The number of the districts with high internal heterogeneity in 2010 increased from one to three districts, including Hanyang, Jiangan, and Wuchang Districts. The areas with the worst ecological security conditions are mainly located in Jiangan, Qiaokou, Jianghan, and Hongshan Districts.

Figure 4.

Figure 4

The distributions of ecological security classes in 2005 and 2010.

3.1.2. Discussion of the Changes from 2005 to 2010

Figure 5 shows the changes of ecological security from 2005 to 2010. The region with red color means an increase in ecological security level, and the region with blue color means a decrease in ecological security level. From the final ecological security evaluation results of 2005 and 2010, we can see that the ecological environment in the central city has decreased slightly during that five-year period. In the central city (circle A in the figure), the ecological environment remains unchanged or just decreases slightly. From the edge of the central city to the suburban areas, most places have an increased ecological security. In the outskirts of the city, the ecological security situation has shown a certain degree of reduction. This is especially true for Xinzhou district and Hannan Districts (circles C1 and C2).

Figure 5.

Figure 5

Changes in ecological security from 2005 to 2010.

Most areas in the 13 administrative districts also retain unchanged ecological conditions. For example, more than 80% of the areas in Wuchang and Jianghan Districts maintain their original ecological security levels. Except for Hannan District, the other 12 districts have enhanced conditions as the second largest proportion. In total 16.76% of the areas in the Hannan District have weakened ecological conditions while only 11.41% of areas in that district have enhanced conditions. Hannan District is the only district that has a larger proportion of areas with weakened conditions than areas with enhanced conditions. There are relatively large ecological security-enhanced areas in Jiangxia, Huangpi, Xinzhou, Caidian, Hongshan and Dongxihu Districts. The proportions of enhanced areas in Hongshan and Qingshan Districts are the two highest proportions in all of the districts, at 39.27% and 38.21%, even if their enhanced areas are not as large as those in the previously mentioned districts because of their small total district areas. Except for Hongshan and Qingshan Districts, Hanyang and Dongxihu Districts have enhanced proportions larger than 30%.

To find out the reason for ecological security changes from 2005 to 2010 in Wuhan, we analyzed the urban ecological security from the perspectives of ecological pressure (P), ecological state (S), and ecological response (R), respectively. Figure 6 illustrates the P/S/R changes from 2005 to 2010. As shown in Figure 6, the overall ecological environment pressure of Wuhan has significantly increased from 2005 to 2010, and only small areas around the main city have decreased ecological pressure. The ecological pressure in north Huangpi District and northeast Xinzhou District has little change. The areas of ecological improvement are mainly located in the southern part of Huangpi District and some areas in Qingshan, Hongshan, and Dongxihu Districts. The northeastern part of Wuhan city that belongs to the Xinzhou area and the southwest part that belongs to the Hannan District show a weakened ecological environment.

Figure 6.

Figure 6

The P/S/R changes and the whole changes of ecological security in Wuhan city from 2005 to 2010.

The ecological state basically remained unchanged from 2005 to 2010, and the ecological response was not significant either. There is only a slight decline of the ecological security in the central city. Nevertheless, the construction expansion from the city center to the surrounding areas of the city was significant, which caused most of the surrounding urban areas to have increased ecological environment pressure. The ecological responses in these areas were the most significant. However, the ecological security state of these areas remained basically unchanged or was even slightly enhanced. This is the main ecological security improvement in Wuhan. The ecological response in the suburb areas was small. If combined with urbanization, the ecological security situation remained basically unchanged or slightly decreased from 2005 to 2010.

We used expert knowledge and a literature review to find out the important drivers of ecological security changes in Wuhan. We found that the better ecological planning management and policies greatly accounted for ecological security changes of Wuhan City from 2005 to 2010. The changes in urban planning and land use policies were linked to modifications of landscapes and ecosystems in Wuhan. Good planning, management, and policies played an important role in driving the security changes. These planning management and policies were mainly applied to the outer ring areas around the main urban area, which include Huangpi, Dongxihu, Caidian, Jiangxia, Xinzhou, Hongshan Districts, and the eastern part of Qingshan District. Based on the expert knowledge and literature review we also found that the ecological security environment changes during 2005–2010 resulted from comprehensive multi-factors such as social, political and economic factors. For example, population growth and changing economic conditions were two causes of ecological security change. Urbanization and extended peri-urban settlement threatened various ecosystem processes and drove ecological security change from 2005 to 2010. Rapid economic development and construction efforts in Wuhan led to major ecological security changes from 2005 to 2010. In general, Wuhan has undergone rapid development period in recent years, especially in the central city, where development and construction efforts continued to increase in its main areas. This resulted in a widespread ecological pressure. However, even with the wide and fast development of the city, there was no sharp decline of the ecological state.

3.2. The Simulation by the Proposed CA Model

We used the proposed CA model with the GWR concept to simulate the ecological security situation in 2010 based on the ecological security situation in 2005. We then compared and verified the simulation results with the actual ecological security values in 2010. Kappa coefficient statistics were used to measure the simulation results. The calculated kappa coefficient is 0.756, which indicates that the simulation results are good and the proposed CA model can be used to predict future ecological security.

The evaluated ecological security results in 2010 and the simulated ecological security results in 2010 are shown in Table 3 and Figure 7. From Figure 7, it can be seen that the proportion of each class in the simulated results in 2010 is roughly the same as the actually evaluated results in 2010. From Table 2 it can be seen that the areas with a fair ecological security in both the evaluated results and the simulated results still occupy the largest proportion. However, Class 4 occupies 12.80% in the simulated results and 21.85% in the evaluated results. Class 4 has the largest difference among the five classes. Only the simulated areas of this class are smaller than the actual areas, and the simulated areas of the other four classes are larger than the actual areas.

Table 3.

The simulated and evaluated ecological security results in 2010.

Simulation Results in 2010 Actual Evaluation Results in 2010
Areas (km2) Percentages (%) Areas (km2) Percentages (%)
CLASS 1 228.86 2.70 47.46 0.56
CLASS 2 694.61 8.21 581.47 6.87
CLASS 3 4850.02 57.30 4568.95 53.98
CLASS 4 1083.58 12.80 1849.09 21.85
CLASS 5 1607.78 18.99 1416.83 16.74

Figure 7.

Figure 7

The evaluated ecological security results in 2010 and the simulated ecological security results in 2010.

3.3. Prediction Results of 2020

We used the proposed CA model to forecast the ecological security situation of Wuhan in 2020. Figure 8 illustrates the predicted results of the ecological security in 2020. As shown in the figure, areas with comparative insecurity (Class 1 and Class 2) are projected to be more concentrated by 2020, especially in Jianghan, Jiangan and Qiaokou Districts. Both of Class 1 and Class 2 occupy more than 70% of the administrative areas in these three districts, and they are the major classes in these three districts. Hanyang District and Wuchang District belong to the areas with a low ecological security, because the proportions with ecological unsafe areas in these two districts are larger than those with secure areas. Caidian, Huangpi, Xinzhou, and Jiangxia Districts belong to the districts with good ecological conditions. These four districts have large areas with mid-security level. The total area with security level higher than the middle level is larger than that with security level lower than the middle level in these four districts. Hannan and Hongshan Districts are the districts with the best ecological conditions in Wuhan because of their large proportions of Class 4 and Class 5. Qingshan District has a big internal difference: the ecological safe areas and unsafe areas account for 42% and 44%, and both are widely distributed. On the contrary, the Dongxihu District has the smallest internal heterogeneity.

Figure 8.

Figure 8

Prediction results of the ecological security in 2020.

Figure 9 illustrates the proportions of each ecological security level in the 13 districts of Wuhan from 2005 to 2020. From the figure, it can be seen that the ecological security situation will have an improvement in the areas of Hannan, Hongshan, Jiangxia, Qingshan, and Jiangan Districts by 2020. Jianghan and Qiaokou Districts should be the areas for future development. These two districts have a lot of areas with low security levels.

Figure 9.

Figure 9

The proportions of each ecological security level in the 13 districts of Wuhan from 2005 to 2020.

4. Conclusions

In this paper, we proposed an improved CA approach for simulate and predict urban ecological security at a fine scale (district level). We proposed to first evaluate urban ecological security using the PSR method, and then simulate and predict urban ecological security using the CA model with the GWR concept. We applied the proposed CA approach in a case study—simulating and predicting urban ecological security in Wuhan, China. We first evaluated the ecological security levels in 2005 and 2010 in Wuhan city using the PSR method. We then simulated and predicted the future urban ecological security situations in 2010 and 2020 using the improved CA model with the GWR concept. The results show that our improved CA model is effective and feasible for simulation or prediction of future ecological security.

Although the simulated results are good, there were some limitations in our case study. For example, the Landsat images were used in this case study. The Landsat imagery has a low resolution and many mixed pixels. The mixed pixels made it difficult to accurately classify the satellite images. As the input data for our models, the inaccurate classification results from the satellite images affected the accuracy of our final simulation results. For example, Class 4 generated the largest error in the simulation results of 2010—there is about 9% difference between the simulation results and the evaluated results of Class 4. This has caused the overall simulated ecological security situation lower than the overall actual situation. The other limitation is validation of the CA model. It is impossible to obtain a perfect simulation result using any model. Therefore, it is important to validate the improved CA model for practical applications. In this study, we only used the kappa coefficient indices for validation purpose. However, the Kappa indices have limitations, and sometimes they may be misleading for purposes of accuracy assessment and map comparison [70]. Therefore, we may consider adopting more measures, such as quantity disagreement and allocation disagreement from a cross-tabulation matrix, for validation purposes in the future.

We discussed the reasons for the ecological security changes in Wuhan from 2005 to 2010. The ecological security environment changes between 2005 and 2010 resulted from multiple factors. The ecological security changes were mainly caused by the rapid economic development and construction efforts in Wuhan. Better ecological planning management practices and policies in 2010 also led to the ecological security improvement. These planning management and policies were mainly applied to the outer ring areas around the main urban areas.

Based on the prediction results of 2020, we would like to make the following policy recommendations for each district in Wuhan. For the districts that are continuing to have a comparably high ecological security and have an obvious improvement from 2005 to 2020, such as Hannan, Hongshan, and Jiangxia Districts, the government only needs to maintain the ecological environment. For the districts that will continue to be the concentration areas with the worst ecological security situations of Wuhan city in 2020, such as the Jianghan, Jiangan, and Qiaokou Districts, the government should pay more attention to a centralized development for them. The government should undertake more contiguous land use planning instead of fragmented land use planning in order to make full use of each piece of land. For some districts such as Qingshan District, diverse plans should be made inside the district considering its high internal spatial heterogeneity in 2020.

Acknowledgments

This research was financially supported by the Special Fund of Ministry of Land and Resources of China in the Public Interest (ID. 201511001).

Author Contributions

Yuan Gao and Chuanrong Zhang conceived and designed the research; Qingsong He helped in experiments and data analysis; Chuanrong Zhang helped in paper organization and language correction; and Yaolin Liu and Yuan Gao wrote the paper.

Conflicts of Interest

The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.

References

  • 1.Chen G.J. On ecological security. Chongqing Environ. Sci. 2002;24:1–3. (In Chinese) [Google Scholar]
  • 2.Zou C.X., Shen W.S. Advances in ecological security. Rural Eco-Environ. 2003;19:56–59. (In Chinese) [Google Scholar]
  • 3.Xiao D., Chen W. On the basic concepts and contents of ecological security. J. Appl. Ecol. 2002;13:354–358. (In Chinese) [PubMed] [Google Scholar]
  • 4.Xie H. A study on indices system and assessment criterion of ecological security for city. J. Beijing Norm. Univ. 2004;40:705–710. (In Chinese) [Google Scholar]
  • 5.Eckersley R. Environmentalism and Political Theory: Toward an Ecocentric Approach. Suny Press; Albany, NY, USA: 1992. [Google Scholar]
  • 6.Brown L.R. Building A Society of Sustainable Development. Scientific and Technological Literature Press Google Scholar; Beijing, China: 1984. [Google Scholar]
  • 7.Stoett P.J. Global environmental security, energy resources and planning: A framework and application. Futures. 1994;26:741–758. doi: 10.1016/0016-3287(94)90042-6. [DOI] [Google Scholar]
  • 8.U.S. Environmental Protection Agency . Environmental Monitoring and Assessment Program (EMAP) Research Plan 1997. U.S. Environmental Protection Agency; Washington, DC, USA: 1998. [Google Scholar]
  • 9.Clark W.C., Jager J., Corell R., Kasperson R., McCarthy J.J., Cash D., Guston D.H. Environment and Natural Resources Program; Cambridge, MA: [(accessed on 14 June 2017)]. Assessing Vulnerability to Global Environmental Risks—Report of the workshop on Vulnerability to Global Environmental Change: Challenges for Research, Assessment and Decision Making, Warrenton, VA. Research and Assessment Systems for Sustainability Program Discussion Paper 2000-12. Available online: http://www.belfercenter.org/publication/assessing-vulnerability-global-environmental-risks. [Google Scholar]
  • 10.Chen X., Zhou C.H. Review of the studies on ecological security. Prog. Geogr. 2005;24:8–20. (In Chinese) [Google Scholar]
  • 11.Norton S.B., Rodier D.J., van der Schalie W.H., Wood W.P., Slimak M.W., Gentile J.H. A framework for ecological risk assessment at the EPA. Environ. Toxicol. Chem. 1992;11:1663–1672. doi: 10.1002/etc.5620111202. [DOI] [Google Scholar]
  • 12.Halle M., Dabelko G., Lonergan S., Matthew R. State-of-the-Art Review of Environment, Security and Development Co-Operation. OECD Development Assistance Committee; Paris, France: 2000. Working Paper of Conducted on Behalf of the OECD DAC Working Party on Development and Environment. [Google Scholar]
  • 13.Hodson M., Marvin S. ‘Urban ecological security’: A new urban paradigm? Int. J. Urban Reg. Res. 2009;33:193–215. doi: 10.1111/j.1468-2427.2009.00832.x. [DOI] [Google Scholar]
  • 14.Cui S.H., Hong H.S., Huang Y.F., Xue X.Z. Progress of the ecological security research. Acta Ecol. Sin. 2005;25:861–868. (In Chinese) [Google Scholar]
  • 15.Liu H., Wang H., Zhang X.W. Research review on ecological security assessment. Chin. J. Ecol. 2006;25:74–78. (In Chinese) [Google Scholar]
  • 16.Huang Q., Wang R., Ren Z., Li J., Zhang H. Regional ecological security assessment based on long periods of ecological footprint analysis. Res. Conserv. Recycl. 2007;51:24–41. doi: 10.1016/j.resconrec.2006.07.004. [DOI] [Google Scholar]
  • 17.Wang G., Cheng G.D., Qian J. Several problems in ecological security assessment research. J. Appl. Ecol. 2003;14:1551–1556. (In Chinese) [PubMed] [Google Scholar]
  • 18.Su Y., Chen X., Liao J., Zhang H., Wang C., Ye Y., Wang Y. Modeling the optimal ecological security pattern for guiding the urban constructed land expansions. Urban For. Urban Green. 2016;19:35–46. doi: 10.1016/j.ufug.2016.06.013. [DOI] [Google Scholar]
  • 19.Kwak S.J., Yoo S.H., Shin C.O. A multiattribute index for assessing environmental impacts of regional development projects: A case study of Korea. Environ. Manag. 2002;29:301–309. doi: 10.1007/s00267-001-0022-2. [DOI] [PubMed] [Google Scholar]
  • 20.Tran L.T., Knight C.G., O’Neill R.V., Smith E.R., Riitters K.H., Wickham J. Fuzzy decision analysis for integrated environmental vulnerability assessment of the Mid-Atlantic Region 1. Environ. Manag. 2002;29:845–859. doi: 10.1007/s00267-001-2587-1. [DOI] [PubMed] [Google Scholar]
  • 21.Yang J., Li X., Zhang Y., Sun C., Xu H., Ji B. Assessment on urban ecological security spatial differences based on causal network: A case of Dalian City. Acta Ecol. Sin. 2008;28:2774–2783. [Google Scholar]
  • 22.Zhang F.T., Su W.C., Zhou J.X. Assessment of urban ecological security based on entropy-weighted gray correlation analysis. Chin. J. Ecol. 2008;27:1249–1254. (In Chinese) [Google Scholar]
  • 23.Zuo W., Wang Q., Wang W.J., Liu J.J., Yang Y.P. Study on regional ecological security assessment index and standard. Geogr. Territorial Res. 2002;18:67–71. (In Chinese) [Google Scholar]
  • 24.Zhou W., Wang R. Methodology assessment of urban ecological security—A case study of Beijing. Chin. J. Ecol. 2005;7:848–852. (In Chinese) [Google Scholar]
  • 25.OECD (Organization of Economic Cooperation and Development) Environmental Indicators-OECD Core Sets. OECD; Paris, France: 1994. [Google Scholar]
  • 26.Hammond A., Adriaanse A., Rodenburg E., Bryant D., Woodward R. Environmental Indicators: A Systematic Approach to Measuring and Reporting on Environmental Policy Performance in the Context of Sustainable Development. World Resources Institute; Washington, DC, USA: 1995. p. 50. [Google Scholar]
  • 27.USEPA U Integrated Risk Information System (IRIS). Inorganic Arsenic. [(accessed on 26 June 2016)]; Available online: http://www.epa.gov/iris/subst/index.html#a,1999.
  • 28.Gong J., Xia B., Guo L. Assessment and prediction models of urban ecological security. Acta Sci. Nat. Univ. Sunyatseni. 2006;45:107–111. (In Chinese) [Google Scholar]
  • 29.Yang Q.S., Qiao J.G., Ai B. Simulation of urban ecological security pattern based on cellular automata: A case of Dongguan City, Guangdong Province of South China. J. Appl. Ecol. 2013;24:2599–2607. (In Chinese) [PubMed] [Google Scholar]
  • 30.Giddings B., Hopwood B., O’brien G. Environment, economy and society: Fitting them together into sustainable development. Sustain. Dev. 2002;10:187–196. doi: 10.1002/sd.199. [DOI] [Google Scholar]
  • 31.Shaker R.R. The well-being of nations: An empirical assessment of sustainable urbanization for Europe. Int. J. Sustain. Dev. World Ecol. 2015;22:375–387. doi: 10.1080/13504509.2015.1055524. [DOI] [Google Scholar]
  • 32.Shaker R.R. The spatial distribution of development in Europe and its underlying sustainability correlations. Appl. Geogr. 2015;63:304–314. doi: 10.1016/j.apgeog.2015.07.009. [DOI] [Google Scholar]
  • 33.Sun H., Forsythe W., Waters N. Modeling urban land use change and urban sprawl: Calgary, Alberta, Canada. Netw. Spat. Econ. 2007;7:353–376. doi: 10.1007/s11067-007-9030-y. [DOI] [Google Scholar]
  • 34.Wang Q., Jin X., Zhou Y. Dynamic analysis of coastal region cultivated land landscape ecological security and its driving factors in Jiangsu. Acta Ecol. Sin. 2011;31:5903–5909. (In Chinese) [Google Scholar]
  • 35.Zhang Z., Liu S., Dong S. Ecological security assessment of Yuan river watershed based on landscape pattern and soil erosion. Proced. Environ. Sci. 2010;2:613–618. doi: 10.1016/j.proenv.2010.10.068. [DOI] [Google Scholar]
  • 36.Han B., Liu H., Wang R. Urban ecological security assessment for cities in the Beijing-Tianjin-Hebei metropolitan region based on fuzzy and entropy methods. Ecol. Model. 2015;318:217–225. doi: 10.1016/j.ecolmodel.2014.12.015. [DOI] [Google Scholar]
  • 37.Zambrano L., Pacheco-Muñoz R., Fernández T. A spatial model for evaluating the vulnerability of water management in Mexico City, Sao Paulo and Buenos Aires considering climate change. Anthropocene. 2016;17:1–12. doi: 10.1016/j.ancene.2016.12.001. [DOI] [Google Scholar]
  • 38.Mcmillen D.P. Geographically weighted regression: The analysis of spatially varying relationships. Am. J. Agric. Econ. 2004;86:554–556. doi: 10.1111/j.0002-9092.2004.600_2.x. [DOI] [Google Scholar]
  • 39.Janssen L.L., Vanderwel F.J. Accuracy assessment of satellite derived land-cover data: A review. Photogramm. Eng. Remote Sens. 1994;60:419–426. [Google Scholar]
  • 40.Landis J.R., Koch G.G. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics. 1977;33:363–374. doi: 10.2307/2529786. [DOI] [PubMed] [Google Scholar]
  • 41.Wuhan Land Resources and Planning Bureau. [(accessed on 23 May 2017)]; Available online: http://www.wpl.gov.cn/pt-353–2.html. (In Chinese)
  • 42.Liu Y., He Q., Tan R., Liu Y., Yin C. Modeling different urban growth patterns based on the evolution of urban form: A case study from Huangpi, Central China. Appl. Geogr. 2016;66:109–118. doi: 10.1016/j.apgeog.2015.11.012. [DOI] [Google Scholar]
  • 43.Luo J., Wei Y.D. Modeling spatial variations of urban growth patterns in Chinese cities: The case of Nanjing. Landsc. Urban Plan. 2009;91:51–64. doi: 10.1016/j.landurbplan.2008.11.010. [DOI] [Google Scholar]
  • 44.Müller K., Steinmeier C., Küchler M. Urban growth along motorways in Switzerland. Landsc. Urban Plan. 2010;98:3–12. doi: 10.1016/j.landurbplan.2010.07.004. [DOI] [Google Scholar]
  • 45.Pijanowski B.C., Brown D.G., Shellito B.A., Manik G.A. Using neural networks and GIS to forecast land use changes: A land transformation model. Comput. Environ. Urban Syst. 2002;26:553–575. doi: 10.1016/S0198-9715(01)00015-1. [DOI] [Google Scholar]
  • 46.Poelmans L., Van Rompaey A. Complexity and performance of urban expansion models. Comput. Environ. Urban Syst. 2010;34:17–27. doi: 10.1016/j.compenvurbsys.2009.06.001. [DOI] [Google Scholar]
  • 47.Sunde M.G., He H.S., Zhou B., Hubbart J.A., Spicci A. Imperviousness Change Analysis Tool (I-CAT) for simulating pixel-level urban growth. Landsc. Urban Plan. 2014;124:104–108. doi: 10.1016/j.landurbplan.2014.01.007. [DOI] [Google Scholar]
  • 48.Vermeiren K., Van Rompaey A., Loopmans M., Serwajja E., Mukwaya P. Urban growth of Kampala, Uganda: Pattern analysis and scenario development. Landsc. Urban Plan. 2012;106:199–206. doi: 10.1016/j.landurbplan.2012.03.006. [DOI] [Google Scholar]
  • 49.Makse H.A., Havlin S., Stanley H.E. Modelling urban growth patterns. Nature. 1995;377:608. doi: 10.1038/377608a0. [DOI] [Google Scholar]
  • 50.Esbah H., Maktav D., Atatanir L., Erbekb F.S. Understanding Urban Growth Patterns: A Landscape Ecology Point of View. [(accessed on 14 June 2017)]; Available online: ftp://128.46.154.21/jshan/proceedings/URBAN_URS05/esbah01.pdf.
  • 51.Zhou K., Liu Y., Tan R., Song Y. Urban dynamics, landscape ecological security, and policy implications: A case study from the Wuhan area of central China. Cities. 2014;41:141–153. doi: 10.1016/j.cities.2014.06.010. [DOI] [Google Scholar]
  • 52.Sun X., Zhu X.D., Li Y.F. Landscape ecological security assessment in rapidly urbanizing bay—Area: A case study of Xiamen City, China. Acta Ecol. Sin. 2008;28:3563–3573. [Google Scholar]
  • 53.Shaker R.R., Yakubov A.D., Nick S.M., Vennie-Vollrath E., Ehlinger T.J., Forsythe K.W. Predicting Aquatic Invasion in Adirondack Lakes: A Spatial Analysis of Lake and Landscape Characteristics. Ecosphere. 2017;8 doi: 10.1002/ecs2.1723. [DOI] [Google Scholar]
  • 54.Costanza R., d’Arge R., De Groot R., Farber S., Grasso M., Hannon B., Limburg K., Naeem S., Oneill R., Paruelo J., et al. The Value of the World’s Ecosystem Services and Natural Capital. Nature. 1997;386:253–260. doi: 10.1038/387253a0. [DOI] [Google Scholar]
  • 55.Xie G.D., Lu C.X., Leng Y.F., Zheng D.U., Li S.C. Ecological assets valuation of the Tibetan Plateau. J. Nat. Res. 2003;18:189–196. (In Chinese) [Google Scholar]
  • 56.McCook L.J., Folke C., Hughes T.P., Nyström M., Obura D., Salm R. Chapter 4: Ecological Resilience, Climate Change and the Great Barrier Reef. Great Barrier Reef Marine Park Authority; Townsville, Australia: 2007. [Google Scholar]
  • 57.McGarigal K., Cushman S.A., Ene E. FRAGSTATS v4: Spatial Pattern Analysis Program for Categorical and Continuous Maps. Computer Software Program Produced by the Authors at the University of Massachusetts, Amherst. [(accessed on 14 June 2017)];2012 Available online: http://www.umass.edu/landeco/research/fragstats/fragstats.html.
  • 58.Tobler W.R. A computer movie simulating urban growth in the Detroit region. Econ. Geogr. 1970;46(Suppl. 1):234–240. doi: 10.2307/143141. [DOI] [Google Scholar]
  • 59.Batty M. Agents, cells, and cities: New representational models for simulating multiscale urban dynamics. Environ. Plan. A. 2005;37:1373–1394. doi: 10.1068/a3784. [DOI] [Google Scholar]
  • 60.White R., Engelen G. Cellular automata as the basis of integrated dynamic regional modelling. Environ. Plan. B Plan. Des. 1997;24:235–246. doi: 10.1068/b240235. [DOI] [Google Scholar]
  • 61.Li X., Yeh A.G.O. Urban simulation using principal components analysis and cellular automata for land-use planning. Photogr. Eng. Remote Sens. 2002;68:341–352. [Google Scholar]
  • 62.Santé I., García A.M., Miranda D., Crecente R. Cellular automata models for the simulation of real-world urban processes: A review and analysis. Landsc. Urban Plan. 2010;96:108–122. doi: 10.1016/j.landurbplan.2010.03.001. [DOI] [Google Scholar]
  • 63.Clarke K.C., Hoppen S., Gaydos L. A self-modifying cellular automaton model of historical urbanization in the San Francisco Bay area. Environ. Plan. B: Plan. Des. 1997;24:247–261. doi: 10.1068/b240247. [DOI] [Google Scholar]
  • 64.Fotheringham A.S., Brunsdon C., Charlton M. Geographically Weighted Regression: The Analysis of Spatially Varying Relationships. John Wiley & Sons; New York, NY, USA: 2003. [Google Scholar]
  • 65.Fotheringham A.S., Brundson C., Charlton M.E. Quantitative Geography. Sage Publications; London, UK: 2000. [Google Scholar]
  • 66.Wang K., Zhang C., Li W. Comparison of geographically weighted regression and regression kriging for estimating the spatial distribution of soil organic matter. GISci. Remote Sens. 2012;49:915–932. doi: 10.2747/1548-1603.49.6.915. [DOI] [Google Scholar]
  • 67.Wang K., Zhang C.R., Li W.D., Lin J., Zhang D.X. Mapping soil organic matter with limited sample data using geographically weighted regression. J. Spat. Sci. 2014;59:91–106. doi: 10.1080/14498596.2013.812024. [DOI] [Google Scholar]
  • 68.Zhang C., Li W., Civco D. Application of geographically weighted regression to fill gaps in SLC-off Landsat ETM+ satellite imagery. Int. J. Remote Sens. 2014;35:7650–7672. doi: 10.1080/01431161.2014.975377. [DOI] [Google Scholar]
  • 69.Wong D., Lee J. Spatial Analysis of Geographic Information with ArcView GIS and ArcGIS. Wiley & Sons Inc.; New York, NY, USA: 2005. [Google Scholar]
  • 70.Pontius R.G., Jr., Millones M. Death to Kappa: Birth of quantity disagreement and allocation disagreement for accuracy assessment. Int. J. Remote Sens. 2011;32:4407–4429. doi: 10.1080/01431161.2011.552923. [DOI] [Google Scholar]

Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES