Next Article in Journal
Adulthood Socioeconomic Position and Type 2 Diabetes Mellitus—A Comparison of Education, Occupation, Income, and Material Deprivation: The Maastricht Study
Previous Article in Journal
Experimental and Numerical Simulation of the Formation of Cold Seep Carbonates in Marine Sediments
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Developing A Sustainable Urban-Environmental Quality Evaluation System in China Based on A Hybrid Model

1
School of Economics & Management, Xiamen University of Technology, Xiamen 361024, China
2
Graduate Institute of Industrial and Business Management, National Taipei University of Technology, Taipei 10608, Taiwan
3
Department of Information and Finance Management, National Taipei University of Technology, Taipei 10608, Taiwan
4
Department of Industrial Engineering and Management, National Taipei University of Technology, Taipei 10608, Taiwan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(8), 1434; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16081434
Submission received: 19 March 2019 / Revised: 17 April 2019 / Accepted: 17 April 2019 / Published: 22 April 2019

Abstract

:
In China, with the acceleration of urbanization, people pay more attention to the quality of urban environment. Air pollution, vegetation destruction, water waste and pollution, and waste sorting have restricted the sustainable development of urban environment. It is important to evaluate the impact of these environmental concerns as a prerequisite to implement an effective urban environmental sustainability policy. The aim of this paper is to establish a system for evaluating sustainable urban environmental quality in China. We extracted six dimensions and 29 criteria for assessing urban sustainable environment. Then, a fuzzy technique and the best worst method were applied to obtain the weights for the dimensions and criteria. Next, grey possibility values were applied to evaluate the sustainable environmental quality of five cities: Beijing, Shanghai, Shenzhen, Guangzhou, and Hangzhou in China. A sensitivity analysis was performed to identify how the ranking of these five cities changed when varying the weights of each criterion. The results show that pollution control, the natural environment, and water management are the three most important dimensions for urban environmental quality evaluation. We suggest that controlling pollutant emissions, strengthening food waste management, improving clean production processes, and utilizing heat energy are the effective measures to improve the urban environment and achieve sustainable urban environmental development.

1. Introduction

Under the background of economic growth and urbanization process in China, the urban environment has been disrupted, and the sustainable development of urban environment has been threatened [1]. For example, the urban heat island effect and the health problem of urban residents are the challenges for facing the sustainable development of cities [2]. The urban population in China has increased too rapidly and they are increasingly devoting their attention to ecological environment construction. Rapid urbanization and modernization have increased the pressure of urban environmental development in China. As the largest developing country in the world, China has made a rapid urbanization and modernization. China’s urbanization rate has increased from less than 20% in 1978 to 59.58% in 2018. However, the problem of environmental pollution has become increasingly prominent, such as China is one of the largest CO2 emitters, and China’s cities are under pressure to reduce energy consumption and emissions [3]. Concrete environmental construction measures have thus been proposed in China, where the government is promoting the ideas of an ecological civilization and devoting more effort toward ecological environmental protection. The Chinese government has always attached importance to the prevention of urban environment damage. Some measures such as garbage sorting, shared bicycles, and wastewater treatment have been proposed [4,5]. However, with rapid urban population growth, the urban environment is facing unprecedented challenges, such as the aggravation of pollution, resource shortages, and traffic congestion [6]. Moreover, cites have become a major source of CO2 emissions, accounting for approximately 70% of all such emissions [7].
Worsening of the urban metabolism and its impact on climate change pose challenges to the sustainable development of urban environments [8]. Hence, the following issues affecting the sustainable development of urban environments are worthy of attention. Firstly, which indicators affect the development of urban sustainable environment, and which of these are key indicators? Secondly, how should the quality of a sustainable environment in a city be evaluated through indicators? Finally, how can improve a city’s environment quality through its status quo? It is particularly essential to develop a sustainable urban environmental quality evaluation system that can serve as a reference for the construction of a sustainable city environment.
The aim of this paper is the development of a sustainable urban-environmental quality evaluation system in order to solve the above problems. The concept of sustainability mainly involves sustainable development and sustainable assessment [9]. Researchers have already made some contributions to the study of sustainable urban environments. Ahvenniemi et al. [10] proposed critical indicators for the sustainable development of a city environment and established a framework for its evaluation. Aldairi and Tawalbeh [11] provided a detailed overview of the main security problems in sustainable cities and their current solutions. They also proposed key indicators for the evaluation of intelligent urban environments. Alencar et al. [12] noted that natural resources, artificial environments, and energy management are the three pillars of sustainable environmental development. Although these studies have proposed some essential factors that influence environmental quality, specific indicators such as water management or pollution control have rarely been considered. Thus, evaluating the sustainable quality framework of a city is a multi-dimensional challenge involving water resources, environmental pollution, energy management, and other factors. Because it is difficult to collect actual data, this study uses the multiple attribute decision-making (MADM) method to evaluate environmental quality. MADM models are proposed to evaluate sustainable urban environmental quality and to help decision makers make sound decisions with limited information. Obviously, this paper mainly deals with the sustainability assessment problems, and sustainability assessment is related to the strong and weak sustainability paradigms. Ziemba (2019) argued that compensatory methods are used to solve the problem of weak sustainability, while the non-compensation method is suitable for solving the decision-making problem with strong sustainability [9]. In this paper, the criteria for evaluating the urban environmental sustainability is partially-compensatory. Therefore, we have a strong sustainability and weak sustainability. And the fuzzy best and worst method which improved in AHP are suitable to address this problem [9].
Only a few scholars have examined intelligent cities and environmental sustainability by applying MADM models. Anand et al. [13] evaluated the sustainability of India’s cities based on a fuzzy analytic hierarchy process (AHP) and data envelopment analysis. Wang et al. [14] assessed the impact of air pollution on urban sustainability by combining an artificial neutral network (ANN) with “the technique for order preference by similarity to an ideal solution” (TOPSIS). However, conventional methods such as AHP and the analytic network process (ANP) are difficult to implement when a considerable number of indicators are being examined. It is also difficult to obtain the accurate judgements of decision makers in the process of evaluation because their ideas are in the form of linguistic terms and are thus vague and subjective [15]. In addition, from the algorithm of these two methods, they have the problem of rank reversal. The rank reversal problem assumes that there is an alternative ranking determined for a decision problem with the use of the preferences aggregation method. For example, a right eigenvector method is used in the computational algorithm of AHP method, a left eigenvector method should use to solve a reversal problem. As a result, a reverse sequence of elements was produced to be pairwise-compared in matrix. However, this is not always true, in particular in the case of some inconsistencies in the pairwise comparison matrix [16]. Additionally, we have differences in the weights of criteria obtained by means of the ANP method with the considered cluster of alternatives or without it. Namely, taking into consideration the cluster of alternatives in the decision model influences the result of criteria weights. The effect of weight changes takes also place in the case of criteria which are not mutually dependent on each other [17].
To address these limitations, we applied a fuzzy best and worst model to obtain weights for the dimensions and criteria. The fuzzy set used in the proposed method can solve the problems related to the ambiguity and uncertainty of experts’ opinions [18]. The best worst method (BWM) developed by Rezaei has been applied in many fields because of its fast comparison times and consistent results [19,20,21,22]. The fuzzy BWM (FBWM), combining fuzzy theory with BWM, can reduce the subjective uncertainty of experts, as well as improve the accuracy of the results [23,24]. Grey relational analysis (GRA) can measure the degree of correlation between factors according to their difference or similarity. It requires a small sample size and little computation, improves the accuracy of the results, and can be used to solve MADM problems [25]. Therefore, this study also used the GRA method to assess sustainable urban environmental performance.
The objectives of this study are as follows: (i) exploring an evaluation structure for urban sustainable environmental quality, (ii) investigating the importance of environmental quality indicators for urban sustainability, and (iii) providing suggestions for improving the performance of an urban sustainable environment. The rest of the paper is organized as follows. Section 2 presents a review of the relevant literature. Section 3 describes the FBWM and GRA method. Section 4 discusses the questionnaire that was designed and implemented, as well as the analysis of the data. Section 5 discusses the results, and concluding remarks are presented in Section 6.

2. Literature Review

Few researchers have discussed smart or sustainable environments, and few well-recognized sustainable urban environmental evaluation systems have been developed at the national level [26,27,28]. Cicirelli et al. [29] argue that a sustainable environment is one capable of sensing, driving, communicating, and computing. The aim is to acquire and utilize environmental knowledge to meet the preferences and requirements of residents. Ahvenniemi et al. [10] proposed five dimensions to reflect sustainable environmental quality: natural environments, built environments, transportation, water management, and waste management. Aldairi et al. [11] proposed energy management, water management, waste management, clean environment, and pollution control as the five factors of a sustainable environmental assessment system. These dimensions are frequently cited and supplemented in studies of sustainable urban environments. However, the dimensions or indicators should reflect the actual environment in different countries.
Unfortunately, research on the sustainable urban environment in China is rare. Many studies have focused on analyzing the overall index of sustainable cities, but few focuses on the importance of the environmental indicators of sustainable cities. Based on a review of the literature and discussions with researchers, urban planners, and environmental experts, this study establishes a sustainable urban environmental evaluation system based on the FBWM to address this research gap in China. The sustainable urban-environmental quality-evaluation system constructed in this study comprises six dimensions and 29 criteria, as detailed in the following sections.

2.1. Natural Environment (D1)

The natural environment refers to the environment formed by natural things, such as soil, water, and climate. The urban natural environment is the foundation of urban economic and cultural development, and undoubtedly represents a crucial indicator of urban environmental sustainability. Ahvenniemi et al. [10] defined the natural environment as one element of a sustainable environmental assessment framework. Giffinge et al. [30] indicated that the attractiveness of the natural environment is a significant factor for assessing sustainable environmental quality.
The natural environment dimension comprises five major indicators: air quality, wetland area, green coverage, biodiversity, and land use. Schirnding [31] proposed an organizational framework for health, environment, and development, with air quality as a major indicator within this framework. Qian [32] emphasized that wetlands are part of the natural ecosystem and should be increased to protect the natural ecosystem. Strzelecka et al. [33] found that when assessing the quality of European smart environments, low green coverage would result in an obvious urban heat-island effect. Nader et al. [34] discussed establishing a monitoring network for environmentally sustainable development by integrating the views of government ministries, universities, research centers, and social organizations. They divided the index system into four categories: population and social-economic, economic activities, environment and sustainable development activities and policies. The green coverage rate and biodiversity were important indicators under the category of environment.
Rudden et al. [35] noted that the “European Green Capital Awards” provide a platform for cities to showcase their environmental features, and biodiversity is one of the basic criteria for this award. Land use in the territorial adjustment index system is used to measure the environmental statuses of nature reserves [36]. Serbanica and Constantin [37] observed that sustainable innovation and intelligent specialization in energy efficiency, effective land use, and waste management contributed to the sustainable development of Eastern European cities. In summary, these indicators reflect the extent to which factor in the natural environment dimension affect the quality of sustainable urban environments.

2.2. Artificial Environment (D2)

The artificial environment refers to the environment built by people in the process of natural transformation and represents a common dimension when analyzing sustainable urban environmental quality. Ahvenniemi et al. [10] observed that the artificial environment is an essential criterion for assessing the sustainability and livability of an urban environment because of its prominent role in urban environmental pollution. This study regards the artificial environment as a dimension of the sustainable urban environmental quality evaluation system.
The artificial environment comprises five major evaluation indicators: green belt area, public health, sustainable transportation, green infrastructure, and green building. Rudden et al. [35] highlighted the beautifying effect of green belts on the urban environment through the example of Vitoria, which won the United Nations Habitat Best Practice Award for improving its living environment by restoring wetlands and increasing green belt areas. Kylili [38] measured the sustainability of an artificial environment using the key performance indicator (KPI) method and emphasized public health as a major environmental performance indicator. Farizkha et al. [39] observed that green and low-carbon urban infrastructure and sustainable public transport are indicators of artificial environmental dimensions. Yi et al. [40] proposed zero-energy green buildings as an ideal choice for achieving sustainable environmental development, ensuring the symbiotic development of buildings and other environmental systems and enhancing the comfort of human settlements.

2.3. Energy Management (D3)

Energy management mainly refers to management of the processes of energy production and consumption. Energy management is used frequently when analyzing sustainable urban environmental quality. Causone et al. [41] argued that reducing energy use and improving energy efficiency should be major aspects of smart city planning. Alencar et al. [12] regarded energy management as the pillar of sustainable urban environmental development. Wang et al. [14] noted the great benefits of improving energy management for an intelligent urban environment. Therefore, this paper employs energy management as a dimension of the intelligent urban environmental quality evaluation system.
Energy consumption, clean energy, heat energy management, and energy efficiency are the four indicators in the energy management dimension. Global energy consumption represents approximately 8920 trillion tons of oil per year and may rise to 14,000 trillion tons per year by 2020 [42]. Reducing energy consumption is the first principle of sustainable development [43]. Kwatra et al. [44] observed that effective and clean energy use is an essential feature of sustainable society and a major indicator of regional sustainability. Kylili [38] identified heat energy management as the key performance index of economic sustainability. Allouhi et al. [42] argued that energy efficiency will become a global energy challenge in the 21st Century, and that various policies and measures should be adopted to improve it.

2.4. Water Management (D4)

The quality of water resource use and treatment is among the major criteria for measuring environmental sustainability. Water resources represent the core of the sustainable development of smart cities [44]. Alencar et al. [12] regarded water management as one of the three basic objectives for achieving sustainable environmental development, and the storage and reuse of rainwater are essential parts of this objective. Wastewater treatment is a vital dimension of the sustainable water resource development blueprint in smart cities [33]. Kylili [38] observed that recycling water is a key performance indicator of water management. Schirnding [31] suggested that water quality can reflect a city’s health and environmental conditions. Therefore, wastewater treatment, water quality, reuse of reclaimed water, and rainwater use are the four criteria under the water management dimension.

2.5. Waste Management (D5)

Waste management primarily refers to the management of solid waste. Waste management has become an indispensable dimension in assessing intelligent urban environmental quality because of its major role in maintaining a city’s image and environmental health [28,33,45,46]. Liu et al. [47] observed that with population growth and ongoing urbanization, waste management has become a key global problem, and waste disposal facility selection is closely related to the environment.
Alencar et al. [12] argued that improving waste management quality is a basic goal for achieving sustainable environmental development and that the production and treatment of recoverable materials is the primary guarantee of waste management. Eriksson et al. [48] emphasized that food waste represents a large proportion of organic waste and that food waste management should be strengthened. Moreover, food waste is likely to rot during collection and transportation, thus producing harmful compounds that can cause environmental hazards [49]. Mapar et al. [50] ranked hazardous waste management among the 80 sustainable development performance indicators for megacities. Kılkış [28] evaluated the environmental sustainability performance of 12 cities in Southeastern Europe and found that urban garbage management was one of the most important assessment criteria. Based on this analysis, recoverable material treatment, food waste management, hazardous waste management, and the management of other waste are the four waste management indicators in this study.

2.6. Pollution Control (D6)

Pollution control refers to the adoption of technical, economic, legal, and other means and methods for eliminating and reducing environmental pollution. It is an essential aspect that cannot be neglected in any study of sustainable urban environment. Nader et al. [34] established a monitoring network for environmentally sustainable development and created an index system that is divided into four major categories. Destruction of the ozone layer and acoustical environmental quality were the major indicators under the environmental category. Girardi and Temporelli [51] evaluated the environmental sustainability of smart cities through qualitative and quantitative indicators, such as greenhouse gas emissions and SO2 concentrations. Kılkış [38] proposed the annual mean PM10 concentrations as an index for the environmental quality dimension. In a ranking of urban sustainability assessment, 106 cities were evaluated using 46 basic indicators such as SO2 concentration and annual average PM10 concentration [52]. Cicirelli et al. [29] used sensors to measure brightness and noise levels and evaluate the climate comfort of a smart city. Cook et al. [46] established a performance index system to measure environmental sustainability and employed the carbon intensity of economic activity as an indicator of air quality and pollution.
Based on this analysis, the seven criteria under pollution control used in this study were greenhouse gas emissions, annual mean PM10 concentration, SO2 concentration, ozone layer destruction, acoustical environmental quality, brightness level, and carbon strength. Table 1 lists each criterion and the associated literature for all selected evaluation structures. Four experts were asked to verify the consistency and redundancy of this evaluating framework, including representatives from academia, government, environmental protection associations, and the environmental movement.

3. Methodology

In order to evaluate a sustainable urban environment, we propose a MADM framework based on FBWM and GRA. As shown in Figure 1, the framework consists of three key phases: screening criteria (Section 2), obtaining optimal weights (Section 3.1) and evaluating city performance (Section 3.2). The details are as follows.

3.1. Fuzzy Best and Worst Method

The basic MADM methods for calculating weights are analytic hierarchy process (AHP), analytic network process (ANP), decision-making trial and evaluation laboratory-based ANP, and hybrid methods such as fuzzy AHP and fuzzy ANP. However, when an evaluation system has a very large number of indicators, the number of paired comparisons between indicators will be similarly excessive, thus rendering weight calculation extremely difficult. As a relatively new MADM method, BWM can obtain criterion weights more easily and accurately with less comparison time and higher consistency [19]. Guo and Zhao [24] proposed a hybrid model that combines fuzzy methods with BWM to improve decision accuracy. Mou et al. [23] proposed an intuitionist fuzzy multiplicative BWM for group decision-making. Hafezalkotob and Hafezalkotob [18] suggested a new method that combines individual and group decisions based on FBWM.
In this study, we examined the fuzzy preference degrees of all criteria in the form of triangular fuzzy sets. Triangular fuzzy set theory was developed to solve fuzzy and uncertain problems and can improve data accuracy based on fuzzy mathematics. A triangular-shape membership function is easy to understand and can convert uncertain data into a lower bound, middle bound and upper bound, which is more consistent with the semantics of human thought expression. Linguistic variables such as “equally important (EI),” “slightly important (SI),” “fairly important (FI),” “very important (VI),” and “absolutely important (AI)” are used to reflect the degree of preference between the best or worst criteria and other criteria. Therefore, the linguistic variables must be transformed into triangular fuzzy numbers (TFNs), with the rules of transformation listed in Table 2 [53].
We next built a fuzzy mathematical programming model to obtain the weights of dimensions and criteria, as follows:
Step 1: Set up a decision standard system.
In this step, the evaluation system criteria should be determined through a literature review and by obtaining expert opinions. Suppose there are n criteria { s 1 , s 2 , , s n } for a research object.
Step 2: Determine the best (most important) dimension or criterion and the worst one (the least important).
In this step, the decision-maker determines the best and worst criteria based on the decision system.
Step 3: Derive the best-to-others (BO) vectors.
Determine the fuzzy preferences of the best criteria to all the others using TFNs, as listed in Table 2. The BO vectors can be described as Q ˜ b = ( q ˜ b 1 , q ˜ b 2 , , q ˜ b n ) , where b is the index of the best criterion, and q ˜ b i is a TNF indicating the degree of importance of the best criterion Cb over criterion Ci. Clearly, q ˜ b b = (1,1,1).
Step 4: Derive the others-to-worst (OW) vectors.
Following the same procedure as in step 3, the decision-maker determines the fuzzy preferences of all other criteria to the worst criterion using the TFNs listed in Table 2. The OW vectors can be described as Q ˜ w = ( q ˜ 1 w , q ˜ 2 w , , q ˜ n w ) , where w is the index of the worst criterion, and q ˜ i w is a TFN indicating the importance degree of another criterion Ci over the worst criterion Cw. It is clear that q ˜ w w = (1,1,1).
Step 5: Determine the optimal fuzzy weights ( w ˜ 1 * , w ˜ 2 * , , w ˜ n * ) .
The ideal fuzzy weight value of each criterion satisfies the following equations: w ˜ b / w ˜ i = q ˜ b i and w ˜ i / w ˜ w = q ˜ b i . We can obtain the dimension and criterion weights by minimizing the maximum absolute differences | w ˜ b w ˜ i q ˜ b i | and | w ˜ i w ˜ W q ˜ i W | , where w ˜ b , w ˜ i , and w ˜ W are TFNs and w ˜ i = ( l i w , m i w , u i w ), l i w is the lower bound of the weight value of dimension or criterion i, m i w is the middle bound, and u i w is the upper bound.
Then, the optimal weight can be obtained by solving the following nonlinear constrained optimization problem [23].
min ζ *
s . t . { | w ˜ b w ˜ i q ˜ b i | ζ * | w ˜ i w ˜ W q ˜ i W | ζ * i = 1 n R ( w ˜ i ) = 1 l i w m i w u i w l i w 0 i = 1 , 2 , , n
where ζ * = ( h * , h * , h * ) , and R ( w ˜ i ) = l i + 4 m i + u i 6 . This equation can be transformed to have greater detail into Equation (2):
s . t . { | ( l b w , m b w , u b w ) ( l i w , m i w , u i w ) ( l b i , m b i , u b i ) | ( h * , h * , h * ) | ( l i w , m i w , u i w ) ( l W w , m W w , u W w ) ( l i W , m i W , u i W ) | ( h * , h * , h * ) i = 1 n R ( w ˜ i ) = 1 l i w m i w u i w l i w 0 i = 1 , 2 , , n
where q ˜ b i = ( l b i , m b i , u b i ) , and q ˜ i w = ( l i W , m i W , u i W ) .
We transform the fuzzy criterion weight represented by TFN w ˜ i = ( l i w , m i w , u i w ) into a crisp value. The function R ( w ˜ i ) is used to resolve ambiguous numbers, so that the weight of each dimension and criterion can be obtained.
Step 6: Determine the consistency ratio (CR) for BWM.
CR is a crucial indicator for determining the consistency of pairwise comparisons. A comparison is fully consistent when q ˜ b i × q ˜ i w = q ˜ b w , where q ˜ b i , q ˜ i w , and q ˜ b w are the fuzzy preference of the best criterion over criterion i, the fuzzy preference of criterion i over the worst criterion, and the fuzzy preference of the best criterion over the worst criterion, respectively. CR can indicate the degree of consistency of a fuzzy pairwise comparison.
Guo and Zhao [24] proposed a method for calculating CR. Given that inconsistency in a fuzzy pairwise comparison occurs when q ˜ b i × q ˜ i w q ˜ b w , the maximum inconsistency occurs when q ˜ b i = q ˜ i w = q ˜ b w , and the variable ζ can be obtained to satisfy Equation (3).
( q ˜ b w ζ ) × ( q ˜ b W ζ ) = ( q ˜ b W + ζ )
Guo and Zhao [18] considered that the upper boundary u b w could be used to calculate the CR, and thus Equation (3) can be transformed into Equation (4):
ζ 2 ( 1 + 2 u b W ) ζ + ( u b W 2 u b W ) = 0
where q ˜ b w = ( l b w , m b w , u b w ) .
According to Table 2, the values of u b W are as follows: u b W = 1,3,4,5,6,7,8,9,10. The maximum possible ζ , which is considered to be consistency index (CI), can be derived using Equation (4). The CIs for different u b W values are listed in Table 3.
Step 7: Determine the dimension or criterion weights.
Suppose that there are k experts. The weight of dimension or criterion j can be identified by vector w j ˜ = { w j 1 , w j 2 , w j 3 , , w j k } , and the dimension or criterion weight can be obtained by averaging the elements w j ˜ :
w = 1 k [ w j 1 + w j 2 + w j 3 + + w j k ]

3.2. Grey Relational Analysis

Grey relational analysis (GRA) is used to measure the degree of correlation between similarities or differences of criteria variability. One advantage of GRA is that it can provide a high-quality result with a small sample size and little calculation. It can be applied to decision-making in multiple-attribute decision problems [25,53]. Therefore, GRA was applied to the performance evaluation of sustainable urban environmental quality. Rajesh and Ravi [54] proposed a GRA method with an interval probability algorithm, that has the following steps:
Step 1: Determine the number of alternatives.
The suitable m alternatives are chosen based on decisions in the sustainable urban environment quality assessment. Let X = { X 1 , X 2 , X 3 , , X m } be m sets of alternatives.
Step 2: Linguistic to grey scale of evaluation of criteria.
Expert h assessing the performance of criterion j of alternative i can be represented as V i j h , where i = { 1 , 2 , 3 , 4 , m } , j = { 1 , 2 , 3 , 4 , n } , and h = { 1 , 2 , 3 , 4 , , k } . The linguistic variable V i j h = V _ i j h , V ¯ i j h can be obtained using the grey relational semantic transformation rule, where V _ i j h is the lower bound of the grey value V i j h , and V ¯ i j h is the upper bound.
The average value can be calculated as follows:
V i j = [ ( 1 k h = 1 k ( V _ i j h ) ) , ( 1 k h = 1 k ( V ¯ i j h ) ) ]
Step 3: Build the grey matrix.
Grey matrix M is obtained from the average grey values V i j .
M = [ V 11 V 12 V 1 n V 21 V 22 V 2 n V m 1 V m 2 V m n ]
Step 4: Normalize the grey relational matrix.
The grey number between limits [0,1] can be obtained through normalization, as follows:
V = [ V _ i j V j max , V i j V j max ]
where V j max = 1 i m max { V ¯ i j } .
The normalized grey relational matrix M* is represented as follows:
M * = [ V 11 * V 12 * V 1 n * V 21 * V 22 * V 2 n * V m 1 * V m 2 * V m n * ]
Step 5: Build the weighted normalized grey relational matrix.
The weighted normalized matrix ( E i j ) can be obtained when the weight ( w j ) calculated using FBWM is multiplied by the normalized grey relational matrix ( V i j * ):
E i j = [ ( V i j * ) * w j ]
where V i j * = V _ i j h , V ¯ i j h
The weighted normalized grey relational matrix M** is represented as follows:
M * * = [ E 11 E 12 E 1 n E 21 E 22 E 2 n E m 1 E m 2 E m n ]
Step 6: Build the ideal referential set of alternatives.
We can obtain the maximum E i j of all columns by comparing the values of each column in matrix M * * . The maximum E i j is denoted as X max :
X max = [ [ 1 max i m E _ i 1 , 1 max i m E ¯ i 1 ] , [ 1 max i m E _ i 2 , 1 max i m E ¯ i 2 ] , [ 1 max i m E _ i 3 , 1 max i m E ¯ i 3 ] , [ 1 max i m E _ i n , 1 max i m E ¯ i n ] ] = { C 1 max , C 2 max , C 3 max , , C n max } ,
where C i max = C _ i max , C ¯ i max .
Step 7: Calculate the grey possibility by comparing Xi with X max .
By comparing the alternatives set Xi with the ideal referential X max , we can obtain the grey possibility for each alternative, which is given as follows:
p ( X i X max ) = 1 n j = 1 n [ max ( 0 , L j * max ( 0 , E ¯ i j C _ j max ) ) L j * ]
where L j * is the sum of length E i j and C j max , which can be represented as follows:
L j * = L ( E i j ) + ( C j max )
Equation (13) can be transformed as follows:
L j * = ( E ¯ i j E _ i j ) + ( C ¯ j max C _ j max )
Step 8: Rank the alternatives.
We can sort the alternatives after obtaining the probability value p ( X i X max ) . An alternative is closer to the ideal referential when its possibility value is lower.

4. Results Analysis

In this section, we apply the proposed hybrid model combining FBWM with GRA to evaluate the sustainable urban environmental quality of five Chinese cities: Guangzhou, Shanghai, Beijing, Hangzhou, and Shenzhen. These five cities are in highly developed regions of China and play a vital role in its economy and culture. Beijing is the capital of China. It is a cultural, political and educational center. Shanghai is China’s most economically developed city and the most populous city. It is China’s financial and technological development center. Guangzhou is the largest city in South China with developed manufacturing and commerce. Shenzhen is China’s most dynamic entrepreneurial city. Its GDP rate is growing fast, and its total GDP has surpassed that of Guangzhou, ranking third. Hangzhou is the representative of the new first-tier cities in China. It is China’s e-commerce capital, there are lots of famous internet companies, such as Alibaba and NetEase. These five cities have been devoted to environmental improvement and smart city construction for a long time. For other cities, based on the familiarity with the advantages and disadvantages of the five cities in a sustainable environment, managers or government can serve as a reference to improve their own urban environment for future development.
To perform a comprehensive evaluation, we selected 10 Chinese experts with abundant experience in different fields. The group of experts comprised three professors from the Institute of Environmental Engineering, two managers at an environmental monitoring company, one researcher from the Intelligent City Institute, one researcher from the Intelligent Environment Institute, one manager at a pollution testing company, and two officials from the Environmental Protection Bureau. The duties of these 10 experts are closely related to the urban environment, including urban environment governance, urban environmental engineering design, environmental pollution detection, and urban environment research. These experts have more than 10 years of work experience. Although they come from different work backgrounds, their different evaluation perspectives are deemed as having equal importance. Experts from enterprises and research institutes are members of the National Urban Environmental Planning Expert Pool. They are very familiar with the urban environment of major cities in China. Government personnel are engaged in urban environmental management and often understand the environmental development of various cities in China. The experts were asked to answer a two-part questionnaire. The first part of the questionnaire was used to assess the importance of the six dimensions and 29 criteria, and the second part was used to rate the performance of the five cities with respect to the 29 criteria. It took three months from November 2017 to January 2018 to contact 10 experts to fill out the questionnaire.

4.1. Determination of Criteria Weights

The analytical processes consisted of the seven steps of fuzzy best and worst method introduced in Section 3.1. They were used to obtain the weights of the dimensions and criteria and as a basis for performance evaluation. The experts were asked to identify the most important of the six dimensions in Table 1 and the most important criterion within each dimension. Similarly, the least important dimension and criteria were decided based on the experts’ opinions. Table 4 displays the best and worst dimensions identified by the experts. One expert stated that natural environment (D1) was the most important dimensions, and another argued that energy management (D3) was the best. The eight other experts all selected pollution control (D6) as the best dimension. All experts unanimously deemed artificial environment (D2) as the worst of the six dimensions. The best and worst criteria within each dimension were obtained in the same manner.
After selecting the best and worst dimensions and criteria, the experts were asked to determine the preference of the best ones over all others and the preferences of all others over the worst dimension or criterion using the linguistic variables proposed in Section 3. As shown in Table 5, the third expert considered pollution control (D6) to be more important (between FI and VI) than artificial environment (D2) with the interval value (5,6,7) obtained according to Table 2. As shown in Table 6, the first expert believed that natural environment (D1) was slightly more important than the worst dimension (artificial environment, D2), with the interval value (2,3,4). The preference values of the best criterion over all other criteria within a dimension and of all others over the worst, were obtained through the same procedure.
The weights of the dimensions and criteria were calculated using a linear model for the experts according to Equation (2). Since the experts come from different departments and have different job responsibilities, their assessments reflect different perspectives. All of the experts have many years of work experience related to the urban environment, and the importance of each expert’s opinion is considered equal [20,55]. The average weight for each dimension and criterion for the experts was obtained, which are ranked by value in Table 7.
We calculated the CRs of the dimensions for the experts, and all were below 0.1. A smaller value indicates a higher consistency in pairwise comparisons.
The results showed that pollution control (D6, 29.3%) accounted for the highest weight in the evaluation system, and ozone layer destruction (C64, 6.4%) ranked fifth among the 29 criteria. Therefore, more attention should be given to ozone layer damage by strengthening the monitoring of harmful substances and incorporating such monitoring in the air evaluation system of the intelligent city environment. The government should also advocate the use of environmentally friendly appliances such as Freon-free refrigerators.
Energy consumption (C31, 0.07%) ranked fourth and hazardous waste management (C53, 0.075%) ranked first among the 29 criteria. This indicates that enterprises should improve their production processes, develop advanced industrial manufacturing, reduce the direct discharge of waste heat, and implement waste heat recycling Urban waste treatment cannot be ignored. It is necessary to popularize garbage sorting activities, promote urban coverage of garbage sorting facilities, promote rational and efficient food waste use, promote clean cities, and create good conditions through different forms of communication, such as the government’s public WeChat channel, publicity handbooks, and banners.

4.2. Sustainable Urban Environmental Quality Evaluation

After obtaining the weights of dimensions and criteria, we evaluated the sustainable environmental quality of each city using the GRA method outlined in Section 3.2. We chose Guangzhou (X1), Shanghai (X2), Beijing (X3), Hangzhou (X4), and Shenzhen (X5) as the five cities for this cases study because they are in China’s top five developed regions.
The experts evaluated the sustainable environmental quality of the cities based on their knowledge and experience. We applied grey preference degrees to all criteria to evaluate the performance of the cities in the form of grey intervals. Linguistic variables were used to rate performance of the alternatives (cities) for the corresponding criterion: “very poor (VP)”, “poor (P)”, “medium poor (MP)”, “fair (F)”, “medium good (MG)”, “good (G)”, and “very good (VG)”. V i j h denotes the value that expert h assigned to criterion j for city i and can be represented using the grey number V i j h = V _ i j h , V ¯ i j h according to the rules in Table 8 [48].
The average evaluation value V i j of criterion j for city i among the experts was calculated using Equation (6), and the grey decision matrix M was obtained using Equation (7), as shown in Table A1 of Appendix A. The normalized grey decision matrix M* obtained using Equation (8) is shown in Table A2 of Appendix A. The weighted normalized grey decision matrix M** was obtained using Equations (10) and (11), as illustrated in Table A3 of Appendix A. The ideal referential set of alternatives X max can be obtained using Equation (12). The overall grey possibility p ( X i X max ) can be calculated using Equations (13)–(15), and the grey possibility of sustainable environmental quality for the five cities is as follows: P ( X 1 < X max ) = 0.91194, P ( X 2 < X max ) = 0.95519, P ( X 3 < X max ) = 0.85828, P ( X 4 < X max ) = 0.64435, and P ( X 5 < X max ) = 0.73386 (see Table 9).
The smaller the probability of the grey relation is the closer to the ideal alternative [54]. Therefore, the cities can be ranked according to sustainable environmental quality as follows: P ( X 4 < X max ) > P ( X 5 < X max ) > P ( X 3 < X max ) > P ( X 1 < X max ) > P ( X 2 < X max ) . The best sustainable environmental quality was thus found in Hangzhou, followed by Shenzhen, Beijing, and Guangzhou, with the worst sustainable environmental quality performance noted in Shanghai.

5. Discussion

Table A1 in Appendix A shows that the scores for green infrastructure (C24), wetland area (C12), green coverage rate (C13), and air quality (C11) were highest, and the maximum upper boundaries of the scores were given by the experts as V 24 = 9.4 , V 12 = 9.3 , V 13 = 9.3 , and V 11 = 9.1 , respectively. Therefore, the sustainable environment construction in the five cities has achieved remarkable results in these four areas. There seems to be a consensus on using water-saving faucets in washrooms and installing green infrastructure such as electric panels on buildings. With the popularization of cultural and scientific knowledge in China, citizens are also paying increasing attention to green vegetation and the roles as the city’s “kidneys” and “lung”. China’s government has placed great emphasis on ecological environment construction, the protection and renewal of vegetation, and increased vegetation coverage. Moreover, cities in China are more committed to improving air quality. In Beijing, for example, air quality has been greatly improved by limiting the number of vehicles and issuing license plates.
For the importance of dimensions (Table 7), the results indicated that pollution control (D6, 0.293), natural environment (D1, 0.192), and water management (D4, 0.178) were the three most influential dimensions for urban sustainable environmental quality. This is consistent with the conclusions of other studies that air pollution and water resource quality are important indicators of urban environments [56,57,58]. Compared to other criteria, Table A1 shows that the performance values for heat energy management (C33), materials treatment (C51), and ozone layer destruction (C64) were significantly lower (the average upper boundaries among the experts were 6.3, 7.2, and 7.5, respectively). Therefore, shortcomings remain in sustainable urban environment construction in these areas. As shown in Table 7, the weight of the ozone layer destruction (C64, 0.064) accounts for 6.424% of the total weight of the urban sustainable environmental quality evaluation system, which means that it is a significant urban environmental indicator. However, many cities still ignore this aspect in weather forecasting and air monitoring and have not established an improved monitoring system, which could hinder the construction of a city environment’s sustainability.
Waste treatment (D5, 0.151) is essential for maintaining a clean urban environment. Hazardous waste management (C53, 0.075) accounts for 7.5% of the assessment system weight and thus has the highest weight among all 29 criteria (Table 7). Its smallest lower-boundary grey value is 0.62, which is larger than that of the other 28 criteria. The Chinese government has realized that hazardous waste causes serious environmental destruction and has banned waste imports as part of its campaign against “foreign garbage.” Garbage-sorting experiments have been carried out in developed cities such as Hangzhou and Xiamen, but public awareness of this practice must be further improved. Some large cities such as Guangzhou have not implemented garbage sorting and lack food waste management. Garbage sorting is beneficial for the rational and efficient use of waste resources.
The way of using waste heat (C33, 0.011) from urban economic production processes and daily life activities is not effective. This not only causes energy waste but also produces more waste heat directly in the air, thus further increasing the urban heat-island effect. Therefore, it is necessary to strengthen heat energy management in production processes, develop advanced industrial manufacturing, promote the reuse of waste-heat resources, promote clean production processes, and undertake sustainable city development.
When experts evaluate sustainable urban environmental quality, they may not consider all the indicators and instead use a single index because of differences in personal values and preferences. This can affect their overall evaluation of the sustainable city environment. Based on a single index of sustainable environmental quality for each city, a single indicator of the five cities’ environmental quality was created, as presented in Table 9. For example, if air quality is a highly preferred indicator, then the quality of the intelligent city environment in Shenzhen would be considered the best.
Mangla et al. [59] and Guota and Barua [60] suggested a sensitivity analysis method for verifying the robustness of an evaluation system and eliminating biases. Therefore, to verify the effects of weights in our proposed model, we selected the highest weight from among the 29 criteria (hazardous waste management, C53) and varied it from 0.1 to 0.9 (Table 10). All other criteria weights were found to correspondingly change with it. A resulting variety in criteria ranking was observed. The five cities were then ranked using GRA in 9 different runs, and their ranks were compared, as shown in Table 11. The sensitivity results indicated that the model proposed in this paper was robust.
We also applied another sensitivity analysis method to test whether the indicators ranked last have an impact on performance evaluation. Interestingly, we found proof that the four lowest-ranked indicators were in the artificial environment dimension. First, we deleted the lowest-ranked criterion (sustainable transportation) and found that the results of the performance evaluation remained stable. Next, we removed green infrastructure, and the results remained unaffected. However, the results of the performance evaluation showed large fluctuations when we deleted the third-lowest indicator, green building. Therefore, we conclude that sustainable transportation and green infrastructure have no significant impact on the assessment of sustainable urban environment in China. Therefore, we believe that the system for evaluating sustainable urban environment quality involves a total of 27 indicators in six dimensions, as shown in Figure 2. Local government in China are devoting their energies to air pollution and water pollution control and management in cities [61,62]. Enterprises under the guidance of the government also began to pay attention to the effective use of energy [63]. These government and enterprise actions further validate the rationality and application value of our model.
In Summary, the proposed hybrid model provides a systematic way to evaluate sustainable urban environment and suggest improvement measures. The sustainability of urban environments is an important issue in urban development and management. The proposed model has not been applied previously in sustainable urban environment evaluation. The model adopts fuzzy and grey techniques to solve the problems related to the subjectivity and information uncertainty in the assessments of experts. The practicality and effectiveness of the proposed model was also demonstrated through a sensitivity analysis. The findings could provide various advantages in terms of (i) deciding the most appropriate criteria for sustainable urban environment evaluation, (ii) applying an advanced model to find the weights of the dimensions and criteria of the evaluation system, (iii) providing a highly reliable assessment of urban sustainability environmental performance, (iv) and providing targeted measures for the improvement of the urban environmental sector based on experts’ judgements. This evaluation system could provide administrations with a guideline for sustainable city development.

6. Conclusions

This study proposed six dimensions and 27 criteria to evaluate urban environmental quality. The dimensions comprise the natural environment, artificial environment, energy management, water management, waste management, and pollution control. A hybrid MADM model was proposed for construction a sustainable urban-environmental quality-evaluation system. FBWM was used to calculate the weights of the criteria, and then GRA was applied with a possibility interval algorithm to obtain the sustainable environmental quality performance of five Chinese cities.
The results indicated that pollution control, natural environment, and water management were the three most influential dimensions for urban sustainable environmental quality. Therefore, controlling pollutant emissions, cleaning air and water, improving clean production processes, and reducing emissions of ozone layer materials represent the most essential tasks for the government and the public. The results of GRA with a possibility interval algorithm showed that the overall levels of sustainable environmental quality in Shenzhen and Hangzhou was good, whereas Beijing had favorable performance for water management but poor performance for natural environment and pollution control. Therefore, the public and the government should devise strategies to improve the natural environment and pollution control quality in this city.
There are some limitations in the application of the hybrid model. We interviewed experts and analyzed the data. Although the average CR was 0.73%, we cannot conclude that this represents the consensus of all stakeholders. Fuzzy and grey techniques were used to reduce the experts’ subjective bias due to their different backgrounds. Other methods could also be used to address this problem, such as Delphi or artificial intelligence methods. If real data can be collected, it could be possible to apply multiple-objectives, decision-making methods, and data mining techniques to obtain more reasonable conclusions. The empirical data were limited to five cities in China, and therefore, the applicability of the findings to other cities and countries may vary. Regarding future research, cases of sustainable urban environments could be collected for performance evaluation using VIKOR, TOPSIS, and other methods, based on the FBWM model in this study. The proposed model could also be used in similar decision-making problems in other fields.

Author Contributions

Q.S. analyzed the data, reviewed the literature, and wrote the paper. S.-S.W. and J.J.H.L. designed the research and co-wrote and revised the paper. H.-W.L. completed the article writing and formatting. H.J. formatted the article as well. This manuscript was edited by Wallace Academic Editing.

Funding

This research received no external funding.

Acknowledgments

This research was supported by the Education and Scientific Research Project’s Fund for Young and Middle-aged Teachers of the Fujian Province Education Department under grant JAS170343.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Detailed Results

Table A1. Direct grey decision matrix M.
Table A1. Direct grey decision matrix M.
C11 C12 C13 C14 C15 C21 C22 C23 C24 C25 C31 C32 C33 C34 C41
LULULULULULULULULULULULULULUL
5.78.167.65.97.96.17.94.25.268.23.44.445.556.44.55.75.67.45.17.13.954.55.74.9
4.96.35.474.65.84.55.75.47.14.96.14.65.64.36.25.36.94.25.24.65.84.75.94.95.96.17.74.6
3.75.34.15.14.45.84.25.478.45.87.45.37.15.77.86.37.95.77.73.74.94.45.63.74.94.76.33.7
6.38.37.99.37.79.37.38.95.47.66.58.96.68.66.78.289.46.486.68.66.28.24.45.45.26.27.6
7.19.15.87.44.66.24.55.96.48.65.77.367.55.885.884.25.46.286.38.54.76.36.78.15
C42 C43 C44 C51 C52 C53 C54 C61 C62 C63 C64 C65 C66 C67
ULULULULULULULULULULULULULULU
6.83.74.94.76.14.15.14.25.23.94.95.47.64.45.456.45.37.15.275.16.35.67.24.86.44.45.4
5.84.96.34.76.14.35.34.96.15.26.65.16.34.95.94.35.84.45.84.86.43.95.24.76.34.45.457.5
4.96.38.36.18.15.884.55.75.57.94.96.95.78.12.73.73.44.94.56.23.14.34.66.25.873.64.7
94.864.65.63.94.95.67.25.16.76.27.26.58.36.27.66.17.56.486.17.55.97.96.58.34.75.7
6.65.78.15.47.64.66.24.15.76.88.25.97.96.48.656.868.46.18.14.96.14.96.53.856.78.3
Table A2. Normalization of direct grey decision matrix M*.
Table A2. Normalization of direct grey decision matrix M*.
C11 C12 C13 C14 C15 C21 C22 C23 C24 C25 C31 C32 C33 C34 C41
LULULULULULULULULULULULULULUL
0.630.890.650.820.630.850.690.890.490.600.670.920.400.510.490.670.530.680.560.710.650.860.600.840.620.790.560.700.54
0.540.690.580.750.490.620.510.640.630.830.550.690.530.650.520.760.560.730.530.650.530.670.550.690.780.940.750.950.51
0.410.580.440.550.470.620.470.610.810.980.650.830.620.830.700.950.670.840.710.960.430.570.520.660.590.780.580.780.41
0.690.910.851.000.831.000.821.000.630.880.731.000.771.000.821.000.851.000.801.000.771.000.730.960.700.860.640.770.84
0.781.000.620.800.490.670.510.660.741.000.640.820.700.870.710.980.620.850.530.680.720.930.741.000.751.000.831.000.56
C42 C43 C44 C51 C52 C53 C54 C61 C62 C63 C64 C65 C66 C67
ULULULULULULULULULULULULULULU
0.760.450.590.580.750.510.640.580.720.480.600.680.960.510.630.660.840.630.850.640.860.680.840.710.910.580.770.530.65
0.640.590.760.580.750.540.660.680.850.630.800.650.800.570.690.570.760.520.690.590.790.520.690.590.800.530.650.600.90
0.540.761.000.751.000.731.000.630.790.670.960.620.870.660.940.360.490.400.580.560.770.410.570.580.780.700.840.430.57
1.000.580.720.570.690.490.610.781.000.620.820.780.910.760.970.821.000.730.890.790.990.811.000.751.000.781.000.570.69
0.730.690.980.670.940.580.780.570.790.831.000.751.000.741.000.660.890.711.000.751.000.650.810.620.820.460.600.811.00
M* means direct grey matrix.
Table A3. Weighted normalized grey relational matrix M**.
Table A3. Weighted normalized grey relational matrix M**.
C11 C12 C13 C14 C15 C21 C22 C23 C24 C25 C31 C32 C33 C34 C41
LULULULULULULULULULULULULULUL
0.0320.0450.0230.0290.0930.1250.2280.2950.0360.0440.0060.0080.0080.0110.0020.0030.0030.0040.0040.0050.0450.0600.0210.0290.0070.0080.0130.0170.030
0.0270.0350.0210.0270.0730.0920.1680.2130.0460.0600.0050.0060.0110.0140.0020.0030.0030.0050.0030.0040.0370.0470.0190.0240.0080.0100.0180.0230.028
0.0210.0290.0160.0190.0700.0920.1570.2020.0590.0710.0060.0070.0130.0170.0030.0040.0040.0050.0050.0060.0300.0400.0180.0230.0060.0080.0140.0190.022
0.0350.0460.0300.0350.1220.1470.2730.3330.0460.0640.0060.0090.0160.0210.0030.0040.0050.0060.0050.0070.0540.0700.0260.0340.0070.0090.0150.0180.046
0.0390.0510.0220.0280.0730.0980.1680.2200.0540.0730.0060.0070.0150.0180.0030.0040.0040.0050.0030.0040.0500.0650.0260.0350.0080.0110.0200.0240.030
C42 C43 C44 C51 C52 C53 C54 C61 C62 C63 C64 C65 C66 C67
ULULULULULULULULULULULULULULU
0.0410.0330.0440.0210.0270.0070.0080.0080.0100.0160.0210.0510.0720.0140.0180.0460.0590.0200.0260.0390.0520.0440.0540.0070.0090.0100.0130.0210.026
0.0350.0440.0560.0210.0270.0070.0090.0100.0120.0220.0280.0480.0600.0160.0190.0400.0540.0160.0210.0360.0480.0330.0450.0060.0080.0090.0110.0240.036
0.0300.0560.0740.0270.0360.0100.0130.0090.0110.0230.0330.0460.0650.0190.0260.0250.0340.0130.0180.0330.0460.0270.0370.0060.0080.0120.0140.0170.023
0.0550.0430.0530.0210.0250.0060.0080.0110.0140.0210.0280.0590.0680.0210.0270.0570.0700.0230.0280.0480.0590.0520.0640.0070.0100.0130.0170.0230.028
0.0400.0510.0720.0240.0340.0080.0100.0080.0110.0290.0340.0560.0750.0210.0280.0460.0630.0220.0310.0450.0600.0420.0520.0060.0080.0080.0100.0330.040
M** means normalized grey relational matrix.

References

  1. Lu, S.R.; Liu, Y. Evaluation system for the sustainable development of urban transportation and ecological environment based on SVM. J. Intell. Fuzzy Syst. 2018, 34, 831–838. [Google Scholar] [CrossRef]
  2. Santamouris, M. On the energy impact of urban heat island and global warming on buildings. Energy Build. 2014, 82, 100–113. [Google Scholar] [CrossRef]
  3. Zhang, S.F.; Hu, T.T.; Li, J.B.; Cheng, C.; Song, M.L.; Xu, B. The effects of energy price, technology, and disaster shocks on China’s Energy-Environment-Economy system. J. Clean. Prod. 2019, 207, 204–213. [Google Scholar] [CrossRef]
  4. Liang, Y.X.; Cheng, X.W.; Zhu, H.; Shutes, B.; Yan, B.X.; Zhou, Q.W.; Yu, X.F. Historical evaluation of mariculture in China during past 40 years and its impacts on eco-environment. Chin. Geogr. Sci. 2018, 28, 363–373. [Google Scholar] [CrossRef]
  5. Zhang, J.; Li, D. Study on water environment restoration and urban water system healthy circulation. Eng. Sci. 2011, 10, 14–19. [Google Scholar]
  6. Joshi, S.; Saxena, S.; Godbole, T.; Shreya. Developing Smart Cities: An Integrated Framework. Procedia Comput. Sci. 2016, 93, 902–909. [Google Scholar] [CrossRef] [Green Version]
  7. Forbes, D. Planning sustainable cities global report on human settlements 2009 by United Nations Human Settlements Program me. Geogr. Res. 2011, 49, 447–448. [Google Scholar] [CrossRef]
  8. Aletà, N.B.; Alonso, C.M.; Arce Ruiz, R.M. Smart Mobility and Smart Environment in the Spanish cities. Trans. Res. Proc. 2017, 24, 163–170. [Google Scholar] [CrossRef] [Green Version]
  9. Ziemba, P. Towards Strong Sustainability Management—A Generalized PROSA Method. Sustainability 2019, 11, 1555. [Google Scholar] [CrossRef]
  10. Ahvenniemi, H.; Huovila, A.; Pinto-Seppä, I.; Airaksinen, M. What are the differences between sustainable and smart cities? Cities 2017, 60, 234–245. [Google Scholar] [CrossRef]
  11. Aldairi, A.; Tawalbeh, L. Cyber Security Attacks on Smart Cities and Associated Mobile Technologies. Proc. Comput. Sci. 2017, 109, 1086–1091. [Google Scholar] [CrossRef]
  12. Alencar, M.H., Jr.; Alencar, L.H. Structuring objectives based on value-focused thinking methodology: Creating alternatives for sustainability in the built environment. J. Clean. Prod. 2017, 156, 62–73. [Google Scholar] [CrossRef]
  13. Anand, A.; Dsilva Winfred Rufuss, D.; Rajkumar, V.; Suganthi, L. Evaluation of Sustainability Indicators in Smart Cities Using MCDM Approach. Energy Proced. 2017, 141, 211–215. [Google Scholar] [CrossRef]
  14. Wang, Q.Y.; Dai, H.N.; Wang, H. A Smart MCDM Framework to Evaluate the Impact of Air Pollution on City Sustainability: A Case Study from China. Sustainability 2017, 9, 911. [Google Scholar] [CrossRef]
  15. Song, W.Y.; Xu, Z.T.; Liu, H.C. Developing sustainable supplier selection criteria for solar air-conditioner manufacturer: An integrated approach. Renew. Sustain. Energy Rev. 2017, 79, 1461–1471. [Google Scholar] [CrossRef]
  16. Ishizaka, A.; Labib, A. Analytic Hierarchy Process and Expert Choice: Benefits and Limitations. OR Insight 2009, 22, 201–220. [Google Scholar] [CrossRef]
  17. Ziemba, P. Inter-Criteria Dependencies-Based Decision Support in the Sustainable wind Energy Management. Energies 2019, 12, 749. [Google Scholar] [CrossRef]
  18. Hafezalkotob, A.; Hafezalkotob, A. A novel approach for combination of individual and group decisions based on fuzzy best-worst method. Appl. Soft Comput. 2017, 59, 316–325. [Google Scholar] [CrossRef]
  19. Rezaei, J. Best-worst multi-criteria decision-making method. Omega 2015, 53, 49–57. [Google Scholar] [CrossRef]
  20. Rezaei, J.; Hemmes, A.; Tavasszy, L. Multi-criteria decision-making for complex bundling configurations in surface transportation of air freight. J. Air Transp. Manag. 2016, 2, 1–11. [Google Scholar] [CrossRef]
  21. Salimi, N.; Rezaei, J. Measuring efficiency of university-industry Ph.D. projects using best worst method. Scientometrics 2016, 109, 1911–1938. [Google Scholar] [CrossRef] [Green Version]
  22. You, X.S.; Chen, T.; Yang, Q. Approach to Multi-Criteria Group Decision-Making Problems Based on the Best-Worst-Method and ELECTRE Method. Symmetry 2016, 8, 95. [Google Scholar] [CrossRef]
  23. Mou, Q.; Xu, Z.; Liao, H. An intuitionistic fuzzy multiplicative best-worst method for multi-criteria group decision making. Inform. Sciences 2016, 374, 224–239. [Google Scholar]
  24. Guo, S.; Zhao, H. Fuzzy best-worst multi-criteria decision-making method and its applications. Knowl.-Based Syst. 2017, 121, 23–31. [Google Scholar] [CrossRef]
  25. Wu, H.H. A Comparative Study of Using Grey Relational Analysis in Multiple Attribute Decision Making Problems. Qual. Eng. 2002, 15, 209–217. [Google Scholar] [CrossRef]
  26. Carli, R.; Dotoli, M.; Pellegrino, R. Multi-criteria decision-making for sustainable metropolitan cities assessment. J. Environ. Manag. 2018, 226, 46–61. [Google Scholar] [CrossRef] [PubMed]
  27. Cugurullo, F. Sustainable Smart Cities in India: Challenges and Future Perspectives. Urban Stud. 2018, 55, 3494–3496. [Google Scholar] [CrossRef]
  28. Kılkış, Ş. Sustainable development of energy, water and environment systems index for Southeast European cities. J. Clean. Prod. 2016, 130, 222–234. [Google Scholar] [CrossRef]
  29. Cicirelli, F.; Fortino, G.; Guerrieri, A.; Spezzano, G.; Vinci, A. Metamodeling of Smart Environments: From design to implementation. Adv. Eng. Inform. 2016, 33, 274–284. [Google Scholar] [CrossRef]
  30. Giffinger, R.; Fertner, C.; Kramar, H.; Kalasek, R.; Pichler-Milanovi, N.; Meijers, E. Smart Cities—Ranking of European Medium-Sized Cities; The Center of Regional Science, Vienna University of Technology: Vienna, Austria, 2007. [Google Scholar]
  31. Schirnding, Y.E.V. Health-and-environment indicators in the context of sustainable development. Can. J. Public Health 2017, 109, 9–15. [Google Scholar]
  32. Qian, Y. Sustainable Management of Water Resources. Engineering 2016, 2, 23–25. [Google Scholar] [CrossRef] [Green Version]
  33. Strzelecka, A.; Ulanicki, B.; Koop, S.; Koetsier, L.; Leeuwen, K.V. Integrating Water, Waste, Energy, Transport and ICT Aspects into the Smart City Concept. Procedia Eng. 2017, 186, 609–616. [Google Scholar] [CrossRef]
  34. Nader, M.R.; Salloum, B.A.; Karam, N. Environment and sustainable development indicators in Lebanon: A practical municipal level approach. Ecol. Indic. 2008, 8, 771–777. [Google Scholar] [CrossRef]
  35. Rudden, P.J.; McEvoy, B.; Treanor, A.; O’Neill, K. Environmental sustainability of European cities. Civ. Eng. 2015, 168, 75–80. [Google Scholar] [CrossRef]
  36. Foronda-Robles, C.; Galindo-Pérez-de-Azpillaga, L. Working with indicators: Description of states of territorial adjustment for protected natural areas. Int. J. Sustain. Dev. World 2011, 19, 287–296. [Google Scholar] [CrossRef]
  37. Serbanica, C.; Constantin, D.L. Sustainable cities in central and eastern European countries. Moving towards smart specialization. Habitat Int. 2017, 68, 55–63. [Google Scholar] [CrossRef]
  38. Kylili, A.; Fokaides, P.A.; Lopez Jimenez, P.A. Key Performance Indicators (KPIs) approach in buildings renovation for the sustainability of the built environment: A review. Renew. Sustain. Energy Rev. 2016, 56, 906–915. [Google Scholar] [CrossRef]
  39. Farizkha, I.A.; Moniz, J.A.; Santosa, H.R. Effect of Real Estate Development on Urban Environment Based on Sustainability. Civ. Environ. Res. 2015, 7, 64–69. [Google Scholar]
  40. Yi, H.; Srinivasan, R.S.; Braham, W.W.; Tilley, D.R. An ecological understanding of net-zero energy building: Evaluation of Sustainability based on emergy theory. J. Clean. Prod. 2017, 143, 654–671. [Google Scholar] [CrossRef]
  41. Causone, F.; Sangalli, A.; Pagliano, L.; Carlucci, S. An Exergy Analysis for Milano Smart City. Energy Proced. 2017, 111, 867–876. [Google Scholar] [CrossRef] [Green Version]
  42. Allouhi, A.; Fouih, Y.E.; Kousksou, T.; Jamil, A.; Zeraouli, Y.; Mourad, Y. Energy consumption and efficiency in buildings: Current status and future trends. J. Clean. Prod. 2015, 109, 18–130. [Google Scholar] [CrossRef]
  43. Kern, A.P.; Antoniolli, C.B.; Wander, P.R.; Mancio, M. Energy and water consumption during the post-occupancy phase and the users’ perception of a commercial building certified by Leadership in Energy and Environmental Design (LEED). J. Clean. Prod. 2016, 133, 826–834. [Google Scholar] [CrossRef]
  44. Kwatra, S.; Kumar, A.; Sharma, P.; Sharma, S.; Singhal, S. Benchmarking sustainability using indicators: An Indian case study. Ecol. Indic. 2016, 61, 928–940. [Google Scholar] [CrossRef]
  45. Harmancioglu, N.B.; Barbaros, F.; Cetinkaya, C.P. Sustainability Issues in Water Management. Water Resour. Manag. 2012, 27, 1867–1891. [Google Scholar] [CrossRef]
  46. Cook, D.; Saviolidis, N.M.; Davíðsdóttir, B.; Jóhannsdóttir, L.; Ólafsson, S. Measuring countries’ environmental sustainability performance of the development of a nation-specific indicator set. Ecol. Indic. 2017, 74, 463–478. [Google Scholar] [CrossRef]
  47. Liu, K.M.; Lin, S.H.; Hsieh, J.C.; Tzeng, G.H. Improving the food waste composting facilities site selection for sustainable development using a hybrid modified MADM model. Waste Manag. 2018, 75, 44–59. [Google Scholar] [CrossRef]
  48. Eriksson, M.; Strid, I.; Hansson, P.A. Carbon footprint of food waste management options in the waste hierarchy—A Swedish case study. J. Clean. Prod. 2015, 93, 115–125. [Google Scholar] [CrossRef]
  49. Lee, S.H.; Choi, K.I.; Osako, M.; Dong, J.I. Evaluation of environmental burdens caused by changes of food waste management systems in Seoul, Korea. Sci. Total Environ. 2007, 387, 42–53. [Google Scholar] [CrossRef] [PubMed]
  50. Mapar, M.; Jafari, M.J.; Mansouri, N.; Arjmandi, R.; Azizinejad, R.; Ramos, T.B. Sustainability indicators for municipalities of megacities: Integrating health, safety and environmental performance. Ecol. Indic. 2017, 83, 271–291. [Google Scholar] [CrossRef]
  51. Girardi, P.; Temporelli, A. Smartainability: A Methodology for Assessing the Sustainability of the Smart City. Energy Proced. 2017, 111, 810–816. [Google Scholar] [CrossRef]
  52. Phillis, Y.A.; Kouikoglou, V.S.; Verdugo, C. Urban sustainability assessment and ranking of cities. Comput. Environ. Urban. 2017, 64, 254–265. [Google Scholar] [CrossRef]
  53. Parameshwaran, R.; Kumar, S.P.; Saravanakumar, K. An integrated fuzzy MCDM based approach for robot selection considering objective and subjective criteria. Appl. Soft Comput. 2015, 26, 31–41. [Google Scholar] [CrossRef]
  54. Rajesh, R.; Ravi, V. Supplier selection in resilient supply chains: A grey relational analysis Approach. J. Clean. Prod. 2015, 86, 343–359. [Google Scholar] [CrossRef]
  55. Lo, H.W.; Liou, J.H.; Wang, H.S.; Tsai, Y.S. An integrated model for solving problems in green supplier selection and order allocation. J. Clean. Prod. 2018, 190, 339–352. [Google Scholar] [CrossRef]
  56. Liu, Y.; Yue, W.Z.; Fan, P.L.; Zhang, Z.T.; Huang, J.N. Assessing the urban environment quality of mountainous cities: A case study in Chongqing, China. Ecol. Indic. 2017, 81, 132–145. [Google Scholar] [CrossRef]
  57. Stigt, R.V.; Driessen, P.J.; Spit, T.J.M. Steering urban environmental quality in a multi-level governance context. How can devolution be the solution to pollution? Land Use Policy 2016, 50, 268–276. [Google Scholar] [CrossRef]
  58. Joseph, M.; Wang, F.H.; Wang, L. GIS-based assessment of urban environmental quality in Port-au-Prince, Haiti. Habitat Int. 2014, 41, 33–40. [Google Scholar] [CrossRef]
  59. Mangla, S.K.; Kumar, P.; Barua, M.K. Risk analysis in green supply chain using fuzzy AHP approach: A case study. Resour. Conserv. Recycle 2015, 104, 375–390. [Google Scholar] [CrossRef]
  60. Gupta, H.; Barua, M.K. Supplier selection among SMEs on the basis of their green innovation ability using BWM and fuzzy TOPSIS. J. Clean. Prod. 2017, 152, 242–258. [Google Scholar] [CrossRef]
  61. Tian, L.; Ge, B.; Li, Y. Impacts of state-led and bottom-up urbanization on land use change in the peri-urban areas of Shanghai: Planned growth or uncontrolled sprawl? Cities 2017, 60, 476–486. [Google Scholar] [CrossRef]
  62. Yuan, F.; Wei, Y.H.D.; Chen, W. Economic transition, industrial location and corporate networks: Remaking the Sunan Model in Wuxi City, China. Habitat Int. 2014, 42, 58–68. [Google Scholar] [CrossRef]
  63. Zhou, Y.; Zhu, S.; He, C. How do environmental regulations affect industrial dynamics? Evidence from China’s pollution-intensive industries. Habitat Int. 2017, 60, 10–18. [Google Scholar] [CrossRef]
Figure 1. Research framework.
Figure 1. Research framework.
Ijerph 16 01434 g001
Figure 2. A sustainable urban environmental quality evaluation system.
Figure 2. A sustainable urban environmental quality evaluation system.
Ijerph 16 01434 g002
Table 1. Descriptions of dimensions and criteria.
Table 1. Descriptions of dimensions and criteria.
DimensionsCriteriaDefinitionsSources
Natural environment D1C11 Air qualityReflects the degree of air pollution[10,30,31]
C12 Wetland areaAn ecosystem that is inundated by water[32]
C13 Green coverage rateThe ratio of the vertical projected area of vegetation to the total land area of the city[33,34]
C14 BiodiversityThe variety and variability of life on city[10,35]
C15 Land useThe management and modification of natural environment or wilderness into built environment[30,37]
Artificial environment D2C21 Green belt areaA protected area of green space, farmland, forests in city[10,35]
C22 Public healthPrevent disease, prolong life and promote human health through organized efforts[38]
C23 Sustainable transportationThe ability to supply the source energy indefinitely in city[39]
C24 Green infrastructureA network providing the “ingredients” for solving urban and climatic challenges by building with nature[39]
C25 Green buildingA structure and application of processes that are environmentally responsible[40]
Energy management D3C31 Energy consumptionThe total energy used by the city[41,42,43]
C32 Clean energyEnergy that does not emit pollutants[44]
C33 Heat energy managementThe transfer of energy between systems[38]
C34 Energy efficiencyThe ratio between the useful output and input of an energy conversion process[43]
Water management D4C41 Wastewater treatmentA process used to convert wastewater to the water with minimum impact on the environment, or directly reused[12,33,45]
C42 Water qualityThe chemical, physical, biological, and radiological characteristics of water[31,45]
C43 Reuse of reclaimed waterReclaimed water can be used for other purposes[12,32,38]
C44 Rainwater utilizationRainwater harvesting system, rainwater interception and infiltration system[12,32,45]
Waste management D5C51 Materials treatmentUse high-tech process materials to reduce environmental hazards[12,35,47]
C52 Food waste managementReduce the pollution of food waste to urban environment[48,49]
C53 Hazardous waste managementThe city adopts systems and technologies for managing hazardous waste[50]
C54 Other waste managementThe way to manage other waste, like construction rubbish[12,28,35]
Pollution control D6C61 Greenhouse gas emissionsThe atmosphere absorbs solar radiation reflected from the ground and re-emits some of the radiated gas, like CO2, NO2[30,34]
C62 Annual mean PM10 concentrationAn average annual distribution density of particles with a particle size below 10 microns[34,38,52]
C63 SO2 concentrationThe flue gas concentration cannot be satisfied when the contact method is self-heating to produce sulfuric acid[34,52]
C64 Ozone layer destructionDegree of damage to the ozone layer over the city[24,52]
C65 Acoustical environmental qualityThe impact of urban noise on residents’ lives[34,52]
C66 Brightness levelCity night illumination[52]
C67 Carbon strengthCO2 emissions per unit of GDP[46]
Table 2. Transformation rules of linguistic variables.
Table 2. Transformation rules of linguistic variables.
Linguistic VariablesMembership Function
Equally importance (EI)(1,1,1)
Between the two(1,2,3)
slightly important (WI)(2,3,4)
Between the two(3,4,5)
Fairly Important (FI)(4,5,6)
Between the two(5,6,7)
Very important (VI)(6,7,8)
Between the two(7,8,9)
Absolutely important (AI)(8,9,10)
Table 3. CI for FBWM.
Table 3. CI for FBWM.
Linguistic Terms q ˜ b W CI
Equally importance (EI)(1,1,1)3.00
Between the two(1,2,3)6.00
Weakly important (WI)(2,3,4)7.36
Between the two(3,4,5)8.69
Fairly Important (FI)(4,5,6)10.00
Between the two(5,6,7)11.27
Very important (VI)(6,7,8)12.53
Between the two(7,8,9)13.77
Absolutely important (AI)(8,9,10)15.00
Table 4. Best and worst dimensions determined by the 10 experts.
Table 4. Best and worst dimensions determined by the 10 experts.
DimensionDetermined as “Best” by Expert No.Determined as “Worst” by Expert No.
D11
D2 1,2,3,4,5,6,7,8,9,10
D36
D4
D5
D62,3,4,5,7,8,9,10
Table 5. BO dimension vectors for the 10 experts.
Table 5. BO dimension vectors for the 10 experts.
Expert No.BestD1D2D3D4D5D6
1D1(1,1,1)(2,3,4)(1,1,1)(1,1,1)(1,1,1)(1,1,1)
2D6(1,2,3)(7,8,9)(3,4,5)(1,2,3)(2,3,4)(1,1,1)
3D6(1,2,3)(5,6,7)(1,2,3)(1,2,3)(1,2,3)(1,1,1)
4D6(1,2,3)(5,6,7)(2,3,4)(1,2,3)(2,3,4)(1,1,1)
5D6(1,2,3)(7,8,9)(2,3,4)(2,3,4)(1,2,3(1,1,1)
6D3(1,1,1)(4,5,6)(1,1,1)(1,1,1)(1,1,1)(1,1,1)
7D6(1,2,3)(7,8,9)(1,2,3)(2,3,4)(3,4,5)(1,1,1)
8D6(1,1,1)(5,6,7)(1,2,3)(1,1,1)(1,2,3)(1,1,1)
9D6(1,1,1)(7,8,9)(1,2,3)(1,1,1)(1,1,1)(1,1,1)
10D6(1,2,3)(8,9,10)(2,3,4)(1,2,3)(2,3,4)(1,1,1)
Table 6. OW dimension vectors for the 10 experts.
Table 6. OW dimension vectors for the 10 experts.
Expert No.12345678910
WorstD2D2D2D2D2D2D2D2D2D2
D1(2,3,4)(3,4,5)(2,3,4)(2,3,4)(4,5,6)(4,5,6)(3,4,5)(5,6,7)(7,8,9)(3,4,5)
D2(1,1,1)(1,1,1)(1,1,1)(1,1,1)(1,1,1)(1,1,1)(1,1,1)(1,1,1)(1,1,1)(1,1,1)
D3(2,3,4)(1,2,3)(2,3,4)(1,2,3)(2,3,4)(4,5,6)(3,4,5)(2,3,4)(3,4,5)(2,3,4)
D4(2,3,4)(3,4,5)(2,3,4)(2,3,4)(2,3,4)(4,5,6)(2,3,4)(5,6,7)(7,8,9)(3,4,5)
D5(2,3,4)(2,3,4)(2,3,4)(1,2,3)(4,5,6)(4,5,6)(1,2,3)(2,3,4)(7,8,9)(2,3,4)
D6(2,3,4)(7,8,9)(5,6,7)(5,6,7)(8,9,10)(4,5,6)(7,8,9)(5,6,7)(7,8,9)(8,9,10)
Table 7. Overall weights of dimensions and criteria.
Table 7. Overall weights of dimensions and criteria.
DimensionsWeightsCriteriaLocal WeightsGlobal WeightsRanking
Natural environment (D1)0.192C110.2630.0519
C120.1840.03512
C130.1470.02816
C140.3330.0646
C150.0720.01422
Artificial environment (D2)0.046C210.1900.00826
C220.4530.02119
C230.0820.00429
C240.1330.00628
C250.1410.00727
Energy management (D3)0.140C310.5010.0704
C320.2510.03513
C330.0760.01124
C340.1720.02418
Water management (D4)0.178C410.3070.0558
C420.4150.0742
C430.2030.03611
C440.0750.01323
Waste management (D5)0.151C510.0940.01421
C520.2280.03414
C530.4940.0751
C540.1850.02817
Pollution control (D6)0.293C610.2400.0703
C620.1060.03115
C630.2050.0607
C640.2190.0645
C650.0340.01025
C660.0580.01720
C670.1380.04010
Table 8. Linguistic assessment and associated grey values.
Table 8. Linguistic assessment and associated grey values.
Associated Grey NumbersLinguistic Assessment
Lower Bound 0Upper Bound 1Rating of Attributes Very Poor (VP)
13Poor (P)
34Medium Poor (MP)
45Fair (F)
56Medium Good (MG)
69Good (G)
910Very Good (VG)
Table 9. Quality rankings of sustainable urban environments for 29 indices.
Table 9. Quality rankings of sustainable urban environments for 29 indices.
CriteriaP(Xi ≤ Xmax)
P(X1 ≤ Xmax)P(X2 ≤ Xmax)P(X3 ≤ Xmax)P(X4 ≤ Xmax)P(X5 ≤ Xmax)Priority
C110.7731.0001.0000.7000.500X5 > X4 > X1 > X2 = X3
C121.0001.0001.0000.5001.000X4 > X1 = X2 = X3 = X5
C130.9441.0001.0000.5001.000X4 > X1 > X2 = X3 = X5
C140.8241.0001.0000.5001.000X4 > X1 > X2 = X3 = X5
C151.0000.9700.5330.8420.579X3 > X5 > X4 > X2 > X1
C210.6301.0000.7750.5000.800X4 > X1 > X3 > X5 > X2
C221.0001.0000.8680.5000.743X4 > X5 > X3 > X1 = X2
C231.0001.0000.6940.5000.649X4 > X5 > X3 > X1 = X2
C241.0001.0001.0000.5001.000X4 > X1 = X2 = X3 = X5
C251.0001.0000.6390.5001.000X4 > X3 > X1 = X2 = X5
C310.7901.0001.0000.5000.632X4 > X5 > X1 > X2 = X3
C320.8101.0001.0000.5480.500X5 > X4 > X1 > X2 = X3
C330.9600.5831.0000.7920.533X5 > X2 > X4 > X1 > X3
C341.0000.6671.0001.0000.500X5 > X2 > X1 = X3 = X4
C411.0001.0001.0000.5001.000X4 > X1 = X2 = X3 = X5
C421.0001.0000.5001.0000.591X3 > X5 > X1 = X2 = X4
C431.0001.0000.5001.0000.643X3 > X5 > X1 = X2 = X4
C441.0001.0000.5001.0000.895X3 > X5 > X2 = X3 = X1
C511.0000.8210.9640.50000.969X4 > X2 > X3 > X5 > X1
C521.0001.0000.7111.0000.500X5 > X3 > X1 = X2 = X4
C530.64100.9660.8110.6300.541X5 > X4 > X1 > X3 > X2
C541.0001.0000.6440.5380.512X5 > X4 > X3 > X1 = X2
C610.9291.0001.0000.5000.813X4 > X5 > X1 > X2 = X3
C620.7561.0001.0000.6220.511X5 > X4 > X1 > X2 = X3
C630.8291.0001.0000.5150.541X4 > X5 > X1 > X2 = X3
C640.9231.0001.0000.5001.000X4 > X1 > X2 = X3 = X5
C650.6390.889 0.91670.5000.833X4 > X1 > X5 > X2 > X3
C661.0001.0000.8330.5001.000X4 > X3 > X1 = X2 = X3
C671.0000.8051.0001.0000.500X5 > X2 > X1 = X3 = X4
Note: We simply wrote P(Xi ≤ Xmax) as Xi in column “Priority”.
Table 10. Changes in all the criteria weights according to C53.
Table 10. Changes in all the criteria weights according to C53.
CriteriaBWM Weight123456789
C110.0510.0490.0440.0380.0330.0270.0220.0160.0110.005
C120.0350.0340.0310.0270.0230.0190.0150.0110.0080.004
C130.0280.0270.0240.0210.0180.0150.0120.0090.0060.003
C140.0640.0620.0550.0480.0410.0350.0280.0210.0140.007
C150.0140.0140.0120.0110.0090.0080.0060.0050.0030.002
C210.0080.0090.0080.0070.0060.0050.0040.0030.0020.001
C220.0210.0200.0180.0160.0140.0110.0090.0070.0050.002
C230.0040.0040.0030.0030.0020.0020.0020.0010.0010.000
C240.0060.0060.0050.0050.0040.0030.0030.0020.0010.001
C250.0070.0060.0060.0050.0040.0040.0030.0020.0010.001
C310.0700.0680.0600.0530.0450.0380.0300.0230.0150.008
C320.0350.0340.0300.0270.0230.0190.0150.0110.0080.004
C330.0110.0100.0090.0080.0070.0060.0050.0030.0020.001
C340.0240.0230.0210.0180.0160.0130.0100.0080.0050.003
C410.0550.0530.0470.0410.0350.0300.0240.0180.0120.006
C420.0740.0720.0640.0560.0480.0400.0320.0240.0160.008
C430.0360.0350.0310.0270.0230.0200.0160.0120.0080.004
C440.0130.0130.0110.0100.0090.0070.0060.0040.0030.001
C510.0140.0140.0120.0110.0090.0080.0060.0050.0030.002
C520.0340.0340.0300.0260.0220.0190.0150.0110.0070.004
C530.0750.1000.2000.3000.4000.5000.6000.7000.8000.900
C540.0280.0270.0240.0210.0180.0150.0120.0090.0060.003
C610.0700.0680.0610.0530.0460.0380.0300.0230.0150.008
C620.0310.0300.0270.0240.0200.0170.0130.0100.0070.003
C630.0600.0590.0520.0460.0390.0330.0260.0200.0130.007
C640.0640.0620.0560.0490.0420.0350.0280.0210.0140.007
C650.0100.0100.0080.0070.0060.0050.0040.0030.0020.001
C660.0170.0170.0150.0130.0110.0090.0070.0060.0040.002
C670.0400.0390.0350.0310.0260.0220.0170.0130.0090.004
Total1111111111
Table 11. Five urban environment quality ranking after 9 runs in the sensitivity analysis.
Table 11. Five urban environment quality ranking after 9 runs in the sensitivity analysis.
CitiesNormalizedRun1Run2Run2Run3Run4Run5Run6Run7Run8Run9
X144444444444
X255555555555
X333333333333
X411111111111
X522222222222

Share and Cite

MDPI and ACS Style

Shao, Q.; Weng, S.-S.; Liou, J.J.H.; Lo, H.-W.; Jiang, H. Developing A Sustainable Urban-Environmental Quality Evaluation System in China Based on A Hybrid Model. Int. J. Environ. Res. Public Health 2019, 16, 1434. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16081434

AMA Style

Shao Q, Weng S-S, Liou JJH, Lo H-W, Jiang H. Developing A Sustainable Urban-Environmental Quality Evaluation System in China Based on A Hybrid Model. International Journal of Environmental Research and Public Health. 2019; 16(8):1434. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16081434

Chicago/Turabian Style

Shao, Qigan, Sung-Shun Weng, James J.H. Liou, Huai-Wei Lo, and Hongbo Jiang. 2019. "Developing A Sustainable Urban-Environmental Quality Evaluation System in China Based on A Hybrid Model" International Journal of Environmental Research and Public Health 16, no. 8: 1434. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16081434

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop