Skip to main content
PLOS One logoLink to PLOS One
. 2024 Dec 12;19(12):e0310491. doi: 10.1371/journal.pone.0310491

Assess the efficacy of China’s Inter-provincial Government Services policy: A quantitative evaluation based on PMC-Index model

Rong-qing Geng 1, Jian Wu 2,*
Editor: Pengpeng Ye3
PMCID: PMC11637331  PMID: 39666607

Abstract

To face with the challenges of governance in the digital age, such as insufficient coordination between regional governments and low quality and efficiency of government services, China has proposed the Inter-provincial Government Services Policy. The policy is capable of realizing the government’s ability to handle service matters for the public in different regions, thus facilitating the regional government’s coordination and upgrading the level of government services. This paper collects and organizes the texts of 28 Inter-provincial Government Services policies, and uses ROSTCM6 text mining software to screen and identify the policy text content. Then a quantitative evaluation method based on the PMC model is proposed to examine the consistency and efficacy of the policy in this paper. The results show that: (a) The policy design is generally considered to be rational, with the majority of policies rated as excellent and a few rated as acceptable. There are no policies considered bad or perfect. From a certain point of view, these policies show obvious advantages in terms of policy nature, policy content and policy function. (b) The equilibrium of various policy indicators implies a high level of policy consistency. It indicates the overall coherence and coordination of the policies, contributing to enhanced predictability, credibility, and operationalization of policies, thereby establishing the foundation for their effective implementation. (c) There are still several weak points with the current policies, including the narrow scope of areas, the lack of medium- and long-term planning, and the insufficiently scientific nature of the instruments, evaluations and citations. This paper presents optimization recommendations aimed at addressing the aforementioned issues, which include expanding the scope of the policy, bolstering the long-term impact of the policy, and enhancing the quality of decision-making.

1. Introduction

With the advent of the digital age, governments around the world have undertaken digital transformation in the field of government services [1]. The digital transformation of government facilitates the process of data-driven decision-making and improves the efficiency of government services. However, it has also brought unprecedented challenges to government governance [2]. Particularly, departmental and hierarchical boundaries in government constrain data sharing, resulting in persistent problems for governments in facilitating cross-regional public services. In response to these challenges, some countries, exemplified by the United Kingdom, have implemented “one-stop” government project [3]. And, China has also proposed Inter-provincial Government Services Policy [4] in 2020. It is the expansion and extension of “one-stop” government project. As an inter-provincial government service model, China’s Inter-provincial Government Services Policy is different from the “one-stop” government project. It not only involves the coordination of services between government departments, but also involves governmental collaboration between different regions [5,6].

Since the implementation of the Inter-provincial Government Services Policy, numerous favorable impacts have emerged. This policy has addressed the issue of government service accessibility for individuals across different regions [79]. It has dismantled regional boundaries among governments, thereby fostering data sharing among regional authorities. So, how does the consistency and effectiveness of this policy fare? There is still a lack of an accurate and scientific evaluation to explore the strengths and weaknesses of the policy. This is not conducive to the long-term implementation[10]. Therefore, it is of great significance to evaluate the existing policy texts on Inter-provincial Government Services to gain deeper insights of their content.

In this paper, based on the texts of 28 Inter-provincial Government Services policies issued by China from 2020 to 2023, ROSTCM6 text mining software is utilized in screening and identifying the textual content of the policies, and a PMC (Policy Model Consistency) index model was constructed to quantitatively evaluate the different policies. The PMC index model evaluation method has the characteristics and advantages of systematic, holistic and predictive. By constructing a multi-dimensional comprehensive index system, it is able to conduct a comprehensive and systematic evaluation of the policy text. The trend of policy content can also be revealed through the analysis of historical data, which helps to identify potential problems and risks in advance and provides a basis for making forward-looking decisions.

The highlights of this paper are summarized as follows: (1) Theoretical Contributions: The first is the innovation of policy evaluation methods. This paper proposes a policy evaluation method based on the PMC model, which provides a new perspective for understanding the effect of policies. Through the quantitative study of the policy text, the lack of evaluation methods of the existing cross-provincial general policy is supplemented. With the help of the PMC index model, the PMC surface diagram is combined with the depression index to analyze the characteristics and shortcomings of the existing policies. This opens up new avenues for public policy evaluation. The second is to deepen the theory of policy evaluation. From the perspective of policy formulation, this paper conducts a quantitative text analysis of the inter-provincial general policy, conducts policy evaluation, and explains the effectiveness and consistency of policy implementation. (2) Practical implications: Firstly, quantitatively evaluate the effect of the policy. The quantitative evaluation of China’s Inter-provincial Government Service Policy through the PMC index model can show the effect of policy implementation more intuitively. This approach can provide policymakers with strong data support. The second is to guide the direction of policy optimization. The PMC index model can not only evaluate the effectiveness of the strategy, but also visually show the strengths and weaknesses of each dimension of the strategy through the PMC surface diagram. There is still the possibility of policy optimization in terms of scope of application, timeliness and scientificity, which provides a clear direction for policy optimization for policymakers.

The rest of the paper is organized as follows: the Literature review section reviews the relevant literature. The Research design section describes the specific research design. The results of the quantitative evaluation of the policies are shown in Evaluation and Comparative Analysis of Inter-provincial Government Services Policies section, and the Conclusions and Policy Implications section presents the conclusions and policy insights.

2. Literature review

In this section, we review the two types of literature that are most relevant to this study, namely, the research on the Inter-provincial Government Services Policy and the research on policy evaluation methods.

2.1 Research on Inter-provincial Government Services policy

At present, scholars’ research on the Inter-provincial Government Services Policy mainly focuses on three aspects: the policy context, the policy background, and the policy practices.

  1. Policy context: The design of the Inter-provincial Government Services Policy is a field of application for the digital transformation of government. Specifically, this policy emphasizes the digitalization of government operations at the technical level [11,12]. Scholars refine the concept of ‘public-technical governance-overlapping action’ and propose three practice modes for cross-domain governance of government services: vertically embedded, internally originated, and governance of government and society. They constructed the development path of cross-domain governance of government services in the four dimensions of strategy, supply and demand, technology, and ecology development path [13,14]. In terms of the development direction of cross-regional synergy of digital transformation of government services, the expectation of all countries is to provide e-services to enterprises and the public at any time and in any place through various means [15].

  2. Policy background: Some scholars have pointed out that the local “one-network co-operation” is bounded by administrative divisions, and faces the problems of “power boundaries” and “differences in goals”, which requires the data sharing mechanism to change from authoritative order to collaborative governance [16]. At the same time, the issue of cross-regional synergy is not a new proposition in the study of administration, on the one hand, there are a large number of theoretical discussions laying the cognitive foundation of cross-regional synergy [1719], on the other hand, in the fields of regional economy [20], environmental governance [2123], emergency management [24] and so on [25,26], it has already produced a rich empirical studies.

  3. Policy practice: Some scholars have taken advanced demonstration zones as the starting point for case studies, explored the practice path of demonstration zones, explored the policy implementation dilemmas at the organizational level, technological level, and process level [27],or constructed an “institutional-technological-structural” framework for the implementation of “cross-provincial common office” in specific areas. The problems and challenges in the implementation process of inter-provincial government services are analyzed [28].

The above studies provide literature support for this paper to conduct research on Inter-provincial Government Services Policy, but the existing studies do not consider the effect of the policy text.

2.2 Research for policy evaluation

Policy evaluation is a complex and systematic project aimed at measuring and evaluating policy programs and providing a basis for policy formulation, adjustment and optimization [29]. And the key to conducting effective policy assessment lies in obtaining sufficient policy information and using appropriate assessment tools [30]. With the in-depth and continuous development of policy evaluation practice, the methods of policy evaluation have become increasingly diversified, ranging from qualitative studies based on cases or expert reviews [31,32] to quantitative studies based on mathematical models [33]. Comprehensive evaluation methods based on empirical analysis, such as text data mining [34,35], social network analysis [36,37], fuzzy comprehensive evaluation [38,39], etc., have been developed. Commonly used empirical analysis tools are PSM-DID model analysis, instrumental variables and integrated control [40]. In recent years, some scholars have used PMC model to quantitatively evaluate manufacturing policies [41]. Text mining is the process of exploring the intrinsic patterns and connections from a large amount of unstructured textual information and mining valuable information from it. The Policy Modeling Research Consistency Index (PMC-Index) is a quantitative policy evaluation analysis method to evaluate the strengths and weaknesses of policy texts. The index can not only analyze the internal heterogeneity and the level of strengths and weaknesses of a policy in multiple dimensions, but also visualize the strengths and weaknesses of each dimension of the policy through the surface diagram, which provides a new way of thinking and a new perspective for the quantitative evaluation of policies [42,43].

In summary, there is a considerable body of literature on the policy of Inter-provincial Government Services and policy evaluation. Although some scholars have conducted studies on the Inter-provincial Government Services policy and provided valuable insights for this paper, these studies mainly focus on the policy implementation results. There are few studies on quantitative evaluation of the policy text from the perspective of policy formulation. However, the quality of Inter-provincial Government Services Policy is directly related to the effectiveness of their implementation. Although China has introduced various policy texts on Inter-provincial Government Services, their quality is still unknown. Therefore, this paper combines the text mining method and the PMC index model to quantitatively evaluate the collected Inter-provincial Government Service Policy texts. On the one hand, it aims to reveal the quality of Inter-provincial Government Service Policies, with a view to identifying the advantages and disadvantages of each policy. On the other hand, it also provides inspiration for the formulation and improvement of a new round of Inter-provincial Government Service Policies.

3. Research design

3.1 Research sample and methodology: Selection criteria and data collection

Under the background of China’s Inter-provincial Government Services Policy, many provinces have successively introduced special policies for cross-provincial government service construction from 2020 to 2023.This provides an important way to change government functions and improve the capacity of government services. This paper reviews the policy documents and searches for the construction of inter-provincial government services. Twenty-eight policy documents were collected for analysis in this paper (see Table 1) by reviewing the policy documents and searching for keywords related to the inter-provincial government services policy. These policies are numbered as P1-P28 according to the order of their promulgation. The policy texts in this paper are taken from China’s State Council Policy Document Library and the official portals of provincial governments to ensure their authority. The collection strategy is as follows:

Table 1. Inter-provincial government services policy texts.

Code Policy Text Name Date Issued
P 1 Guiding Opinions of the General Office of the State Council on Accelerating the Promotion of Inter-provincial Government Services Sept. 24, 2020
P 2 Notice of the General Office of the People’s Government of Chongqing Municipality on the Issuance of the Work Program of Chongqing Municipality for Accelerating the Promotion of Inter-provincial Government Services Nov. 18, 2020
P 3 Notice of the General Office of the People’s Government of Gansu Province on the issuance of the Work Program of Gansu Province to promote high-frequency administrative service matters Inter-provincial Government Services Nov. 19, 2020
P 4 Notice of the General Office of the People’s Government of Guizhou Province on the Issuance of the Work Program of Guizhou Province for Accelerating the Promotion of Inter-provincial Government Services Nov. 26, 2020
P 5 Notice of the General Office of the People’s Government of Tianjin Municipality on the Issuance of the Work Program of Tianjin Municipality for Accelerating the Promotion of Inter-provincial Government Services Nov. 27, 2020
P 6 Notice of the General Office of the People’s Government of Guangdong Province on the Issuance of the Work Program of Guangdong Province for Accelerating the Promotion of Inter-provincial and Intra-provincial Government Services Nov. 27, 2020
P 7 Notice of the General Office of the People’s Government of Yunnan Province on the issuance of the Work Program of Yunnan Province for Accelerating the Promotion of Inter-provincial Government Services Nov. 27, 2020
P 8 Notice of the General Office of the People’s Government of Fujian Province on the issuance of the Work Program of Fujian Province for Accelerating the Promotion of Inter-provincial and Intra-provincial Government Services Dec. 7, 2020
P 9 Notice of the General Office of the People’s Government of Jiangxi Province on the issuance of the Work Program of Jiangxi Province for Accelerating the Promotion of Inter-provincial and Intra-provincial Government Services Dec. 9, 2020
P 10 Notice of the General Office of the People’s Government of Hebei Province on the issuance of the Work Program of Hebei Province for Accelerating the Promotion of Inter-provincial Government Services Dec. 10, 2020
P 11 Notice of the General Office of the People’s Government of Sichuan Province on the issuance of the Work Program of Sichuan Province for Accelerating the Promotion of Inter-provincial Government Services Dec. 14, 2020
P 12 Notice of the General Office of the People’s Government of Xinjiang Uygur Autonomous Region on the issuance of the Work Program of Xinjiang Uygur Autonomous Region for Accelerating the Promotion of Inter-provincial Government Services Dec. 15, 2020
P 13 Notice of the General Office of the People’s Government of the Inner Mongolia Autonomous Region on the issuance of the Work Program of the Inner Mongolia Autonomous Region for Accelerating the Promotion of Inter-provincial Government Services Dec. 17, 2020
P 14 Notice of the General Office of the People’s Government of Jiangsu Province on the issuance of the Work Program of Jiangsu Province for Accelerating the Promotion of Inter-provincial and Intra-provincial Government Services Dec 28, 2020
P 15 Province on the issuance of the Work Program of Zhejiang Province for Accelerating the Promotion of Inter-provincial and Intra-provincial Government Services Dec 29, 2020
P 16 Notice of the General Office of the People’s Government of Hubei Province on the issuance of the Work Program of Hubei Province for Accelerating the Promotion of Inter-provincial Government Services Dec 31, 2020
P 17 Notice of the General Office of the People’s Government of Jilin Province on the issuance of the Work Program of Jilin Province for Accelerating the Promotion of Inter-provincial Government Services Jan 4, 2021
P 18 Notice of the General Office of the People’s Government of Anhui Province on the issuance of the Work Program of Anhui Province for Accelerating the Promotion of Inter-provincial Government Services Jan 5, 2021
P 19 Notice of the General Office of the People’s Government of Hunan Province on the issuance of the Work Program of Hunan Province for Accelerating the Promotion of Inter-provincial Government Services Jan 19, 2021
P 20 Notice of the General Office of the People’s Government of Guangxi Province on the issuance of the Work Program of Guangxi Province for Accelerating the Promotion of Inter-provincial Government Services Mar 22, 2021
P 21 Notice of the General Office of the People’s Government of Shandong Province on the issuance of the Work Program of Shandong Province for Accelerating the Promotion of Inter-provincial and Intra-provincial Government Services Apr 1, 2021
P 22 Notice of the General Office of the People’s Government of Tibet Autonomous Region on the issuance of the Work Program of Tibet Autonomous Region for Accelerating the Promotion of Inter-provincial Government Services in Five Provinces in Southwest China Jul 6, 2021
P 23 Notice of the General Office of the People’s Government of Shanxi Province on the issuance of the Work Program of Shanxi Province for Accelerating the Promotion of Inter-provincial and Intra-provincial Government Services Jul 16, 2021
P 24 Notice of the General Office of the People’s Government of Henan Province on the issuance of the Work Program of Henan Province for Accelerating the Promotion of Inter-provincial Government Services Aug 6, 2021
P 25 Notice of the General Office of the People’s Government of Liaoning Province on the issuance of the Work Program of Liaoning Province for Accelerating the Promotion of Inter-provincial, Intra-provincial and Regional Government Services Aug 16, 2021
P 26 Notice of the General Office of the People’s Government of Heilongjiang Province on the issuance of the Work Program of Heilongjiang Province for Accelerating the Promotion of Inter-provincial and Intra-provincial Government Services Nov 17, 2021
P 27 Notice of the General Office of the People’s Government of Qinghai Province on the issuance of the Work Program of Qinghai Province for Accelerating the Promotion of Inter-provincial Government Services Nov 24, 2022
P 28 Notice of Beijing Municipal Administration of Government Services on the Issuance of the Work Program of Beijing Municipality for Accelerating the Promotion of Inter-provincial Government Services Sep 14, 2023

Firstly, the State Council Policy Document Library contains all the normative policy documents that have been publicly released by the State Council, and the official provincial government portals are the most influential service platforms in each province. Secondly, in terms of searching subject terms, we choose inter-provincial government services as the keyword of policy filtering to ensure its accuracy. Thirdly, in terms of search strategy, the study includes two filtering criteria: (1) The text subject is limited to the State Council and provincial governments, and does not involve policies or industry standards of government departments. (2) The text is directly related to the inter-provincial government services, which is currently being implemented. Finally, we obtained 28 highly relevant and effective policy texts.

3.2 Policy feature recognition: Text mining and data analysis

Following the acquisition of policy texts, the next step involves applying text mining methods to preprocess the policy text in preparation for the model construction. Firstly, the ROSTCM 6.0 software is utilizing in performing word division and word frequency statistics on the policy. Secondly, words that have no obvious effect on analyzing the policy features are eliminated, such as nouns like “matters, licenses, materials”, adjectives like “application-oriented”, and words like “promote, realize, do, strengthen, promote, enhance, build, and so on”. Then, the verbs of tendency such as “advance, realize, do, strengthen, promote, enhance, build, establish, optimize, speed up, perfect” are also eliminated. Finally, the word classification results are arranged according to the word frequency in ascending order, and the top 60 high-frequency words are extracted to form a high-frequency word list (see Table 2). By analyzing the high-frequency words in the policy text, we can identify the following characteristics of the provincial Inter-provincial Government Services Policy:

Table 2. Policy text key words’ frequency statistics table.

Serial Number Vocabulary Frequency Serial Number Vocabulary Frequency
1 Services 2136 31 Mechanisms 156
2 Government 1708 32 Docking 152
3 Departments 682 33 Reform 143
4 Processing 590 34 Window 142
5 Units 501 35 Demand 140
6 Platforms 466 36 Synergy 135
7 Business 423 37 Standards 135
8 Data 360 38 Applications 124
9 Sharing 316 39 Support 124
10 Crowd 281 40 National 120
11 Integration 275 41 Guidance 120
12 Enterprise 266 42 Capabilities 119
13 Electronic 244 43 Issues 119
14 Unified 232 44 Coordination 118
15 offsite 226 45 Centers 115
16 systems 222 46 Area 114
17 Various Locations 202 47 Online 114
18 management 202 48 Levels 112
19 acceptance 200 49 Mode 111
20 Provincial 200 50 Regulatory 110
21 List 185 51 Regulate 106
22 Application 181 52 Personnel 105
23 National 174 53 Responsibilities 103
24 Autonomous Region 169 54 Policies 102
25 Process 167 55 Time Frame 100
26 Regions 167 56 Organization 100
27 Cities 165 57 Administrations 100
28 Province 163 58 Rely on 97
29 Government 163 59 Comprehensive 90
30 Lead 158 60 Programs 89
  1. From the perspective of policy design concepts, the provincial policy implements the guiding opinions of the State Council on accelerating the promotion of inter-provincial government services, adheres to the principle of "people-centered development" and adheres to the concept of new development concepts.

  2. From the perspective of policy implementation subjects, inter-provincial government services not only need national, inter-regional and intra-regional coordination, but also need national integrated government service platforms. The national comprehensive government service platform and government service agencies at all levels play an important role in bridging the blockage of business chains and data sharing.

  3. From the perspective of policy guarantee mechanism, policy guarantee mechanisms, including integration, management, acceptance, and coordination, are crucial for accelerating the construction of Inter-provincial Government Services.

Social network analysis is a set of norms and methods to analyze the structure and attributes of social relations. It mainly analyzes the structure and attributes of the relationships constituted by different social units [44]. The data analysis software Gephi is utilized in constructing a semantic network based on high-frequency words, as shown in Fig 1. The proximity of each subject word is determined by the proximity of the nodes within the semantic network and the thickness of the connecting line, the thicker the straight line, the closer the relationship between two keywords. Also, the size of nodes represents the strength of centrality. If a node has more connections to other nodes, its degree centrality is stronger, which means that the node is more important.

Fig 1. Keyword network map.

Fig 1

The visualization results indicate that certain keywords, such as ‘government’ and ‘services’, hold significant centrality within the semantic network. “Government”, “services” and “departments” are three main key words, indicates that government departments have the primary responsibility as the main body of governance, with the goal of optimizing the delivery of government services. “Sharing” and “platforms” are also an important concern, demonstrates the need to fully apply the government service platform for data sharing and data security protection. Through the keyword network analysis, the focus of the government’s provision of government services is clarified, namely, the three aspects of nature, subject and tools. This provides an important basis for the selection of policy evaluation variables and indicators for the construction of the PMC index model below. At the same time, the relationship between the keywords also illustrates the internal logic between the variables of the PMC index model, making the evaluation index system form an organic whole.

3.3 Construction of PMC index model

In this paper, the PMC index model is used to quantitatively evaluate the Inter-provincial Government Services policies issued by the state. The PMC index model is proposed by Estrada [45] based on the Omnia Mobilis hypothesis [46], which holds that everything in the world is moving and connected, and that all relevant variables should be considered as much as possible in the modeling and no relevant variables should be removed. The construction process consists of the following four steps: (1) classification of variables and identification of parameters; (2) creation of multi-input-output tables; (3) measurement of PMC indices; (4) construction of PMC surfaces [47].

3.3.1 Variable classification and parameter identification

Combined with Dai et.al.[1] and Song [48] research, this paper constructed an index system of Inter-provincial Government Services policy rating (see Table 3). The index system consists of 10 first-level variables and 35 second-level variables, among which the first-level variables are: policy nature(X1), policy subject(X2), policy object(X3), policy content(X4), policy function(X5), policy timeliness(X6), policy domain(X7), policy instrument(X8), policy evaluation(X9), policy citation(X10). All the sub-variables of the remaining level 1 variables and their associated evaluation criteria are shown in Table 3. The tenth level 1 index (X10) is policy citation, which describes whether the policy cites other policies. It has no sub-variables.

Table 3. PMC evaluation index system and evaluation standard.
First-Level Index Second-Level Index Evaluation Criteria
X 1 Forecasting X11
Regulation X12
Recommendation X13
Guidance X14
Policies are predictive, yes 1, no 0
Policy is regulatory in nature, yes 1, no 0
Policy is recommendatory, yes 1, no 0
Policy is guiding, yes 1, no 0
X 2 Government Departments X21
Specialized Agencies X22
Technology Company X23
Enterprises, Citizens X24
Whether the policy subject involves the government and various functional departments, yes 1, no 0
Whether the main body of the policy involves experts, think tanks and research institutions, yes 1, no 0
Whether the main body of the policy involves technology companies and local agencies, yes 1, no 0
Whether the policy subject involves business enterprises and private citizens, yes 1, no 0
X 3 Enterprises X31
Ordinary Citizen X32
Institutions of higher learning X33
Research Organization X34
Other Organizations X35
Whether the policy object involves enterprises and legal persons, yes 1, no 0
Whether the policy object involves the public, citizens, yes 1, no 0
Whether the policy object involves institutions, colleges and universities, yes 1, no 0
Whether the policy object involves scientific research institutions, research institutes, yes 1, no 0
Whether the policy object involves social organizations, institutions, etc., yes 1, no 0
X 4 Off-site Processing X41
Regional cooperation X42
Online Integration X43
Offline synergy X44
Whether the policy involves cross-location processing of matters, yes 1, no 0
Whether the policy involves inter-regional exchanges and cooperation, yes 1, no 0
Whether the policy involves the integration of online service portals, yes 1, no 0
Whether the policy involves synergizing offline service mechanisms, yes 1, no 0
X 5 Optimize Governance X51
Promoting Development X52
Improving People’s Livelihoods X53
Enhancing data sharingX54
Whether the policy has the function of optimizing government governance, yes 1, no 0
Whether the policy has the function of promoting economic development, yes 1, no 0
Whether the policy has the function of improving people’s livelihood services, yes 1, no 0
Whether the policy has the function of enhancing data sharing, yes 1, no 0
X 6 Short-term X61
Medium-term X62
Long-term X63
Whether the policy involves content within 3 years, yes 1, no 0
Whether the policy is related to the content of 3–5 years, yes 1, no 0
Whether the policy covers more than 5 years, yes 1, no 0
X 7 Economic X71
Social X72
Science and Technology X73
Political X74
Environment X75
Whether the policy covers economic areas, yes 1, no 0
Whether the policy covers social areas, yes 1, no 0
Whether the policy covers scientific and technological areas, yes 1, no 0
Whether the policy covers the political domain, yes 1, no 0
Whether the policy involves the environmental domain, yes 1, no 0
X 8 Organization and Coordination X81
Rule of Law System X82
Supervision and Evaluation X83
Publicity and guidance X84
Whether the policy involves organizational leadership and coordination, yes 1, no 0
Whether the policy involves rule of law safeguards and institutional support, yes 1, no 0
Whether the policy involves supervision, guidance and service evaluation, yes 1, no 0
Whether the policy involves publicity and promotion and interpretation guidance, yes 1, no 0
X 9 Adequate basis X91
Informative planning X92
Geographically distinctive X93
Whether the policy is based on sufficient grounds, yes 1, no 0
Whether the policy program is specific and feasible, yes 1, no 0
Whether the policy has distinctive regional characteristics, yes 1, no 0
X 10 / Whether the policy cites other policy documents, yes 1, no 0

3.3.2 Establish multi-input-output table to calculate first-level index

As a basic analytical framework for quantifying the Inter-provincial Government Services policy, the multi-input-output table can measure any single variable in the evaluation index system by storing a large amount of data, which is a key part of the PMC index model construction. So, a multi-input-output table based on the combination of new smart city policy variable classification and parameter identification is established, which is shown in Table 4. In addition, in order to further enhance the quality and reliability of the policy evaluation results, in the process of assigning values to the secondary variables based on Table 3, the corresponding variables can only take the value of 1 if the text of the policy to be evaluated is able to describe the content of the secondary variables in a very clear way; for the content that is difficult to be determined, a Delphi method is used in determining the specific values of the variables, which is able to reduce the subjective error of the policy evaluation to a certain extent.

Table 4. Multi-input-output table.
First-Level Index Secondary Index
X 1 X11,X12,X13,X14
X 2 X21,X22,X23,X24
X 3 X31,X32,X33,X34,X35
X 4 X41,X42,X43,X44
X 5 X51,X52,X53
X 6 X61,X62,X63
X 7 X71,X72,X73,X74,X75
X 8 X81,X82,X83,X84
X 9 X91,X92,X93
X 10 /

3.3.3 Calculation of PMC index

Besides the above first-level and second-level indexes, two additional parameters were introduced into the structure of the PMC index. If the second-level index could fit into the policy model, it was denoted by “1”; if the second-level index could not fit into the policy model, it was denoted by “0”. That is, each parameter was coded to the binary values “0” or “1”. Without losing the generality, this article will give equal weights to all the secondary indicators. The first-level indexes were calculated via summarizing all the secondary indexes using Eq (3), and then the final PMC index was obtained by summing up the values of all variables using Eq (4). Finally, the surface graph, to display the resulting PMC index matrix more intuitively, is drawn. The calculation formulas for the PMC index are detailed below:

XN[0,1] (1)
X={XR:[01]} (2)
Xt=j=14XtjTXtj,t=1,2,,10 (3)
PMC=X1i=14X1i4+X2j=14X2j4+X3k=15X3k5+X4l=14X4l4+X5m=13X5m3+X6n=13X6n3+X7o=15X7o5+X8p=14X8p4+X9q=13X9q3+X10 (4)

According to the calculation results of the PMC index and the research of Estrada [45], the policy evaluation of the PMC index can be divided into four grades (see Table 5). Specifically, if the PMC index value was less than 4.99, the policy was regarded as having “bad consistency”; if the PMC index value was between 5.00 and 6.99, the policy was regarded as having “acceptable consistency”; if the PMC index value was between 7.00 and 8.99, the policy was regarded as having “excellent consistency”; and if the PMC index value was between 9.00 and 10.00, the policy was regarded as having “perfect consistency”.

Table 5. Classification of policy evaluation grades.
PMC Index 0–4.99 5.00–6.99 7.00–8.99 9.00–10
Policy Consistency Bad acceptable excellent perfect

3.3.4 PMC surface drawing

The PMC surface figures (Figs 2 and 3) display a symmetric surface representing the values of nine first-level indexes, providing insights into the strengths and weaknesses of Inter-provincial Government Services policies. Since the values of policy nature (X1) of 28 Inter-provincial Government Services policies are all 1, the policy nature index variables are eliminated, and a 3 × 3 matrix is constructed according to the values of the remaining indicators (see Eq (5)). Due to the limitation of space, this paper only presents the PMC surface graphs of the policies with the highest and the lowest scores of the PMC indexes, i.e., P18(P25 same value as P18) and P19. Different colors in the PMC surface represent different index values, and the convex part of the surface indicates higher scores for the policy-level variables, while the concave part indicates lower scores for the policy-level variables (see Figs 2 and 3 for details).

Fig 2. PMC surface figure of P18.

Fig 2

Fig 3. PMC surface figure of P19.

Fig 3

PMC=X2X3X4X5X6X7X8X9X10 (5)

4. Evaluation and comparative analysis of Inter-provincial Government Services policies

4.1 Calculation of PMC Index of Inter-provincial Government Services policy

The evaluated results are calculated by using Eqs (1)–(4), and the grade evaluation of 28 representative policies were conducted according to Table 5, then the final evaluation results of 28 Inter-provincial Government Services policies are obtained. The evaluation grade of 28 Inter-provincial Government Services policies is divided into 4 grades (see Table 6).

Table 6. Calculation results of PMC index of 28 Inter-provincial Government Services policies.

Policy X 1 X 2 X 3 X 4 X 5 X 6 X 7 X 8 X 9 X 10 PMC Rank Grade
P 1 1.00 0.75 0.60 1.00 1.00 0.33 0.80 1.00 0.67 1.00 8.15 6 excellent
P 2 1.00 0.75 0.40 1.00 1.00 0.33 0.80 1.00 1.00 0.00 7.28 21 excellent
P 3 1.00 0.75 0.40 1.00 1.00 0.33 0.80 1.00 1.00 0.00 7.28 21 excellent
P 4 1.00 0.75 0.40 1.00 1.00 0.67 0.80 0.75 1.00 0.00 7.37 19 excellent
P 5 1.00 0.75 0.40 0.75 1.00 0.67 0.80 0.75 1.00 1.00 8.12 7 excellent
P 6 1.00 0.75 0.40 1.00 1.00 0.33 0.80 0.75 1.00 1.00 8.03 9 excellent
P 7 1.00 0.75 0.40 0.75 1.00 0.33 0.80 1.00 1.00 1.00 8.03 9 excellent
P 8 1.00 0.50 0.40 0.75 1.00 0.33 0.80 0.75 0.67 1.00 7.20 23 excellent
P 9 1.00 0.50 0.40 1.00 1.00 0.33 0.80 0.75 1.00 1.00 7.78 15 excellent
P 10 1.00 0.75 0.40 1.00 1.00 0.33 0.80 1.00 1.00 1.00 8.28 4 excellent
P 11 1.00 0.75 0.40 0.75 1.00 0.33 0.80 1.00 1.00 1.00 8.03 9 excellent
P 12 1.00 0.75 0.40 0.75 1.00 0.67 0.80 1.00 0.67 1.00 8.04 8 excellent
P 13 1.00 0.75 0.40 0.75 1.00 0.33 0.80 1.00 1.00 1.00 8.03 9 excellent
P 14 1.00 0.75 0.40 1.00 1.00 0.33 0.80 0.75 1.00 1.00 8.03 9 excellent
P 15 1.00 0.75 0.40 0.75 1.00 0.33 0.80 0.75 1.00 0.00 6.78 26 acceptable
P 16 1.00 0.75 0.40 0.75 1.00 0.33 0.80 0.50 1.00 0.00 6.53 27 acceptable
P 17 1.00 0.75 0.40 1.00 1.00 0.67 0.80 0.75 1.00 0.00 7.37 19 excellent
P 18 1.00 0.75 0.40 1.00 1.00 0.67 0.80 1.00 1.00 1.00 8.62 1 excellent
P 19 1.00 0.75 0.40 0.75 1.00 0.67 0.80 0.75 0.33 0.00 6.45 28 acceptable
P 20 1.00 0.75 0.40 1.00 1.00 0.33 0.80 0.75 1.00 1.00 8.03 9 excellent
P 21 1.00 0.75 0.40 0.75 1.00 0.33 0.80 0.75 1.00 1.00 7.78 15 excellent
P 22 1.00 0.75 0.40 0.75 1.00 0.33 1.00 0.50 1.00 1.00 7.73 17 excellent
P 23 1.00 0.75 0.40 1.00 1.00 0.67 0.80 0.75 1.00 1.00 8.37 3 excellent
P 24 1.00 0.75 0.40 1.00 1.00 0.67 0.80 1.00 1.00 0.00 7.62 18 excellent
P 25 1.00 0.75 0.40 1.00 1.00 0.67 0.80 1.00 1.00 1.00 8.62 1 excellent
P 26 1.00 0.75 0.40 0.75 1.00 0.33 1.00 1.00 1.00 1.00 8.23 5 excellent
P 27 1.00 0.75 0.40 1.00 1.00 0.33 0.80 0.75 1.00 0.00 7.03 24 excellent
P 28 1.00 0.75 0.40 1.00 0.75 0.33 0.80 0.75 1.00 0.00 6.78 25 excellent
Average 1.00 0.73 0.41 0.89 0.99 0.44 0.81 0.84 0.94 0.64 7.70 / /

4.2 Quantitative evaluation analysis of the polices

4.2.1 Overview of policies: Analyzing overall characteristics

The PMC index scores of the 28 policies (see Table 6) ranged from 6.45 to 8.62, with a mean value of 7.71. Notably, policies 15, 16, and 19 attained acceptable levels, while the others achieved excellence. It indicates that the 28 policies are of relatively good quality, with a certain degree of science and rationality, and can provide guidance for the construction of Inter-provincial Government Services. In terms of the PMC index ranking of the policy samples, P18 = P25>P23>P10>P26>P1, reflecting the tendency that China’s Inter-provincial Government Services policies are “better at the bottom than at the top”, i.e., the lower the policy level, the better the policies promulgated by the government departments. That is, the lower the policy level, the higher the quality of the Inter-provincial Government Services policy. The main reason for this feature is that policies at the national level mainly play an overall and strategic guiding role, and many of their provisions are relatively general, whereas as the level of government decreases, there is a higher demand for operationalization of policies, i.e., in order to effectively promote the work of open government data in their jurisdictions, local governments focus on implementing the basic policies of higher levels of government to formulate more specific action plans and management methods. To effectively reveal the differences between the policies, the advantages and disadvantages of the policies can be analyzed by comparing the scores of each level of variables with the mean value and the differences between the “perfect” policies.

4.2.2 PMC surface diagram of policy average

To visually represent the PMC index calculation results, we transform the first-level index scores of each policy into a third-order matrix by using Eq (5), facilitating analysis of each policy’s internal consistency level through surface concavity and convexity.

In the PMC surface diagram, the color of the blocks varies depending on the indicator scores. A convex surface indicates that a policy has a high score for the indicator, while a concave surface indicates that a policy has a low score for the indicator. Due to space limitation and to further demonstrate the overall consistency level of policies, this paper selects the PMC surface diagram of policy average.

As can be seen from the surface diagram, the overall structure of policies is more balanced. The smoother the surface is, the higher the policy consistency level is; the larger the surface concavity is, the lower the policy consistency level is. From the average PMC surface in Fig 4, we can see that the consistency level of China’s current Inter-provincial Government Services Policy is relatively high, with a balanced force of various indicators and a reasonable structure.

Fig 4. PMC surface diagram of policy average.

Fig 4

4.3 Comparation analysis

4.3.1 Comparison with the mean value

Upon comparing the scores of each policy variable with the mean value, it becomes evident that:

  1. Since each policy has the characteristics of forecasting, regulating, advising and guiding, and the functions of the policy include optimizing government governance, promoting economic development and improving people’s livelihood, the scores of the policy nature X1 and the policy function X5 are equal to the mean value, which are both 1.

  2. Two and four policies scored below the mean in the policy subject X2 and the policy evaluation X9 respectively, i.e. more than half of the policies scored above the mean.This shows that the main body of policy formulation includes the central government, provincial and municipal governments and their functional departments, technology companies, local agencies, as well as clerical enterprises and citizens, but all of them are involved in the advice of experts and research institutes; the policy evaluation in addition to the national central policy, the vast majority of provincial governments are able to take the central policy as a guide to the implementation of the actual situation in accordance with the local implementation and adjustments, while the central policy is mainly to play a role in guiding and advising the central policy. The central policy mainly plays the role of guidance and advice, and cannot fully take into account the different characteristics and needs of localities. From this, we can conclude the importance of the policy subject as the core component of the policy system, and the necessity for local policies to be optimized with distinctive regional characteristics.

  3. More than half of the policies in Policy Object X3, Policy Timeliness X6, Policy Field X7, and Policy Means X8 scored lower than the average value, and among them, except for the central policy involving institutions, the rest of the policy objects only involve enterprises and ordinary citizens. This suggests that due to imperfect supporting institutions and technical constraints, the Inter-provincial Government Services policy is not well adapted to institutions of higher learning, scientific research institutions and other organizations; the policy’s timeliness has not yet involved long-term and medium-term policy content, meaning that the policy’s timeliness is mainly short-term, and although it involves specific annual work objectives, it lacks a long-term deployment of more than five years and a medium-term development plan. In terms of policy areas, most of the policies focus on economic, social, scientific and technological, and political areas, but do not pay attention to the environmental area.

4.3.2 Comparison and analysis with “Perfect” policies

In order to better identify the optimization path of Inter-provincial Government Services policy, it is necessary to analyze the gap between each policy and the “perfect” policy. Therefore, this study draws on the practice of Song [48] and Du & Zhou [49], comparing the score of the first-level indicators with the “perfect” policy with full scores in all evaluation indicators, and the difference between the two is the concavity index (see Table 7).

Table 7. Concavity indices for the 28 policies.
X 1 X 2 X 3 X 4 X 5 X 6 X 7 X 8 X 9 X 10 Concavity Index Grade
P 1 0.00 0.25 0.40 0.00 0.00 0.67 0.20 0.00 0.33 0.00 1.85 23
P 2 0.00 0.25 0.60 0.00 0.00 0.67 0.20 0.00 0.00 1.00 2.72 7
P 3 0.00 0.25 0.60 0.00 0.00 0.67 0.20 0.00 0.00 1.00 2.72 7
P 4 0.00 0.25 0.60 0.00 0.00 0.33 0.20 0.25 0.00 1.00 2.63 9
P 5 0.00 0.25 0.60 0.25 0.00 0.33 0.20 0.25 0.00 0.00 1.88 22
P 6 0.00 0.25 0.60 0.00 0.00 0.67 0.20 0.25 0.00 0.00 1.97 15
P 7 0.00 0.25 0.60 0.25 0.00 0.67 0.20 0.00 0.00 0.00 1.97 15
P 8 0.00 0.50 0.60 0.25 0.00 0.67 0.20 0.25 0.33 0.00 2.8 6
P 9 0.00 0.50 0.60 0.00 0.00 0.67 0.20 0.25 0.00 0.00 2.22 13
P 10 0.00 0.25 0.60 0.00 0.00 0.67 0.20 0.00 0.00 0.00 1.72 25
P 11 0.00 0.25 0.60 0.25 0.00 0.67 0.20 0.00 0.00 0.00 1.97 15
P 12 0.00 0.25 0.60 0.25 0.00 0.33 0.20 0.00 0.33 0.00 1.96 21
P 13 0.00 0.25 0.60 0.25 0.00 0.67 0.20 0.00 0.00 0.00 1.97 15
P 14 0.00 0.25 0.60 0.25 0.00 0.33 0.20 0.25 0.67 1.00 3.55 1
P 15 0.00 0.25 0.60 0.00 0.00 0.67 0.20 0.25 0.00 1.00 2.97 4
P 16 0.00 0.25 0.60 0.00 0.00 0.67 0.20 0.25 0.00 0.00 1.97 15
P 17 0.00 0.25 0.60 0.25 0.00 0.67 0.20 0.25 0.00 1.00 3.22 3
P 18 0.00 0.25 0.60 0.25 0.00 0.67 0.20 0.50 0.00 1.00 3.47 2
P 19 0.00 0.25 0.60 0.00 0.00 0.33 0.20 0.25 0.00 1.00 2.63 9
P 20 0.00 0.25 0.60 0.00 0.00 0.33 0.20 0.00 0.00 0.00 1.38 27
P 21 0.00 0.25 0.60 0.00 0.00 0.67 0.20 0.25 0.00 0.00 1.97 15
P 22 0.00 0.25 0.60 0.25 0.00 0.67 0.20 0.25 0.00 0.00 2.22 13
P 23 0.00 0.25 0.60 0.25 0.00 0.67 0.00 0.50 0.00 0.00 2.27 12
P 24 0.00 0.25 0.60 0.00 0.00 0.33 0.20 0.25 0.00 0.00 1.63 26
P 25 0.00 0.25 0.60 0.00 0.00 0.33 0.20 0.00 0.00 1.00 2.38 11
P 26 0.00 0.25 0.60 0.00 0.00 0.33 0.20 0.00 0.00 0.00 1.38 27
P 27 0.00 0.25 0.60 0.25 0.00 0.67 0.00 0.00 0.00 0.00 1.77 24
P 28 0.00 0.25 0.60 0.00 0.00 0.67 0.20 0.25 0.00 1.00 2.97 4
Average 0.00 0.28 0.59 0.13 0.00 0.57 0.21 0.18 0.09 0.37 2.28 /
Grade 9 4 1 7 9 2 5 6 8 3 / /
  1. In terms of the vertical dimension, i.e., the concavity of the indicators at each level of the policy. All policies have the greatest degree of concavity in Policy Direction X3, with a mean value of 0.59. Analysis of the policy texts reveals that all 28 policies involve enterprises and ordinary citizens, and attach importance to the provision of convenient services to them, but are not specific about the benefits to institutions of higher education, scientific research institutes, and other organizations such as social groups and institutions. The mean value of the depression index of Policy Timeliness X6 is 0.57, ranking second. It can be seen from the policy texts that the timeliness of most policies, including the central policies, is mainly short-term, lacks medium-term development plans and long-term deployments, and fails to make scientific and rational predictions of the future development direction and goals on the basis of grasping the current situation. The mean value of the concavity index of policy citation X10 is 0.37. Most provincial and municipal policies, including central policies, generally cite Xi Jinping’s thought on socialism with Chinese characteristics, the spirit of the 19th National Congress of the Party, and relevant laws and regulations, or use P1 as a guideline, while ten policies do not make citations, which makes the policies lack a clear policy basis. The mean value of the concavity index of policy subject X2 is 0.28. Specifically, the leading role of government departments and the importance of enterprises’ and citizens’ suggestions and policy participation are all taken into account in the process of participating in decision-making and policy implementation, so as to guarantee the smooth promotion of policy work “from the top to the bottom” and the realization of the goal of policies to meet the needs of the people, but all the policies ignore big data. However, all the policies have neglected the important role of big data experts, think tanks and research institutes as “advisors” in the operation of the policy system, while policies P8 and P9 have not included technology companies, agencies and other specialized institutions as partners, neglecting their role in providing professional support. In Policy Area X7, all policies focus on economic, social, scientific and technological, and political services, but very few focus on the environment.

  2. In terms of the horizontal dimples of policies, the dimples of 28 policies range from 1.38 to 3.55, with P18 and P25 having the lowest dimples, i.e., closest to the “perfect policy”, and P19 having the largest gap between the “perfect policy” and the “perfect policy” in comparison to the other policies. The gap between P19 and the “perfect policy” is the largest. In the case of P19, as shown in Table 7, the gap between P19 and the “perfect policy” is larger in the three aspects of policy object X3, policy evaluation X9, and policy citationX10. Tracing back to the assignment of each secondary variable, it can be seen that the defects of P14 in policy object X3 are the biggest point of loss, but they are no different from other policies; in policy evaluation X9, policy P14 lacks regional characteristics, and does not formulate the policy flexibly according to the specific economic development of the region, making it difficult to judge whether or not the policy is in line with the actual situation and whether or not it can be implemented; and policy citation X10 lacks the basis for policy formulation, and does not clearly point out the basis for policy formulation, and does not specify the policy citation X10. The policy citation X10 lacks the basis for policy formulation, and does not clearly indicate whether the policy formulation implements the relevant national regulations and spirit, making the policy program lack of scientific and persuasive power; moreover, in terms of policy means X8, compared with most other policies, P19 only adopts three initiatives of organization and coordination, supervision and evaluation, and publicity and guidance, and lacks the content of the rule of law, which indicates that the relevant safeguards are still unsound, and there is a lack of legal constraints and incentives, and the system building is also lacking in the content. constraints and incentives, and the institutional construction is not perfect. As far as P18 and P25 are concerned, the concavity indices of the two policies are the same after the assignment of each level of variables, and specific analysis shows that the concavity indices in the six aspects of policy nature X1, policy content X4, policy function X5, policy means X8, policy evaluation X9 and policy citation X10 are all 0, and the degree of completeness is more prominent; at the same time, compared with the majority of other policies, P18 and P25 not only clarify the short-term development plans, but also take into account the medium-term development goals. Therefore, the order of policy improvement in P19 is “X3 policy object ‐ X9 policy evaluation ‐ X10 policy citation ‐ X8 policy means ‐ X6 policy time”, and it should be further clarified that the path of policy improvement is not the only one, and it can be adjusted according to the actual situation in Hunan Province.

5. Conclusions and policy implications

5.1 Conclusions and suggestions

The Inter-provincial Government Services Policy enhances data sharing and collaboration among government agencies, enabling more informed decision-making and effective policy formulation. And it facilitates seamless integration and interoperability of government services across different regions, ensuring a cohesive experience for citizens and businesses. This paper uses the text mining method and PMC index model to quantitatively evaluate 28 texts of the Inter-provincial Government Services Policy, with a view to providing practical support for policy optimization. The main conclusions are as below.

  1. The scope of application of the policy is relatively narrow, especially the policy area. Of the 28 policies, only the economic, political and scientific and technological fields are covered, with a small minority application in the environmental field.

  2. The timeframe of the policy text mainly involves the long-term, medium-term and short-term. Short-term goals are usually more specific and operational and can help governments to better plan and allocate resources. Medium-term goals can help the Government to better measure and keep track of its progress, as well as make timely adjustments and improvements. Long-term goals require the Government to have a long-term vision and strong determination to provide direction and guidance for future development. Of the 28 policies, only 9 addressed medium-term goals, while the remaining 19 focused only on short-term plans, and all neglected long-term deployment. To some extent, this has led to a lack of foresight and sustainability in interprovincial government service policies.

  3. The Inter-provincial Government Services policy as an emerging policy can be in the policy means, policy evaluation and policy citation three aspects of efforts to improve the scientific nature of the policy. In terms of policy means,16 policies do not specify the safeguards of relevant laws, regulations and systems, which will make the Inter-provincial Government Services incompatible documents and standards cannot be cleaned up and revised in a timely manner. As for policy evaluation, local policies are able to implement the guiding opinions of the central policy, but are lack of specific, implementable and distinctive programmers based on different local characteristics and development situations. As well, citations are less likely to appear in policy. There are 10 policies with insufficient basis to judge the viability of the policy.

Based on the above conclusion, the conclusions for policy optimization are proposed below.

  1. Expanding the scope of application of government policies. In addition to the fields of economics, science and politics, the policy can also take into account the need for cross-location law enforcement in the field of ecological environmental protection, and actively explore new areas of application. By expanding the areas of policy implementation, policies can benefit people’s livelihoods in all aspects.

  2. Focusing on the long-term effect of the policy. In the future, we should speed up the formulation of long-term goals. It is recommended that the central government should expeditiously issue a macroscopic and authoritative overall plan and constructive opinions to regulate and guide the development of Inter-provincial Government Services, so as to guide other provinces and municipalities to expeditiously issue corresponding policies according to the actual development situation of each region, and make systematic arrangements for the overall requirements, key tasks, and safeguards to avoid the wastage of resources and undue consequences due to the lack of a basis for blind planning.

  3. Improving the quality of the government’s policy making. The Inter-provincial Government Services Policy is still in the stage of exploration and development, and the policy makers need to continuously make adjustments according to the feedback information from the implementation. Efforts can be made in three areas, policy instruments, policy evaluation and policy citation, to form a virtuous cycle of policy making and policy implementation and realize the two-way promotion, so as to enhance the practical effectiveness of the Inter-provincial Government Services. a) Policy instruments: We need to strengthen institutional mechanisms and collaborative governance to promote digital government. b) Policy evaluation: Local governments need to identify shortcomings in the level of informatization and the degree of development of digital infrastructure. On the basis of making up for the shortcomings, we should formulate development programs that suit their local characteristics. c) Policy citation: It is necessary to clarify the guiding ideology of the policy and the requirements of society for building a service-oriented government that satisfies the people, so as to ensure that the policy is based on sufficient grounds and is in line with the actual situation.

5.2 Further discussion

By analyzing the text of China’s inter-provincial general policy from 2020 to 2023, this paper quantitatively evaluates the policy as a whole, and obtains some useful conclusions and enlightenments. However, there are still some deficiencies and areas that can be improved in this paper. And it is difficult to conduct a more comprehensive analysis of the actual effect due to the insufficient sample size due to the short implementation time of the policy. In addition, the research method of this paper only explores the content of the policy text, and does not study the effects brought about by the implementation of the policy. We will consider combining text analysis and quantitative empirical research in the future, in order to provide a more comprehensive and scientific method and empirical reference for the quantitative evaluation of the policy.

Supporting information

S1 File

(DOCX)

pone.0310491.s001.docx (17.9KB, docx)

Data Availability

All the data are based on the texts of 28 Inter-provincial Government Services policies issued by China from 2020 to 2023. These policy documents were downloaded by the authors from Chinese local government websites. And it is shown in file called "supporting information".

Funding Statement

This work was supported by National Social Science Foundation of China (No. 23CSH057), Hebei Natural Science Foundation (No. G2023203015).The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Kraus S., Jones P., Kailer N., Weinmann A., Chaparro-Banegas N., & Roig-Tierno N. (2021). Digital transformation: An overview of the current state of the art of research. Sage Open, 11(3), 21582440211047576. [Google Scholar]
  • 2.Yang C., Yin S., Cui D., Mao Z., Sun Y., Jia C., et al. (2022). Quantitative evaluation of traditional Chinese medicine development policy: A PMC index model approach. Frontiers in Public Health, 10, 1041528. doi: 10.3389/fpubh.2022.1041528 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Veit D., Huntgeburth J., Veit D., & Huntgeburth J. (2014). Online One-Stop Government. Foundations of Digital Government: Leading and Managing in the Digital Era, 67–85. [Google Scholar]
  • 4.Liu X. R. (2022). Characteristics, Models and Paths of Cross-domain Governance of Government Services under the Perspective of Digital Transformation—Taking Inter-provincial Government Services as an Example, E-Government, 9, 112–124. (in Chinese) [Google Scholar]
  • 5.Sun Z. F. & Xi J. C. (2023). Types of Digital Collaborative Governance and Its Logic—The Case of Inter-provincial Government Services, E-Government, 10, 95–105. (in Chinese) [Google Scholar]
  • 6.Jia T. & Chen X. (2007). The practice of one-stop government service organization construction in foreign countries and the inspiration for China, Chinese Administration, 5, 55–58. (in Chinese) [Google Scholar]
  • 7.Chen T. & Gao A. L. (2021). Optimizing Business Environment Driven by Government Digital Transformation: A Case Study of Dongguan City, E-Government, 3, 83–93. (in Chinese) [Google Scholar]
  • 8.Gao X., & Lee J. (2017). E-government services and social media adoption: Experience of small local governments in Nebraska state. Government Information Quarterly, 34(4), 627–634. [Google Scholar]
  • 9.Martin S., & Sanderson I. (1999). Evaluating public policy experiments: measuring outcomes, monitoring processes or managing pilots?. Evaluation, 5(3), 245–258. [Google Scholar]
  • 10.Liu X. R. (2022). Inter-provincial government services: Basic orientation, development obstacles and governance strategies, Administrative Reform, 12, 77–85. (in Chinese) [Google Scholar]
  • 11.Janowski T. (2015). Digital government evolution: From transformation to contextualization. Government information quarterly, 32(3), 221–236. [Google Scholar]
  • 12.Danielsen F., Flak L.S., et al. (2022). Understanding Digital Transformation in Government, Scientific Foundations of Digital Governance and Transformation,38,151–187. [Google Scholar]
  • 13.Li Q., Cao S., et al. (2020). Interpretation of the system theory of the digital transformation of Chinese governance: pattern and path, Chinese Administration, 10, 44–51. (in Chinese) [Google Scholar]
  • 14.Eom S. & Lee J. (2022). Digital government transformation in turbulent times: Responses, challenges, and future direction, Government Information Quarterly, 39(2),1–9. doi: 10.1016/j.giq.2022.101690 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Carter L., & Bélanger F. (2005). The utilization of e‐government services: citizen trust, innovation and acceptance factors. Information systems journal, 15(1), 5–25. [Google Scholar]
  • 16.Liu B. (2022). New Challenges of Data Sharing and Collaborative Governance Strategies in Inter-provincial Government Services, E-Government,2, 88–96. (in Chinese) [Google Scholar]
  • 17.McConaughey M. S. (2017). Tools of Governance: The Importance of Intergovernmental Relations, Available from ProQuest Dissertations & Theses Global A&I: The Humanities and Social Sciences Collection,159–170. [Google Scholar]
  • 18.Zhang J. G. (2013). Intergovernmental governance: New trends in the study of intergovernmental relations in contemporary China, Academic Research, 2, 38–45. (in Chinese) [Google Scholar]
  • 19.Bian X. & Zhang C. (2016). Intergovernmental relations and national governance: Functions, models and reform ideas, Chinese Administration, 5, 14–18. (in Chinese) [Google Scholar]
  • 20.Agranoff R. & McGuire M. (1988). Multi-network management: Collaboration and the hollow state in local economic policy, Journal of Public Administration Research and Theory, 8(1),67–91. [Google Scholar]
  • 21.Koontz M. T. &Thomas W. C. (2006). What Do We Know and Need to Know about the Environmental Outcomes of Collaborative Management? Public Administration Review,66(s1),111–121. [Google Scholar]
  • 22.Smith R. C. (2007). Institutional Determinants of Collaboration: An Empirical Study of County Open- Space Protection, Journal of Public Administration Research and Theory, 19(1),1–21. [Google Scholar]
  • 23.Wei N. & Meng Q. G. (2018). Mechanism Examination and Institutional Logic of Cross-Regional Collaborative Management of Atmospheric Pollution-Based on the Collaborative Practice of Beijing-Tianjin-Hebei, China Soft Science, 10, 79–92. (in Chinese) [Google Scholar]
  • 24.Kettl F. D. (2006). Managing Boundaries in American Administration: The Collaboration Imperative, Public Administration Review, 66(s1),10–19. [Google Scholar]
  • 25.Zhang H. B. (2021). Cross-regional synergy in emergency management, Journal of Nanjing University (Philosophy-Humanities-Social Sciences), 1, 102–110+161. (in Chinese) [Google Scholar]
  • 26.Hu J. H., Lai Y. R., et al. (2023). Research on cross-regional cooperative stockpiling of emergency supplies—an analysis based on SFIC model, Journal of Hebei University of Science and Technology (Social Science Edition), 1, 1–9. (in Chinese) [Google Scholar]
  • 27.Zhang P. (2024). The implementation dilemma of the Inter-provincial Government Services policy and governance in the digital era, Hunan Social Science, 1, 95–103. (in Chinese) [Google Scholar]
  • 28.Hao H. B. (2022). Realistic Dilemma and Practical Progress of Inter-provincial Government Services under the Threshold of Integral Governance—Taking the Pilot of “Inter-provincial Common Office” for Marriage Registration as an Example, China Administration, 6, 12–18. (in Chinese) [Google Scholar]
  • 29.Brock W. A., Durlauf S. N., et al. (2007). Model uncertainty and policy evaluation: Some theory and empirics, Journal of Econometrics, 136(2), 629–664. [Google Scholar]
  • 30.Kuang B., Han J., Lu X., Zhang X., & Fan X. (2020). Quantitative evaluation of China’s cultivated land protection policies based on the PMC-Index model. Land Use Policy, 99, 105062. [Google Scholar]
  • 31.Allen P., Pilar M., Walsh-Bailey C., Hooley C., Mazzucca S., Lewis C. C., et al. (2020). Quantitative measures of health policy implementation determinants and outcomes: a systematic review. Implementation Science, 15, 1–17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Aisaiti G., Xie J., et al. (2022). National Innovation Demonstration Zone policy and city innovation capability—A quasi-natural experimental analysis, Ind. Manag. Data Syst,122(5), 1246–1267. [Google Scholar]
  • 33.Fan F., & Zhang X. (2021). Transformation effect of resource-based cities based on PSM-DID model: An empirical analysis from China, Environmental Impact Assessment Review, 91. [Google Scholar]
  • 34.Kovtun D. (2021). Assessment of Congruence of Unstructured Data Using Text Mining Technology, Paper presented at the 2021 IEEE 23rd Conference on Business Informatics (CBI). [Google Scholar]
  • 35.Preeti. (2021). Review on Text Mining: Techniques, Applications and Issues, Paper presented at the 2021 10th International Conference on System Modeling & Advancement in Research Trends (SMART).
  • 36.Kamalzadeh M.& Haghighat A. T. (2021). Applying the Approach Based on Several Social Network Analysis Metrics to Identify Influential Users of a Brand, Paper presented at the 2021 Eighth International Conference on Social Network Analysis, Management and Security (SNAMS). [Google Scholar]
  • 37.Tabassum S., Pereira F. S., Fernandes S., & Gama J. (2018). Social network analysis: An overview. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 8(5), e1256. [Google Scholar]
  • 38.Yang W., Xu K., Lian J., Bin L., & Ma C. (2018). Multiple flood vulnerability assessment approach based on fuzzy comprehensive evaluation method and coordinated development degree model. Journal of environmental management, 213, 440–450. doi: 10.1016/j.jenvman.2018.02.085 [DOI] [PubMed] [Google Scholar]
  • 39.Huang X. & Zhou X. (2022). Research on Bidding Evaluation of Engineering Projects Based on Fuzzy Comprehensive Evaluation Method, Paper presented at the 2022 International Conference on Machine Learning and Knowledge Engineering (MLKE). [Google Scholar]
  • 40.Hu M., Guo C., Wang Y., & Ma D. (2023). Quantitative evaluation of China’s private universities provincial public funding policies based on the PMC-Index model. PLoS One, 18(12), e0295601. doi: 10.1371/journal.pone.0295601 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Guilisse La Fortune N. N. & Xia Y. Q. (2022). Quantitative evaluation and optimization path of advanced manufacturing development policy based on the PMC—AE index model, Int. J. Glob. Bus. Compet,17 (Suppl. S1), 1–11. [Google Scholar]
  • 42.Hu T., Pang X., et al. (2021). Movable oil content evaluation of lacustrine organic-rich shales: Methods and a novel quantitative evaluation model, Earth-Science Reviews, 214. [Google Scholar]
  • 43.Zhang Y. A. & Qie H. T. (2017). Quantitative Evaluation Innovation Policies of the State Council—Based on the PMC-Index Model, Sci. Technol. Prog, 17. [Google Scholar]
  • 44.Chen Y. (2019). Application of social network analysis method in intelligence analysis, Journal of Information Science, 01, 21–28. [Google Scholar]
  • 45.Estrada M. A. R. (2011). Policy modeling: Definition, classification and evaluation, Journal of Policy Modeling, 33(4), 523–536. [Google Scholar]
  • 46.Estrada M. R., Yap S.F., et al. (2010). Beyond the Ceteris Paribus Assumption: Modeling Demand and Supply Assuming Omnia Mobili, Social Science Electronic Publishing: Rochester, NY, USA. [Google Scholar]
  • 47.Yang Y., Tang J., Li Z., & Wen J. (2022). How effective is the health promotion policy in Sichuan, China: based on the PMC-Index model and field evaluation. BMC Public Health, 22(1), 2391. doi: 10.1186/s12889-022-14860-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Song Y. P. (2021). Quantitative evaluation and optimization of policy content of first-class undergraduate education in colleges and universities-an analysis based on PMC index model, Research on Education Development, 9, 12–20+36. (in Chinese) [Google Scholar]
  • 49.Du H. H & Zhou H. (2023). Quantitative Evaluation and Optimization of China’s Government Open Data Policy ‐ An Analysis Based on PMC Index Model, Library Construction, 3, 70–81. (in Chinese) [Google Scholar]

Decision Letter 0

Pengpeng Ye

11 Jun 2024

PONE-D-24-19514Assess the efficacy of China’s Inter-provincial Government Services Policy: A Quantitative Evaluation Based on PMC-Index ModelPLOS ONE

Dear Dr. Wu,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 26 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Pengpeng Ye

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 

2. Thank you for stating in your Funding Statement: 

"This work was supported by National Social Science Foundation of China (No. 23CSH057),Hebei Natural Science Foundation (No. G2023203015).The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now.  Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement. 

Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf.

3. Please provide a complete Data Availability Statement in the submission form, ensuring you include all necessary access information or a reason for why you are unable to make your data freely accessible. If your research concerns only data provided within your submission, please write "All data are in the manuscript and/or supporting information files" as your Data Availability Statement.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: ABSTRACT

The abstract effectively introduces a study evaluating China's Inter-provincial Government Services Policy using a quantitative approach based on the PMC model. It succinctly presents the findings regarding policy design, consistency, and identified weaknesses, along with proposed optimization recommendations. However, it could benefit from clearer language and organization to enhance readability and impact.For instance, the author could consider restructuring the abstract to begin with a concise statement of the research aim or problem addressed by the Inter-provincial Government Services Policy. Then, provide a brief overview of the methodology employed, followed by a clear presentation of the key findings and their implications. Additionally, using simpler language and avoiding jargon can improve accessibility for readers unfamiliar with the PMC model or policy evaluation terminology.

INTRODUCTION

The introduction could benefit from clearer organization and language to improve readability. For instance, dividing the introduction into subsections such as Background, Significance of the Policy, Research Objective, and Highlights of the Paper would provide clearer structure. Using more concise language to convey key points would enhance readability and make the introduction more engaging.

LITERATURE REVIEW

The literature review provides a comprehensive overview of existing research on the Inter-provincial Government Services Policy and policy evaluation methods. To enhance clarity and readability, consider implementing the following suggestions:

a) The author can introduce clear subheadings for each subsection of the literature review to help readers navigate through different topics more easily. For example, the author could use subheadings like "Perspectives on Inter-provincial Government Services Policy" and "Methods of Policy Evaluation."

Recommendation:

Perspectives on Inter-provincial Government Services Policy

Collaborative Governance

Digital Transformation

Holistic Theoretical Approaches

b) The author needs to ensure that the language used is clear and accessible to readers from diverse backgrounds. Avoid overly technical terms or jargon unless it necessary.Recommendation:

Instead of: "The endogenous endowment of 'public-technical governance-overlapping action' of cross-domain governance of government services is refined by some scholars, who put forward three practice modes of cross-domain governance of government services: vertically embedded, internally originated hair style, and governance of government and society (enterprise), and constructed the development path of cross-domain governance of government services in the four dimensions of strategy, supply and demand, technology, and ecology development path."

Use: "Scholars refine the concept of 'public-technical governance-overlapping action' and propose three practice modes for cross-domain governance of government services: vertically embedded, internally originated, and governance of government and society."

RESEARCH DESIGN

a)The section lacks clear subheadings to delineate different aspects of the research design. Adding subsection headings such as "Research Sample and Methodology," "Policy Feature Recognition," "Construction of PMC Index Model," and "PMC Surface Drawing" would enhance readability and organization. Recommendation:

Before: "3.1 Research Sample and Methodology"

After: "3.1 Research Sample and Methodology: Selection Criteria and Data Collection"

b) The text contains lengthy explanations and repetitive phrases, which could be streamlined for brevity. For instance, instead of repeating phrases like "the high frequency of terms such as," the author could use more concise language to convey the same meaning.Recommendation:

Before: "From the perspective of policy guarantee mechanism, terms such as 'integration, management, acceptance, lead, docking coordination, support, guidance, coordination, supervision, and reliance' appear more frequently, indicating that accelerating the construction of Inter-provincial Government Services requires a variety of ways of coordination..."

After: "Policy guarantee mechanisms, including integration, management, acceptance, and coordination, are crucial for accelerating the construction of Inter-provincial Government Services."

c) The author needs to ensure smooth transition sentences between paragraphs can improve the flow of ideas. Connecting sentences that link each step of the research design process would provide readers with a clearer understanding of the methodology's progression. Recommendation:

Before: "3.2 Policy Feature Recognition. On the basis of obtaining the policy text..."

After: "3.2 Policy Feature Recognition: Following the acquisition of policy texts, the next step involves..."

d)Some sentences may be difficult for readers to comprehend. Simplifying complex phrases and using straightforward language would enhance clarity. Recommendation:

Before: "The visualization results show that keywords 'government', 'services', 'departments', 'sharing' and 'platforms' have a high centrality."

After: "The visualization results indicate that certain keywords, such as 'government' and 'services', hold significant centrality within the semantic network."

e) While the text references tables and figures, it would be beneficial to integrate them more seamlessly into the narrative. Directly referring to specific figures in the text and explaining their relevance to the discussion would enhance understanding.Recommendation:

Before: "The PMC surface figure is a symmetric surface based on the values of nine first-level indexes, which can show the pros and disadvantages of various policies, so as to better evaluate Inter-provincial Government Services policies formulated by the Chinese government."

After: "The PMC surface figure (Figure 1) displays a symmetric surface representing the values of nine first-level indexes, providing insights into the strengths and weaknesses of Inter-provincial Government Services policies."

RESULT AND COMPARATION ANALYSIS

a)The section title "Results and Comparative Analysis" could be clearer if it explicitly mentions what is being analyzed. Also, consider breaking down the content into smaller subsections for easier navigation and comprehension. Recommendation:

Before: "4. Results and Comparation analysis"

After: "4. Evaluation and Comparative Analysis of Inter-provincial Government Services Policies"

b) Some sentences contain redundant phrases or repetitive information. Try to convey the same meaning with fewer words to improve readability and efficiency. Recommendation:

Before: "From the calculation results of the PMC index of the 28 policies (see Table 6), the PMC index scores range from [6.45 to 8.62], with a mean value of 7.71, and 15, 16, and 19 are acceptable levels, while the rest of the policies are excellent levels, and there are no bad and perfect policies. perfect level policies."

After: "The PMC index scores of the 28 policies ranged from 6.45 to 8.62, with a mean value of 7.71. Notably, policies 15, 16, and 19 attained acceptable levels, while the others achieved excellence."

c)The author need to introduce smoother transitions between subsections to improve the flow of the analysis. Clear transitions help guide the reader through the logical progression of ideas. Recommendation:

Before: "4.2.1 Characterization of overall policies"

After: "4.2.1 Overview of Policies: Analyzing Overall Characteristics"

d) The author needs to simplify complex sentences and technical language to ensure clarity and accessibility for all readers. Recommendation:

Before: "Comparing the scores of each level of policy variables with the mean value, it is found that..."

After: "Upon comparing the scores of each policy variable with the mean value, it becomes evident that..."

e) The author needs to ensure that references to figures are clear and seamlessly integrated into the text. Figures should complement the analysis and be introduced in a way that enhances understanding.Recommendation:

Before: "In order to visualize the results of PMC index calculation, the first-level index scores of each policy can be transformed into a third-order matrix as shown in Eq.(5), and then the internal consistency level of each policy can be analyzed by observing the concavity and convexity of the surface."

After: "To visually represent the PMC index calculation results, we transform the first-level index scores of each policy into a third-order matrix (Eq. 5), facilitating analysis of each policy's internal consistency level through surface concavity and convexity."

CONCLUSION

The author needs to:

(a) Divide the conclusion into smaller paragraphs focusing on specific aspects, such as findings, recommendations, and future research directions.

(b) Ensure consistent use of terminology, such as "Inter-provincial Government Services Policy," throughout the conclusion.

(c) Refer to relevant figures, such as the PMC index calculation results, to support statements about policy effectiveness or areas for improvement.

Reviewer #2: 1. In the literature review, the contents of Section 2.1 are not strongly related to its title, Research on Inter-provincial Government Services Policy. The authors mainly illustrate collaborative governance, digital transformation, and holistic governance, with limited research reviews on Inter-provincial Government Services Policy.

2. What is the significance of the keyword network analysis in Section 3.2? How does it contribute to the construction of the PMC index model? Please make the rationale clearer.

3. In Section 3.3.4, PMC Surface Drawing, the text mentions three figures (Figures 2-4), but only Figure 2 is seen at the end of the paper. Please confirm whether the uploaded images are correct.

4. In the conclusion section, the author states that the main body of policy formulation is the government, and that experts, think tanks, and research institutions are not involved in policy formulation. How was this conclusion reached? How did the author obtain information on the composition of policy participants from text analysis and the PMC index model?

5. The article lacks discussions on the limitations.

6. The study uses the PMC index model to evaluate China’s Inter-provincial Government Service Policy, but the theoretical contribution and practical significance of the study are not well embodied.

Reviewer #3: This paper applies the PMC Index Model to quantitatively assess inter-provincial government services policies in China to explore the effectiveness of policy implementation, which indeed is a beneficial research direction. The literature review is clearly structured, advances critical analysis of existing research, and achieves positive results in its conclusions.

The introduction directly presents the research question and clearly lists the contributions of the study. However, I believe that the choice of research methods should be briefly described at the beginning, highlighting the systematic, holistic, and predictive features and advantages of the policy text evaluation method to smoothly transition into the subsequent research.

The paper's conclusions focus on proposing policy optimizations, which need to be more grounded in the research data and results. I perceive some issues with parts of the conclusions where the derivations from the data and data analysis seem less validating than verifying, and the depth of the conclusions appears somewhat lacking. I recommend that the author:

Precisely align the logic connection between data analysis results and conclusions.

Strengthen causal inferences to ensure all conclusions and recommendations are directly based on data analysis results.

The manuscript is clearly written and meets the norms of English academic writing, but there are still some inaccuracies in grammar and word choice that might affect reader comprehension. Further polishing of the language is needed to meet the standards of academic publication.

Overall, the article is suitable for publication in a journal.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: FARAH ADILLA AB RAHMAN

Reviewer #2: No

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Dec 12;19(12):e0310491. doi: 10.1371/journal.pone.0310491.r002

Author response to Decision Letter 0


25 Jul 2024

Dear editors and reviewers:

We thank you very much for your helpful and insightful comments and suggestions on our manuscript entitled “Assess the efficacy of China’s Inter-provincial Government Services Policy: A Quantitative Evaluation Based on PMC-Index Model” .These comments and suggestions are very helpful for improving our paper. We studied them carefully and made some revisions according to the comments and suggestions of the associate editor and the reviewers. The main changes in the paper are marked in red color and the responses to the comments are as follows.

Reviewer #1: ABSTRACT

The abstract effectively introduces a study evaluating China's Inter-provincial Government Services Policy using a quantitative approach based on the PMC model. It succinctly presents the findings regarding policy design, consistency, and identified weaknesses, along with proposed optimization recommendations. However, it could benefit from clearer language and organization to enhance readability and impact. For instance, the author could consider restructuring the abstract to begin with a concise statement of the research aim or problem addressed by the Inter-provincial Government Services Policy. Then, provide a brief overview of the methodology employed, followed by a clear presentation of the key findings and their implications. Additionally, using simpler language and avoiding jargon can improve accessibility for readers unfamiliar with the PMC model or policy evaluation terminology.

Response: We are very grateful to the reviewer for the positive comments. Based on the reviewers' suggestions, this paper has restructured the abstract. First, the author added a concise statement of the research aim at the beginning. Next, the author provided a brief overview of the methodology employed, followed by a clear presentation of the key findings and implications. At the same time, we have revised the paper in more concise language according to your request. All changes are shown in red. (See Abstract, Page 1).

INTRODUCTION

The introduction could benefit from clearer organization and language to improve readability. For instance, dividing the introduction into subsections such as Background, Significance of the Policy, Research Objective, and Highlights of the Paper would provide clearer structure. Using more concise language to convey key points would enhance readability and make the introduction more engaging.

Response: Thank you for your comments. Based on your suggestions, we have rearranged the introduction into background, policy implications, research objectives, and highlights. All changes are reflected in red. (See Introduction, Page 1-Page 3).

LITERATURE REVIEW

The literature review provides a comprehensive overview of existing research on the Inter-provincial Government Services Policy and policy evaluation methods. To enhance clarity and readability, consider implementing the following suggestions:

a) The author can introduce clear subheadings for each subsection of the literature review to help readers navigate through different topics more easily. For example, the author could use subheadings like "Perspectives on Inter-provincial Government Services Policy" and "Methods of Policy Evaluation."

Recommendation:

Perspectives on Inter-provincial Government Services Policy

Collaborative Governance

Digital Transformation

Holistic Theoretical Approaches

b) The author needs to ensure that the language used is clear and accessible to readers from diverse backgrounds. Avoid overly technical terms or jargon unless it necessary. Recommendation:

Instead of: "The endogenous endowment of 'public-technical governance-overlapping action' of cross-domain governance of government services is refined by some scholars, who put forward three practice modes of cross-domain governance of government services: vertically embedded, internally originated hair style, and governance of government and society (enterprise), and constructed the development path of cross-domain governance of government services in the four dimensions of strategy, supply and demand, technology, and ecology development path."

Use: "Scholars refine the concept of 'public-technical governance-overlapping action' and propose three practice modes for cross-domain governance of government services: vertically embedded, internally originated, and governance of government and society."

Response: We really appreciate the valuable advice. Firstly, we have added subheadings for the first subsection of the literature review. Secondly, we have trimmed and modified some of the statements to make them easier for readers of different backgrounds to understand. And the content is marked in red color. (See Section 2.1, Page 3- Page 4)

RESEARCH DESIGN

a)The section lacks clear subheadings to delineate different aspects of the research design. Adding subsection headings such as "Research Sample and Methodology," "Policy Feature Recognition," "Construction of PMC Index Model," and "PMC Surface Drawing" would enhance readability and organization. Recommendation:

Before: "3.1 Research Sample and Methodology"

After: "3.1 Research Sample and Methodology: Selection Criteria and Data Collection"

b) The text contains lengthy explanations and repetitive phrases, which could be streamlined for brevity. For instance, instead of repeating phrases like "the high frequency of terms such as," the author could use more concise language to convey the same meaning. Recommendation:

Before: "From the perspective of policy guarantee mechanism, terms such as 'integration, management, acceptance, lead, docking coordination, support, guidance, coordination, supervision, and reliance' appear more frequently, indicating that accelerating the construction of Inter-provincial Government Services requires a variety of ways of coordination..."

After: "Policy guarantee mechanisms, including integration, management, acceptance, and coordination, are crucial for accelerating the construction of Inter-provincial Government Services."

c) The author needs to ensure smooth transition sentences between paragraphs can improve the flow of ideas. Connecting sentences that link each step of the research design process would provide readers with a clearer understanding of the methodology's progression. Recommendation:

Before: "3.2 Policy Feature Recognition. On the basis of obtaining the policy text..."

After: "3.2 Policy Feature Recognition: Following the acquisition of policy texts, the next step involves..."

d) Some sentences may be difficult for readers to comprehend. Simplifying complex phrases and using straightforward language would enhance clarity. Recommendation:

Before: "The visualization results show that keywords 'government', 'services', 'departments', 'sharing' and 'platforms' have a high centrality."

After: "The visualization results indicate that certain keywords, such as 'government' and 'services', hold significant centrality within the semantic network."

e) While the text references tables and figures, it would be beneficial to integrate them more seamlessly into the narrative. Directly referring to specific figures in the text and explaining their relevance to the discussion would enhance understanding. Recommendation:

Before: "The PMC surface figure is a symmetric surface based on the values of nine first-level indexes, which can show the pros and disadvantages of various policies, so as to better evaluate Inter-provincial Government Services policies formulated by the Chinese government."

After: "The PMC surface figure (Figure 1) displays a symmetric surface representing the values of nine first-level indexes, providing insights into the strengths and weaknesses of Inter-provincial Government Services policies."

Response: Thanks for the valuable suggestions. We have made changes to the corresponding sections according to your request, as follows: First, we modified the subheadings utilized in the research design section to make it clearer what follows.(See Section 3.1 and 3.2, Page 5 and Page 7).Second, we have deleted lengthy explanations and repetitive phrases, and replaced them with more concise expressions (See Section 3.2, Page 7).Next, in section 3.1 and 3.2, we have added transitional sentences between paragraphs to make the process of research design clearer to the readers (See Section 3.1 and Section 3.2,Page 5 and Page 7).Additionally, we've simplified complex phrases and used straightforward language for greater clarity (See Section 3.2,Page 9). Finally, we make direct references to specific charts in the text and explain their relevance to the discussion, allowing the table to fit more seamlessly into the narrative (See Section 3.3.4, Page 12). Specific changes can be found in red in the paper.

RESULT AND COMPARATION ANALYSIS

a)The section title "Results and Comparative Analysis" could be clearer if it explicitly mentions what is being analyzed. Also, consider breaking down the content into smaller subsections for easier navigation and comprehension. Recommendation:

Before: "4. Results and Comparation analysis"

After: "4. Evaluation and Comparative Analysis of Inter-provincial Government Services Policies"

b) Some sentences contain redundant phrases or repetitive information. Try to convey the same meaning with fewer words to improve readability and efficiency. Recommendation:

Before: "From the calculation results of the PMC index of the 28 policies (see Table 6), the PMC index scores range from [6.45 to 8.62], with a mean value of 7.71, and 15, 16, and 19 are acceptable levels, while the rest of the policies are excellent levels, and there are no bad and perfect policies. perfect level policies."

After: "The PMC index scores of the 28 policies ranged from 6.45 to 8.62, with a mean value of 7.71. Notably, policies 15, 16, and 19 attained acceptable levels, while the others achieved excellence."

c)The author need to introduce smoother transitions between subsections to improve the flow of the analysis. Clear transitions help guide the reader through the logical progression of ideas. Recommendation:

Before: "4.2.1 Characterization of overall policies"

After: "4.2.1 Overview of Policies: Analyzing Overall Characteristics"

d) The author needs to simplify complex sentences and technical language to ensure clarity and accessibility for all readers. Recommendation:

Before: "Comparing the scores of each level of policy variables with the mean value, it is found that..."

After: "Upon comparing the scores of each policy variable with the mean value, it becomes evident that..."

e) The author needs to ensure that references to figures are clear and seamlessly integrated into the text. Figures should complement the analysis and be introduced in a way that enhances understanding. Recommendation:

Before: "In order to visualize the results of PMC index calculation, the first-level index scores of each policy can be transformed into a third-order matrix as shown in Eq.(5), and then the internal consistency level of each policy can be analyzed by observing the concavity and convexity of the surface."

After: "To visually represent the PMC index calculation results, we transform the first-level index scores of each policy into a third-order matrix (Eq.5), facilitating analysis of each policy's internal consistency level through surface concavity and convexity."

Response: Thanks for these helpful suggestions. We've made changes to the content in line with the detailed suggestions you have given. First, we revised the title of Section 4 and subdivided the content of the title of 4.2.1 into smaller subsections so that it clearly mentions what is being analyzed.(See Section 4 and Section 4.2.1,Page 12 and Page 14).Second, we eliminated sentences containing redundant phrases or repetitive information to convey the same meaning in fewer words.(See Section 4.2.1 and Section 4.3.1,Page 14 and Page 15).After that, we revised the title of 4.2.1 to allow for smoother transitions between subsections so that the reader understands the logical progression of ideas.(See Section 4.2.1,Page 14). Then, we simplified complex sentences and technical language to ensure clarity and accessibility for all readers (See Section 4.3.1, Page 15).Finally, We modified the expression of the sentences to ensure that references to figures are clear and seamlessly integrated into the text.(See Section 4.2.2, Page 14).All changes are highlighted in red.

CONCLUSION

The author needs to:

(a) Divide the conclusion into smaller paragraphs focusing on specific aspects, such as findings, recommendations, and future research directions.

(b) Ensure consistent use of terminology, such as "Inter-provincial Government Services Policy," throughout the conclusion.

(c) Refer to relevant figures, such as the PMC index calculation results, to support statements about policy effectiveness or areas for improvement.

Response: Thanks for the valuable suggestion. (a) We have revised the conclusion of the paper according to your requirements, and marked the corresponding revisions in red, which part of the article is specified. (b) We have modified some expressions to ensure that terminology is used consistently throughout the conclusions. (c) In the conclusion, we cite figures to support statements about the effectiveness of the policy or areas for improvement. (See Section 5.1, Page 18-Page 20).The changes have been highlighted in red.

Reviewer #2: 1. In the literature review, the contents of Section 2.1 are not strongly related to its title, Research on Inter-provincial Government Services Policy. The authors mainly illustrate collaborative governance, digital transformation, and holistic governance, with limited research reviews on Inter-provincial Government Services Policy.

Response: We greatly appreciate that the reviewer has pointed this out. We have added a synthesis of some studies on Inter-provincial Government Services Policy and made appropriate changes and adjustments to the content.(See Section 2,Page 3-Page 4).

2. What is the significance of the keyword network analysis in Section 3.2? How does it contribute to the construction of the PMC index model? Please make the rationale clearer.

Response: According to the reviewer’s suggestion, we added the significance of keyword network analysis and showed how it can help in constructing PMC index models. (See section 3.2,Page 9).

3. In Section 3.3.4, PMC Surface Drawing, the text mentions three figures (Figures 2-4), but only Figure 2 is seen at the end of the paper. Please confirm whether the uploaded images are correct.

Response: Please forgive us for leaving out two pictures. We have added two figures to the document.(See Figure 2 and Figure 3).

4.In the conclusion section, the author states that the main body of policy formulation is the government, and that experts, think tanks, and research institutions are not involved in policy formulation. How was this conclusion reached? How did the author obtain information on the composition of policy participants from text analysis and the PMC index model?

Response: Thanks for pointing out the issues. We are very sorry not to explain how the conclusions were reached, but in fact we have come to the composition of policy actors through statistical analysis, i.e., the main body of policy-making is the government, experts, think tanks and research institutions. Among them, experts, think tanks and research institutions are less involved in policy- making. To avoid ambiguity, we have removed the corresponding elements from the conclusions and reorganized them to make them more revealing.(See Section 5.1,Page 19).

5.The article lacks discussions on the limitations.

Response: Thanks for the valuable suggestion. We add a discussion of limitations at the end of the article.(See Section 5.2,Page 20).

6. The study uses the PMC index model to evaluate China’s Inter-provincial Government Service Policy, but the theoretical contribution and practical significance of the study are not well embodied.

Response: Thank you for your constructive comments. We apologize for not clarifying the theoretical contribution and practical implications of this article. We have rearranged the article, and the theoretical contributions and practical sign

Attachment

Submitted filename: detailed response to reviewers.docx

pone.0310491.s002.docx (24KB, docx)

Decision Letter 1

Pengpeng Ye

2 Sep 2024

Assess the efficacy of China’s Inter-provincial Government Services Policy: A Quantitative Evaluation Based on PMC-Index Model

PONE-D-24-19514R1

Dear Dr. Wu,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Pengpeng Ye

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #3: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #3: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear Dr. Jian Wu,

I want to extend my sincere appreciation for the thoughtful revisions you've made based on my earlier suggestions. The restructuring of the abstract, particularly the addition of a concise statement of the research aim, has significantly improved the clarity and impact of your study. Additionally, the reorganization of the introduction and literature review, along with the enhancements in language simplicity, have greatly contributed to the readability of your work.

Your attention to detail, such as integrating subheadings in the research design and simplifying complex phrases, has made the methodology and findings more accessible to a broader audience. The adjustments in the results and comparative analysis sections, including the refined transitions and references to figures, have also strengthened the overall flow and coherence of your paper.

It has been a pleasure to review your work, and I am confident that these changes will greatly benefit your readers. I wish you all the best in your future research endeavors and look forward to seeing your continued contributions to the field.

Best regards,

Dr. Farah Adilla Ab Rahman

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Dr. Farah Adilla Ab Rahman

Reviewer #3: No

**********

Acceptance letter

Pengpeng Ye

13 Sep 2024

PONE-D-24-19514R1

PLOS ONE

Dear Dr. Wu,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Pengpeng Ye

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (DOCX)

    pone.0310491.s001.docx (17.9KB, docx)
    Attachment

    Submitted filename: detailed response to reviewers.docx

    pone.0310491.s002.docx (24KB, docx)

    Data Availability Statement

    All the data are based on the texts of 28 Inter-provincial Government Services policies issued by China from 2020 to 2023. These policy documents were downloaded by the authors from Chinese local government websites. And it is shown in file called "supporting information".


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES