Skip to main content
Frontiers in Big Data logoLink to Frontiers in Big Data
. 2026 Sep 24;9:1921037. doi: 10.3389/fdata.2026.1921037

Machine-assisted adaptive feedback consensus method for large-scale group decision making based on reinforcement learning

Hongyu Yu 1, Xuanhua Xu 1,2,*, Weiwei Zhang 1
PMCID: PMC13645702  PMID: 42851366

Abstract

Introduction

Traditional consensus-reaching processes in large-scale group decision making (LSGDM) rely heavily on empirically determined feedback parameters and have difficulty balancing consensus efficiency with the preservation of expert opinions. To address this problem, this paper proposes a reinforcement learning-based machine-assisted adaptive feedback consensus method.

Methods

First, a hesitation degree is introduced to improve the score function of hesitant fuzzy linguistic term sets (HFLTSs), thereby reducing information loss during linguistic information transformation. Second, a comprehensive relationship matrix integrating preference similarity and social trust relationships is constructed, and K-Means clustering is employed to divide large-scale expert groups. On this basis, the consensus-reaching process is modeled as a Markov decision process (MDP), and the LSGDM consensus-reaching process is modeled as a dynamic sequential decision problem. A deep deterministic policy gradient (DDPG) agent is utilized to learn feedback adjustment strategies, enabling feedback parameters to be dynamically adjusted according to the evolution state of group opinions. Meanwhile, network text data and the TF-IDF method are combined to determine attribute weights and improve decision objectivity. Finally, an emergency decision-making case of the “Beijing-Tianjin-Hebei rainstorm” is conducted to verify the proposed method.

Results

The results show that the proposed method can achieve the preset consensus threshold within fewer discussion rounds while effectively balancing the group consensus level and expert opinion retention.

Discussion/Conclusion

These findings verify the effectiveness and feasibility of the proposed method, indicating that it can provide effective decision support for adaptive feedback consensus reaching in LSGDM emergency decision-making.

Keywords: adaptive feedback mechanism, consensus reaching, human-machine collaboration, large-scale group decision-making, reinforcement learning

1. Introduction

In recent years, the frequent occurrence of sudden public emergencies, such as typhoons and extreme rainfall events, has posed severe challenges to social property and human safety. In such highly complex and rapidly changing scenarios, any hesitation or misjudgment during the decision-making process may lead to serious consequences. Therefore, coordinating multiple stakeholders, integrating collective intelligence, and implementing scientific and accurate emergency decision-making are of great importance (Xu and Zhou, 2024; Yin et al., 2025). In particular, the Chinese government has repeatedly emphasized the principles of “people-oriented development” and “prioritizing people's lives and safety,” while continuously improving emergency warning and response mechanisms, which places higher requirements on modern emergency management systems.

With the increasing complexity of real-world decision-making environments, Multiple Attribute Decision Making (MADM) methods have been widely applied in various fields, including risk management, resource allocation, investment evaluation, and sustainable development. In complex decision scenarios, decision makers are usually required to consider multiple evaluation criteria, uncertain information, and diverse stakeholder preferences. Therefore, effectively integrating multi-source information and supporting scientific decision-making have become important research issues. For example, in the field of natural disaster risk management, fuzzy multi-criteria decision-making approaches can effectively handle uncertainty in risk assessment and provide decision support for disaster prevention and emergency resource allocation (Alam et al., 2024). Moreover, in sustainable investment and emerging technology evaluation, the combination of artificial intelligence and fuzzy decision-making methods can comprehensively consider economic, technological, and environmental factors, thereby improving the analysis capability of complex decision problems (Yüksel et al., 2025).

However, as the scale of decision-making tasks continues to expand, traditional small-group decision-making approaches that rely on a limited number of decision makers are no longer sufficient to fully integrate complex and multi-source information. Particularly in major emergency response scenarios, the number of participating experts is usually large, and they often come from different professional backgrounds, resulting in significant differences in knowledge structures, risk perceptions, and value preferences (Xu et al., 2021; Xu and Zhu, 2023). Therefore, Large-Scale Group Decision Making (LSGDM), which can integrate diverse opinions and improve decision-making robustness, has gradually become an important approach for addressing complex emergency decision problems. Nevertheless, how to coordinate conflicts among experts and achieve effective consensus while ensuring decision-making efficiency remains a critical challenge in both theoretical research and practical applications.

In the process of large-scale group decision-making (LSGDM), when a consensus has not been reached among the group members, the opinions of the subgroups obtained through clustering are iteratively evolved until the consensus threshold is satisfied. This iterative procedure is referred to as the Consensus Reaching Process (CRP; Wan et al., 2020; Herrera et al., 2001). As the core component of LSGDM, the efficiency and quality of CRP directly determine the success or failure of emergency responses. A review of the existing literature reveals that early approaches—such as the two-stage consensus method (Gao et al., 2022; Zhang et al., 2023; Li et al., 2021), the minimum-cost consensus method (Lu et al., 2024; Ji et al., 2022; Zhang et al., 2018), and trust-based consensus methods (Zhang et al., 2021; Yu et al., 2021; Zhang et al., 2022)—have established a relatively comprehensive theoretical foundation. With the growing recognition of the complexity inherent in expert behaviors, research perspectives have progressively shifted from static rule-based mechanisms toward dynamic adaptive frameworks. For instance, Shang et al. (2023) employed similarity-driven Louvain dynamic clustering in an intuitionistic fuzzy environment to capture the structural evolution of subgroups induced by experts' compromise behaviors, and designed a two-stage switching strategy characterized by “low-consensus interaction and high-consensus automation” to balance decision efficiency and acceptability, while simultaneously incorporating intra-subgroup negotiation and an “exit-delegation” mechanism to manage non-cooperative behaviors. Concurrently, artificial intelligence techniques have begun to demonstrate promising potential in the field of decision-making. Wang et al., drawing upon cognitive psychology, confirmed that decision-makers' prior beliefs and task-specific knowledge significantly constrain the effectiveness of human-machine collaboration (Wang et al., 2026). Tan et al. (2026) coupled trust structures with preference information and employed the Deep Q-Network (DQN) algorithm to achieve adaptive generation of consensus strategies. Hassani et al. (2023) adopted a Dual-Agent Deep Deterministic Policy Gradient (DDPG) framework to optimize feedback parameters and weight allocation in a coordinated manner. (Tu et al. 2026) combined Multi-Agent Deep Q-Network (MADQN) with social network clustering, effectively reducing the number of iterations and enhancing robustness against non-cooperative behaviors. Shen et al. (2026) further accommodated both interactive and automated decision-making modes within a reinforcement learning paradigm. In addition, Yang and Wang (2026) approached the problem from a psychological behavior perspective, optimizing subgroup weight calculation using the Hamacher T-norm operator, thereby refining the modeling of experts' self-confidence levels and psychological disparities. However, existing reinforcement learning-assisted consensus methods mainly focus on parameter optimization issues, with less consideration given to the characteristics of dynamic opinion evolution within large-scale expert groups. Therefore, this paper does not aim to improve the DDPG algorithm structure, but rather explores how to embed deep reinforcement learning into the dynamic consensus feedback process, enabling the agent to generate adaptive feedback strategies based on real-time group states.

Based on the above analysis, to address the problem that traditional consensus-reaching processes have fixed feedback parameters and struggle to dynamically adapt to changes in group states, this paper proposes a reinforcement learning-based machine-assisted adaptive feedback consensus method for large-scale group decision making. The main contributions of this paper include: to tackle the issue that traditional HFLTS score functions are prone to misjudging equal values, hesitation degree information is introduced to improve the score function, thereby enhancing the expressiveness of uncertain linguistic information; a comprehensive relationship matrix is constructed by integrating expert preference similarity and social trust relationships, and K-Means clustering is employed to partition the large-scale expert group; the consensus-reaching process is modeled as a Markov decision process, and a DDPG agent is utilized to learn feedback adjustment strategies, enabling feedback parameters to be dynamically adjusted according to the evolution of group opinions, thus achieving adaptive optimization of the feedback regulation process; finally, attribute weights are obtained by combining network text data and the TF-IDF method, and a case study is conducted to verify the effectiveness of the proposed method. Motivated by the above analysis, this paper proposes an adaptive feedback consensus reaching method for human-machine collaborative LSGDM based on reinforcement learning, to address the issue that fixed feedback parameters in traditional CRP are incapable of dynamically adapting to the evolution of the group state. The main contributions of this paper are fourfold: (1) to ameliorate the problem that conventional HFLTS score functions are prone to misjudgment due to equivalent values, hesitation degree information is incorporated to refine the score function, thereby enhancing the expressive capacity for uncertain linguistic information; (2) a comprehensive relationship matrix is constructed by integrating expert preference similarity with social trust relations, upon which K-Means clustering is performed to realize the partition of large-scale experts into subgroups; (3) the CRP is modeled as a Markov Decision Process (MDP), and the DDPG algorithm is employed to dynamically generate continuous feedback parameters, thereby achieving adaptive optimization of the feedback adjustment process; and (4) attribute weights are derived from online textual data using the TF-IDF approach, and a case study is conducted to validate the effectiveness of the proposed method.

2. Materials and methods

2.1. Problem formulation

Consider a Large-Scale Group Decision-Making (LSGDM) problem, in which there exists a set of alternatives and a set of evaluation attributes C = {cj|j = 1, 2, …, N}, with the corresponding attribute weight vector denoted as w = {wj|j = 1, 2, …, N}. The decision-making large group consists of M experts, denoted as Ω = {ei|i = 1, 2, …, M; M≥20}. Each expert ei provides an initial preference matrix in the form of Hesitant Fuzzy Linguistic Term Sets (HFLTS), denoted as Hi={Hlji}P×N. The objective of this paper is to adaptively drive the feedback consensus reaching process through deep reinforcement learning, incorporate public social information to optimize the attribute weights, and ultimately output the optimal alternative.

2.2. Refined hesitant fuzzy linguistic score function

Linguistic terms have been widely employed in decision-making problems. However, as decision-making problems have become increasingly complex and dynamic, decision-makers tend to express their preferences using multiple linguistic terms or more sophisticated linguistic expressions. To handle such hesitant situations, Rodriguez et al. (2011) introduced the concept of Hesitant Fuzzy Linguistic Term Sets (HFLTS).

Definition 1 (Rodriguez et al., 2011): Let S = {s0, s1, …, sτ} be a linguistic term set (LTS) with granularity (τ+1), and let HS be a hesitant fuzzy linguistic term set (HFLTS), which is an ordered finite subset of consecutive linguistic terms of S:

HS={sδl|l=1,2,…,#HS;sδl∈S}

where #HS is the number of linguistic terms in HS.

Owing to the heterogeneity of decision-makers' knowledge backgrounds, decision-making perspectives, and personal preferences, their judgments on the same issue may differ considerably. Consequently, multi-granularity linguistic terms are commonly adopted for preference expression to ensure the relative accuracy of preference representation. For example, a linguistic term set with granularity 5, S5 = {very poor, poor, fair, good, very good}, and a set with granularity 3, S3 = {low, medium, high}.

Definition 2 (Xu et al., 2023): For an HS = {sδl|l = 1, 2, …, #HS}, the score function F(HS) is defined as follows:

F(HS)=δ¯-1#HS∑l=1#HS(δl-δ¯)var(τ)2 (1)

where δ¯=1#HS∑l=1#HSδl, and var(τ)=(0-τ/2)2+…+(τ-τ/2)2τ+1. The following decision rules apply: If F(HS1)>F(HS2), then HS1>HS2;If F(HS1)=F(HS2), then HS1=HS2.

To address the issue that traditional score functions are prone to misjudgment due to equivalent values under varying decision-making uncertainties—for instance, when a multi-element set and a single-element set yield identical scores—this paper introduces the hesitation degree HD(HS) to characterize the extent of experts' hesitation when articulating linguistic evaluations.

Definition 3 (Zhong et al., 2022): For an HFLTS HS = {sδl|l = 1, 2, …, #HS}, the hesitation degree is defined as follows:

HD(HS)=∑l=1#HS(γl-γ¯)2#HS (2)

where γl=lτ denotes the membership degree of the linguistic term in HS, τ is the maximum subscript of the adopted linguistic term set (LTS), γ¯=∑l=1#HSγl#HS is the mean of the membership degrees of the linguistic terms in HS, and #HS is the number of linguistic terms in HS.

In the environment of hesitant fuzzy linguistic term sets (HFLTS), experts may simultaneously provide multiple linguistic terms to express their degree of hesitation. This paper introduces a hesitation degree indicator to quantify the uncertainty embedded in linguistic evaluation sets. A higher value of this indicator indicates greater uncertainty in expert opinions, and consequently, a lower reliability of the evaluations. Compared with merely relying on linguistic evaluation values, incorporating hesitation information can more comprehensively capture the psychological uncertainty in experts' expression processes, thus being particularly suitable for large-scale group decision-making scenarios characterized by high complexity and uncertainty.

The selection of the hesitation degree indicator in this paper is mainly based on the following two considerations:

  • (1) It aligns with the essential characteristics of hesitant fuzzy linguistic expressions. In large-scale group decision making, due to differences in experts' knowledge backgrounds, risk preferences, and access to information, they often find it difficult to provide a single deterministic evaluation and tend to offer multiple possible linguistic values. The hesitation degree can effectively reflect this trait.

  • (2) It serves to depict the reliability of expert opinions. Traditional HFLTS methods primarily focus on the transformation of linguistic information but neglect the inherent uncertainty within the evaluations. Introducing the hesitation degree indicator can simultaneously reflect the degree of certainty, information reliability, and preference stability in expert opinions, thereby providing an important basis for further improving the rationality of expert weight calculation.

Accordingly, the refined score function is constructed as follows:

ρ(HS)=(1-HD(HS))×F(HS) (3)

For expert ei, the preference matrix is denoted as Hi={Hlji}P×N, where each element Hlji represents the evaluation value of expert ei in the form of a hesitant fuzzy linguistic term set with respect to alternative xl and attribute cj. First, Equation 3 is applied to obtain ρ(Hlji). Then, Equation 4 is employed to normalize the resulting values vlji into the interval [0, 1], yielding the final numerical preference matrix Vi={vlji}P×N for expert ei:

vlji=ρ(Hlji)τ (4)

It should be noted that the constant 6 used in the above normalization process originates from the seven-granularity linguistic evaluation set defined in this paper as S = {s0, s1, s2, s3, s4, s5, s6}, where the maximum subscript of the linguistic terms is 6. This parameter is not an empirically determined threshold, but is determined by the scale of the linguistic evaluation system. When the granularity of the linguistic term set changes, the normalization constant should be adjusted accordingly to the maximum subscript of the linguistic set. For example, if a five-granularity linguistic term set S = {s0, s1, s2, s3, s4} is adopted, the normalization constant should be adjusted to 4. This design ensures the generality and consistency of the score function across different linguistic evaluation systems.

Definition 4: Inspired by the concept of Hamming distance (Zhang et al., 2017), for experts ei and eh with preference matrices Hi={Hlji}P×N and Hh={Hljh}P×N, respectively, the distance between Hlji and Hljh is computed by first converting them into numerical preferences vlji and vljh using Equation 4, and then calculating the distance as follows:

d(Hlji,Hljh)=|vlji-vljh| (5)

2.3. Social network analysis

In the field of decision-making, decision experts are not isolated individuals and are inevitably influenced by others. Therefore, under complex and dynamic decision-making environments, it is necessary to conduct Social Network Analysis (SNA) of experts.

Social networks can be represented in three forms: network graphs, adjacency matrices, and algebraic expressions (Xu and Zhang, 2020), as illustrated below:

Network graph: The relationship between two experts can be represented by an edge connecting the corresponding vertices in the graph.

Social relation matrix: Each element SThi in the social relation matrix Tr = [SThi]M×M represents the trust value assigned by expert eh to expert ei.

Algebraic expression: An expression such as ehRei can denote the trust relationship between decision-makers.

Definition 5 (Xu and Zhang, 2020): Let the normalized in-degree and normalized out-degree of expert ei in the social network be denoted as INDi and OUTDi, respectively, which are computed as follows:

INDi=INiL (6)
OUTDi=OUTiL (7)

where INi and OUTi denote the number of directed edges with expert ei as the destination and source, respectively, and L is the total number of edges in the social network graph.

3. Methodology fundamentals

3.1. Expert clustering by integrating preferences and trust relations

Many existing studies cluster large-scale experts based solely on either preference information or trust relations. However, a scenario may arise in which two experts share a high level of mutual trust yet hold divergent preferences. To mitigate the clustering distortion caused by such preference divergence in the presence of high trust, this paper fuses preference similarity and trust values to construct a comprehensive relationship.

Definition 6: For experts ei and eh, their preference expressions in the form of HFLTS with respect to alternative xl and attribute cj are denoted asHljh and Hlji, respectively. The similarity between them with respect to alternative xl and attribute cj is computed as follows:

smhilj=1-d(Hlji,Hljh)=1-|vlji-vljh| (8)

The overall opinion similarity between experts ei and eh is computed as follows:

SDhi=1P×N∑l=1P∑j=1N(1-|vlji-vljh|) (9)

The preference similarity and trust value between experts eh and ei are denoted as SDhi and SThj, respectively. The former can be obtained using Equation 9, while the latter is derived from the trust relation matrix. On this basis, the new comprehensive relationship between experts ei and eh is computed as follows:

SNhi=α×SThi+(1-α)×SDhi (10)

where α ∈ [0, 1] is a balance coefficient [set to α = 0.5 in this paper following (Lu et al., 2024)]. Based on the SN matrix, the K-Means clustering method (Lu et al., 2021) is employed to partition the large-scale experts into K clusters, denoted as Ω* = {C1, C2, …, Ck}, where the number of experts in cluster CK is denoted as nk.

In large-scale group decision making, clustering based solely on preference similarity may lead to the neglect of long-term trust relationships among experts, failing to reflect social influence factors; while relying solely on social trust relationships may overlook the actual differences in expert opinions. Therefore, this paper integrates preference similarity and social trust relationships, enabling the simultaneous characterization of both the proximity of expert opinions and the degree of influence among expert relationships. Regarding the choice of the fusion coefficient θ, a sensitivity analysis is conducted in this paper (see Section 5.2 for details), testing the clustering performance under different values of θ = 0.3, 0.5, 0.7. The results show that when θ = 0.5, the two types of information are assigned equal importance, yielding the highest silhouette coefficient and the best clustering performance. Therefore, this paper adopts θ = 0.5 as the default value. In addition, the K-Means clustering method is employed, and the optimal number of subgroups is determined by the silhouette coefficient to ensure the rationality of the clustering results.

3.2. Determination of cluster and expert weights

3.2.1. Determination of cluster weights

We introduce the Hamacher t-norm operator (Urena et al., 2019), defined as (a,b)=a+b-2ab1-ab, to fuse the scale weight λk and the credibility weight Tλk for computing the normalized comprehensive weight uk of cluster CK:

λk=nkM,Tλk=∑i=1,ei∈CknkTDi∑k=1K∑i=1,ei∈CknkTDi (11)
uk=φ(λk,Tλk)∑k=1Kφ(λk,Tλk) (12)

3.2.2. Determination of expert weights

In a social network, experts who interact more frequently or trust each other more deeply are assigned greater weights. The former can be measured by the normalized in-degree and normalized out-degree, while the latter can be quantified by the credibility degree. By integrating the network topology degree and the credibility degree, the topological weight ω~i and the final normalized weight ωi of expert ei are computed as follows:

ω~i=INDi+OUTDi∑i=1M(INDi+OUTDi) (13)
ωi=φ(ωi,TDi)∑i=1Mφ(ωi,TDi) (14)

3.3. Consensus measurement

Consensus reaching plays a pivotal role in large-scale group decision-making. Once the group consensus level attains the consensus threshold γ, the process can proceed to the alternative selection stage. Otherwise, feedback adjustment is required until the consensus threshold is satisfied, after which the alternative selection process is conducted.

3.3.1. Consensus calculation

Let the decision matrix of cluster Ck be denoted as Rk={cljk}P×N, Since different subgroups contain varying numbers of experts and different sums of global weights after clustering, directly using the global expert weights to compute subgroup preferences may lead to underestimation of the contributions of experts within certain subgroups. Therefore, this paper first performs a re-normalization of the expert weights within each subgroup. The local weight of expert ei in subgroup Ck is defined as follows:

ω¯ik=ωi∑ej∈Ckωj (15a)

where ωi denotes the global weight of expert ei, and ω¯ik denotes the re-normalized local weight of expert ei within subgroup Ck, satisfying the following condition:

∑ei∈Ckω¯ik=1

Based on the above local weights, the elements of the comprehensive preference matrix for the k-th subgroup are computed as follows:

cljk=∑ei∈Ckω¯ikvlji=∑ei∈Ckωi∑ej∈Ckωjvlji (15)

where cljk represents the comprehensive preference value of the k-th subgroup for alternative l under attribute j; vlji denotes the preference value of expert ei for alternative l with respect to attribute j; ωi is the global weight of expert ei; Ck denotes the k-th expert subgroup; and ω¯ik is the local weight of expert ei within subgroup Ck.

After obtaining the comprehensive preference matrices of each subgroup, the subgroup preferences are further aggregated according to the subgroup weights to obtain the comprehensive decision matrix G = {glj}P×N of the entire expert group, where glj is computed as follows:

glj=∑k=1Kuk·cljk (16)

For the (l, j)-th element, the element-level consensus level of expert ei is computed as follows:

cεlji=1-|vlji-glj| (17)

For a given alternative xl, the consensus level of expert ei is computed as follows:

cεli=1N∑j=1Ncεlji (18)

The consensus level of expert ei is computed as follows:

CLi=1p∑l=1pcεli (19)

The consensus level of cluster Ck is computed as follows:

CLCk=∑i=1,ei∈Cknkωi·CLi (20)

The group consensus level is computed as follows:

GCL=∑k=1Kuk·CLCk (21)

3.3.2. Feedback adjustment

Once the consensus measurement is completed, the recommendation mechanism is activated to generate suggestions for the experts identified according to the following identification and direction rules.

3.3.2.1. Identification rules

Identify the clusters that do not satisfy the consensus threshold, and select all experts in the cluster with the minimum consensus level:

C={k|CLCk<γ;k=1,2,…,K}Cmin={k|min(CLCk);k∈C}EXPCH={(k,i)|ei∈Ck∩k∈Cmin} (22)

Identify the set of alternatives to be adjusted, denoted as ALT:

ALT={(k,i,l)|(k,i)∈EXPCH∩cεli<γ} (23)

Identify the set of opinions to be adjusted, denoted as APS:

APS={(k,i,l,j)|(k,i,l)∈ALT∩cεlji<γ} (24)
3.3.2.2. Adjustment rules

The personalized adjustment suggestions are generated as follows:

vlji(t+1)=(1-δ)vlji(t)+δglj(t) (25)

The opinion retention degree RDi of expert ei is computed as follows:

RDi=1-1P×N∑l=1P∑j=1N(|vlji(t)-vlji(t+1)|) (26)

where vlji(t+1) denotes the adjusted evaluation value of expert ei, vlji(t) denotes the evaluation value of expert ei at round t with respect to alternative xl and attribute cj,glj(t) denotes the group evaluation value at round t with respect to alternative xl and attribute cj, and δ ∈ [0, 1] is the feedback parameter.

Regarding the adjustment rules, the magnitude of the feedback parameter δ significantly influences the CRP. In many existing studies, this value is determined based on experts' historical experience. In contrast, this paper employs a reinforcement learning algorithm to determine the feedback parameter δ, as detailed in Section 3.4.

3.4. Adaptive adjustment method for feedback parameters based on reinforcement learning

In the process of large-scale group consensus reaching, traditional fixed or linearly adjusted parameters often face a dilemma: excessively large step sizes may lead to over-adjustment of expert preferences, while excessively small step sizes may result in a significant increase in the number of discussion rounds. In view of this, this paper models the consensus reaching process as a Markov decision process (MDP; Urena et al., 2019). Given that feedback adjustment is inherently a control problem within a continuous action space, the Deep Deterministic Policy Gradient (DDPG) algorithm (Hassani et al., 2023) exhibits superior architectural adaptability for continuous-domain control tasks compared to discrete policy algorithms. Therefore, this paper introduces a DDPG-driven approach that leverages the Actor-Critic architecture to solve and optimize continuous feedback control actions, aiming to generate smoother and more adaptive adjustment parameters in dynamic environments.

State Space S: The state at round t is defined as st=(d(H1t,Hct),(H2t,Hct),…,d(HMT,Hct)), where d(Hit,Hct) denotes the hesitant fuzzy linguistic distance between cluster i and the group center preference at round t. This distance vector reflects the degree of deviation of each cluster from the group center, and thus serves as a critical characterization of the environmental state. To ensure that the state satisfies the Markov property, this paper further extends the state space by defining the state variable as st = (dt, Ct, Rt, It), where dt is the vector of opinion deviation degrees of experts, Ct is the current group consensus level, Rt is the historical feedback adjustment effect (i.e., the feedback parameters in the previous round and the corresponding consensus improvement), and It is the opinion change trend (i.e., statistics of the rate of opinion change between two adjacent rounds). The extended state space can more comprehensively describe the dynamic characteristics of the current consensus environment. Given the current state st, the next state s(t+1) depends only on the current state and the action at taken by the agent, thus satisfying the Markov property. This is because the state variables already contain the main information required for future feedback decisions: the current opinion distribution (dt), the consensus level (Ct), and the historical feedback effect (Rt). These sufficient statistics cover the key dynamic information during the consensus evolution process.

Action Space A: The action is defined as at = δt ∈ [0, 1], which determines the magnitude of opinion adjustment for experts at the current round.

Temporal Bi-Objective Piecewise Reward Function:

The reward function comprehensively considers the improvement of group consensus, the reduction of discussion rounds, and the preservation of expert opinion retention, aiming to balance consensus efficiency and individual satisfaction:

{∑i=1MRDin×δ  T≤6∑i=1MRDiM×δ×T  T>6 (27)

where GCLt and GCLt+1 denote the group consensus levels at rounds t and t+1, respectively, Tdenotes the number of discussion rounds, and RDi denotes the opinion retention degree of expert ei. Under the premise of ensuring group consensus growth, a larger reward r is obtained by maintaining relatively small values of δ and the number of discussion rounds T.

In this paper, the consensus process is modeled as a Markov decision process M = (S, A, R, T, γ). The state st represents the consensus state at round t, including group consensus level, expert deviation degree, and inter-subgroup opinion differences; the action space at = λt denotes the feedback adjustment intensity; the state transition process is that after the agent executes the feedback action, the new expert opinion state is generated by the feedback adjustment rule, i.e., st→s(t+1). Since the current state st already contains sufficient statistics such as group consensus and expert deviation degree, the next state s(t+1) depends only on the current state and action, satisfying the Markov property. The reward function adopts a multi-objective design Rt = ωc·Rc+ωe·Re−ωl·Rl, where Rc is the consensus improvement reward, Re is the expert preference preservation reward, and Rl is the feedback round penalty, with ωc, ωe, ωl as weight coefficients. This design ensures that the agent not only pursues rapid consensus but also avoids excessively modifying expert opinions.

Policy Optimization and Execution:

The δ−Agent is internally composed of online Actor-Critic networks and their corresponding target networks. At each interaction round, the system feeds the state st into the online Actor network π(s|θπ), which outputs an actionat, and the Critic network Q(s, a|θQ) evaluates the action. The interaction tuple (st, at, rt, st+1) is stored in the experience replay buffer R. The Critic network is updated by minimizing the Temporal Difference (TD) error:

L(θQ)=1/J∑i=1J(yi−Q(si,ai|θQ))2,yi=ri            +γQ'(si+1,π'((si+1|θπ')|θQ') (28)

Finally, the Actor network is optimized using the policy gradient theorem, and the target network parameters are progressively updated via a soft update coefficient. The pseudo-code is presented in Algorithm 1.

Algorithm 1

Interaction between the agent and the decision-making environment. Algorithm pseudocode for a reinforcement learning approach, detailing initialization of actor and critic networks, replay buffer, experience sampling, action selection with noise, loss calculation, gradient update, and target network soft updates, formatted in a structured code block.

During the training phase, the parameters of the Actor and Critic networks are updated through interactions with the environment using historical consensus state samples. Specifically, the system first collects consensus evolution data from multiple large-scale group decision-making scenarios as the training set. In each round of interaction, the Actor network outputs feedback parameters based on the current state, while the Critic network evaluates the value of the action. The Critic network is updated by minimizing the temporal difference (TD) error, and the Actor network is optimized using the policy gradient theorem. After the training converges, the learned policy ππ is applied to new decision-making tasks, enabling automatic generation of feedback parameters. This training-application separation mechanism allows the model to learn sufficiently offline, and then quickly generate adaptive feedback strategies during online application. The specific process is illustrated in Figure 1.

Figure 1.

Flowchart illustrating a DDPG-based Markov Decision Process model framework, beginning with expert group opinion input, progressing through state definition, DDPG agent processing, opinion feedback adjustment with an adaptive parameter, multi-objective reward evaluation, and a decision point yielding either final consensus output or further iteration.

DDPG-based MDP model framework diagram.

This framework illustrates the complete decision process of the MDP model: (1) Expert group state input: the system collects the preference information of each subgroup in the current round, calculates the group consensus level, expert deviation degree, historical feedback effect, and opinion change trend, and constructs the state vector st; (2) DDPG agent decision-making: the Actor network outputs a continuous feedback parameter at = λt based on the current state st, and the Critic network evaluates the value of this action; (3) Execution of feedback parameters: the feedback parameter λt is applied to the experts identified for adjustment by the recognition rule, generating personalized adjustment suggestions; (4) Expert opinion update: experts make gradual opinion adjustments according to the feedback intensity, producing a new preference matrix; (5) Environmental state update: the system recalculates the group consensus level and generates the new state s(t+1); (6) Reward calculation: the reward Rt = ωc·Rc+ωe·Re−ωl·Rl is computed based on consensus improvement, preference preservation, and the number of discussion rounds; (7) Policy optimization: the Critic network is updated via TD error, and the Actor network is updated via policy gradient. This closed-loop mechanism realizes an adaptive feedback cycle of “state perception—policy learning—opinion adjustment—environment update.”

In practical case applications, it is only necessary to input the distance vectorst of the large group in real time. Once training is completed, the policy network can generate adaptive feedback parameters δt in real time according to the group state, thereby improving the efficiency of consensus adjustment and achieving data-driven adaptive machine-assisted collaborative decision-making.

3.5. Determination of attribute weights and alternative selection

3.5.1. Acquisition of attribute weights

In this paper, the “Octopus” web crawler software is employed to collect data related to the “Beijing-Tianjin-Hebei rainstorm” from Weibo during a specific time period. Python software is then utilized to preprocess the data, and the TF−IDF algorithm is applied to analyze the processed content to obtain keyword term frequencies and inverse document frequencies. Subsequently, the keywords are matched with the attributes to derive the corresponding attributes and their weights. As a method widely used to evaluate the importance of feature terms in documents, the TF−IDF algorithm is computed as follows:

TF-IDF=tfi,j,idfi=ni,j∑knk,j·log|D|1+|j:ti∈dj| (29)

where tfi, j denotes the frequency of keyword tiin document dj, and the inverse document frequency idfi measures the generality of the keyword, i.e., if a term appears in numerous documents, it is considered relatively common and of low importance; otherwise, it is deemed highly important. Here, ni, j and ∑knk, j denote the number of occurrences of keyword ti in document dj and the total number of keywords in document dj, respectively. |D| denotes the total number of documents, and |j:ti ∈ dj| denotes the number of documents containing keyword ti.

Given the attribute set cj(j = 1, 2, …, N) and the keyword set kci(i = 1, 2, …, n) under attribute cj, the attribute weights are obtained by computing the TF−IDF values of the keywords, as shown in the following formula:

w(cj)=∑kci∈cj(TF-IDF)kci (30)

where (TF−IDF)kci denotes the TF-IDF value of keyword kci.

After normalization, the standardized decision attribute weights are obtained as follows:

wj=w(cj)∑j=1Nw(cj) (31)

3.5.2. Alternative selection

After the group reaches consensus, the group decision matrix G = {glj}P×N is obtained. Given the attribute weight vector w = {wj|j = 1, 2, …, N} with ∑j=1Nwj=1 the comprehensive score of each alternative is computed as follows:

Ol=∑jNwj·glj (32)

The comprehensive score of each alternative is calculated using Equation 32, and the alternative with the highest score is selected as the optimal alternative.

In summary, the framework of the human-machine collaborative large-group feedback mechanism and consensus method based on the reinforcement learning algorithm is illustrated in Figure 2. The specific steps are as follows:

Figure 2.

Flowchart illustrating a decision-making framework involving expert preferences, trust relations, and clustering leading to temporary group preference. The process measures consensus, checks a threshold condition, and if unmet, adjusts feedback using a reinforcement learning module. If the threshold is satisfied, alternative selection occurs, informed by attribute weights computed from social text data using TF-IDF.

Framework of the adaptive feedback consensus method based on reinforcement learning (DDPG).

Step 1: Acquisition of expert preferences and social relations. The expert preferences in the form of hesitant fuzzy linguistic term sets are converted into numerical forms using Equations 1–5, and social network analysis is conducted based on the experts' social structure. Expert weights are then obtained using Equations 13, 14.

Step 2: Large-group clustering. The expert preferences and trust relations are integrated and clustered using the K-Means method to formKclusters. Subsequently, cluster weights are obtained using Equations 11, 12, and the temporary group preference is derived using Equations 15, 16.

Step 3: Consensus measurement. The initial consensus levels of each cluster and the group are calculated using Equations 17–21. To ensure both decision quality and timeliness, the group consensus threshold is set to γ = 0.9 (Tang and Liao, 2021). If the group consensus level does not reach the consensus threshold, the process proceeds to Step 4 for preference adjustment until the threshold is satisfied; otherwise, it proceeds to Step 5.

Step 4: Feedback adjustment. The expert preferences requiring adjustment are identified using Equations 25, 26. The feedback parameter is determined via the reinforcement learning algorithm, and the expert opinions are modified using Equation 26 until the group consensus threshold is met.

Step 5: Alternative selection. The final group preference matrix is obtained using Equation 16. Combined with public information, the attribute weights are derived, and the comprehensive score of each alternative is calculated using Equation 34. The alternative with the highest score is selected as the optimal alternative.

4. Case application

4.1. Case background

On July 29, 2023, Typhoon Doksuri moved northward carrying abundant moisture, triggering historically rare and extreme torrential rainfall in the Beijing-Tianjin-Hebei region. Heavy to extremely heavy rainfall occurred in most parts of Beijing, Tianjin, and central and southern Hebei, with some areas experiencing extraordinary downpours. Multiple departments and regions initiated emergency responses and carried out rescue operations. According to statistics, as of 24:00 on August 8, the disaster had caused 33 deaths and 18 missing persons in Beijing (Xinhua News Agency, 2023); across the entire Beijing-Tianjin-Hebei region, the typhoon claimed at least 21 lives, forced more than one million people to evacuate, and affected as many as 600,000 people [PNN (Public Television News Network), 2023].

In the aftermath of the disaster, the Central Committee of the Communist Party of China and the State Council attached great importance to the situation, emphasizing that the safety of people's lives and property must always be prioritized, and demanding the conscientious implementation of various flood prevention and disaster relief measures. The emergency management department promptly established an emergency decision-making rescue command center and convened a total of 20 experts from various fields, denoted as the expert set Ω = {ei|i = 1, 2, …, 20}. Based on the attribute set C = {c1, c2, c3, c4}, these experts were tasked with making decisions on four emergency alternatives X = {x1, x2, x3, x4} that were quickly formulated according to the actual situation, with the consensus threshold set at γ = 0.9 (Tang and Liao, 2021). The attributes include personnel search and rescue (c1), resource allocation and resettlement (c2), public opinion management (c3), and timeliness (c4). The four alternatives are as follows:

Alternative x1: Grasp the real-time situation, conduct headcounts as needed, check for injured or missing persons and verify their identities, and ensure that medical teams promptly treat critically and urgently injured individuals. Establish material distribution points and allocate daily necessities reasonably. For the core disaster-affected areas, organize water rescue (specialized rescue teams) to actively rescue people in distress and search for missing persons, and promptly release information on the disaster situation.

Alternative x2: Actively rescue surrounding trapped personnel, organize the safe transfer of people in hazardous areas, ascertain the number and identities of missing persons, and communicate with their families in a timely manner. Conduct public opinion guidance across various social media platforms, hold press conferences to alleviate public panic, and provide comfort to evacuees to ease their distress. Coordinate and organize all parties to reasonably allocate materials.

Alternative x3: Promptly assess the damage to transportation, communications, power supply, water supply, and medical facilities. The transportation department must repair damaged roads without delay to ensure that rescue teams and equipment can reach the disaster sites safely. Restore traffic safety as soon as possible to ensure the smooth progress of relief efforts. Dispatch various rescue teams to the affected areas to expand the scope of search and rescue operations. The logistics support department must ensure that relief supplies are delivered to stranded individuals in a timely manner, and hold regular press conferences to provide reassurance to all stakeholders.

Alternative x4: Organize water rescue (specialized rescue teams) to actively rescue people stranded in water, on rooftops, and in other dangerous environments. Dispatch engineering teams to carefully inspect dams, roads, bridges, and other structures for potential collapse risks. Identify and eliminate hazardous operations, and effectively manage secondary disasters such as hazardous chemical leaks. Allocate donated supplies and government-allocated materials in a reasonable manner, and promptly release updates on search and rescue progress and the disaster situation.

4.2. Decision-making process

According to the above decision-making procedure, the specific steps are as follows:

To validate the effectiveness of the proposed method, this paper constructs experimental data by simulating expert decision-making scenarios, and sets the evaluation attributes and alternatives with reference to actual emergency decision-making processes.

Step 1: Twenty experts express their preferences on four alternatives with respect to four attributes using multi-granularity hesitant fuzzy linguistic terms, and the evaluation matrices are obtained as shown in Appendix A. The linguistic term sets and their corresponding semantics adopted by the experts are presented in Table 1.

Table 1.

Linguistic term sets and their corresponding semantics.

Granularity Linguistic term set Corresponding semantics
3 S3={S03,S13,S23} {Poor, Fair, Good}
5 S5={S05,S15,S25,S35,S45} {VeryPoor, Poor, Fair, Good, VeryGood}
7 S7={s07,s17,s27,s37,s47,s57,s67} {Very Poor,Poor,RelativelyPoor,Fair,RelativelyGood,Good,VeryGood}

Subsequently, the social trust relations among the experts are collected. The preference matrix of expert e1 is presented as follows:

H1={{s23}{s03,s13}{s13,s23}{s03}{s27,s37}{s57,s67}{s27,s37,s47}{s47,s57,s67}{s05,s15}{s25,s35,s45}{s35,s45}{s45}{s37}{s47,s57,s67}{s47}{s17,s27}} (33)

The score function values of the preference matrix are computed using Equations 1–4 and subsequently normalized to obtain the numerical preference evaluation values, as presented in Equation 34:

V1=[10.04690.421900.37240.83070.40800.69590.08200.53060.73810.50.55190.66670.2196] (34)

Additionally, the social network relations among the experts are obtained. The trust relation network is presented in Figure 3.

Figure 3.

Network diagram displaying 20 blue nodes, each numbered from one to twenty in a circular arrangement, interconnected by numerous black lines representing the relationships or connections between nodes.

Social network relations among experts.

By employing Equations 6, 7, 13, 14, the expert weights are obtained, as presented in Table 2.

Table 2.

Expert weight information.

Expert IND i OUT i TD i W i Expert IND i OUT i TD h W i
e 1 0.0074 0.0178 0.0526 0.019 e11 0.057 0.0326 0.4053 0.083
e 2 0.0156 0.037 0.1105 0.04 e12 0.0378 0.0444 0.2684 0.071
e 3 0.0141 0.0363 0.1 0.037 e13 0.0215 0.023 0.1526 0.038
e 4 0.0133 0.0252 0.0947 0.03 e14 0.0356 0.0378 0.2526 0.064
e 5 0.017 0.0244 0.1211 0.034 e15 0.0333 0.0415 0.2368 0.064
e 6 0.0244 0.0252 0.1737 0.042 e16 0.0252 0.017 0.1789 0.037
e 7 0.0304 0.0356 0.2158 0.056 e17 0.0156 0.0163 0.1105 0.027
e 8 0.0163 0.0267 0.1158 0.034 e18 0.0593 0.0274 0.4211 0.08
e 9 0.0578 0.0319 0.4105 0.083 e19 0.0141 0.0222 0.1 0.029
e 10 0.0689 0.0274 0.4895 0.091 e20 0.057 0.0326 0.4053 0.083

Step 2: Based on the expert preference matrices and trust relations, the opinion similarity between experts is calculated using Equations 9 and 10. Subsequently, by further incorporating the trust relations among experts, the K-Means clustering method is applied. The clustering results are presented in Table 3.

Table 3.

Clustering results.

Cluster(Ck) Size Experts included Weight
C 1 5 e1, e2, e5, e8, e14 0.1827
C 2 3 e6, e10, e19 0.2021
C 3 7 e3, e4, e11, e16, e17, e18, e20 0.3090
C 4 3 e7, e13, e15 0.1699
C 5 2 e9, e12 0.1363

By applying Equations 15 and 16, the temporary group preference is obtained, as presented in Equation 35:

G=[0.26150.31560.48260.62030.33270.40810.49730.60780.42830.41250.49240.58290.36460.53640.70080.6185] (35)

Step 3: Based on Equations 17–21, the initial consensus levels of each cluster and the group are calculated, as presented in Table 4.

Table 4.

Initial consensus levels.

CLC 1 CLC 2 CLC 3 CLC 4 CLC 5 GCL
0.8489 0.8487 0.8795 0.8566 0.8511 0.8599

Since the group consensus level GCL = 0.8599 < γ = 0.9 is lower than the consensus threshold γ = 0.9, the group consensus level does not meet the predefined threshold, the consensus reaching process (CRP) is required to be performed.

Step 4: By applying Equations 25, 26 and the proposed consensus method, the feedback adjustment and consensus reaching process are conducted. After 6 iterations, the consensus threshold is satisfied. The feedback parameter results are presented in Table 5, the consensus results are presented in Table 6, and the group preference matrix is presented in Equation 36.

Table 5.

Feedback parameter results.

Round (t) 1 2 3 4 5 6
Feedback parameter (δt) 0.2195 0.2595 0.3685 0.3733 0.4878 0.5946

Table 6.

Group consensus level iteration results.

Round (t) 1 2 3 4 5 6
GCL 0.8659 0.8720 0.8783 0.8851 0.8951 0.9043
G={0.28430.33620.45680.63010.32110.41620.50550.59750.41230.41700.50160.56220.37510.53640.71550.651} (36)

Step 5: More than 50,000 posts related to the “Beijing-Tianjin-Hebei rainstorm” are collected from Weibo using the “Octopus” web crawler software. After data preprocessing, the attribute weights are obtained via the TF−IDF algorithm, as presented in Table 7.

Table 7.

Attribute weights derived from Weibo data via the TF-IDF algorithm.

Attribute Keywords Weight
Personnel search and rescue PLA, armed police, search and rescue, fire brigade, rescue, medical treatment, … 0.3051
Resource allocation and resettlement Supplies, resettlement work, settlement, relief supplies, distribution, … 0.2119
Timeliness Emergency, urgent, fastest, rapid, wartime, rescue, response, … 0.2288
Public opinion management Information, early warning, release, latest updates, official, CCTV, rumor, … 0.2542

By applying Equation 34, the comprehensive scores of the four alternatives are calculated and ranked as O4>O3>O2>O1, which indicates that x4 is the optimal alternative.

4.3. Comparative analysis

To verify the feasibility and superiority of the refined score function, a comparison is conducted between the refined score function (which incorporates the hesitation degree) and the original score function. The comparative results are presented in Table 8.

Table 8.

Comparison of the refined score function and the original score function.

Method / Score function O 1 O 2 O 3 O 4 Ranking result
Refined score function 0.4227 0.4512 0.4718 0.5573 x4>x3>x2>x1
Original score function 0.4476 0.4737 0.5257 0.5713 x4>x3>x1>x2

From the ranking results, it can be observed that although the top two alternatives remain in the same order, the ranking order of the third and fourth alternatives differs. This indicates that the hesitation degree information embedded in the original decision matrix exerts an influence on the final ranking of alternatives. Moreover, under the refined score function incorporating the hesitation degree, the final scores of all alternatives are lower than those obtained by the original method. This is because, when converting expert preferences into numerical forms with the hesitation degree taken into account, each element in the expert decision matrix is multiplied by a real number not greater than 1, which consequently reduces the resulting values and thus lowers the final scores of the alternatives. This further demonstrates that the hesitation degree information affects the final ranking of alternatives. Therefore, it is necessary to incorporate the hesitation degree information, which substantiates the effectiveness and superiority of the proposed method.

To further evaluate the performance of the proposed feedback parameter adjustment method, it is compared with the methods in Xu and Xiao (2023) and Xu et al. (2015). The comparison results are presented in Figure 4.

Figure 4.

Line graph comparing consensus threshold values versus iteration for three methods: proposed method (blue dashed line), Method in [33] (black dashed line), and Method in [34] (green dashed line), with a red dashed horizontal line at 0.90 marking the consensus threshold; the proposed method and Method in [33] each cross the threshold by iteration seven, while Method in [34] reaches the threshold by iteration eight.

Comparison results of different methods.

In addition, the comparison results of different methods in terms of discussion rounds and alternative ranking are presented in Table 9.

Table 9.

Comparison results of different methods.

Method Discussion rounds Adjustment parameter determination Ranking result
Method in Xu and Xiao (2023) 7 Determined objectively x4>x3>x2>x1
Method in Xu et al. (2015) 8 Combined subjective and objective determination x4>x2>x3>x1
Proposed method 6 Determined objectively x4>x3>x2>x1

From the final results, it can be observed that both the proposed method and the compared methods identify x4 and x1 as the optimal and worst alternatives, respectively, which demonstrates the rationality of the proposed method. In terms of the determination of adjustment parameters, the method in Xu et al. (2015) obtains a comprehensive adjustment parameter by combining subjective and objective determinations. In contrast, both the method in Xu and Xiao (2023) and the proposed method determine the adjustment parameter objectively. Notably, the subjective adjustment parameter in Xu et al. (2015) requires expert discussion, which may lead to unreliable decision outcomes, and the number of discussion rounds is significantly influenced by the subjective parameter. Objectively determined adjustment parameters, on the other hand, are typically based on stable data and standards, which can reduce the impact of subjective bias on decision results.

Comparing the method in Xu and Xiao (2023) with the proposed method, the ranking results of all alternatives are identical, but the method in Xu and Xiao (2023) requires more discussion rounds than the proposed method. Specifically, the method in Xu and Xiao (2023) determines the feedback parameter based on trust relations and similarity relations, whereas the proposed method employs a reinforcement learning algorithm. By effectively learning from historical experience and continuously improving through interaction with the decision-making environment, the reinforcement learning algorithm ensures the efficiency and correctness of the feedback adjustment process.

Comparing the method in Xu et al. (2015) with the proposed method, although the optimal and worst alternatives are ranked identically, the overall rankings of the alternatives differ. This is because the parameter determination in Xu et al. (2015) involves subjectivity, and the resulting discussion rounds are also greater than those of the proposed method. In summary, the proposed method exhibits strong superiority.

5. Extended experiments and analysis

To further validate the effectiveness and robustness of the proposed method, extended experiments are carried out in this section on the basis of the original case analysis, encompassing consensus experiments with varying numbers of experts, parameter sensitivity analysis, and comparative experiments with other methods.

5.1. Description of algorithm parameter settings

To ensure the reproducibility of the experimental results, this section provides a detailed description of the key algorithm parameters of the proposed method and the rationale behind their configuration. All parameters are determined via preliminary experiments, and their settings are validated to ensure algorithm convergence and stability.

  • (1) DDPG algorithm parameter settings: The Actor network learning rate is set to lrc = 0.001, following common practice in reinforcement learning to ensure stable policy gradient updates. The Critic network learning rate is set to lrc = 0.002, slightly higher than the Actor's learning rate to accelerate the convergence of the value function. The discount factor is γ = 0.95, balancing immediate rewards and long-term returns. The replay buffer size is N = 1, 000, ensuring diversity of training samples. The mini-batch size is batch_size = 64, improving training efficiency. The exploration noise standard deviation is σ = 0.05, initially set larger to encourage exploration and gradually decayed to promote exploitation. The soft update coefficient is τ = 0.001, enabling smooth tracking of the target network parameters.

The above parameter settings refer to the recommended configurations in Hassani et al. (2023) and Lillicrap et al. (2016), and are further fine-tuned via grid search over the range [0.0005,0.005] × [0.001,0.01]. The configuration that yields the fastest training convergence is finally selected.

  • (2) Model parameter settings: The consensus threshold is set to δ = 0.9, as recommended by Xu et al. (2015) for emergency decision-making scenarios. The fusion coefficient is set to θ = 0.5, determined via sensitivity analysis (see Section 5.3) that equal weighting of preference similarity and trust relationship yields the optimal performance. The number of K-Means clusters is determined by searching over the range [2,8] using the silhouette coefficient. The reward function weights are set as ωc = 0.5,ωe = 0.3, and ωl = 0.2, corresponding to the consensus improvement reward, preference preservation reward, and round penalty, respectively. Through sensitivity analysis (see Section 5.3), the default configuration is determined to achieve the best balance between consensus efficiency and preference preservation.

5.2. Experiments with expert groups of different sizes

To verify the applicability of the proposed method in large-scale group decision-making scenarios with different group sizes, simulated decision scenarios involving 20, 50, 100, and 200 experts are, respectively, established, with the consensus threshold set to 0.9. Each experiment is repeated 10 times and the results are averaged. The experimental results are shown in Table 10.

Table 10.

Experimental results of expert groups with different sizes.

Number of experts Initial consensus Rounds to consensus Final consensus Preference preservation rate Number of clusters
20 0.8567 5.6 0.9076 0.7173 3
50 0.8506 5.9 0.9081 0.7003 4
100 0.8405 6.4 0.9091 0.6924 5
200 0.8322 7.5 0.9102 0.6802 6

As shown in Table 10, as the number of experts increases, the initial consensus level decreases slightly (from 0.8567 to 0.8322), and the number of rounds required to reach consensus increases accordingly (from 5.6 to 7.5 rounds). However, the consensus threshold of 0.9 can be achieved within 8 rounds across all group sizes. The preference preservation rate remains between 0.68 and 0.72, indicating that the DDPG agent can effectively balance consensus efficiency and expert opinion retention under different group sizes. This verifies the applicability and stability of the proposed method in large-scale group decision-making scenarios with varying group sizes.

To further validate the generalization ability of the proposed method, additional experiments are designed using different types of simulated datasets. Specifically, three types of preference distributions are considered: (1) Uniform distribution dataset: expert preferences are randomly generated from a uniform distribution U(0,1), simulating scenarios without obvious preference clustering; (2) Normal distribution dataset: expert preferences are randomly generated from a normal distribution N(0.5,0.15), simulating scenarios with a mainstream opinion and moderate divergence; (3) Multimodal distribution dataset: expert preferences are randomly generated from a Gaussian mixture model 0.4N(0.3,0.08) + 0.6N(0.7,0.08), simulating scenarios with clear opinion polarization. The three datasets are tested with expert group sizes of 50, 100, and 200, respectively. Experimental results show that the proposed method can reach the consensus threshold of 0.9 within 8 rounds under all three distribution types, with the preference preservation rate ranging from 0.65 to 0.73. Among them, the multimodal distribution scenario requires slightly more rounds to reach consensus (approximately 0.5–1.0 rounds more on average), but still within an acceptable range, which confirms the adaptability and generalization ability of the proposed method to different data distributions.

5.3. Parameter sensitivity analysis

  • (1) Sensitivity analysis of the fusion coefficient θ. Taking 50 experts as an example, the clustering and consensus performance are tested for θ values of 0.0, 0.3, 0.5, 0.7, and 1.0. The results are shown in Table 11.

Table 11.

Sensitivity analysis results of the fusion coefficient θ.

θ value Rounds to consensus Final consensus Preference preservation rate Silhouette coefficient
0.0 8.0 0.8881 0.6694 0.1228
0.3 7.2 0.8962 0.7000 0.2812
0.5 6.2 0.9091 0.7056 0.4308
0.7 7.0 0.9040 0.7161 0.3497
1.0 9.0 0.8910 0.7214 0.2348

As shown in Table 11, when θ = 0.5, the silhouette coefficient is the highest (0.4308), the number of rounds required to reach consensus is the smallest (6.2 rounds), and the final consensus level is the highest (0.9091), indicating that equal weighting of preference similarity and trust relationships yields the best clustering performance. When θ = 0.0 (trust relationships only) or θ = 1.0 (preference similarity only), both clustering effectiveness and consensus efficiency decrease significantly, confirming the necessity of integrating the two types of information.

  • (2) Sensitivity analysis of DDPG training parameters. The effects of different Actor/Critic learning rates and exploration noise on consensus performance are tested, and the results are shown in Table 12.

Table 12.

Sensitivity analysis results of DDPG training parameters.

Parameter configuration Rounds to consensus Final consensus Preference preservation rate
lra = 0.0005, lrc = 0.001, σ = 0.03 6.0 0.9069 0.7057
lra = 0.001, lrc = 0.002, σ = 0.05 6.4 0.9068 0.7068
lra = 0.002, lrc = 0.004, σ = 0.10 7.4 0.9060 0.6793
lra = 0.005, lrc = 0.01, σ = 0.15 11.8 0.9082 0.6845

As shown in Table 12, when the learning rate is relatively small (lra = 0.0005), the training process is stable, the number of rounds required to reach consensus is the smallest (6.0 rounds), and the preference preservation rate is relatively high (0.7057). However, an excessively small learning rate may lead to insufficient parameter updates, resulting in a slight increase in the number of rounds needed to reach consensus under the multimodal distribution experiment (approximately 0.5–1.0 additional rounds on average), and the adaptability to extreme data distributions is slightly weaker. When the learning rate is moderate (lra = 0.001), the number of rounds increases slightly (6.4 rounds), but the preference preservation rate is the highest (0.7068), and the training process is more robust with lower sensitivity to the initial random seed. When the learning rate is too large (lra = 0.005), the training exhibits noticeable fluctuations, with the number of rounds significantly increasing (11.8 rounds) and the preference preservation rate dropping to 0.6845, indicating that an excessive learning rate leads to policy oscillation. Considering convergence speed, stability, and generalization ability comprehensively, this paper selects lra = 0.001, lrc = 0.002, σ = 0.05 as the default configuration, which ensures training stability while maintaining good adaptability across scenarios.

  • (3) Sensitivity analysis of reward weights. The effects of different reward weight configurations on consensus performance are tested, and the results are shown in Table 13.

Table 13.

Sensitivity analysis results of reward weights.

Configuration ωc, ωe, ωl Rounds to consensus Preference preservation rate
Default 0.5, 0.3, 0.2 6.0 0.6975
Consensus-oriented 0.6, 0.2, 0.2 5.8 0.6824
Preference-oriented 0.4, 0.4, 0.2 7.0 0.7235
Preference-first 0.5, 0.2, 0.3 5.7 0.6885
Strong consensus-driven 0.7, 0.2, 0.1 5.2 0.6498

As shown in Table 13, different reward weight configurations have significant impacts on both consensus efficiency and preference preservation rate. When ωc increases (consensus-oriented), the number of rounds decreases but the preference preservation rate declines. When ωe increases (preference-oriented), the preference preservation rate improves but the number of rounds increases. The default configuration (ωc = 0.5, ωe = 0.3, ωl = 0.2) achieves a good balance between the two objectives.

5.4. Method comparison experiments

To verify the superiority of the proposed DDPG-based adaptive feedback method, it is compared with a fixed-parameter feedback method (λ = 0.3), a non-DDPG feedback method (random small-step adjustment), and a traditional CRP method (linear increasing parameters). Experiments are conducted with group sizes of 50, 100, and 200 experts, each repeated 10 times. The evaluation metrics include rounds to consensus, maximum consensus level, expert preference preservation rate, and time complexity. The comparison results are presented in Table 14.

Table 14.

Comparative experimental results of different methods.

Number of Experts Method Rounds to consensus Final consensus Preference preservation rate Time (s)
50 Proposed DDPG method 6.2 0.9090 0.6849 0.372
50 Fixed parameter (λ = 0.3) 8.4 0.9056 0.6306 0.504
50 Non-DDPG feedback 12.4 0.9045 0.7632 0.744
50 Traditional CRP method 10.5 0.9055 0.6075 0.630
100 Proposed DDPG method 6.5 0.9084 0.6990 0.715
100 Fixed parameter (λ = 0.3) 8.6 0.9046 0.6135 0.946
100 Non-DDPG feedback 13.3 0.9044 0.7592 1.463
100 Traditional CRP method 11.2 0.9048 0.5915 1.232
200 Proposed DDPG method 6.9 0.9092 0.6920 1.449
200 Fixed parameter (λ = 0.3) 9.5 0.9059 0.5948 1.995
200 Non-DDPG feedback 14.4 0.9041 0.7570 3.024
200 Traditional CRP method 12.1 0.9053 0.5821 2.541

As shown in Table 14, under all group sizes, the proposed DDPG method achieves the fewest rounds to consensus (6.2 rounds for 50 experts vs. 8.4 for fixed parameter, 12.4 for non-DDPG feedback, and 10.5 for traditional CRP), and its preference preservation rate outperforms both the fixed-parameter and traditional CRP methods. Although the non-DDPG feedback method yields a slightly higher preference preservation rate, it requires significantly more rounds to reach consensus (approximately twice as many as the proposed method) and incurs higher time complexity. This indicates that the DDPG agent can dynamically adjust feedback parameters according to the group state, effectively maintaining expert preferences while ensuring consensus efficiency. Moreover, as the expert group size increases, the advantages of the proposed method become more pronounced, further validating its applicability in large-scale group decision-making scenarios.

It should be further noted that there exists an inherent trade-off between consensus efficiency and expert preference preservation in the proposed method. As shown in Table 14, the non-DDPG feedback method achieves a slightly higher preference preservation rate than the proposed method (e.g., 0.7632 vs. 0.6849 for 50 experts). This is because the non-DDPG method adopts a conservative small-step random adjustment strategy, which results in smaller modifications to the original expert preferences. However, the number of rounds required to reach consensus is approximately twice that of the proposed method (12.4 rounds vs. 6.2 rounds). In emergency decision-making scenarios, where disaster conditions change rapidly and time is critical, an excessively long consensus process may lead to missing the optimal decision window. Therefore, the proposed method achieves a significant improvement in efficiency at the cost of moderate preference adjustments, demonstrating stronger practical value in emergency contexts. For decision tasks in non-urgent scenarios that require higher preference preservation, a more conservative feedback strategy can be realized by lowering the consensus improvement weight (ωc) or increasing the preference preservation weight (ωe) in the reward function. This flexibility is also a key advantage of the DDPG-based adaptive mechanism.

It should be further clarified that this paper compares the proposed method with four benchmark approaches: (1) Traditional CRP method (linearly increasing parameters): adopting the trust-based feedback mechanism from Xu and Xiao (2023) with parameters increasing linearly at a fixed rate; (2) Fixed-parameter feedback method (λ = 0.3): using the subjective-objective parameter determination approach from Xu et al. (2015) with a constant value of 0.3; (3) Non-DDPG feedback method (random small-step adjustment): without reinforcement learning, performing opinion adjustment with random small step sizes (λ ε [0.1, 0.3]); and (4) The proposed DDPG-based adaptive method. The addition of the non-DDPG feedback method and the traditional CRP method as baselines covers four distinct paradigms—rule-driven, fixed-parameter, random-adjustment, and reinforcement-learning-based—thereby enabling a more comprehensive validation of the proposed method's effectiveness. Furthermore, this paper evaluates all methods from four dimensions: rounds to consensus, final consensus level, preference preservation rate, and time complexity, ensuring the comprehensiveness and objectivity of the comparative results.

6. Conclusion

With the increasing demand for digital agile emergency response and the growing emphasis on collaborative intelligence synergy, the deep integration of machine intelligence's dynamic computational advantages with the structured experience of human experts has become a fundamental trend in the evolution of Large-Scale Group Decision-Making (LSGDM). To address the limitations of traditional consensus-reaching mechanisms—namely, information loss during preference transformation and the rigidity of discrete feedback parameters—this paper proposes a machine-assisted adaptive feedback consensus model based on deep reinforcement learning. The methodological innovations of this study are realized in the following three dimensions:

By incorporating the hesitation degree to improve the classical score function, the proposed approach compensates for the shortcoming of traditional Hesitant Fuzzy Linguistic Term Sets (HFLTS) which are prone to misjudgment due to equivalent values during uncertain preference conversion, thereby preserving the decision-making heterogeneity of experts to the greatest extent, and integrating with trust networks to achieve more robust complex social network clustering.

To overcome the inflexibility of predefined parameters in conventional rule-driven models, this paper proposes an adaptive feedback mechanism based on deep reinforcement learning. This mechanism reformulates the consensus-reaching process as a Markov Decision Process (MDP), in which the agent dynamically outputs continuous and flexible feedback parameters through the dual-network interaction framework of the DDPG algorithm. Experimental results demonstrate that this regulatory approach can effectively reduce over-adjustment and improve the preservation of expert opinions.

A multi-objective reward function is designed to achieve Pareto optimization of the dual objectives—”consensus convergence timeliness” and “preservation of individual expert opinions.” Meanwhile, attribute weights are obtained through text mining of external online big data (TF-IDF), forming a machine-assisted architecture that integrates “individual linguistic cognition—small-group network topology—large-group adaptive evolution—public social preference mapping.”

The real-world case study of the “Beijing-Tianjin-Hebei rainstorm” emergency decision-making, along with comparative experiments, demonstrates that the proposed model can drive high-dimensional heterogeneous experts to rapidly converge to high-quality consensus with fewer negotiation rounds.

It should be noted that the current model assumes that experts make gradual adjustments according to the feedback mechanism, with AI assisting in generating feedback strategies and experts adjusting their opinions based on the feedback intensity. Future research will further consider experts' active acceptance, rejection, partial adoption, and negotiation behaviors to construct a more realistic human-machine interactive decision model.

Appendix A

Table A1.

H1=[{s03,s13}{s03,s13}{s13,s23}{s23}{s15}{s15,s25,s35}{s15,s25,s35}{s45}{s17,s27}{s27,s37}{s37,s47}{s67}{s27,s37}{s37,s47}{s57}{s67}] H2=[{s03,s13}{s13,s23}{s13,s23}{s23}{s15,s25}{s25}{s15,s25,s35}{s45}{s17,s27,s37}{s27,s37,s47}{s37,s47}{s67}{s27,s37}{s37,s47}{s57,s67}{s57,s67}]
H3=[{s13}{s13}{s13,s23}{s13,s23}{s05,s15,s25}{s15,s25,s35,s45}{s15,s25}{s35,s45}{s17,s27,s37}{s27,s37}{s27,s37,s47}{s47,s57,s67}{s27}{s37,s47,s57}{s47,s57}{s67}] H4=[{s13}{s13}{s13,s23}{s23}{s15,s25}{s25,s35}{s15,s25}{s15,s25,s35,s45}{s17,s27,s37}{s27,s37,s47}{s37,s47,s57}{s47,s57}{s27,s37}{s37,s47}{s47,s57,s67}{s57}]
H5=[{s03,s13}{s13}{s13,s23}{s13,s23}{s25,s35,s45}{s15,s25,s35}{s15,s25,s35}{s25,s35,s45}{s27,s37,s47}{s07,s17,s27}{s37,s47}{s47,s57}{s17,s27}{s37,s47,s57}{s47,s57,s67}{s37,s47}] H6=[{s03,s13}{s03,s13}{s13,s23}{s23}{s35,s45}{s15,s25,s35,s45}{s25,s35}{s25,s35}{s57,s67}{s27,s37}{s37,s47}{s67}{s03,s13}{s13}{s13,s23}{s13,s23}]
H7=[{s03,s13}{s03,s13}{s13,s23}{s23}{s13,s23}{s13,s23}{s23}{s13,s23}{s17,s27,s37,s47}{s27,s37,s47}{s27,s37,s47}{s37,s47,s57,s67}{s27,s37,s47,s57}{s37,s47,s57}{s57}{s17,s27,s37}] H8=[{s13}{s03,s13}{s13,s23}{s13}{s15}{s05,s15,s25}{s15,s25,s35}{s25,s35}{s35,s45}{s05,s15,s25}{s25,s35}{s15,s25,s35,s45}{s27,s37,s47,s57,s67}{s37,s47}{s57}{s67}]
H9=[{s13,s23}{s13}{s13,s23}{s03,s13}{s17,s27,s37}{s47,s57,s67}{s37,s47,s57}{s27,s37}{s35}{s25,s35,s45}{s15,s25}{s25,s35,s45}{s27,s37,s47,s57}{s37,s47,s57,s67}{s57}{s27,s37,s47,s57}] H10=[{s03,s13}{s13}{s23}{s13,s23}{s13}{s13}{s13}{s13,s23}{s13}{s13,s23}{s13}{s13,s23}{s13}{s13}{s13,s23}{s13}]
H11=[{s03}{s03,s13}{s13,s23}{s23}{s15,s25,s35}{s25,s35,s45}{s25,s35}{s25,s35,s45}{s17,s27}{s47,s57,s67}{s37}{s27,s37,s47}{s27,s37}{s37,s47,s57,s67}{s57,s67}{s27,s37,s47,s57}] H12=[{s15,s25,s35}{s15,s25,s35}{s15,s25,s35}{s25,s35}{s05,s15}{s15,s25,s35,s45}{s15,s25,s35}{s25,s35,s45}{s25,s35,s45}{s25,s35,s45}{s15,s25}{s35}{s05,s15,s27}{s25,s35,s45}{s25}{s25}]
H13=[{s13,s23}{s03,s13,s23}{s13,s23}{s13,s23}{s15,s25,s35}{s25}{s35}{s35,s45}{s37,s47,s57}{s37,s47,s57}{s37,s47}{s37,s47,s57,s67}{s35}{s25,s35,s45}{s15,s25,s35}{s15,s25,s35,s45}] H14=[{s13}{s03,s13}{s13,s23}{s23}{s15}{s05,s15,s25}{s15,s25,s35}{s45}{s27}{s27,s37}{s37,s47,s57}{s37,s47,s57,s67}{s27,s37,s47}{s37,s47}{s37,s47,s57}{s47,s57,s67}]
H15={{s13,s23}{s03,s13,s23}{s13,s23}{s13,s23}{s15,s25,s35}{s15,s25}{s25,s35}{s25,s35}{s17,s27}{s27,s37,s47,s57}{s37,s47,s57,s67}{s17,s27,s37,s47}{s27,s37,s47}{s37,s47,s57,s67}{s57,s67}{s47}} H16=[{s27,s37,s47}{s27,s37,s47,s57}{s27,s37,s47}{s47,s57,s67}{s17,s27,s37}{s27,s37}{s47}{s57,s67}{s27}{s27,s37,s47,s57}{s37,s47,s57}{s37,s47}{s37}{s37,s47,s57,s67}{s57,s67}{s57}]
H17={{s17,s27,s37,s47}{s37,s47,s57}{s37,s47}{s47,s57,s67}{s17,s27}{s37}{s47}{s47,s57,s67}{s27,s37}{s17,s27,s37,s47,s57}{s47,s57}{s37,s47,s57,s67}{s27,s37}{s47,s57,s67}{s57,s67}{s57,s67}} H18=[{s15,s25}{s25,s35}{s25,s35}{s35,s45}{s15}{s15,s25}{s15,s25}{s35}{s15}{s05,s15}{s25,s35,s45}{s25,s35,s45}{s15}{s05,s15,s25,s35}{s25,s35}{s45}]
H19=[{s03,s13}{s13}{s13,s23}{s13,s23}{s13}{s13,s23}{s13,s23}{s13}{s13}{s13,s23}{s13}{s13}{s03,s13}{s13}{s23}{s13,s23}] H20=[{s15,s25,s35}{s25,s35}{s35,s45}{s25,s35,s45}{s15,s25}{s15,s25}{s25,s35}{s45}{s27}{s27,s37,s47}{s37,s47,s57}{s37,s47,s57,s67}{s27,s37}{s47,s57,s67}{s57,s67}{s47,s57,s67}]

Funding Statement

The author(s) declared that financial support was received for this work and/or its publication. This research was based upon work supported by the Major Program of the National Natural Science Foundation of China (grant number 72293574), the Key Program of Xiangjiang Laboratory (grant number 25XJ02007) to Xuanhua Xu, and the Outstanding Youth Project of the Education Department of Hunan Province (grant number 24B0566) to Weiwei Zhang.

Footnotes

Edited by: Cristian Randieri, University of eCampus, Italy

Reviewed by: Yufeng Shen, Huazhong University of Science and Technology, China

Yu Wang, Xidian University, China

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Author contributions

HY: Writing – original draft. XX: Writing – review & editing. WZ: Writing – review & editing.

Conflict of interest

The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Correction note

A correction has been made to this article. Details can be found at: 10.3389/fdata.2026.2014647.

Generative AI statement

The author(s) declared that Generative AI was used in the creation of this manuscript. The language of this manuscript was polished with the assistance of AI, while all data analysis and result interpretation were completed independently by the author.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  1. Alam Z., Ali Y., Pamucar D. (2024). Elevating Pakistan's flood preparedness: a fuzzy multi-criteria decision making approach. Financial Innov. 10:140. doi: 10.1186/s40854-024-00659-7 [DOI] [Google Scholar]
  2. Gao Y., Fan S., Hu Z., Li C., Dong Y. (2022). Learning personalized individual semantics through the data of distributed linguistic preference relations: a two-stage method to support linguistic consensus reaching. Comput. Indus. Eng. 172:108581. doi: 10.1016/j.cie.2022.108581 [DOI] [Google Scholar]
  3. Hassani H., Razavi-Far R., Saif M., Herrera-Viedma E. (2023). Reinforcement learning-based feedback and weight-adjustment mechanisms for consensus reaching in group decision making. IEEE Trans. Syst. Man Cybernet. Syst. 53, 2456–2468. doi: 10.1109/TSMC.2022.3214221 [DOI] [Google Scholar]
  4. Herrera F., Herrera-Viedma E., Chiclana F. (2001). Multiperson decision-making based on multiplicative preference relations. Eur. J. Oper. Res. 129, 372–385. doi: 10.1016/S0377-2217(99)00197-6 [DOI] [Google Scholar]
  5. Ji Y., Li H., Zhang H. (2022). Risk-averse two-stage stochastic minimum cost consensus models with asymmetric adjustment cost. Group Decis. Negot. 31, 261–291. doi: 10.1007/s10726-021-09752-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Li S., Rodríguez R. M., Wei C. (2021). Two-stage consensus model based on opinion dynamics and evolution of social power in large-scale group decision making. Appl. Soft Comput. 111:107615. doi: 10.1016/j.asoc.2021.107615 [DOI] [Google Scholar]
  7. Lillicrap T. P., Hunt J. J., Pritzel A., Heess N., Erez T., Tassa Y., et al. (2016). “Continuous control with deep reinforcement learning,” in Proceedings of the 4th international conference on learning representations (ICLR 2016), San Juan, Puerto Rico. arXiv:1509.02971. doi: 10.48550/arXiv.1509.02971 [DOI] [Google Scholar]
  8. Lu Y. L., Xu Y. J., Herrera-Viedma E., Han Y. (2021). Consensus of large-scale group decision making in social network: the minimum cost model based on robust optimization. Inf. Sci. 547, 910–930. doi: 10.1016/j.ins.2020.08.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Lu Y. L., Xu Y. J., Li M. Q. (2024). Large-scale group decision-making method based on negative behavior management and improved minimum cost consensus model in social network environment. Control Decis. 39, 327–335. (in Chinese) doi: 10.13195/j.kzyjc.2022.0636 [DOI] [Google Scholar]
  10. PNN (Public Television News Network) (2023). 杜苏芮台风尾扫中国京津冀 21死百万人急疏散. https://news.pts.org.tw/article/649737 (Accessed June 25, 2026). (in Chinese)
  11. Rodriguez R. M., Martinez L., Herrera F. (2011). Hesitant fuzzy linguistic term sets for decision making. IEEE Trans. Fuzzy Syst. 20, 109–119. doi: 10.1109/TFUZZ.2011.2170076 [DOI] [Google Scholar]
  12. Shang C., Zhang R., Zhu X. (2023). An adaptive consensus model in large-scale group decision making with noncooperative and compromising behaviors. Appl. Soft Comput. 149:110944. doi: 10.1016/j.asoc.2023.110944 [DOI] [Google Scholar]
  13. Shen Y. Ma X. Bao Y. Kou G. Zhan J. (2026). A consensus method based on reinforcement learning for group decision-making. Eur. J. Oper. Res. 330, 941–955. doi: 10.1016/j.ejor.2025.08.054 [DOI] [Google Scholar]
  14. Tan X., Cai J. Q., Gong Z. W. (2026). Modeling of group consensus decision-making based on reinforcement learning under the “structure–information” coupled network. Chin. J. Manage. Sci. 34, 357–368. (in Chinese) doi: 10.16381/j.cnki.issn1003-207x.2024.2237 [DOI] [Google Scholar]
  15. Tang M., Liao H. (2021). Multi-attribute large-scale group decision making with data mining and subgroup leaders: an application to the development of the circular economy. Technol. Forecast. Soc. Change 167:120719. doi: 10.1016/j.techfore.2021.120719 [DOI] [Google Scholar]
  16. Tu Y., Wang W., Ma Z., Li Z., Lev B. (2026). Multi-agent reinforcement learning-based consensus building for large-scale group decision making. Inf. Fusion 126:103629. doi: 10.1016/j.inffus.2025.103629 [DOI] [Google Scholar]
  17. Urena R., Chiclana F., Melancon G., Herrera-Viedma E. (2019). A social network based approach for consensus achievement in multiperson decision making. Inf. Fusion 47, 72–87. doi: 10.1016/j.inffus.2018.07.006 [DOI] [Google Scholar]
  18. Wan Q., Xu X., Chen X., Zhuang J. (2020). A two-stage optimization model for large-scale group decision making in disaster management: minimizing group conflict and maximizing individual satisfaction. Group Decis. Negot. 29, 901–921. doi: 10.1007/s10726-020-09684-0 [DOI] [Google Scholar]
  19. Wang Z. H., Xu X. H., Wang Z. R., Qian Y. Y. (2026). Research on the influence of “knowledge-belief” cognitive framework on human-machine collaborative decision-making. Chin. J. Manag. Sci. 34, 92–103. In Chinese. doi: 10.16381/j.cnki.issn1003-207x.2024.1385 [DOI] [Google Scholar]
  20. Xinhua News Agency (2023). 北京此轮强降雨因灾死亡33 人 因抢险救援牺牲5 人 18人失踪. https://www.news.cn/local/2023-08/09/c_1129794177.htm (Accessed June 25, 2026). (in Chinese)
  21. Xu X., Du Z., Chen X. (2015). Consensus model for multi-criteria large-group emergency decision making considering non-cooperative behaviors and minority opinions. Decis. Support Syst. 79, 150–160. doi: 10.1016/j.dss.2015.08.009 [DOI] [Google Scholar]
  22. Xu X. H., Dai X. H., Chen X. H. (2023). Knowledge fusion method and application for fuzzy ontologies based on value measure in large group emergency decision making. Data Anal. Knowl. Discov. 7, 129–144. (in Chinese) doi: 10.11925/infotech.2096-3467.2022.0347 [DOI] [Google Scholar]
  23. Xu X. H., Xiao T. (2023). Consensus model for large group emergency decision-making driven by social network behavior data. Syst. Eng. Electron. 45, 2086–2097. (in Chinese) doi: 10.12305/j.issn.1001-506X.2023.07.19 [DOI] [Google Scholar]
  24. Xu X. H. Yin X. P. Zhong X. Wan Q. Yang Z. (2021). Review on large-group decision making: problems and challenges. Inf. Control 50, 54–64+74. (in Chinese) doi: 10.13976/j.cnki.xk.2021.9666 [DOI] [Google Scholar]
  25. Xu X. H., Zhang Q. H. (2020). Management of non-cooperative behavior in consensus-based large group emergency decision-making in social network environment. Control Decis. 35, 2497–2506. (in Chinese) doi: 10.13195/j.kzyjc.2019.0226 [DOI] [Google Scholar]
  26. Xu X. H., Zhou J. (2024). Knowledge fusion method and application in alternative sorting of dual large-scale behavior agents under emergency environments. Control Decis. 39, 1675–1686. (in Chinese) doi: 10.13195/j.kzyjc.2022.1012 [DOI] [Google Scholar]
  27. Xu X. H., Zhu Y. C. (2023). Data-driven dynamic collaborative method of public and experts in large-group emergency decision-making. Syst. Eng. Electron. 45, 3875–3886. (in Chinese) doi: 10.12305/j.issn.1001-506X.2023.12.17 [DOI] [Google Scholar]
  28. Yang W., Wang Y. (2026). Adaptive personalized large-scale group decision-making model based on psychobehavior in comprehensive trust network. Expert Syst. Appl. 299:129863. doi: 10.1016/j.eswa.2025.129863 [DOI] [Google Scholar]
  29. Yin J., Chen J. J., Li F., Zhang L. (2025). Research on consensus reaching in emergency group decision-making for sudden natural disasters considering public opinions. J. Saf. Environ. 25, 250–261. (in Chinese) doi: 10.13637/j.issn.1009-6094.2024.1268 [DOI] [Google Scholar]
  30. Yu S., Du Z., Zhang X., Luo H., Lin X. (2021). Punishment-driven consensus reaching model in social network large-scale decision-making with application to social capital selection. Appl. Soft Comput. 113:107912. doi: 10.1016/j.asoc.2021.107912 [DOI] [Google Scholar]
  31. Yüksel S., Eti S., Dinçer H., Gökalp Y., Olaru G. O., Oflaz N. K. (2025). Innovative financial solutions for sustainable investments using artificial intelligence-based hybrid fuzzy decision-making approach in carbon capture technologies. Financial Innov. 11:20. doi: 10.1186/s40854-024-00671-x [DOI] [Google Scholar]
  32. Zhang B., Liang H., Gao Y., Guiqing Z. (2018). The optimization-based aggregation and consensus with minimum-cost in group decision making under incomplete linguistic distribution context. Knowl. Based Syst. 162, 92–102. doi: 10.1016/j.knosys.2018.05.038 [DOI] [Google Scholar]
  33. Zhang H., Wang F., Dong Y., Chiclana F., Herrera-Viedma E. (2021). Social trust driven consensus reaching model with a minimum adjustment feedback mechanism considering assessments-modifications willingness. IEEE Trans. Fuzzy Syst. 30, 2019–2031. doi: 10.1109/TFUZZ.2021.3073251 [DOI] [Google Scholar]
  34. Zhang S., Zhang S., Ma Z., Liu X. (2023). A two-stage multi-attribute group consensus model based on distributed linguistic assessment information from the perspective of fairness concern. Adapt. Behav. 31, 213–238. doi: 10.1177/10597123221126208 [DOI] [Google Scholar]
  35. Zhang Y., Chen X., Gao L., Dong Y., Pedryczc W. (2022). Consensus reaching with trust evolution in social network group decision making. Expert Syst. Appl. 188:116022. doi: 10.1016/j.eswa.2021.116022 [DOI] [Google Scholar]
  36. Zhang Y., Xu Z., Liao H. (2017). A consensus process for group decision making with probabilistic linguistic preference relations. Inf. Sci. 414, 260–275. doi: 10.1016/j.ins.2017.06.006 [DOI] [Google Scholar]
  37. Zhong X., Xu X., Chen X., Goh M. (2022). Reliability-based multi-attribute large group decision making under probabilistic linguistic environment. Expert Syst. Appl. 210:118342. doi: 10.1016/j.eswa.2022.118342 [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.


Articles from Frontiers in Big Data are provided here courtesy of Frontiers Media SA

RESOURCES