Abstract
The rapid advances in artificial intelligence (AI) and machine learning have transformed computer technology. Now, computers can learn and adapt autonomously, make sound judgments, and create environments in which humans and AI work in harmony. Analytical frameworks that can process data with uncertainty, imprecision, and multiple perspectives are essential for the success of human-AI collaboration. In this connection, linguistic Z-number (LZN) evolution models play a crucial role in selecting tools for human-AI collaboration because they can better capture uncertainty and fuzziness. Given this, we extend multicriteria group decision-making (MCGDM) by incorporating LZNs. The structure of MCGDM under LZNs, the consensus-building process, estimation of experts’ weights, and the ranking of options are the main challenges. In the experts’ primary opinion-based MCGDM, we believe that expert participation and the opportunity to revise their opinions with original linguistic terms (LTs) would be more practical. However, in existing studies, experts have no scope to revise their opinions based on the original LTs. Most studies on consensus-building either do so automatically or advise experts to revise their opinions based on virtual LTs. But either automatically or virtually, LTs cannot be physically represented by words, which is a significant drawback. Given these facts, we propose an interactive, strategy-based consensus-building in which we advise experts to revise their opinions within the original LTs. To estimate experts’ weights, we developed an integrated subjective and objective method. By simultaneously assigning subjective weights and opinion-based relative-relevance indices to the experts, we derive the adjusted subjective expert weights. The objective weights of experts are derived from the criterion-based entropy method. The ranking of options, we proposed the prospect and regret theory-based TOPSIS ranking approach to rank the options. Finally, a case study on the optimal selection of an AI tool for human-AI collaboration validates the proposed method. Through a comparative analysis with alternative methodologies, we demonstrate the feasibility, stability, and superiority of the proposed model.
Keywords: Multi-criteria group decision making, Consensus process, Linguistic Z number, Artificial intelligence
Subject terms: Mathematics and computing, Psychology, Psychology
Introduction
The proliferation of artificial intelligence (AI) across industrial, scientific, and social domains has redefined the interface between human cognition and computational intelligence. Modern AI systems no longer operate as isolated tools but as adaptive partners capable of learning, reasoning, and making autonomous decisions in domains such as robotics, autonomous driving, face recognition, natural language processing, and virtual assistants1–4. This rapid evolution has intensified the need for effective human–AI collaboration, where interpretability, trust, and joint decision coherence are paramount. To address these requirements, researchers have sought analytical frameworks that can accommodate uncertainty, linguistic ambiguity, and multiple expert perspectives. Within this context, several studies have incorporated fuzzy and neutrosophic theories into AI-driven decision models. Ashraf et al.5 applied AI-assisted fuzzy decision systems to the selection of hydrogen power plants using single-valued neutrosophic sine–trigonometric aggregation operators, while Abdullah and Ashraf6 extended such frameworks to agricultural decision models under STSV neutrosophic data. Wang7 further explored T-spherical fuzzy sets with Aczel–Alsina aggregation operators for evaluating AI tools in collaborative settings. Building on this foundation, the present study develops a multi-criteria consensus-based group decision-making (MCGDM) model with a prospect–regret theory–based selection mechanism under linguistic Z-numbers (LZNs), aimed at enhancing the precision and behavioral accuracy of AI tool management for human–AI collaboration.
Addressing the diverse judgments involved in human–AI collaboration, MCGDM provides a systematic framework for integrating the evaluations of multiple experts across competing criteria. As a central branch of decision science, MCGDM enables collective reasoning in situations where information is incomplete, uncertain, or subjective. In such contexts, linguistic information offers experts a flexible medium to articulate their assessments using qualitative terms that capture human perception more naturally than numerical scales. This linguistic representation helps overcome cognitive limitations and biases that often arise when experts must quantify imprecise judgments8. To enhance expressiveness and precision, numerous extensions of linguistic modeling have been proposed, including the 2-tuple linguistic (2TL) model9, the Pythagorean linguistic set (PLS)10, hesitant fuzzy linguistic term sets (HFLTSs)11, and probabilistic linguistic term sets (PLTSs)12, among others. These approaches have substantially expanded the applicability of MCGDM to complex, high-dimensional decision environments.
The aforementioned linguistic models, despite their effectiveness in accurately describing the qualitative content of expert judgments, neglect the reliability or confidence associated with those evaluations. In real decision environments, involving human–AI interaction, experts’ assessments are often influenced by psychological, contextual, or informational uncertainty, leading to varying degrees of dependability in their expressed opinions. Consequently, there is a need for a representation model that can express linguistic information with scientific accuracy and semantic completeness. In this regard, the linguistic Z-number (LZN), introduced by Wang et al.13, provides a powerful framework for expressing uncertain and reliability-weighted linguistic evaluations. As a result of this LZNs have been proved particularly suitable for complex MCGDM problems where experts’ opinions may differ not only in content but also in certainty14–17.
The concept of LZNs originates from Zadeh’s theory of Z-numbers (ZNs)18, which capture both an expert’s evaluation and its associated reliability within a unified representation. Recognizing the need for more expressive forms, Ezadi et al.19 proposed a multi-layer framework for assessing and ranking ZNs, and Allahviranloo et al.20 introduced advanced ZNs to enhance their computational flexibility. Building on these developments, Wang et al.13 extended the framework by coupling ZNs with linguistic terms (LTs), producing linguistic Z-numbers (LZNs) that align more closely with the structure of human reasoning. Recent research on LZNs can be broadly classified into three major domains: (i) foundational studies establishing theoretical formalisms, standardization, distance measures, aggregation operators, and data representation techniques21,22; (ii) applied studies addressing decision-making problems such as MCGDM23–27, large-scale GDM28,29, and consensus-based evaluation30,31; and (iii) hybrid models integrating LZNs with other methodologies, including the best–worst method32, the gained-and-lost dominance score method33, and failure mode and effects analysis (FMEA)34.
Effective consensus building in MCGDM requires two essential conditions, the individual assessments of experts must be both consistent and compatible35. In this context, notable studies, such as the minimum-adjustment consensus under multi-granular hesitant linguistic information, establish an important optimisation-based consensus-reach process (CRP)36, personalised individual semantics and consistency control in linguistic CRP37, and social network group decision-making that enhances CRP-based MCGDM38. However, most existing MCGDM models developed under the LZN framework fail to guarantee these properties13,17,22–28,33. Consequently, there is a continuing need for procedures that promote consistency and agreement among experts during implementation. Several attempts have been made to address this issue. Mandal et al.30 proposed a consensus-based MCGDM approach in which consensus was modelled as the minimum adjustment sum. Xu et al.31 designed the consensus based on a minimum-compensation-cost optimisation model. Du et al.29 proposed a consensus-based MCGDM based on the minimum cost with Type
constraints, where a large number of experts are involved in decision-making.
The above studies have made valuable contributions both to the development of MCGDM frameworks for selecting AI tools in human–AI collaboration and to the advancement of MCGDM methodologies under LZN environments. Nevertheless, several limitations remain, which can be summarized as follows:
In complex and uncertain decision environments, existing models5–7,22 fail to incorporate procedures for determining subjective expert weights. Subjective weights derive from established facts, such as an expert’s renown, prestige, position, and knowledge of the problem at hand. Subjective weights assigned to experts may inherently reflect bias. It may not be appropriate to assign weights in advance. For example, if certain experts have high weights yet their judgment differs substantially from the group’s overall view, their preferences may be overly concentrated, which will make the final answers less accurate and precise.
The consensus-based MCGDM approaches proposed in29–31 rely primarily on minimum-adjustment and optimization techniques. These optimization models tend to be automatic adjustments producing virtual terms, limited expert interpretability/acceptance, and inflexible adjustment constraints. However, expert feedback is essential to making the decision outcome more acceptable and persuasive. As noted in39, achieving a high degree of group consensus requires consensus feedback, while it is recognized that feedback techniques help experts align their thoughts more closely with the group’s40.
In existing studies on LZNs, it may be challenging to get experts to comprehend and adopt the updated LTs as their new preferences because the revised LTs are virtual LTs derived from consistency-improvement algorithms presented in29–31.
The ranking of alternatives studied in22,29–31 is score-based; none of them considers the psychological characteristics of loss aversion and regret aversion of experts.
Based on the above analysis, we outline below the motivation and significance of this study.
To enable effective and reliable cooperation between humans and AI systems, decision models must be capable of handling ambiguity, uncertainty, and diversified multi-element judgements. Traditional decision frameworks often struggle to process nebulous data or subjective human perspectives. Prior studies have shown the most effective way to address these challenges is to integrate MCGDM techniques with LZNs. To improve decision-making testing for the optimal implementation of collaborative system designs, MCGDM approaches utilise complex analytical systems to evaluate uncertain data with imprecise components. In this article, we’ll demonstrate how to utilise an MCGDM within the LZN framework to assess and improve human-AI collaboration in software engineering.
Traditionally, artificial intelligence systems have been built to process input that is crisp, numerical, or binary. They have great potential in controlled environments. But, as is common in the actual world of decision-making, they can struggle faced with opposing, realistic, or absent human inputs. The use of modelling LTs, such as very good, moderately good, partially good, etc., in linguistic situations introduces ambiguity. This adaptability enables the effective acquisition and processing of human ideas, which are often conveyed in subjective or fluid forms. Thus, the fuzzy system can be seen as both a bridge and a barrier between human reasoning and machine logic; it also aids in decision-making when data is incomplete or when views are contradictory or have varying values. The framework outperforms more conventional AI approaches for processing nuanced human-AI interactions due to the incorporation of LZNs, which take into account not only primary information but also capture relative information of primary information.
In this paper, we propose an adjustment-based process for determining expert subjective weights in the LZN environment. We assume that each group member has background knowledge, skills, and familiarity with all options and qualities, enabling them to adjust the assigned subjective weights. To obtain the modified subjective expert weights, we combine the upfront weight assignment with the experts’ relative relevance. After providing judgment information for each alternative, each expert must assess the relative importance of the other experts. To compute the expert objective weight, we employ the entropy method. Finally, we propose an approach to determining the integrated expert weight based on the expert’s subjective and objective weights.
An expert interactive consensus-based MCGDM under LZNs is proposed, in which experts can modify their opinions through the consensus-reaching process. With the proposed feedback technique, it is easy to identify the experts and their corresponding positions required for modifications.
In the proposed consensus-reaching process, advice generation with recommendations for the expert to revise their opinions in light of the original LTs, aligning their thoughts more closely with the group’s.
People who use AI tools are generally risk-averse because they believe that mistakes could incur substantial costs (operational, reputational, compliance, and safety), and they later regret their choice when a tool they selected doesn’t perform as well as others. Standard rational frameworks, such as traditional AHP/TOPSIS, presuppose stable value and fail to explicitly incorporate loss aversion and regret effects that influence expert assessments in uncertain contexts. Considering the psychological characteristics of loss aversion and regret aversion among experts, a prospect-regret theory (PRT)-based TOPSIS ranking approach is proposed. Our PRT-based TOPSIS stage is therefore not “added for novelty,” but to model a well-known managerial reality: experts’ evaluations deviate from purely rational scoring when downside risk is salient.
The text’s outline is as follows: The core concepts of LTSs, LZNs, Regret theory (RT), and Prospect theory (PT) are introduced in “Preliminaries” section. In “The proposed consensus-based MCGDM method under LZN” section, we give the consensus-based MCGDM under LZNs. In this section, we present a novel approach to determining expert weights, the weights assigned to the criteria, and the consensus process algorithm. A case study on the optimal selection of AI tools for human-AI collaboration, along with comparative and statistical analysis, is discussed in “Example with discussion” section. A comprehensive overview of the work is presented in “Conclusion” section, which also explores potential avenues for future research.
Preliminaries
Linguistic term set (LTS) and linguistic Z number (LZN) are the fundamental ideas we explore below, which will be helpful for our next discussion.
Linguistic term set with scale function
Let
be a LTS of cardinality
with the following properties30: (1)
if and only if
. (2)
(3)
if
. (4)
if
.
Following41,42, the linguistic scale function (LSF) is a monotonically increasing function, which is defined below.
Definition 1
Let
be a LTS and
. Then the LSF
is defined as:
,
, where
if
.
In general, the LSFs come in three varieties, each of which corresponds to distinct semantics.
![]() |
1 |
![]() |
2 |
![]() |
3 |
Linguistic Z number
Definition 2
21,30 Let
be a finite alternative set,
and
be two LTSs, where
and
are positive integers. Then, for any
and
, the LZN in
is defined as
, where
denotes the fuzzy restriction applied to the domain of the uncertain variables, while
serves as a measure of the reliability associated with
. For simplicity, in this study we express LZN
instated of
, where
and
.
Example 1
For
and
, then let two LTSs
Particularly poor,
Very poor,
Marginally poor,
Slightly poor,
Medium,
Marginally good,
Good,
Very good,
Particularly good
, and
Not at all sure,
Not sure,
Slightly not sure,
Fair,
Slightly sure,
Sure,
Very sure
, are respectively. These two LTSs represent evaluation and credibility, respectively. The expert evaluates the project risk as “I’m not sure that the risk of the project is very good,” represented as an LZN
Very good, Not sure
.
For any two LZNs,
and
,
,
, the “max” and “min” operations are calculated in the following way:
,
.
As introduced in14, the distance between two LZNs,
and
is computed in the following way:
![]() |
4 |
where
with
and
.
In accordance to43, we use the following rule to compare two LZNs in this paper.
Definition 3
Let
and
be two LZNs. Then
if and only if
, where
![]() |
5 |
In equation (5),
, and
and
.
Definition 4
Let
,
be a set of objects with corresponding criteria set
. Then with the basis of
and
, an information system (IS) is represented by
, where
, (
) is a domain of
and
is a function such that
for each
and
. If
be an LZN, then the IS is called LZN IS (LZNIS).
Regret and prospect theories
Both regret and prospect theories are valuable instruments for resolving decision-making issues. They offer us experts, practical ways to think, and analytical tools to better understand and anticipate potential behavioural deviations and psychological reactions during the decision-making process. They also provide expert guidance and scientific ways of thinking to reduce decision-making risk and increase decision-making impact.
Definition 5
44 Let
be the regret-rejoice function, which is expressed in the following way:
![]() |
6 |
where a and
represent the risk aversion coefficient and the two schemes’ utility difference, respectively.
and
indicate the joy and regret values, respectively.
Tversky et al. (1992)45 introduced prospect theory, which extends the idea of limited rationality and accounts for experts’ individual risk preferences. The value function, decision weights, and the reference point for gains and losses make up the three main parts of the theoretical model.
Definition 6
The following is an expression for the value functions:
![]() |
7 |
where
denotes the the deviation of
from a reference point
.
and
indicates the gain and losses, are respectively. The coefficient of loss aversion is denoted by c, whereas b and d stand for the expert’s sensitivity to gains and losses, respectively.
Remark 1
Kahneman and Tversky45 have shown that, when
and
, the choice outcomes closely resemble the actual experts’ perceived gains and losses, which are influenced by the results of prospect theory analysis.
The proposed consensus-based MCGDM method under LZN
This section introduces the principle and approach of the consensus-based MCGDM method. We also explain the key steps of the decision-making process of the proposed method.
The MCGDM problem
Let
be the set of experts with their corresponding weight vector set is
such that
. Let
,
be a set of alternatives,
be a set of criteria with corresponding criteria weight vector
, where
such that
. Let
be the k-th experts’ opinion judgements for the i-th alternative about j-th criteria, i.e.,
, where
is an LZN information of the k-th experts’ opinion judgements for the i-th object about j-th attribute and
,
are two pre-defined distinct LTSs. Let
be the evaluation matrix of k-th expert, where
| 8 |
The normalized decision matrix (NDM) of
is denoted by
, where
![]() |
9 |
Computation of the weights of criteria
Based on studies33,43, we use the correlation coefficient technique to determine the weights of the criteria. From the evaluation matrix (8) of k-th expert, we get the
![]() |
10 |
where
![]() |
11 |
Let B and C denote the sets of benefit and cost criteria, respectively. Then, in equation (11),
and similarly calculated
and
.
Equation (10) computes the objective weight
of criterion
from the perspective of expert
. Conceptually, it assigns a larger weight to a criterion if that criterion contributes more unique (non-redundant) information compared with the other criteria. (1) In our framework, each criterion
induces a profile across the alternatives
through the LZN evaluations
. (2) Equation (11) defines
, which measures the correlation (dependency / redundancy) between the profiles of criteria
and
. (3) Equation (10) then uses
as an “independence degree” (or “non-redundancy degree”) between criteria
and
. (4) Finally, equation (10) aggregates
over all v and normalizes the result so that
. Thus, equation (10) is an objective, data-driven weighting rule: criteria with lower correlation (less overlap) with the remaining criteria receive higher weights, while highly redundant criteria receive lower weights.
We have the following justification for the correlation-based criteria structure suitable in our context:
Avoiding double-counting when criteria are interdependent In human–AI collaboration management, criteria such as interpretability/trust, transparency, and real-time availability can be partially overlapping. If two criteria are strongly correlated, assigning both high weights risks “counting the same information twice.” The correlation-based formulation reduces this redundancy by down-weighting highly correlated criteria.
Objective weighting without extra elicitation burden Many subjective weighting methods require additional pairwise comparisons or preference inputs (which increases expert workload and may introduce further inconsistency). Equation (10) uses only the already-provided evaluation matrices, making it operationally practical.
Compatibility with the LZN environment Because evaluations are linguistic Z-numbers, direct numeric correlation on raw values is not meaningful. Equation (11) constructs correlation using normalized distance-based quantities derived from the LZN distance function and ideal points (benefit/cost handling), which is consistent with the uncertainty-aware information structure of LZNs.
Computation of weight of experts and aggregation of expert opinion
According to studies in33,46, when making real-world decisions, we can’t discount experts’ academic credentials and professional experience when assessing their weight. Inspired by these studies, we present an integrated process for determining expert weights. In making real-world decisions, any one group member evaluating and weighing other members based on their regard for their knowledge or opinions on the matter at hand is not possible in practice. Therefore, we determine the relative relevance indices of experts by analysing the intensity of the disparities in the judgments expressed by group members. One expert receives a higher score when their judgment is somewhat consistent with that of other experts. Conversely, when the judgment information is more diverse, they receive a lower value. In this connection, one must first modify the given subjective weights, then calculate the objective weights, and finally combine the modified subjective weights with the objective weights to obtain the integrated expert weights.
For the computation of the expert subjective weights, we follow the following steps.
Step 1: From the evaluation judgement matrix (8), we compute the relative relevance indices of
from
’s point of view in the following way:
![]() |
12 |
for all
,
.
Step 2: The overall relative relevance indices of k-th expert according to the evaluation judgement matrix of other experts computed compute in the following way:
![]() |
13 |
Step 3: Based on the overall relative relevance indices of k-th expert
, we compute the adjusted subjective weight
of expert
in the following way:
![]() |
14 |
where
,
,
,
are the subjective weights of experts given in advanced.
For the computation of the expert objective weights, we follow the following steps.
Step 1: With the basis of the criteria weight
determinant from the
expert opinion by equation (10), we construct the weight NDM of each
as:
![]() |
15 |
where
.
Step 2: Compute the arithmetic mean of
in the following way:
![]() |
16 |
where
.
Step 3: Compute the entropy of
in the following way:
![]() |
17 |
where
.
Step 4: Compute the entropy of
in the following way:
![]() |
18 |
where
.
Step 5: Compute the relative proximity
of
from equations (17) and (18) in the following way:
![]() |
19 |
Step 6: Compute the expert object weight
of expert
from equation (19) in the following way:
![]() |
20 |
where
.
Remark 2
The entropy technique is introduced for computing expert objective weights because it provides a principled way to objectively quantify information quality/dispersion in expert assessments, without requiring additional subjective inputs. Specifically:
Entropy captures the dispersion (information concentration vs. uniformity) of an expert’s assessments: In group decision-making, an expert whose weighted evaluations are nearly uniform across alternatives/criteria contributes less discriminative information than one who expresses clearer differentiation (while still being consistent). Entropy provides a well-established scalar measure of this dispersion pattern after normalization.
Entropy enables an objective benchmark against the group via
: Equation (19) uses
to measure deviation from the group’s overall information structure. This is important because our goal is not merely to reward “more extreme” or “more uniform” assessments, but to give higher objective weight to experts whose information contribution is more aligned with the collective structure.- It reduces the need for purely subjective expert weighting while remaining computationally efficient. In real management practice, asking participants to assign detailed subjective credibility scores for all experts can be sensitive and difficult. The entropy-based component provides a data-driven alternative that is easy to compute (linear in nm per expert after normalization), which also supports the practical controllability of time cost. Based on adjusted subjective weight defined in equation (14) and objective weight defined in equation (20), the integrated weight
of expert
is computed in the following way:
Based on expert weight
21
of expert
and inspire by Ref.21, the k number of experts’ opinions are aggregated and denoted by
,
and defined in the following way:
22
Decision process
Phase 1: Consistency analysis with acceptable collective opinion of expert
Step 1: Three levels consensus index of expert opinion
The three levels consensus index (CI) of expert opinion decision matrix
are:
Elements:
.Alternatives:
.Evaluation matrix:
.
In addition, the group consensus level (GCL) is as:
.
Step 2: Identification of inconsistent positions
Let
be a consensus threshold value. If
, then the GCL is acceptable. Otherwise, in the following way we identify the inconsistent positions of opinions of experts.
![]() |
Step 3: Generation of advice with recommendation
In the k-th experts’ opinion judgements for the i-th alternative about j-th criteria
have two parts, first part is
and second part is
. Therefore, in the following we propose the generation of advice for two parts of expert
:
If
(
), then the expert
, decrees his/her first part (second part) in
in the position (i, j).If
(
), then the expert
, increase his/her first part (second part) in
in the position (i, j).If
(
), then the expert
, unchanged his/her first part (second part) in
in the position (i, j).
The element
of decision matrix
of expert
have two parts
and
, which are included into the two distinct predefined LTSs
and
. This indicates that
and
are original LTSs. Therefore, we believe that the recommendation of reconsider LTs are original and it is better than the virtual LTs. In this connection, we offer the set of two distinct original LTs for
and
of expert
for choosing LTs of
and
of reconsidering their (i, j)-th position opinion. Therefore, the recommendation set of two distinct original LTs of experts
for
and
are determined in the following way:
For
:
![]() |
23 |
where
is the (i, j)-th position nearest original LT of corresponding (i, j)-th position LT of
.
For
:
![]() |
24 |
where
is the (i, j)-th position nearest original LT of corresponding (i, j)-th position LT of
.
Based on the above discussion of the consensus process, we present Algorithm 1.
Algorithm 1.
The computation process of acceptable collective opinion
Theorem 1
The Algorithm 1is convergent.
Remark 3
The assignment operations are involved in lines 2 and 16 and therefore the time complexity of each step is O(l). In line 3, the weight of criteria experts weights computation complexity is O(nm). In lines from 5 to 8, the experts weights computation complexity is
. The complexity of line 7 is calculated by the aggregation operator, therefore it is
. The complexity of line 8 is determinate by the three level consensus measure of expert opinions, therefore it is
. No loop in line 9, thus in this step 0 is the complexity. In line 11, the complexity is O(4lmn). line 12 is the modification of the object under corresponding criteria, therefore, in this step the complexity is
. Finally, the total complexity of Algorithm 1 is
.
Remark 4 If the experts are still unable to reach a consensus within the original term intervals after multiple iterations, we will follow the following mechanism: (I) We will set the maximum iteration, i.e.,
. (II) Advice generation with recommendation plans when consensus is not reached within original LTs in intervals: If GCL remains below the threshold after
, we will include alternative managerial options: (1) reduce/adjust the consensus threshold
to a practically acceptable value. (2) expand the recommendation interval by one adjacent LT step (still interpretable), rather than switching immediately to fully virtual terms. (3) allow an optional automatic adjustment step for only the remaining inconsistent entries, while keeping the majority of updates within original LTs.
Phase 2: PRT TOPSIS-based ranking method
With the basis of studies in47,48, in this section, we integrated PT and RT into an acceptable collective opinion
where
for ranking of alternatives. The comprehensive methods are outlined below:
- Computation of positive ideal object (PIO) and negative ideal object (NIO) for each criteria.
- PIO:
. - NIO:
.
- Computation of the distance from alternatives to the PIO and NIO We use the following computation technique for determination of the distance from alternatives to the PIO, denoted by
, and the distance from alternatives to the NIO, denoted by
. 
25 
26 Computation of PRT-based relative closeness index (RCI) of each alternative Based on their findings, the authors of49 suggest that experts’ psychological utility of physical distances from current alternatives to the PIO and NIO can be reflected in RCI determination using PT. Then, to calculate RCI, we will include RT and PT. Compared to the PT, the RT improves the match between people’s actions and the utility function by incorporating regret, an additional psychological component. In the proposed RCI, we say that regret is the diminished pleasure that results from opting out of the PIO and that joy is the increased pleasure that results from opting out of the NIO. Therefore, we will now present the detailed process for calculating the PRT-based RCI for each alternative.
With the basis of PT, we use the following computation technique for determination of the prospect value of each alternative concerning PIO and NIO as follows:
PPV:
, if 
NPV:
, if
,
where
and
called positive prospect value (PPV) and negative prospect value (NPV) of
.
Using the principles of RT, we apply the following computation technique to determine the regret-rejoice value for each alternative in relation to NPV and PPV:
PRgV:
, if 
PRjV:
, if
,
where
and
called prospect-regret value (PRgV) and prospect-rejoice value (PRjV) of
.
Based on the PRgV and PRjV of
, the PRT-based perceptive utility of
is as follows:
GRjPU:
,LRgPU:
,
where
and
called gain-rejoining perceptive utility (GRjPU) and loss-regret perceptive utility (LRgPU) of
.
Based on GRjPU and LRgPU of
, in the following we propose PT-based RCI computation technique.
![]() |
27 |
The options are sorted from best to worst based on the descending order of the enhanced relative proximity coefficient.
In summary, Fig. 1 illustrates our proposed multi-criteria consensus-based group decision-making process under LZN with the prospect-regret TOPSIS ranking method.
Fig. 1.
Visualisation of our proposed multi-criteria consensus-based group decision making with prospect-regret TOPSIS-based ranking approach.
Example with discussion
To demonstrate the proposed approach, we consider a case study of the optimal selection of AI tools for human-AI collaboration in this section. This section also performs a sensitive analysis of related parameters using a comparative approach.
An example: a case study of the optimal selection of AI tools for human-AI collaboration
Unpredictable human preferences, including the use of AI tools and behavioural patterns, continue to pose obstacles to the advancement of computer technologies and AI, making successful human-AI collaboration an elusive goal. An appropriate evaluation strategy for this partnership would include creating a model to examine several qualitative and quantitative factors in an unpredictable environment. This paper’s overarching goal is to provide an MCGDM under a linguistic information framework for evaluating and improving human-AI cooperation strategies in IT development. The framework’s systematic assessment procedure uses AI technologies and systems as examples, assessing them against specified criteria.
The ability to be understood and to have faith in someone (
).How well the system works (
).Users’ capacity to adjust
).Availability in near-real time and being open and honest (
).
To generate firm conclusions from linguistic evaluations, a consensus-based MCGDM with a PRT TOPSIS-based ranking model will be employed. When dealing with the complex assessment process for human-AI collaboration in imprecise and unpredictable scenarios, it is vital to include LZNs within the proposed MCGDM framework. By providing greater flexibility, the LZNs’ information enables better representations of human choice and a clearer expression of expert judgements. The combination of human decision-making and AI operating behaviours might lead to confusing assessment outcomes, which requires special consideration in the development of computer technology. By effectively leveraging its expressive and flexible characteristics, the LZN information framework can process complex language inputs and inconsistent expert evaluations, leading to more easily understandable judgements. Incorporating LZN into assessment methods offers several benefits, including improved accuracy in defining how well the system works, greater clarity in understanding, trust in someone’s criteria, and the availability of near-real-time feedback, along with transparency as an AI tool.
We plan to analyse eight human-AI collaboration technologies
, considering the above-specified criteria. The evaluation, which relies on decision analysis and artificial intelligence, was conducted by three recognised experts
with their weight vector
in the field using the predefined LTSs are
Particularly poor,
Very poor,
Marginally poor,
Slightly poor,
Medium,
Marginally good,
Good,
Very good,
Particularly good
, and
Not at all sure,
Not sure,
Slightly not sure,
Fair,
Slightly sure,
Sure,
Very sure
from various disciplines in relevant fields to assess the options based on the criteria
.
The description of three experts is given in the following:
: An expert with over a decade of experience in academia and industry, he teaches courses on intelligent decision support systems and AI system architecture.
: An accomplished data scientist who focuses on developing AI with natural language understanding and flexible learning algorithms.
: A human-computer interaction research fellow with expertise on ethical alignment, interpretability, and trust in AI-based systems.
The description of four criterion is given in the following:
: An AI system’s ability to be understood and to have faith in someone is defined as its capacity to provide human-traceable, comprehensible rationale for its outputs and the level of specificity with which end-users evaluate the AI system’s performance and outcomes. When an AI system presents its reasoning in a way that humans can comprehend, whether through explanations or visual representations, it achieves “particularly good” and the relative information is “very sure”, meaning the system produces accurate and dependable results.
: When assessing the reliability of AI systems and tools, experts look at how fast and accurately the computers are. When basic AI systems demonstrate they can handle many inputs and outputs effectively, they are considered “particularly good”, and the relative information is “very sure”, indicating the AI system’s high performance and efficiency under dynamic conditions.
: The criteria evaluate a user’s capacity to adjust, usability, and learning potential in relation to an AI system. When the AI is flexible, the user experience is “particularly good” and the relative information is “very sure”, meaning the system is designed to adjust to high data utilisation and the level of decision-making logic.
: In terms of availability in near-real time, openness and honesty, privacy, and accountability, the evaluation assesses how well an AI system follows the rules and handles more users, more data, and more complex tasks. A “particularly good” suggests that the function is widely applicable in different contexts, and the relative information is “very sure”, meaning the system actively safeguards ethical considerations.
In Table 1, we show the opinion judgements for human-AI collaboration of AI tools.
Table 1.
The evaluation information expressed by the LZNs provided by three experts.
| Expert | Alternative | ![]() |
![]() |
![]() |
![]() |
|---|---|---|---|---|---|
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
Phase 1: Consistency analysis of expert opinion with aggregation
Set
,
, and
. The expert subjective weights are
,
, and
. Then by Algorithm 1,
,
,
,
, and the acceptable collective opinion is
![]() |
28 |
Phase 2: PRT TOPSIS-based ranking method
Set
. The PRT TOPSIS-based ranking of alternatives is shown in Table 2.
Table 2.
Ranking order (RO) of alternatives.
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
RO | |
|---|---|---|---|---|---|---|---|---|---|---|
![]() |
0.5387 | 0.5729 | 0.5802 | − 1.3781 | 0.2298 | 0.4621 | 0.8100 | -0.9160 | 0.4693 | 6 |
![]() |
0.5152 | 0.5615 | 0.5579 | − 1.3539 | 0.2220 | 0.4563 | 0.7799 | -0.8977 | 0.4649 | 7 |
![]() |
0.6419 | 0.4353 | 0.6770 | − 1.0823 | 0.2626 | 0.3856 | 0.9396 | -0.6968 | 0.5742 | 1 |
![]() |
0.5647 | 0.4809 | 0.6047 | − 1.1813 | 0.2383 | 0.4123 | 0.8430 | -0.7690 | 0.5230 | 3 |
![]() |
0.5050 | 0.5389 | 0.5482 | − 1.3058 | 0.2186 | 0.4444 | 0.7667 | -0.8615 | 0.4709 | 5 |
![]() |
0.6826 | 0.6173 | 0.7146 | − 1.4717 | 0.2750 | 0.4843 | 0.9896 | -0.9874 | 0.5006 | 4 |
![]() |
0.4718 | 0.6267 | 0.5163 | − 1.4913 | 0.2073 | 0.4889 | 0.7236 | -1.0025 | 0.4192 | 8 |
![]() |
0.5780 | 0.4735 | 0.6173 | − 1.1655 | 0.2425 | 0.4081 | 0.8599 | -0.7573 | 0.5317 | 2 |
Therefore, from Table 2 the ranking of the object is
. Then we suggest to build
as a AI tool for human-AI collaboration.
Discussion
In this section, we discuss the effects of the parameters on decision outcomes and compare our proposed consensus-based MCGDM approach with existing studies.
Sensitivity analysis
Our proposed consensus-based MCGDM approach involved
,
, the consensus threshold value
, and the parameter related to RT
. Sensitive analysis involving the other three parameters related to PT cannot be performed here. This restriction is due to the extensive examination of experimental data conducted by Tversky and Kahneman45 to determine these three parameters. The values of parameters are noted in Remark 1.
(1) Effect of
and
on decision result: Here, we will examine the impact of
and
on the CI of the experts’ evaluation matrix at the matrix level, as well as on GCL with ranking outcomes. Two parameters indicate the relative significance of evaluative information and its dependability. If the importance of the assessment information surpasses its dependability, then
. If dependability supersedes evaluative information, then
. If the significance of assessment information and dependability is identical, then
. We conduct a sensitivity study by defining the range of
values from 0 to 1 and the range of
values from 1 to 0, using a step size of 0.1, along with the CI of the evaluation matrix level and GCL ranking outcomes. The results are displayed in Fig. 2. Figure 2 illustrates that the ranking results exhibit relatively significant variation with the changes in
and
. The findings demonstrate that considering the significance of dependability substantially influences the CI of the experts’ evaluation matrix at the matrix level and of the GCL in ranking outcomes.
Fig. 2.
The values of CI, GCL, and the number of iterations, along with the ranking of alternatives that change for different values of
, are presented while keeping
,
, and
.
(2) Effect of
on decision result: The distance metric in equation (4) is the Minkowski distance. The main advantage of this distance metric is that it can be adjusted for different needs by changing its parameter
: when
, it becomes the Hamming distance; when
, it changes to the Euclidean distance; and as
tends to infinity, it turns into the Chebyshev distance. Subsequently, we will examine how changing
affects the CI of the experts’ evaluation matrix level and GCL with ranking results across six cases:
. Figure 3 displays the results. The results show that using different distance functions yielded distinct CIs for the experts’ evaluation matrix levels and GCL ranking results. Therefore, the set of
is dependent on each particle’s needs.
Fig. 3.
The values of CI, GCL, and the number of iterations, along with the ranking of alternatives that change for different values of
, are presented while keeping
,
, and
.
(3) Effect of
on decision result: To elucidate the precise impact of
on decision outcomes, we initially conduct a sensitivity analysis by incrementing
by 0.2 from 0.85 to 1. For each value of
, we calculate the CI of expert opinion
(
) as well as GCL and finally the ranking order of alternatives. The detailed results are shown in Fig. 4. In Fig. 4, we observe that
maintains the top rank. Again, we see that after
increased from 0.9 to 1, the number of adjustments increased, making the process more time-consuming, while the top-rank status of alternatives remained unchanged.
Fig. 4.
The values of CI, GCL, and the number of iterations, along with the ranking of alternatives that change for different values of
, are presented while keeping
,
, and
.
(4) Effect of a on decision result: This section will involve sensitivity studies examining concurrent changes to the parameter a. We now set
,
, and
, allowing a to incrementally rise from 0 to 1. The experimental findings are presented in Fig. 5. Figure 5 indicates that the influence of variations in a on the ranking outcomes is minimal, underscoring the robustness of the suggested model.
Fig. 5.
The values of CI, GCL, and the number of iterations, along with the ranking of alternatives that change for different values of a, are presented while keeping
,
, and
.
(5) Quantitative analysis regarding the relationship between
and
: To quantify the managerial time cost of the consensus-reaching phase, we record the number of iterations
required by Algorithm 1 to achieve different consensus thresholds
(see Fig. 4). As
increases from 0.85 to 1,
increases monotonically but remains small shown in Table 3. Hence, the number of feedback/adjustment rounds is
even under the strictest consensus requirement. Moreover, because the time complexity of Algorithm 1 is
, the total computational complexity scales linearly with
, i.e.,
. For the case study (
), this yields a very small computational burden, indicating that the practical time cost is mainly driven by a limited number of feedback rounds, which is controllable. Consistent with Fig. 4, although higher
increases the number of adjustments (especially when
rises from 0.9 to 1.0), the top-ranked alternative remains unchanged.
Table 3.
Relationship between
and
in Algorithm 1 (fixed parameters:
,
,
).
![]() |
0.85 | 0.86 | 0.88 | 0.90 | 0.92 | 0.94 | 0.96 | 0.98 | 1 |
![]() |
1 | 1 | 1 | 2 | 2 | 3 | 3 | 3 | 4 |
Comparative analysis
In this section, we compare our proposed approach from two perspectives: one perspective compares it with related MCGDM approaches, while the other compares it with consensus-based approaches in the LZN environment.
Compared with related MCGDM approaches
The MCGDM model examined in22,33,50 may be employed to resolve the issue of selecting AI tools for human-AI collaboration, which is the focus in this section. In this connection, we compare our proposed approach with four aspects: (I) determination of criteria weights, (II) determination of expert weights, (III) considering the opinions of experts without and with consensus, and (IV) ranking technique of alternatives.
(I) Determination of criteria weights:
In22, the weights of criteria and order positions are assumed. However, in30, it was noted that the weight of criteria plays an essential role in MCGDM and in final decision outcomes. For the computation of criteria weights, Liu et al.’s33 approach adopts a hybrid technique, which is a combination of subjective and objective weights. In their approach, they need additional information, such as subjective preference degrees between criteria, which are provided by experts based on comparisons of criteria with respect to Best-to-Others and Others-to-Worst. Zheng et al.’s50 approach uses the maximum deviation method to calculate criterion weights, based on a linear optimisation technique. These approaches are well-established for computing criterion weights that align with practical needs. However, the criteria of AI tools for human-AI collaboration management are highly dependent on and correlated with one another. In this view, we proposed the correlation coefficient method for determining criterion weights, which is more effective, as indicated in the study10,51.
(II) Determination of expert weights:
The determination of experts’ weights is avoided in22,33,50; however,30,47 points out that it cannot be avoided in the MCGDM because experts come from different fields, and their knowledge differs based on experience and expertise. In this paper, we propose a novel approach to computing experts’ weights based on the study46,52.
(III) Considering the opinions of experts with and without consensus:
The approach employed in22,33,50 does not account for expert agreement. However, the decision’s outcome is questionable due to the lack of a consensus process in the studies referenced in31,47. In this context, we analysed the studies by Chen et al.22 approach1, Liu et al.33 approach2, and Zhang et al.50 approach3 along with our approach, which considers expert opinions with and without consensus. Tables 4 and 5 display the detailed results. From Tables 4 and 5, we observe that the optimal alternative remains unchanged when expert opinion consensus is considered, indicating that the consistency of expert opinions significantly affects decision outcomes. However, considering expert opinions without consensus significantly alters the ranking results.
Table 4.
Assessment of AI tools for human-AI collaboration by the studies in22,33,50 vs. our approach with consensus case.
| Alternatives | Chen et al.22 approach |
Liu et al.33 approach |
Zhang et al.50 approach |
Our approach | ||||
|---|---|---|---|---|---|---|---|---|
| Ranking value |
Ranking order |
Ranking value |
Ranking order |
Ranking value |
Ranking order |
Ranking value |
Ranking order |
|
![]() |
0.5300 | 2 | − 0.0327 | 6 | 0.4127 | 5 | 0.4693 | 6 |
![]() |
0.4916 | 7 | − 0.0520 | 7 | 0.3677 | 6 | 0.4649 | 7 |
![]() |
0.5340 | 1 | 0.0536 | 1 | 0.5453 | 1 | 0.5742 | 1 |
![]() |
0.5220 | 4 | 0.0268 | 4 | 0.4757 | 3 | 0.5230 | 3 |
![]() |
0.4995 | 5 | 0.0198 | 5 | 0.3606 | 7 | 0.4709 | 5 |
![]() |
0.4936 | 6 | 0.0482 | 2 | 0.4725 | 4 | 0.5006 | 4 |
![]() |
0.5284 | 3 | − 0.0698 | 8 | 0.3274 | 8 | 0.4192 | 8 |
![]() |
0.4897 | 8 | 0.0326 | 3 | 0.4868 | 2 | 0.5317 | 2 |
Table 5.
Assessment of AI tools for human-AI collaboration by the studies in22,33,50 vs. our approach without consensus case.
| Alternatives | Chen et al.22 approach |
Liu et al.33 approach |
Zhang et al.50 approach |
Our approach | ||||
|---|---|---|---|---|---|---|---|---|
| Ranking value |
Ranking order |
Ranking value |
Ranking order |
Ranking value |
Ranking order |
Ranking value |
Ranking order |
|
![]() |
0.4748 | 2 | − 0.0520 | 7 | 0.4092 | 4 | 0.4660 | 8 |
![]() |
0.4352 | 6 | − 0.0297 | 6 | 0.4081 | 5 | 0.5446 | 3 |
![]() |
0.4655 | 4 | 0.0499 | 2 | 0.4732 | 2 | 0.5696 | 2 |
![]() |
0.4663 | 3 | 0.0007 | 5 | 0.3785 | 7 | 0.5148 | 4 |
![]() |
0.4576 | 5 | 0.0281 | 3 | 0.3511 | 8 | 0.5096 | 5 |
![]() |
0.4304 | 7 | 0.0268 | 4 | 0.4230 | 3 | 0.5038 | 6 |
![]() |
0.4772 | 1 | − 0.0852 | 8 | 0.3807 | 6 | 0.4679 | 7 |
![]() |
0.4165 | 8 | 0.0711 | 1 | 0.4848 | 1 | 0.5880 | 1 |
(IV) The ranking technique of alternatives.
The ranking method in Chen et al.22 is based on LZN scores, which, in some cases, fails, as shown in43. For ranking alternatives, Liu et al.’s33 uses the original GLDS method, which is based on PT. They avoid another RT. The ranking method of Zheng et al.50 is based on the ORESTE approach. However, in his study, Steinhagen48 pointed out that the ORESTE approach has notable shortcomings, specifically the Besson ranking and the distance-based criteria. He claims that in his research, these shortcomings in decision-making frameworks may lead to unexpected or even undesirable results. In our approach, we used a PRT-based TOPSIS ranking technique to rank alternatives, thereby addressing the shortcomings of Chen et al.’s22, Liu et al.’s33, and Zheng et al.’s50 approaches.
Compared with consensus-based approach
For validity analysis, we compare our model with Xu et al.’s31 approach4. Thus, based on the Xu et al. approach, we are selecting AI tools for human-AI collaboration. The steps are as follows:
Step 1: Convert the expert opinion shown in In Table 1. The results are shown in Table 6.
Table 6.
The converted decision matrix of each expert.
![]() |
![]() |
![]() |
||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
|
![]() |
0.9778 | 0.9856 | 0.8439 | 0.9856 | 0.9771 | 0.2814 | 0.7186 | 0.6202 | 0.8886 | 0.4717 | 0.7711 | 0.9856 |
![]() |
0.7838 | 0.6443 | 0.9778 | 0.7704 | 0.9161 | 0.9946 | 0.9459 | 0.9856 | 0.8462 | 0.9778 | 0.8608 | 0.6202 |
![]() |
0.9856 | 0.9771 | 0.3720 | 0.7186 | 0.9351 | 0.8886 | 0.8886 | 0.8164 | 0.9856 | 0.9351 | 0.8886 | 0.9778 |
![]() |
0.4594 | 0.7186 | 0.9778 | 0.9351 | 0.9778 | 0.8608 | 0.9856 | 0.9161 | 0.9203 | 0.9552 | 0.8608 | 0.5946 |
![]() |
0.9778 | 0.4594 | 0.8439 | 0.9778 | 0.9351 | 0.7186 | 0.9778 | 0.7704 | 0.7711 | 0.8462 | 0.9778 | 0.8608 |
![]() |
0.7930 | 1.0000 | 0.9161 | 0.0222 | 0.9771 | 0.9771 | 0.8462 | 0.6280 | 0.9856 | 0.8886 | 0.9203 | 0.9203 |
![]() |
0.9856 | 0.9778 | 0.7225 | 0.9778 | 0.8164 | 0.1392 | 0.9203 | 0.9161 | 0.4717 | 0.8382 | 0.9161 | 0.9771 |
![]() |
0.9771 | 0.6202 | 0.9552 | 0.9015 | 0.9161 | 0.9771 | 0.6443 | 0.6568 | 0.9771 | 0.9778 | 0.9771 | 0.9856 |
Step 2: The collective decision matrix is shown in Table 7.
Table 7.
The initial collective decision matrix.
![]() |
![]() |
![]() |
![]() |
|
|---|---|---|---|---|
![]() |
0.9478 | 0.5796 | 0.7779 | 0.8638 |
![]() |
0.8487 | 0.8723 | 0.9282 | 0.7921 |
![]() |
0.9688 | 0.9336 | 0.7164 | 0.8376 |
![]() |
0.7858 | 0.8449 | 0.9414 | 0.8153 |
![]() |
0.8947 | 0.6747 | 0.9332 | 0.8697 |
![]() |
0.9186 | 0.9552 | 0.8942 | 0.5235 |
![]() |
0.7579 | 0.6517 | 0.8529 | 0.957 |
![]() |
0.9567 | 0.8584 | 0.8589 | 0.848 |
Step 3: We have now calculated the individual consensus levels, which are
,
, and
. Thus, the group consensus level is 0.8837, which is greater than 0.85. That means in this example, no feedback loop is needed. Thus, the initial decision matrix shown in Table 6 is the final decision matrix of each expert.
Step 4: We have now computed the weights for each expert: 0.1484, 0.4289, and 0.4227. The optimal weights for the criteria are 0.2377, 0.3207, 0.1296 and 0.3120.
Step 5: Based on the quantum-like Bayesian network (BN), the first layer probabilities are the weights for each expert. In the quantum-like Bayesian network (BN), the first-layer probabilities correspond to the weights for each expert. The conditional probability in the BN is
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
.
Therefore, the probability of each alternative is
,
,
,
,
,
,
,
.
Based on the value of the probability of each alternative, the ranking is
.
Step 6: We have now computed the standardized Deng entropy (SDE), shown in equation (29).
![]() |
29 |
Step 7: With the basis of quantum interference effects, the quantum probability of each alternative is
,
,
,
,
,
,
,
.
Based on the value of the quantum probability of each alternative, the ranking is
. The results indicate that our method is compatible with Xu et al.’s31, since the optimal alternative remains the same when comparing the two.
Statistical analysis
In this section, we conduct a statistical analysis to identify AI tools for human-AI collaboration. Specifically, we rank the eight AI tools for human-AI collaboration, based on the approaches outlined in22,31,33,50 and our proposed approach. First, we analyse it without consensus-based approaches22,33,50, and then we include a consensus-based approach31 in our analysis.
Statistical analysis of without consensus-based approaches
In this section, we apply two popular techniques: Spearman’s rank correlation (SRC) coefficient5 and Kendall’s Tau tests6. We aim to quantify differences between the compared methods and measure similarities among rank sets. Figures 6, 7, and 8 display the detailed results. From Figs. 6, and 7, we observe that our method is highly consistent with Zheng et al.’s50 approach, strongly consistent with Liu et al.’s33 approach, and significantly divergent from Chen et al.’s22 approach, considering the opinions of experts with and without consensus. However, from Fig. 8, we observe that our method is strongly consistent with Liu et al.’s33 approach, moderately consistent with Zheng et al.’s50 approach, and significantly divergent from Chen et al.’s22 approach.
Fig. 6.
The statistical ranking tests of our method are compared with those examined in22,33,50, emphasizing the consensus among experts’ opinions.
Fig. 7.
The statistical ranking tests of our method, compared to those examined in22,33,50, highlight the lack of consensus among experts’ opinions.
Fig. 8.
The statistical ranking tests of our method, compared to those examined in22,33,50.
Statistical analysis of consensus-based approaches
In this section, we apply two popular techniques: SRC coefficient and Kendall’s Tau tests. We aim to quantify differences between the compared methods and measure similarities among rank sets. Figure 9 displays the detailed results. From Fig. 9, we observe that our method shows a moderate correlation with Xu et al.’s31 approach in the absence of an interface effect. Still, there is no meaningful correlation when the interface effect is present. However, we observe that the optimal alternative is unchanged in Xu et al.’s31 and our approaches in both cases.
Fig. 9.
The statistical ranking tests of our vs. Xu et al.’s31 approaches.
Implications of this study for a real-world scenario
Experts who guide and engage AI systems in human-computer dialogue can make better judgments in uncertain contexts using the proposed LZN-based MCGDM paradigm. Due to its adaptability and linguistic reasoning capabilities, it finds usage in several practical fields:
In the medical field, the paradigm can be used to evaluate diagnostic AI tools by considering key AI properties, including the ability to be understood and to have faith in someone, how well the system works, users’ capacity to adjust, availability in near-real time and being open and honest. These properties are crucial for the confidence and acceptance of these tools in clinical contexts.
The semi-autonomous driving systems rely heavily on human-AI interaction. Based on their ability to be understood, the system’s effectiveness, users’ capacity to adjust, and safety in dynamic circumstances, the model may rate the perception and navigation modules.
In the customer service, responsiveness, user-friendliness, and dependability should be the pillars around which chatbots and virtual agents are built. Customer experience managers can utilise the framework to evaluate and select tools based on expert consensus.
In the education systems, human educators can evaluate the usefulness and timeliness of real-time feedback and corrections, as well as the ability to personalise a system for each user, in both intelligent tutoring systems and adaptive learning environments. The provided examples demonstrate the exceptional adaptability of the recommended model across various domains that require expert work and human-AI collaboration.
A multi-expert evaluation of eight AI tools in relation to four critical features validates the usefulness of the proposed methodology. The model’s robustness is demonstrated by the findings, which consistently show that the ranking order stays constant independent of the values of parameters
, and a. On the other hand, statistical analysis in “Statistical analysis” section reveals that the rankings of the AI tools in some existing studies are highly correlated with our research.
To achieve the study’s goal of discovering a technique to advance human-AI collaboration, this empirical investigation demonstrates that the model is adaptable and trustworthy for monitoring human-like decision-making behaviour under uncertainty.
Conclusion
In this article, we explore the assessment of AI tools for human-AI collaboration using the consensus-based MCGDM under LZNs. Some important things that this study has brought to light are:
Discussed interactive, strategy-based consensus-building in which we advise experts to revise their opinions within the original LTs, which resolves the deficiency of related studies.
Developed how to obtain subjective and objective-based integrated expert weights with LZN-based decision information. For derived subjective expert weights, we compare the judgments of any two experts and derive the overall relative-relevance indices for each expert, which are then used to adjust the subjective weights. To obtain objective expert weights, the criterion-weight-based entropy method is employed.
To measure the psychological characteristics of loss aversion and regret aversion of experts, the PRT-based TOPSIS ranking approach is developed.
An essential part of the decision-making process outlined in this essay was how to measure the efficacy of AI tools for human-AI collaboration. Similarly, a wide range of characteristics may be considered to provide greater precision.
The advantages of our proposed model are listed below:
Our proposed consensus model has a simple, meaningful feedback cum advice generation process. It is easy to identify which experts and which positions oppose the consensus goal. In the advice-generation process, experts revise their opinions using original LTs, which are easier for them to understand than virtual LTs.
This is because the expert’s reputation, standing, occupation, degree of expertise, and other observable qualities underlie the subjective weights. Subjective weights assigned to experts may be inherently skewed. Therefore, it might not be reasonable to assign weights in advance. We present a realistic and bias-free method for determining an expert’s adjusted subjective weights.
By merging PRT-based TOPSIS, we derive six relative utility functions, which we then use to explain the limited rationality of DMs. Decisions are less likely to be impacted by subjective considerations and biases when these relative utility functions are used.
To account for experts’ bounded rationality, we combine prospect theory, regret theory, and TOPSIS to derive the RCI for each alternative. This PRT-based RCI for each alternative effectively reduces the influence of subjective factors on decision-making and the risk of decision errors due to subjective biases.
We demonstrate that the technique is successful in real-world settings and is both feasible and stable by comparing it with existing decision-making methods and conducting a parametric analysis of the results. This demonstrates that our approach not only enhances MCGDM’s utility but also provides more rigorous, scientific support for complex decision-making. However, the proposed model has several limitations, which are listed below:
The current model assumes static expert or agent weights.
Unlike automatic consensus models, the suggested model requires user interaction to make decisions, which adds time to the process. In53, the advantages and disadvantages of the automated and interactive approaches were compared.
The model’s parameters are not always easy to pin down. However, the rigorous experimental analysis in54,55 shows that
and
.
Despite these limitations indicate clear avenues for future work. First, a promising extension is to introduce dynamic weighting, in which the influence of human experts and AI agents evolves based on consistency, reliability, and trust calibration across iterations or decision rounds. Second, investigate computational acceleration, that is, decomposition across expert blocks, parallel implementation of consensus updates, and incremental consensus updating when new experts/alternatives arrive. Third, focus on domain-specific parameter calibration through empirical elicitation and data-driven estimation to ensure validity in AI-management contexts.
Acknowledgements
We use ChatGPT 5.2 Pro to improve English.
Author contributions
Prasenjit Mandal: Conceptualization of this study, methodology, validation, writing–original draft. Leo Mrsic: Funding acquisition, validation and visualization. Antonios Kalampakas: Data curation, formal analysis, and visualization. Tofigh Allahviranloo: Formal analysis, visualization, and supervision. Sovan Samanta: Formal analysis, investigation, resources, writing—review and editing.
Funding
Project related funding: project “Innovative digital platform for assessing brain activity levels based on EEG technology and advanced machine learning (BRAINACTIV) NPOO.C3.2.R3-I1.06.0082".
Data availability
The data will be made available on request.
Declarations
Competing interests
The authors declare no competing interests.
Informed consent
The authors confirm that written informed consent has been obtained from the involved experts.
Footnotes
Particularly poor,
Very poor,
Marginally poor,
Slightly poor,
Medium,
Marginally good,
Good,
Very good,
Particularly good
, and
Not at all sure,
Not sure,
Slightly not sure,
Fair,
Slightly sure,
Sure,
Very sure
;
, and 
Particularly poor,
Very poor,
Marginally poor,
Slightly poor,
Medium,
Marginally good,
Good,
Very good,
Particularly good
, and
Not at all sure,
Not sure,
Slightly not sure,
Fair,
Slightly sure,
Sure,
Very sure
;
, and 
, and 
,
,
, Initially, the weights of each expert are equal.
The SR between two rankings
and
is:
, where
and
.
Kendall’s Tau
, where, C : number of concordant pairs, and D : number of discordant pairs,
.
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Edwards, C., Edwards, A., Stoll, B., Lin, X. & Massey, N. Evaluations of an artificial intelligence instructor’s voice: Social Identity Theory in human-robot interactions. Comput. Hum. Behav.90, 357–362. 10.1016/j.chb.2018.08.027 (2019). [Google Scholar]
- 2.Hill, J., Ford, W. R. & Farreras, I. G. Real conversations with artificial intelligence: A comparison between human-human online conversations and human-chatbot conversations. Comput. Hum. Behav.49, 245–250. 10.1016/j.chb.2015.02.026 (2015). [Google Scholar]
- 3.Suen, H. Y., Chen, M. Y. C. & Lu, S. H. Does the use of synchrony and artificial intelligence in video interviews affect interview ratings and applicant attitudes?. Comput. Hum. Behav.98, 93–101. 10.1016/j.chb.2019.04.012 (2019). [Google Scholar]
- 4.Wang, J., Molina, M. D. & Sundar, S. S. When expert recommendation contradicts peer opinion: Relative social influence of valence, group identity and artificial intelligence. Comput. Hum. Behav.107, 106278. 10.1016/j.chb.2020.106278 (2020). [Google Scholar]
- 5.Ashraf, S., Abdullah, S., Zeng, S., Jin, H. & Ghani, F. Fuzzy decision support modeling for hydrogen power plant selection based on single valued neutrosophic sine trigonometric aggregation operators. Symmetry12, 298. 10.3390/sym12020298 (2020). [Google Scholar]
- 6.Ashraf, S. & Abdullah, S. Decision support modeling for agriculture land selection based on sine trigonometric single valued neutrosophic information. Int. J. Neutros. Sci.9, 60–73. 10.54216/IJNS.090201 (2020). [Google Scholar]
- 7.Wang, J. Role of human collaboration in artificial intelligence with fuzzy based mathematical models and decision making problems. Sci. Rep.15, 34029. 10.1038/s41598-025-13466-6 (2025). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Jin, F., Guo, S. & Liu, J. A novel probabilistic linguistic group decision-making method driven by DEA cross-efficiency and trust relationship. Appl. Intell.55, 1035. 10.1007/s10489-025-06696-8 (2025). [Google Scholar]
- 9.Zhong, Y., Li, G., Chen, C., Jin, T. & Liu, Y. Reliability allocation method based on 2-tuple linguistic weighted muirhead mean operator and 2-tuple linguistic best-worst method. IEEE Trans. Reliab.72, 542–551. 10.1109/TR.2022.3177941 (2023). [Google Scholar]
- 10.Mandala, P., Mrsic, L., Kalampakas, A., Allahviranloo, T. & Samanta, S. Pythagorean linguistic information-based green supplier selection using quantum-based group decision-making methodology and the MULTIMOORA approach. Artif. Intell. Rev.58, 199. 10.1007/s10462-025-11205-x (2025). [Google Scholar]
- 11.Wu, Z., Xu, J., Jiang, X. & Zhong, L. Two MAGDM models based on hesitant fuzzy linguistic term sets with possibility distributions: VIKOR and TOPSIS. Inf. Sci.473, 101–120. 10.1016/j.ins.2018.09.038 (2019). [Google Scholar]
- 12.Wang, X., Dong Liang, X., Yan Li, X. & Luo, P. Collaborative emergency decision-making for public health events: an integrated BWM-TODIM approach with multigranularity extended probabilistic linguistic term sets. Appl. Soft Comput.144, 110531. 10.1016/j.asoc.2023.110531 (2023). [Google Scholar]
- 13.Wang, J., Cao, Y. & Zhang, H. Multi-criteria decision-making method based on distance measure and choquet integral for linguistic Z-numbers. Cogn. Comput.9, 827–842. 10.1007/s12559-017-9493-1 (2017). [Google Scholar]
- 14.Xiao, Y., Liao, H., Jin, X. & Zhan, J. A linguistic Z-number-based sorting method for three-way multi-criterion decision-making in ecological function zoning. Inf. Sci.673, 120706. 10.1016/j.ins.2024.120706 (2024). [Google Scholar]
- 15.Jia, Q., Hu, J., Safwat, E. & Kamel, A. Polar coordinate system to solve an uncertain linguistic Z-number and its application in multicriteria group decision-making. Eng. Appl. Artif. Intell.105, 104437. 10.1016/j.engappai.2021.104437 (2021). [Google Scholar]
- 16.Wang, H., Ju, Y., Dong, P., Wang, A. & Cabrerizo, F. J. Preference-based regret three-way decision method on multiple decision information systems with linguistic Z-numbers. Inf. Sci.654, 119861. 10.1016/j.ins.2023.119861 (2024). [Google Scholar]
- 17.Mandal, P., Mrsic, L., Kalampakas, A., Allahviranloo, T. & Samanta, S. Multicriteria group decision making based on TODIM and PROMETHEE II approaches with integrating quantum decision theory and linguistic Z number in renewable energy selection. Mathematics12, 3790. 10.3390/math12233790 (2024). [Google Scholar]
- 18.Zadeh, L. A. A note on Z-numbers. Inf. Sci.181, 2923–2932. 10.1016/j.ins.2011.02.022 (2011). [Google Scholar]
- 19.Ezadi, S., Allahviranloo, T. & Mohammadi, S. Two new methods for ranking of Z-numbers based on sigmoid function and sign method. Int. J. Intell. Syst.33, 1476–1487. 10.1002/int.21987 (2018). [Google Scholar]
- 20.Allahviranloo, T. & Ezadi, S. Z-advanced numbers processes. Inf. Sci.480, 130–143. 10.1016/j.ins.2018.12.012 (2019). [Google Scholar]
- 21.Chai, J., Su, Y. & Lu, S. Linguistic Z-number preference relation for group decision making and its application in digital transformation assessment of SMEs. Expert Syst. Appl.213, 118749. 10.1016/j.eswa.2022.118749 (2023). [Google Scholar]
- 22.Chen, B., Cai, Q., Wei, G. & Mo, Z. Novel aczel-alsina operations-based linguistic Z-number aggregation operators and their applications in multiattribute group decision-making process. Eng. Appl. Artif. Intell.124, 106541. 10.1016/j.engappai.2023.106541 (2023). [Google Scholar]
- 23.Aliev, R. A., Guirimov, B. G., Huseynov, O. H. & Aliyev, R. R. Country selection problem for business venturing in Z-information environment. Inf. Sci.597, 230–243. 10.1016/j.ins.2022.03.049 (2022). [Google Scholar]
- 24.Mandal, P., Samanta, S., Allahviranloo, T., Pal, M. & Dubey, V. K. A new approach of MCGDM: MARCOS-based alternatives measurement with ranking under linguistic Z number information and their application in the selection of logistics distribution cold chain centre. In Allahviranloo, T. & Samanta, S. (eds.) Management of Uncertainty Using Linguistic Z-Numbers, vol. 434 of Studies in Fuzziness and Soft Computing, 33–49. 10.1007/978-3-031-65854-9_3 (Springer, Cham, 2024).
- 25.Mandal, P., Samanta, S., Allahviranloo, T. & Pal, M. Linguistic Z number environment-based site selection of medical logistic centre with TODIM-VIKOR approach. In Allahviranloo, T. & Samanta, S. (eds.) Management of Uncertainty Using Linguistic Z-Numbers, vol. 434 of Studies in Fuzziness and Soft Computing, 53–67. 10.1007/978-3-031-65854-9_4 (Springer, Cham, 2024).
- 26.Mandal, P., Samanta, S., Allahviranloo, T. & Pal, M. A novel approach of extended ORESTE-based linguistic Z number MCGDM and their applications in the ability of regional energy assessment. In Allahviranloo, T. & Samanta, S. (eds.) Management of Uncertainty Using Linguistic Z-Numbers, vol. 434 of Studies in Fuzziness and Soft Computing, 87–103. 10.1007/978-3-031-65854-9_6 (Springer, Cham, 2024).
- 27.Mandal, P., Samanta, S., Allahviranloo, T. & Pal, M. MCGDM based on MULTIMOORA with linguistic Z number and their application in software selection. In Allahviranloo, T. & Samanta, S. (eds.) Management of Uncertainty Using Linguistic Z-Numbers, vol. 434 of Studies in Fuzziness and Soft Computing, 105–121. 10.1007/978-3-031-65854-9_7 (Springer, Cham, 2024).
- 28.Jiang, S., Shi, H., Lin, W. & Liu, H. C. A large group linguistic Z-DEMATEL approach for identifying key performance indicators in hospital performance management. Appl. Soft Comput.86, 105900. 10.1016/j.asoc.2019.105900 (2020). [Google Scholar]
- 29.Du, Z., Yu, S., Guo, L. & Zhong, X. Multi-stage type- constrained minimum-cost consensus for linguistic Z-number large-scale decision-making. Eng. Appl. Artif. Intell.136, 109032. 10.1016/j.engappai.2024.109032 (2024). [Google Scholar]
- 30.Mandal, P., Samanta, S. & Pal, M. Failure mode and effects analysis in consensus-based GDM for surface-guided deep inspiration breath-hold breast radiotherapy for breast cancer under the framework of linguistic Z-number. Inf. Sci.658, 120016. 10.1016/j.ins.2023.120016 (2024). [Google Scholar]
- 31.Xu, Y., Yan, S., Pérez, I. J. & Cabrerizo, F. J. Quantum group consensus model based on linguistic Z-numbers and its application to meteorological disaster emergency. Inf. Sci.700, 121777. 10.1016/j.ins.2024.121777 (2025). [Google Scholar]
- 32.Aboutorab, H., Saberi, M., Asadabadi, M. R., Hussain, O. & Chang, E. ZBWM: the Z-number extension of best worst method and its application for supplier development. Expert Syst. Appl.107, 115–125. 10.1016/j.eswa.2018.04.015 (2018). [Google Scholar]
- 33.Liu, F., Liao, H., Wu, X. & Al-Barakati, A. Evaluating internet hospitals by a linguistic Z-number-based gained and lost dominance score method considering different risk preferences of experts. Inf. Sci.630, 647–668. 10.1016/j.ins.2023.02.061 (2023). [Google Scholar]
- 34.Huang, J., Xu, D. H., Liu, H. C. & Song, M. S. A new model for failure mode and effect analysis integrating linguistic Z-numbers and projection method. IEEE Trans. Fuzzy Syst.29, 530–538. 10.1109/TFUZZ.2019.2955916 (2019). [Google Scholar]
- 35.Jin, F., Lin, H. & Zhou, L. Bounded rationality consensus reaching process with prospect theory and preventing individual weight manipulation for multi-attribute group decision making. Inf. Fusion112, 102574. 10.1016/j.inffus.2024.102574 (2024). [Google Scholar]
- 36.Yu, W., Zhang, Z. & Zhong, Q. Consensus reaching for magdm with multi-granular hesitant fuzzy linguistic term sets: a minimum adjustment-based approach. Ann. Oper. Res.300, 443–466. 10.1007/s10479-019-03432-7 (2021). [Google Scholar]
- 37.Zhang, Z. & Li, Z. Personalized individual semantics-based consistency control and consensus reaching in linguistic group decision making. IEEE Trans. Syst. Man Cybern. Syst.52, 5623–5635. 10.1109/TSMC.2021.3129510 (2022). [Google Scholar]
- 38.Cao, M. et al. Social network group decision making: Characterization, taxonomy, challenges and future directions from an ai and llms perspective. Inf. Fusion120, 103107. 10.1016/j.inffus.2025.103107 (2025). [Google Scholar]
- 39.Liu, X., Xu, Y., Gong, Z. & Herrera, F. Democratic consensus reaching process for multi-person multi-criteria large scale decision making considering participants’ individual attributes and concerns. Inf. Fusion77, 220–232. 10.1016/j.inffus.2021.07.023 (2022). [Google Scholar]
- 40.Xu, Y., Wen, X. & Zhang, W. A two-stage consensus method for large-scale multi-attribute group decision making with an application to earthquake shelter selection. Comput. Ind. Eng.116, 113–129. 10.1016/j.cie.2017.11.025 (2018). [Google Scholar]
- 41.Jian-qiang, W., Peng, L., Hong-yu, Z. & Xiao-hong, C. Method of multi-criteria group decision-making based on cloud aggregation operators with linguistic information. Inf. Sci.274, 177–191. 10.1016/j.ins.2014.02.130 (2014). [Google Scholar]
- 42.Wang, J., Wu, J., Wang, J., Zhang, H. & Chen, X. Interval-valued hesitant fuzzy linguistic sets and their applications in multi-criteria decision-making problems. Inf. Sci.288, 55–72. 10.1016/j.ins.2014.07.034 (2014). [Google Scholar]
- 43.Mandala, P., Mrsic, L., Kalampakas, A., Allahviranloo, T. & Samanta, S. Three-way multi-criteria prospect-regret theory and generalised TODIM-based decision-making approach with linguistic information: An application in analysis of heart failure data. Communicated. [DOI] [PMC free article] [PubMed]
- 44.Bell, D. E. Regret in decision making under uncertainty. Oper. Res.30, 297–323 (1982). [Google Scholar]
- 45.Tversky, A. & Kahneman, D. Advances in prospect theory: Cumulative representation of uncertainty. J. Risk Uncertain.5, 297–323. 10.1007/BF00122574 (1992). [Google Scholar]
- 46.Liu, P., Dang, R., Wang, P., Xu, Y. & Zhang, Y. Online–offline combined adaptive hotel recommendation system considering attribute importance and group consensus. Decis. Support Syst.196, 114503. 10.1016/j.dss.2025.114503 (2025). [Google Scholar]
- 47.Mondal, A., Roy, S. K. & Zhan, J. A reliability-based consensus model and regret theory-based selection process for linguistic hesitant-Z multi-attribute group decision making. Expert Syst. Appl.228, 120431. 10.1016/j.eswa.2023.120431 (2023). [Google Scholar]
- 48.Steinhagen, G. A critical analysis of the ORESTE method, its shortcomings and possible alternatives. Comput. Appl. Math.44, 414. 10.1007/s40314-025-03380-y (2025). [Google Scholar]
- 49.Liu, X., Yang, Y. & Jiang, J. The behavioral TOPSIS based on prospect theory and regret theory. Int. J. Inf. Technol. Decis. Making22, 1591–1615. 10.1142/S0219622022500778 (2023). [Google Scholar]
- 50.Zheng, Q., Liu, X., Wang, W. & Han, S. A hybrid HFACS model using DEMATEL-ORESTE method with linguistic Z-number for risk analysis of human error factors in the healthcare system. Expert Syst. Appl.235, 121237. 10.1016/j.eswa.2023.121237 (2024). [Google Scholar]
- 51.Wu, Q., Liu, X., Qin, J., Wang, W. & Zhou, L. A linguistic distribution behavioral multi-criteria group decision making model integrating extended generalized TODIM and quantum decision theory. Appl. Soft Comput.98, 106757. 10.1016/j.asoc.2020.106757 (2021). [Google Scholar]
- 52.Yue, C. Entropy-based weights on decision makers in group decision-making setting with hybrid preference representations. Appl. Soft Comput.60, 737–749. 10.1016/j.asoc.2017.07.033 (2017). [Google Scholar]
- 53.Wu, Z. & Xu, J. Managing consistency and consensus in group decision making with hesitant fuzzy linguistic preference relations. Omega65, 28–40. 10.1016/j.omega.2015.12.005 (2016). [Google Scholar]
- 54.Huang, X., Zhan, J., Xu, Z. & Fujita, H. A prospect-regret theory-based three-way decision model with intuitionistic fuzzy numbers under incomplete multi-scale decision information systems. Expert Syst. Appl.214, 119144. 10.1016/j.eswa.2022.119144 (2023). [Google Scholar]
- 55.Zhang, H., Liu, Y., Selang, D. & He, Y. A three-way decision with prospect-regret theory under pythagorean fuzzy environments. Appl. Soft Comput.167, 112286. 10.1016/j.asoc.2024.112286 (2024). [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data will be made available on request.































































































































































































































































