Skip to main content
Entropy logoLink to Entropy
. 2026 Mar 11;28(3):314. doi: 10.3390/e28030314

Moment Estimation in Paired Comparison Models with a Growing Number of Subjects

Qiuping Wang 1,*, Lu Pan 2, Ting Yan 3
Editor: Nikolai Leonenko
PMCID: PMC13024907  PMID: 41899966

Abstract

When the number of subjects, n, is large, paired comparisons are often sparse. Here, we study statistical inference in a class of paired comparison models parameterized by a set of merit parameters, under an Erdös–Rényi comparison graph, where the sparsity is measured by a probability pn tending to zero. We use the moment estimation base on the scores of subjects to infer the merit parameters. We establish a unified theoretical framework in which the uniform consistency and asymptotic normality of the moment estimator hold as the number of subjects goes to infinity. A key idea for the proof of the consistency is that we obtain the convergence rate of the Newton iterative sequence for solving the estimator. We use the Thurstone model to illustrate the unified theoretical results. Further extensions to a fixed sparse comparison graph are also provided. Numerical studies and real data analysis illustrate our theoretical findings.

Keywords: consistency, central limit theorem, method of moments, paired comparison, parameter estimation, sparse

1. Introduction

Subjects are repeatedly compared in pairs in a wide spectrum of situations, including sports games [1], ranking of scientific journals [2,3], the quality of product brands [4] and crowdsourcing [5]. For instance, one team plays with another team in basketball; papers in one journal cite papers in another journal; one consumer chooses one product over another; workers in a crowdsourcing setup are asked to compare pairs of items.

One of the fundamental problems in paired comparison analysis is to derive a fair and reliable ranking of all subjects based on observed comparison data. In round-robin tournaments—where every pair of subjects competes sufficiently many times—a natural ranking can be directly obtained from the number of wins, as the full pairwise comparisons eliminate biases from incomplete matchups. However, in most practical scenarios (e.g., sports leagues, crowdsourcing evaluations, or journal rankings), comparisons are often sparse (not all pairs interact) and stochastic (outcomes contain random noise), leading to unreliable direct rankings based solely on raw win counts. To address this issue, paired comparison models have been developed to statistically infer the underlying merit parameters of subjects and generate objective rankings; see the classic monograph by [6] for a comprehensive overview of such models and their theoretical foundations. Statistical models not only provide a method of ranking all subjects but are also tools for making inferences on the merits of subjects (e.g., testing whether two subjects have the same merit).

Here, we are concerned with a class of paired comparison models that assign one merit parameter to each subject and assume that the win–loss probability of any pair only depends on the difference between their merit parameters. Specifically, the probability of subject i winning j is

P(iwinsj)=F(βi−βj),i,j=0,1,…,n;i≠j, (1)

where F is a known cumulative distribution function satisfying F(x)=1−F(−x), βi is the merit parameter of subject i and n+1 is the total number of subjects. The well-known Bradley–Terry model [7], which dates back to at least 1929 [8], and the Thurstone model [9], are two special cases of Model (1). The former postulates the logistic distribution of F(x), while the latter postulates the normal distribution.

In the standard setting that n is fixed and the number of comparisons in each pair goes to infinity, the theoretical properties of Model (1) have been widely investigated in Chapter 4 of [6]. In the opposite scenario that n goes to infinity and each pair has a fixed number of comparisons, ref. [10] proved the uniform consistency and asymptotic normality of the maximum likelihood estimator (MLE) in the Bradley–Terry model.

When the number of subjects is large, paired comparisons are often sparse. Taking the NCAA Division I FBS (Football Bowl Subdivision) regular season, for example, a team plays with at most 14 other teams among a total of 120 teams. The observed comparisons can be represented in a comparison graph with n+1 nodes denoting subjects and a weighted edge between two nodes denoting the number of comparisons. The Erdös–Rényi comparison graph has been widely considered in the literature, e.g., [1,11,12,13], where the number of comparisons between any two subjects follows a binomial distribution (T,pn), and pn measures the sparsity. Under a very weak condition on the sparsity on pn, ref. [13] established the uniform consistency and asymptotic normality of the MLE in the Bradley–Terry model by extending the proof strategies in [10].

Moreover, ref. [14] considered a fixed sparse comparison graph by controlling the length from one subject to another subject with 2 or 3, in which the consistency and asymptotic normality of the MLE also hold. Inference in the high-dimensional setting under the Bradley–Terry model and some generalized versions has also attracted great interest in the machine learning literature; the upper bounds of various errors are established under different conditions [e.g., the ℓ1 error ∥β^−β∥1 in [15,16], the mean square error in [17], the bias E∥β^−β∥∞ in [18]. Under the assumption that the log-likelihood function is strictly convex, ref. [1] establish the uniform consistency of the MLE in general paired comparison models. However, the asymptotic theory of moment estimation under sparse paired comparison models remains largely underdeveloped in the literature. Existing theoretical developments focus almost exclusively on maximum likelihood estimation (MLE), which relies on strict distributional assumptions and is computationally demanding in high-dimensional settings. In contrast, this paper develops the method of moments (MOM), which avoids full distribution assumptions and maintains computational simplicity while achieving comparable asymptotic properties. The primary novelty of this work is to extend the asymptotic theory of high-dimensional sparse paired comparison models from MLE to the method of moments, establishing a parallel and complementary theoretical framework.

We further elaborate on the advantages of the method of moments (MOM) for high-dimensional sparse paired comparison models. Beyond computational efficiency, MOM has two key strengths over maximum likelihood estimation (MLE) for practical inference: (1) Robustness—the moment estimator is much less sensitive to outliers (e.g., upsets in our NFL data) in sparse settings, where MLE can be biased by extreme observations; (2) Quasi-likelihood compatibility—MOM relies only on moment conditions and avoids strict distributional assumptions, making it robust to model misspecification in high-dimensional sparse scenarios. These merits justify the use of MOM in this study, and our subsequent analysis establishes its asymptotic properties as the core theoretical contribution.

The main contributions of this paper are as follows. First, we develop the moment estimation, instead of the maximum likelihood estimation (MLE) or Bayesian estimation, based on the scores of subjects (i.e., the number of wins) to estimate the merit parameters in Model (1). The reason why we prioritize moment estimation over MLE is that it is natural to rank subjects according to their scores and the computation based on moment equations is simpler, especially in high-dimensional sparse settings where MLE may suffer from numerical instability due to nonlinear optimization. When F(·) belongs to the exponential family distribution, both estimations are identical. Second, under an Erdös–Rényi comparison graph, we establish a unified theoretical framework in which the uniform consistency and asymptotic normality of the moment estimator hold when n goes to infinity and pn tends to zero. A key idea for the proof of the consistency is that we obtain the convergence rate of the Newton iterative sequence for solving the estimator. The asymptotic normality is proved by applying Taylor expansions to a series of functions constructed from estimating equations and showing that remainder terms in the expansions are asymptotically neglected. Although each pair of subjects is assumed to have a comparison with the same probability pn, our proof strategy can be easily extended to the case with different comparison probabilities at the order of pn. Third, we use the Thurstone model to illustrate the unified theoretical results. Further extensions to a fixed sparse comparison graph in [14] are also derived. Numerical studies and real data analysis illustrate our theoretical findings.

The rest of this paper is organized as follows. In Section 2, we present the moment estimation. In Section 3, we present the consistency and asymptotic normality of the moment estimator. We illustrate our unified results with one application in Section 4. We extend the asymptotic results to a fixed comparison graph in Section 5. In Section 6, we carry out simulations and give real data analysis. We give a summary and further discussion in Section 7. The proofs of the main results are relegated to Appendix A. The proofs of supported lemmas are relegated to Appendix B.

2. Moment Estimation

Assume that n+1 subjects that are labeled as “0,…,n”, are compared in pairs repeatedly. Let tij be the times that subject i compares with subject j and aij be the times that subject i wins subject j out of tij comparisons. As a result, aij+aji=tij. By convention, define tii=0 and aii=0. The comparison matrix (tij)(n+1)×(n+1) is generated from an Erdös–Rényi comparison graph, where tij follows a binomial distribution Bin(T,pn) with pn measuring the sparsity of comparisons. More generally, tij∼Bin(Tij,pn). We set Tij to be the same for ease of exposition. Recall that β0,…,βn are the merit parameters of subjects 0,…,n. The probability in Model (1) implies that the winning probability only depends on the difference in merit between two subjects. For the identification of models, we normalize βi,i=0,1,…,n by setting β0=0 as in [10]. We assume that all paired comparisons are independent and aij follows a binomial distribution Bin(tij,pij) conditional on tij.

Let ai=∑j=0naij be the total wins of subject i and a=(a1,…,an)⊤. To motivate the estimating equations, we compare the maximum likelihood equation and the moment equation under the Thurstone model described in Section 4. The maximum likelihood equations are

∑j≠iaijϕ(βi−βj)Φ(βi−βj)−(tij−aij)ϕ(βi−βj)1−Φ(βi−βj)=0,i=1,…,n.

where ϕ(·) is the density function of the standard normality and Φ(·) is its distribution function. The corresponding moment equations are

ai=∑j≠itijΦ(βi−βj),i=1,…,n.

We can see that the latter is simpler and easier to compute. On the other hand, it is natural to rank subjects according to their scores. Thus, we use the moment estimation here. When F(·) in Model (1) belongs to the exponential family distributions, both are the same.

Write μ(·) as the expectation of F(·) and μij(β)=μ(βi−βj). Then, the estimating equations are

ai=∑j≠itijμij(β),i=1,…,n. (2)

The solution to the above equations is the moment estimator denoted by β^=(β^1,…,β^n)⊤ and β^0=0. Let

φ(β)=(∑j≠1tijμ1j(β),…,∑j≠ntnjμnj(β))⊤.

If φ(β):Rn→(0,∞) is a one-to-one mapping, then β^ exists and is unique, i.e., β^=φ−1(a). When φ−1 does not exist (i.e., φ is not one-to-one), any solution β^ of Equation (2) is a moment estimator of β. The Newton–Raphson algorithm can be used to solve Equation (2). Moreover, the R language provides the package “BradleyTerry2” to solve the estimator in the Bradley–Terry model.

We discuss the existence of β^ from the viewpoint of graph connection. If the comparison graph with the matrix (tij)i,j=0,…,n as its adjacency matrix is not connected, then there are two empty sets such that there are no comparisons between subjects in the first set and those in the second. In this case, there is no basis for ranking subjects in the first set and those in the second set. Further, a necessary condition for the existence of β^ is that the directed graph Gn with the win–loss matrix A=(aij) as its adjacency matrix is strongly connected. In other words, for every partition of the subjects into two nonempty sets, a subject in the second set beats a subject in the first at least once. To see this, assume that there are two empty sets B1 and B2 such that all subjects in B1 win all comparisons with subjects in B2. Without loss of generality, we set B1={0,…,m} and B2={m+1,…,n} with 0≤m<n, where aij=tij for i∈B1 and j∈B2. By summing ai over i=0,…,m, we have

∑i=0mai=∑i=0m∑j=0mtijμ(βi−βj)+∑i=0m∑j=m+1ntijμ(βi−βj).

Because ai is a sum of aij, j=0,…,n, and μ(βi−βj)+μ(βj−βi)=1, we have

∑i=0m∑j=m+1naij=∑i=0m∑j=m+1ntijμ(βi−βj).

Because aij=tij for i=0,…,m and j=m+1,…,n and at least such one tij>0, it must be μ(βi−βj)=1 when tij>0 in order to guarantee both sides in the above equation to be equal. In this case, at least one such difference βi−βj must go to infinity such that the moment estimate does not exist. The strong connection of Gn is also sufficient for guaranteeing the existence of the MLE in the Bradley–Terry model [19] in which the moment estimator is equal to the MLE. It is interesting to see whether the strong connection of Gn is sufficient to guarantee the existence of β^ in a general model. In the next section, we will show that β^ exists with probability approaching one under some mild conditions.

3. Asymptotic Properties

In this section, we present the consistency and asymptotic normality of the moment estimator. We first introduce some notations. For a subset C⊂Rn, let C0 and C¯ denote the interior and closure of C, respectively. For a vector x=(x1,…,xn)⊤∈Rn, denote ∥x∥ by a vector norm with the ℓ∞-norm, ∥x∥∞=max1≤i≤n|xi|, and the ℓ1-norm, ∥x∥1=∑i|xi|. Let B(x,ϵ)={y:∥x−y∥∞≤ϵ} be an ϵ-neighborhood of x. For an n×n matrix J=(Jij), let ∥J∥∞ denote the matrix norm induced by the ℓ∞-norm on vectors in Rn, i.e.,

∥J∥∞=maxx≠0∥Jx∥∞∥x∥∞=max1≤i≤n∑j=1n|Jij|,

and let ∥J∥ be a general matrix norm. Define the matrix maximum norm: ∥J∥max=maxi,j|Jij|. We use the superscript “*” to denote the true parameter under which the data are generated. When there is no ambiguity, we omit the superscript “*”.

Recall that μ(·) is the expectation of F(·). We assume that μ(·) is a continuous function with the third derivative. Write μ′ and μ″ as the first and second derivatives of μ(π) on π, respectively. Let ϵn be a small positive number. When β∈B(β∗,ϵn), we assume that there are three positive numbers, bn0,bn1,bn2, such that

[mini,jμ′(πij)]·[maxi,jμ′(πij)]>0, (3a)
bn0≤mini,j|μ′(πij)|≤maxi,j|μ′(πij)|≤bn1, (3b)
maxi,j|μ″(πij)|≤bn2, (3c)

where πij:=βi−βj.

We use the Bradley–Terry model to illustrate the above inequalities, where μ(x)=ex/(1+ex). A direct calculation gives that

μ′(x)=ex(1+ex)2,μ″(x)=ex(1−ex)(1+ex)3.

It is easy to show that

bn0=e2∥β∗∥∞+2ϵn(1+e2∥β∗∥∞+2ϵn)2≤|μ′(x)|≤bn1=14,|μ″(x)|≤bn2=14. (4)

If ϵn=o(1), then 1/bn0=O(e2∥β∗∥∞).

3.1. Consistency

To establish the consistency of β^, let us first define a system of functions:

Hi(β)=∑j=0ntijμij(β)−ai,i=0,…,n, (5)

and H(β)=(H1(β),…,Hn(β))⊤. It is clear that H(β^)=0. Let H′(β) be the Jacobian matrix of H(β) on the parameter β. The asymptotic behavior of β^ depends crucially on the inverse of H′(β). For convenience, denote H′(β) as V=(vij)i,j=1,…,n, where

vij=−tijμ′(πij),i≠j,vii=∑j=0,j≠intijμ′(πij).

Define

vi0=v0i:=∑j=0,j≠invij−vii=−t0iμ′(π0i),i=1,…,n,v00=∑j=1nt0jμ′(π0j).

When β∈B(β∗,ϵn) and mini,jμ′(πij)>0, in view of inequality (3b), the entries of V satisfy the following inequalities:

ifti0>0,ti0bn0≤vii+∑j=1,j≠invij≤ti0bn1,i=1,…,n,iftij>0,tijbn0≤−vij≤tijbn1,i,j=1,…,n;i≠j. (6)

Without loss of generality, we assume that mini≠jμ′(πij)>0 when β∈B(β∗,ϵn) hereafter (otherwise, we redefine Hi(β)=ai−∑j≠iμij(β) and repeat a similar process). Our strategy for the proof of consistency crucially depends on the existence of the inverse of V, which requires that V is a full rank matrix. It is easy to show that V is positively semi-definite. Thus, if V has a full rank, then V must be positively definite. The following lemma assures the existence of the inverse of V.

Lemma 1.

Assume that mini,jμij′(β)>0. With probability at least 1−(1−pn)nT, H′(β) is positively definite.

Because log(1−x)≤−x when x∈(0,1), we have

enTlog(1−pn)≤e−pnTn.

The probability of the nonexistence of V−1 is less than e−pnTn, going exponentially fast to zero. Generally, the inverse of V does not have a closed form. Ref. [20] proposed to approximate the inverse of V, V−1, by the matrix S=(sij)n×n, where

sij=δijvii+1v00. (7)

In the above equation, δij=1 if i=j; otherwise, δij=0. By extending the proof of [20] to the sparse case, the upper bound of the approximate error ∥V−1−S∥max is given in Lemma A2.

Recall that the main idea of the proof of the consistency in the Bradley–Terry model [10,14] contains two parts. Let u^i=eβ^i, ui=eβi, i0=argmaxiu^i/ui and i1=argminiu^i/ui. Since u^0/u0=1, it suffices to show that the ratio of subject i0, u^i0/ui0, and the ratio of i1, u^i1/ui1 are very close. With the nice mathematical properties of the logistic function μ(x)=ex/(1+ex), the first part is to show that there are a number of subjects satisfying the following inequalities:

b∑{j:ti0,j>0}(u^i0/ui0−u^j/uj)≤c,b∑{j:ti1,j>0}(u^j/uj−u^i0/ui0)≤c, (8)

where b and c are certain numbers. The second part is to eliminate common terms u^j/uj based on the condition that the number of the common neighbors between any two subjects, mini,j#{k:tik>0,tjk>0}, is at least τn, where τ=1 in [10] and τ∈(0,1) in [14]. In the Erdös–Rényi comparison graph, [13] further showed that there is at least one subject with its ratio close to both u^i0/ui0 and u^i1/ui1.

The aforementioned strategies for the proof of consistency are built on the the premise of the existence of the MLE, which is guaranteed by the necessary and sufficient condition that the directed graph with the win–loss matrix as its adjacency matrix is strongly connected [19]. As discussed before, it may be difficult to find the minimal sufficient condition to guarantee the existence of β^ in general paired comparison models. To overcome this difficulty, we aim to obtain the convergence rate of the Newton iterative sequence for solving Equation (2). Under the well-known Newton–Kantorich conditions, the Newton iterative sequence converges, and its limiting point is the solution. We apply an adjusted version of the Newton–Kantorich theorem in [21] to this end, which not only guarantees the existence of the solution but also gives an optimal error bound for the Newton iterative sequence.

Now, we formally state the consistency result.

Theorem 1.

Assume that Conditions (3a), (3b) and (3c) hold. If bn14bn2/(bn06pn4)=o((n/logn)1/2), then β^ exists with probability approaching one and is uniformly consistent in the sense that

∥β^−β∗∥∞=Opbn12bn03pn2lognn=op(1). (9)

To see how small pn could be, we consider a special case that β∗ is a constant vector, in which bn0,bn1 and bn2 are also constants. According to the above theorem, if pn>O((logn/n)1/8), then ∥β^−β∗∥∞=Op(pn−2(logn/n)1/2).

3.2. Asymptotic Normality of β^

We establish the asymptotic distribution of β^ by characterizing its asymptotical representation. In detail, we apply a second-order Taylor expansion to H(β^) and find that β^−β∗ can be represented as the sum of a main term V−1(a−E∗a) and an asymptotically neglected remainder term, where E∗ denotes the conditional expectation conditional on {tij:i,j=0,…,n}. Because V−1 does not have a closed form, we use the matrix S defined in (7) to approximate it. We formally state the asymptotic normality of β^ as follows.

Theorem 2.

Let V=∂H(β∗)/∂β and U=(uij):=Var(a|tij,0≤i,j≤n). If bn2bn16bn0−9pn−6=o(n1/2/logn), then for fixed k, the vector ((β^1−β∗),…,(β^k−βk∗)) follows a k-dimensional multivariate normal distribution with mean zero and the covariance matrix Σ=(σij)k×k, where

σij=δijuiivii2+u00v002. (10)

Remark 1.

If U=V, then σij is equal to δij/vii+1/v00. When F(·) belongs to the exponential family distribution (e.g., the Bradley–Terry model), U is identical to V. If U≠V, then the asymptotic variance of β^i is involved with an additional factor uii. The asymptotic variance of β^i is on the order of (npn)−1/2 if β∗ is bounded above by a constant.

4. Application to the Thurston Model

In this section, we illustrate the unified theoretical result by the application to the Thurston model.

The original Thurston model has a variance σ2 in the normal distribution, i.e., the probability that subject i is preferred over j is F((βi−βj)/σ). Since the merit parameters are scale invariable, we simply set σ=1 hereafter. Recall that ϕ(x)=(2π)1/2e−x2/2 is the standard normal density function and Φ(x)=∫−∞xϕ(x)dx is the distribution function of the standard normality. In the Thurston model, μ(x)=Φ(x). Then,

μ′(x)=ϕ(x),μ″(x)=x2πe−x2/2.

Since ϕ(x)=(2π)1/2e−x2/2 is an decreasing function on |x|, we have when |x|≤Qn,

12πe−Qn2/2≤ϕ(x)≤12π.

Let h(x)=xe−x2/2. Then, h′(x)=(1−x2)e−x2/2. Therefore, when x∈(0,1), h(x) is an increasing function on its argument x; when x∈(1,∞), h(x) is an decreasing function on x. As a result, h(x) attains its maximum value at x=1 when x>0. Since h(x) is a symmetric function, we have |h(x)|≤e−1/2≈0.6. Therefore,

bn0=12πe−(∥β∗∥∞+ϵn)2/2,bn1=12π,bn2=(2πe)−1/2.

In view of Theorems 1 and 2, we have the following corollary.

Corollary 1.

If bn14bn2/(bn06pn2)=o((n/logn)1/2) and pn>24logn/n, then β^ exists with probability approaching one and is uniformly consistent in the sense that

∥β^−β∗∥∞=Opbn12bn03pnlognn=op(1). (11)

Let V=∂H(β∗)/∂β. If bn2bn16bn0−9=o(n1/2/logn), then for fixed k, the vector ((β^1−β∗),…,(β^k−βk∗)) follows a k-dimensional multivariate normal distribution with mean zero and the covariance matrix Σ=(σij)k×k defined at (10).

5. Extension to a Fixed Sparse Design

In some applications such as sports, the comparison graph may be fixed, not random. For example, in the regular season of the National Football League (NFL), games are scheduled in advance. More specially, there are 32 teams in the 2 conferences of the NFL that are divided into 8 divisions, each consisting of 4 teams. In the regular season, each team plays 16 matches, 6 within the division and 10 between the divisions. Motivated by the design, ref. [14] proposed a sparse condition to control the length from one subject to another subject with 2 or 3:

τn:=min0≤i<j≤n#{k:tik>0,tjk>0}t.

That is, τn is the minimum ratio of the total number of paths between any i and j with length 2 or 3. Under the Erdös–Rényi comparison graph, there are similar sparsities. Specifically, the set of common neighbors of any two subjects i and j has at least the following size:

#{k:tik>0,tjk>0}≥12(n−1)pn2,

with a probability of at least 1−O(1/n) if npn2≥24logn; see (A12) in the proof of A2.

We assume that if two subjects have comparisons, they are compared T times, in accordance with the aforementioned setting for easy of exposition. Similar to Lemma A2, the approximate error of using S to approximate V−1 is

∥V−1−S∥max≤2T2bn12ρmaxbn03τn3n2,

where ρmax=tmax/n and tmax=maxiti. With similar lines of argument as in the proofs of Theorems 1 and 2, we have the following theorem, whose proof is omitted.

Theorem 3.

Assume that conditions (3a), (3b) and (3c) hold. If bn14bn2/(bn06τn2)=o((n/logn)1/2), then β^ exists with probability approaching one and is uniformly consistent in the sense that

∥β^−β∗∥∞=Opbn12bn03τnlognn=op(1). (12)

Let V=∂H(β∗)/∂β and U=(uij):=Var(a|tij,0≤i,j≤n). If bn2bn16bn0−9τn−3=o(n1/2/logn), then for fixed k, the vector ((β^1−β∗),…,(β^k−βk∗)) follows a k-dimensional multivariate normal distribution with mean zero and the covariance matrix Σ=(σij)k×k, where σij is given in (7).

6. Numerical Studies

In this section, we evaluate the asymptotic results of the moment estimator in the Thurston model through simulation studies and a real data example.

6.1. Simulation Studies

We carry out simulations to evaluate the finite sample performance of the moment estimator in the Thurston model. We set T=1, which means that any pair has one comparison with probability pn and no comparison with probability 1−pn. Let c be a constant. We set the merit parameters to be a linear form, i.e., βi∗=iclogn/n for i=1,…,n, where β0∗=0. We considered four different values for c as c=0.3,0.5,0.8. By allowing ∥β∗∥∞ to grow with n, we intended to assess the asymptotic properties under different asymptotic regimes.

In order to see how small pn could be, we first evaluate the fail frequency that the “win–loss” graph Gn is strongly connected, which is the necessary condition to guarantee the moment estimator exists. We set c to be fixed with c=0.4. The results are shown in Table 1 with 1000. We can see that the necessary condition did not hold in each simulation when pn=logn/n, while it holds with almost 100% frequency when pn=(logn/n)1/2. This shows that it is necessary to control the rate of pn tending to zero.

Table 1.

The fail frequency (×100%).

pn n=100 n=500 n=1000
(logn/n)1/2 0.5 0 0
(logn/n)2/3 25.8 0.2 0
logn/n 100 100 100

Based on Theorem 2, ξ^ij=[β^i−β^j−(βi∗−βj∗)]/(u^ii/v^ii2+u^00/v^002)1/2 converges in distribution to the standard normality, where u^ii and v^i,i are the estimates of uii and vii by replacing β∗ with β^. Therefore, we assessed the asymptotic normality of ξ^ij via the coverage probability of the 95% confidence interval and the length of the confidence interval. The times that β^ failed to exist were also recorded. Two values, n=100 and n=200, were considered for the number of subjects. Each simulation was repeated 10,000 times.

The simulation results are shown in Table 2. When pn=(logn/n)1/4, all simulated coverage probabilities are very close to the target level 95%. On the other hand, when pn=(logn/n)1/2, they are a little lower than the normal level in the case n=100 and are very close to 95% in the case n=200. The length of the confidence interval decreases as n increases, which qualitatively agrees with the theory. It is also expected that the length of the confidence interval increases as pn decreases when n is fixed. Another phenomenon is that the length of the confidence interval under three distinct c has little difference when n and pn are fixed.

Table 2.

The reported values are the coverage frequency (×100%) for βi−βj for a pair (i,j)/length of the confidence interval/fail probabilities (×100%).

pn=(logn/n)1/4
n i c=0.2 c=0.5 c=0.8
100 (1,2) 94.5/1.04/0 94.62/1.06/0 94.62/1.06/0
(49,50) 94.97/1.04/0 94.34/1.04/0 94.34/1.04/0
(99,100) 95.12/1.04/0 94.99/1.06/0 94.99/1.06/0
200 (1,2) 95.18/0.78/0 94.71/0.79/0 94.71/0.79/0
(99,100) 95.14/0.78/0 94.49/0.78/0 94.49/0.78/0
(199,200) 94.82/0.78/0 94.64/0.79/0 94.64/0.79/0
pn=(logn/n)1/2
n i c=0.2 c=0.4 c=0.6
100 (1,2) 93.28/1.58/0.19 93.48/1.60/0.49 93.48/1.60/1.15
(49,50) 93.85/1.58/0.19 93.94/1.58/0.49 93.94/1.58/1.15
(99,100) 93.80/1.58/0.19 93.96/1.61/0.49 93.96/1.61/1.15
200 (1,2) 94.04/1.26/0 93.89/1.28/0 93.89/1.28/0
(99,100) 94.14/1.26/0 94.22/1.26/0 94.22/1.26/0
(199,200) 94.38/1.26/0 93.98/1.28/0 93.98/1.28/0

6.2. A Real Data Example

We use the 2018 NFL regular season data as an illustrative example, which is available from https://www.espn.com/nfl/schedule/_/year/2018 (accessed on 20 August 2025). The NFL league consists of thirty-two teams that are divided evenly into two conferences, and each conference has four divisions that have four teams each. In the regular season, each team plays with three intra-division teams (each twice) and ten games with ten inter-division teams (each once). As discussed in [14], the design of the NFL regular season satisfies the sparsity condition of the fixed comparison graph, where τn=1/16. We removed two ties before our analysis. The fitted merits that were obtained from fitting the Thurstone model for the remaining data are given in Table 3, where we used “Arizona Cardinals” with the smallest number of wins as the baseline (with β^0=0).

Table 3.

The fitted merit β^i, the number of wins ai, and the standard error σ^i.

American Football Conference National Football Conference
Division Team β^i ai σ^i Division Team β^i ai σ^i
East New England Patriots 1.452 11 0.519 East Dallas Cow boys 1.284 10 0.512
New York Jets 0.338 4 0.530 Philadelphia Eagles 1.193 9 0.511
Miami Dophins 0.718 7 0.509 New York Giants 0.423 5 0.514
Buffalo Bills 0.673 6 0.514 Washington Redskins 0.756 7 0.511
North Baltimore Ravens 1.382 10 0.514 North Chicago Bears 1.494 12 0.532
Cincinnati Bengals 0.769 6 0.514 Green Bay Packers 0.595 6 0.522
Pittsburgh Steelers 1.337 9 0.52 Minnesota Vikings 1.059 8 0.523
Cleveland Browns 0.968 7 0.519 Detroit Lions 0.579 6 0.516
South Indianapolis Colts 1.244 10 0.512 South New Orleans Saints 1.908 13 0.544
Houston Texans 1.430 11 0.516 Atlanta Falcons 0.767 7 0.512
Tennessee Titans 1.205 9 0.51 Carolina Panthers 0.840 7 0.511
Jacksonville Jaguars 0.591 5 0.517 Tampa Bay Buccaneers 0.506 5 0.52
West Kansas City Chiefs 1.762 12 0.537 West Los Angeles Rams 1.963 13 0.559
Denver Broncos 0.713 6 0.523 San Francisco 49ers 0.166 4 0.54
Oakland Raiders 0.365 4 0.537 Seattle Seahawks 1.305 10 0.525
Los Angeles Chargers 1.748 12 0.536 Arizona Cardinals 0 3 0.555

It is interesting to compare the ordering of six playoff seeds of the two conferences with the NFL rules with the ordering by their fitted merits in Table 3. The NFL rules are based on the regular season won–lost percentage record (PCT) and can be briefly summarized as follows: the teams in each division with the best PCT are seeded one through four; another two teams from each conference are seeded five and six based on their PCT. The six playoff seeds in the American Football Conference from No. 1 to No. 6 based on the PCT are Kansas City Chiefs, New England Patriots, Pittsburgh Steelers, Houston Texans, Los Angeles Chargers, and Indianapolis Colts, while the selected teams based on the fitted merits are Kansas City Chiefs, New England Patriots, Houston Texans, Baltimore Ravens, Los Angeles Chargers, and Pittsburgh Steelers. The corresponding six playoff seeds in the National Football Conference based on the PCT are Los Angeles Rams, New Orleans Saints, Chicago Bears, Washington Redskins, Seattle Seahawks, and Carolina Panthers, while the selected teams base on the fitted merits are Los Angeles Rams, New Orleans Saints, Chicago Bears, Dallas Cow boys, Seattle Seahawks, and Philadelphia Eagles. As we can see, the selected top three teams based on the PCT and the fitted merits in each conference are the same, and the selected teams from No. 4, No. 5 and No. 6 are not all the same.

7. Summary and Discussion

We have presented the moment estimation based on the scores of subjects in the paired comparison model under sparse comparison graphs. We have established the uniform consistency and asymptotic normality of the moment estimator. The consistency is shown by obtaining the convergence rate of the Newton iterative sequence. This leads to a condition on the sparsity parameter pn requiring that pn≥O((logn/n)1/8) if β∗ is a constant vector. We note that this condition looks much stronger than that in the Bradley–Terry model in [13]. Since we consider a general model, it would seem to be suitable that a more severe condition is imposed. On the other hand, the condition imposed on bn0 may not be the best possible condition. In particular, the conditions for guaranteeing the asymptotic normality seem stronger than those needed for the consistency. Note that the asymptotic behavior of the moment estimator depends not only on bn0 but also on the configuration of all parameters. It would be of interest to investigate whether these conditions could be relaxed.

In this paper, we assume that given the comparison graph, all paired comparisons are independent. Note that the moment equation holds regardless of whether comparisons are independent.

When comparisons are not independent, the moment estimation still works. The consistency result in Theorem 1 still holds as long as there is the same order of the upper bound of ai−E∗ai in Lemma A4. In fact, the independence assumption is not directly used when checking our proofs. It is only used in Lemma A4 to derive the upper bound of ai−E∗ai using the Hoeffding inequality. Analogously, the independence assumption is used to derive the central limit theorem of ai−E∗ai. In the dependence case, there are also many Hoeffding-type exponential tail inequalities (e.g., [22,23,24]) and cental limit theorems for sums of a sequence of random variables (e.g., [25,26]) to apply.

Building on the theoretical and empirical findings of this study, we identify two promising avenues for further exploration, which not only address the current limitations but also extend the moment estimation framework to more complex and practical scenarios: 1. Moment estimation for paired comparison models with dependent outcomes. This paper assumes that all paired comparison outcomes are independent, which is a standard but restrictive assumption in many real-world settings (e.g., crowdsourcing evaluations where raters may have consistent biases, or sports leagues where team performance is serially correlated). A natural extension is to develop moment estimation methods for models with dependent outcomes, such as incorporating Markovian dependence or exchangeable correlation structures. Key challenges include deriving unbiased moment equations under dependence and establishing asymptotic properties (consistency, asymptotic normality) using tools from dependent random variable theory (e.g., Hoeffding-type inequalities for associated variables [22,23,24]). 2. High-dimensional sparse paired comparison models with structured merit parameters. This study focuses on unstructured merit parameters (i.e., βi are independent). However, in many applications, merit parameters often exhibit inherent structures, such as group-level homogeneity (e.g., teams in the same sports division share similar strengths) or sparsity (e.g., only a few subjects have distinct merits in large-scale crowdsourcing). Extending the moment estimation framework to incorporate such structures (e.g., group lasso-penalized moment estimation, sparse merit parameter inference) would improve estimation efficiency. Key research questions include designing computationally feasible penalized moment equations and establishing oracle properties for the structured estimators. These directions align with the core theme of sparse paired comparison inference and address practical limitations of the current work. We believe pursuing these avenues will not only extend the theoretical scope of moment estimation but also broaden its applicability to more complex real-world problems.

Appendix A

In this section, we present the proofs of the theorems.

Appendix A.1. Preliminaries

We state two preliminary results firstly, which will be used in the proofs. The first result is the optimal error bound in the Newton method in [21] under the Kantorovich conditions [27].

Lemma A1

([21]). Let X and Y be Banach spaces, D be an open convex subset of X and F: D⊆X→Y be Fréchet differentiable. Assume that, at some x0∈D, F′(x0) is invertible and that

∥F′(x0)−1(F′(x)−F′(y))∥≤K∥x−y∥,x,y∈D, (A1)
∥F′(x0)−1F(x0)∥≤η,h=Kη≤1/2,S¯(x0,t∗)⊆D,t∗=2η/(1+1−2h). (A2)
  • Then: (1) The Newton iterates xn+1=xn−F′(xn)−1F(xn), n≥0 are well-defined, lie in S¯(x0,t∗) and converge to a solution x∗ of F(x)=0.

  • (2) The solution x∗ is unique in S(x0,t∗∗)∩D, t∗∗=(1+1−2h)/K if 2h<1 and in S¯(x0,t∗∗) if 2h=1.

  • (3) ∥x∗−xn∥≤t∗ if n=0 and ∥x∗−xn∥≤21−n(2h)2n−1η if n≥1.

The second result is the approximate error of using S to approximate V−1, whose proof is in the Appendix B.

Lemma A2.

If pn≥24logn/n, then for sufficiently large n with a probability of at least 1−O(n−1), we have

∥V−1−S∥max≤12Tbn12bn03n(n−1)pn3.

Appendix A.2. Proof of Theorem 1

We aim to show Theorem 1 by obtaining the convergence rate of the Newton iterative sequence in view of Lemma A1, which requires us to verify the Kantovorich conditions (A1) and (A2). Condition (A1) depends on the Lipschitz continuous form of Hi′(β). Recall that tmax=maxi=0,…,nti and tmin=mini=0,…,nti.

Lemma A3.

Let D=B(β∗,ϵn)(⊂Rn) be an open convex set containing the true point β∗. For any given set {tij,0≤i,j≤n}, if Inequality (3c) holds, then

maxi=0,…,n∥Hi′(x)−Hi′(y)∥1≤4bn2tmax∥x−y∥∞.

Moreover, Condition (A1) also depends on the magnitudes of |ai−E(ai|tij,j=0,…n)|, i=0,…,n, which are stated below.

Lemma A4.

With a probability of at least 1−O(1/n), we have

maxi=0,…,n|ai−E(ai|tij,j=0,…,n)|≤2logntmax.

The following results are the lower bound of tmin and the upper bounds of tmax and of ∑iti.

Lemma A5.

(1) With probability at least 1−(n+1)exp(−18nTpn),

tmin=mini=0,…,nti≥12nTpn.

(2) With probability at least 1−(n+1)exp(−110nTpn),

tmax=maxi=0,…,nti≤32nTpn.

(3) With probability at least 1−exp(−110n(n+1)Tpn,

∑i=0nti≤3n(n+1)Tpn.

We are now ready to prove Theorem 1.

Proof of Theorem 1.

Note that β^ is the solution to the equation H(β) = 0. We prove the consistency by obtaining the convergence rate of the Newton iterative sequence: β(k+1)=β(k)−[H′(β(k))]−1H(β(k)), where we set β(0):=β∗. To apply Lemma A1, we choose the convex set D=B(β∗,ϵn). The following calculations are based on the event En:

{tij,0≤i,j≤n:maxi|ai−E(ai|tij,j=0,…,n)|≤2tmaxlogn,H′(β)>0,tmin≥T2npn,tmax≤32nTpn}.

Note that bn0≤|μij′(β)|≤bn1 when β∈B(β∗,ϵn). Let V=(vij)n×n=H′(β∗). We use S defined in (7) to approximate V−1 and let W=V−1−S. We verify the Kantovorich conditions in Lemma A1 as follows. Since ∑i=0nHi(β)=0, we have

∑i=1nHi(β)=−H0(β).

Based on Lemma A3, we have

∥[H′(β∗)]−1[H′(x)−H′(y)]∥∞≤∥S[H′(x)−H′(y)]∥∞+∥W[H′(x)−H′(y)]∥∞≤maxi=1,…,n1vii∥Hi′(x)−Hi′(y)∥1+1v00∥H0′(x)−H0′(y)∥1+∥W∥∞∥H′(x)−H′(y)∥∞≤[2bn0tmin+n·12bn12Tn(n−1)bn03pn3]×4bn2tmax×∥x−y∥∞=O(bn12bn2bn03pn2)×∥x−y∥∞.

Thus, we can set K=O(bn12bn2bn0−3ηn−1) in (A1). Again, based on the event En, we have

η=∥[H′(β∗)]−1H(β∗)∥∞≤n∥V−1−S∥max∥H(β∗)∥∞+maxi=1,…,n|Hi(β∗)|vii+|H0(β∗)|v00≤O(bn12nbn03pn3)+O(1bn0tmin)×O((tmaxlogn)1/2)=Obn12bn03pn2lognn.

If

Kη=Obn14bn2bn06pn4lognn=o(1), (A3)

then this verifies Condition (A2). Based on Lemma A1, limkβ(k) exists, denoted by β^, and it satisfies

∥β^−β∗∥∞=Obn12bn03pn2lognn.

Based on Lemmas 1, A2, A4 and A5, the event En holds with a probability of at least 1−O(n−1) if pn≥24logn/n. Note that (A3) implies pn≥24logn/n. This completes the proof. □

Appendix A.3. Proofs for Theorem 2

Write Var∗ and E∗ as the conditional variance and conditional expectation given tij for 0≤i,j≤n. Let U=(uij):=Var∗(a). In the Bradley–Terry model, U=H′(β∗). Note that ai is a sum of ti independent Bernoulli random variables. Based on Lemma A5, we know that miniti=Op(npn). Let σmin=mini≠jpij(1−pij). If npnσmin→∞, then miniuii→∞. Based on the central limit theorem in the bound case, as in [28] (p. 289), if npnσmin→∞, then uii−1/2{ai−E∗(ai)} converges in distribution to the standard normal distribution. When considering the asymptotic behaviors of the vector (a1,…,ar) with a fixed r, one could replace the degrees a1,…,ar by the independent random variables a˜i=ai,r+1+…+ain, i=1,…,r. Therefore, we have the following proposition.

Proposition A1.

If npnσmin→∞, then as n→∞, for any fixed r≥1, the components of (a1−E∗(a1),…,ar−E∗(ar)) are asymptotically independent and normally distributed with variances u11,…,urr, respectively. Moreover, the first r rows of S(a−E∗(a)) are asymptotically normal with covariance matrix Σ=(σij), where

σij=δijuiivii2+u00v002.

Lemma A6.

Let V=H′(β∗) and W=V−1−S and Cov∗(·)=Cov(·|tij,0≤i,j≤n). Then,

Cov∗(WH′(β∗))=Op(bn15n2bn06pn5).

Further, if U=H′(β∗), then

Cov∗(WH′(β∗))=Op(bn12n2bn03pn5).

Now, we are ready to prove Theorem 2.

Proof of Theorem 2.

Let π^ij=β^i−β^j and πij∗=βi∗−βj∗. Based on Theorem 1, β^∈B(β∗,ϵn). To simplify notations, write μij′=μ′(πij∗). Based on a second-order Taylor expansion, we have

tijμ(π^ij)−tijμ(πij∗)=tijμij′(β^i−βi∗)−tijμij′(β^j−βj∗)+gij,i≠j, (A4)

where gij is the second-order remainder term:

gij=tijμ″(π˜ij)[(β^i−βi)2+(β^j−βj)2−2(β^i−βi)(β^j−βj)].

In the above equation, π˜ij lies between πij∗ and π^ij. If bn14bn2bn0−6pn−4=o((n/logn)1/2), based on Theorem 1, we have

∥β^−β∗∥∞=Opbn12bn03pn2lognn.

Therefore, in view of (3c), |μij″(π˜ij)|≤tijbn2 such that

|gij|≤4bn2tij∥β^−β∗∥∞2. (A5)

Let gi=∑j≠igij, i=0,…,n, and g=(g1,…,gn)⊤. Then, based on Lemma A5 (2), we have

maxi=0,…,n|gi|=4bn2tmax·Opbn14lognnbn06pn4=Opbn14bn2lognbn06pn3. (A6)

By writing the equation in (A4) into a matrix form, we have

E∗a−a=V(β^−β∗)+g. (A7)

Equivalently,

β^−β∗=V−1(E∗a−a)+V−1g. (A8)

Similarly, we have

E∗a0−a0=∂H0(β∗)∂β(β^−β∗)+12(β^−β∗)⊤∂2H0(β˜)∂β∂β⊤(β^−β∗)=−∑i=1nvi0(β^i−βi∗)+12vi0(β^i−βi∗)2.

Therefore, based on Lemma A5 (2), we have

|E∗a0−a0+∑i=1nvi0(β^i−βi∗)|=Opbn14tmaxlognnbn06pn4=Opbn14lognbn06pn3.

Note that ∑i=0nai−E∗(ai)=0. Multiplying both sides of (A7) by a row vector with all element 1 yields

∑i=1ngi=a0−E∗a0+∑i=1nvi0(β^i−βi∗).

Therefore, we have

|∑i=1ngi|=Opbn14lognbn06pn3. (A9)

Based on (A6) and Lemma A2, we have

∥V−1g∥∞≤∥Sg∥∞+∥(V−1−S)g∥∞≤maxi=1,…,n1vii|gi|+1v00|∑i=1ngi|+n∥V−1−S∥max∥g∥∞=Opbn2tminbn0+bn12nbn03pn3×Opbn14bn2lognbn06pn3=Op(bn2bn16lognnbn09pn6).

If bn2bn16bn0−9pn−6=o(n1/2/logn), then we have

β^i−βi∗=V−1(E∗a−a)+op(n−1/2). (A10)

Consequently, in view of Lemma A6, we have

β^i−βi∗=[S(E∗a−a)]i+op(n−1/2).

Therefore, Theorem 2 immediately comes from Proposition A1. □

Appendix B

In this section, we present the proofs of supported lemmas.

Appendix B.1. Proof of Lemma 1

Proof of Lemma 1.

For an arbitrarily given nonzero vector x=(x1,…,xn)⊤∈Rn, direct calculations give

x⊤Vx==∑i=1nxi2vii+∑i=1n∑j=1,j≠inxivijxj=−∑i=1n∑j=1,j≠inxi2vij−∑i=1nxi2vi0+∑i=1n∑j=1,j≠inxivijxj=−12∑i=1n∑j=1,j≠in(xi−xj)2vij−∑i=1nxi2vi0,

where the second equality is due to that vii=−∑j≠ivij. Therefore, x⊤Vx=0 if and only if

xivi0=0,i=1,…,n,vij(xi−xj)=0,1≤i≠j≤n.

Because μij(β)≠0 and vij=tijμij(β) for i≠j, the above equations are identical to

xiti0=0,i=1,…,n,tij(xi−xj)=0,1≤i≠j≤n.

Let E be the event

{{tij}i,j=0,i≠jn:xiti0=0,i=1,…,n,tij(xi−xj)=0,1≤i≠j≤n}.

To show Lemma 1, it is sufficient to obtain the lower bound of the probability of the event E. We will evaluate the probability of the event E under two cases: there exists some zero element in x and there are no zero elements in x.

Case I: We consider there are zero elements in x. Let {0,xi1,…,xik} be k+1 different distinct values in {x1,…,xn}, Ω0={i:xi=0} and Ωj={q:xq=xij}, j=1,…,k. Since x≠0, k≥1. It is clear that

|Ω0|>0,|Ωj|>0,j=1,…,k,∑i=0k|Ωi|=n+1, (A11)

where |Ωi| denotes the cardinality of Ωi. Therefore, we have

P(E)=(1−pn)∑j=1k|Ωj|×∏0≤i<j≤k(1−pn)T|Ωi||Ωj|=(1−pn)∑j=1k|Ωj|+∑0≤i<j≤k|Ωi||Ωj|.

To obtain the lower bound of P(E), it is sufficient to solve the minimizer of ∑j=1k|Ωj|+∑0≤i<j≤k|Ωi||Ωj| under the restricted condition (A11). Let yi=|Ωi|. Then,

∑j=1kyi+∑0≤i<j≤kyiyj=∑j=1kyi+12∑i=0n∑j=0,j≠ikyiyj=12∑i=0n∑j=0nyiyj−12∑i=0kyi2+∑j=1kyi=12(∑i=0nyi)2−12∑i=1k(yi−1)2−12y02+12k=12((n+1)2+k)−12(∑i=0kzi2),

where z0=y0 and zi=yi−1, i=1,…,k. Under the restriction ∑izi=n+1−k>0 and zi≥0, the function ∑i=0kzi2 obtains its maximizer at such points z=(0,…,n+1−k,0,…,0). Therefore, we have

∑j=1kyi+∑0≤i<j≤kyiyj≥12((n+1)2+k−(n+1−k)2)=12(2(n+1)k+k−k2)=12[−(k−2(n+1)+12)2+(n+1+12)2].

Because 1≤k≤n, the above function obtains its minimizer at k=1. That is,

−(k−2(n+1)+12)2+((n+1)+12)2≥−(1−(n+1)−1/2)2+(n+1)2+(n+1)+1/4=2(n+1).

This shows

P(E)≤(1−pn)2T(n+1).

Case II: there are no zero elements in x. With the same notation Ωj as in Case I, we have that |ω0|=0 and

P(E)=(1−pn)∑j=1k|Ωj|×∏1≤i<j≤k(1−pn)T|Ωi||Ωj|=(1−pn)T(∑j=1k|Ωj|+∑1≤i<j≤k|Ωi||Ωj|).

It is sufficient to obtain the minimizer of ∑j=1k|Ωj|+∑1≤i<j≤k|Ωi||Ωj|. under the restriction ∑i|Ωi|=n and k≥1. Let yi=|Ωi|. Then,

∑j=1kyi+∑1≤i<j≤kyiyj=∑j=1kyi+12∑i=1n∑j=1,j≠ikyiyj=12∑i=1k∑j=1kyiyj−12∑i=1kyi2+(n+1)=12(∑i=1kyi)2−12∑i=1kyi2+(n+1)=12(n+1)2+(n+1)−12(∑i=1kyi2).

Under the restriction ∑iyi=n+1>0 and zi≥0, the functions ∑i=1kzi2 obtain their maximizer at points z=(0,…,n+1,0,…,0). Therefore, we have

∑j=1kyi+∑1≤i<j≤kyiyj≥12((n+1)2+(n+1)−(n+1)2)≥n+1.

This shows

P(E)≤(1−pn)(n+1)T.

By combining the lower bounds of P(E) under Cases I and II, we have

P(Ec)≥1−(1−pn)(n+1)T,

where Ec denotes that V is positively definite. □

Appendix B.2. Proof of Lemma A2

Proof of Lemma A2.

Based on Lemma 1, V is a positively definite matrix with a probability of at least 1−e−pnT(n+1). In what follows, we assume that V is positively definite such that its inverse exists. The proof proceeds two parts. The first part is to evaluate the cardinality of the set of the common neighbors of any two subjects i and j. That is, we establish the lower bound:

mini,j#{k:tik>0,tkj>0}.

The second part is to show such inequality [c.f. (A16)]

a≥b[∑{k:tαk>0,tkβ>0}(ziα−ziβ)].

We use the method of the proof in [20] with minor modifications that simplify their proofs to show the second part.

Part I. Let 1{·} be an indicator variable. It is equal to one when the expression in {·} is true; otherwise, it is equal to zero. For any given i≠j, define

ξij=∑k=0,k≠i,jn1{tik>0,tjk>0}.

Note that ξij is the sum of n−1 independent Bernoulli random variables, and for three distinct indices i,j,k,

Eξij=P(tik>0)P(tjk>0)=(1−(1−pn)T)2:=ηn.

Based on the Chernoff bound in [29], we have

Pξij≤12(n−1)ηn≤exp−18(n−1)ηn.

It follows that

P(mini,jξij≤12(n−1)ηn)≤∑i,jPξij≤12(n−1)ηn≤(n+1)n2exp−18(n−1)ηn.

Since T≥1,

ηn=(1−(1−pn)T)2≥(1−(1−pn))2=pn2.

That is, with a probability of at least 1−(n+1)n2exp−18(n−1)ηn, we have

mini,jξij≥12(n−1)ηn≥12(n−1)pn2. (A12)

Part II. For convenience, we introduce a non-negative array {qij}i,j=1n, where

qij:=−vij,i≠j;qii:=∑k=1nvik=−vi0,i,j=1,…,n.

Let

m:=min(i,j)∈{(i,j):qij>0}qij,M:=maxi,jqij,tmax:=maxiti,tmin:=miniti.

It is clear that M≥m>0 and

qij≥0,qij=qji,vij=−qij,i≠j,Mtmax≥vii=∑k=1nqik≥mtmin.

Notice that

V−1−S=(V−1−S)(I−VS)+S(I−VS),

where I is a n×n identity matrix. Let X=I−VS, Y=SX and Z=V−1−S; we have the recursion formula

Z=ZX+Y.

The goal is to give an upper bound of all |zij|.

According the definitions of S, V and X, we have

xij=δij−∑k=1nvikskj=δij−∑k=1nvik(δkjvjj+1v00)=δij−vijvii−qiiv00=(1−δij)qijvjj−qiiv00.

and

yij=∑k=1nsikxkj=∑k=1n(δikvii+1v00)((1−δkj)qkjvjj−qkkv00)=∑k=1nδikvii(1−δkj)qkjvjj−qkkv00+∑k=1n1v00(1−δkj)qkjvjj−qkkv00=(1−δij)qijviivjj−qiiviiv00−qjjvjjv00.

Since

0≤qijviivjj≤Mm2tmin2,0≤qijviiv00≤Mm2tmin2,

for any different i,j,k, we have

|yij|≤a:=2Mm2tmin2,|yij−yik|≤a. (A13)

In view of the expressions of xij and yij, we have

zij=∑k=1nzik(1−δkj)qkjvjj−∑k=1nzikqkkv00+yij,i,j=1,…,n. (A14)

Now, we fix an arbitrary i value and consider the upper bound of maxj|zij|.

Let α and β be such that

ziα=maxk=1,…,nzik,ziβ=mink=1,…,nzik.

Without loss of generality, we assume ziα≥|ziβ| (otherwise, we can invert the sign of zik and repeat the same process). Below, we will show ziβ≤0. Note that this conclusion is not investigated in [20]. By multiplying vjj by both sides of (A14), we have

vjjzij=∑k=1nzik(1−δkj)qkj−∑k=1nzikqkkvjjv00+vjjyij.

Summarizing the above equations with j=1,…,n, we have

∑j=1nvjjzij=∑k=1n∑j=1nzik(1−δkj)qkj−∑k=1n∑j=1nzikqkkvjjv00+∑j=1nvjj((1−δij)qijviivjj−qiiviiv00−qjjvjjv00).

Thus,

∑k=1n∑j=1nzikqkkvjjv00+∑k=1nzikqkk=∑j=1nvjj((1−δij)qijviivjj−qiiviiv00−qjjvjjv00)=∑j=1n(1−δij)qijvii−qii∑jvjjviiv00−∑j=1nqjjv00=−qiivii−qii∑jvjjviiv00=−qiiviiv00(v00+∑j=1nvjj)

Thus,

−qiiviiv00(v00+∑j=1nvjj)=∑k=1nzikqkk∑j=1nvjjv00+∑k=1nzikqkk≥ziβ(v00+∑j=1nvjj),

This shows

ziβ≤−qiiviiv00≤0. (A15)

Since ∑k=1nqkα/vαα=1, we have

∑k=1nziαqkαvαα=∑k=1nzik(1−δkα)qkαvαα−∑k=1nzikqkkv00+yiα.

In other words,

∑k=1n[ziα−zik(1−δkα)]qkαvαα=−∑k=1nzikqkkv00+yiα.

Analogously, we have

∑k=1n[zik(1−δkβ)−ziβ]qkβvββ=∑k=1nzikqkkv00−yiβ.

Therefore,

yiα−yiβ=∑k=1n{[ziα−zik(1−δkα)]qkαvαα+[zik(1−δkβ)−ziβ]qkβvββ} ≥[∑{k:tαk>0,tkβ>0}(ziα−ziβ)]×mMtmax. (A16)

The following calculations are based on the event En:

{mini≠jξij≥12(n−1)pn2,tmin≥12nTpn,tmax≤32nTpn}

In view of (A15) and (A16), we have

ziα≤ziα−ziβ≤Mtmaxm×[mini≠jξij]−1×2Mm2tmin2 ≤M·32nTpnm×112(n−1)pn2×2Mm2(12nTpn)2 =24M2n(n−1)m3Tpn3 (A17)

Note that M=Tbn1 and m=bn0. Based on Lemma 6 in the main text, we have

P(tmin≥12nTpn,tmax≤32nTpn)≥1−2(n+1)exp(−18nTpn).

In view of inequality (A12), we have

P(En)≥1−(n+1)n2e−18(n−1)pn−2(n+1)e−18nTpn.

If pn≥24logn/n, then

(n+1)n2e−18(n−1)pn≤O(1n),(n+1)e−110npn=o(1n1.4),

such as

P(En)≥1−O(1n).

Let Fn be the event that V−1 exists. Based on Lemma 1, if pn≥24logn/n, then

P(Fn)≥1−exp(pnT(n+1))≥1−1n24.

Therefore,

P(En⋂Fn)≥1−O(1n).

Substituting M=Tbn1 and m=bn0 into (A17) shows Lemma 2. □

Appendix B.3. Proof of Lemma A3

Proof of Lemma A3.

Recall that πij=βi−βj and

Hi(β)=∑j≠itijμ(πij)−ai,i=1,…,n.

The Jacobian matrix H′(β) of H(β) can be calculated as follows. By finding the partial derivative of Hi with respect to β for i≠j, we have

∂Hi(β)∂βj=−tijμ′(πij),∂Hi(β)∂βi=∑j≠itijμ′(πij),
∂2Hi(β)∂βi∂βj=−tijμ″(πij),∂2Hi(β)∂βi2=∑j≠itijμ″(πij).

When β∈B(β∗,ϵn), based on Condition (3c), we have

|∂2Hi(β)∂βi∂βj|≤bn2tij,i≠j.

Let

gij(β)=(∂2Hi(β)∂β1∂βj,…,∂2Hi(β)∂βn∂βj)⊤.

Therefore,

|∂2Hi(β)∂βi2|≤tibn2,|∂2Hi(β)∂βj∂βi|≤bn2tij. (A18)

This demonstrates that ∥gii(β)∥1≤2tibn2. Note that when i≠j and k≠i,j,

∂2Hi(β)∂βk∂βj=0.

Therefore, we have ∥gij(β)∥1≤2tijbn2 for j≠i. Consequently, for vectors x,y⊂D, we have

maxi=0,…,n∥Hi′(x)−Hi′(y)∥1≤maxi=0,…,n∑j=1n|∂Hi(x)∂xj−∂Hi(y)∂yj|=maxi=0,…,n∑j=1n|∫01[gij(tx+(1−t)y)]⊤(x−y)dt|≤maxi=0,…,n4bn2ti∥x−y∥∞=4bn2tmax∥x−y∥∞.

This completes the proof. □

Appendix B.4. Proof of Lemma A4

Proof of Lemma A4.

Recall that ti=∑j≠itij, and ai is the number of wins of subject i out of ti comparisons. Since all comparisons are mutually independent, ai is the sum of mi independent Bernoulli random variables given tij=mij for j=0,…,n, where mi=∑j≠imij. Based on [30]’s (1963) inequality, we have

P|ai−E(aij|tij,j=0,…,n)|≥2milogn|tij=mij,j=0,…,n≤2exp{−2milognmi}=2n2.

where E(aij|tij,j=0,…,n) is the conditional expectation given tij for 0≤j≤n. Note that the upper bound of the above probability does not depend on mij. With the law of total probability, for fixed i,

P|ai−∑jE(aij|tij,j=0,…,n)|≥2tilogn|=∑mi0=0T…∑min=0TP(tij=mij,j=0,…,n)×P|ai−∑jE(aij|tij,j=0,…,n)|≥2milogn|tij=mij,j=0,…,n≤2n−2∑mi0=0T…∑min=0TP(tij=mij,j=0,…,n)≤2exp{−2milognmi}=2n2.

Therefore,

Pmaxi=1,…,n|ai−∑jE(aij|tij,j=0,…,n)|≥2tmaxlogn≤P⋃i|ai−Eai|≥2tilogn≤∑i=1nP|ai−Eai|≥2tilogn≤n×1n2=1n.

This completes the proof. □

Appendix B.5. Proof of Lemma A5

Proof of Lemma A5.

We first evaluate the uniform lower bound of ti, i=0,…,n. Note that ti is the sum of nT independent and identically distributed (i.i.d.) binomial random variables, Bin(T,pn). It can be also regarded as the sum of Tn, i.i.d., Bernoulli random variables. With the use of the Chernoff bound ([29]), we have

P(mini=0,…,nti<T2npn)≤∑i=0nP(ti<T2npn)≤(n+1)exp(−T8npn).

Thus, with a probability of at least 1−(n+1)exp(−T8npn),

mini=0,…,nti≥T2npn.

Analogously, with the use of the Chernoff bound ([29]), we have

P(maxi=0,…,nti>32nTpn)≤∑i=0nP(ti>32nTpn)≤(n+1)exp(−110nTpn),

and

P(12∑iti>32(n+1)nTpn)≤exp(−110(n+1)nTpn).

□

Appendix B.6. Proof of Lemma A6

Proof of Lemma A6.

Write

H=H(β∗),V−1=H′(β∗),E∗(·)=E(·|tij,0≤i,j≤n),Cov∗(·)=Cov(·|tij,0≤i,j≤n).

Then,

H=E∗(a)−a.

Let W=V−1−S. Note that U=Cov∗(H). Via direct calculations, we have

Cov∗(WH)=(V−1−S)U(V−1−S):=I1+I2

where I1=V−1−S+SVS−S and I2=(V−1−S)(U−V)(V−1−S). It is easy to verify

(SVS−S)ij=vi0viiv00+v0jvjjv00−(1−δij)vijviivjj.

Therefore,

maxi,j|(SVS−S)ij|≤3bn1tmin2bn02.

Based on Lemmas 3 and 5 in the main text, we have

I1=Op(bn12n2bn03pn5).

Now, we evaluate I2. Direct calculations give

[(V−1−S)(U−V)(V−1−S)]ij=∑k,s(V−1−S)ik(U−V)ks(V−1−S)sj=O((bn12n2bn03pnηn)2)∑k,s|(U−V)ks|=O((bn12n2bn03pnηn)2)×2(bn1+1/4)∑iti=O(bn15n2bn06pn5).

where the second inequality is due to Lemma 3 and the third inequality is due to pij(1−pij)≤1/4 and μij′(β)≤bn1. Therefore, we have

I1+I2=Op(bn15n2bn06pn5).

□

Author Contributions

Conceptualization, Q.W.; Data curation, Q.W.; Formal analysis, Q.W.; Funding acquisition, Q.W.; Investigation, Q.W. and L.P.; Methodology, Q.W. and T.Y.; Software, Q.W. and L.P.; Supervision, T.Y.; Validation, Q.W. and T.Y.; Visualization, Q.W. and L.P.; Writing—original draft, Q.W.; Writing—review and editing, Q.W., L.P. and T.Y. All authors have read and agreed to the published version of the manuscript.

Informed Consent Statement

Not Applicable.

Data Availability Statement

We use the 2018 NFL regular season data as an example, which is available from https://www.espn.com/nfl/schedule/_/year/2018 (accessed on 20 August 2025).

Conflicts of Interest

The authors declare no conflicts of interest.

Funding Statement

This research was funded by the National Natural Science Foundation of China, grant number 12301386.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.Han R., Xu Y., Chen K. A general pairwise comparison model for extremely sparse networks. J. Am. Stat. Assoc. 2023;118:2422–2432. doi: 10.1080/01621459.2022.2053137. [DOI] [Google Scholar]
  • 2.Stigler S.M. Citation patterns in the journals of statistics and probability. Stat. Sci. 1994;9:94–108. doi: 10.1214/ss/1177010655. [DOI] [Google Scholar]
  • 3.Varin C., Cattelan M., Firth D. Statistical modelling of citation exchange between statistics journals. J. R. Stat. Soc. Ser. A-Stat. Soc. 2016;179:1–63. doi: 10.1111/rssa.12124. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Radlinski F., Joachims T. Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM; San Jose, CA, USA: 2007. Active exploration for learning rankings from clickthrough data; pp. 570–579. [Google Scholar]
  • 5.Chen B., Escalera S., Guyon I., Ponce-López V., Shah N.B., Simon M.O. European Conference on Computer Vision (ECCV 2016) Workshops. Volume 9915. Springer; Cham, Switzerland: 2016. Overcoming calibration problems in pattern labeling with pairwise ratings: Application to personality traits; pp. 419–432. [Google Scholar]
  • 6.David H.A. The Method of Paired Comparisons. 2nd ed. Oxford University Press; Oxford, UK: 1988. [Google Scholar]
  • 7.Bradley R.A., Terry M.E. Rank analysis of incomplete block designs the method of paired comparisons. Biometrika. 1952;39:324–345. doi: 10.2307/2334029. [DOI] [Google Scholar]
  • 8.Zermelo E. Die berechnung der turnier-ergebnisse als ein maximumproblem der wahrscheinlichkeitsrechnung. Math. Z. 1929;29:436–460. doi: 10.1007/BF01180541. [DOI] [Google Scholar]
  • 9.Thurstone L.L. A law of comparative judgment. Psychol. Rev. 1927;34:273–286. doi: 10.1037/h0070288. [DOI] [Google Scholar]
  • 10.Simons G., Yao Y.C. Asymptotics when the number of parameters tends to infinity in the bradley-terry model for paired comparisons. Ann. Stat. 1999;27:1041–1060. doi: 10.1214/aos/1018031267. [DOI] [Google Scholar]
  • 11.Chen Y., Suh C. Spectral mle: Top-k rank aggregation from pairwise comparisons. In: Bach F., Blei D., editors. Proceedings of the 32nd International Conference on Machine Learning (ICML 2015) International Machine Learning Society (IMLS); Stroudsburg, PA, USA: 2015. pp. 371–380. [Google Scholar]
  • 12.Shah N.B., Wainwright M.J. Simple, robust and optimal ranking from pairwise comparisons. J. Mach. Learn. Res. 2018;18:1–38. [Google Scholar]
  • 13.Han R., Ye R., Tan C., Chen K. Asymptotic theory of sparse bradley-terry model. Ann. Appl. Probab. 2020;30:2491–2515. doi: 10.1214/20-AAP1564. [DOI] [Google Scholar]
  • 14.Yan T., Yang Y., Xu J. Sparse paired comparisons in the bradley-terry model. Stat. Sin. 2012;22:1035–1318. doi: 10.5705/ss.2010.299. [DOI] [Google Scholar]
  • 15.Agarwal A., Patil P., Agarwal S. Proceedings of the Machine Learning Research, Stockholmsmässan, Stockholm, Sweden, 10–15 July 2018. Volume 80. PMLR; Cambridge, MA, USA: 2018. Accelerated spectral ranking; pp. 70–79. [Google Scholar]
  • 16.Hendrickx J., Olshevsky A., Saligrama V. Proceedings of the Conference on Neural Information Processing Systems. NIPS; San Diego, CA, USA: 1999. Graph resistance and learning from pairwise comparisons; pp. 2702–2711. [Google Scholar]
  • 17.Vojnovic M., Yun S. Parameter estimation for thurstone choice models. arXiv. 2017 doi: 10.48550/arXiv.1705.00136.1705.00136 [DOI] [Google Scholar]
  • 18.Wang J., Shah N., Ravi R. Stretching the effectiveness of mle from accuracy to bias for pairwise comparisons. In: Chiappa S., Calandra R., editors. Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics (AISTATS 2020), Online, 26–28 August 2020. Volume 108. PMLR; Cambridge, MA, USA: 2020. pp. 66–76. Proceedings of Machine Learning Research. [Google Scholar]
  • 19.Ford L.R. Solution of a ranking problem from binary comparisons. Am. Math. Mon. 1957;64:28–33. doi: 10.1080/00029890.1957.11989117. [DOI] [Google Scholar]
  • 20.Simons G., Yao Y.C. Approximating the inverse of a symmetric positive definite matrix. Linear Algebra Appl. 1998;281:97–103. doi: 10.1016/S0024-3795(98)10038-1. [DOI] [Google Scholar]
  • 21.Yamamoto T. Error bounds for newton s iterates derived from the kantorovich theorem. Numer. Math. 1986;48:91–98. doi: 10.1007/BF01389444. [DOI] [Google Scholar]
  • 22.Delyon B. Exponential inequalities for sums of weakly dependent variables. Electron. J. Probab. 2009:752–779. doi: 10.1214/EJP.v14-636. [DOI] [Google Scholar]
  • 23.Roussas G.G. Exponential probability inequalities with some applications. Lect. Notes-Monogr. Ser. 1996;30:303–319. [Google Scholar]
  • 24.Ioannides D.A., Roussas G.G. Exponential inequality for associated random variables. Stat. Probab. Lett. 1999;42:423–431. doi: 10.1016/S0167-7152(98)00240-5. [DOI] [Google Scholar]
  • 25.Cocke W.J. Central limit theorems for sums of dependent vector variables. Ann. Math. Statist. 1972;43:968–976. doi: 10.1214/aoms/1177692559. [DOI] [Google Scholar]
  • 26.Cox J.T., Grimmett G. Central limit theorems for associated random variables and the percolation model. Ann. Probab. 1984;12:514–528. doi: 10.1214/aop/1176993303. [DOI] [Google Scholar]
  • 27.Kantorovich L.V. Functional analysis and applied mathematics. Uspekhi Mat. Nauk. 1948;3:89–185. [Google Scholar]
  • 28.Loève M. Probability Theory I. 4th ed. Springer; New York, NY, USA: 1977. [Google Scholar]
  • 29.Chernoff H. A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations. Ann. Math. Statist. 1952;23:493–507. doi: 10.1214/aoms/1177729330. [DOI] [Google Scholar]
  • 30.Hoeffding W. Probability inequalities for sums of bounded random variables. J. Am. Stat. Assoc. 1963;58:13–30. doi: 10.1080/01621459.1963.10500830. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

We use the 2018 NFL regular season data as an example, which is available from https://www.espn.com/nfl/schedule/_/year/2018 (accessed on 20 August 2025).


Articles from Entropy are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES