Abstract
When the number of subjects, n, is large, paired comparisons are often sparse. Here, we study statistical inference in a class of paired comparison models parameterized by a set of merit parameters, under an Erdös–Rényi comparison graph, where the sparsity is measured by a probability tending to zero. We use the moment estimation base on the scores of subjects to infer the merit parameters. We establish a unified theoretical framework in which the uniform consistency and asymptotic normality of the moment estimator hold as the number of subjects goes to infinity. A key idea for the proof of the consistency is that we obtain the convergence rate of the Newton iterative sequence for solving the estimator. We use the Thurstone model to illustrate the unified theoretical results. Further extensions to a fixed sparse comparison graph are also provided. Numerical studies and real data analysis illustrate our theoretical findings.
Keywords: consistency, central limit theorem, method of moments, paired comparison, parameter estimation, sparse
1. Introduction
Subjects are repeatedly compared in pairs in a wide spectrum of situations, including sports games [1], ranking of scientific journals [2,3], the quality of product brands [4] and crowdsourcing [5]. For instance, one team plays with another team in basketball; papers in one journal cite papers in another journal; one consumer chooses one product over another; workers in a crowdsourcing setup are asked to compare pairs of items.
One of the fundamental problems in paired comparison analysis is to derive a fair and reliable ranking of all subjects based on observed comparison data. In round-robin tournaments—where every pair of subjects competes sufficiently many times—a natural ranking can be directly obtained from the number of wins, as the full pairwise comparisons eliminate biases from incomplete matchups. However, in most practical scenarios (e.g., sports leagues, crowdsourcing evaluations, or journal rankings), comparisons are often sparse (not all pairs interact) and stochastic (outcomes contain random noise), leading to unreliable direct rankings based solely on raw win counts. To address this issue, paired comparison models have been developed to statistically infer the underlying merit parameters of subjects and generate objective rankings; see the classic monograph by [6] for a comprehensive overview of such models and their theoretical foundations. Statistical models not only provide a method of ranking all subjects but are also tools for making inferences on the merits of subjects (e.g., testing whether two subjects have the same merit).
Here, we are concerned with a class of paired comparison models that assign one merit parameter to each subject and assume that the win–loss probability of any pair only depends on the difference between their merit parameters. Specifically, the probability of subject i winning j is
| (1) |
where F is a known cumulative distribution function satisfying , is the merit parameter of subject i and is the total number of subjects. The well-known Bradley–Terry model [7], which dates back to at least 1929 [8], and the Thurstone model [9], are two special cases of Model (1). The former postulates the logistic distribution of , while the latter postulates the normal distribution.
In the standard setting that n is fixed and the number of comparisons in each pair goes to infinity, the theoretical properties of Model (1) have been widely investigated in Chapter 4 of [6]. In the opposite scenario that n goes to infinity and each pair has a fixed number of comparisons, ref. [10] proved the uniform consistency and asymptotic normality of the maximum likelihood estimator (MLE) in the Bradley–Terry model.
When the number of subjects is large, paired comparisons are often sparse. Taking the NCAA Division I FBS (Football Bowl Subdivision) regular season, for example, a team plays with at most 14 other teams among a total of 120 teams. The observed comparisons can be represented in a comparison graph with nodes denoting subjects and a weighted edge between two nodes denoting the number of comparisons. The Erdös–Rényi comparison graph has been widely considered in the literature, e.g., [1,11,12,13], where the number of comparisons between any two subjects follows a binomial distribution , and measures the sparsity. Under a very weak condition on the sparsity on , ref. [13] established the uniform consistency and asymptotic normality of the MLE in the Bradley–Terry model by extending the proof strategies in [10].
Moreover, ref. [14] considered a fixed sparse comparison graph by controlling the length from one subject to another subject with 2 or 3, in which the consistency and asymptotic normality of the MLE also hold. Inference in the high-dimensional setting under the Bradley–Terry model and some generalized versions has also attracted great interest in the machine learning literature; the upper bounds of various errors are established under different conditions [e.g., the error in [15,16], the mean square error in [17], the bias in [18]. Under the assumption that the log-likelihood function is strictly convex, ref. [1] establish the uniform consistency of the MLE in general paired comparison models. However, the asymptotic theory of moment estimation under sparse paired comparison models remains largely underdeveloped in the literature. Existing theoretical developments focus almost exclusively on maximum likelihood estimation (MLE), which relies on strict distributional assumptions and is computationally demanding in high-dimensional settings. In contrast, this paper develops the method of moments (MOM), which avoids full distribution assumptions and maintains computational simplicity while achieving comparable asymptotic properties. The primary novelty of this work is to extend the asymptotic theory of high-dimensional sparse paired comparison models from MLE to the method of moments, establishing a parallel and complementary theoretical framework.
We further elaborate on the advantages of the method of moments (MOM) for high-dimensional sparse paired comparison models. Beyond computational efficiency, MOM has two key strengths over maximum likelihood estimation (MLE) for practical inference: (1) Robustness—the moment estimator is much less sensitive to outliers (e.g., upsets in our NFL data) in sparse settings, where MLE can be biased by extreme observations; (2) Quasi-likelihood compatibility—MOM relies only on moment conditions and avoids strict distributional assumptions, making it robust to model misspecification in high-dimensional sparse scenarios. These merits justify the use of MOM in this study, and our subsequent analysis establishes its asymptotic properties as the core theoretical contribution.
The main contributions of this paper are as follows. First, we develop the moment estimation, instead of the maximum likelihood estimation (MLE) or Bayesian estimation, based on the scores of subjects (i.e., the number of wins) to estimate the merit parameters in Model (1). The reason why we prioritize moment estimation over MLE is that it is natural to rank subjects according to their scores and the computation based on moment equations is simpler, especially in high-dimensional sparse settings where MLE may suffer from numerical instability due to nonlinear optimization. When belongs to the exponential family distribution, both estimations are identical. Second, under an Erdös–Rényi comparison graph, we establish a unified theoretical framework in which the uniform consistency and asymptotic normality of the moment estimator hold when n goes to infinity and tends to zero. A key idea for the proof of the consistency is that we obtain the convergence rate of the Newton iterative sequence for solving the estimator. The asymptotic normality is proved by applying Taylor expansions to a series of functions constructed from estimating equations and showing that remainder terms in the expansions are asymptotically neglected. Although each pair of subjects is assumed to have a comparison with the same probability , our proof strategy can be easily extended to the case with different comparison probabilities at the order of . Third, we use the Thurstone model to illustrate the unified theoretical results. Further extensions to a fixed sparse comparison graph in [14] are also derived. Numerical studies and real data analysis illustrate our theoretical findings.
The rest of this paper is organized as follows. In Section 2, we present the moment estimation. In Section 3, we present the consistency and asymptotic normality of the moment estimator. We illustrate our unified results with one application in Section 4. We extend the asymptotic results to a fixed comparison graph in Section 5. In Section 6, we carry out simulations and give real data analysis. We give a summary and further discussion in Section 7. The proofs of the main results are relegated to Appendix A. The proofs of supported lemmas are relegated to Appendix B.
2. Moment Estimation
Assume that subjects that are labeled as “”, are compared in pairs repeatedly. Let be the times that subject i compares with subject j and be the times that subject i wins subject j out of comparisons. As a result, . By convention, define and . The comparison matrix is generated from an Erdös–Rényi comparison graph, where follows a binomial distribution with measuring the sparsity of comparisons. More generally, . We set to be the same for ease of exposition. Recall that are the merit parameters of subjects . The probability in Model (1) implies that the winning probability only depends on the difference in merit between two subjects. For the identification of models, we normalize by setting as in [10]. We assume that all paired comparisons are independent and follows a binomial distribution conditional on .
Let be the total wins of subject i and . To motivate the estimating equations, we compare the maximum likelihood equation and the moment equation under the Thurstone model described in Section 4. The maximum likelihood equations are
where is the density function of the standard normality and is its distribution function. The corresponding moment equations are
We can see that the latter is simpler and easier to compute. On the other hand, it is natural to rank subjects according to their scores. Thus, we use the moment estimation here. When in Model (1) belongs to the exponential family distributions, both are the same.
Write as the expectation of and . Then, the estimating equations are
| (2) |
The solution to the above equations is the moment estimator denoted by and . Let
If is a one-to-one mapping, then exists and is unique, i.e., . When does not exist (i.e., is not one-to-one), any solution of Equation (2) is a moment estimator of . The Newton–Raphson algorithm can be used to solve Equation (2). Moreover, the R language provides the package “BradleyTerry2” to solve the estimator in the Bradley–Terry model.
We discuss the existence of from the viewpoint of graph connection. If the comparison graph with the matrix as its adjacency matrix is not connected, then there are two empty sets such that there are no comparisons between subjects in the first set and those in the second. In this case, there is no basis for ranking subjects in the first set and those in the second set. Further, a necessary condition for the existence of is that the directed graph with the win–loss matrix as its adjacency matrix is strongly connected. In other words, for every partition of the subjects into two nonempty sets, a subject in the second set beats a subject in the first at least once. To see this, assume that there are two empty sets and such that all subjects in win all comparisons with subjects in . Without loss of generality, we set and with , where for and . By summing over , we have
Because is a sum of , , and , we have
Because for and and at least such one , it must be when in order to guarantee both sides in the above equation to be equal. In this case, at least one such difference must go to infinity such that the moment estimate does not exist. The strong connection of is also sufficient for guaranteeing the existence of the MLE in the Bradley–Terry model [19] in which the moment estimator is equal to the MLE. It is interesting to see whether the strong connection of is sufficient to guarantee the existence of in a general model. In the next section, we will show that exists with probability approaching one under some mild conditions.
3. Asymptotic Properties
In this section, we present the consistency and asymptotic normality of the moment estimator. We first introduce some notations. For a subset , let and denote the interior and closure of C, respectively. For a vector , denote by a vector norm with the -norm, , and the -norm, . Let be an -neighborhood of x. For an matrix , let denote the matrix norm induced by the -norm on vectors in , i.e.,
and let be a general matrix norm. Define the matrix maximum norm: . We use the superscript “*” to denote the true parameter under which the data are generated. When there is no ambiguity, we omit the superscript “*”.
Recall that is the expectation of . We assume that is a continuous function with the third derivative. Write and as the first and second derivatives of on , respectively. Let be a small positive number. When , we assume that there are three positive numbers, , such that
| (3a) |
| (3b) |
| (3c) |
where .
We use the Bradley–Terry model to illustrate the above inequalities, where . A direct calculation gives that
It is easy to show that
| (4) |
If , then .
3.1. Consistency
To establish the consistency of , let us first define a system of functions:
| (5) |
and . It is clear that . Let be the Jacobian matrix of on the parameter . The asymptotic behavior of depends crucially on the inverse of . For convenience, denote as , where
Define
When and , in view of inequality (3b), the entries of V satisfy the following inequalities:
| (6) |
Without loss of generality, we assume that when hereafter (otherwise, we redefine and repeat a similar process). Our strategy for the proof of consistency crucially depends on the existence of the inverse of V, which requires that V is a full rank matrix. It is easy to show that V is positively semi-definite. Thus, if V has a full rank, then V must be positively definite. The following lemma assures the existence of the inverse of V.
Lemma 1.
Assume that . With probability at least , is positively definite.
Because when , we have
The probability of the nonexistence of is less than , going exponentially fast to zero. Generally, the inverse of V does not have a closed form. Ref. [20] proposed to approximate the inverse of V, , by the matrix , where
| (7) |
In the above equation, if ; otherwise, . By extending the proof of [20] to the sparse case, the upper bound of the approximate error is given in Lemma A2.
Recall that the main idea of the proof of the consistency in the Bradley–Terry model [10,14] contains two parts. Let , , and . Since , it suffices to show that the ratio of subject , , and the ratio of , are very close. With the nice mathematical properties of the logistic function , the first part is to show that there are a number of subjects satisfying the following inequalities:
| (8) |
where b and c are certain numbers. The second part is to eliminate common terms based on the condition that the number of the common neighbors between any two subjects, , is at least , where in [10] and in [14]. In the Erdös–Rényi comparison graph, [13] further showed that there is at least one subject with its ratio close to both and .
The aforementioned strategies for the proof of consistency are built on the the premise of the existence of the MLE, which is guaranteed by the necessary and sufficient condition that the directed graph with the win–loss matrix as its adjacency matrix is strongly connected [19]. As discussed before, it may be difficult to find the minimal sufficient condition to guarantee the existence of in general paired comparison models. To overcome this difficulty, we aim to obtain the convergence rate of the Newton iterative sequence for solving Equation (2). Under the well-known Newton–Kantorich conditions, the Newton iterative sequence converges, and its limiting point is the solution. We apply an adjusted version of the Newton–Kantorich theorem in [21] to this end, which not only guarantees the existence of the solution but also gives an optimal error bound for the Newton iterative sequence.
Now, we formally state the consistency result.
Theorem 1.
Assume that Conditions (3a), (3b) and (3c) hold. If , then exists with probability approaching one and is uniformly consistent in the sense that
(9)
To see how small could be, we consider a special case that is a constant vector, in which and are also constants. According to the above theorem, if , then .
3.2. Asymptotic Normality of
We establish the asymptotic distribution of by characterizing its asymptotical representation. In detail, we apply a second-order Taylor expansion to and find that can be represented as the sum of a main term and an asymptotically neglected remainder term, where denotes the conditional expectation conditional on . Because does not have a closed form, we use the matrix S defined in (7) to approximate it. We formally state the asymptotic normality of as follows.
Theorem 2.
Let and . If , then for fixed k, the vector follows a k-dimensional multivariate normal distribution with mean zero and the covariance matrix , where
(10)
Remark 1.
If , then is equal to . When belongs to the exponential family distribution (e.g., the Bradley–Terry model), U is identical to V. If , then the asymptotic variance of is involved with an additional factor . The asymptotic variance of is on the order of if is bounded above by a constant.
4. Application to the Thurston Model
In this section, we illustrate the unified theoretical result by the application to the Thurston model.
The original Thurston model has a variance in the normal distribution, i.e., the probability that subject i is preferred over j is . Since the merit parameters are scale invariable, we simply set hereafter. Recall that is the standard normal density function and is the distribution function of the standard normality. In the Thurston model, . Then,
Since is an decreasing function on , we have when ,
Let . Then, . Therefore, when , is an increasing function on its argument x; when , is an decreasing function on x. As a result, attains its maximum value at when . Since is a symmetric function, we have . Therefore,
In view of Theorems 1 and 2, we have the following corollary.
Corollary 1.
If and , then exists with probability approaching one and is uniformly consistent in the sense that
(11) Let . If , then for fixed k, the vector follows a k-dimensional multivariate normal distribution with mean zero and the covariance matrix defined at (10).
5. Extension to a Fixed Sparse Design
In some applications such as sports, the comparison graph may be fixed, not random. For example, in the regular season of the National Football League (NFL), games are scheduled in advance. More specially, there are 32 teams in the 2 conferences of the NFL that are divided into 8 divisions, each consisting of 4 teams. In the regular season, each team plays 16 matches, 6 within the division and 10 between the divisions. Motivated by the design, ref. [14] proposed a sparse condition to control the length from one subject to another subject with 2 or 3:
That is, is the minimum ratio of the total number of paths between any i and j with length 2 or 3. Under the Erdös–Rényi comparison graph, there are similar sparsities. Specifically, the set of common neighbors of any two subjects i and j has at least the following size:
with a probability of at least if ; see (A12) in the proof of A2.
We assume that if two subjects have comparisons, they are compared T times, in accordance with the aforementioned setting for easy of exposition. Similar to Lemma A2, the approximate error of using S to approximate is
where and . With similar lines of argument as in the proofs of Theorems 1 and 2, we have the following theorem, whose proof is omitted.
Theorem 3.
Assume that conditions (3a), (3b) and (3c) hold. If , then exists with probability approaching one and is uniformly consistent in the sense that
(12) Let and . If , then for fixed k, the vector follows a k-dimensional multivariate normal distribution with mean zero and the covariance matrix , where is given in (7).
6. Numerical Studies
In this section, we evaluate the asymptotic results of the moment estimator in the Thurston model through simulation studies and a real data example.
6.1. Simulation Studies
We carry out simulations to evaluate the finite sample performance of the moment estimator in the Thurston model. We set , which means that any pair has one comparison with probability and no comparison with probability . Let c be a constant. We set the merit parameters to be a linear form, i.e., for , where . We considered four different values for c as . By allowing to grow with n, we intended to assess the asymptotic properties under different asymptotic regimes.
In order to see how small could be, we first evaluate the fail frequency that the “win–loss” graph is strongly connected, which is the necessary condition to guarantee the moment estimator exists. We set c to be fixed with . The results are shown in Table 1 with 1000. We can see that the necessary condition did not hold in each simulation when , while it holds with almost frequency when . This shows that it is necessary to control the rate of tending to zero.
Table 1.
The fail frequency ().
| 0 | 0 | ||
| 0 | |||
| 100 | 100 | 100 |
Based on Theorem 2, converges in distribution to the standard normality, where and are the estimates of and by replacing with . Therefore, we assessed the asymptotic normality of via the coverage probability of the confidence interval and the length of the confidence interval. The times that failed to exist were also recorded. Two values, and , were considered for the number of subjects. Each simulation was repeated 10,000 times.
The simulation results are shown in Table 2. When , all simulated coverage probabilities are very close to the target level . On the other hand, when , they are a little lower than the normal level in the case and are very close to in the case . The length of the confidence interval decreases as n increases, which qualitatively agrees with the theory. It is also expected that the length of the confidence interval increases as decreases when n is fixed. Another phenomenon is that the length of the confidence interval under three distinct c has little difference when n and are fixed.
Table 2.
The reported values are the coverage frequency () for for a pair /length of the confidence interval/fail probabilities ().
| n | ||||
|---|---|---|---|---|
| 100 | ||||
| 200 | ||||
| n | ||||
| 100 | ||||
| 200 | ||||
6.2. A Real Data Example
We use the 2018 NFL regular season data as an illustrative example, which is available from https://www.espn.com/nfl/schedule/_/year/2018 (accessed on 20 August 2025). The NFL league consists of thirty-two teams that are divided evenly into two conferences, and each conference has four divisions that have four teams each. In the regular season, each team plays with three intra-division teams (each twice) and ten games with ten inter-division teams (each once). As discussed in [14], the design of the NFL regular season satisfies the sparsity condition of the fixed comparison graph, where . We removed two ties before our analysis. The fitted merits that were obtained from fitting the Thurstone model for the remaining data are given in Table 3, where we used “Arizona Cardinals” with the smallest number of wins as the baseline (with ).
Table 3.
The fitted merit , the number of wins , and the standard error .
| American Football Conference | National Football Conference | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Division | Team | Division | Team | ||||||
| East | New England Patriots | 11 | East | Dallas Cow boys | 10 | ||||
| New York Jets | 4 | Philadelphia Eagles | 9 | ||||||
| Miami Dophins | 7 | New York Giants | 5 | ||||||
| Buffalo Bills | 6 | Washington Redskins | 7 | ||||||
| North | Baltimore Ravens | 10 | North | Chicago Bears | 12 | ||||
| Cincinnati Bengals | 6 | Green Bay Packers | 6 | ||||||
| Pittsburgh Steelers | 9 | Minnesota Vikings | 8 | ||||||
| Cleveland Browns | 7 | Detroit Lions | 6 | ||||||
| South | Indianapolis Colts | 10 | South | New Orleans Saints | 13 | ||||
| Houston Texans | 11 | Atlanta Falcons | 7 | ||||||
| Tennessee Titans | 9 | Carolina Panthers | 7 | ||||||
| Jacksonville Jaguars | 5 | Tampa Bay Buccaneers | 5 | ||||||
| West | Kansas City Chiefs | 12 | West | Los Angeles Rams | 13 | ||||
| Denver Broncos | 6 | San Francisco 49ers | 4 | ||||||
| Oakland Raiders | 4 | Seattle Seahawks | 10 | ||||||
| Los Angeles Chargers | 12 | Arizona Cardinals | 0 | 3 | |||||
It is interesting to compare the ordering of six playoff seeds of the two conferences with the NFL rules with the ordering by their fitted merits in Table 3. The NFL rules are based on the regular season won–lost percentage record (PCT) and can be briefly summarized as follows: the teams in each division with the best PCT are seeded one through four; another two teams from each conference are seeded five and six based on their PCT. The six playoff seeds in the American Football Conference from No. 1 to No. 6 based on the PCT are Kansas City Chiefs, New England Patriots, Pittsburgh Steelers, Houston Texans, Los Angeles Chargers, and Indianapolis Colts, while the selected teams based on the fitted merits are Kansas City Chiefs, New England Patriots, Houston Texans, Baltimore Ravens, Los Angeles Chargers, and Pittsburgh Steelers. The corresponding six playoff seeds in the National Football Conference based on the PCT are Los Angeles Rams, New Orleans Saints, Chicago Bears, Washington Redskins, Seattle Seahawks, and Carolina Panthers, while the selected teams base on the fitted merits are Los Angeles Rams, New Orleans Saints, Chicago Bears, Dallas Cow boys, Seattle Seahawks, and Philadelphia Eagles. As we can see, the selected top three teams based on the PCT and the fitted merits in each conference are the same, and the selected teams from No. 4, No. 5 and No. 6 are not all the same.
7. Summary and Discussion
We have presented the moment estimation based on the scores of subjects in the paired comparison model under sparse comparison graphs. We have established the uniform consistency and asymptotic normality of the moment estimator. The consistency is shown by obtaining the convergence rate of the Newton iterative sequence. This leads to a condition on the sparsity parameter requiring that if is a constant vector. We note that this condition looks much stronger than that in the Bradley–Terry model in [13]. Since we consider a general model, it would seem to be suitable that a more severe condition is imposed. On the other hand, the condition imposed on may not be the best possible condition. In particular, the conditions for guaranteeing the asymptotic normality seem stronger than those needed for the consistency. Note that the asymptotic behavior of the moment estimator depends not only on but also on the configuration of all parameters. It would be of interest to investigate whether these conditions could be relaxed.
In this paper, we assume that given the comparison graph, all paired comparisons are independent. Note that the moment equation holds regardless of whether comparisons are independent.
When comparisons are not independent, the moment estimation still works. The consistency result in Theorem 1 still holds as long as there is the same order of the upper bound of in Lemma A4. In fact, the independence assumption is not directly used when checking our proofs. It is only used in Lemma A4 to derive the upper bound of using the Hoeffding inequality. Analogously, the independence assumption is used to derive the central limit theorem of . In the dependence case, there are also many Hoeffding-type exponential tail inequalities (e.g., [22,23,24]) and cental limit theorems for sums of a sequence of random variables (e.g., [25,26]) to apply.
Building on the theoretical and empirical findings of this study, we identify two promising avenues for further exploration, which not only address the current limitations but also extend the moment estimation framework to more complex and practical scenarios: 1. Moment estimation for paired comparison models with dependent outcomes. This paper assumes that all paired comparison outcomes are independent, which is a standard but restrictive assumption in many real-world settings (e.g., crowdsourcing evaluations where raters may have consistent biases, or sports leagues where team performance is serially correlated). A natural extension is to develop moment estimation methods for models with dependent outcomes, such as incorporating Markovian dependence or exchangeable correlation structures. Key challenges include deriving unbiased moment equations under dependence and establishing asymptotic properties (consistency, asymptotic normality) using tools from dependent random variable theory (e.g., Hoeffding-type inequalities for associated variables [22,23,24]). 2. High-dimensional sparse paired comparison models with structured merit parameters. This study focuses on unstructured merit parameters (i.e., are independent). However, in many applications, merit parameters often exhibit inherent structures, such as group-level homogeneity (e.g., teams in the same sports division share similar strengths) or sparsity (e.g., only a few subjects have distinct merits in large-scale crowdsourcing). Extending the moment estimation framework to incorporate such structures (e.g., group lasso-penalized moment estimation, sparse merit parameter inference) would improve estimation efficiency. Key research questions include designing computationally feasible penalized moment equations and establishing oracle properties for the structured estimators. These directions align with the core theme of sparse paired comparison inference and address practical limitations of the current work. We believe pursuing these avenues will not only extend the theoretical scope of moment estimation but also broaden its applicability to more complex real-world problems.
Appendix A
In this section, we present the proofs of the theorems.
Appendix A.1. Preliminaries
We state two preliminary results firstly, which will be used in the proofs. The first result is the optimal error bound in the Newton method in [21] under the Kantorovich conditions [27].
Lemma A1
([21]). Let X and Y be Banach spaces, D be an open convex subset of X and F: be Fréchet differentiable. Assume that, at some , is invertible and that
(A1)
(A2)
Then: (1) The Newton iterates , are well-defined, lie in and converge to a solution of .
(2) The solution is unique in , if and in if .
(3) if and if .
The second result is the approximate error of using S to approximate , whose proof is in the Appendix B.
Lemma A2.
If , then for sufficiently large n with a probability of at least , we have
Appendix A.2. Proof of Theorem 1
We aim to show Theorem 1 by obtaining the convergence rate of the Newton iterative sequence in view of Lemma A1, which requires us to verify the Kantovorich conditions (A1) and (A2). Condition (A1) depends on the Lipschitz continuous form of . Recall that and .
Lemma A3.
Let be an open convex set containing the true point . For any given set , if Inequality (3c) holds, then
Moreover, Condition (A1) also depends on the magnitudes of , , which are stated below.
Lemma A4.
With a probability of at least , we have
The following results are the lower bound of and the upper bounds of and of .
Lemma A5.
(1) With probability at least ,
(2) With probability at least ,
(3) With probability at least ,
We are now ready to prove Theorem 1.
Proof of Theorem 1.
Note that is the solution to the equation = 0. We prove the consistency by obtaining the convergence rate of the Newton iterative sequence: , where we set . To apply Lemma A1, we choose the convex set . The following calculations are based on the event :
Note that when . Let . We use S defined in (7) to approximate and let . We verify the Kantovorich conditions in Lemma A1 as follows. Since , we have
Based on Lemma A3, we have
Thus, we can set in (A1). Again, based on the event , we have
If
(A3) then this verifies Condition (A2). Based on Lemma A1, exists, denoted by , and it satisfies
Based on Lemmas 1, A2, A4 and A5, the event holds with a probability of at least if . Note that (A3) implies . This completes the proof. □
Appendix A.3. Proofs for Theorem 2
Write and as the conditional variance and conditional expectation given for . Let . In the Bradley–Terry model, . Note that is a sum of independent Bernoulli random variables. Based on Lemma A5, we know that . Let . If , then . Based on the central limit theorem in the bound case, as in [28] (p. 289), if , then converges in distribution to the standard normal distribution. When considering the asymptotic behaviors of the vector with a fixed r, one could replace the degrees by the independent random variables , . Therefore, we have the following proposition.
Proposition A1.
If , then as , for any fixed , the components of are asymptotically independent and normally distributed with variances , respectively. Moreover, the first r rows of are asymptotically normal with covariance matrix , where
Lemma A6.
Let and and . Then,
Further, if , then
Now, we are ready to prove Theorem 2.
Proof of Theorem 2.
Let and . Based on Theorem 1, . To simplify notations, write . Based on a second-order Taylor expansion, we have
(A4) where is the second-order remainder term:
In the above equation, lies between and . If , based on Theorem 1, we have
Therefore, in view of (3c), such that
(A5) Let , , and . Then, based on Lemma A5 (2), we have
(A6) By writing the equation in (A4) into a matrix form, we have
(A7) Equivalently,
(A8) Similarly, we have
Therefore, based on Lemma A5 (2), we have
Note that . Multiplying both sides of (A7) by a row vector with all element 1 yields
Therefore, we have
(A9) Based on (A6) and Lemma A2, we have
If , then we have
(A10) Consequently, in view of Lemma A6, we have
Therefore, Theorem 2 immediately comes from Proposition A1. □
Appendix B
In this section, we present the proofs of supported lemmas.
Appendix B.1. Proof of Lemma 1
Proof of Lemma 1.
For an arbitrarily given nonzero vector , direct calculations give
where the second equality is due to that . Therefore, if and only if
Because and for , the above equations are identical to
Let E be the event
To show Lemma 1, it is sufficient to obtain the lower bound of the probability of the event E. We will evaluate the probability of the event E under two cases: there exists some zero element in x and there are no zero elements in x.
Case I: We consider there are zero elements in x. Let be different distinct values in , and , . Since , . It is clear that
(A11) where denotes the cardinality of . Therefore, we have
To obtain the lower bound of , it is sufficient to solve the minimizer of under the restricted condition (A11). Let . Then,
where and , . Under the restriction and , the function obtains its maximizer at such points . Therefore, we have
Because , the above function obtains its minimizer at . That is,
This shows
Case II: there are no zero elements in x. With the same notation as in Case I, we have that and
It is sufficient to obtain the minimizer of . under the restriction and . Let . Then,
Under the restriction and , the functions obtain their maximizer at points . Therefore, we have
This shows
By combining the lower bounds of under Cases I and II, we have
where denotes that V is positively definite. □
Appendix B.2. Proof of Lemma A2
Proof of Lemma A2.
Based on Lemma 1, V is a positively definite matrix with a probability of at least . In what follows, we assume that V is positively definite such that its inverse exists. The proof proceeds two parts. The first part is to evaluate the cardinality of the set of the common neighbors of any two subjects i and j. That is, we establish the lower bound:
The second part is to show such inequality [c.f. (A16)]
We use the method of the proof in [20] with minor modifications that simplify their proofs to show the second part.
Part I. Let be an indicator variable. It is equal to one when the expression in is true; otherwise, it is equal to zero. For any given , define
Note that is the sum of independent Bernoulli random variables, and for three distinct indices ,
Based on the Chernoff bound in [29], we have
It follows that
Since ,
That is, with a probability of at least , we have
(A12) Part II. For convenience, we introduce a non-negative array , where
Let
It is clear that and
Notice that
where I is a identity matrix. Let , and ; we have the recursion formula
The goal is to give an upper bound of all .
According the definitions of S, V and X, we have
and
Since
for any different , we have
(A13) In view of the expressions of and , we have
(A14) Now, we fix an arbitrary i value and consider the upper bound of .
Let and be such that
Without loss of generality, we assume (otherwise, we can invert the sign of and repeat the same process). Below, we will show . Note that this conclusion is not investigated in [20]. By multiplying by both sides of (A14), we have
Summarizing the above equations with , we have
Thus,
Thus,
This shows
(A15) Since , we have
In other words,
Analogously, we have
Therefore,
(A16) The following calculations are based on the event :
In view of (A15) and (A16), we have
(A17) Note that and . Based on Lemma 6 in the main text, we have
In view of inequality (A12), we have
If , then
such as
Let be the event that exists. Based on Lemma 1, if , then
Therefore,
Substituting and into (A17) shows Lemma 2. □
Appendix B.3. Proof of Lemma A3
Proof of Lemma A3.
Recall that and
The Jacobian matrix of can be calculated as follows. By finding the partial derivative of with respect to for , we have
When , based on Condition (3c), we have
Let
Therefore,
(A18) This demonstrates that . Note that when and ,
Therefore, we have for . Consequently, for vectors , we have
This completes the proof. □
Appendix B.4. Proof of Lemma A4
Proof of Lemma A4.
Recall that , and is the number of wins of subject i out of comparisons. Since all comparisons are mutually independent, is the sum of independent Bernoulli random variables given for , where . Based on [30]’s (1963) inequality, we have
where is the conditional expectation given for . Note that the upper bound of the above probability does not depend on . With the law of total probability, for fixed i,
Therefore,
This completes the proof. □
Appendix B.5. Proof of Lemma A5
Proof of Lemma A5.
We first evaluate the uniform lower bound of , . Note that is the sum of independent and identically distributed (i.i.d.) binomial random variables, . It can be also regarded as the sum of , i.i.d., Bernoulli random variables. With the use of the Chernoff bound ([29]), we have
Thus, with a probability of at least ,
Analogously, with the use of the Chernoff bound ([29]), we have
and
□
Appendix B.6. Proof of Lemma A6
Proof of Lemma A6.
Write
Then,
Let . Note that . Via direct calculations, we have
where and . It is easy to verify
Therefore,
Based on Lemmas 3 and 5 in the main text, we have
Now, we evaluate . Direct calculations give
where the second inequality is due to Lemma 3 and the third inequality is due to and . Therefore, we have
□
Author Contributions
Conceptualization, Q.W.; Data curation, Q.W.; Formal analysis, Q.W.; Funding acquisition, Q.W.; Investigation, Q.W. and L.P.; Methodology, Q.W. and T.Y.; Software, Q.W. and L.P.; Supervision, T.Y.; Validation, Q.W. and T.Y.; Visualization, Q.W. and L.P.; Writing—original draft, Q.W.; Writing—review and editing, Q.W., L.P. and T.Y. All authors have read and agreed to the published version of the manuscript.
Informed Consent Statement
Not Applicable.
Data Availability Statement
We use the 2018 NFL regular season data as an example, which is available from https://www.espn.com/nfl/schedule/_/year/2018 (accessed on 20 August 2025).
Conflicts of Interest
The authors declare no conflicts of interest.
Funding Statement
This research was funded by the National Natural Science Foundation of China, grant number 12301386.
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Han R., Xu Y., Chen K. A general pairwise comparison model for extremely sparse networks. J. Am. Stat. Assoc. 2023;118:2422–2432. doi: 10.1080/01621459.2022.2053137. [DOI] [Google Scholar]
- 2.Stigler S.M. Citation patterns in the journals of statistics and probability. Stat. Sci. 1994;9:94–108. doi: 10.1214/ss/1177010655. [DOI] [Google Scholar]
- 3.Varin C., Cattelan M., Firth D. Statistical modelling of citation exchange between statistics journals. J. R. Stat. Soc. Ser. A-Stat. Soc. 2016;179:1–63. doi: 10.1111/rssa.12124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Radlinski F., Joachims T. Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM; San Jose, CA, USA: 2007. Active exploration for learning rankings from clickthrough data; pp. 570–579. [Google Scholar]
- 5.Chen B., Escalera S., Guyon I., Ponce-López V., Shah N.B., Simon M.O. European Conference on Computer Vision (ECCV 2016) Workshops. Volume 9915. Springer; Cham, Switzerland: 2016. Overcoming calibration problems in pattern labeling with pairwise ratings: Application to personality traits; pp. 419–432. [Google Scholar]
- 6.David H.A. The Method of Paired Comparisons. 2nd ed. Oxford University Press; Oxford, UK: 1988. [Google Scholar]
- 7.Bradley R.A., Terry M.E. Rank analysis of incomplete block designs the method of paired comparisons. Biometrika. 1952;39:324–345. doi: 10.2307/2334029. [DOI] [Google Scholar]
- 8.Zermelo E. Die berechnung der turnier-ergebnisse als ein maximumproblem der wahrscheinlichkeitsrechnung. Math. Z. 1929;29:436–460. doi: 10.1007/BF01180541. [DOI] [Google Scholar]
- 9.Thurstone L.L. A law of comparative judgment. Psychol. Rev. 1927;34:273–286. doi: 10.1037/h0070288. [DOI] [Google Scholar]
- 10.Simons G., Yao Y.C. Asymptotics when the number of parameters tends to infinity in the bradley-terry model for paired comparisons. Ann. Stat. 1999;27:1041–1060. doi: 10.1214/aos/1018031267. [DOI] [Google Scholar]
- 11.Chen Y., Suh C. Spectral mle: Top-k rank aggregation from pairwise comparisons. In: Bach F., Blei D., editors. Proceedings of the 32nd International Conference on Machine Learning (ICML 2015) International Machine Learning Society (IMLS); Stroudsburg, PA, USA: 2015. pp. 371–380. [Google Scholar]
- 12.Shah N.B., Wainwright M.J. Simple, robust and optimal ranking from pairwise comparisons. J. Mach. Learn. Res. 2018;18:1–38. [Google Scholar]
- 13.Han R., Ye R., Tan C., Chen K. Asymptotic theory of sparse bradley-terry model. Ann. Appl. Probab. 2020;30:2491–2515. doi: 10.1214/20-AAP1564. [DOI] [Google Scholar]
- 14.Yan T., Yang Y., Xu J. Sparse paired comparisons in the bradley-terry model. Stat. Sin. 2012;22:1035–1318. doi: 10.5705/ss.2010.299. [DOI] [Google Scholar]
- 15.Agarwal A., Patil P., Agarwal S. Proceedings of the Machine Learning Research, Stockholmsmässan, Stockholm, Sweden, 10–15 July 2018. Volume 80. PMLR; Cambridge, MA, USA: 2018. Accelerated spectral ranking; pp. 70–79. [Google Scholar]
- 16.Hendrickx J., Olshevsky A., Saligrama V. Proceedings of the Conference on Neural Information Processing Systems. NIPS; San Diego, CA, USA: 1999. Graph resistance and learning from pairwise comparisons; pp. 2702–2711. [Google Scholar]
- 17.Vojnovic M., Yun S. Parameter estimation for thurstone choice models. arXiv. 2017 doi: 10.48550/arXiv.1705.00136.1705.00136 [DOI] [Google Scholar]
- 18.Wang J., Shah N., Ravi R. Stretching the effectiveness of mle from accuracy to bias for pairwise comparisons. In: Chiappa S., Calandra R., editors. Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics (AISTATS 2020), Online, 26–28 August 2020. Volume 108. PMLR; Cambridge, MA, USA: 2020. pp. 66–76. Proceedings of Machine Learning Research. [Google Scholar]
- 19.Ford L.R. Solution of a ranking problem from binary comparisons. Am. Math. Mon. 1957;64:28–33. doi: 10.1080/00029890.1957.11989117. [DOI] [Google Scholar]
- 20.Simons G., Yao Y.C. Approximating the inverse of a symmetric positive definite matrix. Linear Algebra Appl. 1998;281:97–103. doi: 10.1016/S0024-3795(98)10038-1. [DOI] [Google Scholar]
- 21.Yamamoto T. Error bounds for newton s iterates derived from the kantorovich theorem. Numer. Math. 1986;48:91–98. doi: 10.1007/BF01389444. [DOI] [Google Scholar]
- 22.Delyon B. Exponential inequalities for sums of weakly dependent variables. Electron. J. Probab. 2009:752–779. doi: 10.1214/EJP.v14-636. [DOI] [Google Scholar]
- 23.Roussas G.G. Exponential probability inequalities with some applications. Lect. Notes-Monogr. Ser. 1996;30:303–319. [Google Scholar]
- 24.Ioannides D.A., Roussas G.G. Exponential inequality for associated random variables. Stat. Probab. Lett. 1999;42:423–431. doi: 10.1016/S0167-7152(98)00240-5. [DOI] [Google Scholar]
- 25.Cocke W.J. Central limit theorems for sums of dependent vector variables. Ann. Math. Statist. 1972;43:968–976. doi: 10.1214/aoms/1177692559. [DOI] [Google Scholar]
- 26.Cox J.T., Grimmett G. Central limit theorems for associated random variables and the percolation model. Ann. Probab. 1984;12:514–528. doi: 10.1214/aop/1176993303. [DOI] [Google Scholar]
- 27.Kantorovich L.V. Functional analysis and applied mathematics. Uspekhi Mat. Nauk. 1948;3:89–185. [Google Scholar]
- 28.Loève M. Probability Theory I. 4th ed. Springer; New York, NY, USA: 1977. [Google Scholar]
- 29.Chernoff H. A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations. Ann. Math. Statist. 1952;23:493–507. doi: 10.1214/aoms/1177729330. [DOI] [Google Scholar]
- 30.Hoeffding W. Probability inequalities for sums of bounded random variables. J. Am. Stat. Assoc. 1963;58:13–30. doi: 10.1080/01621459.1963.10500830. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
We use the 2018 NFL regular season data as an example, which is available from https://www.espn.com/nfl/schedule/_/year/2018 (accessed on 20 August 2025).
