Table 1.

Simulation parameters for generating a score made by Judge j for item i

Notation	Parameter	Random function
A	Judge’s Accuracy	Normal (μ = 0; σ = 1)
S	Judge’s Stringency	Normal (μ = 0; σ = 1)
L	Judge’s Leadership	Normal (μ = 0; σ = 1)
Wa	Accuracy’s Weight	(Normal (μ = 0; σ = 1) + 3)/3
Ws	Stringency’s Weight	(Normal (μ = 0; σ = 1) + 3)/3
Ji	Judge’s raw score of item i	Normal (μ = 0; σ = Aj)
Sji	Judge’s Stringency for item i	Normal (μ = Sj; σ = 1)
Sa	The impacts of Accuracy on Stringencya	Normal (μ = 1-Aj; σ = 1)
La	The impacts of Accuracy on Leadershipa	Normal (μ = 1-Aj; σ = 1)
Lji	Judge’s Leadership in the second round	Normal (μ = Lj; σ = 1)

^aImpact of accuracy is the component of Accuracy (expertise) that contributes to Stringency or Leadership