Skip to main content
. Author manuscript; available in PMC: 2021 Oct 11.
Published in final edited form as: Hum Biol. 2015 Oct;87(4):313–337. doi: 10.13110/humanbiology.87.4.0313

Table 1.

Summary of Notation

Symbol Meaning
k The number of loci that influence a quantitative trait
The ploidy of the individuals being considered
M An individual’s population membership; takes values A and B
L ij An individual’s allelic type at the jth allele at the ith locus; takes values 0 and 1
p i The frequency of the 1 allele at locus i in population A (Eq. 1)
q i The frequency of the 1 allele at locus i in population B (Eq. 1)
p¯ The mean frequency of the 1 allele across loci in population A (Eq. 2)
q¯ The mean frequency of the 1 allele across loci in population B (Eq. 2)
sp2 The variance across loci in the frequency of the 1 allele in population A (Eq. 3)
sq2 The variance across loci in the frequency of the 1 allele in population B (Eq. 3)
V ij An indicator for whether an individual’s jth allele at the ith locus is a + allele (Eq. 4)
T An individual’s value for a quantitative trait (Eq. 4)
X i An indicator for whether the 0 or the 1 allele is also the + allele at locus i (Eq. 5)
S The number of 1 alleles an individual carries (Eq. 6)
δ i The difference between populations in the frequency of the 1 allele at locus i (Eq. 8)
δ¯ The mean allele-frequency difference between populations, or q¯p¯ (Eq. 9)
δ2¯ The mean squared difference between populations in the frequency of the 1 allele (Eq. 10)
FSTk The ratio of the mean (across k loci) within-population variance in an allelic indicator variable to the mean (across k loci) total variance in an allelic indicator variable (Eq. 14)
DL2 A function of FSTk that bears the same relationship to FSTk as the square of Cohen’s d does to r2 (Eq. 15)
FST()k A generalization of FSTk for the sum of independent allelic indicator variables (Eq. 16)
DL()2 A function of FST()k that bears the same relationship to FST()k as the square of Cohen’s d does to r2 (Eq. 17)
U i A transformation of the Xi: if Xi = 1, then Ui = 1; if Xi = 0, then Ui = −1 (Eq. 18)
D T The standardized difference between populations A and B on the trait (Eqs. 25, 34)
ρT2 The proportion of the total variance in the trait attributable to between-population difference on the trait (Eqs. 26, 27,
41)
Q ST A quantitative-trait analogue of FST: if = 1(haploid organisms), then QST=ρT2 (Eq. 28)
W S A quantity that equals 1 if an individual is classified into the wrong population on the basis of its value of S, and that equals 0 otherwise (Eq. 55)
W T A quantity that equals 1 if an individual is classified into the wrong population on the basis of its value of T, and that equals 0 otherwise (Eq. 56)