Figure - PMC

Skip to main content

An official website of the United States government

Here's how you know

Here's how you know

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

View full-text article in PMC

. 2009 Jun 23;7(6):e1000131. doi: 10.1371/journal.pbio.1000131

Search in PMC
Search in PubMed
View in NLM Catalog
Add to search

Mora et al.

This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.

PMC Copyright notice

Validity refers to the degree to which the responders' answers approach the truth. Reliability refers to the extent to which different experts agreed in their answers. (A) Using countries for which duplicated responses were obtained, we show the frequency distribution of the Pearson correlation coefficients contrasting each responder to other responders in the same country. (B) depicts the frequency with which responders chose the same score or the next closest choice. Dotted lines in the plot indicate the confidence limits of a null model in which the levels of agreement were measured when choices were made randomly. The confidence limits are based on 1,000 repetitions of this null model. The error bars indicate standard deviation. (C) Using empirical data collected by another study [15], we show the similarities between our expert-based score and an empirically based score for a particular question (see Materials and Methods). The diagonal line indicates the 1:1 ratio.