Table 1.

Validity of Using the 3 Online Crowdsourcing Platforms to Identify the BCC Licensing Directory

	Sensitivity	Specificity	Positive Predictive Value (PPV)	Negative Predictive Value (NPV)
Gold Standard = Whether being Present in the BCC Licensing Directory; Test = Whether being Present on Each Crowdsourcing Platform
Weedmaps	.59 (.55, .62)	NA	.45 (.42, .49)	NA
Leafly	.70 (.67, .74)	NA	.83 (.80, .86)	NA
Yelp	.53 (.49, .57)	NA	.23 (.21, .25)	NA
Gold Standard = Whether being Present in the BCC Licensing Directory; Test = Whether Passing Call Verification
Weedmaps	.58 (.54, .62)	.34 (.29, .38)	.56 (.52, .59)	.36 (.31, .41)
Leafly	.66 (.62, .69)	.49 (.39, .60)	.90 (.87, .93)	.17 (.13, .22)
Yelp	.52 (.48, .56)	.87 (.85, .89)	.69 (.65, .73)	.76 (.74, .79)

Notes: 95% Confidence Intervals are reported in parentheses. BCC: California Bureau of Cannabis Control. Specificity and PPV were not calculated when the test was whether being present on each online crowdsourcing platform because we were not able to identify “true negative” (business records that were excluded from each crowdsourcing platform and absent in the BCC directory).