Table 2.
Validity of Using the BCC Licensing Directory and the 3 Online Crowdsourcing Platforms to Identify Active Brick-and-Mortar Dispensaries
| Sensitivity | Specificity | Positive Predictive Value (PPV) |
Negative Predictive Value (NPV) |
|
|---|---|---|---|---|
|
Gold Standard = Whether being Present in the Call-Verified, Combined Database; Test = Whether being Present in Each Data source | ||||
| BCC | .59 (.55, .62) | NA | .77 (.74, .80) | NA |
| Weedmaps | .80 (.77, .82) | NA | .81 (.78, .84) | NA |
| Leafly | .56 (.52, .59) | NA | .86 (.83, .89) | NA |
| Yelp | .57 (.54, .60) | NA | .32 (.30, .35) | NA |
|
Gold Standard = Whether being Present in the Call-Verified, Combined Database; Test = Whether Passing Call Verification | ||||
| BCC | .59 (.55, .62) | NA | NA | .30 (.26, .34) |
| Weedmaps | .80 (.77, .82) | NA | NA | .48 (.42, .53) |
| Leafly | .56 (.52, .59) | NA | NA | .17 (.14, .21) |
| Yelp | .57 (.54, .60) | NA | NA | .74 (.71, .76) |
Notes: 95% Confidence Intervals are reported in parentheses. BCC: California Bureau of Cannabis Control. Specificity and NPV were not calculated when the test was whether being present in each data source because we were not able to identify “true negative” (business records that were excluded from each data source and absent in call-verified, combined database). Specificity and PPV were not calculated when the test was whether passing call verification because no records could be categorized as “false positive” (business records that passed call verification but were excluded from the call-verified, combined database).