|
Barriers
|
|
Access to dashboard |
“This might be a little petty, but just the fact that I have to use a password to access it. I think especially people on our coalition, they may not write down their passwords that they use for [the HCSa] because it’s not their full-time job. So. if they forget the password, they’re less likely to go through the steps to retrieve it and get in there, so they may not use it as much if it were just open access” (Kentucky). “I remember my login info and its only because my computer remembers it. I think my username was given to me and it’s not what I normally use for things so I think if my computer didn’t hold my username and password, I would have had to fiddle with it every time I try to open it” (New York). “Another thing too, and this is my last thought is that it’s kind of odd who can have access and who cannot have access. It feels very gate kept in a way. And that’s going to be a barrier just anyway, so you know, we have our voting is set up for one vote per agency, which has led to just one representative per agency so that one representative for that agency is the only one who has access but their partner or a contact of theirs within their agency is the one emailing me for the information. They don’t have access to the dashboard. So that kind of does create a barrier as well and it’s definitely something that I don’t like about it. I don’t like there’s a password. I don’t like that you have to log in” (Ohio).
|
|
Data manageability |
“[Describing barriers and challenges] first of all it’s not being able to download the data but also not being able to compare two different data sets” (Ohio). “[I]nitially, they wanted us to have a couple slides and go over overdoses every month, and all of us were like, ‘What? There’s so many different things, and it looks insane. I don’t know how to explain that.’ Once I felt more comfortable with filtering things out to make it digestible, it’s been more useful. But initially, it was kind of crazy to look at” (Kentucky). “I might add that, as a CDM [community data manager] in a cluster community, these communities don’t often combine their data, so on the data dashboard for...those aggregate counts, or that aggregated together from each community, so it’s really hard to see what’s working, although we want to break silos. They don’t identify together, so I think that’s been a little bit hard, not to be able to see that separate breakdown” (Massachusetts).
|
|
Unable to locate usable data |
“I would say, a major barrier in [deidentifed community], as well, are the suppression rules, you know, because we have such a small population” (Ohio). “[I]t’s a rural community or communities, and so often our data is suppressed for the variables that require suppression. So, I think that just based on it’s great to remain confidentiality and is hard to understand if there’s an increase from one to four, et cetera, or zero to four. So, the suppression in rural communities is that point” (Massachusetts). “And so, we were anticipating and we were being told over and over again, that this data is coming, wait to see the dashboard, and then behind the scenes, we would get contacted and say, you guys got to push this dashboard, you guys got to keep pushing it, and so I’ll go on the dashboard and there’s nothing to push” (New York).
|
|
Presentation of numbers and labels |
“So, I’m assuming if any numerator is a one through 10 or a denominator’s one through 10, the data gets suppressed, but I guess I’m not 100% sure, and then...And then I noticed like on the overdose deaths for May of ‘21. There’s a zero value there. I don’t know if that’s like you know when there’s a zero on the dashboard. Are those true zeros or is it like a placeholder? Like do we really not have any overdose deaths in May at all. Which seems kind of, like it, you know not right, I guess” (Ohio). “Sometimes I wonder if, you know, the line across whatever the imputed data value [ie, values masked due to suppression rules] that is chosen for a particular measure, now that there’s the trend line, I wonder if just leaving off the imputed value all together, so it doesn’t show on the plot. Because I feel like if someone looks at it fast, they’re not looking at it close enough to be like, ‘Oh, why is March missing?’ They wouldn’t even notice that and that might clear up a bunch of confusion” (New York). “[On their naloxone administration event data] But yeah, it’s like on a five, it’s like five. And I remember somebody asking me like, ‘Why is it stuck at five instead of zero?’ I don’t know why. And I couldn't explain that. So, like, if I can't explain that, then like I don't -- like then they look at me, and, you know, whatever, we're all supposed to be experts and we all have degrees in-in, you know, in bio stats or data or whatever, we're experienced and if we can't explain that, then-then they question that” (New York). “My thing is super minor, and it’s a visual thing...On our specific dashboard, there’s the cover page, and the first one in the upper hand corner, it still says opioid overdose deaths, but if you click in it’s more like, I would say it’d be more accurate to describe it as opioid overdose events or related events, because it seems like, if someone were to click on it, they’d only be able to access the death data...When I present it, people were like, ‘Oh, I didn’t realize there was EMS data there too,’ so it’s totally a minor label thing” (Massachusetts).
|
|
Facilitators
|
|
Additional support |
“I think, just like before maybe HEALing Communities leaves our county...It might be nice to like have a refresher to some of our stakeholders about the dashboard and what information is out there. You know, maybe like a you know presentation, or something and how to get access to it and that kind of thing. I know that was done a while back, because I feel like...I’m even a data person and I, you know still kind of struggle with the dashboard of HEALing Communities so and there’s a lot on there obviously that I didn’t even know about” (Ohio). “It may be helpful just for me to have some kind of training on how to put the data together though. Because I can go in there and just mess with everything. But looking at the community profile, the dashboards, and how to build those specific charts and things, I’m not sure exactly the functionality of it. So maybe just a video or just being able to ask questions or something like that would be pretty helpful” (Kentucky). “I was going to say for troubleshooting too, I think we’ve run into that challenge. Of course, coalition members will come to us saying they’ve run into an error or whatever the case may be, and it’s just challenging to triage some of that, to be like, ‘Hold on. Let me get in touch, try to figure out what’s going on, and then I’ll try to get back to you as soon as possible.’ And I think everyone in [Organization] has been really responsive” (Massachusetts).
|
|
Data accessibility |
“So, I do like that up at the top of the dashboard it has like where you are compared to 2017, it compares the various years to 2017 so that you see...the -- if it’s increasing or decreasing compared to that, like really steady fixed baseline. I also like that you can look at the data by month, by quarter, and by year, because I think that is also really helpful. Especially like with overdose deaths, where there can be some seasonality to that, it’s helpful to see that” (Ohio). “I like that you’re able to add more than one indicator to kind of look at how the trends have changed over the last couple of years and being able to put in more than one thing to get a graph and look at. Because it’s very helpful when it’s all in one place. Because I did a lot of data for a grant for that [deidentified] grant that I wrote a couple of years ago. And it was so hard to get all that data because you had to look at multiple different programs and now it’s just all on one program. So that’s really helpful” (Kentucky). “It’s quick, it’s like a bottom line, you know. If you, if you had to throw together a newsletter or a speech or a letter to the editor, you could, you know, you could glance over it and get some up to date, real time numbers, you know, for that area, pretty reliably” (New York).
|
|
Navigability |
“I think the dashboards, I think they’re beautiful, I think you guys did a really great job...I think it looks great, it just -- the data is just not very useful for us right now, unfortunately” (New York). “It’s very easy to use and I’m kind of a very visual person. So, for me, being able to look at graphs makes it a lot easier. And so, I use a lot of graphs...having those graphs provides me with a very quick and easy picture of ups and downs is really valuable” (Massachusetts). “I like the charts. I think that as someone who...I mean not only do I write grants and those charts are really helpful to stick in there for the reviewer, especially when you have something that you want to really emphasize. But also doing presentations and reports and things like that for other people, it really helps them to be able to see the trend and understand you know that. So, I just like the fact that it makes really nice, simple, pretty charts” (Ohio). “One of the things that I liked about it is being able to go in there and see the trends. It’s like it’s talking about pharmacy dispensing, and naloxone dispensing in the community, whether that’s trending up and down. I thought that was pretty helpful. It’s a few months behind, but an accurate view of what’s going on in the community right now” (Kentucky).
|
