16 (psychologist) – I clicked on a couple of the links to the Twitter leads as well. And that’s quite nice, because that gives sort of a current flavor, […] real-world things that people are talking about. |
03 (project coordinator) – I really like this [case study from a medical drama storyline]. This was, for me, tied in to pop culture – like what are most people familiar with? You could relate to it, and it’s a clear example right there. So it’s not just a whole lot of theory. And I think that’s why the polls were kind of nice as well. |
16 (psychologist) – … real life examples that happen quite commonly in clinical trials. I think that’s quite nice. It’s one thing to learn about in the abstract, but when you know that it’s happened in the real world, it’s a real thing that can happen and that you need to watch out for this, I find that’s quite powerful. |
Example polls
|
03 (project coordinator) – [The examples were] a really interactive way for people to actually sit down, like for me not to know a lot about risk of bias, and be learning it on the go, and you don’t have to do a lot to learn piece by piece. Like if I had to go do something else, then I could still go back to it and pick away at it, […] then you don’t feel like it’s too intensive. |
01 (trialist, systematic reviewer) – But does it tell you whether you’re right or wrong in the end? |
14 (trialist, systematic reviewer) – I answered the poll, and then you sort of see how other people have answered the poll. But maybe that’s just me being sort of scholastic, but I’d be sort of curious about what the answer is. But I don’t think there is an answer, is there? And then the more I thought about it, I think that’s the point, is that you know, two really smart people could answer the same question different ways, and not necessarily one of them is right or wrong. |
10 (trialist) – To see votes, I mean it’s like a beauty contest or something like that […] and it’s not very attractive, I think, to people who want to do serious scientific work. |
Technological features
|
13 (research assistant) – To me, it wouldn’t be as big of a deal to have [the text of the examples separated from the polls in a less esthetically pleasing format] than to have the page slowed down [by large text boxes]. |
14 (trialist, systematic reviewer) – I noticed that it was slow every time I was on it. |
12 (systematic reviewer) – I like the fact that everything – it’s not overwhelming. I’m not much for websites with lots of bells and whistles, so I like the fact that it’s not overwhelming, but it’s not bland either. |
16 (psychologist) – I think one of its beauties is its simplicity. |
13 (research assistant) – I thought it would be cool […] if you could have the [risk of bias] guidelines move along down the page [beside the examples while scrolling]. |
01 (trialist, systematic reviewer) – I know this is an over-simplification of the whole process, but people tend to like wizards. Where you’re asked a question and you say for example, “was this study randomized?” Or “will this study be randomized?” And then they say yes or no, and then based on that, you get a second question and so on. And at the end they would get their answer. |