Table 3.
Changes made to prototypes
| Task |
| Number of studies contributing to meta-analysis |
| Task Given to Participants: A colleague briefly describes the meta-analysis. Can you locate this information and describe how many studies it summarizes? |
| Iteration/ Errors: |
| Cycle 1=2 errors – Change made: Heading moved from right-hand side to left-hand side |
| Cycle 2=3 errors – Change made: Text in heading bolded |
| Cycle 3=2 errors – Change made: No further changes |
| Task |
| Locate evidence rating scale |
| Task Given to Participants: You want to present some of this information to others and need to confirm how the evidence rating scale works. Can you describe the evidence rating scale? |
| Iteration/ Errors: |
| Cycle 3=1 error – Change made: No changes made - review of transcripts indicated misinterpretation of question |
| Task |
| State ‘take home message’ Task Given to Participants: You need to give a group of residents the clinical ‘take-home message’ from the document. What information would you share with them? |
| Iteration/ Errors: |
| Cycle 1=2 errors – Change made: Question re-worded to ‘summary or take-home message’ |
| Task |
| Report explanation for odds ratio |
| Task Given to Participants: You want to confirm the explanation for an odds ratio. Can you find this information and describe it? |
| Iteration/ Errors: |
| Cycle 2=1 error – Change made: Information on bottom of document distinctly separated by adding boxes or white space |
| Task |
| Treatment for ocular rosacea |
| Task Given to Participants: There are no trials for several treatments. Can you locate one treatment for ocular rosacea where there are no randomized controlled trials for evaluation and state it? |
| Iteration/ Errors: |
| Cycle 2=1 error – Changes made: i) Text: colour changed from red to black; capitalized; made larger, and ii) Information on bottom of document distinctly separated by adding boxes or white space |
| Cycle 3=2 errors – Change made: No further changes |
| Task |
| Number of studies contributing to review Task Given to Participants: You want a sense of how many studies contributed to the entire review. Locate this information and describe the number of studies. |
| Iteration/ Errors: |
| Cycle 1=1 error – Change made: Efforts focused on making number of studies in the meta-analysis distinct |
| Cycle 2=2 errors – Change made: Efforts focused on making number of studies in the meta-analysis distinct |
| Cycle 3=1 error – Change made: No further changes |