Skip to main content
. 2020 Aug 26;9(20):7363–7374. doi: 10.1002/cam4.3335

TABLE 3.

Patient‐reported outcomes (PRO) reporting according to ISOQOL PRO Guidelines and study design

Variable Total Open‐label Blinded P
No. (%) No. (%) No. (%)
110 (100) 68 (100) 42 (100)
Title and abstract
The PRO should be identified as an outcome in the abstract. .69
No 9 (8.2) 5 (7.3) 4 (9.5)
Yes 101 (91.8) 63 (92.7) 38 (90.5)
The title of the paper should be explicit as to the RCT including a PRO * .63
No 17 (44.7) 11 (47.8) 6 (40.0)
Yes 21 (55.3) 12 (52.2) 9 (60.0)
Introduction, background, and objectives
The PRO hypothesis should be stated and specify the relevant PRO domain, if applicable. .58
No 26 (23.6) 16 (23.5) 10 (23.8)
Yes 36 (32.7) 20 (29.4) 16 (38.1)
N/A (if explorative) 48 (43.7) 32 (47.1) 16 (38.1)
The introduction should contain a summary of PRO research that is relevant to the RCT * .22
No 9 (23.7) 7 (30.4) 2 (13.3)
Yes 29 (76.3) 16 (69.6) 13 (86.7)
Additional details regarding the hypothesis should be provided, including the rationale for the selected domains, the expected directions of change, and the time points for assessment * 0.09
No 31 (81.6) 21 (91.3) 10 (66.7)
Yes 7 (18.4) 2 (8.7) 5 (33.3)
Methods
Outcomes
The mode of administration of the PRO tool and the methods of collecting data should be described .61
No 89 (80.9) 54 (79.4) 35 (83.3)
Yes 21 (19.1) 14 (20.6) 7 (16.7)
The rationale for the choice of the PRO instrument used should be provided. .02
No 47 (42.7) 23 (33.8) 24 (57.1)
Yes 63 (57.3) 45 (66.2) 18 (42.9)
Evidence of PRO instrument validity and reliability should be provided or cited. .23
No 31 (28.2) 17 (25.0) 14 (33.3)
Yes, for All PRO instruments 54 (49.1) 32 (47.1) 22 (52.4)
Yes, only for some PRO instruments 25 (22.7) 19 (27.9) 6 (14.3)
The intended PRO data collection schedule should be provided. .60
No 11 (10.0) 6 (8.8) 5 (11.9)
Yes 99 (90.0) 62 (91.2) 37 (88.1)
PRO should be identified in the trial protocol; post hoc analyses should be identified. <.01
No 67 (60.9) 49 (72.1) 18 (42.9)
Yes 43 (39.1) 19 (27.9) 24 (57.1)
The status of PRO as either a primary or secondary outcome should be stated. .07
No 11 (10.0) 10 (14.7) 1 (2.4)
Yes 88 (80.0) 50 (73.5) 38 (90.5)
Unclear 11 (10.0) 8 (11.8) 3 (7.1)
A citation for the original development of the PRO instrument should be provided * .57
No 14 (36.8) 7 (30.4) 7 (46.8)
Yes 13 (34.2) 9 (39.2) 4 (26.7)
Yes, only for some PRO instruments 11 (29.0) 7 (30.4) 4 (26.7)
Windows for valid PRO responses should be specified and justified as being appropriate for the clinical context * .46
No 18 (47.4) 12 (52.2) 6 (40.0)
Yes 20 (52.6) 11 (47.8) 9 (60.0)
Sample size
There should be a power sample size calculation relevant to the PRO based on a clinical rationale * .72
No 14 (36.8) 9 (39.1) 5 (33.3)
Yes 24 (63.2) 14 (60.9) 10 (66.7)
Statistical methods
There should be evidence of appropriate statistical analysis and tests of statistical significance for each PRO hypothesis tested. .57
No 5 (4.5) 3 (4.4) 2 (4.8)
Yes 33 (30.0) 18 (26.5) 15 (35.7)
N/A (if PRO hypotheses were not stated) 72 (65.5) 47 (69.1) 25 (59.5)
The extent of missing data should be stated. a .44
No 32 (29.1) 18 (26.5) 14 (33.3)
Yes 78 (70.9) 50 (73.5) 28 (66.7)
Statistical approaches for dealing with missing data should be explicitly stated. a .68
No 81 (73.6) 51 (75.0) 30 (71.4)
Yes 29 (26.4) 17 (25.0) 12 (28.6)
The manner in which multiple comparisons have been addressed should be provided * .80
No 27 (71.1) 16 (69.6) 11 (73.3)
Yes 11 (28.9) 7 (30.4) 4 (26.7)
Results
Participant flow
A flow diagram or a description of the allocation of participants and those lost to follow‐up should be provided for PRO specifically. .37
No 61 (55.5) 40 (58.8) 21 (50.0)
Yes 49 (44.5) 28 (41.2) 21 (50.0)
The reasons for missing data should be explained. 0.60
No 70 (63.6) 42 (61.8) 28 (66.7)
Yes 40 (36.4) 26 (38.2) 14 (33.3)
Baseline data
The study patients’ characteristics should be described, including baseline PRO scores. .88
No 35 (31.8) 22 (32.4) 13 (30.9)
Yes 75 (68.2) 46 (67.6) 29 (69.1)
Outcomes and estimation
Are PRO outcomes also reported in a graphical format? b .44
No 39 (35.5) 26 (38.2) 13 (30.9)
Yes 71 (64.5) 42 (61.8) 29 (69.1)
The analysis of PRO data should account for survival differences between treatment groups, if relevant * .45
No 1 (2.6) 1 (4.3) 0 (0)
Yes 5 (13.2) 2 (8.7) 3 (20.0)
N/A (if not relevant) 32 (84.2) 20 (87.0) 12 (80.0)
Results should be reported for all PRO domains (if multidimensional) and items identified by the reference instrument * .97
No 10 (26.3) 6 (26.1) 4 (26.7)
Yes 28 (73.7) 17 (73.9) 11 (73.3)
The proportion of patients achieving predefined responder definitions should be provided where relevant * .11
No 4 (10.5) 1 (4.4) 3 (20.0)
Yes 7 (18.4) 3 (13.0) 4 (26.7)
N/A (if not relevant) 27 (71.1) 19 (82.6) 8 (53.3)
Discussion
Limitations
The limitations of the PRO components of the trial should be explicitly discussed .60
No 70 (63.6) 42 (61.8) 28 (66.7)
Yes 40 (36.4) 26 (38.2) 14 (33.3)
Generalizability
Generalizability issues uniquely related to the PRO results should be discussed. .42
No 47 (42.7) 27 (39.7) 20 (47.6)
Yes 63 (57.3) 41 (60.3) 22 (52.4)
Interpretation
Are PRO interpreted (not just restated)? b .23
No 28 (25.5) 20 (29.4) 8 (19.1)
Yes 82 (74.5) 48 (70.6) 34 (80.9)
The clinical significance of the PRO findings should be discussed. .12
No 74 (67.3) 42 (61.8) 32 (76.2)
Yes 36 (32.7) 26 (38.2) 10 (23.8)
The PRO results should be discussed in the context of the other clinical trial outcomes. .19
No 15 (13.6) 7 (10.3) 8 (19.1)
Yes 95 (86.4) 61 (89.7) 34 (80.9)
Other information
Protocol
A copy of the instrument should be included if it has not been published previously * .35
No 15 (39.5) 11 (47.8) 4 (26.7)
Yes 12 (31.5) 7 (30.4) 5 (33.3)
N/A (if the instrument is already published or known in the literature) 11 (29.0) 5 (21.8) 6 (40.0)
a

These items were originally combined in the ISOQOL recommended standards but have been split in this report to better investigate possible discrepancies between documentation of PRO missing data (ie, reporting how many patients did not complete a given questionnaire at any given time point) versus actual reporting of statistical methods to address this issue.

b

These items were not included in the ISOQOL recommended standards but have been evaluated in our study and reported in this table to have a wider outlook on the level of reporting.

*

Additional standards only for PRO as primary outcome, number of trials = 38.