Table 3.
The number of methodological concerns by level.
| Type of methodological concern |
Type of methodological concern |
||||||||
| Level 1 |
Major |
Important |
Minor |
Total level 1 |
Level 2 |
Major |
Important |
Minor |
Total level 2 |
| Structural choices | 1 (4%)(9%)* | 12 (46%)(15%)* | 13 (50%)(9%)* | 26 (11%) | Economic analysis and choice of outcome criterion | 1 (50%) | 0 (0%) | 1 (50%) | 2 (8%) |
| Time horizon | 0 (0%) | 1 (50%) | 1 (50%) | 2 (8%) | |||||
| Comparison of strategies | 0 (0%) | 11 (52%) | 10 (48%) | 21 (81%) | |||||
| Perspective | 0 (0%) | 0 (0%) | 1 (100%) | 1 (4%) | |||||
| Measurement and valuation of health states and costs | 1 (1%)(9%)* | 16 (21%) | 58 (77%) | 75 (31%) | Costs | 0 (0%) | 6 (14%) | 36 (86%) | 42 (56%) |
| (20%)* | (38%)* | · Measure and calculation | 0 (0%) | 3 (14%) | 19 (86%) | 22 (52%) | |||
| · Cost type | 0 (0%) | 1 (20%) | 4 (80%) | 5 (12%) | |||||
| · Valuation | 0 (0%) | 2 (13%) | 13 (87%) | 15 (36%) | |||||
| Health states | 1 (3%) | 10 (30%) | 22 (67%) | 33 (44%) | |||||
| · Measure (methods and data) | 1 (4%) | 10 (37%) | 16 (59%) | 27 (82%) | |||||
| · Valuation | 0 (0%) | 0 (0%) | 6 (100%) | 6 (18%) | |||||
| Modelling | 3 (4%)(27%)* | 27 (34%) | 49 (62%) | 79 (33%) | Transition estimates | 1 (3%) | 9 (26%) | 24 (71%) | 34 (43%) |
| (34%)* | (32%)* | · Data extrapolation | 0 (0%) | 4 (67%) | 2 (33%) | 6 (18%) | |||
| · Estimation method | 1 (8%) | 0 (0%) | 12 (92%) | 13 (38%) | |||||
| · Reporting | 0 (0%) | 0 (0%) | 5 (100%) | 5 (15%) | |||||
| · Efficacy data source | 0 (0%) | 5 (50%) | 5 (50%) | 10 (29%) | |||||
| Modelled population | 2 (20%) | 2 (20%) | 6 (60%) | 10 (13%) | |||||
| Model structure | 0 (0%) | 13 (48%) | 14 (52%) | 31 (39%) | |||||
| Programming errors | 0 (0%) | 3 (75%) | 1 (25%) | 4 (5%) | |||||
| Study objective | 0 (0%)(0%)* | 2 (100%)(3%)* | 0 (0%)(0%)* | 2 (1%) | |||||
| Results presentation and sensitivity analyses | 6 (10%)(55%)* | 23 (38%) | 32 (52%) | 61 (25%) | Sensitivity analyses | 3 (8%) | 17 (47%) | 16 (44%) | 36 (59%) |
| (29%)* | (21%)* | · Deterministic /Probabilistic | 3 (10%) | 14 (45%) | 14 (45%) | 31 (86%) | |||
| · Scenario | 0 (0%) | 3 (60%) | 2 (40%) | 5 (14%) | |||||
| Presentation | 3 (25%) | 3 (25%) | 6 (50%) | 12 (20%) | |||||
| Validity (internal and external) and study limitations | 0 (0%) | 3 (23%) | 10 (77%) | 13 (21%) | |||||
| Total | 11 (4.5%) | 80 (32.9%) | 152 (62.6%) | 243 (100%) | 11 (4.5%) | 80 (32.9%) | 152 (62.6%) | 243 (100%) | |
*The indicated percentage is calculated by reservation type (minor, important and major). All other percentages are calculated by category level.