Summary
Background
The OVAMA (Outcome Measures for VAscular MAlformations) project determined quality of life (QoL) as a core outcome domain for evaluating treatment effect in vascular malformations. To correctly evaluate treatment effect on QoL, patient-reported outcome measures (PROMs) are needed that are responsive to changes. In children with vascular malformations, we explored if two widely used PROMs were responsive to changes: the Pediatric Quality of Life Inventory (PedsQL) and the Children's Dermatology Life Quality Index (CDLQI).
Methods
In an international multicenter prospective study, conservatively and invasively treated children completed the PedsQL and CDLQI at baseline and after follow-up of 6–8 weeks. At follow-up, change in health was assessed by a global rating of change (GRC) scale. Responsiveness was assessed by testing hypotheses on expected correlation strength between change scores of the PROMs and the GRC scale, and by calculating the area under the receiver operating characteristics curve (AUC). The PROMs were considered responsive if ≥75% of the hypotheses were confirmed or if the AUC was ≥0.7.
Results
Twenty-nine children were recruited in three centers in the Netherlands and United States, of which 25 completed all baseline and follow-up measurements. For both the PedsQL and CDLQI, less than 75% of the hypotheses were confirmed and the AUC was <0.7.
Discussion
The results suggest that these PROMs are not sufficiently responsive for evaluating treatment effect in peripheral vascular malformations. Our study emphasizes the need for assessing responsiveness before using a PROM in evaluating treatment effect.
Keywords: Vascular malformations, Quality of life, Responsiveness, Core outcome set, Patient-reported outcome measure, Validity
Introduction
Vascular malformations are rare congenital vessel anomalies. The tangles of dilated vessels often present as a visible mass leading to a distorted appearance. Apart from the cosmetic problems, patients commonly experience pain, bleeding, functional impairment and thrombotic complications.1, 2, 3, 4, 5 Symptoms and complications vary depending on the type, extent and localization of the lesion.
The lesions are classified according flow velocity and the types of vessels involved. Simple types include the high-flow arteriovenous malformations, and the low-flow venous, lymphatic and capillary malformations.3 Lesions may additionally be of combined origin, and can occur as part of different syndromes.
The anomalies may impact different aspects of quality of life (QoL), and are associated with an overall poorer QoL when compared with the general population.6 Since the clinical presentation varies widely, depending on subtype, localization, size, and extension, the impact on QoL varies as well, ranging from no impact at all to a very poor QoL.6
Many treatments are available, such as surgical excision, sclerotherapy, embolization, laser therapy, conservative management with analgesia or compression stockings, targeted medicaments, and combinations. Treatment effect is unpredictable, as both excellent and poor results are observed. However, the patient's perspective in evaluating treatment effect is often overlooked.
Different aspects of QoL, including emotional wellbeing, mobility, social functioning and other patient-reported outcomes (PROs) were recently included in the core domain set (CDS) for vascular malformations.7 A CDS is a minimum set of outcome domains that should be measured when evaluating treatment outcomes in a certain health condition.8 The CDS results from the OVAMA (Outcome Measures for VAscular MAlformations) project, an international consensus project which aims at uniform outcome reporting by determining what and how to measure.2,7
The next step is selecting or developing appropriate outcome measurement instruments for measuring the core domains, i.e. developing a core outcome measurement set (COMS).8,9 QoL and other PROs are measured by patient-reported outcome measures (PROMs). To correctly evaluate treatment outcome on QoL, PROMs are needed that are able to detect changes in QoL before and after treatment, which means that the PROMs must be responsive to changes.10,11 It is of great clinical relevance to be familiar with the term responsiveness, since every measurement tool must be sufficiently responsive in order to evaluate changes over time, such as before and after treatment.
Additionally, it is crucial for clinicians that research is conducted on how their treatments affect different aspects of the patient's life. This allows for clinicians to better inform the patient, which improves shared-decision making, and ultimately enables more personalized care tailored to the specific problems of the individual. Again, for this field of research to advance, a responsive PROM is needed.
In children with vascular malformations, we explored whether two widely used QoL PROMs showed responsiveness to changes in overall health regarding the vascular malformation: the Pediatric Quality of Life Inventory (PedsQL) and the Children's Dermatology Life Quality Index (CDLQI). We investigated if these PROMs can be used for assessing treatment effect and should be considered for inclusion in the COMS for peripheral vascular malformations.
Methods
Patients and data collection
From October 2016 until September 2017, data were collected prospectively of children under the age of 18 with a diagnosed peripheral vascular malformation at the outpatient clinics of the Amsterdam University Medical Centre in Amsterdam, Radboud University Medical Centre in Nijmegen, and the Vascular Birthmark Institute in New York. Written informed consent was obtained from all participants.
Patient and vascular malformation characteristics were extracted from the patient files. This included gender, age at start of treatment, type of vascular malformation, size (maximal diameter of <5 cm, 5–10 cm, ≥10 cm), localization (head/neck, trunk, upper extremities, lower extremities, combined), involved tissues (skin/subcutaneous tissue, muscle, organs, bone), and previous treatments.
Patients could receive conservative treatment (watchful waiting or compression stockings), or invasive treatment (including laser therapy, sclerotherapy and surgery). Follow-up measurement was 6–8 weeks post-treatment, which is customary for evaluating treatment effect in these clinics.
Outcome measures
PedsQL
The PedsQL is a generic QoL PROM for children and adolescents, containing 23 items measuring four domains of QoL: ‘physical functioning’, ‘emotional functioning’, ‘social functioning’, and ‘school functioning’.12 Additionally, a composite ‘psychosocial’ score can be derived. Higher scores indicate a better QoL.
CDLQI
The CDLQI is a PROM measuring the impact of skin disease on QoL in children. The questionnaire consists of 10 items forming 6 scales: ‘symptoms and feelings’, ‘leisure’, ‘school or holidays’, ‘personal relationships’, ‘sleep’, and ‘treatment’.13 Higher scores indicate a worse QoL.
All change scores were calculated such that a positive change score reflects improvement.
Global rating of change scale
At follow-up, the children additionally filled in a global rating of change (GRC) scale for measuring experienced change since baseline in overall health regarding their vascular malformation. The question was as follows: ‘To what extent has your overall health with respect to your vascular malformation changed when compared to your situation when you filled out the previous questionnaire? In other words, has anything changed since the last time you filled out the questionnaire (concerning the vascular malformation or any complaints you might have had)?’ Response options included ‘very much worse’, ‘worse’, ‘somewhat worse’, ‘no change’, ‘somewhat better’, ‘better’, and ‘very much better’.
All questionnaires were suitable for self-report from 8–17-year old. Parents were allowed to help with completing the GRC scale.
Evaluating responsiveness
The first method for evaluating responsiveness used the ‘construct approach’. This involves testing predefined hypotheses on correlations with other outcome measurement instruments, in this case: the other PROM and the GRC scale. For both the PedsQL and the CDLQI, we formulated 7 hypotheses (Table 1). These hypotheses were based on previous studies assessing responsiveness and methodology guidelines by COSMIN (COnsensus-based Standards for the Selection of Health Measurement INstruments).11,14, 15, 16, 17 As advised, if ≥75% of the hypotheses were confirmed, the questionnaire was considered responsive.11,14
Table 1.
PedsQL |
1. High positive correlation (>0.5) between PedsQL total change score and the GRC scale |
2. High positive correlation (>0.5) between PedsQL total change score and CDLQI total change score |
3. Moderate positive correlation (0.3–0.5) between PedsQL total change score and the CDLQI leisure subscale change score |
4. Low positive (<0.3) or negative correlation between PedsQL total change score and the CDLQI treatment subscale change score |
5. Patients indicating improvement on the GRC scale should have a positive mean change score |
6. Patients indicating worsening on the GRC scale should have a negative mean change score |
7. The mean change score of patients indicating improvement should be higher than the mean change score of unchanged patients, which in turn should be higher than the mean change score of worsened patients |
CDLQI |
1. High positive correlation (>0.5) between CDLQI total change score and the GRC scale |
2. High positive correlation (>0.5) between CDLQI total change score and PedsQL total change score |
3. Moderate positive correlation (0.3–0.5) between CDLQI total change score and the PedsQL physical subscale change score |
4. Low positive (<0.3) or negative correlation between CDLQI total change score and the PedsQL school subscale change score |
5. Patients indicating improvement on the GRC scale should have a positive mean change score |
6. Patients indicating worsening on the GRC scale should have a negative mean change score |
7. The mean change score of patients indicating improvement should be higher than the mean change score of unchanged patients, which in turn should be higher than the mean change score of worsened patients |
The hypotheses were formulated beforehand by two independent researchers (M.L., S.H.). Disagreement was resolved by consensus (M.L., S.H.). Spearman's rank correlation coefficients were calculated for assessing correlation strength. Correlation strength was interpreted as high (≥0.5), moderate (0.3–0.5), and low (<0.3), based on previous studies and guidelines for assessing responsiveness.11,14, 15, 16, 17, 18 Hypotheses 5, 6, and 7 concerned the mean change scores of improved, unchanged, and worsened patients according to the GRC scale.
With the second method, responsiveness was assessed by calculating the area under the receiver operating characteristics curve (AUC). The AUC is a value representing the instrument's ability to discriminate between improved and unchanged patients. Patients were categorized as improved or unchanged according to their GRC scale response. With an AUC of ≥0.7, an instrument can be considered responsive.11,19
All data were analyzed with IBM SPSS statistics 25.0.
Results
A total of 44 children were asked to participate of which 29 were included. Twenty-five (86%) children completed both PROMs at baseline and follow-up and completed the GRC scale.
Baseline characteristics
An overview of the included children's baseline characteristics is presented in Table 2. No significant differences were found in baseline characteristics between ex- and included children, and between children who completed follow-up and those who did not.
Table 2.
Total n=25 | Mean (range) | IQR (25th–75th percentile) |
---|---|---|
Age at baseline | 14 (8–17) | 14 (12–17) |
Frequency | Percentage | |
Gender | ||
Female | 21 | 84 |
Type | ||
Venous | 15 | 60 |
Lymphatic | 4 | 16 |
Arteriovenous | 2 | 8 |
Venous, capillary | 2 | 8 |
Venous, lymphatic | 1 | 4 |
Arteriovenous, capillary | 1 | 4 |
Localization | ||
Lower extremity | 10 | 40 |
Head/neck | 5 | 20 |
Upper extremity | 4 | 16 |
Trunk, lower extremity | 2 | 8 |
Trunk, upper extremity | 2 | 8 |
Trunk | 1 | 4 |
Head/neck, trunk | 1 | 4 |
Size (maximal diameter) | ||
<5 cm | 13 | 52 |
5–10 cm | 1 | 4 |
≥10 cm | 11 | 44 |
Depth/extension | ||
Skin/subcutaneous tissue, muscle | 11 | 44 |
Skin/subcutaneous tissue | 6 | 24 |
Skin/subcutaneous tissue, muscle, bone | 3 | 12 |
Skin/subcutaneous tissue, muscle, airway involvement | 2 | 8 |
Skin/subcutaneous tissue, muscle, visceral organs | 1 | 4 |
Muscle | 1 | 4 |
Bone | 1 | 4 |
Treatment history | ||
No prior treatment | 11 | 44 |
Sclerotherapy | 6 | 24 |
Surgery | 3 | 12 |
Elastic stockings | 2 | 8 |
Embolization | 1 | 4 |
Laser therapy, elastic stockings | 1 | 4 |
Surgery, sclerotherapy | 1 | 4 |
Treatment during study period | ||
Conservative | ||
Expectant management | 14 | 56 |
Elastic stockings | 5 | 20 |
Invasive | ||
Sclerotherapy | 5 | 20 |
Surgery | 1 | 4 |
Descriptive data
Descriptive data of the PedsQL and CDLQI at baseline and follow-up is shown in Table 3. For all domains of both PROMs scores ranged widely from no impact to large impact.
Table 3.
All patients |
Conservative treatment group |
Invasive treatment group |
|||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
N | Baseline |
Follow-up |
Change |
N | Baseline |
Follow-up |
Change |
N | Baseline |
Follow-up |
Change |
||||||||||
Mean | SD | Mean | SD | Mean | SD | Mean | SD | Mean | SD | Mean | SD | Mean | SD | Mean | SD | Mean | SD | ||||
PedsQL total | 25 | 78.7 | 16.1 | 78.1 | 16.7 | –0.7 | 9.9 | 19 | 76.8 | 17.1 | 76.0 | 17.1 | –0.8 | 10.2 | 6 | 85.0 | 11.7 | 84.6 | 15.2 | –0.4 | 9.8 |
PedsQL physical | 25 | 75.3 | 22.2 | 75.3 | 22.0 | 0.1 | 12.0 | 19 | 73.2 | 23.1 | 73.1 | 22.9 | 0.0 | 11.0 | 6 | 81.8 | 19.1 | 82.3 | 18.7 | 0.5 | 16.2 |
PedsQL emotional | 25 | 78.0 | 17.4 | 76.4 | 19.2 | –1.6 | 19.0 | 19 | 77.9 | 18.4 | 73.2 | 20.6 | –4.7 | 20.0 | 6 | 78.3 | 15.4 | 86.7 | 8.8 | 8.3 | 12.1 |
PedsQL social | 25 | 85.0 | 16.0 | 85.0 | 17.4 | 0.0 | 11.5 | 19 | 82.1 | 17.0 | 83.9 | 17.5 | 1.8 | 11.2 | 6 | 94.2 | 7.4 | 88.3 | 18.1 | –5.8 | 11.6 |
PedsQL school | 25 | 78.8 | 18.2 | 77.2 | 19.1 | –1.6 | 12.7 | 19 | 76.1 | 19.3 | 75.5 | 19.4 | –0.5 | 12.7 | 6 | 87.5 | 11.3 | 82.5 | 18.9 | –5.0 | 13.4 |
PedsQL psychosocial | 25 | 80.6 | 15.2 | 79.5 | 16.1 | –1.1 | 11.0 | 19 | 78.7 | 16.5 | 77.5 | 16.7 | –1.1 | 12.0 | 6 | 86.7 | 8.4 | 85.8 | 13.5 | –0.8 | 8.0 |
CLDQI total | 25 | 6.44 | 5.75 | 6.08 | 6.08 | 0.36 | 3.80 | 19 | 7.32 | 6.12 | 6.47 | 6.17 | 0.84 | 3.59 | 6 | 3.67 | 3.39 | 4.83 | 6.18 | –1.17 | 4.36 |
CDLQI symptoms and feelings | 25 | 1.00 | 0.79 | 0.82 | 0.73 | 0.18 | 0.59 | 19 | 1.13 | 0.81 | 0.87 | 0.70 | 0.26 | 0.61 | 6 | 0.58 | 0.58 | 0.67 | .88 | –0.08 | 0.49 |
CDLQI leisure | 25 | 0.75 | 0.71 | 0.69 | 0.78 | 0.05 | 0.57 | 19 | 0.75 | 0.68 | 0.67 | 0.72 | 0.09 | 0.55 | 6 | 0.72 | 0.85 | 0.78 | 1.00 | –0.06 | 0.68 |
CDLQI personal relationships | 25 | 0.14 | 0.37 | 0.24 | 0.56 | –0.10 | 0.35 | 19 | 0.18 | 0.42 | 0.29 | 0.63 | –0.11 | 0.39 | 6 | 0.00 | 0.00 | 0.08 | 0.20 | –0.08 | 0.20 |
CDLQI school or holidays | 25 | 0.92 | 1.04 | 0.80 | 1.04 | 0.12 | 0.67 | 19 | 1.16 | 1.07 | 0.95 | 1.08 | 0.21 | 0.71 | 6 | 0.17 | 0.41 | 0.33 | 0.82 | –0.17 | 0.41 |
CDLQI sleep | 25 | 0.56 | 0.77 | 0.52 | 0.71 | 0.04 | 0.61 | 19 | 0.74 | 0.81 | 0.58 | 0.77 | 0.16 | 0.60 | 6 | 0.00 | 0.00 | 0.33 | 0.52 | –0.33 | 0.52 |
CDLQI treatment | 25 | 0.44 | 0.77 | 0.56 | 0.92 | -0.12 | 1.17 | 19 | 0.53 | 0.84 | 0.63 | 0.96 | -0.11 | 1.24 | 6 | 0.17 | 0.41 | 0.33 | 0.82 | -0.17 | 0.98 |
GRC scale responses are presented in Table 4. All 12 patients indicating ‘no change’ received conservative treatment. Five of 6 invasively treated patients indicated improvement.
Table 4.
GRC scale response (n) | –3 | –2 | –1 | 0 | +1 | +2 | +3 |
---|---|---|---|---|---|---|---|
All patients | 0 | 3 | 3 | 12 | 2 | 4 | 1 |
Conservative treatment group | 0 | 3 | 2 | 12 | 0 | 2 | 0 |
Invasive treatment group | 0 | 0 | 1 | 0 | 2 | 2 | 1 |
No significant differences were found between different types of vascular malformation, size groups in PedsQL, CDLQI and GRC scale outcomes. The tissue involvement groups differed significantly in baseline PedsQL emotional functioning (p=0.033), school functioning (p=0.020) and baseline CDLQI symptoms and feelings (p=0.046), leisure (p<0.001) and CDLQI total score (p=0.005).
Responsiveness: hypotheses testing and area under the receiver operating characteristics curve
Full hypotheses testing results are shown in Table 5. For both the PedsQL and CDLQI, 1 of 7 (14%) hypotheses was confirmed. The AUC for the change in total score of the PedsQL was 0.375 (95% confidence interval (CI): 0.101–0.649), and for the CDLQI 0.429 (CI: 0.155–0.702).
Table 5.
Spearman's rank correlation coefficients |
5. Mean change improved (n=7) | 6. Mean change unchanged (n=12) | 7. Mean change worsened (n=6) | AUC | Hypotheses confirmed | ||||
---|---|---|---|---|---|---|---|---|---|
1. GRC scale | 2. CDLQI total | 3. CDLQI leisure | 4. CDLQI treatment | ||||||
PedsQL | 0.19 | 0.45 | 0.17 | 0.25 | –1.7 | 1.9 | –4.5 | 0.38 (0.10–0.65) | 14% |
Spearman's rank correlation coefficients |
5. Mean change improved (n=7) | 6. Mean change unchanged (n=12) | 7. Mean change worsened (n=6) | AUC | Hypotheses confirmed | ||||
1. GRC scale | 2. PedsQL total | 3. PedsQL physical | 4. PedsQL school | ||||||
CLDQI | –0.10 | 0.45 | 0.31 | 0.30 | –1.00 | 0.67 | 1.33 | 0.43 (0.16–0.70) | 14% |
Correlation between PedsQL and CDLQI score changes and GRC scale scores
Spearman's rank correlation coefficients between the PedsQL and CDLQI score changes and the GRC scale are shown in Supplementary File 1. All correlations were low, except for a moderate correlation between the CDLQI ‘personal relationships’ scale and the GRC scale.
Correlation between PedsQL change scores and CDLQI change scores
Spearman's rank correlation coefficients between the PedsQL score changes and the CDLQI score changes are shown in Supplementary file 2. All correlations were low or moderate, except between the PedsQL ‘emotional’ scale and the CDLQI total score, which was high.
Discussion
This exploratory study suggests that the PedsQL and CDLQI are insufficiently responsive for measuring vascular malformation-related health problems in children. Clinicians and researchers should be aware that changes in PedsQL and CDLQI scores over time might not reflect the true change these patients experienced. Responsiveness was assessed using two methods, both suggesting that these PROMs might not be suitable for evaluating treatment effects in children with vascular malformations, and thereby should not be included in the COMS.
It is notable that the group who indicated ‘no change’ on the GRC scale had a broad range of PROM change scores, suggesting the PROMs have large measurement errors (insufficient reliability), which might explain insufficient responsiveness. A study on responsiveness of two generic QoL measures in adult patients with vascular malformations also found insufficient responsiveness, plausibly caused by large measurement errors.20 A systematic review on outcome measurement instruments in vascular malformations found no other studies on responsiveness in this patient group or similar groups.21
It is known that most generic PROMs have large measurement errors, because they are often designed for cross-sectional use in very large populations.22 Most of the widely used generic PROMs make use of classical-test theory, for which many questions per measured domain are necessary to reduce measurement error.23 This is, however, limited by question burden, especially when measuring multiple health domains.
We believe researchers should be aware of this, and not blindly use a generic PROM for interpreting treatment effects without first ensuring if its responsiveness is evaluated correctly. Even the best-known PROMs are often not evaluated for responsiveness.24
Insufficient responsiveness could also be found if the GRC scale did not measure change correctly. However, as one would expect, the invasively treated group indicated more improvement with the GRC scale than the conservatively treated group, which predominantly indicated no change, supporting the GRC scale's ability in measuring change.
Although differences were seen between the different tissue involvement groups in baseline scores, no differences were seen between these groups in GRC scale scores. This suggests that tissue involvement might be a predictor of symptom severity and QoL, while it has no influence on treatment effects. However, we must not draw firm conclusions, since the subgroups in these analyses are very small.
Another possible cause is that treatment effect of vascular malformations is too subtle to detect, or the follow-up period was too short. However, this was contradicted by the GRC scale responses, since 71% of the patients indicating improvement rated their change as +2 or +3. Additionally, the goal is to find responsive PROMs with which all clinically relevant effects of treatment of vascular malformations can be measured.
Most correlations between PedsQL and CDLQI subscales were low to moderate, suggesting the two PROMs do not measure the same domains (convergent validity). The slightly higher correlations between the two PROMs as opposed to with the GRC scale suggest that health regarding vascular malformations might be attributed to other domains than the ones measured by the PedsQL and CDLQI. It might be that not all relevant items for this population are included (content validity), even though the domains match with the core domains for vascular malformations.
Mean scores of both PROMs at baseline show that the children's QoL was impacted moderately. However, QoL ranged broadly from normal to very poor, which may be caused by the heterogeneity of the disease, or the measurement error of the PROMs. Evidence is lacking for what clinical characteristics are associated with poor QoL. If reporting standards would be developed, it will be possible to identify clinically distinct groups, allowing the study of more homogeneous groups.
The study population seems small; however, in a recent guideline, there is explicitly no statement on sample size for evaluating responsiveness, since it involves evaluation of correlations in which significance plays no part.15 Additionally, our goal with this exploratory study was to investigate whether these widely used PROMs showed promising responsiveness, and therefore used the lowest cut-off values for ‘high’, ‘medium’ and ‘low’ correlations. Regarding the rarity of the disease, our goal is to find a PROM that is responsive in smaller study populations.
Innovations such as PROMIS (Patient-Reported Outcomes Measurement Information System) make use of item-response theory, reducing the number of needed items and decreasing measurement error, which is tested in different patient populations.23,25 We believe PROMIS might be a solution, and we are evaluating responsiveness of different PROMIS item banks in children with vascular malformations for measuring the more ‘universal’ core domains. For the remaining disease-specific domains, a disease-specific PROM is currently developed. Disease-specific domains, such as vascular malformation symptoms and appearance, might be targeted more directly by therapy, and therefore might be more suitable for detecting changes over time.
Conclusion
This exploratory study suggests that the PedsQL and CDLQI are not sufficiently responsive for evaluating treatment effect in children with peripheral vascular malformations. Our study casts doubts on the applicability of PROMs in evaluating treatment effect in specific conditions if the measurement properties, especially responsiveness, are not evaluated. Since PROMs are increasingly used to evaluate treatment effect, it is crucial that clinicians and researchers know about the responsiveness of the PROMs they use. Otherwise, treatment effects might be wrongly assessed. Many PROMs are not developed for smaller patient populations, hence the responsiveness will be problematic in such study populations and daily care. The solution might lie in developing a PROM focusing on disease-specific health aspects, and concurrent use of innovations such as the thoroughly evaluated PROMIS for measuring more universal health aspects.
Declaration of Competing Interest
None.
Acknowledgments
Funding
None.
Ethical approval
n/a.
Footnotes
All authors give consent for publication.
This study was approved by the Medical Ethics Institutional board of the Amsterdam University Medical Centres. Written informed consent was obtained from all participants.
Supplementary material associated with this article can be found, in the online version, at doi:10.1016/j.jpra.2020.11.013.
Appendix. Supplementary materials
References
- 1.Dasgupta R, Fishman SJ. ISSVA classification. Semin Pediatr Surg. 2014;23:158–161. doi: 10.1053/j.sempedsurg.2014.06.016. [DOI] [PubMed] [Google Scholar]
- 2.Horbach SER, van der Horst C, Blei F. Development of an international core outcome set for peripheral vascular malformations: the OVAMA project. Br J Dermatol. 2018;178:473–481. doi: 10.1111/bjd.16029. [DOI] [PubMed] [Google Scholar]
- 3.Wassef M, Blei F, Adams D. Vascular Anomalies Classification: Recommendations From the International Society for the Study of Vascular Anomalies. Pediatrics. 2015;136:e203–e214. doi: 10.1542/peds.2014-3673. [DOI] [PubMed] [Google Scholar]
- 4.Horbach SE, Lokhorst MM, Oduber CE. Complications of pregnancy and labour in women with Klippel-Trenaunay syndrome: a nationwide cross-sectional study. BJOG: an international journal of obstetrics and gynaecology. 2017;124:1780–1788. doi: 10.1111/1471-0528.14698. [DOI] [PubMed] [Google Scholar]
- 5.Horbach SE, Lokhorst MM, Saeed P. Sclerotherapy for low-flow vascular malformations of the head and neck: A systematic review of sclerosing agents. Journal of plastic, reconstructive & aesthetic surgery. 2016;69:295–304. doi: 10.1016/j.bjps.2015.10.045. JPRAS. [DOI] [PubMed] [Google Scholar]
- 6.Nguyen HL, Bonadurer GF, 3rd, Tollefson MM. Vascular Malformations and Health-Related Quality of Life: A Systematic Review and Meta-analysis. JAMA Dermatol. 2018;154:661–669. doi: 10.1001/jamadermatol.2018.0002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Lokhorst MM, Horbach SER, van der Horst C. Finalizing the international core domain set for peripheral vascular malformations: the OVAMA project. Br J Dermatol. 2019;181:1076–1078. doi: 10.1111/bjd.18043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Boers M, Kirwan JR, Wells G. Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0. J Clin Epidemiol. 2014;67:745–753. doi: 10.1016/j.jclinepi.2013.11.013. [DOI] [PubMed] [Google Scholar]
- 9.Schmitt J, Apfelbacher C, Spuls PI. The Harmonizing Outcome Measures for Eczema (HOME) roadmap: a methodological framework to develop core sets of outcome measurements in dermatology. J Invest Dermatol. 2015;135:24–30. doi: 10.1038/jid.2014.320. [DOI] [PubMed] [Google Scholar]
- 10.Mokkink LB, Terwee CB, Patrick DL. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–745. doi: 10.1016/j.jclinepi.2010.02.006. [DOI] [PubMed] [Google Scholar]
- 11.De Vet HC, Terwee CB, Mokkink LB. Cambridge University Press; Cambridge: 2011. Measurement in Medicine. et al. [Google Scholar]
- 12.Varni JW, Seid M, Rode CA. The PedsQL™: measurement model for the pediatric quality of life inventory. Medical care. 1999:126–139. doi: 10.1097/00005650-199902000-00003. [DOI] [PubMed] [Google Scholar]
- 13.Lewis-Jones M, Finlay A. The Children's Dermatology Life Quality Index (CDLQI): initial validation and practical use. British Journal of Dermatology. 1995;132:942–949. doi: 10.1111/j.1365-2133.1995.tb16953.x. [DOI] [PubMed] [Google Scholar]
- 14.Mokkink LB, Terwee CB, Patrick DL. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19:539–549. doi: 10.1007/s11136-010-9606-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Mokkink LB, de Vet HCW, Prinsen CAC. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual Life Res. 2018;27:1171–1179. doi: 10.1007/s11136-017-1765-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Lee AC, Driban JB, Price LL. Responsiveness and Minimally Important Differences for 4 Patient-Reported Outcomes Measurement Information System Short Forms: Physical Function, Pain Interference, Depression, and Anxiety in Knee Osteoarthritis. J Pain. 2017;18:1096–1110. doi: 10.1016/j.jpain.2017.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Stuge B, Jenssen HK, Grotle M. The Pelvic Girdle Questionnaire: Responsiveness and Minimal Important Change in Women With Pregnancy-Related Pelvic Girdle Pain, Low Back Pain, or Both. Phys Ther. 2017;97:1103–1113. doi: 10.1093/ptj/pzx078. [DOI] [PubMed] [Google Scholar]
- 18.Mokkink LB, Prinsen CAC, Patrick DL. 2018. COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs) et al. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Terwee CB, Bot SD, de Boer MR. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. doi: 10.1016/j.jclinepi.2006.03.012. [DOI] [PubMed] [Google Scholar]
- 20.Lokhorst MM, Horbach SER, Waner M. Responsiveness of quality of life measures in patients with peripheral vascular malformations: the OVAMA project. Br J Dermatol. 2019 doi: 10.1111/bjd.18619. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Horbach SER, Rongen APM, Elbers RG. Outcome measurement instruments for peripheral vascular malformations and an assessment of the measurement properties: a systematic review. Qual Life Res. 2019 doi: 10.1007/s11136-019-02301-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.DA Young-Afat. Patient-Reported Outcomes in Routine Care-A True Innovation but Only If Used Correctly. JAMA Oncol. 2019 doi: 10.1001/jamaoncol.2019.2321. [DOI] [PubMed] [Google Scholar]
- 23.Cella D, Gershon R, Lai JS. The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment. Qual Life Res. 2007;16(Suppl 1):133–141. doi: 10.1007/s11136-007-9204-6. [DOI] [PubMed] [Google Scholar]
- 24.Gabes M, Tischer C, Apfelbacher C. Measurement properties of quality-of-life outcome measures for children and adults with eczema: An updated systematic review. Pediatric Allergy and Immunology. 2019 doi: 10.1111/pai.13120. [DOI] [PubMed] [Google Scholar]
- 25.Cella D, Riley W, Stone A. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63:1179–1194. doi: 10.1016/j.jclinepi.2010.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.