Skip to main content
Infectious Diseases and Therapy logoLink to Infectious Diseases and Therapy
. 2022 Sep 6;11(5):2017–2033. doi: 10.1007/s40121-022-00678-w

Patient-Reported Outcomes (PROs) in HIV Infection: Points to Consider and Challenges

Antonio Antela 1,, José Ignacio Bernardino 2, Juan Carlos López-Bernaldo de Quirós 3, Pablo Bachiller 4, María José Fuster-RuizdeApodaca 5,6, Jordi Puig 7, Silvia Rodríguez 8, Isabel Castrejón 9,10, Beatriz Álvarez 11, Marta Hermenegildo 12
PMCID: PMC9618004  PMID: 36066841

Abstract

Introduction

The aim of this study was to reach consensus on the use of PROs (patient-reported outcome measures) in people living with HIV (PLHIV).

Methods

A scientific committee of professionals with experience in PROMs methodology issued recommendations and defined the points to support by evidence. A systematic review of the literature identified the coverage, utility, and psychometric properties of PROMs used in PLHIV. A Delphi survey was launched to measure the degree of agreement with the recommendations of a group of practicing clinicians and a group of patient representatives.

Results

Four principles and ten recommendations were issued; however, the results of the Delphi showed significant differences in the opinion between health professionals and PLHIV, and polarization within collectives, hampering consensus.

Conclusions

Despite a wealth of evidence on the benefit of PROMs, there are clear barriers to their use by healthcare professionals in HIV care. Intervention on these barriers is paramount to allow truly patient-centered care.

Graphical abstract

graphic file with name 40121_2022_678_Figa_HTML.jpg

Supplementary Information

The online version contains supplementary material available at 10.1007/s40121-022-00678-w.

Keywords: Patient-reported outcomes, PROs, HIV, Consensus, Recommendations

Key Summary Points

Why carry out this study?
In HIV, therapy has a notable impact on quality of life (QoL), and so regulators recommend the use of patient-reported outcomes (PROs). PROs are increasingly incorporated in clinical trials, but their use in clinical practice is very limited.
The PROMETEO project aimed to reach expert consensus on how to incorporate PROs in the care of people with HIV.
What was learned from the study?
Despite the wealth of information on the benefits of PROs in HIV, the recommendations of an expert panel did not reach consensus at the broad community level.
A deeply rooted aversion to subjectivity and other beliefs may act as barriers.
Much more is needed to convince clinicians to use PROs in their daily practice of people with HIV.

Digital Features

This article is published with digital features, including an infographic, to facilitate understanding of the article. To view digital features for this article go to https://doi.org/10.6084/m9.figshare.20348400.

Introduction

The efficacy and persistence of antiretroviral therapy (ART) for HIV infection have transformed the life expectancy of people living with HIV (PLHIV). Today, after years of progressive improvement, life expectancy is similar to that of the general population. One of the consequences of this evolution is that the diagnostic-therapeutic target published by the World Health Organization (WHO) for the year 2020 was 90%–90%–90% (i.e., 90% of people diagnosed, on treatment, and with viral suppression) [1]. A fourth 90% was added in 2016, relating to health-related quality of life (HRQoL) [2], which will allow that, in addition to sustained viral suppression, PLHIV will also enjoy healthy aging [3].

Patient-reported outcomes (PROs) assess symptoms, health behaviors, and life circumstances associated with HIV and comorbidities resulting from the disease itself and its treatment. PROs focus primarily on specific aspects of health and treatment that can only be elicited through specific questions, such as psychological concepts or non-specific symptoms that are not obvious to the observer (anxiety, fatigue, etc.), and reveal their frequency and severity, as well as their impact on patients’ quality of life [49]. In addition, PROs also allow the assessment of other important aspects, such as adherence to ART, possible risky sexual behaviors, stigmatization, and depression [10]. Moreover, their use improves doctor–patient communication on more complex issues, such as mental and sexual health [11].

The measurement of PROs is usually performed with PROMs (patient-reported outcomes measures), namely questionnaires, either unidimensional or multidimensional, which can be generic or specifically validated for a particular disease. These questionnaires provide essential data for patient evaluation and follow-up, clinical decision-making, assessment, coping with the disease, and evaluation of therapeutic efficacy and quality of care provided. PROMs allow exploration of the physical, social, mental, and emotional domains of patients, and their application in clinical practice can increase both the commitment to self-care [12] and satisfaction with the healthcare received [13]. Nevertheless, a fundamental premise of the usefulness of these questionnaires is that they must be validated and adapted to the geographical and cultural context as well as to the language in which they are applied [14].

In the case of HIV, it is unquestionable that ART and its toxicity have a notable impact on the HRQoL of PLHIV. Both the EMA (European Medicines Agency) and the FDA (US Food and Drug Administration) have recommended the use of PROMs for the evaluation and optimization of new treatments, given their relationship with therapeutic efficacy and their predictive value on the use of new treatments [15] and health services [16]. PROMs can play a decisive role in the choice of ART regimens since, given equal levels of efficacy and safety, a better assessment of the level of satisfaction, compliance, and comfort with treatment can help determine the most appropriate regimen [17].

On the other hand, PROMs help explain certain discrepancies between the results of clinical trials and those obtained in real life [17]. Although PROMs have been incorporated more frequently in ART efficacy studies in recent years [1822], their incorporation into clinical practice is proven to be laborious, as a result of, among other reasons, the reluctance of some specialists to use them [2325].

A review of systematic reviews of PROMs for measuring HRQoL in PLHIV showed that the questionnaires with the best properties were the MOS-HIV, the WHOQOL-HIV BREF, and the PROQOL-HIV [26]. There are validations in Spanish of both the MOS-HIV [27] and the WHOQOL-HIV BREF [14].

The incorporation of PROs and PROMs into routine clinical practice places PLHIV at the epicenter of therapeutic decisions, as it not only allows the identification of patient problems and concerns but also facilitates more efficient and personalized healthcare [3, 17]. Therefore, it is essential to conduct studies to define, validate, and identify which PROs and PROMs should be used by professionals caring for PLHIV.

In this sense, the objective of the PROMETEO project is to reach expert consensus on the use of the most appropriate PROs and PROMs in PLHIV in Spain.

Methods

Study Design

The usual evidence-based consensus methodology was used, including nominal group meetings, systematic literature review, and Delphi survey [28]. It was conducted in full compliance with the principles established in the Declaration of Helsinki, concerning medical research on human subjects, in its latest version, and accordance with the applicable regulations on Good Clinical Practice. After consultation with the Ethics Committee of Comunidad de Madrid, a review and approval was deemed unnecessary given the nature of data collected, namely the absence of health and personal data.

Panel of Experts

To address all the important aspects, a multidisciplinary panel of experts was established, consisting of six infectious disease specialists, a rheumatology specialist with vast experience in the use and validation of PROS, a hospital pharmacist, and a psychosocial researcher with methodological expertise in the design and validation of PROs (also a patient representative). The main functions of this panel consisted of defining the points of greatest debate or controversy; validating the profiles of the most suitable participants/panelists to evaluate the agreement; and drafting the recommendations. In addition, a technical team with experience in systematic reviews and consensus techniques was in charge of editing the first survey, inviting the panel of experts, sending the first round of the Delphi, and analyzing the responses.

Systematic Literature Review

The scientific committee wanted to know what PROMs were used in PLHIV, the domains covered, and the level of validation; where, how often, and by whom the PROMs are collected; at what points in the disease should they be collected, and how to integrate them into clinical practice. The research questions defined by the panel were transformed into the PICOt epidemiological format (Population, Intervention, Comparator, Outcome, and Type of study) to be answered by a systematic review of the literature (Supplementary material).

Search strategy The review was conducted in Medline via PubMed (final search date January 20, 2021). We identified and tested terms from published reviews on “HIV” and “patient-reported outcome measures” to which we applied the necessary modifications to make them sensitive to the control documents (Supplementary material).

Eligibility criteria Three types of studies were included: (a) those describing PROMs (development, psychometric properties, and use in randomized clinical trials (RCTs)); (b) those involving PLHIV and use of PROMs in real-life conditions; and (c) those integrating PROMs into HIV consultations with subsequent measurement of effectiveness (Best practice studies/Health services research). On the other hand, we excluded studies (a) conducted in children or adolescents; (b) those in which HIV was part of a broader set of diseases without specific outcome analysis; and (c) those using PROMs on HIV screening (prevention), identification of barriers and facilitators of treatment or follow-up, patient preferences and determinants of quality of life.

The total number of studies exceeded 22,000, so it was decided to filter the search by systematic reviews only. A single expert reviewer made the selection of studies, first by title, then by abstract, and, in case of doubt or absence of abstract, by detailed reading. The selection was reflected in a flowchart and tables of included and excluded studies. Once the articles had been selected for detailed reading, the systematic reviews that responded to the research questions were screened. In the absence of a systematic review for a specific question, the literature was reviewed with the TripDatabase search engine, a meta-search engine that allows simultaneous access to the information contained in different resources.

For each of the selected studies, the following data were collected: objective, domains explored, and results. In parallel, a table was elaborated with all the PROMs included in the studies, with the following fields: PROMs name, generic or HIV-specific nature, domains and subdomains assessed, original study, number of items, self-administered, free of charge, and a subjective measure of validity based on a quick scan of published validation studies, in BiblioPRO (IMIM, available at https://www.bibliopro.org/) or PubMed, using the name and MeSH term “Validation Studies as Topic”[MeSH].

The quality of the included systematic reviews, with or without meta-analysis, was assessed using the AMSTAR-2 scale, available online at https://amstar.ca/Amstar-2.php, which assesses the overall confidence in the results of a systematic review (high, moderate, low, or critically low) [29]. The lowest quality is associated with reviews of observational studies. Finally, studies developing or analyzing a particular PROM were assessed using the COSMIN consensus checklist [30, 31].

Consensus Meeting for the Formulation of Recommendations

Once the literature review had been completed, and based on the aspects indicated in the first meeting, the results were presented and discussed in a virtual meeting. The scientific committee agreed on four overarching or guiding principles and 10 recommendations. These were discussed and edited in front of the members of the committee until a consensus was reached.

Delphi Survey

The guiding principles and recommendations were transported into the items of a Delphi survey to seek the consensus of a larger group. The survey was conducted anonymously online and was sent to a group of 80 health professionals attending to PLHIV and another group of representatives of PLHIV. Before sending out the Delphi, the items were reviewed by patient research partners, who required some modifications of the language to make it more accessible to all audiences. Each item had to be scored with a 0 to 10 scale with 0 meaning no agreement and 10 meaning full agreement, and there were open text boxes for comments. Disagreement was defined as values below 40 and agreement above 70. The idea was to reach a consensus in two to three Delphi rounds, maintaining only the items with the largest agreement (aggregated scores 8–10 over 80%).

Results

Systematic Review

The search produced a total of 729 articles (only systematic reviews). After reading the title and abstract, we excluded 676 and selected 52 for detailed reading, plus one extracted by secondary search from the bibliographic references of the selected articles. Finally, 35 studies were included (Fig. 1).

Fig. 1.

Fig. 1

Flowchart of the recovered, screened, and included studies

Fifteen of the included studies are systematic reviews of PROMs, six of randomized clinical trials (RCTs) in which PROMs were used as endpoints, and eight of observational studies with PROMs (Supplementary material).

The included studies mention up to a total of 140 PROMs, of which 52 are specific to PLHIV, and that covered five major domains: quality of life, self-management, social factors, spirituality, and satisfaction (Table 1).

Table 1.

Questionnaires on PROs specific to PLHIV

Domain Questionnaires
Quality of life FAHI, HAT-QOL: HIV/AIDS-Targeted Quality of Life, HOPES, ISSQoL, MOS-HIV, PozQoL, PROQOL-HIV, WHOQOL-HIV, WHOQOL-HIV BREF, ACTG-QOL, ART Intrusiveness Scale, HIV-QL31, HIV-SQUAD, HCSUS, HIV/AIDS Targeted Quality of Life Instrument, GHSA, Hopkins Symptoms Checklist-25 (HSCL-25), HIV-SI / SDM, MAS, SPNSQ, AIDS-HAQ: AIDS Health Assessment Questionnaire, HIV-PARSE, Perkins Inventory, Wheatly Stress Profile-derived Inventory, HIV-related Life stressor burden scale, Berger Stigma Scale, Internalized AIDS-Related Stigma Scale (IA-RSS), Demi-HIV Stigma Scale, HIV Stigma Measure
Self-management BMQ-ART, CEAT-VIH, ART adherence, UCSF Adherence Questionnaire, QLP, HIV Impact Scale, LWH: Living with HIV Scale
Psychosocial factors Access to Resources Scale, PSS-HIV, Social Support Inventory for People Who are HIV Positive or Have AIDS, HIV-Negative Social Provisions Scale, HIV-Positive Social Provisions Scale, Instrument Support Evaluation List, Social Support for PLWH, Screenphiv
Spirituality ELQ, EMS, I-W SR Index Short form
Satisfaction Beck’s Questionnaire, Patient satisfaction survey for HIV ambulatory care, Quote-HIV

The development of some of these HIV-specific PROMs, such as the MOS-HIV, the FAHI, or the WHOQOL-HIV BREF, was based on generic instruments, with the participation of both HIV-positive individuals and health professionals. Each of these PROMs has demonstrated excellent psychometric properties in the HIV population [32]. Among the most widely used HIV-specific questionnaires are the MOS-HIV, the FAHI, and the HIV-SI/SDM [17, 32].

The MOS-HIV questionnaire is one of the PROMs with the best psychometric properties and is also the most widely accepted among healthcare professionals [26, 33]. It consists of 35 items covering 10 domains (including physical function, pain, social role/function, emotional well-being, etc.), is self-administered, and takes approximately 10 min to complete [34]. Among its limitations are the limited contribution of PLHIV during its development [26]. The MQOL-HIV, whose usefulness derives from the important consideration of the specific problems of PLHIV, is not as useful as the PROQOL-HIV or the WHOQOL-HIV BREF [26]. By adapting generic questionnaires, other instruments specific to PLHIV have been obtained, such as the FAHI (“Functional Assessment of HIV Infection”), developed from a scale used in patients with cancer (FACT-G) and containing 44 items related to the domains of physical, emotional, family, social well-being, and relationship with the physician [34]. It is self-administered, with an implementation time of less than 15 min, and assesses HRQoL based on patients’ experiences in the previous 7 days [26, 35]. Another specific HRQoL questionnaire in PLHIV is the PozQoL, which has demonstrated excellent conceptual validity, with good reliability, consistency, and temporal stability, and of which there is a Spanish version [35]. The PozQoL and FAHI questionnaires show good correlation and a high degree of concordance in the concepts evaluated [35]. In clinical research, the reference questionnaire on HIV-related symptoms is the HIV-SI/SDM [32].

The CEAT-HIV is a useful, valid, and reliable instrument for measuring treatment adherence. It is used in many countries, including Spain, and in addition to the English and Spanish versions it is also available in other languages such as Portuguese and Romanian [36].

One limitation of questionnaires developed specifically for PLHIV is their length (e.g., HIV-HOPES, FAHI, PROQOL-HIV), which prolongs completion time and makes them difficult to use as a method of evaluation [35]. The HIV-HOPES (“HIV Overview of Problem/Evaluation System”) questionnaire, for instance, consists of 168 items and 35 subscales. An additional limitation of this PROM is the negative formulation of the questions, which makes it difficult to interpret the answers and can lead to errors [34].

The most commonly used generic questionnaires in HIV research are the EQ-5D, the SF-36, and the WHOQOL-BREF. An important advantage of the use of these generic instruments is the possibility of comparing the HRQoL of PLHIV with that of patients with other chronic diseases or even in PLHIV with other concomitant diseases. On the other hand, one of their limitations is their lower sensitivity to changes in the evolution of the disease or its treatment [26].

Delphi

In the first Delphi-round, 120 people participated, of whom 80 were health professionals and 40 PLHIV. The response rate was high, with percentages of 79% among health professionals (n = 63) and 100% of PLHIV (n = 40). Four percent of respondents were less than 30 years old, 36% between 30 and 49, and 60% between 50 and 70 years old. The distribution by age group (30–49 and 50–70) was somewhat different, with a higher proportion of health professionals in the 50–70 age group. Sixty-three percent were male, 35% female, and 2% other. The PLHIV belonged to different NGOs (ACCAVIH, ADHARA, AGAVIH, etc.), 33% had been living with the virus for 2–10 years and 67% for more than 10 years. Regarding sexual orientation, 36% were heterosexual, 56% homosexual, and 8% were included in other categories. Very importantly, 17.5% of the PLHIV who participated in the first round were at risk of social exclusion.

Guiding Principles

There are four guiding principles of these recommendations: (1) the patient should be the center of attention; (2) when identifying needs, it is essential to take into account the patient’s perception as assessed by the PROs; (3) questionnaires are useful, whether used individually or collectively; and (4) questionnaires provide valuable information for decision-making.

Table 2 shows the results of the first round of the Delphi, both globally and by type of respondent. There was unanimity between PLHIVs and health professionals that the focus is on the patient, but this was not the case for the other three principles, where high standard deviations and much lower scores were obtained for health professionals than for PLHIVs.

Table 2.

Delphi agreement with principles proposed by healthcare providers people living with HIV

graphic file with name 40121_2022_678_Tab2_HTML.jpg

m mean, SD standard deviation, Min minimum, Max maximum, HCP healthcare providers, PLHIV people living with HIV, PROs patient-reported outcomes

These results indicate that PLHIV support the use of PROMs, even if not validated, and believe that they allow for individualized treatment. PLHIV point out the importance of concise questions, with clear response options, and easy-to-understand vocabulary. Some comments included in the free text by some health professionals may help understand this polarization: “the questionnaires do not allow decision-making”, “their only usefulness is to obtain information”, “there is an excessive number of PROMs”, “their completion is improvised and not very reflexive”, “they can be manipulated (by an institution or organization) to obtain the desired response”, “they require time that physicians do not have”, and “the perception of the PLHIV is not always real”. This reflects either a misconception of PROMs or a bad experience.

Recommendations

Ten recommendations were issued (Table 3) and the results of the Delphi are shown in Table 4.

Table 3.

Recommendations for the use of patient-reported outcomes in people living with HIV

1 It is recommended to use questionnaires with proven validity
2 Multidimensional questionnaires can identify problems, so they should be used at the time of diagnosis and when there are major changes in the patient’s treatment or situation
3 Once a specific problem has been identified, it is best to use a specific questionnaire for follow-up
4 It is recommended to identify factors that interfere in the healthcare professional–patient relationship that can secondarily affect treatment adherence
5 The individualization of healthcare with the help of questionnaires should take into account the epidemiological, social, and health profile of patients
6 Multidimensional PROs can be used to decide the best consultation model (face-to-face consultation, telematics) for each patient
7 It is recommended that patients complete the questionnaires in a quiet environment that ensures confidentiality
8 Once completed, it is advisable to review the questionnaires with the patient during the consultation
9 The importance of completing the questionnaires must be conveyed to the patient; therefore, training in completion and the use of reminders should be part of patient education
10 Digital technology can be of great help in the application of the questionnaires, without ever forgetting the limitations existing in specific patients (digital divide)

PROs patient-reported outcomes

Table 4.

Results of the agreement with the recommendations obtained in the Delphi round

graphic file with name 40121_2022_678_Tab4_HTML.jpg

m mean, SD standard deviation, Min minimum, Max maximum, HCP healthcare providers, PLHIV people living with HIV, PROMs patient-reported outcome measures

The responses obtained in all the recommendations, except the first and last, again showed a very significant polarization between PLHIV and health professionals. These results led the scientific committee to conclude that it would not be possible to achieve a rapprochement of positions in a second Delphi round, and so it was decided to suspend the second round and show the results obtained in the first round, with all its controversy.

About the implementation of questionnaires, a significant percentage of healthcare professionals indicated that it should be the nursing staff, educators, patient associations, or other health center personnel with specific training who should help in the completion of the PROMs. In addition, they insisted on the lack of time in the consultation rooms to incorporate the evaluation of the questionnaires, which, if used at all, should be self-administered, offering patients training on their completion by other professionals, such as auxiliary personnel. Some of the professionals’ responses were a total rejection of the PROMs.

On the other hand, the PLHIV supported the recommendations and pointed out that the PROMs should be brief, clear, and concise, and that they should include some open-ended questions because sometimes they do not feel identified with some of the answers. In addition, they again commented that PROMs allow for more individualized treatment by the physician and that training for completion is important because of the complexity of some questions.

Discussion

The purpose of using PROMs is to assess the perceptions and opinions of PLHIV on different aspects related to their health. These tools are useful for the initial evaluation and follow-up of patients [37], clinical decision-making [13, 37, 38], treatment planning [3941], and evaluation of the efficacy [17, 26, 37, 4244]. In addition, PROMs enhance correct self-management and coping with the disease [45, 46], help evaluate the quality of care provided, and improve the patient–physician relationship [13, 36, 38, 47]. Therefore, it is necessary to have valid, reliable PROMs that are easy to complete, score, and interpret, so that the resulting information is representative and complete [26, 44].

Our approach to reach recommendations is not without limitations. First, it was done in a single country, Spain. Secondly, the samples of experts and patient representatives might be considered small or biased. Doing the study in a single country facilitates discussion and comprehension, as everything happens in a language and a culture with which all participants are comfortable. It also facilitates implementation, as the problems that arise will be very typically the problems that would have occurred in a larger sample in the same country. As to the number, for Delphi studies, representativeness is a more relevant issue than quantity, and the demographic statistics of both samples reflect very well the underlying populations, and it is without doubt that the results reflect very clearly the expected controversy and diversity of opinions. Also, the sample of professionals is very representative and covers a large proportion of the population of interest.

We tried to establish a set of guiding principles and recommendations on the use of PROMs in PLHIV supported by the literature. The guiding principle is that the focus of care should be on the patient, a principle that dates back to 1987 and is used internationally to advocate for quality healthcare [42] and as such should be sensitive to patients and their families [12]. A fundamental characteristic of patient-centered care is transparency, based on information obtained through measurement instruments. In this context, PROMs complement the traditional method of obtaining information, based on the medical history and physical examination [13]. In addition, in chronic diseases, such as HIV, it is very important to expand the information [42] and questionnaires with free-text responses make it possible to collect a type of information that is difficult to obtain by other means [48].

The second principle (inquiring about the views and listening to the perceptions of PLHIV about their state of health and the evolution of their disease) refers to “humanizing care”, a fact to be taken into account in the context of today’s increasing dependence on technology [49].

Concerning the individual and collective usefulness of the questionnaires (third principle), it should be emphasized that their overall usefulness depends, among other reasons, on the participation of the PLHIV in their selection. In this way, and thanks to their cascade effect, multiple individual benefits are achieved derived from a greater perception of the symptoms and better physician–patient interaction [45, 50]. At the collective level, the use of PROMs makes it possible to audit the quality, appropriateness, and performance of the care services provided, and to improve the allocation and efficiency of the services provided and resources [13, 47].

Finally, about the fourth principle, several studies point out that greater knowledge of the factors that are important for PLHIV facilitates therapeutic planning in the consultation room [3941] and allows physicians to have a more holistic perspective [51, 52]. There is evidence that the regular use of PROMs not only improves medical decision-making [38], as this principle indicates, but also symptom recognition, doctor–patient communication [53], and the identification of related problems [11], which facilitates coping with the disease [46].

Despite the wealth of information on the benefits of PROMs, it has not been possible to reach a consensus on the recommendations established, as a result of significant discrepancies between health professionals and PLHIV, and within the groups, which prevented a second round of the Delphi from being carried out. This discrepancy may be reflecting a deeply rooted aversion to subjectivity and other beliefs that act as a barrier. Although a high percentage of physicians believe that data collection through PROMs does not produce objective benefits in the therapeutic relationship or the involvement of patients in their treatment, most of these beliefs are based on studies not performed in PLHIV and published more than 30 years ago [54]. Since then, there has been a spectacular growth in the development and validation of PROMs [55].

The reality is that the penetration of PROMs in clinical practice in HIV is limited because of, among other reasons, physicians' perception of their competencies, the lack of information on their importance, feasibility, and support or resources to incorporate them into the daily dynamics of care [24, 56]. These data underline the importance of professional training and the need to introduce PROMs in the context of other clinical priorities [24, 37]. In fact, in our survey, healthcare professionals manifested their concern about new requirements derived from the implementation of PROMs.

The use of PROMS is incorporated into the clinical practice of other medical fields, such as rheumatic diseases or inflammatory bowel disease. One way to promote their use in PLHIV is to reduce the burden associated with their compliance and to achieve a balance between the frequency of administration and their complexity [13, 37].

As in other chronic diseases, treatment adherence is a fundamental aspect of living with HIV. Adherence is a complex phenomenon involving multiple factors [57]. PROMs provide insight into motivations for adherence and facilitate a relationship with the physician [58] in which the patient freely expresses his or her preferences and becomes involved in the treatment, resulting in improved adherence [38, 59, 60]. There is no single PROM for assessing adherence to ART in PLHIV, and there are many influences from various factors, such as quality of life and depression, which show significant variability between different cultures, sexes, ages and socioeconomic strata [6163].

Another aspect addressed in the recommendations is the use of electronic questionnaires that allow PLHIV to record and track changes in health status in their own home, encouraging engagement and self-care between visits [45]. Despite the advantages of electronic systems for completing questionnaires through cell phone applications, web pages, e-mails, etc., their use in clinical practice is not yet well established [64, 65]. One of the reasons may be the lack of electronic devices among some PLHIV, especially the elderly who are at risk of social exclusion, although it seems unlikely that this is a real barrier given the rapid growth of these devices in all age and socioeconomic strata, as recently demonstrated by a study carried out in the UK [66]. Electronic collection of PROMs is becoming increasingly popular as it reduces completion time and the likelihood of errors, allowing the results to be used on an individual basis [42] or in series [67, 68]. However, the possibility of completing PROMs on electronic devices does not imply the abandonment of the paper format, as there are still PLHIV with a clear preference for the latter.

The PROMETEO project has revealed a significant perception gap regarding the use of PROMs in the consultation room between PLHIV and their physicians and polarized perceptions within both collectives. Among the reasons given by health professionals for not implementing PROMs, the lack of time in the consultation room and the lack of other professionals, such as nurses, to be in charge of their completion, stand out. In addition, it has been observed that health professionals overlook information on the usefulness and benefits of PROMs specific to PLHIV in multiple health domains, such as quality of life, adherence, social factors, or satisfaction with care. On the other hand, PLHIV value them positively and demand the use of simple tools written in a language appropriate to their situation. The barriers mentioned are solvable and a rapprochement between the attitudes of professionals and PLHIV should be encouraged to achieve a consensus that can improve the quality of life of these people. The benefits of the implementation of PROMs will also result in a better allocation and efficiency of healthcare resources, which is essential in today’s healthcare system.

Conclusion

Despite the lack of consensus, the scientific committee of PROMETEO suggests a differentiated use of PROMs between newly diagnosed and follow-up PLHIV. In newly diagnosed cases, the use of general PROMs (multidimensional) is recommended, preferably in paper format to facilitate a more personalized conversation, while in PLWHA attending follow-up visits, PROMs for assessment of specific areas are preferable and electronic format is favored to study the evolution. PROMs can play a fundamental role in the adoption of an individual-centered care approach.

Supplementary Information

Below is the link to the electronic supplementary material.

Acknowledgements

We thank all the participants of the study.

Funding

This study was funded by Gilead Sciences. The funding included the services of an agency specialized in PROs, systematic reviews, and consensus methodology and the journal’s Rapid Service Fee.

Medical Writing, Editorial and Other Assistance

The technical team at Inmusc (Madrid, Spain), including experts in systematic reviews, validation studies, and consensus techniques, performed the systematic review, supervised the consensus and surveys, and provided a draft of the manuscript. This was funded by Gilead Sciences.

Author Contributions

AA and SR coordinated the project. JIB, JCBQ, PB, MJFRdA, JP, IC, AA, and MH participated in the meetings and gave insight to the design of recommendations. AA was responsible for the recruitment of the health professionals, and MJFRdA of the recruitment of patients’ representatives. All authors contributed to the manuscript and reviewed the last version.

Disclosures

Antonio Antela, José Ignacio Bernardino, Juan Carlos López-Bernaldo de Quirós, Pablo Bachiller, María José Fuster-RuizdeApodaca, Jordi Puig, Silvia Rodríguez, Isabel Castrejón, Beatriz Alvarez and Marta Hermenegildo have nothing to disclose.

Compliance with Ethics Guidelines

After consultation with the Ethics Committee of Comunidad de Madrid, a review and approval was deemed unnecessary given the nature of data collected, namely the absence of health and personal data. Delphi surveys are, by nature, anonymous and voluntary, and they include opinions on statements, not health data. No identification data (personal data) is collected. By agreeing to continue after the study explanation, as well as by submitting the opinions at the end, the participants agreed to participate in the survey. This study was conducted in full compliance with the principles established in the Declaration of Helsinki concerning medical research on human subjects, and in accordance with the applicable regulations on Good Clinical Practice.

Data Availability

All surveys and data are available upon reasonable request.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Zuniga JM. UNAIDS 90–90-90-opportunity in every difficulty. J Int Assoc Provid AIDS Care. 2018;17:2325958218809075. doi: 10.1177/2325958218809075. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Lazarus JV, Safreed-Harmon K, Barton SE, et al. Beyond viral suppression of HIV—the new quality of life frontier. BMC Med. 2016;14(1):94. doi: 10.1186/s12916-016-0640-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Kall M, Marcellin F, Harding R, et al. Patient-reported outcomes to enhance person-centred HIV care. Lancet HIV. 2020;7(1):e59–e68. doi: 10.1016/S2352-3018(19)30345-5. [DOI] [PubMed] [Google Scholar]
  • 4.Guidance for industry patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79. doi: 10.1186/1477-7525-4-79. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Bristowe K, Murtagh FEM, Clift P, et al. The development and cognitive testing of the positive outcomes HIV PROM: a brief novel patient-reported outcome measure for adults living with HIV. Health Qual Life Outcomes. 2020;18(1):214. doi: 10.1186/s12955-020-01462-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Deshpande PR, Rajan S, Sudeepthi BL, et al. Patient-reported outcomes: a new era in clinical research. Perspect Clin Res. 2011;2(4):137–144. doi: 10.4103/2229-3485.86879. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Duracinsky M, Herrmann S, Berzins B, et al. The development of PROQOL-HIV: an international instrument to assess the health-related quality of life of persons living with HIV/AIDS. J Acquir Immune Defic Syndr. 2012;59(5):498–505. doi: 10.1097/QAI.0b013e318245cafe. [DOI] [PubMed] [Google Scholar]
  • 8.Porter I, Gonçalves-Bradley D, Ricci-Cabello I, et al. Framework and guidance for implementing patient-reported outcomes in clinical practice: evidence, challenges and opportunities. J Comp Eff Res. 2016;5(5):507–519. doi: 10.2217/cer-2015-0014. [DOI] [PubMed] [Google Scholar]
  • 9.Simpelaere I, White A, Bekkering GE, et al. Patient-reported and proxy-reported outcome measures for the assessment of health-related quality of life among patients receiving enteral feeding: a systematic review protocol. JBI Database Syst Rev Implement Rep. 2016;14(7):45–75. doi: 10.11124/JBISRIR-2016-002982. [DOI] [PubMed] [Google Scholar]
  • 10.Crane HM, Crane PK, Tufano JT, et al. HIV provider documentation and actions following patient reports of at-risk behaviors and conditions when identified by a web-based point-of-care assessment. AIDS Behav. 2017;21(11):3111–3121. doi: 10.1007/s10461-017-1718-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Detmar SB, Muller MJ, Schornagel JH, et al. Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial. JAMA. 2002;288(23):3027–3034. doi: 10.1001/jama.288.23.3027. [DOI] [PubMed] [Google Scholar]
  • 12.Norberg A, Nelson J, Holly C, et al. Experiences of HIV-infected adults and healthcare providers with healthcare delivery practices that influence engagement in US primary healthcare settings: a qualitative systematic review. JBI Database Syst Rev Implement Rep. 2019;17(6):1154–1228. doi: 10.11124/JBISRIR-2017-003756. [DOI] [PubMed] [Google Scholar]
  • 13.Field J, Holmes MM, Newell D. PROMs data: can it be used to make decisions for individual patients? A narrative review. Patient Relat Outcome Meas. 2019;10:233–241. doi: 10.2147/PROM.S156291. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Fuster-RuizdeApodaca MJ, Laguía A, Safreed-Harmon K, et al. Assessing quality of life in people with HIV in Spain: psychometric testing of the Spanish version of WHOQOL-HIV-BREF. Health Qual Life Outcomes. 2019;17(1):144. doi: 10.1186/s12955-019-1208-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kleijnen S, Leonardo Alves T, Meijboom K, et al. The impact of quality-of-life data in relative effectiveness assessments of new anti-cancer drugs in European countries. Qual Life Res. 2017;26(9):2479–2488. doi: 10.1007/s11136-017-1574-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Gnanasakthy A, Mordin M, Evans E, et al. A review of patient-reported outcome labeling in the United States (2011–2015) Value Health. 2017;20(3):420–429. doi: 10.1016/j.jval.2016.10.006. [DOI] [PubMed] [Google Scholar]
  • 17.Akinosoglou K, Antonopoulou S, Katsarolis I, et al. Patient-reported outcomes in HIV clinical trials evaluating antiretroviral treatment: a systematic review. AIDS Care. 2020 doi: 10.1080/09540121.2020.1852160:1-9. [DOI] [PubMed] [Google Scholar]
  • 18.Gallant J, Lazzarin A, Mills A, et al. Bictegravir, emtricitabine, and tenofovir alafenamide versus dolutegravir, abacavir, and lamivudine for initial treatment of HIV-1 infection (GS-US-380-1489): a double-blind, multicentre, phase 3, randomised controlled non-inferiority trial. Lancet. 2017;390(10107):2063–2072. doi: 10.1016/S0140-6736(17)32299-7. [DOI] [PubMed] [Google Scholar]
  • 19.Hoffmann C, Welz T, Sabranski M, et al. Higher rates of neuropsychiatric adverse events leading to dolutegravir discontinuation in women and older patients. HIV Med. 2017;18(1):56–63. doi: 10.1111/hiv.12468. [DOI] [PubMed] [Google Scholar]
  • 20.Molina JM, Ward D, Brar I, et al. Switching to fixed-dose bictegravir, emtricitabine, and tenofovir alafenamide from dolutegravir plus abacavir and lamivudine in virologically suppressed adults with HIV-1: 48 week results of a randomised, double-blind, multicentre, active-controlled, phase 3, non-inferiority trial. Lancet HIV. 2018;5(7):e357–e365. doi: 10.1016/S2352-3018(18)30092-4. [DOI] [PubMed] [Google Scholar]
  • 21.Raffi F, Esser S, Nunnari G, et al. Switching regimens in virologically suppressed HIV-1-infected patients: evidence base and rationale for integrase strand transfer inhibitor (INSTI)-containing regimens. HIV Med. 2016;17(Suppl 5):3–16. doi: 10.1111/hiv.12440. [DOI] [PubMed] [Google Scholar]
  • 22.Sax PE, Pozniak A, Montes ML, et al. Coformulated bictegravir, emtricitabine, and tenofovir alafenamide versus dolutegravir with emtricitabine and tenofovir alafenamide, for initial treatment of HIV-1 infection (GS-US-380-1490): a randomised, double-blind, multicentre, phase 3, non-inferiority trial. Lancet. 2017;390(10107):2073–2082. doi: 10.1016/S0140-6736(17)32340-1. [DOI] [PubMed] [Google Scholar]
  • 23.Basch E, Barbera L, Kerrigan CL, et al. Implementation of patient-reported outcomes in routine medical care. Am Soc Clin Oncol Educ Book. 2018;38:122–134. doi: 10.1200/EDBK_200383. [DOI] [PubMed] [Google Scholar]
  • 24.Nic Giolla Easpaig B, Tran Y, Bierbaum M, et al. What are the attitudes of health professionals regarding patient reported outcome measures (PROMs) in oncology practice? A mixed-method synthesis of the qualitative evidence. BMC Health Serv Res. 2020;20(1):102. [DOI] [PMC free article] [PubMed]
  • 25.Philpot LM, Barnes SA, Brown RM, et al. Barriers and benefits to the use of patient-reported outcome measures in routine clinical care: a qualitative study. Am J Med Qual. 2018;33(4):359–364. doi: 10.1177/1062860617745986. [DOI] [PubMed] [Google Scholar]
  • 26.Cooper V, Clatworthy J, Harding R, et al. Measuring quality of life among people living with HIV: a systematic review of reviews. Health Qual Life Outcomes. 2017;15(1):220. doi: 10.1186/s12955-017-0778-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Badia X, Guerra L, García M, et al. Evaluation of the quality of life in patients with HIV and AIDS infection. Med Clin (Barc) 1999;112(19):739–744. [PubMed] [Google Scholar]
  • 28.Fitch K, Bernstein S, Aguilar M, et al. The RAND/UCLA Appropriateness Method User's Manual. 2001. http://www.rand.org/content/dam/rand/pubs/monograph_reports/2011/MR1269.pdf.
  • 29.Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008. doi: 10.1136/bmj.j4008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Mokkink LB, de Vet HCW, Prinsen CAC, et al. COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1171–1179. doi: 10.1007/s11136-017-1765-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–549. doi: 10.1007/s11136-010-9606-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Simpson KN, Hanson KA, Harding G, et al. Patient reported outcome instruments used in clinical trials of HIV-infected adults on NNRTI-based therapy: a 10-year review. Health Qual Life Outcomes. 2013;11:164. doi: 10.1186/1477-7525-11-164. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Wu AW, Hanson KA, Harding G, et al. Responsiveness of the MOS-HIV and EQ-5D in HIV-infected adults receiving antiretroviral therapies. Health Qual Life Outcomes. 2013;11:42. doi: 10.1186/1477-7525-11-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Gakhar H, Kamali A, Holodniy M. Health-related quality of life assessment after antiretroviral therapy: a review of the literature. Drugs. 2013;73(7):651–672. doi: 10.1007/s40265-013-0040-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Brown G, Mikołajczak G, Lyons A, et al. Development and validation of PozQoL: a scale to assess quality of life of PLHIV. BMC Public Health. 2018;18(1):527. doi: 10.1186/s12889-018-5433-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Remor E. Systematic review of the psychometric properties of the questionnaire to evaluate the adherence to HIV therapy (CEAT-VIH) Patient. 2013;6(2):61–73. doi: 10.1007/s40271-013-0009-0. [DOI] [PubMed] [Google Scholar]
  • 37.Greenhalgh J, Gooding K, Gibbons E, et al. How do patient reported outcome measures (PROMs) support clinician-patient communication and patient care? A realist synthesis. J Patient Rep Outcomes. 2018;2:42. doi: 10.1186/s41687-018-0061-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Boyce MB, Browne JP, Greenhalgh J. The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research. BMJ Qual Saf. 2014;23(6):508–518. doi: 10.1136/bmjqs-2013-002524. [DOI] [PubMed] [Google Scholar]
  • 39.Chang CH. Patient-reported outcomes measurement and management with innovative methodologies and technologies. Qual Life Res. 2007;16(Suppl 1):157–166. doi: 10.1007/s11136-007-9196-2. [DOI] [PubMed] [Google Scholar]
  • 40.Greenfield S, Nelson EC. Recent developments and future issues in the use of health status assessment measures in clinical settings. Med Care. 1992;30(5 Suppl):Ms23–41. doi: 10.1097/00005650-199205001-00003. [DOI] [PubMed] [Google Scholar]
  • 41.Higginson IJ, Carr AJ. Measuring quality of life: using quality of life measures in the clinical setting. BMJ. 2001;322(7297):1297–1300. doi: 10.1136/bmj.322.7297.1297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Berwick D, Black N, Cullen D, et al. Recommendations to OECD ministers of health from the high level reflection group on the future of health statistics. OECD 2017. https://www.oecd.org/els/health-systems/.
  • 43.Land L, Nixon S, Ross JD. Patient-derived outcome measures for HIV services in the developed world: a systematic review. Int J STD AIDS. 2011;22(8):430–435. doi: 10.1258/ijsa.2011.010450. [DOI] [PubMed] [Google Scholar]
  • 44.Malmqvist S, Leboeuf-Yde C, Ahola T, et al. The Nordic back pain subpopulation program: predicting outcome among chiropractic patients in Finland. Chiropr Osteopat. 2008;16:13. doi: 10.1186/1746-1340-16-13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Santana MJ, Feeny D. Framework to assess the effects of using patient-reported outcome measures in chronic care management. Qual Life Res. 2014;23(5):1505–1513. doi: 10.1007/s11136-013-0596-1. [DOI] [PubMed] [Google Scholar]
  • 46.Greenhalgh J. The applications of PROs in clinical practice: what are they, do they work, and why? Qual Life Res. 2009;18(1):115–123. doi: 10.1007/s11136-008-9430-6. [DOI] [PubMed] [Google Scholar]
  • 47.DeSalvo KB, Jones TM, Peabody J, et al. Health care expenditure prediction with a single item, self-rated health measure. Med Care. 2009;47(4):440–447. doi: 10.1097/MLR.0b013e318190b716. [DOI] [PubMed] [Google Scholar]
  • 48.Ashworth M, Robinson S, Evans C, et al. What does an idiographic measure (PSYCHLOPS) tell us about the spectrum of psychological issues and scores on a nomothetic measure (CORE-OM)? Prim Care Community Psychiatr. 2007;12(1):7–11. [Google Scholar]
  • 49.Bottega F, Fontana R. Pain as the fifth vital sign: Use of the evaluation scale by nurses of a general hospital. Text Context Nursi. 2010;19:283–290. [Google Scholar]
  • 50.Callaly T, Hallebone EL. Introducing the routine use of outcomes measurement to mental health services. Aust Health Rev. 2001;24(1):43–50. doi: 10.1071/ah010043. [DOI] [PubMed] [Google Scholar]
  • 51.Boyce MB, Browne JP. Does providing feedback on patient-reported outcomes to healthcare professionals result in better outcomes for patients? A systematic review. Qual Life Res. 2013;22(9):2265–2278. doi: 10.1007/s11136-013-0390-0. [DOI] [PubMed] [Google Scholar]
  • 52.Fung CH, Hays RD. Prospects and challenges in using patient-reported outcomes in clinical practice. Qual Life Res. 2008;17(10):1297–1302. doi: 10.1007/s11136-008-9379-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Etkind SN, Daveson BA, Kwok W, et al. Capture, transfer, and feedback of patient-centered outcomes data in palliative care populations: does it make a difference? A systematic review. J Pain Symptom Manage. 2015;49(3):611–624. doi: 10.1016/j.jpainsymman.2014.07.010. [DOI] [PubMed] [Google Scholar]
  • 54.Kazis LE, Callahan LF, Meenan RF, et al. Health status reports in the care of patients with rheumatoid arthritis. J Clin Epidemiol. 1990;43(11):1243–1253. doi: 10.1016/0895-4356(90)90025-k. [DOI] [PubMed] [Google Scholar]
  • 55.Holmes MM, Lewith G, Newell D, et al. The impact of patient-reported outcome measures in clinical practice for pain: a systematic review. Qual Life Res. 2017;26(2):245–257. doi: 10.1007/s11136-016-1449-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Greenhalgh J, Dalkin S, Gooding K, et al. Health Services and Delivery Research. Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care. Southampton (UK): NIHR Journals Library; 2017. [PubMed]
  • 57.Remor E, Fuster MJ, Ballester-Arnal R, et al. Development of a new instrument for the assessment of psychological predictors of well-being and quality of life in people with HIV or AIDS. AIDS Behav. 2012;16(8):2414–2423. doi: 10.1007/s10461-012-0230-1. [DOI] [PubMed] [Google Scholar]
  • 58.Shubber Z, Mills EJ, Nachega JB, et al. Patient-reported barriers to adherence to antiretroviral therapy: a systematic review and meta-analysis. PLoS Med. 2016;13(11):e1002183. doi: 10.1371/journal.pmed.1002183. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Bofill LM, Lopez M, Dorigo A, et al. Patient-provider perceptions on engagement in HIV care in Argentina. AIDS Care. 2014;26(5):602–607. doi: 10.1080/09540121.2013.844767. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Thirumurthy H, Siripong N, Vreeman RC, et al. Differences between self-reported and electronically monitored adherence among patients receiving antiretroviral therapy in a resource-limited setting. AIDS. 2012;26(18):2399–2403. doi: 10.1097/QAD.0b013e328359aa68. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Toupin I, Engler K, Lessard D, et al. Developing a patient-reported outcome measure for HIV care on perceived barriers to antiretroviral adherence: assessing the needs of HIV clinicians through qualitative analysis. Qual Life Res. 2018;27(2):379–388. doi: 10.1007/s11136-017-1711-5. [DOI] [PubMed] [Google Scholar]
  • 62.Kim BY, Lee J. Smart devices for older adults managing chronic disease: a scoping review. JMIR Mhealth Uhealth. 2017;5(5):e69. doi: 10.2196/mhealth.7141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Lawrence V, Murray J, Banerjee S, et al. Concepts and causation of depression: a cross-cultural study of the beliefs of older adults. Gerontologist. 2006;46(1):23–32. doi: 10.1093/geront/46.1.23. [DOI] [PubMed] [Google Scholar]
  • 64.Fortner B. Editorial: the challenge of electronically captured patient-reported outcomes. J Oncol Pract. 2007;3(3):120–121. doi: 10.1200/JOP.0731503. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Jensen RE, Snyder CF, Abernethy AP, et al. Review of electronic patient-reported outcomes systems used in cancer clinical care. J Oncol Pract. 2014;10(4):e215–222. doi: 10.1200/JOP.2013.001067. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Kim GS, Choi JP, Yi JM, et al. Development of a question prompt list for patients living with HIV and assessment of their information needs. J Assoc Nurses AIDS Care. 2019;30(5):575–583. doi: 10.1097/JNC.0000000000000080. [DOI] [PubMed] [Google Scholar]
  • 67.Jones JB, Snyder CF, Wu AW. Issues in the design of Internet-based systems for collecting patient-reported outcomes. Qual Life Res. 2007;16(8):1407–1417. doi: 10.1007/s11136-007-9235-z. [DOI] [PubMed] [Google Scholar]
  • 68.Rose M, Bezjak A. Logistics of collecting patient-reported outcomes (PROs) in clinical practice: an overview and practical examples. Qual Life Res. 2009;18(1):125–136. doi: 10.1007/s11136-008-9436-0. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

All surveys and data are available upon reasonable request.


Articles from Infectious Diseases and Therapy are provided here courtesy of Springer

RESOURCES