Abstract
Mixed methods research forms the backbone of translational research methodologies. Qualitative research and subjective data lead to hypothesis generation and ideas that are then proven via quantitative methodologies and gathering objective data. In this vein, clinical trials that generate subjective data may have limitations, when they are not followed through with quantitative data, in terms of their ability to be considered gold standard evidence and inform guidelines and clinical management. However, since many research methods utilise qualitative tools, an initial factor is that such tools can create a burden on patients and researchers. In addition, the quantity of data and its storage contributes to noise and quality issues for its primary and post hoc use. This paper discusses the issue of the burden of subjective data collected and fatigue in the context of congestive heart failure (CHF) research. The CHF population has a high baseline morbidity, so no doubt the focus should be on the content; however, the lengths of the instruments are a product of their vigorous validation processes. Nonetheless, as an important source of hypothesis generation, if a choice of follow-up qualitative assessment is required for a clinical trial, shorter versions of the questionnaire should be used, without compromising the data collection requirements; otherwise, we need to invest in this area and find suitable solutions
Keywords: cardiovascular disease, chronic disease management, health data, congestive heart failure, guidelines, processes of care, multidisciplinary care
1. Introduction
With the abundance of multicentre randomised controlled trials referenced in congestive heart failure (CHF) guidelines, it is of interest to note that global reductions in mortality and morbidity outcomes have been patchy [1,2]. Considering the selective nature of the trials with stringent inclusion criteria, a way to attain a more consistent outcome is to study a more diverse treated population and, consequently, reflect on those who exhibit poorer outcomes. The methodology for such research is well established in phase IV or translational research methodologies. This type of research is often in the form of audits, which are informative and hypothesis-generating, should novel observations be recorded. This type of research also has foundations in the mixed methods research methodology (MMR). In the first section, we discuss the role of data from community hubs, which are at the forefront of ambulatory clinical translational models [3]. Randomised controlled trials (RCT) are rigid, and the trial elements are limited to intervention and objective (quantitative) outcomes. Their findings are highly translatable to the question and the population studied [4,5,6]. Hence, these trials form the gold-standard evidence that is the backbone of evidence-based medicine (EBM) and guideline-derived medical therapies (GDMT) in clinical guidelines. Furthermore, in this paper (part 2), the two relevant critical elements are disease complexity (e.g., multimorbidity) and layered health services (e.g., multidisciplinary teams), which are required to manage chronic cardiovascular diseases (CVD). The real-world scenarios are not frequently reflected in clinical trials, and, therefore, the means to translate proven evidence and complex care at the population level are needed.
There is, however, robust post-translational evidence for CHF. Generic cardiac and, more specifically, CHF rehabilitation are established in evidence, clinically translated by utilising multidisciplinary care to support improved outcomes [7,8,9], including in the elderly [10]. Care, with similar foundations as cardiac rehabilitation, is routinely advocated in clinical guidelines as a translational tool to enhance multidisciplinary care, following gold-standard evidence in trials and clinical translation [11]. It is important to understand that these management tools are not evidence of therapies as such but measures to collate guideline evidence and deliver it in an organised fashion. There are also failures in multidisciplinary approaches, where the collection of evidence has stalled, and guideline recommendations have even been demoted. Self-management programs in CVD and CHF have been downgraded from performance to quality measures [12]. Importantly, this concept requires a mixed methods approach to generate new ideas. Thus, RCTs are the engine for proof, while MMR is the machinery used for innovation, discovery and creating a combined approach to deliver the findings. In particular, subjective questionnaires are an important component of this methodology. In this second section, the authors aim to explore the gaps and avenues needing to be innovated in this area.
2. Mixed Method Research in Translating CVD and CHF Guidelines
MMR is a research methodology that cumulates, investigates, and interprets data within a study or program of research. MMR utilises both quantitative and qualitative methods for investigating diseases such as CHF and CVD [13]. There is a well-documented pathway for research ranging from observations at the bedside or in the laboratory to smaller-scale trials and, subsequently, large RCTs [14]. In instances where the trials provide strong evidence, the same system can be utilised in an uncontrolled clinical setting in order to generalise the findings and audit the outcomes at the population level.
However, should any variation in outcomes arise, the gold-standard proofing method is to conduct another RCT. Having said that, it is not always feasible, as translating new findings can be even more costly and lead to delays in achieving cost-effectiveness.
2.1. Foundations of Combining Research Methodologies
It makes sense to incorporate patient experiences when measuring the endpoints and outcomes of treatments being translated. Subjectively, researchers have argued that multimethods and MMR will allow for a more complete understanding of a research problem, with robust quantitative data being integrated with multiple viewpoints [15,16]. How this differs from traditional studies that include smaller studies or quasi-experimental trials is a topic for discussion. Nonetheless, since the 1990s, the distinction of MMR as a methodology has taken shape, as has its use across broad social, educational, behavioural and health sciences fields [17,18]. As is common in evidence-based research, this paradigm took its own course, with debate, skepticism, consensus, and ongoing criticism. As further discussion is not relevant for this paper, the readers are guided accordingly [17,19,20]. Of relevance, however, is the complexity of concepts involved in the conduct of MMR. From the author’s perspective, rigidity is becoming a significant barrier that limits the translation of RCT findings to global populations, and our understanding of MMR is at the heart of this problem. One philosophical assumption argued that MMR is a third research methodology [15]. Thus, for the purpose of the arguments in this paper, we accept the definition of MMR as a combination of different methods (convergent findings, comprehensive coverage, connected contributions) to extract the strengths and reduce the weaknesses of a multimodality approach in a single study [21,22]. Figure 1 highlights the terminology, theories, and a brief historical perspective in the first box; the layers of research in second box; and in the last box, some considerations for formulating MMR studies.
Figure 1.
Analysis of research data and determining what information is needed in Phase IV translational work: (a) defining the problem, terminology and methodology; (b) designing mixed methods research; (c) the research onion. Abbreviations: data use = converged data collection; (+) simultaneous; (→) sequential; quan = quantitative; qual = qualitative uppercase = dominant method used, e.g., QUAL; lowercase = lower-priority method, e.g., qual; vs = versus [19] Glossary: http://www.fiu.edu/~bridges/glossary.htm, accessed on 12 November 2023.
2.2. What Are the Issues with Translating Gold Standard Evidence?
The factors at play here can be simplified into three categories: trial, health services and patient factors. Trial related factors are the most established; however, research remains static largely due to the difficulty of conducting tightly controlled studies to remove confounders and match a study group that is closely matched to the treatment arm. This approach has maintained high confidence in the findings and, with that, answering the hypothesis in question. All aspects of the design, methodology, publication, and interpretation of results will in fact reflect this. The strong internal control comes at the expense of reduced generalisability at the population level [23]. Trials, however, need to account for deficiencies in translational outcomes, as post-trial studies explore the health system and patient factors. As existing rigours of drug and treatment discoveries will remain, it will probably be a long while before the right balance can be struck in trial design to meaningfully address these factors. Thus, a greater effort must be made to ensure that post-trial audits are minimised. Secondly, disease management [24] and clinical service organisation studies [25,26] have proven useful in CHF. Hence, these publications have provided proof that organised care is vital for improving CHF outcomes. Thirdly, for patient factors (Figure 2), there are numerous publications of variations in results from CHF trials and the post-trial populations. We will focus the discussion on patient factors below.
Figure 2.
Factors involved in translating trial findings.
2.3. Incidental Post-Trial Population-Level Patient Factors in Congestive Heart Failure
The vasodilators used in heart failure studies provided evidence to support the prognostic benefit of nitrate in combination with hydralazine for heart failure with reduced ejection fraction in the 1980s, and they are currently continued as recommended therapies in some circumstances. In the initial study, V-HEFT and V-HEFT1 evidence of a greater benefit in the African American cohort was accumulated. This was then confirmed in the A-HEFT study [27]. Additional studies with ethnographic differentials were noted in the blood pressure trial using diuretics and several renin aldosterone modulating agents, lisinopril and losartan [28,29,30]. Moreover, epidemiological studies in African American cohorts have shown racial differences in the higher incidence of some traditional risk factors, particularly hypertension and modifiable cardiometabolic risk factors [31,32]. Population-based genome-sequencing studies identified differences in alleles’ frequencies with racial-incident HF [33,34]. This extends to black women, for whom higher peripartum cardiomyopathy that is also less responsive to the prescription of angiotensin-converting enzyme inhibitors (ACEi) and β-blockers, was noted [35]. The relative deficiency of natriuretic factors and higher prevalence of salt sensitivity, sodium retention and physiologically low renin and aldosterone levels have treatment implications [36,37,38,39].
From the above physiology, a combination of modifiable and non-modifiable factors must be balanced with acquired and modifiable barriers of socioeconomics in health equity [39]. It is at this juncture that we can start to appreciate the complexity of CHF and achieve equitable outcomes at the population level. Trial controls and trial support either exclude or buffer these differences. However, appreciating that the level of evidence for the proposed question is very high, the opportunity now is to prescribe widely, replicate guidelines and create a mechanism to identify lags in outcomes. If we are to take the example of socio-economic and demography, disparities may not be specific for any one ethnicity. There are multiple levels of influence on racial and socioeconomic disparities in CHF incidence and outcomes [40]. Additionally, models of care to improve these disparities must target layers of sociology, physiology and jurisdictional constraints [41]. Hence, the importance of using subjective and objective data in a single study, as, in these situations, it is now increasingly indispensable [42,43].
3. Data Accumulation and Patient Fatigue
An important consideration often not given due consideration, and it is also the focus of this communication, is patient fatigue and dropout. In a phase III randomised controlled trial, patients are the participants. In a post-trial phase IV study, patients can now be considered consumers. Objective data can be obtained from registries or clinical databases and stored as standardised, mostly quantitative performance measures [11]. Within these performance measures are quality measures that include disease management. For the latter, some performance measures will require a subjective (qualitative) research methodology to investigate and then meaningfully inform translational gaps.
3.1. Subjective Questionnaires in Medical Research
There is an entire school of knowledge that is required to conduct qualitative research and surveys to obtain patient and customer sentiment, satisfaction, and well-being information [39,40], the purpose of which are as follows:
Economical and efficient means to collect information, attitudes and opinions from many people or monitor a program’s progress.
A high level of skill and knowledge is required to design and conduct quality surveys. These skills include knowledge on how to design surveys to answer a focused research question, understanding how to design survey items and response options that will yield interpretable and usable results, understanding survey structures such that the individual items contribute to answers on the research question coherently, and understanding the shortfalls of surveys within the context of the population that they study, including sampling errors, coverage errors, non-response errors, measurement errors, processing errors and transparency indexes [41].
To understand the ethical and general considerations for the whole spectrum of the population, risk burdens and benefits, vulnerable groups and individuals.
To be able to draw a conclusion on these subjective points, meaning that surveys must be representative of the population.
The survey response among 904 physicians of varying specialties, surveyed by an established internet-based survey company that offered reminders and gift certificate prizes, was only 35%. Among non-respondents, the main reason for non-participation was lack of time and survey burden [42]. Additionally, 154 of 165 journals (93%) contained minimal guidance on survey reporting, despite 82% of journals publishing qualitative results [44]. There are challenges faced in health services’ qualitative research. The low response rate is a potential contributor to bias, poses challenges in terms of drawing meaningful translational answers and results in a lack of structured guidance to determine the reliability of the data.
3.2. Patient Reported Measures and Subjective Questionnaires in Heart Failure
From a report on ‘Crossing the Quality Chasm’, the six domains of health care include safe, timely, efficient, equitable care and patient-centred care, with the latter domain reflecting entirely on topics that the patient is best suited to address [45]. Indeed, patient-reported experiences (PREs) and patient-reported outcomes (PROs) reflect the consumer view on health services and their outcomes. Upon being studied, they are organised into experience and outcome measures, or PROMs and PREMs. There are five dimensions of PROM health-related quality of life (HRQL): functional status, symptoms, symptom burden, health behaviours and patient experience [46].
The definitions of PRO, “as any report of the status of a patient’s health condition that comes directly from the patient, without interpretation of the patient’s response by a clinician or anyone else”, and PROM, as validated questionnaires and tools to extract PROs, are critical the argument on study fatigue [47,48]. Studies can be conducted through several means, including self-completed questionnaires, face-to-face interviews and telephone surveys. Finally, in addition to the six STEEEP (care that is safe, timely, effective, efficient, equitable and patient-centred) factors, we aim for improvement based on core values and guiding principles that place the patient’s interest at the heart of health and social care. Thus patient-centredness requires due consideration of individuality, independence, privacy, partnership, choice, dignity, respect and rights and ethics (beneficence, nonmaleficence, autonomy, and justice). Addressing patient fatigue is, thus, vital for MMR.
3.3. Patient Fatigue
In CHF, there are several acknowledged PROM tools that complement clinical, biochemical and imaging biomarkers (Table 1). However, none of these have evolved and are integrated as part of clinical care, despite the compelling reasons for their benefits. Specifically, Kelkar et al. studied a total of 31 instruments: 9 met the inclusion criteria, and only 2 instruments—Minnesota Living with Heart Failure Questionnaire and the Kansas City Cardiomyopathy Questionnaire—met all the evaluation criteria for the psychometric and clinical criteria and symptom coverage [49]. Psotka et al. studied 19 PROMs used in CHF, conducting a review of the characteristics of these instruments’ ability that support potential approvals for the U.S. Food and Drug Administration’s (FDA) product label claim. The Kansas City Cardiomyopathy Questionnaire (KCCQ) and the Minnesota Living with Heart Failure Questionnaire (MLHFQ) had the most extensive evaluation and validation in CHF population. Nonetheless, none of these PROMs met all the relevant criteria listed in the FDA PRO guidance to support product-level claims [50].
The lengths of questionnaires contribute to the response burden and rate. Nonetheless, from the 32 identified and 20 included in the meta-analysis, only 3 studies utilised patients’ input in evaluating response burden. An association between length and response rate was then identified (p ≤ 0.0001). As it is not possible to differentiate the impact of content from the length of the questionnaires, not surprisingly, shorter tool lengths have also not been shown to improve this issue [51]. Edwards et al.’s study analyses 38 RCT trials where participants were tasked with completing questionnaires of variable lengths (the actual numbers of pages were unknown). Heterogeneity in regression coefficients in trial response was subsequently explained where meta-regression explained the variations in the length of the questionnaire used in individual trials. For example, in postcard (shortest) questionnaires, the odds of a response more than halved for each extra page (0.39; 95% CI 0.34 to 0.45); for trials of one page in length versus two or three pages, the odds of response for each page increase were 1.01 (95% CI 0.82 to 1.24); for one versus four or more pages, and for two or more pages versus longer questionnaires, the odds ratios per one-page increase were 0.90 (95% CI 0.83 to 0.98) and 0.98 (95% CI 0.96 to 0.99), respectively. Unsurprisingly, it appears that responses can be improved by using shorter questionnaires and with a moderate change in the lengths of short questionnaires, which can be more effective than moderate changes in the lengths of long questionnaires [52]; these findings are supported by similar studies [53,54,55].
3.4. Future Areas of Study to Improve Qualitative Research in Heart Failure
Thus far, we have argued the case for MMR to help in the translation of RCT findings, particularly those entrenched in clinical guidelines. In CHF, guidelines reflect a spectrum of care from pharmaceuticals, devices and interventions, as well as allied health comprehensive care. The objective (quantitative) data and its translation are clear. However, despite having robust tools for subjective (qualitative and PRO) data, many steps contribute to study fatigue and lower response rates, and the majority are also not powered sufficiently to inform administrative and regulatory bodies like the FDA in the United States. Strengthening the translational capabilities and using a simpler format should be factors for future discussion. We suggest some broad options:
Questionnaire length—In an 87-patient observational study, Iyngkaran et al. observed chronic disease self-management in CHF. In this study protocol, the authors noted three tiers of subjective data. Clinical interviews and examinations with doctors, NYHA class during each visit, the Flinders Program of Chronic Disease Self-Management, MLWHF-Q, SF-36, PSQ-9 and investigations including 6MWT, echocardiography and biochemistry were used. There was an overlap between objective contributors to disease severity and many of the scales used. The subjective scales ranged from four- to eight-point Likert scales [55,56]. Presently, we have no mechanism to negate the overlapping questions from each tool, factoring in the Likert scale scoring system. The authors suggest a simpler process based on care domains and a no greater than three-point scoring systems and two questions per domain. An example is highlighted in the SCRinHF tool in the study protocol [56].
Translational component—It is important that information gathered through a long trial process carries weight with health administrators and regulators. In this regard, we recommend organizing a focus group to devise the minimum standards required for information in post-trial phase IV studies [56,57,58,59]. Similar to checklists like PRISMA, this simple checklist will ensure that relevant findings will attract relevant health service bodies.
Taxonomy for MMR—Krumholtz et al. provided the impetus for creating a system for disease management. MMR is at the point where overlap in theory and clinical use is sometimes indistinguishable. The theory component for this is strong and grounded in the short history of this methodological process. It is time to create a distinction between research tools, which could use Likert-based broad scales and longer questionnaires, and translational tools, which are more focused on extracting relevant PROs. An important area is the diversity of presentations, even for the same condition, e.g., cognition, rhythm disturbance, ischemic aetiology, etc. [60,61,62,63,64,65,66,67]. The simplification of established tools will also require validation. Prior to this, there must be an agreement on the direction that will be taken in this process. This will probably become a subject of greater debate in time.
Table 1.
Qualitative tools measuring outcomes for HF and self-care programs.
| Tool | Type of Measure | Summary of Instrument/Tool | Dimensions |
|---|---|---|---|
| ACIC | Health Systems | The components of ACIC were derived after specific evidence-based interventions from the six components of the Chronic Care Model. Thus, similar to this model, the ACIC addresses the main elements for improving chronic illness care at the community, organisation, practice and patient levels. | Many measures were considered:
|
| PACIC | Patient Satisfaction | 20- or 26-item patient report instruments were used to rate chronic illness care over a 6-month period. They cover 5 dimensions of care. | Many measures were considered:
|
| PSQ-18 | Patient satisfaction | Short form of PSQ-III using a Likert scale questionnaire evaluating 18 items from 7 dimensions of patient satisfaction directed toward doctors. | Many measures were considered:
|
| CAHPS | Patient satisfaction | Survey for consumers and patients to report on and evaluate their experiences with health care across 12 dimensions. | Many measures were considered:
|
| SF-36v2 | Patient reported outcomes |
Patient-reported 5-point survey covering mental and physical health over eight scaled scores. Each question has equal weight, with final score from 0 to 100 scale. Lower scores are associated with greater disability. | Many measures were considered:
|
| EQ-5D | Patient reported outcomes |
The most used self-administered survey, being available in >70 languages, that can be completed within minutes. Scoring based on a 3-point descriptive questionnaire and 20 cm vertical visual analogue scale with best (top) or worst health (bottom). | Many measures were considered:
|
| QWB-SA | Patient reported outcomes |
Survey of an interview with 71 items scored from 0 (death) to 1.0 (full function) taking 10–15 min. It can be translated into QALY. It requires training. | Many measures were considered:
|
| HUI | Patient reported outcomes |
A family of generic health profiles and preference-based systems measuring health status, reporting health-related quality of life, and producing utility scores. It explores the following: (1) experience of patients undergoing therapy; (2) long-term outcomes of disease or therapy; (3) the efficacy, effectiveness, and efficiency of interventions; and (4) health status of general populations. Each HUI attribute (dimension) has 3–6 levels of discrimination and is very responsive to changes in health caused by treatment therapies or other influences. |
Three measures were considered:
|
| KCCQ | Disease specific QOL |
The Kansas City Cardiomyopathy Questionnaire (KCCQ) is a new, self-administered, 23-item questionnaire developed to provide a better description of HRQoL in patients with CHF. It quantifies, in a disease-specific fashion, physical limitation, symptoms (frequency, severity and recent change over time), QoL, social interference, and self-efficacy. | Many measures were considered:
|
| MLHFQ | Disease specific QOL |
A self-administered, 5–10 min, 21-item 5-point Likert variable used to measure the effects of symptoms, functional limitations, and psychological distress on an individual’s quality of life, the MLHF questionnaire asks each person to indicate using a 6-point, zero to five, Likert scale on how much each of 21 facets prevented them from living as they desired. The MLHFQ is designed to measure the effects of heart failure and its treatments on an individual’s quality of life. MLHFQ measures the effects of symptoms, functional limitations, and psychological distress on an individual’s quality of life. It consists of questions that assess the impacts of frequent physical symptoms, the effects of heart failure on physical/social functions, and side effects of treatments, hospital stays, and costs of care. | |
| NYHA | Disease specific QOL |
A standardised health care provider assessment of heart failure severity. Dyspnoea grading with varying states of rest and exercise. Range of 0–4. Higher scores are worse. | One component—Universal. |
| CFPI | Understanding self-care and goals | Partners in Health Scale tests self-efficacy for managing chronic disease using a 6-item scale, Energy/Fatigue Scale, Cue and Response Score, and Problems and Goals Score. Training required for use. | Three testing methods were used:
|
| EHFScBS | CHF self-care | The EHFScBS is a 12-item questionnaire that measures 3 aspects of health maintenance behaviours: compliance with their management regimen, asking for help, and adapting daily activities. Responses are on a 5-point Likert-type scale indicating how often each behaviour is performed, ranging from “I completely agree” to “I don’t agree at all”. Scores are summed. Lower scores indicate better self-care. The instrument has subsequently been revised into a 9-item instrument. | Translated into 14 languages:
|
| SCHFI | CHF self-care | The SCHFI consists of 15 items that measure 3 subscales: behaviours undertaken to maintain clinical stability (self-care maintenance), the decision-making process with regard to symptom changes (self-care management), and the confidence to manage symptoms and evaluate any actions implemented (self-care confidence). Self-care management can only be computed if patients have been symptomatic in the past month. Summary scores for the 3 subscales are used by transforming each subscale into a scale from 0 to 100. Adequate scores are more than 70 on any subscale. |
Officially translated into Spanish and Thai languages and requests to use it in 24 other countries:
|
2DE, BNP and 6MWT are simple reproducible qualitative tools that can be combined with routine biochemistry. Abbreviations: CAHPS—Consumer Assessment of Healthcare Providers and Systems; EQ-5D—EuroQOL five dimensions questionnaire; HUI—health utility index; KCCQ—Kansas City Cardiomyopathy Questionnaire; MLHFQ—Minnesota Living with Heart Failure questionnaire; PACIC—Patient Assessment of Chronic Illness Care; PSQ-18—The Patient Satisfaction Questionnaire Short Form; PRO—patient reported outcomes; QOL—quality of life; QWB-SA—quality of well-being self-administered version. Details of table compiled from reference [59].
4. Conclusions
Although research can be complex, the arguments in this paper are in favour of simplicity. In a sense, to accumulate new knowledge in an area warrants multiple dimension framework and protocols. To provide the solution to the lay public, it must be contextual. In this paper, we have not fully explored those details as our focus was to argue that the issues of patient burden and fatigue are real. Nonetheless, there are foundations for how PROs are designed and used. It will often be the case that the early steps create a complex tool. In the latter steps, we require a case-by-case scenario to address these needs. In time, we believe that guidelines could evolve to help to steer this area. Presently, we are not aware of a consensus statement or approach to meet this goal. Some broad guidelines conclude, given the inherently problematic nature of comparing questionnaires of various lengths, that it is preferable to base decisions regarding the use of instruments on the content rather than the length per se. If a choice of follow-up questionnaire exists for a clinical trial, the shorter one should be used. If a new follow-up questionnaire is to be designed, it should be made as short as possible, without compromising the data collection requirements of the trial. This field is still evolving, and additional exploration and brainstorming will be necessary to progress positively.
Author Contributions
Conceptualization, P.I.; methodology, P.I. and F.H.; validation, F.H.; formal analysis, P.I. and F.H.; data curation, P.I.; writing—original draft preparation, P.I. and Z.B.; writing—review and editing, W.U. and F.H.; visualization, W.U.; supervision, F.H.; project administration, Z.B. and W.U. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
Not applicable as this is a secondary data analysis where no human interaction or primary data collection was performed.
Informed Consent Statement
Not applicable, see above.
Data Availability Statement
Data used in this perspective were publically available and most information provided here are from references listed in this paper.
Conflicts of Interest
The authors declare no conflicts of interest.
Funding Statement
All authors have won government and non-government funding support. None of these relationships pose a conflict of interest for this paper. This research received no external funding.
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Heidenreich P.A., Bozkurt B., Aguilar D., Allen L.A., Byun J.J., Colvin M.M., Deswal A., Drazner M.H., Dunlay S.M., Evers L.R., et al. 2022 AHA/ACC/HFSA Guideline for the Management of Heart Failure: A Report of the American College of Cardiology/American Heart Association Joint Committee on Clinical Practice Guidelines. J. Am. Coll. Cardiol. 2022;79:e263–e421. doi: 10.1016/j.jacc.2021.12.012. Correction in J. Am. Coll. Cardiol. 2023, 81, 1551. [DOI] [PubMed] [Google Scholar]
- 2.McDonagh T.A., Metra M., Adamo M., Gardner R.S., Baumbach A., Böhm M., Burri H., Butler J., Čelutkienė J., Chioncel O., et al. 2021 ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure: Developed by the Task Force for the diagnosis and treatment of acute and chronic heart failure of the European Society of Cardiology (ESC) With the special contribution of the Heart Failure Association (HFA) of the ESC. Eur. Heart J. 2021;42:3599–3726. doi: 10.1093/eurheartj/ehab670. [DOI] [PubMed] [Google Scholar]
- 3.Iyngkaran P., Usmani W., Hanna F., de Courten M. Challenges of Health Data Use in Multidisciplinary Chronic Disease Care: Perspective from Heart Failure Care. J. Cardiovasc. Dev. Dis. 2023;10:486. doi: 10.3390/jcdd10120486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ezekowitz J., Mentz R.J., Westerhout C.M., Sweitzer N.K., Givertz M.M., Piña I.L., O’Connor C.M., Greene S.J., McMullan C., Roessig L., et al. Participation in a Heart Failure Clinical Trial. Perspectives and Opportunities From the VICTORIA Trial and VICTORIA Simultaneous Registry. Circ. Heart Fail. 2021;14:e008242. doi: 10.1161/CIRCHEARTFAILURE.120.008242. [DOI] [PubMed] [Google Scholar]
- 5.Martin S.S., Ou F.S., Newby L.K., Sutton V., Adams P., Felker G.M., Wang T.Y. Patient- and trial-specific barriers to participation in cardiovascular randomized clinical trials. J. Am. Coll. Cardiol. 2013;61:762–769. doi: 10.1016/j.jacc.2012.10.046. [DOI] [PubMed] [Google Scholar]
- 6.Krishnamoorthy A., Tonks R.W., Adams P.A., Felker G.M., Patel C.B., Mentz R.J. Enrollment in Heart Failure Clinical Trials: Insights into Which Entry Criteria Exclude Patients. J. Card. Fail. 2015;21:608–609. doi: 10.1016/j.cardfail.2015.04.008. [DOI] [PubMed] [Google Scholar]
- 7.Kamiya K., Sato Y., Takahashi T., Tsuchihashi-Makaya M., Kotooka N., Ikegame T., Takura T., Yamamoto T., Nagayama M., Goto Y., et al. Multidisciplinary Cardiac Rehabilitation and Long-Term Prognosis in Patients with Heart Failure. Circ. Heart Fail. 2020;13:e006798. doi: 10.1161/CIRCHEARTFAILURE.119.006798. [DOI] [PubMed] [Google Scholar]
- 8.Bozkurt B., Fonarow G.C., Goldberg L.R., Guglin M., Josephson R.A., Forman D.E., Lin G., Lindenfeld J., O’Connor C., Panjrath G., et al. ACC’s Heart Failure and Transplant Section and Leadership Council. Cardiac Rehabilitation for Patients with Heart Failure: JACC Expert Panel. J. Am. Coll. Cardiol. 2021;77:1454–1469. doi: 10.1016/j.jacc.2021.01.030. [DOI] [PubMed] [Google Scholar]
- 9.Taylor R.S., Dalal H.M., McDonagh S.T.J. The role of cardiac rehabilitation in improving cardiovascular outcomes. Nat. Rev. Cardiol. 2022;19:180–194. doi: 10.1038/s41569-021-00611-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Chen Z., Li M., Yin C., Fang Y., Zhu Y., Feng J. Effects of cardiac rehabilitation on elderly patients with Chronic heart failure: A meta-analysis and systematic review. PLoS ONE. 2022;17:e0273251. doi: 10.1371/journal.pone.0273251. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Fonarow G.C., Stough W.G., Abraham W.T., Albert N.M., Gheorghiade M., Greenberg B.H., O’Connor C.M., Sun J.L., Yancy C.W., Young J.B., et al. Characteristics, Treatments, and Outcomes of Patients with Preserved Systolic Function Hospitalized for Heart Failure. J. Am. Coll. Cardiol. 2007;50:768–777. doi: 10.1016/j.jacc.2007.04.064. [DOI] [PubMed] [Google Scholar]
- 12.Heidenreich P.A., Fonarow G.C., Breathett K., Jurgens C.Y., Pisani B.A., Pozehl B.J., Spertus J.A., Taylor K.G., Thibodeau J.T., Yancy C.W., et al. 2020 ACC/AHA Clinical Performance and Quality Measures for Adults with Heart Failure. A Report of the American College of Cardiology/American Heart Association Task Force on Performance Measures. Circ. Cardiovasc. Qual. Outcomes. 2020;13:e000099. doi: 10.1161/HCQ.0000000000000099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Leech N., Onwuegbuzie A. A typology of mixed methods research designs. Qual. Quant. 2008;43:265–275. doi: 10.1007/s11135-007-9105-3. [DOI] [Google Scholar]
- 14.Iyngkaran P., Liew D., McDonald P., Thomas M.C., Reid C., Chew D., Hare D.L. Phase 4 Studies in Heart Failure—What is Done and What is Needed? Curr. Cardiol. Rev. 2016;12:216–230. doi: 10.2174/1573403X12666160606121458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Creswell J.W., Plano Clark V.L. Designing and Conducting Mixed Methods Research. 3rd ed. Sage; Thousand Oaks, CA, USA: 2018. [Google Scholar]
- 16.Fetters M.D. The Mixed Methods Research Workbook: Activities for Designing, Implementing, and Publishing Projects. Sage; Thousand Oaks, CA, USA: 2020. [Google Scholar]
- 17.Fàbregues S., Escalante-Barrios E.L., Molina-Azorin J.F., Hong Q.N., Verd J.M. Taking a critical stance towards mixed methods research: A cross-disciplinary qualitative secondary analysis of researchers’ views. PLoS ONE. 2021;16:e0252014. doi: 10.1371/journal.pone.0252014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Plano Clark V.L., Ivankova N.V. Mixed Methods Research: A Guide to the Field. Sage; Thousand Oaks, CA, USA: 2016. [Google Scholar]
- 19.Tashakkori A., Teddlie C., editors. The SAGE Handbook of Mixed Methods in Social and Behavioral Research. 2nd ed. Sage; Thousand Oaks, CA, USA: 2010. Epilogue: Current developments and emerging trends in integrated research methodology; pp. 803–826. [Google Scholar]
- 20.Creswell J.W. Controversies in mixed methods research. In: Denzin N.K., Lincoln Y., editors. The SAGE Handbook of Qualitative Research. 4th ed. Sage; Thousand Oaks, CA, USA: 2011. pp. 269–283. [Google Scholar]
- 21.Andrew S., Halcomb E.J. Mixed methods research is an effective method of enquiry for community health research. Adv. Contemp. Nurse. 2006;23:145–153. doi: 10.5172/conu.2006.23.2.145. [DOI] [PubMed] [Google Scholar]
- 22.Greene J.C., Caracelli V.J., Graham W.F. Toward a conceptual framework for mixed methods evaluation design. Educ. Eval. Policy Anal. 1989;11:255–274. doi: 10.3102/01623737011003255. [DOI] [Google Scholar]
- 23.Heneghan C., Goldacre B., Mahtani K.R. Why clinical trial outcomes fail to translate into benefits for patients. Trials. 2017;18:122. doi: 10.1186/s13063-017-1870-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Krumholz H.M., Currie P.M., Riegel B., Phillips C.O., Peterson E.D., Smith R., Yancy C.W., Faxon D.P. American Heart Association Disease Management Taxonomy Writing Group. A taxonomy for disease management: A scientific statement from the American Heart Association Disease Management Taxonomy Writing Group. Circulation. 2006;114:1432–1445. doi: 10.1161/CIRCULATIONAHA.106.177322. [DOI] [PubMed] [Google Scholar]
- 25.Fonarow G.C., Albert N.M., Curtis A.B., Gheorghiade M., Heywood J.T., Liu Y., Mehra M.R., O’Connor C.M., Reynolds D., Walsh M.N., et al. Associations between outpatient heart failure process-of-care measures and mortality. Circulation. 2011;123:1601–1610. doi: 10.1161/CIRCULATIONAHA.110.989632. [DOI] [PubMed] [Google Scholar]
- 26.Schjødt I., Johnsen S.P., Strömberg A., DeVore A.D., Valentin J.B., Løgstrup B.B. Evidence-Based Process Performance Measures and Clinical Outcomes in Patients with Incident Heart Failure with Reduced Ejection Fraction: A Danish Nationwide Cohort Study. Circ. Cardiovasc. Qual. Outcomes. 2022;15:e007973. doi: 10.1161/CIRCOUTCOMES.121.007973. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Al-Mohammad A. Hydralazine and nitrates in the treatment of heart failure with reduced ejection fraction. ESC Heart Fail. 2019;6:878–883. doi: 10.1002/ehf2.12459. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Iyngkaran P., Thomas M.C., Johnson R., French J., Ilton M., McDonald P., Hare D.L., Fatkin D. Contextualizing Genetics for Regional Heart Failure Care. Curr. Cardiol. Rev. 2016;12:231–242. doi: 10.2174/1573403X12666160606123103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Gu A., Yue Y., Desai Raj P., Argulian E. Racial and ethnic differences in antihypertensive medication use and blood pressure control among US adults with hypertension. Circ. Cardiovasc. Qual. Outcomes. 2017;10:e003166. doi: 10.1161/CIRCOUTCOMES.116.003166. [DOI] [PubMed] [Google Scholar]
- 30.Iyngkaran P., Majoni W., Cass A., Sanders P., Ronco C., Brady S., Kangaharan N., Ilton M., Hare D.L., Thomas M.C. Northern Territory perspectives on heart failure with comorbidities—Understanding trial validity and exploring collaborative opportunities to broaden the evidence base. Heart Lung Circ. 2015;24:536–543. doi: 10.1016/j.hlc.2014.12.007. [DOI] [PubMed] [Google Scholar]
- 31.Bibbins-Domingo K., Pletcher M.J., Lin F., Vittinghoff E., Gardin J.M., Arynchyn A., Lewis C.E., Williams O.D., Hulley S.B. Racial differences in incident heart failure among young adults. N. Engl. J. Med. 2009;360:1179–1190. doi: 10.1056/NEJMoa0807265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Morris A.A., Patel R.S., Binongo J.N., Poole J., Al Mheid I., Ahmed Y., Stoyanova N., Vaccarino V., Din-Dzietham R., Gibbons G.H., et al. Racial differences in arterial stiffness and microcirculatory function between Black and White Americans. J. Am. Heart Assoc. 2013;2:e002154. doi: 10.1161/JAHA.112.002154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Xu H., Dorn G.W., Shetty A., Parihar A., Dave T., Robinson S.W., Gottlieb S.S., Donahue M.P., Tomaselli G.F., Kraus W.E., et al. A genome-wide association study of idiopathic dilated cardiomyopathy in African Americans. J. Pers. Med. 2018;8:11. doi: 10.3390/jpm8010011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Myers V.D., Gerhard G.S., McNamara D.M., Tomar D., Madesh M., Kaniper S., Ramsey F.V., Fisher S.G., Ingersoll R.G., Kasch-Semenza L., et al. Association of variants in BAG3 with cardiomyopathy outcomes in African American Individuals. JAMA Cardiol. 2018;3:929–938. doi: 10.1001/jamacardio.2018.2541. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Irizarry O.C., Levine L.D., Lewey J., Boyer T., Riis V., Elovitz M.A., Arany Z. Comparison of clinical characteristics and outcomes of peripartum cardiomyopathy between African American and Non-African American Women. JAMA Cardiol. 2017;2:1256–1260. doi: 10.1001/jamacardio.2017.3574. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Gupta D.K., de Lemos J.A., Ayers C.R., Berry J.D., Wang T.J. Racial differences in natriuretic peptide levels: The dallas heart study. JACC Heart Fail. 2015;3:513–519. doi: 10.1016/j.jchf.2015.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Morris A.A., Nayak A., Ko Y.-A., D’Souza M., Felker G.M., Redfield M.M., Tang W.H.W., Testani J.M., Butler J. Racial differences in diuretic efficiency, plasma renin, and rehospitalization in subjects with acute heart failure. Circ. Heart Fail. 2020;13:e006827. doi: 10.1161/CIRCHEARTFAILURE.119.006827. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Richardson S.I., Freedman B.I., Ellison D.H., Rodriguez C.J. Salt sensitivity: A review with a focus on non-Hispanic blacks and Hispanics. J. Am. Soc. Hypertens. 2013;7:170–179. doi: 10.1016/j.jash.2013.01.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Nayak A., Hicks A.J., Morris A.A. Understanding the Complexity of Heart Failure Risk and Treatment in Black Patients. Circ. Heart Fail. 2020;13:e007264. doi: 10.1161/CIRCHEARTFAILURE.120.007264. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Fowler F.J. Improving Survey Questions: Design and Evaluation. Volume 38 Sage Publishing; Thousand Oaks, CA, USA: 1995. (Applied Social Research Methods Series). [Google Scholar]
- 41.VanGeest J.B., Johnson T.P., Welch V.L. Methodologies for improving response rates in surveys of physicians: A systematic review. Eval. Health Prof. 2007;30:303–321. doi: 10.1177/0163278707307899. [DOI] [PubMed] [Google Scholar]
- 42.Audibert C., Glass D., Johnson T.P. Method and transparency of online physician surveys: An overview. Surv. Methods Insights Field. 2020 doi: 10.13094/SMIF-2020-00001. [DOI] [Google Scholar]
- 43.Cunningham C.T., Quan H., Hemmelgarn B., Noseworthy T., A Beck C., Dixon E., Samuel S., A Ghali W., Sykes L.L., Jetté N. Exploring physician specialist response rates to web-based surveys. BMC Med. Res. Methodol. 2015;15:32. doi: 10.1186/s12874-015-0016-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Bennett C., Khangura S., Brehaut J.C., Graham I.D., Moher D., Potter B.K., Grimshaw J.M. Reporting Guidelines for Survey Research: An Analysis of Published Guidance and Reporting Practices. PLoS Med. 2011;8:e1001069. doi: 10.1371/journal.pmed.1001069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Wolfe A. Institute of Medicine Report: Crossing the Quality Chasm: A New Health Care System for the 21st Century. Policy Politics Nurs. Pract. 2001;2:233–235. doi: 10.1177/152715440100200312. [DOI] [Google Scholar]
- 46.Cella D., Hahn E.A., Jensen S.E., Butt Z., Nowinski C.J., Rothrock N., Lohr K.N. Patient-Reported Outcomes in Performance Measurement. RTI Press; Research Triangle Park, NC, USA: 2015. [PubMed] [Google Scholar]
- 47.US Food and Drug Administration Guidance for Industry: Patientreported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. [(accessed on 12 March 2023)];2009 December; Available online: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patientreported-outcome-measures-use-medical-product-developmentsupport-labeling-claims.
- 48.Agarwal A., Pain T., Levesque J.F., Girgis A., Hoffman A., Karnon J., King M.T., Shah K.K., Morton R.L., HSRAANZ PROMs Special Interest Group Patient-reported outcome measures (PROMs) to guide clinical care: Recommendations and challenges. Med. J. Aust. 2022;216:9–11. doi: 10.5694/mja2.51355. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Kelkar A.A., Spertus J., Pang P., Pierson R.F., Cody R.J., Pina I.L., Hernandez A., Butler J. Utility of Patient-Reported Outcome Instruments in Heart Failure. JACC Heart Fail. 2016;4:165–175. doi: 10.1016/j.jchf.2015.10.015. [DOI] [PubMed] [Google Scholar]
- 50.Psotka M.A., von Maltzahn R., Anatchkova M., Agodoa I., Chau D., Malik F.I., Patrick D.L., Spertus J.A., Wiklund I., Teerlink J.R. Patient-Reported Outcomes in Chronic Heart Failure: Applicability for Regulatory Approval. JACC Heart Fail. 2016;4:791–804. doi: 10.1016/j.jchf.2016.04.010. [DOI] [PubMed] [Google Scholar]
- 51.Rolstad S., Adler J., Rydén A. Response burden and questionnaire length: Is shorter better? A review and meta-analysis. Value Health. 2011;14:1101–1108. doi: 10.1016/j.jval.2011.06.003. [DOI] [PubMed] [Google Scholar]
- 52.Edwards P., Roberts I., Sandercock P., Frost C. Follow-up by mail in clinical trials: Does questionnaire length matter? Control. Clin. Trials. 2004;25:31–52. doi: 10.1016/j.cct.2003.08.013. [DOI] [PubMed] [Google Scholar]
- 53.Hatch R., Young D., Barber V., Harrison D.A., Watkinson P. The effect of postal questionnaire burden on response rate and answer patterns following admission to intensive care: A randomised controlled trial. BMC Med. Res. Methodol. 2017;17:49. doi: 10.1186/s12874-017-0319-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Edwards P., Roberts I., Clarke M., DiGuiseppi C., Pratap S., Wentz R., Kwan I., Cooper R. Methods to increase response rates to postal questionnaires. Cochrane Database Syst. Rev. 2007;2:MR000008. doi: 10.1002/14651858.MR000008.pub3. Update in Cochrane Database Syst. Rev. 2009, 3, MR000008. [DOI] [PubMed] [Google Scholar]
- 55.Nakash R.A., Hutton J.L., Jørstad-Stein E.C., Gates S., Lamb S.E. Maximising response to postal questionnaires--a systematic review of randomised trials in health research. BMC Med. Res. Methodol. 2006;6:5. doi: 10.1186/1471-2288-6-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Iyngkaran P., Hanna F., Andrew S., Horowitz J.D., Battersby M., De Courten M.P. Comparison of Short and Long Form Flinders Program of Chronic Disease SELF-MANagement on Participants starting SGLT-2 Inhibitors for Congestive Heart Failure (SELFMAN-HF): Protocol for a prospective, observational study. Front. Med. 2023;10:1059735. doi: 10.3389/fmed.2023.1059735. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Rubio R., Palacios B., Varela L., Fernández R., Correa S.C., Estupiñan M.F., Calvo E., José N., Muñoz M.R., Yun S., et al. Quality of life and disease experience in patients with heart failure with reduced ejection fraction in Spain: A mixed-methods study. BMJ Open. 2021;11:e053216. doi: 10.1136/bmjopen-2021-053216. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Patel K.K., Veenstra D.L., Patrick D.L. A review of selected patient-generated outcome measures and their application in clinical trials. Value Health. 2003;6:595–603. doi: 10.1046/j.1524-4733.2003.65236.x. [DOI] [PubMed] [Google Scholar]
- 59.Higgins J.P.T., Thomas J., Chandler J., Cumpston M., Li T., Page M.J., Welch V.A., editors. Cochrane Handbook for Systematic Reviews of Interventions. 2022. [(accessed on 2 November 2023)]. Version 6.3; Updated February 2022. Cochrane. Available online: www.training.cochrane.org/handbook.
- 60.Iyngkaran P., Toukhsati S.R., Harris M., Connors C., Kangaharan N., Ilton M., Nagel T., Moser D.K., Battersby M. Self Managing Heart Failure in Remote Australia—Translating Concepts into Clinical Practice. Curr. Cardiol. Rev. 2016;12:270–284. doi: 10.2174/1573403X12666160703183001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Goh F.Q., Kong W.K.F., Wong R.C.C., Chong Y.F., Chew N.W.S., Yeo T.-C., Sharma V.K., Poh K.K., Sia C.-H. Cognitive Impairment in Heart Failure—A Review. Biology. 2022;11:179. doi: 10.3390/biology11020179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Ventoulis I., Arfaras-Melainis A., Parissis J., Polyzogopoulou E. Cognitive Impairment in Acute Heart Failure: Narrative Review. J. Cardiovasc. Dev. Dis. 2021;8:184. doi: 10.3390/jcdd8120184. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.John J.E., Claggett B., Skali H., Solomon S.D., Cunningham J.W., Matsushita K., Konety S.H., Kitzman D.W., Mosley T.H., ClarkIII D., et al. Coronary Artery Disease and Heart Failure with Preserved Ejection Fraction: The ARIC Study. J. Am. Heart Assoc. 2022;11:e021660. doi: 10.1161/JAHA.121.021660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Hegyi B., Hernandez J.M., Ko C.Y., Hong J., Shen E.Y., Spencer E.R., Smoliarchuk D., Navedo M.F., Bers D.M., Bossuyt J. Diabetes and Excess Aldosterone Promote Heart Failure with Preserved Ejection Fraction. J. Am. Heart Assoc. 2022;11:e027164. doi: 10.1161/JAHA.122.027164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Omar A.M.S., Rahman M.A.A., Rifaie O., Bella J.N. Atrial Fibrillation in Heart Failure with Preserved Left Ventricular Systolic Function: Distinct Elevated Risk for Cardiovascular Outcomes in Women Compared to Men. J. Cardiovasc. Dev. Dis. 2022;9:417. doi: 10.3390/jcdd9120417. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Tamirisa K.P., Dye C., Bond R.M., Hollier L.M., Marinescu K., Vaseghi M., Russo A.M., Gulati M., Volgman A.S. Arrhythmias and Heart Failure in Pregnancy: A Dialogue on Multidisciplinary Collaboration. J. Cardiovasc. Dev. Dis. 2022;9:199. doi: 10.3390/jcdd9070199. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Horodinschi R.N., Diaconu C.C. Heart Failure and Atrial Fibrillation: Diastolic Function Differences Depending on Left Ventricle Ejection Fraction. Diagnostics. 2022;12:839. doi: 10.3390/diagnostics12040839. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data used in this perspective were publically available and most information provided here are from references listed in this paper.


