Abstract
Background
In the UK older adults in care homes have exhibited poorer oral health than age-equivalent persons in the community. In response the National Institute for Health and Care Excellence issued guidance (NG48) on the maintenance and improvement of oral health in this group. Currently, there is little evidence on the cost-effectiveness of such interventions. The aim of this study was to examine the feasibility of evaluating an intervention framed around NICE guidance.
Methods
The study was undertaken in 22 care homes across 2 sites with eligibility criteria used to ensure access to residents for whom the oral health care intervention was relevant and who could consent to participation. The intervention followed the guidance issued by NICE in respect of care staff knowledge; oral health assessment and development of care plans, and provision of daily mouth care to residents. Quantitative and qualitative data were collected from residents and care home managers and interviews undertaken with a range of stakeholders. Quantitative data from residents comprised EQ5D5L at baseline, 6 and 12 months, qualitiative data was taken from interviews. Descriptive statistics and a discussion of themes raised in surveys and interviews was undertaken. The trial was registered with the UK’s Clinical Study Registry (ISRCTN10276613) on 17/04/2020.
Results
Of 119 residents recruited, 115 provided usable EQ5D5L data at baseline. The data had good face validity. Managers from 7 of 22 homes provided responses to the care home survey. All responding care homes routinely recorded information on care provided to residents and 5 of the 7 recorded information on the funding source for that care. Care assistant time was a key consideration among managers in terms of resource use. Residents overall quality of life was a key consideration among managers in terms of outcomes. Among key stakeholders, there was a universal appreciation of the need to improve the evidence base on the value for money of interventions framed around NG48.
Conclusion
The study supports the case for the conduct of an economic evaluation in a definitive trial to address a manifest gap in the evidence base on oral hygiene interventions in this context.
Keywords: Oral health, Older people, Care homes, Feasibility study, Economics evaluation
Good oral health is important to eating and social interaction and is associated with better health-related quality of life ratings [1, 2]. Among older persons (those aged over 65) specifically, good oral health has been shown to improve oral health-related quality of life [3]general health [4] and diet [5, 6]. While significant improvements in the oral health of older persons have been recorded in the UK over time [7]variations are evident across groups of older persons with respect to age and dependency level. Those who are older and in particular people who live in care homes, for example, have been shown to exhibit poorer oral health compared to those living in the community [8]. This can in part be explained by their more complex needs and higher levels of care dependency [9] making self-care related to oral hygiene more difficult. Diets rich in sugars [10]polypharmacy resulting in dry mouth [11] and barriers to access dental care [12]may also contribute to poorer oral health. Appreciation of the importance of good oral health to overall well-being has increased as has evidence of inequalities in health for those in care homes [13]. Within this context, it is unsurprising that interest in how best to maintain and improve oral health among care home residents should increase.
It was within this context that the National Institute for Health and Care Excellence issued guideline NG48 [14] in 2016 that set out a series of recommendations for the improvement and maintenance of good oral health of care home residents. Subsequent reviews by the Care Quality Commission (CQC) [15] have highlighted improvements in awareness of the guidance by care home managers (from 61% of managers in 2019 to 91% in 2022), in adoption of policies to promote and protect residents’ oral health (from 25% of care home providers in 2019 to 53% in 2022) and in the use of oral health assessments upon admission (from 73% of care home providers in 2019 to 83% in 2022).The guidelines, however, are quite broad and not directly implementable, containing only a limited number of specific actions that could be utilised by care home staff. While the most recent CQC review noted more widespread practices regarding the review and update of resident care plans to reflect changing resident needs, it also noted a wide variation in the detail contained in such plans [15]. Perhaps this is unsurprising given the generality of guidelines and the wide variation in the organisational and structural characteristics of care homes across the country. As such, the evidence base in respect of interventions promoting oral health care in a care home environment remains sparse [16].
To advance understanding and pave the way for more definitive studies, a feasibility study entitled ‘Improving the Oral HealTh of Older People In Care homes (TOPIC)’ was undertaken to determine the potential of a definitive randomised controlled trial in this context [17]. The study examines the feasibility of a complex intervention framed around key aspects of the NG48. It consists of: (1) the administration by trained care home staff of the Oral Health Assessment Tool [18]; (2) a “support worker assisted” daily tooth-brushing regime with toothpaste containing 1,500ppm fluoride; and (3) a care home staff training package. The intervention was adapted using co-design principles and a suite of materials were produced based on the experience of those that provide care for older people in care homes [19]. The study is a pragmatic cluster randomised control feasibility trial conducted in 22 care homes across two locations– Northern Ireland and London. The results in terms of the feasibility and the process evaluation are presented separately [20, 21]. In parallel, a cost-consequence feasibility analysis explored the relevance and relative importance of different outcome measures in an assessment of value for money for an intervention of this type. Focus in this exercise was given to the feasibility of collecting what were considered to be key data and also on the strategies to efficiently collect such data for an evaluation. This paper reports the results of this exercise and discusses its implications for an economic evaluation to be run alongside a subsequent definitive trial.
Methods
Quantitative and qualitative data were collected from residents and staff (managers) from the care homes that participated in the TOPIC study, and a range of key stakeholders that included care commissioners, registration and inspections bodies, resident advocacy (the voluntary sector) and community dental practitioners with experience of delivering care in care homes.
Quantitative data were collected directly from residents through researcher-administered questionnaires in care homes. These data were collected in 22 care homes across two sites (11 each in London and Northern Ireland). care homes were randomised to an intervention arm (n = 11) and a control arm (n = 11). Randomisation was in pairs on a 1:1 intervention/control ratio, using a dynamic adaptive randomisation algorithm with stratification by geographic location (Northern Ireland/ London). Ethical approval for this was received from the London: City & East Research Ethics Committee (ref: 19/LO/1107). All participants provided written informed consent. Residents were eligible to participate if they had capacity to provide consent and met the following inclusion criteria: aged 65 years and over; dentate or partially dentate; and living full-time in the care home. Residents were not eligible if they: were receiving end-of-life or palliative care; had severe cognitive impairment (6-item Cognitive Impairment Test (6-CIT) score of 10 or higher); or did not have a working level of spoken English.
The intervention comprised 3 elements. First, care home staff received a training package (written and online training) to raise awareness and provide skills to implement oral health promotion activities (the package was also used for the induction of new staff). Second, an oral health assessment tool was used to assess resident needs at baseline and 12 month follow-up and develop a personal oral healthcare plan for each resident. The oral health assessment tool [18] comprised a brief and practical assessment of the resident’s oral health needs that is reviewed and updated over time based on guidance within NG48. Third, a support worker assisted twice daily in resident tooth-brushing with 1500ppm fluoride toothpaste. Care homes allocated to the control arm continued usual care over the same 12 month period. Further details are available elsewhere [20] and in the trial protocol [17].
Data on health-related quality of life was collected from residents using the EQ5D5L [21] (at baseline, six months and twelve months follow-up), and on oral health-related quality of life through the Oral Impacts on Daily Performances (OIDP) [22] at the same time points. Data from care home staff were collected using a short survey circulated by email to participating homes organized in the October of 2023. The survey solicited information across a range of topics intended to inform the feasibility study. Areas covered were whether there were records of dental treatments provided to residents; whether such data were readily available and whether they contained details of treatments provided and by whom; arrangements for provision of oral healthcare training for staff; whether the care home maintained records of residents with particular oral health needs and; what care home managers perceived to be key costs and outcomes from their perspective.
These data were supplemented with data collected in interviews with key stakeholers conducted in December of 2023, as noted above, that covered perceptions of the challenges for conducting a cost-consequence study of an oral health promotion intervention in a care home environment and the value of such a study. Each interview began with a brief discussion of the importance of oral health in a care home environment and impressions of the existing evidence base on the effectiveness of interventions in this area. An open conversation then followed in which respondents were asked to reflect on what they saw as the key challenges around the delivery and evaluation of an intervention in this area. When the issue was not raised by the respondent, interview prompts referred to the implications for staff, given other commitments; the implications of staff turnover; the availability of data and challenges around collecting data; the outcomes they considered important and; the usefulness of an intervention and its evaluation for improving oral health in this environment. Respondents were free to discuss any other issue they thought important. Interviews were conducted by phone/online and typically lasted 45 min to one hour. The study was undertaken in a manner consistent with CONSORT guidelines for pilot or feasibility studies.
Data analysis
EQ5D5L captures quality of life across 5 domains, with 5 levels of severity in each domain. For each timepoint quantitative data on EQ5D5L were tabulated as percentages across levels of each dimension of the framework. No attempt was made to apply preference weights to EQ5D5L scores as agreed preference weights are currently unavailable [21] and this is in any event beyond the scope of the feasibility study. Attrition– the change in sample size over time - and changes in responses were examined to assess the potential threat that attrition might pose to an economic evaluation in a subsequent definitive study. Data related to the OIDP are reported elsewhere [20]. Survey data collected in care homes were reported as percentages across response items before being synthesized narratively.
Five interviews were undertaken - due in part to the feasibility of interviewing experienced individuals across the UK in a relatively short time window (2 months). Contemporaneous notes were taken during the course of the interviews. These were used immediately after each interview to construct a thematic record of the conversation, recording the responses of interviewees to prompts (when these were used), to note issues they raised independently and the language they used to describe issues related for example, to time pressure facing staff in care homes. Findings were shared with interviewees who had the opportunity to amend the record.
Results
Resident survey of health-related quality of life
A total of 119 residents were recruited to the study, of which 115 provided usable outcomes data at baseline (four residents did not complete baseline after consent). Of those who provided usable EQ5D5L responses, 60.9% were female, the average age was 84 years and 30% (of those who provided responses) were exempt from dental charges. Details of the recruitment, retention and data completion rates for the study are provided elsewhere [20].
In Table 1 results from the EQ5D5L survey are presented by time point– baseline (t0), 6 months (t1) and 12 months (t2) follow-up - in terms of percentage by domain. Three points are worthy of note with respect to the results. First, attrition is evident over time with the number of completed responses falling from 115 to 78 between t0 and t2. The attrition rate differs between sites; in Northern Ireland 50% of responses were missing at t1 and a similar amount at t2. By contrast in London approximately only 20% were missing at t1 and 38% at t2. Attrition will affect all data collected, not just the EQ5D5L, though non-response may differ across individual items depending on how challenging respondents find completing a particular survey. Second, it is evident from the responses that health deteriorated over time. For example, with respect to those reporting issues with mobility the percentage who reported no problems in walking fell from 26.1 to 14.1% between t0 and t2. With respect to self-care the fall was even more evident, the percentage reporting no problems washing or dressing falling from 48.7 to 16.7% between t0 and t2. Similar patterns were evident across domains with a shift in the distribution toward greater problems in health. Third, the domain profiles indicated that residents were more likely to experience mobility issues, followed by self-care, issues with usual activities, pain/discomfort and anxiety/depression being less prevalent at moderate or above levels.
Table 1.
Results of EQ5D5L survey
Percentage by response category
Time | Domain | |||||
---|---|---|---|---|---|---|
Level | Mobility | Self Care | Usual activity | Pain/Discomfort | Anxiety/depression | |
Baseline | 1 | 26.09 | 48.70 | 73.04 | 72.17 | 69.57 |
2 | 18.26 | 16.52 | 9.57 | 12.17 | 14.78 | |
3 | 13.04 | 8.70 | 7.83 | 10.43 | 12.17 | |
4 | 21.74 | 9.57 | 5.22 | 5.22 | 3.48 | |
5 | 20.87 | 16.52 | 4.35 | 0 | 0 | |
N = 115 | ||||||
6 month | 1 | 19.48 | 24.68 | 38.96 | 51.95 | 49.35 |
2 | 9.09 | 10.39 | 18.18 | 16.88 | 18.18 | |
3 | 24.68 | 19.48 | 19.48 | 18.18 | 24.68 | |
4 | 20.78 | 23.38 | 19.48 | 11.69 | 7.79 | |
5 | 25.97 | 22.08 | 3.90 | 1.30 | 0 | |
N = 77 | ||||||
12 month | 1 | 14.10 | 16.67 | 26.92 | 50.00 | 46.15 |
2 | 20.51 | 20.51 | 28.21 | 16.67 | 32.05 | |
3 | 28.21 | 30.77 | 26.92 | 25.64 | 17.95 | |
4 | 17.95 | 14.10 | 10.26 | 6.41 | 2.56 | |
5 | 19.23 | 17.95 | 7.69 | 1.28 | 1.28 | |
N = 78 |
Note level refers to level of severity, where 1 is lowest– for example in mobility, I have no problems walking about– and 5 is highest, for example in mobility I am unable to walk about. Responses were drawn from intervention and control groups. No attempt was made to make comparison by group
In Table 2, socio-demographic characteristics of respondents are reported. At baseline 63 of the sample were drawn from control homes and 52 from intervention homes. As can be seen most residents identified as being from the British Isles, as being widowed, and the overall average age was 84. More granular detail is not provided to avoid potential disclosure. No attempt was made to compare responses across groups as the study was not powered to detect differences.
Table 2.
Socio-demographic characteristics of resident respondents to quality of life survey at baseline
Control (N) | Intervention (N) | All (N) | |
---|---|---|---|
Male | 21 | 24 | 45 |
Female | 42 | 28 | 70 |
N = 115 | |||
Eng/Wel/Scot/NI/Britain/ Ireland | 56 | 46 | 102 |
Other* | 7 | 5 | 12 |
N = 114 | |||
Never married | 13 | 10 | 23 |
Widowed | 37 | 25 | 62 |
Other** | 12 | 17 | 29 |
N = 114 | |||
Mean Age (standard error) | 85.60 (1.01) | 82.36(1.27) | 84.13 (0.81) |
N = 115 |
Survey of care home managers
With respect to the survey of care home staff, 7 care homes supplied data– no data was returned from care homes in Northern Ireland– and all homes were from the intervention group. All homes reported that they routinely record information about dental care provided to residents, and 4 were able to furnish examples of dental care in some detail. Five homes reported on what type of practice provided dental care; NHS and private providers were mentioned with equal frequency, with 2 homes reporting that dental care was provided by exclusively private providers, 2 exclusively by NHS and 1 by NHS, private and community dental services.
Two homes reported staff training in delivery of oral hygiene taking more than 20 min; 3 homes reported that it took 10–20 min and 2 reported that training took less than 10 min. Five homes reported that 25–50% of their residents had some of their own teeth; 1 home reported that it was more than 75% and 1 home less than 25%. All care homes reported that oral hygiene was provided to residents by care staff– though 1 qualified this by also saying “no one” suggesting that when under time pressure staff may have to prioritise tasks other than oral hygiene.
Four aspects of time, as a resource, were offered to managers as being potentially impacted by the intervention: time needed to train care assistants; time taken to supervise care assistants in delivery of an intervention; time taken by care assistants to deliver the intervention and; time saved for care assistants in not having to manage poor oral health. Managers were asked to rank order aspects of time as factors that would influence their decision to adopt an intervention. Looking at the average sum of ranks indicated that, from a management consideration, the impact on care assistant time for delivering the intervention and/or potentially time saved in managing the outcomes of poor oral health were ranked as equally important, followed by time needed to train staff.
Four aspects of outcomes were offered to managers as being potentially impacted by the intervention: residents’ quality of life related to everyday activities such as eating; residents’ quality of life related to pain; improvements in the resident’s oral health; and improvements in residents health generally. Managers were asked to rank order these as factors that would influence their decision to adopt the intervention. The average sum of ranks indicated that improvements in residents’ everyday quality of life were deemed most important followed by improvements in health generally. Five out of 7 homes ranked first the residents’ quality of life related to everyday activities such as eating. In terms of staff turnover, five homes estimated it to be between 0 and 10%, 1 at 11–20% and 1 at 21–30%.
Stakeholder interviews
With respect to stakeholder interview, two interviewees were from a registration/inspection background (A & B); one was from a community dental service background (C ); one was from a service commissioning background (D) and one was from a patient advocacy background (E). Four of those interviewed (A-D) had trained as dentists though not all currently practiced dentistry. A number of themes recurred across the interviews with key stakeholders. First was the importance of oral health to overall health and well-being and the importance of prevention in particular given challenges around access to dental care. While all respondents mentioned the importance of prevention, informant C elaborated, noting the challenges for more advanced treatment in this patient group. The occasional need for general anaesthesia because of compliance issues (related to cognitive impairment), was specifically mentioned as giving rise to additional risks and costs that could be avoided through appropriate prevention. At the opposite end of clinical need, informant E, argued that the importance of intervention for social interaction should not be underestimated, independent of its clinical effects. It was suggested that what was referred to as a “placebo” in terms of oral health may nonetheless have important quality of life effects, and this should not be discounted.
Second, the challenging circumstances that care home staff work under and the implications of these both for the delivery and evaluation of an intervention was referenced by all informants. There was a general perception that staff-resident ratios were low, resident needs complex and priorities other than delivering oral hygiene would be more pressing. A perception of high staff turnover was also uniformly referenced and seen as adding to the demands on staff. As argued by informant B, undertaking steps to avoid bed ulcers may be prioritised over tooth brushing by staff. This may be especially the case if, as referenced by informants A and C, staff may be reluctant to brush teeth either because of the intimacy involved or issues of consent with residents.
Third, the pressure on dentists in providing care to residents and for residents in accessing care from dentists was widely referenced. Four informants (A-D) referenced this issue and the implications for oral health in care homes arising from it. Informant A highlighted regional inequalities in access to publicly funded care provided by general dental practitioners, with dependence on the private sector as a result. While informants A and B expressed some concerns with regard to the range of treatments that the general dental practitioner service could deliver due to issues of transporting equipment (oxygen for example), the main issue appeared to be the opportunity cost of providing such care given current levels of remuneration. Informants C and D, noted that community dental service staff were also under considerable pressure, with competing demands from other sources - those with learning disabilities being mentioned explicitly. Interestingly the competing needs of those with learning disabilities was echoed by informants E and A. As with comments related to the complexity, cost and risk of treatment in this age group, these underscored the value of prevention in this population.
Fourth, the importance of developing a set of evidence based standards against which performance in care homes can be assessed was referenced. Perhaps unsurprisingly the two informants (A and B) from registration and inspection backgrounds both made reference to the importance of a standard grounded in evidence to inform their inspections. These stakeholders, provided useful insights into the conduct of inspections and the constraints within which inspections were undertaken, in particular with respect to time pressure on inspectors. They commented that while time was taken to speak with staff, residents and family members, there was no attempt to undertake physical examinations of residents (“they do not look in people’s mouths”). It seemed unlikely that any future inspection would include physical examination of residents. In consequence inspections of adherence to new guidelines would likely rely on documentary evidence maintained by homes as well as interviews with staff, residents and family members. Informant D, a service commissioner, also referenced the need for an evidence base to help inform commissioning while informant C referred to a “manifest need” for research to provide clear direction on what works. These comments highlight an appreciation that however standards are operationalized, if they are to be inspected there needs to be an appreciation of the time constraints within which inspectors operate and what is feasible in consequence.
Other issues alluded to by informants included concerns regarding participant sample study attrition (informant C) and the potential care home (informant B) related for example to bankruptcy that could again affect the feasibility of an evaluation. These echo in some respects the point raised for the EQ5D5L data above.
Discussion
The aim of this study was to assess the feasibility of conducting a cost-consequence evaluation of an oral hygiene intervention within a care home context. The sine qua non for such a study is the need to develop an evidence base for its effectiveness and cost-effectiveness. Based on the literature [16]the reviews of NG48 [23] and the comments received from informants interviewed as part of this study, it is clear that there is a manifest need for the development of an evidence base. The variability evident in current practice identified in the NICE review for NG48 [23], will as suggested by key stakeholders, delay the development of standards against which behaviour in homes can be assessed. This in turn will hinder the adoption of preventative measures at a time when it is clear oral health is an issue that impacts residents in a manner disproportionate to their community dwelling peers, challenging homes and the providers of dental treatment that are already under pressure.
This study demonstrates that it is possible to collect key data on outcomes from within the recruited care homes. That both homes and residents of homes were willing and able to engage with the research augurs well for the conduct of a definitive trial suggesting that it is feasible to collect the evidence necessary to assess the value for money of an oral health intervention though it is acknowledged this will not be without its challenges. While care home staff were aware of dental treatments provided to residents, not all homes were able to describe such data. This suggests that such data would need to be collected by researchers to ensure the veracity and accuracy of its measurement. Given the time constraints under which care home staff operate this would seem especially warranted but presents no obstacle in principle to the conduct of a definitive trial.
The study, however, does highlight issues that need to be carefully navigated in the conduct of an economic evaluation alongside a future definitive trial. The survey of care homes undertaken as part of this study took place in October 2023 towards the end of the study and when homes in Northern Ireland– which had undergone a change in ownership/management - may have been winding down their involvement with it. That less time was afforded for its completion and for follow-up with non-responders may help explain the poor response. In retrospect conducting the survey sooner would have been wiser and something that could be factored into a definitive trial if access to care home records or personnel is important. The data collected nevertheless suggests that care home managers are acutely aware of the potential for an oral hygiene intervention to reduce the burden on care assistants and improve the quality of life of residents– issues to which they appear to attach a high value to. In this regard it echoes the reviews of NG48 [23]. This is important as it suggests conditions are conducive for recruitment of homes to a future study. That most homes had a significant number of dentate residents, were aware of the dental care that residents received, the time required to train staff and had in place arrangements for providing assistance with tooth brushing again provides evidence that a definitive trial is feasible. However, as the completion rates for these data were less than optimal and the data provided by some homes was vague collecting such data prospectively rather than relying on retrospective records or memories of staff may be a more prudent approach.
The study also highlights challenges for the conduct of an evaluation alongside a definitive trial related to attrition. The high attrition rate among residents recorded here should not be surprising given the age and frailty of those at whom the intervention would be targeted. This could present challenges for data imputation if an intention to treat approach is adopted. Missing data, however, is unlikely to present an insurmountable issue. Published guidance on handling of missing data within evaluations alongside trials is available [24]. The EQ5D5L data produced in the study appears to have good face validity both in regard to the domains of health that exhibited limitations and how this changed over time. The percentage of subjects reporting no issues across domains of health declined though this should be interpreted carefully given the potential for survivor effects. That is, the exit of sicker members of the original cohort through death or inability to provide responses may mask to some extent the decline in health of survivors through changes in the composition of the cohort. Attrition notwithstanding, as might be expected in this population a decline in health over time is evident but the transition was to poorer health rather than the most severe health state, indicating that the decline was not precipitous, among survivors. In other words, data would exhibit change and be available for a significant number of participants over the course of a relatively short period. While the issue of attrition in this population presents issues for a definitive study, the existence of a proxy version of EQ5D5L that has been deployed in a care home environment [25] provides a contingency plan for a future study. With appropriate contingencies and transparent recording of the reasons for attrition, this should not present an insurmountable problem for a definitive study. As noted elsewhere, OIDP data were also available suggesting both cost-utility and cost-effectiveness calculations would be feasible.
An issue of perhaps greater concern is how generalisble the results of a study based on those able to give consent in a care home environment is to those unable to give consent. The Alzeimar’s Society estimate that in the UK about 70% of people in care homes have dementia or severe memory problems [28]. In most homes such persons likely make up a large group of residents who stand to benefit from an intervention of the type envisaged in NG48. While, as noted, proxy measures could be used for those unable to give consent or unable to respond for other reasons, studies that have examined the validity and feasibility of using proxy measures of health-related quality of life are rare. One study noted low levels of missing data, adequate levels of internal consistency and no evidence of floor effects in measures collected using EQ5D5L by proxy [29]. This could be taken as offering some comfort to the feasibility of a study based on a broader population of residents. Another study, however, that examined agreement between proxy and self-reported measures, again using EQ5D5L, was less positive [30]. This reported the strength of agreement to be fair between resident and proxy reported measures in the case of only one domain of EQ5D5L and in the index scored measure of quality of life but only slight agreement in respect of other domains or visual analogue data. This suggests that it may be more difficult to capture the evidence of effects for an intervention on this group using trial data. Recourse may have to be made to other proxy data, such as use of dental services, prescriptions for antibiotics or analgesia from which inferences might be drawn if access to it can be agreed. This is though something a definitive trial will need to consider.
Similarly, for those residents who can provide consent to access care home and dental records, there is no reason that the issue of missing data or attrition in respect of resource use could not be overcome, at least to an extent. It should be relatively easy, that is, for a research team to identify, record and measure resource use in the care home using an adaptation of the client services receipt inventory [26]. This data could be supplemented from records within the home and/or dentists’ records of those consented to a definitive trial and sources cross referenced to provide a more complete and in places verified record– provided access can be agreed, including those for for whom consent is an issue. While the existence of multiple sources of funding for personal and dental care will add to the complexity of monetizing resource use, this is a common issue in mixed payment systems and when a broader perspective than that of a publicly funded payer is adopted. That private general dental practitioners will likely charge higher fees than publicly funded dentists and may also be more easily accessed, is not in itself a significant barrier to collection of resource use data or its monetization. This may similarly be the case with respect to care assistants responsible for the delivery of an intervention. At a minimum, it suggests a sub-group analysis comparing private and public residents/dentist users may be warranted in a future evaluation. This, however, is a relatively minor issue which can be addressed with little effort. It does, however have implications for the perspective that a definitive study should adopt. While NICE recommends a NHS and personal social services perspective [27]– what might be interpreted as a publicly funded perspective– this could produce anomalies in this particular context as it may not be the reality for all residents. For example, the potential savings/costs associated with an intervention would be related to the percentage of residents whose care (including dental care) is funded publicly. This will vary between homes and is likely also to vary across the UK. To avoid this the adoption of a societal perspective may be more straightforward alongside a NHS perspective with the suggested sub-group analysis providing useful additional insights.
The lack of engagement with the survey of care home managers in Northern Ireland sounds a cautionary note about management of relationships over the course of a trial. Had the survey been conducted at the outset of the feasibility study it is probable that a larger number of responses would have been obtained as additional time would have been afforded for completion and additional time for follow-up with care homes who did not respond. By the same token, however, care home managers will have had more informed opinions at the end of the study than at the start which must also be considered. Clearly, a balance here has to be struck as to when information is sought but ongoing engagement with homes throughout a study will be important.
The study has a number of strengths and limitations. Surveying residents, care home managers and interviewing relevant stakeholders allowed responses to be triangulated from distinct perspectives as regards the feasibility of undertaking a cost-effectiveness and cost-utility evaluation in a definitive trial. Arguably this provided a more rounded assessment of the feasibility than would otherwise have been the case as well as identifying the challenges that might be encountered and how these might be overcome. Demonstrating the feasibility of collecting outcomes data related specifically to quality of life in a care home environment provides concrete evidence that a research team can recruit homes and collect data of the type needed for an evaluation of a definitive oral health trial. This augurs well for the collection of the type of quantitative data– on a range of outcomes and costs– that would be needed to populate a cost-consequence model. That care home managers from Northern Ireland did not engage with the survey of managers is a limitation though one that could be explained and overcome. While attrition was evident among residents, this is not unsurprising for a subject group of this type and does in itself jeopardize a definitive trial. The issue of generalizability to the broader care home community is something that a definitive study will need to carefully consider.
Conclusions
Overall, the study supports the case for the conduct of an economic evaluation in a definitive trial to address a manifest gap in the evidence base on oral hygiene interventions in a care home context. It identified quality of life as a key outcome of concern to stakeholders including care home managers. It demonstrated the feasibility of collecting such data with face validity among those able to consent in this context. Thus a case is made for a definitive study to adopt a cost-utility approach of the type favoured by NICE for an evaluation. A parallel cost-effectiveness analysis based on OIDP would also be prudent, as would a close examination of the correlation between any outcomes and use of services. The study suggests that among those care homes who responded, data on provision of oral hygiene and utilization of dental treatments could be readily collected by a research team and validated by reference to dental records. It identified care assistant time as a key resource likely to influence the decisions of care home managers when assessing the success of an intervention. The existence of high attrition rates and the mixed economy of care homes– with private and publicly funded personal and dental care services– present challenges for the conduct of an economic evaluation alongside a definitive trial, as does the generalisabilty of the findings. The evidence collected in this study, however, suggest that with careful planning these should not be insurmountable issues.
Acknowledgements
The project was funded by the National Institute for Health Research (NIHR) [Public Health Research Programme: PHR 17/03/11]. The views expressed in this publication are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. NIHR had no role in study design, and were not involved in the data collection, analysis, interpretation of analysis and preparation of the manuscript.
Author contributions
GT, GMK and PRB conceived the study and together with ZH, RGW, RRW, AS, CJS, FK, CON, AH, PC and NL were responsible for the study design. CON prepared the first draft of the manuscript and revised it following input from the whole team.
Funding statement
This project was funded by the National Institute for Health Research (NIHR) [Public Health Research Programme: PHR 17/03/11]. The views expressed in this publication are those of the authors and not necessarily those of the NIHR or the Department of health and Social Care. NIHR had no role in study design, and will not be involved in the data collection, analysis, interpretation of analysis and preparation of the manuscript.
Data availability
Data are available from the corresponding author upon reasonable request.
Declarations
Ethics approval and consent to participate
The TOPIC study was approved by the London: City & East Research Ethics Committee (ref: 19/LO/1107).
Consent for publication
Not applicable.
Patient consent statement
All participants provided written informed consent.
Permission to reproduce material from other sources
N/a.
Clinical trial registration
ISRCTN10276613. Registered on 17th April 2020. http://www.isrctn.com/ISRCTN10276613.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Naito M, Yuasa H, Nomura Y, Nakayama T, Hamajima N, Hanada N. Oral health status and health-related quality of life: a systematic review. J Oral Sci. 2006;48(1):1–7. [DOI] [PubMed] [Google Scholar]
- 2.Haag DG, Peres KG, Balasubramanian M, Brennan DS. Oral conditions and Health-Related quality of life: A systematic review. J Dent Res. 2017;96(8):864–74. 10.1177/0022034517709737. [DOI] [PubMed] [Google Scholar]
- 3.Porter J, Ntouva A, Read A, Murdoch M, Ola D, Tsakos G. The impact of oral health on the quality of life of nursing home residents. Health Qual Life Outcomes. 2015;13(1):102. 10.1186/s12955-015-0300-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Gerritsen A, Allen P, Witter D, Bronkhorst E, Creugers N. Tooth loss and oral health-related quality of life: a systematic review and meta-analysis. Health Qual Life Outcomes. 2010;8(1):126. 10.1186/1477-7525-8-126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Walls A, Steele J. The relationship between oral health and nutrition in older people. Mech Ageing Dev. 2004;125(12):853–7. 10.1016/j.mad.2004.07.011. [DOI] [PubMed] [Google Scholar]
- 6.Moynihan P. The relationship between nutrition and systematic and oral well-being in older people. J Am Dent Assoc. 2007;138(4):493–7. 10.14219/jada.archive.2007.0201. [DOI] [PubMed] [Google Scholar]
- 7.The Faculty of Dental Surgery of The Royal. College of Surgeons of England file:///C:/Users/3041840/Downloads/FDS%20Improving%20older%20peoples%20oral%20health%202017.pdf accessed April 2024.
- 8.Karki A, Monaghan N, Morgan M. Oral health status of older people living in care homes in Wales. Br Dent J. 2015;219(7):331–4. 10.1038/sj.bdj.2015.756. [DOI] [PubMed] [Google Scholar]
- 9.Cepoiu-Martin M, Tam-Tham H, Patten S, Maxwell CJ, Hogan DB. Predictors of long-term care placement in persons with dementia: a systematic review and meta-analysis. Int J Geriatr Psychiatry. 2016;31(11):1151–71. [DOI] [PubMed] [Google Scholar]
- 10.Pretty I. The life course, care pathways and elements of vulnerability. A picture of health needs in a vulnerable population. Gerodontology. 2014;31(s1):1–8. 10.1111/ger.12092. [DOI] [PubMed] [Google Scholar]
- 11.Cannon I, Robinson-Barella A, McLellan G, et al. From drugs to dry mouth: A systematic review exploring oral and psychological health conditions associated with dry mouth in older adults with polypharmacy. Drugs Aging. 2023;40:307–16. 10.1007/s40266-023-01017-5. [DOI] [PubMed] [Google Scholar]
- 12.Care Quality Commission. 2019 chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://www.cqc.org.uk/sites/default/files/20190624_smiling_matters_full_report.pdf accessed April 2024.
- 13.Tsakos G, Demakakos P, Breeze E, Watt R. Social gradients in oral health in older adults: findings from the english longitudinal survey of aging. Am J Public Health. 2011;101(10):1892–9. 10.2105/AJPH.2011.300215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.National Institute for Health and Care Excellence. Oral health for adults in care homes (NG48). 2016. https://www.nice.org.uk/guidance/ng48
- 15.Care Quality Commission. 2023 https://www.cqc.org.uk/publications/smiling-matters-oral-health-care-homes-progress-report/summary accessed April 2024.
- 16.Hoben M, Kent A, Kobagi N, Huynh K, Clarke A, Yoon M. Effective strategies to motivate nursing home residents in oral care and to prevent or reduce responsive behaviors to oral care: a systematic review. PLoS ONE. 2017;12(6):e0178913. 10.1371/journal.pone.0178913. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Tsakos G, Brocklehurst PR, Watson S, et al. Improving the oral health of older people in care homes (TOPIC): a protocol for a feasibility study. Pilot Feasibility Stud. 2021;7:138. 10.1186/s40814-021-00872-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Chalmers JM, King PL, Spencer AJ, Wright FA, Carter KD. The oral health assessment tool–validity and reliability. Aust Dent J. 2005;50(3):191–9. 10.1111/j.1834-7819.2005.tb00360.x. [DOI] [PubMed] [Google Scholar]
- 19.Langley J, Wassall R, Geddis-Regan A, Watson S, Verey A, McKenna G, Brocklehurst P, Tsakos G. Putting guidelines into practice: using co-design to develop a complex intervention based on NG48 to enable care staff to provide daily oral care to older people living in care homes. Gerodontology. 2023;40(1):112–26. 10.1111/ger.12629. [DOI] [PubMed] [Google Scholar]
- 20.Tsakos G, Brocklehurst P, Syed s, Harvey M, Daniyal S, Watson S et al. July. Improving the oral health of older people in care homes: results from a randomised feasibility study. Paper submitted to Community Dentistry and Oral Epidemiology. 2024. [DOI] [PMC free article] [PubMed]
- 21.Stolk E, Ludwig K, Rand K, van Hout B, Ramos-Goñi JM. Overview, update, and lessons learned from the international EQ-5D-5L valuation work: version 2 of the EQ-5D-5L valuation protocol. Value Health. 2019;22(1):23–30. 10.1016/j.jval.2018.05.010. [DOI] [PubMed] [Google Scholar]
- 22.Tsakos G, Marcenes W, Sheiham A. Evaluation of a modified version of the index of oral impacts on daily performances (OIDP) in elderly populations in two European countries. Gerodontology. 2001;18(2):121–30. 10.1111/j.1741-2358.2001.00121.x. [DOI] [PubMed] [Google Scholar]
- 23.National Institute for Health and Care Excellence (NICE). https://www.nice.org.uk/about/what-we-do/our-programmes/nice-guidance/technology-appraisal-guidance/eq-5d-5l
- 24.Faria R, Gomes M, Epstein D, White IR. A guide to handling missing data in cost-effectiveness analysis conducted within randomised controlled trials. Pharmacoeconomics. 2014;32(12):1157-70. 10.1007/s40273-014-0193-3. PMID: 25069632. [DOI] [PMC free article] [PubMed]
- 25.Toh HJ, Yap P, Wee SL, Koh G, Luo N. Feasibility and validity of EQ-5D-5L proxy by nurses in measuring health-related quality of life of nursing home residents. Qual Life Res. 2021;30(3):713–20. 10.1007/s11136-020-02673-5. [DOI] [PubMed] [Google Scholar]
- 26.Client Services Receipt Inventory (CSRI). PSSRU https://www.pssru.ac.uk/csri/client-service-receipt-inventory/ accessed April 2024.
- 27.NICE health technology evaluations. the manual: October 2023 chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://www.nice.org.uk/process/pmg36/resources/nice-health-technology-evaluations-the-manual-pdf-72286779244741 accessed April 2024.
- 28.https://www.alzheimers.org.uk/about-us/news-and-media/facts-media accessed April 2025.
- 29.Towers A, Rand S, Allan S, et al. Assessing the feasibility of measuring residents’ quality of life in english care homes and the construct validity and internal consistency of measures completed by staff proxy: a cross-sectional study. BMJ Open. 2025;15:e090684. 10.1136/bmjopen-2024-090684. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Adeela Usman S, Lewis K, Hinsliff-Smith A, Housley LG, Jordan J, Gage H, Dening T, Gladman JRF, Gordon AL. Measuring health-related quality of life of care home residents: comparison of self-report with staff proxy responses, Age and Ageing, Volume 48, Issue 3, May 2019, Pages 407–413. 10.1093/ageing/afy191 [DOI] [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data are available from the corresponding author upon reasonable request.