Skip to main content
BMC Family Practice logoLink to BMC Family Practice
. 2016 Nov 25;17:165. doi: 10.1186/s12875-016-0561-5

Impact of financial incentives on alcohol intervention delivery in primary care: a mixed-methods study

Amy O’Donnell 1,, Catherine Haighton 1,2, David Chappel 3, Colin Shevills 4, Eileen Kaner 1
PMCID: PMC5124277  PMID: 27887577

Abstract

Background

Local and national financial incentives were introduced in England between 2008 and 2015 to encourage screening and brief alcohol intervention delivery in primary care. We used routine Read Code data and interviews with General Practitioners (GPs) to assess their impact.

Methods

A sequential explanatory mixed-methods study was conducted in 16 general practices representing 106,700 patients and 99 GPs across two areas in Northern England. Data were extracted on screening and brief alcohol intervention delivery for 2010-11 and rates were calculated by practice incentive status. Semi-structured interviews with 14 GPs explored which factors influence intervention delivery and recording in routine consultations.

Results

Screening and brief alcohol intervention rates were higher in financially incentivised compared to non-incentivised practices. However absolute rates were low across all practices. Rates of short screening test administration ranged from 0.05% (95% CI: 0.03-0.08) in non-incentivised practices to 3.92% (95% CI: 3.70-4.14) in nationally incentivised practices. For the full AUDIT, rates were also highest in nationally incentivised practices (3.68%, 95% CI: 3.47-3.90) and lowest in non-incentivised practices (0.17%, 95% CI: 0.13-0.22). Delivery of alcohol interventions was highest in practices signed up to the national incentive scheme (9.23%, 95% CI: 8.91-9.57) and lowest in non-incentivised practices (4.73%, 95% CI: 4.50-4.96). GP Interviews highlighted a range of influences on alcohol intervention delivery and subsequent recording including: the hierarchy of different financial incentive schemes; mixed belief in the efficacy of alcohol interventions; the difficulty of codifying complex conditions; and GPs’ beliefs about patient-centred practice.

Conclusions

Financial incentives have had some success in encouraging screening and brief alcohol interventions in England, but levels of recorded activity remain low. To improve performance, future policies must prioritise alcohol prevention work within the quality and outcomes framework, and address the values, attitudes and beliefs that shape how GPs’ provide care.

Electronic supplementary material

The online version of this article (doi:10.1186/s12875-016-0561-5) contains supplementary material, which is available to authorized users.

Keywords: Alcohol drinking, Screening, Brief intervention, Pay for performance, Primary health care, Mixed methods

Background

Heavy drinking affects one in four adult primary care patients in the United Kingdom (UK), [1] contributes to 61 disease conditions, [2] and results in a £3.5 billion annual cost to the National Health Service (NHS). [3] Yet it is one of the most important modifiable causes of premature morbidity and mortality. [4] There is strong evidence of effectiveness supporting screening and brief alcohol interventions at reducing consumption, [5] but historically there have been low rates of delivery. [6] Voluntary financial incentives were employed between 1st April 2008 and 31st March 2015 to encourage English general practitioners (GPs) to screen their patients for heavy drinking using a validated self-report questionnaire [7], and deliver brief behavioural interventions to those in need of support. [8]

Under the national alcohol-related risk reduction directed enhanced service (DES) scheme, participating practices were paid £2.38 for each newly registered adult patient recorded as being screened for heavy drinking. [9] Whilst the scheme did not directly remunerate intervention delivery, contractual and audit guidance made clear that those patients identified as drinking at hazardous or harmful levels should be offered a brief or extended intervention. Locally-negotiated enhanced service (LES) schemes for alcohol were also introduced in certain areas. LES schemes varied in their scope and reimbursement rates, although generally they were more generous than their national counterparts and involved a more opportunistic approach to screening. For example, in one area of Northern England, practices received £8.00 for each registered patient aged 16+ (excluding newly registered patients covered via the DES) who screened positive for risky drinking and received brief advice. Both national and local schemes were voluntary, and separate to the Quality and Outcomes Framework (QOF), the principal UK incentive scheme, which links up to 25% [10] of GPs’ income to performance against a series of clinical and organisational priority areas [11]. Currently, the QOF does not include specific payments for alcohol interventions, although GPs are expected to record alcohol consumption in some disease management areas such as hypertension, coronary heart disease and mental health.

Financial incentives have been used to stimulate improvements in healthcare quality in the UK and other parts of the world. [12] Yet the extent to which this approach has been effective remains contested, [13] with concerns voiced over the perverse and unintended consequences of structuring a health system around targets and process. [1416] In theory, routine data provide a timely, cost-effective and comprehensive information source to support evaluation of incentive schemes. [17] However, evidence highlights their low sensitivity in capturing the management and treatment of complex and chronic conditions. [18] Moreover, even where such data suggest improvements in health-related outcomes, a common criticism of pay-for-performance programmes is that they merely promote better recording of care rather than better care itself. [19] At the extreme end of the scale, there have also been accusations of GPs ‘gaming’ the system, by manipulating recording of care to boost financial reward. [20]

There has been limited research into the impact of financial incentives on alcohol prevention work in England. [21] The primary aim of our study was to assess the impact of two specific national and local pay-for-performance schemes to encourage screening and brief alcohol intervention delivery using routinely recorded Read Code data. Given the use of routine data as a proxy measure of care under such incentive schemes, our secondary aim was to examine the value of such data from the GP perspective.

Method

A sequential, mixed-methods study was conducted between February 2010 and May 2013. First, we sought to assess the impact of financial incentives on screening and brief alcohol interventions by comparing recorded rates of delivery between those practices receiving financial incentives for alcohol screening and those not receiving additional payments. Second, we used semi-structured interviews to explore GPs’ perceptions of factors influencing the delivery and recording of alcohol interventions in routine consultations.

Quantitative analyses

Data and measures

Read Code data were extracted from a sample of 16 general practices based in Northern England. Read Codes are a standard clinical vocabulary which support encoding of multiple patient events in the UK, including: demographic details; clinical symptoms and diagnoses; and laboratory tests and results. [22] Whilst their principal role is to support clinical practice, Read Codes are also used to evidence the extent to which GPs have met their administrative, legal, and contractual obligations, including those required by financial incentive schemes. [23]

Read Code search strategies were developed for EMIS [24] and SystmOne [25] clinical computing systems, drawing on guidance on the recording of incentivised screening and brief alcohol intervention activity. [26] The key coding outcomes of interest were: [1] administration of an alcohol screening test (four item FAST [27]; three item AUDIT-C [28]; ten item AUDIT questionnaire [7]); and [2] delivery of either brief alcohol advice (sometimes coded as a brief intervention), or an extended brief intervention (which could include additional sessions or longer input). [29] Given the discrete populations covered by each enhanced service scheme (only patients registered during the previous 12 month period were eligible for DES payments, whereas the LES explicitly excluded this group), we extracted aggregated counts of each coding outcome of interest from the total eligible adult population as opposed to newly registered patients only. This approach also served to protect patient confidentiality in smaller practices. Full details of the search strategies are available from the authors.

Data and sample

Stratified purposive sampling was used to identify practices based on three variables: NHS area (either area A or B); incentive status (DES only; DES + LES; none); and practice size. In addition to allowing the comparison of incentivised versus non-incentivised delivery rates, this allowed us to compare recorded activity in an area in which a LES had been launched in addition to the DES (area B); and one where only the DES was available (area A). Practice managers were emailed an invitation to participate in the study, which explained the purpose of the research, and what their involvement would entail. A confidentiality agreement was signed between participating practices and the research team. Recruitment took place between March 2011 and April 2013.

Analysis

Screening and brief alcohol intervention rates were calculated by dividing the aggregated Read Code counts by the total eligible registered adult patient population for each practice. As indicated above, we used the total adult population as opposed to newly registered patients only as our denominator when extracting data and conducting primary analyses. Taking into account the targeted remit of the DES scheme however, we also estimated the rate of short alcohol screening test administration amongst newly registered patients only. Rates for each coding outcome of interest were grouped by incentive status (DES only; DES + LES; none). 95% confidence intervals were determined with the binomial distribution and calculated using the Wilson Score method [30].

Qualitative analyses

Data and sample

Next, we interviewed 14 GPs to explore their views on delivering and recording screening and alcohol intervention activity. A purposeful sampling strategy was employed to identify a maximum variety of participants based on four criteria: NHS area; incentive status; gender; and employment (salaried or practice partner). We interviewed GPs from the quantitative sample practices above, and additional participants whose practice data had not been assessed, in case the former scrutiny affected their responses. [31] GPs were contacted via telephone or email, at which point the confidential and anonymous nature of the study was emphasised, and written informed consent obtained. Interviews took place at a time and location convenient to the participant, generally at their practice. A topic guide was used to focus discussions on experiences of delivering and recording alcohol-related care (see Additional file 1), however emergent issues were also pursued. Interviews lasted 22-47 minutes (mean = 32 minutes) and were conducted until data saturation occurred.

Analysis

Interviews were audio-recorded, transcribed verbatim and anonymised. Analysis was guided using the Framework approach, [32] whereby data were sifted, coded and charted against a coding framework in accordance with initial and emergent themes. NVivo Qualitative Research software (version 9.2) was used for data management and analysis. [33] All interviews were conducted and analysed initially by AO, with emergent themes discussed and refined within the wider research team.

Mixed methods synthesis

Mixed methods data integration took place at two levels. Results from the quantitative phase informed the content and direction of the interviews with GPs, as well as the identification of interviewees. Findings from both research phases were then drawn together to determine common themes across the study as a whole. As part of this process, a mixed-methods matrix was employed to support cross-case analysis of results from nine practices where both qualitative and quantitative data were available. [34] This allowed the identification of overarching themes as well as helping to highlight areas of divergence and discrepancy.

Results

Quantitative results

Data were collected in 16 practices, representing 106,700 patients and 99 GPs in Northern England. Five practices were signed up to the DES, seven to the DES + LES, and four had no incentive scheme. Areas A and B were located adjacently within the same region and were broadly similar in terms of demography and deprivation. The key difference between the two areas concerned the additional local incentive (LES) available to practices in area B. As take-up of both the LES and the national DES achieved saturation during 2010-11 in area B, we were unable to recruit non-incentivised practices to the study from that part of the region. Additional practice characteristics are detailed in Table 1, with all data summarised in Table 2.

Table 1.

Key characteristics of sample practices

Enhanced Service for Alcohol Status Size of Practice Index of Multiple Deprivation
ID No Enhanced Service DES only DES + LES Number of registered patients* No. GPs Quintile (1st = most)
Area A P01 1 0 0 1,400 5 1st
P02 1 0 0 16,500 13 2nd
P03 1 0 0 7,600 8 4th
P04 1 0 0 8,000 6 1st
P05 0 1 0 9,800 10 3rd
P06 0 1 0 3,000 2 2nd
P07 0 1 0 6,800 7 3rd
P08 0 1 0 600 3 1st
P09 0 1 0 8,800 7 4th
Area B P10 0 0 1 4,900 4 1st
P11 0 0 1 1,200 4 1st
P12 0 0 1 3,100 4 1st
P13 0 0 1 4,800 4 1st
P14 0 0 1 6,200 5 2nd
P15 0 0 1 7,500 5 1st
P16 0 0 1 16,500 12 3rd
TOTALS 4 5 7 106,700 99 -

* All registered adult patients; totals rounded to nearest 100 to preserve practice anonymity

Table 2.

Recorded delivery of screening and brief alcohol intervention by practice

Enhanced service status Practice All patients* (newly registered only) FAST/ AUDIT-C screening test (%) FAST/ AUDIT-C screening test (newly registered show patients only) (%) Full AUDIT screening test (%) Any form of alcohol intervention (%)
Area A No enhanced service P01 1400 (720) 1.09 2.08 0.00 0.00
P02 16500 (1190) 0.01 0.17 0.35 0.44
P03 7600 (330) 0.00 0.00 0.00 9.41
P04 8000 (440) 0.00 0.00 0.00 9.89
ALL 32100 (2680) 0.05 0.63 0.17 4.73
DES only P05 9800 (530) 0.00 0.00 0.31 5.63
P06 3000 (180) 4.98 86.52 0.00 0.00
P07 6800 (440) 0.01 0.23 0.00 0.01
P08 600 (360) 56.21 92.29 5.20 7.89
P09 8800 (880) 7.37 73.47 11.46 23.69
ALL 29000 (2390) 3.92 47.54 3.68 9.23
Area B DES + LES P10 4900 (480) 7.06 72.18 0.00 23.82
P11 1200 (350) 29.67 103.11 0.81 17.97
P12 3100 (590) 15.51 80.00 0.73 9.45
P13 4800 (350) 0.00 0.00 0.00 9.58
P14 6200 (250) 4.14 104.02 0.00 0.37
P15 7500 (500) 1.60 23.73 1.23 6.78
P16 16500 (760) 0.10 2.11 8.50 6.14
ALL 44200 (3280) 3.56 47.91 3.44 8.32

*All registered adult patients; totals rounded to nearest 100 [10] to preserve practice anonymity

Screening for an alcohol use disorder

Rates of short screening test administration (FAST or AUDIT-C) were lowest in practices with no enhanced service (0.05% (17/33539), 95% CI: 0.03-0.08). Rates were higher in practices signed up to either both the LES + DES (3.56% (1574/44202), 95% CI: 3.39-3.74) or the DES only (3.92% (1138/29065), 95% CI: 3.70-4.14). Taken as a proportion of newly registered patients only, rates were also lowest in non-incentivised practices (0.63% (17/2680), 95% CI: 0.40-1.01), compared to either practices signed up to the DES only (47.54% (1138/2394), 95% CI: 45.54-49.54) or those signed up to both the LES and DES (47.91% (1574/3285), 95% CI: 46.21-49.62).

For the full AUDIT, practices not signed up to an enhanced service had the lowest recorded rates of delivery (0.17% (57/33539), 95% CI: 0.13-0.22). Those signed up to both DES + LES services had slightly lower recorded rates (3.44% (1521/44202), 95% CI: 3.28-3.62) in comparison to practices signed up to only the DES (3.68% (1069/29065), 95% CI: 3.47-3.90).

Alcohol intervention

When all instances of recorded alcohol interventions were combined (brief advice, brief intervention and extended intervention), rates were highest in practices signed up to one or more enhanced service for alcohol. Combined intervention activity was highest in practices signed up to either the DES only (9.23% (2684/29065), 95% CI: 8.91-9.57) or both the DES + LES (8.32% (3677/44202), 95% CI: 8.06-8.58). Rates were lowest in practices not signed up to either enhanced service (4.73% (1585/33539), 95% CI: 4.50-4.96).

Qualitative results

Ten of the 14 GP interviewees were based in practices that participated in the quantitative phase of the research. An equal representation of practices from each NHS area was achieved. Further participant details are provided in Table 3, with overarching interview themes, including where key differences emerged between GPs working in incentivised versus non-incentivised practices, described below.

Table 3.

Summary characteristics of qualitative interview participants

N [14]
Gender Male 7
Female 7
Experience in practice >5 years 4
5-15 years 3
>15 years 7
Employment status Partner 7
Salaried GP 6
Registrar 1
Location Area A 7
Area B 7
Enhanced service status No Enhanced Service 3
Directed Enhanced Service 4
Directed Enhanced Service & Local Enhanced Service 7

The hierarchy of incentive schemes

All GPs across our sample prioritised the delivery and recording of QOF-related activity above that for other incentive schemes, and this hierarchy was reinforced via administrative and computing systems primarily designed to support the collection of QOF data. For GPs based in practices signed up to an alcohol enhanced service, as payment was based on the number of screening tests completed, the administration and recording of any subsequent preventative activity, such as the delivery of a brief intervention for alcohol, was less systematic. Moreover, screening activity was typically devolved to nurses and healthcare assistants as part of standard annual health checks or new patient registrations. GPs reported being unlikely to formally screen patients for heavy drinking during a consultation.

“…you’re driven by what’s important or what you have to categorise. Somebody smoking is QOF-related so I find a way to Read Code somebody’s smoking status… So if you were saying would I record ‘Delivered brief intervention on alcohol’, I wouldn’t. Unless there was QOF driven reason for it, or it was important to put in their notes…”

GP11, male, DES + DES

“We have better systems in the practice to make sure that the QOF data is collected and there are more reminders on the screen if it’s not done. Back office staff will chase people up and things like that.”

GP2, male, DES

Belief in the efficacy of screening and alcohol interventions

Irrespective of practice incentive status, most GPs believed that alcohol interventions could be effective in certain contexts, and with certain patients. However, there were also situations in which such an approach was viewed as unlikely to be impactful. Only one participant expressed an unreservedly positive view on their effectiveness. For some interviewees, this lack of faith in the effectiveness of brief alcohol interventions related to a belief that a patient needed to be ‘ready to change’ for interventions to work. As such, many GPs restricted their delivery (and in turn, recording) of alcohol interventions to patients that they judged as being ‘ready to change’.

“I suppose one of the key things I feel with alcohol to some extent is, I suppose people have to be wanting to change before you can take them too far down the road of an intervention. And so sometimes yes they know they’re drinking too much but they’re not that ready to change, so going through a whole pathway doesn’t always help.”

GP2, male, DES

“You can feel like you’ve had a very good consultation and they’ll still go on drinking. Or you can do something really quickly and say ‘You know for heaven’s sake you’ve got to stop drinking.’ And they’ll come back in three months and say ‘Do you know when you said that I was really shocked, I’ve stopped drinking.’ And you think ‘Oh my goodness!’ It’s very hard to predict who you’re going to have an effect on.”

GP3, female, no enhanced service

“I’m realistic, it doesn’t work every time… that’s one of the mysteries, you don’t quite know who it’s gonna work with, or when it’s gonna work.”

GP7, male, DES + LES

The challenge of coding complex and sensitive conditions

Given the critical role of Read Code data in evidencing performance for payment purposes, and supporting continuity of care, most GPs were anxious to code clinical activities correctly. However even in incentivised practices, there was low awareness of the appropriate Read Codes for screening and brief alcohol interventions, an issue potentially exacerbated by the existence of over 280 possible alcohol-related codes. [35] Further, many interviewees questioned the applicability of the available Read Code vocabulary to complex health conditions or behaviours that were less easily quantifiable, and thus codified. A few participants also highlighted the adverse consequences for patients potentially arising from formally recording their alcohol status, both in terms of financial impacts (e.g. higher health insurance costs), and the wider stigma associated with substance use disorders. When in doubt, some GPs reported using free text to record such issues rather than formal Read Coding. Indeed, irrespective of incentive scheme, it appeared that care delivery and care recording were not always tightly aligned.

“Because, you know the situation is usually so complex, in terms of the person’s own personal and social history and what’s led them to heavy drinking…Read coding, simple coding can’t capture all that sort of, not by a long shot…you could perfectly well have instances in which the codes tell you that the doctor or the nurse has done the right things in terms of an intervention. But actually if the relationship and the trust and the understanding of the person’s social context isn’t there, then you don’t know the whole story.”

GP6, male, no enhanced service

“I always struggle to find any Read Codes for alcohol…I wouldn’t use specific Read Codes for an intervention delivered, I would record more what I say I did in free-text…I haven’t found so far any benefit from using codes…if you want to say a number of units a week then you’d really have tie a patient down…and somebody says oh I had three glasses of wine and a whiskey, tonight, somebody might classify that as four units but in reality it’s more nearer seven isn’t it? So if somebody was saying I drink that every night, seven times seven is 49, and then seven times four is 28, so you can say I see your alcohol consumption used to be 49 and now it’s 28, and it could just be the inaccuracies of data collection. So for me I don’t want to tie something down…because you could draw false inferences from data that isn’t that accurate.”

GP11, male, DES + LES

The role of the GP within the patient-centred consultation

All GPs expressed an overriding concern to deliver a patient-centred consultation, informed by a thorough understanding of their wider social and familial circumstances. Whilst interviewees acknowledged the importance of recording treatment to support continuity of care, most saw Read Code data of limited value in terms of documenting a patient’s wider circumstances. This was seen as a particular weakness when it came to recording alcohol intervention delivery. In contrast, Read Codes were viewed as a more appropriate means of capturing the nurse-led activities that supported the GP role, particularly alcohol screening test administration.

“I think often people in government, administrative bodies they say why aren’t we doing more about alcoholism in the UK forget that when patients come to the doctors it’s not a hole in the wall situation…doctors aren’t automatons and each patient is an individual.”

GP12, female, DES + LES

“I don’t like codes; you know…I’m a clinician, I love the clinical encounter… the commitment [is] to what has gone on with the patient.”

GP7, male, DES + LES

“As long as I know somebody’s drinking 50 units and I know that I’ve talked them through it and I know that they’re coming back to see me about it, whether I’ve coded it on the system or not, so what? The intervention’s been done.”

GP5, female, DES

Discussion

The introduction of financial incentives in England appears to have had some success in encouraging primary care providers to identify and support patients to reduce heavy alcohol consumption. However, whilst rates of screening and brief alcohol intervention delivery were higher in incentivised practices, this trend needs to be set against very low levels of recorded activity overall. Since the national DES incentivised the screening of newly registered patients only, a relatively small group within the wider patient population, such low rates may be expected. Our estimated rates of short screening test administration amongst newly registered patients indicate a more sizeable reach for the national enhanced service scheme. However it must be emphasised that these rates are estimates only: as the 100% + rates achieved by two of our practices indicate, alcohol screening tests were conducted with both new as well as existing registered patients.

Previous research by Purshouse et al suggests that if such a screening programme is implemented effectively, it would achieve around 40% coverage of the registered adult population over a ten year period, leading to reduced health service costs and increased health benefits [36]. However, this scenario is based on an assumption that a brief intervention for alcohol is delivered immediately after a patient screens positive for risky alcohol consumption. In many of our practices, there seemed to be a mismatch between screening patients for heavy drinking, and the delivery of subsequent advice or counselling about alcohol. Available prevalence data would suggest that approximately one in four patients [37] are likely to be drinking excessively, meaning that one might expect that at least a quarter of all patients screened would have received an alcohol intervention. In reality, for some practices, intervention delivery rates appeared much lower than expected. Yet, in others, the rates were much higher when compared with the proportion actually screened. We could not determine if this was due to an absence of coding or a lack of follow through to advice or counselling. We were not told of any deliberately erroneous or ‘over-coding’ by GPs incentivised for enhanced performance. However our interview findings suggest that additional factors beyond monetary incentives shaped routine practice. In particular, despite consistent evidence to the contrary, [5] many physicians remain unconvinced of the effectiveness of brief alcohol interventions: a barrier to delivery raised in previous implementation literature in this field [38].

The strength of our study was the mixed methods design, which helped provide a rich and nuanced understanding of the impact of financial incentives on GPs’ delivery and recording of screening and brief alcohol interventions. By using routinely recorded data as a measure of activity, we also provide a valuable insight into the rates of alcohol prevention work being delivered in real world as opposed to research trial settings.

However, there are several limitations to our data. Practices were not randomly sampled and thus there was a potential for self-selection bias. [39] In the absence of corroborating observational data (such as consultation recording), it was only possible to assess activity rates via formal coding. It is possible that these data were not an accurate record of all care provided, [40] particularly given our searches were limited to Read Coded rather free text data. Moreover, as we extracted aggregated counts of each variable of interest at practice level, there is potential for double-counting: that is an individual patient may have been screened twice with both shorter and longer tools; or received both brief advice as well as an extended intervention during the period of interest. Changes in the Read Codes used to record alcohol interventions since 2008 make it challenging to compare trends pre and post the introduction of financial incentives. Thus whilst our study suggests there are significant differences in delivery rates between incentivised and non-incentivised practices, these trends cannot be interpreted as causal.

The majority of interviewees were drawn from practices signed up to at least one enhanced service for alcohol. Interview accounts may have differed if we had recruited more ‘non-incentivised’ practitioners, but these were less inclined to be recruited. Further, whilst overall, recorded levels of alcohol prevention activity were significantly higher in incentivised practices, rates at individual practice level were nevertheless low even for some incentivised practices (P06, P07 and P16), suggesting that our sample captured a range of perspectives. In addition, despite the central role they appear to play in delivering alcohol screening tests, we did not interview nurses in this study. This study sampled 16 practices and interviewed 14 GPs across two NHS areas in one region in England, representing approximately eight per cent of the total practice population. In comparison to other parts of the UK, Northern England is relatively deprived [41] and has higher average alcohol consumption [42], potentially limiting the generalisability of our data. Whilst the low delivery rates reported here are unlikely to be higher elsewhere, a larger study would be required to validate our findings.

To some extent, our findings support previous research, suggesting that financial incentives can have positive impacts on screening and brief alcohol intervention delivery in primary care. [21, 43, 44] Interestingly, our results do not indicate that there was any cumulative effect for practices that were signed-up to both the local and national incentive schemes. Given that the GP interviews suggested that routine FAST or AUDIT-C delivery was more likely when embedded within nurse-delivered practice and associated recording systems (such as registering a new patient, as incentivised by the DES), limited instances of opportunistic screening (as incentivised by the LES) might be expected.

However, the recorded activity rates reported here were comparatively low for all outcomes of interest, irrespective of financial incentive status. Alongside the design of the scheme, this may be also due to the low level of remuneration associated with the national DES in particular. For example, practices participating in the QOF+ scheme assessed by Hamilton et al, were paid up to £5,607 for screening and delivering a brief intervention to all eligible patients. [45] DES practices in this study would have received just £2.38 for each newly registered patient screened, meaning they would need to screen around 2,300 patients per annum to achieve similar financial returns. Our qualitative findings suggest that differing incentive schemes are not seen as equal by GPs. Specifically, the QOF has the largest effect on practice income, so the delivery and recording of enhanced service activities are often accorded lower priority. [46]

At the same time, a strong theme from our interviews was the challenge that GPs experience when recording complex and potentially stigmatising conditions such as harmful alcohol consumption. In particular, their concern to preserve ‘patient-centred’ consultations sometimes clashed with the need to record simple diagnoses and outcomes, especially when uncertainty or sensitivity was at play. [47] This tension has been described as a “rational-reality gap”, [48] requiring clinicians to maintain a “dual orientation” towards coding. [49] Whilst other research suggests that financial incentives such as QOF serve to promote an increasingly biomedical agenda in terms of the management of chronic and complex health issues in primary care [50], our results suggest more nuanced behaviour on the part of GPs. Importantly, we found numerous examples of GPs adapting the system to allow their behaviour to more closely align with their preferred ‘patient-centred’ approach, with the ‘tick-box’ elements of alcohol-related care devolved to nurses.

Conclusions

This study provides further evidence that policy initiatives that focus solely on the extrinsic motivations of GPs, such as financial incentives, are unlikely to have the desired level of impact without acknowledging the values, attitudes and beliefs that also shape care. The incongruity we observed between recorded rates of screening versus actual alcohol intervention delivery also highlight the potentially distorting effects of pay-for-performance on healthcare recording, and in particular, of incentivising process as opposed to outcomes [51]. Our findings also suggest that some incentive schemes are more impactful than others, with QOF unarguably most influential as far as English primary care is concerned. Given the radical reduction to the number of clinical indicators covered by the current QOF, [52] the addition of screening and brief alcohol intervention in the future seems unlikely. This is despite that the fact that over one in four patients continue to drink above recommended levels, [37] whilst three quarters of the English population do not have any of the diseases listed in the QOF. [53] Since April 2015, the national enhanced service for alcohol has been withdrawn, although local level incentive schemes remain in place for some areas [54], and there is now a contractual requirement for practices to identify newly registered adult patients drinking above recommended levels [55]. Based on the findings from this study, which highlight the substantial challenges experienced by GPs seeking to prioritise non-incentivised care over their routine management of QOF conditions, this seems a risky strategy. If NHS England is to deliver on its promise of “hard-hitting” action on tackling risky lifestyle behaviours in the future, [56] a fresh look at the financing and organisation of preventative care is urgently required.

Acknowledgements

The authors would like to thank the GPs and other practice staff that participated in the study.

Funding

This work was supported by Fuse, the Centre for Translational Research in Public Health, a UKCRC Public Health Research Centre of Excellence (ES/G007470/1). AO was a fully funded doctoral student, CH is a partially funded staff member and EK is a Fuse Senior Investigator. Funding for Fuse from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the National Institute for Health Research, is gratefully acknowledged.

Availability of data and materials

The quantitative datasets supporting the conclusions of this paper are available from the corresponding author on reasonable request. Qualitative data are not publicly available due to ethical restrictions and to preserve anonymity.

Authors’ contributions

AOD, CH, DC, CS and EK conceived and designed the study. AOD was responsible for recruitment of practices and GP interview participants and collected the quantitative and qualitative data. AOD conducted the initial data analyses, and CH, DC, CS and EK contributed to the interpretation of the analyses. AOD drafted the manuscript, and CH, DC, CS and EK revised it critically for important intellectual content. All authors read and approved the final manuscript and are accountable for the accuracy and integrity of the research reported.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable. The authors confirm that all practice/personal identifiers have been removed or disguised so the practice/person(s) described are not identifiable and cannot be identified through the details of the manuscript.

Ethics approval and consent to participate

The study was granted ethical approval by Newcastle and North Tyneside Research Ethics Committee 1 (10/HO906/47). Written informed consent was obtained from all GP interview participants.

Abbreviations

AUDIT

Alcohol Use Disorders Identification Test

AUDIT C

Alcohol Use Disorders Identification Test Consumption

DES

Directed Enhanced Service

FAST

Fast Alcohol Screening Test

LES

Local Enhanced Service

NHS

National Health Service

QOF

Quality and Outcomes Framework

Additional file

Additional file 1: (19.6KB, docx)

Interview guide for General Practitioners. (DOCX 19 kb)

Contributor Information

Amy O’Donnell, Phone: +44 191 208 5696, Email: amy.odonnell@newcastle.ac.uk.

Catherine Haighton, Email: katie.haighton@newcastle.ac.uk.

David Chappel, Email: David.Chappel@phe.gov.uk.

Colin Shevills, Email: colin.shevills@balancenortheast.co.uk.

Eileen Kaner, Email: eileen.kaner@newcastle.ac.uk.

References

  • 1.Funk M, Wutzke S, Kaner E, Anderson P, Pas L, McCormick R, et al. A multicountry controlled trial of strategies to promote dissemination and implementation of brief alcohol intervention in primary health care: Findings of a world health organization collaborative study. J Stud Alcohol. 2005;66(3):379–88. doi: 10.15288/jsa.2005.66.379. [DOI] [PubMed] [Google Scholar]
  • 2.Rehm J, Mathers C, Popova S, Thavorncharoensap M, Teerawattananon Y, Patra J. Global burden of disease and injury and economic cost attributable to alcohol use and alcohol-use disorders. The Lancet. 2009;373:2223–33. doi: 10.1016/S0140-6736(09)60746-7. [DOI] [PubMed] [Google Scholar]
  • 3.Home Office . The Government’s Alcohol Strategy. London: HM Government; 2012. [Google Scholar]
  • 4.Goldstein MG, Whitlock EP, DePue J. Multiple behavioral risk factor interventions in primary care: Summary of research evidence. American journal of preventive medicine. 2004;27(2, Supplement):61–79. doi: 10.1016/j.amepre.2004.04.023. [DOI] [PubMed] [Google Scholar]
  • 5.O’Donnell A, Anderson P, Newbury-Birch D, Schulte B, Schmidt C. Reimer J, et al. The impact of brief alcohol interventions in primary healthcare: A systematic review of reviews Alcohol and Alcoholism. 2014;49(1):66–78. doi: 10.1093/alcalc/agt170. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.van Beurden I, Anderson P, Akkermans RP, Grol RP, Wensing M, Laurant MG. Involvement of general practitioners in managing alcohol problems: a randomized controlled trial of a tailored improvement programme. Addiction. 2012;107(9):1601–11. doi: 10.1111/j.1360-0443.2012.03868.x. [DOI] [PubMed] [Google Scholar]
  • 7.Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption II. Addiction. 1993;88:791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x. [DOI] [PubMed] [Google Scholar]
  • 8.National Health Service. NHS Health Check Minimum Data Set (MDS): Standard Specification. London: NHS, 2009 July. Report No.: Contract No.: Draft Version No: 1.4
  • 9.NHS Employers. General Medical Services Contract 2014/15: Guidance and Audit Requirements. . London: BMA, NHS England & NHS Employers, 2014 Contract No.: NHS England Gateway reference: 01347
  • 10.Kontopantelis E, Springate DA, Ashworth M, Webb RT, Buchan IE, Doran T (2015) Investigating the relationship between quality of primary care and premature mortality in England: a spatial whole-population study. BMJ 350 [DOI] [PMC free article] [PubMed]
  • 11.Gregory S. General practice in England: An overview. London: The King's Fund; 2009. [Google Scholar]
  • 12.Scott A, Sivey P, Ait Ouakrim D, Willenberg L, Naccarella L, Furler J, Young D. The effect of financial incentives on the quality of health care provided by primary care physicians. Cochrane Database Syst Rev. 2011;(9). Art. No.: CD008451. doi:10.1002/14651858.CD008451.pub2. [DOI] [PubMed]
  • 13.Sermuga B, Ross-Degnan D, Avery A, Elliott R, Majumdar S, Zhang F, et al. Effect of pay for performance on the management and outcomes of hypertension in the United Kingdom: interrupted time series study. British Medical Journal. 2011;342:1–7. doi: 10.1136/bmj.d108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Maisey S, Steel N, Marsh R, Gillam S, Fleetcroft R, Howe A. Effects of payment for performance in primary care: qualitative interview study. Journal of health services research & policy. 2008;13(3):133–9. doi: 10.1258/jhsrp.2008.007118. [DOI] [PubMed] [Google Scholar]
  • 15.McDonald R, Harrison S, Checkland K, Campbell S, Roland M. Impact of financial incentives on clinical autonomy and internal motivation in primary care: ethnographic study. British Medical Journal. 2007;10(1136):1–6. doi: 10.1136/bmj.39238.890810.BE. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.McDonald R, Roland M. Pay for performance in primary care in England and California: comparison of unintended consequences. Annals of Family Medicine. 2009;7(2):121–7. doi: 10.1370/afm.946. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Powell A, Davies H, Thomson R. Using routine comparative data to assess the quality of health care: understanding and avoiding common pitfalls. Quality and Safety in Health Care. 2003;12:122–8. doi: 10.1136/qhc.12.2.122. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Hrisos S, Eccles M, Francis J, Dickinson H, Kaner E, Beyer F et al (2009) Are there valid proxy measures of clinical behaviour? A systematic review. Implementation Science 4 (No. 37) [DOI] [PMC free article] [PubMed]
  • 19.Campbell S, Reeves D, Kontopantlis E, Middleton E, Sibbald B, Roland M. Quality of Primary Care in England with the Introduction of Pay for Performance. The New England Journal of Medicine. 2007;357(2):181–90. doi: 10.1056/NEJMsr065990. [DOI] [PubMed] [Google Scholar]
  • 20.Bevan G, Hood C. What’s measured is what matters: targets and gaming in the English public health care system. Public Administration. 2006;84(3):517–38. doi: 10.1111/j.1467-9299.2006.00600.x. [DOI] [Google Scholar]
  • 21.Hamilton FL, Laverty AA, Gluvajic D, Huckvale K, Car J, Majeed A et al (2013) Effect of financial incentives on delivery of alcohol screening and brief intervention (ASBI) in primary care: longitudinal study. Journal of Public Health [DOI] [PubMed]
  • 22.UK Terminology Centre . Read codes clinical terms version 3: introduction and overview. London: NHS; 2008. [Google Scholar]
  • 23.Department of Health. Quality and Outcomes Framework London [Available from: www.qof.ic.nhs.uk/index.asp.
  • 24.EMIS. Egton Medical Information Systems Ltd (EMIS) https://www.emishealth.com.
  • 25.TPP. SystmOne: one patient record. http://www.tpp-uk.com/systmone-overview/2013.
  • 26.Department of Health . Alcohol care pathways. London: Department of Health; 2009. [Google Scholar]
  • 27.Hodgson RJ, Alwyn T, John B, Thom B, Smith A. The FAST Alcohol Screening Test. Alcohol & Alcoholism. 2002;37:61–6. doi: 10.1093/alcalc/37.1.61. [DOI] [PubMed] [Google Scholar]
  • 28.Bush K, Kivlahan D, McDonell MB, Fihn SD, Bradley KA. The AUDIT Alcohol Consumption Questions (AUDIT-C) Archives of Internal Medicine. 1998;158(16):1789–95. doi: 10.1001/archinte.158.16.1789. [DOI] [PubMed] [Google Scholar]
  • 29.Kaner E, Beyer F, Dickinson H, Pienaar E, Campbell F, Schlesinger C, et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database of Systematic Reviews. 2007;Issue 2:CD004148.DOI:10.1002/14651858.CD4148.pub3. [DOI] [PubMed]
  • 30.Wilson EB. Probable inference, the law of succession and statistical inference. Journal of the American Statistical Association. 1927;22:209–12. doi: 10.1080/01621459.1927.10502953. [DOI] [Google Scholar]
  • 31.Roethlisberger F, Dickson W. Management and the worker. Cambridge: Harvard University Press; 1939. [Google Scholar]
  • 32.Ritchie J. Jane Ritchie national centre for social research L, Lewis J, McNaughton Nicholls C, Ormston R. Qualitative Research Practice. London: SAGE; 2013. [Google Scholar]
  • 33.NatCen. Framework method of analysis now supported by NVivo 9 software London: National Centre for Social Research; 2011 [Available from: http://www.natcen.ac.uk/our-expertise/methods-expertise/qualitative/framework/-.
  • 34.Pope C, Ziebland S, Mays N. Analysing qualitative data. BMJ. 2000;320(7227):114–6. doi: 10.1136/bmj.320.7227.114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.O’Donnell A, Haighton K, Chappel D, Shevills C, Kaner E. Can routine data help evaluate the implementation of a brief alcohol intervention in primary health care? Alcoholism: Clinical and Experimental Research. 2013;35(S6):149A. [Google Scholar]
  • 36.Purshouse R, Brennan A, Rafia R, Latimer N, Archer R, Angus C, et al. Modelling the Cost-Effectiveness of Alcohol Screening and Brief Interventions in Primary Care in England. Alcohol and Alcoholism. 2013;48(2):180–8. doi: 10.1093/alcalc/ags103. [DOI] [PubMed] [Google Scholar]
  • 37.National Statistics . Statistics on Alcohol: England, 2015. London: Health and Social Care Information Centre; 2015. [Google Scholar]
  • 38.Lock C, Wilson G, Kaner E, Cassidy P, Christie M, Heather N. A survey of general practitioners' knowledge, attitudes and practices regarding the prevention and management of alcohol-related problems: an update of a World Health Organisation survey ten years on. London: Alcohol Education and Research Council; 2009. [Google Scholar]
  • 39.Down L, Metcalfe C, Avery K, Noble S, Lane JA, Neal DE, et al. Factors distinguishing general practitioners who more readily participated in a large randomized trial were identified. Journal of Clinical Epidemiology. 2009;62(1):67–73. doi: 10.1016/j.jclinepi.2008.02.014. [DOI] [PubMed] [Google Scholar]
  • 40.Dresselhaus T, Peabody J, Lee M, Wang M, Luck J. Measuring Compliance with Preventative Care Guidelines: Standardised Patients, Clinical Vignettes, and the Medical Record. Journal of General Internal Medicine. 2000;15:782–8. doi: 10.1046/j.1525-1497.2000.91007.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Smith T, Noble M, Noble S, Wright G, McLennan D, Plunkett E. The English indices of deprivation 2015: research report. London: Department for Communities and Local Government; 2015. [Google Scholar]
  • 42.NEPHO . Alcohol and health in North East England. Stockton on Tees: North East Public Health Observatory; 2006. [Google Scholar]
  • 43.Lapham GT, Achtmeyer CE, Williams EC, Hawkins EJ, Kivlahan DR. KA. B. Increased documented brief alcohol interventions with a performance measure and electronic decision support. Med Care. 2012;50(2):179–87. doi: 10.1097/MLR.0b013e3181e35743. [DOI] [PubMed] [Google Scholar]
  • 44.Michaud P, Fouilland P, Dewost AV, Abesdris J, de Rohan S, Toubal S, et al. Early screening and brief intervention among excessive alcohol users: mobilizing general practitioners in an efficient way. La Revue du praticien. 2007;57(11):1219–26. [PubMed] [Google Scholar]
  • 45.NHS Hammersmith and Fulham, Imperial College London . Quality and outcomes framework plus: towards world class healthcare for all. London: NHS Hammersmith and Fulham 2009 / eHealth Unit, Department of Primary Care and Social Medicine, Imperial College; 2009. [Google Scholar]
  • 46.Millett C, Majeed A, Huckvale C, Car J (2011) Going local: devolving national pay for performance programmes. BMJ 342 [DOI] [PubMed]
  • 47.May C, Rapley T, Moreira T, Finch T, Heaven B. Technogovernance: Evidence, subjectivity, and the clinical encounter in primary care medicine. Social Science & Medicine. 2006;62(4):1022–30. doi: 10.1016/j.socscimed.2005.07.003. [DOI] [PubMed] [Google Scholar]
  • 48.Heeks R, Mundy D, Salazar A. 1999. University of Manchester, Why Health Care Information Systems Succeed or Fail. Information Systems for Public Sector Management Working Paper Series; No. 9. p. e001754.
  • 49.Swinglehurst D, Greenhalgh T, Roberts C. Computer templates in chronic disease management: ethnographic case study in general practice. BMJ Open. 2012;2(6). [DOI] [PMC free article] [PubMed]
  • 50.Chew-Graham CA, Hunter C, Langer S, Stenhoff A, Drinkwater J, Guthrie EA, et al. How QOF is shaping primary care review consultations: a longitudinal qualitative study. BMC Family Practice. 2013;14(1):1–7. doi: 10.1186/1471-2296-14-103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Thorlby R, Maybin J. A high-performing NHS?: A review of progress 1997-2010. London: The King's Fund; 2010. [Google Scholar]
  • 52.British Medical Association, NHS Employers. Summary of changes to the GMS (General Medical Services) contract in England for 2014/15. BMA & NHS Employers, 2013. Available from: http://www.nhsemployers.org/your-workforce/primary-care-contacts/general-medical-services/gms-contract-changes/contract-changes-2014-15.
  • 53.Heath I, Hippisley-Cox J, Smeeth L. Measuring performance and missing the point? British Medical Journal. 2007;335:1075–6. doi: 10.1136/bmj.39377.387373.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Newcastle Gateshead CCG . Practice Engagement Programme (PEP) 2015-2016: Primary Care Quality Indicators Definitions and supporting information. Newcastle upon Tyne: Newcastle Gateshead CCG; 2015. [Google Scholar]
  • 55.NHS Employers, BMA,NHS England . Technical requirements for 2014/15 GMS contract changes. NHS England Gateway reference: 02000. London: NHS Employers; 2014. [Google Scholar]
  • 56.NHS England. Five year forward view. London: NHS; 2014. https://www.england.nhs.uk/wp-content/uploads/2014/10/5yfv-web.pdf.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The quantitative datasets supporting the conclusions of this paper are available from the corresponding author on reasonable request. Qualitative data are not publicly available due to ethical restrictions and to preserve anonymity.


Articles from BMC Family Practice are provided here courtesy of BMC

RESOURCES