Skip to main content
Journal of the Royal Society of Medicine logoLink to Journal of the Royal Society of Medicine
. 2016 Jan;109(1):18–26. doi: 10.1177/0141076815608853

Has NHS reorganisation saved lives? A CuSum study using 65 years of data

Alice S Lale 1, Jonathan MF Temple 2,
PMCID: PMC4724772  PMID: 26432817

Abstract

Objectives

To determine if NHS reforms affect population mortality.

Design

Retrospective study using routinely published data.

Setting & participants

Resident population of England and Wales 1948 to 2012

Main outcome measure

All cause age sex directly standardised mortality England and Wales 1948 to 2012.

Methods

Using the CuSum technique and Change-Point Analysis to identify sustained changes in the improving age-standardised mortality rates for the period 1948-2012, and comparing the time of these changes with periods of NHS reform. Where observed changes did not fit with NHS reform, changes external to the NHS were sought as a possible explanation of changes observed.

Results

CuSum plotting and CPA showed no significant changes in female mortality trend between 1948 and 2012. However, this analysis identified a sustained improvement in the male mortality trend, occurring in the mid-1970s. A further change in the rate of male mortality decline was found around the Millennium.

Conclusion

The 1974 NHS reorganisation, changing service arrangements predominantly for women and children, is considered an unlikely explanation of the improved rate of male mortality decline. Thus, centrally led NHS reorganisation has never had any detectable effect on either male or female mortality and must be considered ineffective for this purpose. But some evidence supporting the view that increased funding improves outcomes is found.

Keywords: mortality, health care reform, statistics, statistical process control

Introduction

Britain’s National Health Service (NHS) aims to improve the health of the UK population both by delivering healthcare to the population that meets individual’s needs without personal cost at the point of access and by action on the causes of ill health. At its creation in 1948, the NHS acquired the mosaic of healthcare services that had evolved, but ensured central funding. Since then it has undergone several, centrally driven, structural and management reforms starting in 1962. Each time, these reorganisations aimed to reduce costs while improving healthcare delivery to patients and thus improving the health of the population. Reforming the NHS is an increasingly costly process and it is therefore important to investigate whether reorganisation improved health outcomes as expected.

This study therefore addresses an essential public health question, at a time when health services are experiencing demands to save money.

Evaluation of the NHS, and its reform, may be carried out in a number of ways. Most commonly, activity levels are used to monitor the ‘success’ of the NHS. So, NHS performance is reported in terms of achieving targets such as increasing numbers of staff, hospitals, beds and equipment, or operational indicators. Such targets were set out by The NHS Plan in 2000.1 In this way, the evaluation of NHS reorganisation has compared targets such as surgical queues and healthcare activity reached before and after the introduction of an NHS reorganisation.2

The impact of NHS reorganisation may also be measured using economic evaluation, such as cost-benefit analysis. Propper3 examined the impact of the internal market reforms by investigating the effect of competition on prices, quality and quantity of production.

More recently, the concept of ‘mortality amenable to health care’ has been developed as a way of assessing the performance of healthcare services. Mortality amenable to healthcare refers to ‘deaths from certain causes that should not occur in the presence of timely and effective health care’.4 However, this method fails to recognise health system performance beyond specific healthcare interventions, and is thus not conducive to assessing the performance of the health system as a whole.5

Since preventing premature deaths is a fundamental aim of public health action, this study examines the public health effect of past NHS reorganisation and policy change on mortality in England and Wales over the first 65 years of the NHS' existence. All-cause mortality is used in this study as a marker for the effectiveness of the health service in totality, not just the healthcare component. While not a perfect indicator, it does directly reflect one primary public health aim to prolong healthy life. The use of mortality rates is a long established method of monitoring health systems. Higher mortality rates are expected in less healthy populations with higher unmet health needs.

Since Bunker6 showed that around half the health gain in the post war period (i.e. throughout the operation of the NHS) is due to healthcare improvements, important changes in the effectiveness of healthcare delivery should detectably alter mortality rates; exemplified by using cancer survival rates (inverse mortality rates) to indicate cancer services effectiveness.

Methods

Timeline of NHS reorganisation

A timeline of NHS reorganisations between 1948 and 2012 was produced using Gorsky’s review of NHS historiography.7

Mortality and population data collection

Routinely published mortality data and mid-year population estimates for England and Wales, from the Office for National Statistics,8 were used to calculate directly age-standardised mortality rates (Appendix 1) using the European Standard Population 19769 as the reference population. Male and female populations were analysed separately, as factors may affect mortality in the two genders differently.

Data analysis

The data were analysed using the CuSum and Change Point Analysis methods. These Statistical Process Control (SPC) methods are widely used in industry and more recently in healthcare10 for quality review and assurance.

In view of the known steady secular improvement in 20th century UK mortality,11 that predates the NHS, the methods were adapted by adopting the least squares regression line as the putative central indicator. Using the deviations from this regression line as the input to both the CuSum12 and Change-Point Analysis (CPA) sustained changes in the trend of mortality rates are highlighted indicating a sustained change occurring in the effectiveness of the NHS.

The CuSum technique (plotting the cumulative sum by subtracting the mean of all the data from each data point and cumulating these differences13) highlights sustained changes in the data mean (Appendix 2). In this case we plotted the cumulating deviations from the regression line. When the gradient of a CuSum plot shifts for a sustained period of time, this indicates there has been a sustained change in the average mortality rate decline. Since centrally driven changes happen over a short period of time, the change in expected mortality should have been relatively brisk.

CPA methods develop the utility of CuSum methods to detect small changes of both mean and variance by estimating the probability of the occurrence of a sustained change. Taylor’s method14 is novel, using a combination of CuSum plotting and bootstrap methods. While not commonly applied in the medical field, it is used by the Centers for Disease Control and Prevention (CDC) in their BioSense programme, a system designed for early detection of symptoms caused by bioterrorism.15 A total of 10,000 bootstrap samples are generated by random reordering of the original data. The CuSum of each bootstrap is calculated. If no change has occurred, the bootstrap CuSums mimic the original CuSum. However, if the magnitude of change occurring in the bootstrap samples is less than the original CuSum, it can be said that a change has occurred.13 For this study, Change-Point Analyzer Software was used.16

Results

A timeline of NHS reform and reorganisation

Figure 1 shows the timings of the major policy changes and reforms of the NHS between 1948 and 2012. The bar along the bottom shows how the political party in power changes at each point in time as an indication of the prevailing political view.

Figure 1.

Figure 1.

A timeline of NHS reform and reorganisation, 1948–2012. (Derived from Gorsky6.)

Analysis of female mortality

The plot of age-standardised mortality rates against year for the female population is shown in Figure 2. As expected, the age-standardised mortality data appeared to follow a constant downward trend, thus a single linear regression line fitted the data well.

Figure 2.

Figure 2.

Female age-standardised all-cause mortality rates, England and Wales 1948–2012.

Visual review of the CuSum (Figure 3) shows no sustained change from the general trend, though a wave-like variation with a periodicity of about 35 to 40 years is suggested.

Figure 3.

Figure 3.

Female age-standardised all-cause mortality CuSum, England and Wales 1948–2012.

Change point analysis confirmed, at a 95% confidence level, that no sustained change in the rate of female mortality decline could be detected. After 10,000 bootstraps, no significant change was detected in either variability around the regression line or deviation from the regression line of age-standardised mortality rates.

Analysis of male mortality

The single uniform secular improvement assumption was invalid for male mortality. Linear regression was therefore applied to two subsections of the male mortality data, as shown in Figure 4. An initial regression line was fitted to the first 21 data points, 1948–1968, to set an expected level of mortality. The deviations from this regression were calculated for the full set of data, 1948–2012 (Figure 5).

Figure 4.

Figure 4.

Male age-standardised all-cause mortality rates, England and Wales 1948–2012. Linear regression applied to subsections.

Figure 5.

Figure 5.

Male age-standardised all-cause mortality CuSum, England and Wales 1948–2012. (Regression Base 1948–1968.)

Visual review of the CuSum plot indicated that a change in the trend occurred early in the 1970s. In addition, the chart suggested that the decline was sustained from the 1980s onwards. It was therefore assumed that a change happened in the mid-1970s, and was established by 1976. A second regression line was fitted, this time to the final 21 points in the 20th century, 1980–2000. Using this regression equation, the mean deviation from this regression line was calculated and this was then used to plot the CuSum from after this reset point forward, 1976–2012 (Figure 6).

Figure 6.

Figure 6.

Male age-standardised all-cause mortality CuSum, England and Wales 1976–2012. (Regression Base 1980–2000.)

Taylor’s CPA indicates, at a 95% confidence level, that there was no significant sustained change in both rate of decline and variability in male mortality between 1948 and the mid-1970s. However, after 1977 the change in rate of decline is so extreme that the CuSum ‘runs off the chart’ due to a shift in the mean rate of improvement.13 The CuSum requires resetting from 1976. The second analysis, for the time period 1976 to 2012, shows no significant deviation from the regression line, at a 95% confidence level, until 2000 when an improvement occurred. This improvement suggests the Mean ASMR had been lowered by around 19.9 male deaths/100,000 per annum, with a 99% confidence. The data is tabulated in Tables 1 to 3 after Appendix 2.

Summary

These analyses show no sustained change in female mortality decline since 1948, suggesting that NHS reorganisation failed to improve female mortality over that which can be attributed to both general health measures and continuing improvements in healthcare. However, male mortality decline underwent a sustained improvement during a short period in the mid-1970s and again in the new millennium which was sustained until 2012. This suggests that in the early 1970s something changed which improved male health, but had no impact on female health. Similar arguments apply to the changes observed in 2000.

Discussion

The National Health Service Reorganisation Act 1973,17 effective from 1 April 1974, was the first major reorganisation of the NHS since its beginning, designed to improve efficiency and effectiveness. Prior to 1974, the NHS was based on a tripartite system, divided into three separate areas comprising hospital care, primary care and community services. The 1973 Act abolished the tripartite system; instead all health services came under the control of district health authorities and local family practitioner committees. So the link in time might indicate a causal effect. However, the major effect of the 1974 reorganisation was to bring maternity and childcare into the NHS. Thus it is unlikely to have had an effect on male mortality alone, since services affected were predominantly aimed at women and children. Are changes in society outside the NHS more likely explanations for the improved reduction in male mortality?

Likely candidates include the Health and Safety at Work Act 1974.18 This act aimed to improve safety and working conditions particularly among heavy industrial occupations such as mining, fishing, manufacturing and construction; the types of work with the highest fatal accident levels and which employed a predominantly male workforce. The Health and Safety Executive19 report an 82% reduction in fatal injuries to employees in the workplace since 1974. The timing of the Act is strongly associated with the change found in this investigation. Hence the Health and Safety at Work Act could plausibly account for some of the sustained improvement in male mortality seen since the mid-1970s.

In addition, the UK entered a period of economic and industrial decline in the early 1970s. This was accompanied by a growth in the service sector. The reduction in the heavy industrial sector employment20 is likely to have been coupled with a reduction in fatal injuries in the workplace and the adverse health effects of heavy industry on employees.

The 1970s also saw a rapidly changing attitude towards cigarette smoking: an increase in anti-smoking campaigns, a variety of bans on cigarette advertising, widespread public education about the health effects of smoking via television documentaries and health warnings on cigarette packs.21

It is probable that all these changes (the Health and Safety at Work Act, the change in the industrial landscape and the attitude towards cigarette smoking) combined to affect the changes seen in the male mortality trend, as they impacted on men more than women.

As well as considering periods of change in mortality trends, periods of no change are equally informative and should be addressed. The NHS entered a long period of continual reformation and restructuring from 1974 onwards. The Griffiths report in 198322 which introduced general management into the NHS, and the 1989 market reforms, are two major changes that were intended to better services and to benefit population health. However, analysis of mortality for this period, 1976 to 2012, showed no significant deviations from the long-term trend for women. For the male population there was a sudden and sustained improvement in the mortality trend in 2000 when an increase in healthcare funding was made available, but no reorganisation. The data demonstrate that no improvement in mortality reduction has arisen from this lengthy period of reform. This is strong evidence that the belief that management reform improves health service delivery and population health is false.

Strengths of the study

Mortality is a hard epidemiological endpoint which is easy to measure, and is a universally accepted marker of health in the population. As the ONS – a respected independent source with a long record of providing reliable population statistics for England and Wales – publishes the data used in this study, it is unlikely that these data were biased.

The analytical tools used in this study, while unusual in the healthcare domain, are widely accepted in industrial practice, where they are found to be both useful and reliable. The changes in outcome measures are taken as a measure of the quality of the health-care process. In this case by assuming the health system aims to create a steady improvement in mortality, any change in the organisation of the system that alters this rate would be detectable by changes in outcome. So it is reasonable to apply these methods in the current context.

This method should detect a sustained change of about half a standard deviation in the standardised mortality rate, about 12 deaths per 100,000 annually or an improvement in outcome of about 0.5%. Since outcome improvements of greater than 10% are currently being sought, the change detectable by our methods must be considered trivial by policy makers.

The study data start with the foundation of the NHS. Thus it only considers all-cause mortality since the NHS as a comprehensive health system has been in place. Extending the study to earlier years (including two world wars with the population being blockaded as a tactic as well as direct attacks on civilians), would have weakened the focus of the study.

Weaknesses of the study

The method for age-standardising mortality rates, though widely accepted, uses the mid-year population estimates as a marker for the population at risk. However, mortality is measured at the end of each calendar year, thus producing an endpoint difference between the estimation of population and mortality. Despite this, the daily variation in mortality for England and Wales is small in comparison with the overall population. Age-standardising is therefore unlikely to produce biased rates.

Relationship and context to current literature

Remarkably little research has been conducted into the health effects of NHS reform. The National Health Service Reorganisation Act 1973 was criticised for its addition of multiple tiers of administrative decision-making23 and the increased administrative costs that resulted. However, its effect on the health of patients appears not to have been addressed.

The literature surrounding NHS general management is predominantly focused on either the cost of implementing management,23 or issues surrounding the efficient functioning of the managerial system.24 The Griffiths report22 recognised the need for more stringent monitoring of health outcomes. Despite this, the relationship between management and health has not been studied in great depth.

The essential aims of the 1990 market reforms were to decrease costs and increase quality. While quality of care and efficiency have been examined in the literature,25 the impact of the market reforms on health is under-researched. This is in part due to the failure of the government to set in place official monitoring systems.26

Implications for policy and practice

A common theme each time reform is implemented is the absence of systems to monitor its progress and effectiveness. Governments are reluctant to set in place such provisions. Kenneth Clarke, when Secretary of State for Health, ‘denied the need for formal monitoring and evaluation and expressed the view that calling on the advice of academics in this way was a sign of weakness’.27 The recent Health and Social Care Act also fails to acknowledge the need for such evaluation. As the NHS enters a new period of reorganisation, it would seem sensible to implement evaluative systems alongside the changes. In this way, the impact of the changes would be clarified.

As reorganisation involves multiple changes across a large range of NHS sectors, and can be measured using a variety of different variables, the net effect is difficult to measure.26 The director of policy at The King’s Fund states that ‘any research evaluation will have to be flexible and iterative tracking the reform process in real time in a variety of different contexts’.28 The current study uses SPC methods to investigate the effect of historical reorganisations on population mortality. SPC methods are both flexible and, as this study demonstrates, are more usually used to highlight changes in real time. So this study proffers one possible approach for monitoring the effects of the current changes.

Conclusion

This study provides strong evidence that all the changes made to NHS management and structure, between 1948 and 2012, have had no sustained effect on mortality. This indicates that major NHS reorganisations have minimal impact on male or female population health. However, major increases in funding, while not having much impact on female health, appears to improve male outcomes.

Since the increased expenditure associated with each reform has not improved outcomes, the efficiency of the service must have reduced with each. Therefore, politically led management changes to the NHS seems to be a wasteful ineffective practice.

Appendix 1. Method used for the calculation of age-standardised mortality rates29

Rate=iwiriiwi×100,000   (expressedper100,000population) (1)

where Wi is the number, or proportion, of individuals in the standard population in age group i.

ri is the crude age-specific rate in the subject population in age group i, given by

ri=Oini (2)

where Oi is the observed number of events in the subject population in age group i.

ni is the number of individuals in the subject population in age group i.

Appendix 2. The CuSum technique

The following equation (Kass-Hout et al.15) expresses the CuSum technique, where Si is the cumulative sum, Xi is the current data point, and X¯ is the mean. The first point is set at 0, ie. s0=0

si=si-1+(Xi-X¯) (3)

For i=1,,N.

The cumulative sum was calculated by taking the differences between the deviation from the regression line and the overall mean deviation at each point, and then cumulatively summing these values.

Table 1.

Females: 1948–2012.

Year Age-standardised mortality rate Fitted least squares regression estimate Deviation from regression
1948 1011.9 1063.917 −52.0
1949 1102.5 1054.261 48.2
1950 1080.5 1044.605 35.9
1951 1151.8 1034.949 116.8
1952 1007.9 1025.293 −17.4
1953 1010.4 1015.637 −5.2
1954 976.3 1005.981 −29.7
1955 999.2 996.3245 2.9
1956 984.7 986.6684 −2.0
1957 938.8 977.0123 −38.2
1958 954.0 967.3562 −13.3
1959 944.8 957.7001 −12.9
1960 916.6 948.044 −31.4
1961 947.4 938.3879 9.0
1962 938.2 928.7318 9.5
1963 951.7 919.0757 32.6
1964 864.5 909.4196 −44.9
1965 869.6 899.7635 −30.2
1966 882.5 890.1074 −7.7
1967 836.4 880.4513 −44.0
1968 881.5 870.7952 10.7
1969 866.8 861.1391 5.6
1970 852.0 851.483 0.5
1971 818.9 841.8269 −22.9
1972 843.6 832.1708 11.5
1973 831.5 822.5147 9.0
1974 820.9 812.8586 8.0
1975 806.4 803.2025 3.2
1976 821.6 793.5464 28.0
1977 780.5 783.8903 −3.4
1978 783.3 774.2342 9.0
1979 784.9 764.5781 20.3
1980 757.1 754.922 2.1
1981 742.4 745.2659 −2.9
1982 738.8 735.6098 3.2
1983 725.1 725.9537 −0.8
1984 702.0 716.2976 −14.3
1985 719.1 706.6415 12.4
1986 697.4 696.9854 0.5
1987 676.5 687.3293 −10.8
1988 674.5 677.6732 −3.2
1989 673.9 668.0171 5.8
1990 648.7 658.361 −9.7
1991 647.1 648.7049 −1.6
1992 627.3 639.0488 −11.7
1993 642.8 629.3927 13.4
1994 610.1 619.7366 −9.7
1995 616.9 610.0805 6.8
1996 610.4 600.4244 10.0
1997 603.0 590.7683 12.2
1998 592.8 581.1122 11.7
1999 590.4 571.4561 18.9
2000 567.9 561.8 6.1
2001 551.40 552.1439 −0.7
2002 549.24 542.4878 6.7
2003 553.74 532.8317 20.9
2004 523.61 523.1756 0.4
2005 515.32 513.5195 1.8
2006 495.54 503.8634 −8.3
2007 489.26 494.2073 −4.9
2008 487.52 484.5512 3.0
2009 460.73 474.8951 −14.2
2010 456.78 465.239 −8.5
2011 441.65 455.5829 −13.9
2012 446.95 445.9268 1.0

Table 2.

Males: 1948–2012, with 1948–1968 regression base.

Year Age-standardised mortality rate Fitted least squares regression estimate (1948–1968 base) Deviation from regression
1948 1410.0 1521.381 −111.3
1949 1523.0 1516.543 6.4
1950 1512.4 1511.705 0.7
1951 1675.1 1506.867 168.3
1952 1503.2 1502.029 1.1
1953 1495.0 1497.191 −2.1
1954 1470.7 1492.353 −21.6
1955 1499.3 1487.515 11.8
1956 1489.0 1482.676 6.3
1957 1440.0 1477.838 −37.8
1958 1461.8 1473 −11.2
1959 1444.8 1468.162 −23.3
1960 1415.9 1463.324 −47.4
1961 1475.0 1458.486 16.5
1962 1481.0 1453.648 27.3
1963 1511.7 1448.81 62.8
1964 1385.0 1443.972 −59.0
1965 1405.3 1439.134 −33.8
1966 1439.8 1434.295 5.5
1967 1357.3 1429.457 −72.2
1968 1435.2 1424.619 10.6
1969 1422.5 1419.781 2.7
1970 1395.7 1414.943 −19.3
1971 1346.7 1410.105 −63.4
1972 1392.5 1405.267 −12.8
1973 1365.5 1400.429 −34.9
1974 1349.5 1395.591 −46.1
1975 1329.3 1390.753 −61.5
1976 1345.2 1385.914 −40.7
1977 1281.6 1381.076 −99.5
1978 1292.7 1376.238 −83.5
1979 1290.1 1371.4 −81.3
1980 1241.7 1366.562 −124.8
1981 1218.9 1361.724 −142.8
1982 1209.4 1356.886 −147.5
1983 1192.8 1352.048 −159.3
1984 1148.8 1347.21 −198.4
1985 1169.9 1342.372 −172.4
1986 1137.0 1337.533 −200.6
1987 1089.5 1332.695 −243.2
1988 1081.0 1327.857 −246.9
1989 1070.9 1323.019 −252.1
1990 1040.7 1318.181 −277.5
1991 1029.1 1313.343 −284.2
1992 993.7 1308.505 −314.8
1993 1009.2 1303.667 −294.5
1994 955.1 1298.829 −343.7
1995 959.9 1293.991 −334.1
1996 939.2 1289.152 −349.9
1997 915.1 1284.314 −369.2
1998 896.8 1279.476 −382.7
1999 882.5 1274.638 −392.2
2000 847.6 1269.8 −422.2
2001 816.7 1264.962 −448.3
2002 807.0 1260.124 −453.1
2003 797.8 1255.286 −457.5
2004 755.7 1250.448 −494.8
2005 735.1 1245.61 −510.5
2006 710.6 1240.771 −530.2
2007 693.9 1235.933 −542.0
2008 684.9 1231.095 −546.2
2009 657.3 1226.257 −568.9
2010 641.6 1221.419 −579.8
2011 618.1 1216.581 −598.5
2012 614.0 1211.743 −597.7

Table 3.

Males: 1976–2012, with 1980–2000 regression base.

Year Age-standardised mortality rate Fitted least squares regression estimate (1980–2000 base) Deviation from regression
1976 1345.2 1319.592 25.6
1977 1281.6 1300.234 −18.6
1978 1292.7 1280.876 11.8
1979 1290.1 1261.518 28.6
1980 1241.7 1242.16 −0.4
1981 1218.9 1222.802 −3.9
1982 1209.4 1203.444 5.9
1983 1192.8 1184.086 8.7
1984 1148.8 1164.728 −15.9
1985 1169.9 1145.37 24.6
1986 1137.0 1126.012 11.0
1987 1089.5 1106.654 −17.2
1988 1081.0 1087.296 −6.3
1989 1070.9 1067.938 3.0
1990 1040.7 1048.58 −7.9
1991 1029.1 1029.222 −0.1
1992 993.7 1009.864 −16.2
1993 1009.2 990.506 18.7
1994 955.1 971.148 −16.0
1995 959.9 951.79 8.1
1996 939.2 932.432 6.8
1997 915.1 913.074 2.0
1998 896.8 893.716 3.1
1999 882.5 874.358 8.1
2000 847.6 855 −7.4
2001 816.7 835.642 −18.9
2002 807.0 816.284 −9.3
2003 797.8 796.926 0.9
2004 755.7 777.568 −21.9
2005 735.1 758.21 −23.1
2006 710.6 738.852 −28.2
2007 693.9 719.494 −25.6
2008 684.9 700.136 −15.3
2009 657.3 680.778 −23.4
2010 641.6 661.42 −19.8
2011 618.1 642.062 −23.9
2012 614.0 622.704 −8.7

Declarations

Competing interests

None declared

Funding

None declared

Ethical approval

NHS Research Ethics Committee approval was not required as: 1. The data was from publicly available data, collected under statutory provision. 2. No patient specific data was required, sought or obtained. 3. No individual would receive an alteration to their treatment as a result. 4. Evaluating the effectiveness of Health Services is a core duty of public health physicians.

Guarantor

JMFT

Contributorship

ASL obtained the data from published sources, undertook the analysis under JMFT’s supervision while a medical student and drafted the manuscript.

JMFT conceived the idea, supervised and helped refine the analysis as part of ASL’s intercalated degree project. He subsequently edited and modified the manuscript in response to the reviewer’s comments.

Acknowledgement

We thank the reviewer for the helpful suggestion to extend the years included in the study, which revealed the unexpected change in male mortality trends post 2000.

Provenance

Not commissioned; peer-reviewed by Julie Vile.

References


Articles from Journal of the Royal Society of Medicine are provided here courtesy of Royal Society of Medicine Press

RESOURCES