Abstract
The aim of this study was to validate a newly developed tool for predicting the risk of recurrence within 12 months of a venous leg ulcer healing. Performance of the tool to predict recurrence within a 12‐month period was assessed using Area Under the Receiver Operating Characteristic Curve (AUC) analysis. Multi‐site retrospective and prospective longitudinal studies were undertaken to validate a risk assessment tool for the recurrence of venous leg ulcers within 12 months. In the retrospective study (n = 250), 55% of venous leg ulcers recurred within 12 months, and the risk assessment total score had excellent discrimination and goodness of fit with an AUC of 0.83 (95% CI, 0.76‐0.90, P < .001). The prospective study (n = 143) observed that 50.4% (n = 63) of venous leg ulcers recurred within 12 months of healing. Participants were classified using the risk assessment tool as being at low risk (28%), moderate risk (59%), and high risk (13%); the proportion of wounds recurring at 12 months was 15%, 61%, and 67% for each group, respectively. Validation results indicated good discrimination and goodness of fit, with an AUC of 0.73 (95% CI, 0.64‐0.82, P < .001). Validation of this risk assessment tool for the recurrence of venous leg ulcers provides clinicians with a resource to identify high‐risk patients and to guide decisions on adjunctive, tailored interventions to address the specific risk factors to decrease the risk of recurrence.
Keywords: recurrence, risk assessment, validation, venous leg ulcers
1. INTRODUCTION
Chronic leg ulcers pose a considerable personal and financial burden for both patients and carers.1, 2 Venous aetiology is the primary underlying factor in 70% of all chronic leg ulcers,3 and 60‐70% of these ulcers are reported to recur after healing.3, 4 The highest rates of recurrence are within the first 3 months after healing,5, 6 while the majority recur within 12 months,3, 4 a pattern of events often sustained over decades.7 A total of 28% of patients will experience more than 10 episodes of venous leg ulceration in their lifetimes.8
Previously identified risk factors for recurrence predominantly relate to the severity of the underlying venous disease, that is, history of deep vein thrombosis,3, 4, 9, 10 lipodermatosclerosis,11 deep vein insufficiency,4, 12, 13, 14 larger ulcer size,10, 15, 16 number of previous ulcerations,9, 11 and longer ulcer duration.11, 12, 13, 17 Comorbidities such as rheumatoid arthritis, diabetes, cardiac disease, or low body mass index (BMI) were associated with higher recurrence rates in a smaller number of studies.6, 7, 18, 19 There is conflicting evidence on poor mobility as a risk factor for recurrence. A large study by Barwell et al.18 found no association between patient mobility scores and either healing or recurrence. However, patient mobility and/or restricted ankle movement were significantly related to recurrence rates in more recent studies by Sinabulya et al.,20 Brooks et al.,21 Vowden and Vowden,15 and Nelson et al..11 Although few sociodemographic risk factors have been reported, male gender was associated with higher recurrence rates in 2 smaller studies.12, 22
Due to the chronic nature of the venous disease that underpins venous leg ulceration, ongoing monitoring is essential after healing.23 The primary evidence‐based recommended prevention strategy is compression therapy.24 A systematic review concluded that use of compression hosiery lowered recurrence rates compared with no compression, and 1 study found that high‐level compression hosiery lowered recurrence rates compared with moderate level hosiery, although adherence to high‐level compression was low.25 Another strategy is surgery—episodes of recurrence have reduced in patients who undergo surgery for superficial venous reflux and/or perforator surgery in addition to wearing compression.26, 27, 28 However, surgery is not always an option for all patients, particularly in this population where patient age and comorbidities frequently restrict suitability for surgery. Leg elevation is often recommended as a logical way to assist venous return, although only a few studies of low‐level evidence have found an association with reduced recurrence rates.6, 21, 22 For people with a history of multiple venous leg ulcers, the long‐term nature of these ulcers and the habitual recurrence leads to uncertainty,29 disappointment, hopelessness, and worry that they may never be free of the condition.30
Given existing demands on already stretched health care resources, a conscientious yet effective use of resources to prevent venous leg ulcer recurrences is required. The field of wound management presently lacks a validated means to identify those individuals at the greatest risk of recurrence. At present, clinicians utilise their own expert judgement and previous experience in relation to whether they consider a patient's ulcer likely to recur or not. A review of the literature has not identified any screening tools to assist clinicians to detect patients at high risk of recurrence after healing in order to guide appropriate prevention strategies. Yet, not only would the quality of life of patients be optimised by reducing venous leg ulcer recurrences but estimates of 8% of cost savings to community nursing time would be achieved for every 1 month that the healed state was maintained.31
A risk assessment tool has been developed to identify the risk of recurrence of venous leg ulcers within 12 months of healing.32 The tool items were based on data analysis from longitudinal studies of patients with venous leg ulcers, evidence in the literature, and advice from an expert wound advisory group.32 The items included a history of previous leg ulcers, DVT, ulcer duration, a low BMI, whether the patient lived alone, level of activity, leg elevation, and level and days/week wearing compression.32 Scoring and parameters of each item are described in Parker et al.32
The risk assessment tool is easy to use, includes a small number of items, does not require specialist assessment technology or skills,33 and could be used in time to generate a prediction of risk and guide clinical decision making.34 It is important that a tool uses items that are part of normal routine patient follow up and useful for all wound care health professionals. Previous reliability testing of the tool indicated high clinical relevance with the majority of ICC indices rated high (0.7 to 0.9) when compared between 3 raters (P < .05).32 Given these encouraging results, the validation of the recurrence risk assessment tool in venous leg ulcers was necessary to establish the tool's credentials for use in clinical care.
2. METHODS
2.1. Design
Two studies were undertaken to test validity: (1) a retrospective validation study and (2) a prospective longitudinal validation study to determine how accurately the risk assessment tool could identify patients at high risk of developing a venous leg ulcer recurrence within 12 months of healing.
2.2. Study 1
2.2.1. Participants
The dataset used for retrospective validation was a combined database from 3 previous longitudinal studies that followed patients who had a newly healed venous leg ulcer between 2006 and 2011 and had previously been described by the authors.9 The aim of the contributing studies was to identify factors associated with leg ulcer recurrence, and participants were recruited from community and hospital outpatient wound clinics. Inclusion criteria were patients with a recently healed leg ulcer of primarily venous aetiology, ABPI between 0.8 and 1.2, and those who had cognitive capacity to provide consent.9 Further details are available in Finlayson et al.9
2.2.2. Procedure and data measures
All participants in the contributing studies received a patient information and consent package, and written consent was obtained. Ethical approval for the secondary analysis of data was obtained.
Recurrence of a venous leg ulcer was defined as a wound that had achieved 100% epithelialisation, maintained for 2 weeks (ie, healed), and that had recurred on the same leg of the recently healed venous leg ulcer and was diagnosed as predominantly venous in aetiology by the clinician in charge of care. Data collected for the contributing studies included demographic, general health, mobility, medical history, venous history, previous ulcer characteristics, treatments, preventive strategies, and psychosocial variables. These included data on all items forming the newly developed risk assessment tool, described in Parker et al.,32 that is,
History of previous leg ulcers in this leg
History of deep vein thrombosis in study ulcer leg
Previous ulcer duration (weeks)
BMI < 22
Whether the client lived alone
Preventive activities included:
Moving around on feet for at least 3 hours/day (ie, walking, doing housework, shopping)
Elevating legs for 30 minutes/day or more (above level of the heart)
Wearing compression hosiery of Class 2 or above (ie, 20 mmHg or higher) for at least 5 days/week
Using these measures collected at the time of healing (ie, enrolment in the recurrence studies), the risk assessment tool sub‐category scores (health/social history and preventive activities) were calculated and summed to produce an overall risk assessment score ranging from 0 to 16, with 0 = low risk and 16 = highest risk. Risk of wound recurrence of participants was categorised into 3 equal groups according to the range of possible scores (ie, low risk: < 6, moderate risk: 6‐10, and high risk: ≥11). Follow‐up data on recurrence status were collected in the previous studies every 3 months for 12 months during clinic visits, home nursing visits, postal surveys, or via telephone. The 12‐month recurrence data were used to validate the risk assessment tool.
2.2.3. Analysis
Data were analysed with the IBM SPSS Statistics for Windows (Version 21.0) software. A P value of below .05 was used for statistical significance. Risk assessment tool performance was evaluated in terms of discrimination (Area Under the Receiver Operating Characteristic [ROC] curve (AUC) and calibration (Hosmer‐Lemeshow statistic)). The AUC value has been widely used and is a fundamental tool for diagnostic test evaluation, indicating the overall discriminative ability of a model.35 The AUC is a good measure of how well a parameter can distinguish between 2 groups36 (eg, those venous leg ulcers that recurred and those that did not recur by 12 months). Values range between 1.0 (perfect assessment of whether the venous leg ulcer will recur or not) and 0.5 (no indication as to whether the venous leg ulcer will recur or not). Thus, the nearer the AUC to 1, the better the risk assessment score is in its ability to detect whether a venous leg ulcer will recur within 12 months. The Hosmer‐Lemeshow Goodness of Fit Test is widely used for the evaluation of risk‐scoring models in medicine, developed using a wide range of sample sizes,37 to test whether the predicted probabilities agree with the observed probabilities.38 The Hosmer‐Lemeshow Goodness of Fit Test indicates a poor fit if the significance level is less than 0.05; so, to support a model, a significance value of larger than 0.05 is required.39
2.3. Study 2
2.3.1. Procedure
All patients receiving wound care from 10 hospital outpatient clinics, community clinics, or domiciliary care sites across 2 states of Australia were approached to participate in this study if they had a newly healed venous leg ulcer (within 4 weeks of healing). These were sites similar to those in the retrospective study, with the inclusion of domiciliary sites. All participants received a patient information and consent package in relation to the study, written consent was obtained, and participants were assured that they could withdraw from the study at any time.
2.3.2. Participants
Sample size calculations indicated that a total of 195 participants were required for AUC curve analysis based on the following parameters: 195 patients (to obtain 55 positive cases and 55 negative cases): 90% power, 95% significance level, and an expected 40% recurrence rate; null hypothesis of AUC 0.5; alternative hypothesis of AUC 0.75; and allowing for 30% dropout.
Inclusion Criteria:
Participants with a healed leg ulcer of primarily venous aetiology as diagnosed by the clinician in charge of care
Participants with an Ankle Brachial Pressure Index ≥0 .8 and <1.3
Exclusion Criteria:
Participants whose recent leg ulcer was of non‐venous aetiology (eg, arterial, diabetic) as diagnosed by the clinician in charge of care
Participants with a cognitive impairment
2.3.3. Data collection and measures
Recurrence of a venous leg ulcer was defined as a wound that had achieved 100% epithelialisation maintained for 2 weeks and that had recurred on the same leg as the recently healed venous leg ulcer and was diagnosed as predominantly venous in aetiology by the clinician in charge of care. Data collected were guided by the initial development of the risk assessment tool for recurrence in venous leg ulcers.32
Data collected at baseline (at time of healing) for the risk assessment tool included:
Health, medical, and social history:
History of previous leg ulcers in this leg
History of deep vein thrombosis in study ulcer leg
Previous ulcer duration (weeks)
BMI < 22
Client lived alone
Preventive activities:
Moving around on feet for at least 3 hours/day (ie, walking, doing housework, shopping)
Elevating legs for 30 minutes/day or more (above level of the heart)
Wearing compression hosiery of Class 2 or above (ie, 20 mmHg or higher) for at least 5 days/week
These variables were collected by Registered Nurses with expertise and current wound care experience. The risk assessment tool's sub‐category scores (health/social history and preventive activities) were calculated from data collected at enrolment to the study (ie, at the time of healing) and summed to produce an overall risk assessment score ranging from 0 to 16, with 0 = low risk and 16 = highest risk. Follow‐up data were collected every 3 months for 12 months on clinical variables and recurrence status during follow‐up clinic visits or home nursing visits. The 12‐month recurrence data were used to validate the risk assessment tool. Risk of wound recurrence of participants was grouped into 3 equal groups according to the range of possible scores (ie, low risk: < 6, moderate risk: 6‐10, and high risk: ≥11).
2.3.4. Analysis
Data were analysed with IBM SPSS Statistics for Windows (Version 21.0) software using the same parameters as reported above. Area Under the Receiver Operating Characteristic (ROC) curve (AUC) and calibration (Hosmer‐Lemeshow statistic) tests were utilised to evaluate the validity of the risk assessment tool.
3. ETHICAL CONSIDERATIONS
Ethical approval for these studies was obtained through the Human Research Ethics Committees of the institutions involved. All participants received a patient information and consent package, and written consent was obtained. Participants were assured that they could withdraw from the study at any time. If participants experienced physical pain or psychological distress at any point in the study process, the collection of data was ceased.
4. RESULTS
4.1. Study 1
4.1.1. Participant characteristics
The sample for retrospective analysis consisted of 250 participants; 55% (n = 98) of venous leg ulcers recurred within 12 months, while 45% (n = 81) did not. Full risk assessment tool data were only available on 156 participants due to differences in collection of data in the studies involved (ie, 1 of the 3 studies did not collect BMI or previous ulceration data), thus, 156 were included in the analysis. The model had excellent discrimination and goodness of fit in predicting recurrence of venous leg ulcers with an AUC of 0.83 (95% CI, 0.76 to –0.90, P < .001) for the total risk assessment score. Thus, the model correctly discriminated between ulcers that did not recur compared with those that did within 12 months, 83% of the time. The AUC results can be found in Table 1 and Figure 1.
Table 1.
Recurrent venous leg ulcers within 12 months
| AUC | SE | P | 95% CI | |
|---|---|---|---|---|
| Health, medical, and social history | 0.674 | 0.044 | <.001 | 0.589‐0.760 |
| Clinical examination | 0.795 | 0.036 | <.001 | 0.723‐0.866 |
| Total score | 0.826 | 0.035 | <.001 | 0.758‐0.895 |
AUC Results of retrospective analysis of subscales and total risk assessment score (n = 156).
Figure 1.

Retrospective analysis: ROC Curve for subscales and total risk assessment score
Participants were grouped according to the total risk assessment score into 3 equal groups: low risk: < 6; moderate risk: 6 to 10; and high risk: ≥11 (Table 2), and scores indicated that the higher the score, the more likely a venous leg ulcer was to recur. At enrolment to the study (at the time of healing), 19% (n = 30) of participants were at low risk of recurrence, and of this group, 16.7% (5/30) subsequently experienced an ulcer recurrence in the following 12 months. Of the participants who were at moderate risk of recurrence (46%, n = 72) on healing, 54.2% (39/72) experienced a recurrence in the following 12 months. Of the participants who were at high risk of recurrence at the time of healing (35%, n = 54), 85.2% (46/54) subsequently had an ulcer recurrence in the following 12 months (Figure 2). The Hosmer‐Lemeshow Goodness of Fit Test showed the total risk assessment tool score to be acceptable, χ 2(7) = 6.29, P = . 51.
Table 2.
Recurrence within 12 months of venous leg ulcers by total risk assessment score: Retrospective validation sample (n = 156)
| Total risk assessment score | n, % not recurred | n, % recurred |
|---|---|---|
| <6 (low risk) | 25 (83.3%) | 5 (16.7%) |
| 6‐10 (moderate risk) | 33 (45.8%) | 39 (54.2%) |
| ≥ 11 (high risk) | 8 (14.8%) | 46 (85.2%) |
Figure 2.

Prospective validation Sample—AUC Results for the sub‐scores and total risk assessment score
4.2. Study 2
4.2.1. Participant characteristics
The prospective study recruited 143 participants between June 2012 and July 2015. Data on number of eligible patients and response rates were not available from 2 of the 10 sites due to limited resources. However, at the remaining 8 sites, 178 patients who fitted the inclusion criteria were treated with a venous leg ulcer, which healed during the study recruitment period. Of these, 129 (72%) consented to participate and were enrolled in the study. The participants had a mean age of 72.66 years (SD 13.59). There was an equal representation of males (51%) and females (49%). Other demographic, ulcer, and treatment characteristics of participants are shown in Table 3, and preventative activities are shown in Table 4. A total of 50% (n = 63) of participants experienced a venous leg ulcer recurrence within 12 months of healing. Rates of recurrence over the 12 months for both the retrospective and prospective studies are shown in Figure 3.
Table 3.
General demographic and Health Descriptive Variables (Prospective Study: n = 143)
| Demographic and health information | n (%) | |
|---|---|---|
| Age (Mean ± SD) | 72.66 ± 13.59 | |
| BMI (Mean ± SD) | 32.39 ± 10.14 | |
| aBMI <22 | 16 (11%) | |
| Wound duration of recently healed ulcer (weeks) [Median [Range]) | 23.5 (1–182) | |
| aWound duration ≥52 weeks | 29 (20%) | |
| Gender | Female | 73 (51%) |
| Male | 70 (49%) | |
| Income | Age Pension | 84 (59.2%) |
| Current unemployed | 19 (13.4%) | |
| Self‐funded retiree | 13 (9.2%) | |
| Disability pension | 12 (8.5%) | |
| Dept of Veterans Affairs pension | 11 (7.7%) | |
| Unemployment benefit | 3 (2.1%) | |
| a Social functioning | Live alone | 63 (44.1%) |
| Comorbidities | Hypertension | 94 (65.7%) |
| Osteoarthritis | 79 (55.6%) | |
| Heart disease | 65 (45.5%) | |
| Chronic pulmonary disease | 33 (23.2%) | |
| Diabetes | 31 (21.7%) | |
| Cancer | 23 (16.2%) | |
| CVA | 22 (15.4%) | |
| Hypercholesterolemia/Hyperlipidaemia | 21 (14.8%) | |
| Autoimmune disease | 16 (11.3%) | |
| Rheumatoid arthritis | 12 (8.5%) | |
| Hypothyroidism | 9 (6.3%) | |
| Gout | 6 (4.2%) | |
| >3 medical conditions | 90 (62.9%) | |
| Venous history in study leg | Varicose veins | 102 (73.9%) |
| Surgery or trauma | 63 (45.7%) | |
| Venous surgery | 26 (18.6%) | |
| aDVT | 25 (17.6%) | |
| a>1 previous ulcer | 95 (66.4%) | |
| Other | Walking aid | 67 (47.5%) |
| Smokers | 13 (9.2%) | |
Items that were part of the risk assessment tool.
Table 4.
General preventative activities (prospective study: n = 143)
| aWearing compression hosiery of Class 2 or above for at least 5 days/week | Yes | 89 (65%) |
| No | 48 (35%) | |
| Moisturising | At least once/day | 75 (62.5%) |
| Less than once/day | 45 (37.5%) | |
| aMoving around on feet for at least 3 hours/day | Yes | 85 (60.3%) |
| No | 56 (39.7%) | |
| aElevating legs (above level of heart) for 30 minutes or more/day | Yes | 57 (41%) |
| No | 82 (59%) | |
| Ankle/leg exercises (>10 min) | No | 39 (37.1%) |
| Once or less/week | 4 (3.8%) | |
| 2‐3 times/week | 18 (17.1%) | |
| Nearly every day | 22 (21%) | |
| At least once/day | 22 (21%) |
Items that were part of the risk assessment tool.
Figure 3.

Ulcer recurrence rates over 12 months in retrospective and prospective studies
Of this sample of 143 participants, 26 were lost to follow up due to missing data regarding wound recurrence (5 participants), missing data on 1 or more of the risk assessment tool fields (8 participants), withdrawal (2 participants), or inability to locate patient (11 participants). Therefore, the final analysis consisted of 117 participants.
The risk assessment scores of participants were again grouped into 3 groups: low risk (< 6); moderate risk [6‐10], or high risk (≥11) (Table 5). In this study, at enrolment [upon healing], 28% (n = 33) of participants were at low risk of recurrence, and of this group, 15.2% (5/33) subsequently experienced an ulcer recurrence in the following 12 months. A total of 59% of participants were at moderate risk of recurrence [n = 69] on healing, and of these, 60.9% (42/69) experienced a recurrence in the following 12 months. Of the participants who were at high risk of recurrence at the time of healing (13%, n = 15), 66.7% [10/15] subsequently had an ulcer recurrence in the following 12 months. The model had good discrimination and goodness of fit in predicting the recurrence of venous leg ulcers within 12 months with an AUC of 0.73 (95% CI 0.64‐0.82, P < .001) for the total risk assessment score. The Hosmer‐Lemeshow Goodness of Fit Test also showed the total risk assessment tool score to be an acceptable measure of recurrence within 12 months, χ 2(7) =10.19, P = .18. AUC results for health, medical and social history, clinical examination, and total risk assessment scores can be found in Table 6 and Figure 2.
Table 5.
Recurrence within 12 months of venous leg ulcers by total risk assessment score: Prospective validation sample (n = 117)
| n, % not recurred | n, % recurred | |
|---|---|---|
| < 6 (low risk) | 28 (84.8%) | 5 (15.2%) |
| 6 to 10 (moderate risk) | 27 (39.1%) | 42 (60.9%) |
| ≥ 11 (high risk) | 5 (33.3%) | 10 (66.7%) |
Table 6.
Recurrence venous leg ulcers within 12 months: AUC Results of prospective analysis of subscales and total risk assessment score (n = 117)
| AUC | SE | P | 95% CI | |
|---|---|---|---|---|
| Health, medical, and social history | 0.69 | 0.05 | <.001 | 0.60‐0.79 |
| Preventive activities | 0.62 | 0.05 | .03 | 0.52‐0.72 |
| Total risk assessment score | 0.73 | 0.05 | <.001 | 0.64‐0.82 |
5. DISCUSSION
After healing, the risk of recurrence of venous leg ulcers needs to remain a priority for all health professionals given the chronic nature of the underlying condition and high recurrence rates. The recurrence rates in these 2 studies were slightly lower (50‐55%) compared with those in the literature of 60–70%3, 4 but were still high rates within a 12‐month period after healing. Knowledge of the likelihood of recurrence within the next 12 months could contribute to improved outcomes for patients if it is used to shape communication about self‐management between clinicians and patients. In addition, the tool could inform a customised schedule of patient monitoring during the maintenance phase to ensure the judicious yet effective use of health care resources, for example, patients at high risk may be prioritised for early access to specialist expertise such as vascular physicians or compression therapy specialists. This study provides evidence to support the use of this risk assessment tool across a variety of clinical settings.
Development of this tool was based on evidence in the literature as described above, previous studies by the authors,9, 40, 41 and guidance from an expert panel, as described in Parker et al.32 A risk assessment tool has an advantage over memorising a list of known risk factors by assigning scores appropriate to the strength of known predictors and providing a quick, easy‐to‐use total score indicating the level of risk of future ulcer recurrence of patients at the time of healing.32 The validity of any tool is an essential requirement in ensuring the clinical relevance of that tool. A loss of predictive ability in the prospective validation study, as compared with the validation based on the derivation database (AUC 0.83‐AUC 0.73), was an expected finding,42 occurring in other validation studies of venous leg ulcer risk assessment (for delayed healing) tools.43, 44 When looking at risk classification as low, moderate, or high, the item with the largest change in predictive ability was for those classified as “high risk”, where 85% of patients scoring at high risk at the time of healing then recurred within 12 months in the retrospective study; however, only 67% of those scoring at high risk subsequently recurred in the prospective study. This suggests that the lower boundary of the scores classified as ‘high risk’ (grouped as between 11–16) may need to be raised to 12 and over. However, as this result is only from 1 sample, additional studies in other countries and with different samples are needed to refine the cut‐off scores for risk classification. Despite the drop, an AUC of 0.73 remained a good result. Furthermore, the samples included participants from multiple clinical settings, including home care, specialist private, and public and community domiciliary services, and as such, the tool has strong external validity and generalisability across a range of settings.
Providing a valid and reliable tool for measuring the risk for recurrence of venous leg ulcers will enable clinicians to intervene sooner according to the patient's individual level of risk and assist health professionals in being more confident in recognising the necessity for interventions to prevent venous leg ulcers in patients who have healed. This tool is not resource‐intensive and provides a quick and easy way to identify those at high risk of recurrence of a venous leg ulcer. Questions use plain language with simple responses and can be applied in an inexpensive manner in a variety of clinical settings.
The tool may facilitate decisions with respect to ongoing care of the patient, when to review, or referrals that may be necessary to improve the recurrence rates. For example, following identification of a patient as high‐risk, a plan to address the individual risk factors identified by the tool for that patient could be developed and implemented, including close monitoring of progress. The presence of risk factors indicating more severe venous disease may prompt referral to specialist vascular centres and/or allied health specialists, for example, exercise physiologists for tailored programmes to improve calf muscle exercise and venous return. Patients of low BMI may benefit from referral to a dietician, while those living alone may need referral for additional support services to assist them with treatments or attending health services for follow‐up care. Similarly, high‐risk scores resulting from poor involvement in preventive activities, such as wearing compression, lower limb exercise, and leg elevation, suggest the need for a multidisciplinary approach to long‐term management of chronic venous insufficiency, in addition to innovative models of care that promote patient education, peer support, and self‐management skills. Knowledge of being at higher risk may help increase motivation for adherence to preventive self‐management activities. Widespread use of the tool and sharing of level of risk may also help lower the likelihood of conflicting advice that is often reported by patients as having been received from health professionals.45 Instruments to assess the risk of recurrence of these wounds could help to enhance communication among clinicians by defining a common language and standardising assessment characteristics.46 When paired with adequate instruction, clear documentation, and guidelines for use, such an instrument will enable even a novice wound care health professional to complete an accurate assessment.
5.1. Limitations
The risk factors included were limited to those assessed in the derivation study, literature, and expert opinion. There may be other factors that have not been investigated well, such as ankle range of motion or venous disease characteristics, that may be identified and provide a more reliable scoring system. Recurrence over a period of time longer than 12 months was not assessed.
Although the study did not reach the required sample size of 195 participants, we still achieved a large sample with good results. Conservative figures of 40% recurrence and 30% loss to follow up were used in the pre‐study calculation, while the study actually had an 18% loss to follow up. Calculations undertaken with current software demonstrate that a sample of 106 participants is adequate to provide 90% power,47 indicating both studies had a sufficient sample size.
This study provides evidence to support the use of the risk assessment tool for use in all settings; however, further prospective testing will continue to evaluate individual variables to determine individual variable influence on the final outcome, which could guide future education and lead to lower levels of recurrence in future by targeting specific variables. There are also a high number of participants in the moderate risk groups (retrospective study 46% and prospective study 59%), and further investigation should focus on the groupings.
6. CONCLUSION
This study confirmed that the tool for recurrence, with components of past history of ulceration, living alone, level of activity, leg elevation, and type and amount of compression therapy use, is a valid measure of the risk of recurrence within 12 months after healing of venous leg ulcers.
Venous leg ulcer management and prevention is a priority for all health professionals working in wound care. Early availability of information on the risk of recurrence within 12 months could contribute to improved outcomes for patients and health care systems. This study provides evidence to support the validity of this risk assessment tool in home, community clinic, and hospital outpatient settings.
Finlayson KJ, Parker CN, Miller C, et al. Predicting the likelihood of venous leg ulcer recurrence: The diagnostic accuracy of a newly developed risk assessment tool. Int Wound J. 2018;15:686–694. 10.1111/iwj.12911
Funding information Wound Management Innovation Cooperative Research Centre, Grant/Award number: 3.05
REFERENCES
- 1. Kapp S, Santamaria N. The financial and quality‐of‐life cost to patients living with a chronic wound in the community. Int Wound J. 2017;14:1108‐1119. 10.1111/iwj.12767. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Graves N, Zheng H. Modelling the direct health care costs of chronic wounds in Australia. Wound Pract Res. 2014;22:20‐33. [Google Scholar]
- 3. Abbade LPF, Lastória S. Venous ulcer: epidemiology, physiopathology, diagnosis and treatment. Int J Dermatol. 2005;44:449‐456. [DOI] [PubMed] [Google Scholar]
- 4. McDaniel HB, Marston WA, Farber MA, et al. Recurrence of chronic venous ulcers on the basis of clinical, etiologic, anatomic, and pathophysiologic criteria and air plethysmography. J Vasc Surg. 2002;35:723‐728. [DOI] [PubMed] [Google Scholar]
- 5. Moffatt CJ, Dorman MC. Recurrence of leg ulcers within a community ulcer service. J Wound Care. 1995;4:57‐61. [DOI] [PubMed] [Google Scholar]
- 6. Finlayson K, Edwards H, Courtney M. Factors associated with recurrence of venous leg ulcers. Int J Nurs Stud. 2009;46:1071‐1078. [DOI] [PubMed] [Google Scholar]
- 7. Abbade LPF, Lastoria S, Rollo HA. Venous ulcer: clinical characteristics and risk factors. Int J Dermatol. 2011;50:405‐411. [DOI] [PubMed] [Google Scholar]
- 8. Weller C, Buchbinder R, Johnston R. Interventions for helping people adhere to compression treatments for venous leg ulceration (Review). Cochrane Database Syst Rev. 2013;9:CD008378. [DOI] [PubMed] [Google Scholar]
- 9. Finlayson K, Wu M‐L, Edwards H. Identifying risk factors and protective factors for venous leg ulcer recurrence using a theoretical approach. Int J Nurs Stud. 2015;52:1042‐1051. [DOI] [PubMed] [Google Scholar]
- 10. Franks PJ, Oldroyd MI, Dickson D, et al. Risk factors for leg ulcer recurrence: a randomized trial of two types of compression stocking. Age Ageing. 1995;24:490‐494. [DOI] [PubMed] [Google Scholar]
- 11. Nelson EA, Harper DR, Prescott RJ, Gibson B, Brown D, Ruckley CV. Prevention of recurrence of venous ulceration: Randomized controlled trial of class 2 and class 3 elastic compression. J Vasc Surg. 2006;44:803‐808. [DOI] [PubMed] [Google Scholar]
- 12. Tzaneva S, Heere‐Ress E, Kittler H, Böhler K. Surgical treatment of large vascular leg ulcers: a retrospective review evaluating risk factors for healing and recurrence. Dermatol Surg. 2014;40:1240‐1248. [DOI] [PubMed] [Google Scholar]
- 13. Gohel MS, Taylor M, Earnshaw JJ, Heather BP, Poskitt KR, Whyman MR. Risk factors for delayed healing and recurrence of chronic venous leg ulcers ‐ An analysis of 1324 legs. Eur J Vasc Endovasc Surg. 2005;29:74‐77. [DOI] [PubMed] [Google Scholar]
- 14. Barwell J, Davies C, Deacon J, et al. Comparison of surgery and compression with compression alone in chronic venous ulceration (ESCHAR study): randomised controlled trial. Lancet. 2004;363:1854‐1859. [DOI] [PubMed] [Google Scholar]
- 15. Vowden K, Vowden P. Factors influencing venous leg ulcer recurrence: Implications for practice. in From the laboratory to the patient: Future organisation and care of problem wounds. EWMA Conference Abstracts. 2005. Stuttgart, Germany: EWMA.
- 16. TenBrook JA, Iafrati MD, O'Donnell TF, et al. Systematic review of outcomes after surgical management of venous disease incorporating subfascial endoscopic perforator surgery. J Vasc Surg. 2004;39:583‐589. [DOI] [PubMed] [Google Scholar]
- 17. Magnusson MB, Nelzén O, Volkmann R. Leg ulcer recurrence and its risk factors: A duplex ultrasound study before and after vein surgery. Eur J Vasc Endovasc Surg. 2006;32:453‐461. [DOI] [PubMed] [Google Scholar]
- 18. Barwell JR, Ghauri ASK, Taylor M, et al. Risk factors for healing and recurrence of chronic venous leg ulcers. Phlebology. 2000;15:49‐52. [Google Scholar]
- 19. Ghauri ASK, Taylor MC, Deacon JE, et al. Influence of a specialized leg ulcer service on management and outcome. Br J Surg. 2000;87:1048‐1056. [DOI] [PubMed] [Google Scholar]
- 20. Sinabulya H, Ostmyren R, Blomgren L. Mid‐term outcomes of endovenous laser ablation in patients with active and healed venous ulcers: A follow‐up study. Eur J Vasc Endovasc Surg. 2017;53:710‐716. [DOI] [PubMed] [Google Scholar]
- 21. Brooks J, Ersser SJ, Lloyd A, Ryan TJ. Nurse‐led education sets out to improve patient concordance and prevent recurrence of leg ulcers. J Wound Care. 2004;13:111‐116. [DOI] [PubMed] [Google Scholar]
- 22. Finlayson, Edwards H, Courtney M. Relationships between preventive activities, psychosocial factors and recurrence of venous leg ulcers: a prospective study. J Adv Nurs. 2011;67:2180‐2190. [DOI] [PubMed] [Google Scholar]
- 23. Wounds Australia . Standards for Wound Prevention and Management. 3rd ed. Osborne Park, WA: Cambridge Media; 2016. [Google Scholar]
- 24. AWMA . Austalian and New Zealand Clinical Practice Guidelines for Prevention and Management of Venous Leg Ulcers. Barton, ACT: AWMA; 2011. [Google Scholar]
- 25. Nelson E, Bell‐Syer SEM. Compression for preventing recurrence of venous ulcers. Cochrane Database Syst Rev. 2014;4:CD002303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Gohel MS, Barwell JR, Taylor M, et al. Long term results of compression therapy alone versus compression plus surgery in chronic venous ulceration (ESCHAR) randomised controlled trial. Br Med J. 2007;335:83‐87. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Kheirelseid E, Bashar K, Aherne T, et al. Evidence for varicose vein surgery in venous leg ulceration. Surgeon. 2016;14:219‐233. [DOI] [PubMed] [Google Scholar]
- 28. Nelzén O, Fransson I. True long‐term healing and recurrence of venous leg ulcers following SEPS combined with superficial venous surgery: a prospective study. Eur J Vasc Endovasc Surg. 2007;34:605‐612. [DOI] [PubMed] [Google Scholar]
- 29. Chase SK, Melloni M, Savage A. A forever healing: the lived experience of venous ulcer disease. J Vasc Nurs. 1997;15:73‐78. [DOI] [PubMed] [Google Scholar]
- 30. Hareendran A, Bradbury A, Budd J, et al. Measuring the impact of venous leg ulcers on quality of life. J Wound Care. 2005;14:53‐57. [DOI] [PubMed] [Google Scholar]
- 31. Flaherty E. Setting up a community nurse‐led healed leg ulcer clinic. Br J Nurs. 2005;14:S14‐S20. [PubMed] [Google Scholar]
- 32. Parker C, Finlayson K, Edwards H. Predicting the likelihood of delayed venous leg ulcer healing and recurrence: development and reliability testing of risk assessment tools. Ostomy Wound Manage. 2017;63:16‐33. [PubMed] [Google Scholar]
- 33. El Miedany Y, El Gaafary M, Toth M, et al. Falls risk assessment score (FRAS): time to rethink. J Clin Gerontol Geriatrics. 2011;2:21‐26. [Google Scholar]
- 34. Wyatt JC, Altman DG. Commentary‐—prognostic models: clinically useful or quickly forgotten? Br Med J. 1995;311:1539‐1539, 1541. [Google Scholar]
- 35. Fawcett T. An introduction to ROC analysis. Pattern Recogn Lett. 2006;27:861‐874. [Google Scholar]
- 36. Park SH, Goo JM, Jo C‐H. Receiver Operating Characteristic (ROC) Curve: Practical Review for Radiologists. Korean J Radiol. 2004;5:11‐18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Paul P, Pennell ML, Lemeshow S. Standardizing the power of the Hosmer–Lemeshow goodness of fit test in large data sets. Stat Med. 2013;32:67‐80. [DOI] [PubMed] [Google Scholar]
- 38. Sbidian E, Wolkenstein P, Valeyrie‐Allanore L, et al. NF‐1Score: a prediction score for internal neurofibromas in neurofibromatosis‐1. J Invest Dermatol. 2010;130:2173‐2178. [DOI] [PubMed] [Google Scholar]
- 39. Pallant J. SPSS Survival Manual. 4th ed. New South Wales, Australia: Allen & Unwin; 2011. [Google Scholar]
- 40. Parker C, Finlayson K, Edwards H. Living alone and ulcer area reduction at 2 weeks predict failure to heal by 24 weeks in venous leg ulcers. J Wound Care. 2015;25:626‐634. [DOI] [PubMed] [Google Scholar]
- 41. Parker C, Finlayson K, Shuter P, et al. Risk factors for delayed healing in venous leg ulcers: a review of the literature. Int J Clin Pract. 2015;69:967‐977. [DOI] [PubMed] [Google Scholar]
- 42. Justice AC, Covinsky KE. Assessing the generalizability of prognostic information. Ann Intern Med. 1999;130:515‐524. [DOI] [PubMed] [Google Scholar]
- 43. Margolis DJ, Berlin JA, Strom BL. Which venous leg ulcers will heal with limb compression bandages? Am J Med. 2000;109:15‐19. [DOI] [PubMed] [Google Scholar]
- 44. Kulkarni SR, Gohel MS, Wakely C. A severity score comprising patient age, ulcer chronicity, and venous refill time predicted venous leg ulcer healing at 24 weeks. Evid Based Nurs. 2007;10:122. [DOI] [PubMed] [Google Scholar]
- 45. Ebbeskog B, Emami A. Older patients' experience of dressing changes on venous leg ulcers: more than just a docile patient. J Clin Nurs. 2005;14:1223‐1231. [DOI] [PubMed] [Google Scholar]
- 46. Mullins M, Thomason SS, Legro M. Monitoring Pressure Ulcer Healing in Persons with Disabilities. Rehabil Nurs. 2005;30:92‐99. [DOI] [PubMed] [Google Scholar]
- 47. Goksuluk D, Korkmaz S, Zararsiz G, Karaagaoglu A. 2016. easyROC: an interactive web‐tool for ROC curve analysis using R language environment. http://www.biosoft.hacettepe.edu.tr/easyROC/. Accessed February 2, 2018.
