Objective:
This study assesses the user burden, reliability, and longitudinal validity of the AHQ, a novel VH patient-reported outcomes measure (PROM).
Background:
We developed and psychometrically validated the AHQ as the first VH-specific, stakeholder-informed PROM. Yet, there remains a need to assess the AHQ's clinical applicability and further validate its psychometric properties.
Methods:
To assess patient burden, pre- and postoperative patients were timed while completing the corresponding AHQ form. To measure test-retest reliability, a subset of patients completed the AHQ within a week of initial completion, and consecutive responses were correlated. Lastly, patients undergoing VH repair were prospectively administered the pre- and postoperative AHQ forms, the Hernia-Related Quality of Life Survey and the Short Form-12 both preoperatively and at postoperative intervals, up to over a year after surgery. Quality-of-Life scores were correlated from the 3 PROMs and effect sizes were compared using analysis of normal variance.
Results:
Median response times for the pre- and postoperative AHQ were 1.1 and 2.7 minutes, respectively. The AHQ demonstrates high test-retest reliability coefficients for pre- and postoperative instruments (r = 0.91, 0.89). The AHQ appropriately and proportionally measures expected changes following surgery and significantly correlates with all times points of the
Hernia-Related Quality of Life Survey and Short Form-12 MS and 4/5 (80%) SF12-PS.
Conclusion:
The AHQ is a patient-informed, psychometrically-validated, clinical instrument for measuring, quantifying, and tracking PROMs in VH patients. The AHQ exhibits low response burden, excellent reliability, and effectively measures hernia-specific changes in quality-of-Life following ventral hernia repair.
Keywords: abdominal hernia-Q, hernia, patient burden, patient reported outcomes, PROM development, quality of life
Ventral hernias (VH) are a common, chronic surgical problem facing any patient undergoing abdominal surgery. 1,2 Although traditionally thought of as a simple surgical issue, clinicians have come to recognize VH as a complex, multi-dimensional disease. For instance, patients with VH experience negative effects on whole-body fitness, including reduced truncal and extremity strength, creating significant downstream effects including restricted motion, increased pain, and difficulties completing activities of daily living. 3–6 Similarly, VH leads to adverse effects on psychosocial well-being and a negative impact on body image and mental health. 7 Unfortunately, traditional clinical outcome measures incompletely capture and measure the complex disease burden associated with VH, including its impact on function, body image, and, subsequently, patient quality-of-life (QoL). 7,8
Patient-reported outcome measures (PROMs) have garnered growing support as a means of holistically characterizing a patient's health state. 9–11 When properly designed, developed, and tested, PROMs provide insight into a patient's QoL, enable monitoring of disease progression, and facilitate personalized care. 11–14 This is critically important in surgery, as patient perspective can guide clinical decision making and improve pre- and postoperative counseling. 10,13,15,16 Consequently, providers incorporated PROMs into VH patient's care, initially employing generic, nonspecific instruments - examples of these include the Visual Analog Scale 17 and, more commonly, the 12-Item (SF-12) and 36-Item (SF-36) Short Form surveys. 18–20 However, to be useful to VH surgeons, PROMs must be tailored to capture disease-specific aspects of QoL and demonstrably measure changes after intervention. 21,22 Furthermore, they must be designed with content validity, psychometrically validated, and perhaps most importantly, easily implementable in practice. 23
To address these aforementioned needs, we designed the abdominal hernia-Q (AHQ) and detailed its development, from foundational qualitative work to extensive psychometric validation (Link: http://links.lww.com/SLA/B544). 22 Although there are other hernia-specific PROMs available, namely the hernia-related-quality of life survery (HerQLes) and Carolinas Comfort Scale (CCS), the AHQ is unique in that it was rigorously designed for implementation with broad stakeholder input at all stages of development, underscoring the AHQ's fundamental content validity. 22,24–27 The AHQ is further differentiated from the HerQLes and CCS by measuring QoL in distinct hernia-related domains, including physical function, body image, and satisfaction with surgical care, all of which have been shown to be critical components of successful repair. 6,7 The multidimensional measurement offered by the AHQ facilitates targeted improvements in clinical practice, which may be critical as PROMs are utilized as performance measures and metrics for quality. 22,28,29 Although newly developed PROMs have emerged for a variety of surgical diseases, few have undergone rigorous testing of their clinical usability, including assessment of user burden in a diverse population, reliability of measurements, and sensitivity to change. 15,26,27,30–33 Thus, we evaluated the AHQ, by measuring user burden, testing internal reliability through rigorous test-retest-ing, and explored the AHQ's psychometric properties through longitudinal, prospective administration throughout key timepoints in the surgical management of VH. These critical steps set the stage for widescale dissemination of the AHQ as a standardized PROM in an emerging area of surgery, termed Abdominal Core Health, in which VH is a critical area of surgical focus. 34
Methods
Patient Identification and Clinic Flow
This study was approved by the Institutional Review Board and all research subjects provided informed consent. Inclusion criteria for this study was any adult, English-speaking patient (>18 years) seen in clinic from January 2017 to December 2019 with a diagnosis of ventral, umbilical, parastomal, paramedian or epigastric hernia. Patients were eligible for the preoperative AHQ if they were scheduled for ventral hernia repair (VHR) within 6 months and for the postoperative instrument if they had undergone repair in the last 24 months. Patients meeting our inclusion criteria were identified by an advanced practice provider (APP) from the daily clinic schedule. At the start of each appointment, the APP administered the relevant AHQ form either on paper or with an iPad. IPads were purchased for research purposes, and locked onto the AHQ screen, preventing patients from scrolling to different pages. After completion, the iPads were wiped with disinfectant, and the APP recorded completed responses within the electronic medical record (EMR) as a part of the encounter note. Once uploaded, surgeons could view QoL data and individual item responses within the EMR.
Patient Burden
APPs provided the appropriate AHQ form to the corresponding patient and allowed sufficient time for completion. All preoperative and over 6-month postoperative patients completed the AHQ on an iPad, while patients within 6 months of VHR completed a paper form. Patients were manually timed, beginning from the moment they began reading and ending with completion of the final item. A retrospective chart review was conducted on all patients who were enrolled in this portion of the study. Demographic variables such as age, race, and ethnicity were abstracted from the medical record. Additionally, median income was estimated based on patient Zip Codes. 35 Krus-kal-Wallis tests were used to examine the association of demographics, median income, and administration method with patient burden.
Inter-test Reliability
Patients participating in patient burden testing were asked if they would be willing to be tested again at a later date. If so, repeat online testing was conducted within 5-7 days after their clinic visit to assess for inter-test reliability. This arm of the study only included pre- and postoperative patients that were at least 6 months removed from VHR. We chose to limit the postoperative patients with this criterion, so that test-retesting would not be affected by changes in QoL during the acute healing process. Pearson reliability coefficient tests were completed for the preoperative and postoperative instruments, in addition to individual items from each.
Longitudinal Validation
We aimed to longitudinally validate the AHQ as a metric sensitive to changes in QoL after VHR. To do so, we prospectively compared its performance to other commonly used QoL metrics. We chose to administer only 2 comparative PROMs (1-disease specific and 1 generic), as we believed that adding any additional surveys would greatly reduce patient responses. We chose the SF-12 as the generic instrument, as it is the most widely used nonspecific PROM in hernia repair. 36 For the hernia-specific comparative PROM, we opted to use the HerQLes, as opposed to the CCS, since the CCS includes mesh specific questions that limits its use preoperatively or in patients for whom mesh was not used. 26,27 Patients seen in consultation between August 2017 and May 2018, with plans to undergo VHR within the next 6 months were contacted via email after their initial visit with a hernia surgeon. If consented, we administered the preoperative AHQ, HerQLes, and SF-12. Following VHR, we periodically administered the 3 PROMs during clinic visits and by email, with 2 email reminders and 3 phone reminders. Due to variable response rates, patients were only included in the longitudinal analysis if they had completed at least 1 pre- and postoperative AHQ and HerQLes instruments. SF-12 completion was not a part of the inclusion criteria, but this data has been included, when available.
Postoperative intervals were designed to capture responses around standard follow-up periods, with flexible windows to accommodate variations in scheduling. AHQ and HerQLes raw scores were converted to QoL metrics out of a 100%, 37,38 for ease of interpretation, and Pearson correlations were completed to compare the AHQ to the HerQLes and SF-12. Effect sizes were calculated for each questionnaire in the various postoperative time intervals. 22 Analysis of normal variance was used to compare effect sizes of various instruments, with Tukey test used for post-hoc comparisons.
The PROMs’ sensitivities to 30-day and 90-day complications, readmission, and recurrence were compared. A composite complication outcome was created, which included infection, seroma, venous thromboembolism, and mesh infection. To accurately determine if the metrics were sensitive to the aforementioned complications, QoL scores were only included if they were captured within 3 months of the outcome of interest. For patients without the defined complications, an average of all their postoperative responses was used for comparison. Patients who suffered a complication, but did not have a QoL response within the 3-month window were excluded from analysis. Cohort QoL scores were tested for equivalent variance using Kolmogorov-Smirnov tests, and Wilcoxon rank sum and t-tests were used accordingly. Finally, paired Wilcoxon Rank Sum were used to determine if there were changes in AHQ scores in the postoperative windows. Statistical significance was set at P < 0.05. All analyses were performed in R Studio 4.0 (RStudio, Boston, MA).
Results
Patient Burden
We obtained patient burden data from 419 completed AHQs (209 preoperative and 210 postoperative). The median time to instrument completion was 67 seconds [interquartile range (IQR) 51-86] preoperatively and 161 seconds (IQR 119-215) postoperatively (Table 1). In both groups, older patients (≥65 years) took longer to complete the AHQ (P < 0.05). Electronic administration of the AHQ with an iPad significantly reduced postoperative burden (150 vs 181 seconds, P = 0.005). Notably, in sub-group analysis, the older patients also completed the postoperative instrument in a significantly shorter time when using an iPad (165 vs 205 seconds, P = 0.02), but no difference was detected in the preoperative instrument. No differences in time to completion were noted across race, ethnicity, and adjusted gross income.
Table 1.
Patient Burden for Preoperative and Postoperative AHQ
| Preoperative AHQ | Postoperative AHQ | |||||
|---|---|---|---|---|---|---|
| Variable | N | Seconds [IQR] | P-value | N | Seconds [IQR] | P-value |
| Overall | 209 | 67 s [51, 86] | n/a | 210 | 161 s [119, 215] | n/a |
| Age | 0.04 | 0.002 | ||||
| <45 yr | 60 | 58 s [50, 74] | 47 | 134 s [103, 180] | ||
| 45–65 yr | 106 | 69 s [51, 90] | 107 | 163 s [118, 218] | ||
| >65 yr | 43 | 72 s [60, 90] | 56 | 187 s [137, 236] | ||
| Race/ethnicity | 0.89 | 0.12 | ||||
| White | 143 | 65 s [50, 84] | 159 | 158 s [117, 210] | ||
| African American | 44 | 69 s [53, 88] | 43 | 186 s [123, 250] | ||
| Asian | 10 | 64 s [44,180] | 1 | 110 s [110, 110] | ||
| Pacific Islander | 1 | 65 s [65, 65] | 0 | n/a | ||
| Unknown | 11 | 70 s [54, 110] | 7 | 136 s [96, 156] | ||
| Ethnicity | 0.45 | 0.29 | ||||
| Non-Hispanic | 204 | 67 s [51, 88] | 207 | 163 s [119, 215] | ||
| Hispanic/Latino | 4 | 60 s [46, 79] | 2 | 145 s [137, 153] | ||
| Unknown | 4 | 56 s [52, 64] | 1 | 90 s [90, 90] | ||
| Median Income | 0.42 | 0.09 | ||||
| <$25,000 | 5 | 63 s [50, 78] | 12 | 208 s [130, 285] | ||
| $25,000–$50,000 | 42 | 67 s [51, 90] | 44 | 184 s [115, 295] | ||
| $50,000–$75,000 | 72 | 69 s [51, 91] | 72 | 155 s [119, 210] | ||
| $75,000–$10,000 | 62 | 68 s [56, 76] | 57 | 140 s [109, 181] | ||
| >$100,000 | 28 | 57 s [49, 71] | 25 | 164 s [133, 215] | ||
| Survey method | 0.86 | 0.005 | ||||
| iPad | 46 | 67 s [51, 90] | 73 | 150 s [115,195] | ||
| Paper | 163 | 68 s [53, 81] | 137 | 181 s [133, 238] | ||
AHQ indicates abdominal hernia-Q; IQR, interquartile range.
Inter-test Reliability
For test-retest reliability, we obtained data for 173 patients, 88 preoperatively and 85 postoperatively. Median time to retest was 9 (IQR 6–15) and 10 days (IQR 7-16), respectively. Median preoperative AHQ scores were 2.5 (IQR 2.1–3.1) versus 2.44 (IQR 1.9–3.1) in the re-test, with a high reliability coefficient (r = 0.91, P < 0.0001). Postoperative AHQ showed similarly high correlations (r = 0.89, P < 0.0001), with retest median score of 3.69 (IQR 3.2-3.9), compared to initial test score of 3.68 (IQR 3.3–3.8) (Fig. 1). Preoperative correlation coefficients for test-retest ranged from 0.67 to 0.84 (all P < 0.0001) across the 8 items, whereas postoperative correlation coefficients ranged from 0.57 to 0.86 (all P < 0.0001) across each of the 16 items.
Figure 1.

A, Preoperative;B, Postoperative test-retest reliability plot showing high correlation (r = 0.91, 0.89).
Longitudinal Validation
After consent, a total of 106 patients met the inclusion criteria, having completed at least 1 AHQ and HerQLes study, pre- and postoperatively (Supplemental Figure 1, http://links.lww.com/SLA/C863). Median age at the time of surgery was 55.6, and 43 patients (41%) were male (Supplemental Table 1, http://links.lww.com/SLA/C864). There was a significant increase in AHQ QoL scores immediately postoperatively (51.9 vs 83.3, P < 0.0001) (Fig. 2). The scores continued to rise until the 7.5 month to 13.5 months postoperative window, and then dropped after 13.5 months post-VHR, although this difference was not significant (89.6 vs 83.3, P = 0.15). Additionally, there were no significant differences found between the immediate postoperative score and any of the subsequent time periods.
Figure 2.

Longitudinal performance of AHQ, HerQles, and SF-12. AHQ indicates abdominal hernia-Q;HerQles, hernia-related quality of life survey; SF-12, short form-12.
Overall, the AHQ demonstrated high correlation to the HerQLes and SF-12 in both the preoperative and postoperative period (Table 2). The AHQ was significantly correlated with the HerQLes in 5 out of 5 time points (100%), ranging from the preoperative period to over 13.5 months postoperatively (r = 0.47–0.76). Similarly, the AHQ showed good correlation with the SF-12, with significant correlations with 4/5 time points (80%) of the SF-12 PS scores and 5/5 (100%) of the SF-12 MS scores. The AHQ did not correlate to the SF-12 PS score 13.5 months after VHR.
Table 2.
Correlation of the AHQ to HerQLes, and SF-12 in the Postoperative Period
| Instrument | Preoperative | <1.5 m | 1.5–7.5 m | 7.5–13.5 m | >13.5 m |
|---|---|---|---|---|---|
| Hernia-Q QoL [IQR] | 51.9 [37, 70] | 83.3 [77, 90] | 87.5 [73, 94] | 89.6 [76, 98] | 83.3 [58, 92] |
| (N) | (N = 106) | (N = 33) | (N = 86) | (N = 56) | (N = 15) |
| HerQles QoL [IQR] | 33.9 [18, 57] | 51.7 [29, 65] | 76.7 [40, 92] | 81.7 [53, 92] | 60.0 [30, 82] |
| Correlation Coeff. | 0.76 | 0.72 | 0.76 | 0.47 | 0.60 |
| (N) | (N = 106) | (N = 26) | (N = 45) | (N = 61) | (N = 14) |
| SF-12 PS [IQR] | 45.0 [38, 51] | 42. 5 [35, 50] | 47.2 [41, 53] | 51.8 [45, 57] | 50 [36, 56] |
| Correlation Coeff. | 0.50 | 0.52 | 0.44 | 0.52 | 0.52 |
| (N) | (N = 106) | (N = 25) | (N = 85) | (N = 53) | (N = 10) |
| SF-12 MS [IQR] | 43.0 [33, 54] | 48.2 [38, 56] | 54.1 [45, 58] | 54.2 [46, 58] | 52.2 [31, 57] |
| Correlation Coeff. | 0.55 | 0.52 | 0.56 | 0.59 | 0.75 |
| (N) | (N = 104) | (N = 25) | (N = 85) | (N = 54) | (N = 11) |
Bold indicates significant correlation to AHQ.
AHQ indicates abdominal hernia-Q; HerQles, hernia-related quality of life survey; QoL, quality-of-life; SF-12, short form-12.
The AHQ demonstrated greater effect sizes in each of the postoperative windows (Table 3). Analysis of normal variance analysis showed a significant difference between the effect sizes of various instruments (F (3,12) = 12.7, P < 0.0001). Post-hoc Tukey tests showed that the AHQ effect size was significantly greater than the HerQLes (P = 0.04), SF-12 PS (P < 0.0001) and the SF-12 MS (P = 0.001) (Fig. 3). Further, the HerQLes had significantly greater effect size when compared to the SF-12 PS (P = 0.03), but not the SF-12 MS (P = 0.37), and no difference was detected between the 2 SF-12 component scores (P > 0.05).
Table 3.
Effect Sizes for QoL Instruments in the Postoperative Period
| Instrument | <1.5 m | 1.5–7.5 m | 7.5–13.5 m | >13.5 m |
|---|---|---|---|---|
| AHQ effect size | 1.50 | 1.40 | 1.38 | 1.04 |
| HerQLes effect size* | 0.47 | 0.91 | 1.07 | 0.64 |
| SF-12 PS effect size | –0.19 | 0.30 | 0.64 | 0.23 |
| SF-12 MS effect size | 0.43 | 0.66 | 0.75 | 0.40 |
HerQLes summary score used.36
AHQ indicates abdominal hernia-Q; HerQles, hernia-related quality of life survey; QoL, quality-of-life; SF-12, short form-12.
Figure 3.

Effect sizes of QoL instruments compared in this study. QoL indicates quality-of-life.
The AHQ was sensitive to negative clinical outcomes, with significantly lower scores for patients who had 30- and 90-day complications, readmissions, and importantly, recurrence (P < 0.05) (Table 4). The HerQLes, SF-12 PS, and SF-12 MS were all sensitive to readmissions, with patients with readmissions demonstrating significantly lower scores (P < 0.05). However, these 3 metrics did not show discriminatory ability between patients with 30-day complications, 90-day complications, or recurrence (P > 0.05).
Table 4.
PROM Sensitivity to Negative Clinical Outcomes
| AHQ | HerQLes | SF-12 PS | SF-12 MS | |
|---|---|---|---|---|
| 30-d composite complication | ||||
| Yes | 75.2 [63, 89] | 74.2 [52, 96] | 47.4 [40, 57] | 52.4 [44, 57] |
| No | 87.5 [77, 94] | 65.0 [40, 88] | 46.9 [41, 51] | 53.3 [44, 57] |
| P-value | 0.03 | 0.44 | 0.65 | 0.75 |
| 90-d composite complication | ||||
| Yes | 76.0 [63, 90] | 76.7 [52, 92] | 47.2 [43, 53] | 51.9 [44, 57] |
| No | 87.8 [77, 9 4] | 64.7 [40, 88] | 46.9 [41, 51] | 52.6 [44, 56] |
| P-value | 0.02 | 0.39 | 0.65 | 0.67 |
| Readmission | ||||
| Yes | 67.7 [61, 77] | 38.3 [28, 46] | 41.6 [31, 46] | 33.9 [31, 46] |
| No | 87.5 [75, 94] | 73.0 [53, 87] | 49.0 [42, 54] | 52.6 [46, 57] |
| P-value | 0.001 | 0.0005 | 0.002 | <0.001 |
| Recurrence | ||||
| Yes | 76.0 [62, 85] | 60 [13, 83] | 45.4 [34, 54] | 57.7 [36, 59] |
| No | 87.0 [73, 93] | 71.4 [44, 87] | 46.9 [42, 54] | 51.0 [45, 57] |
| P-value | 0.02 | 0.36 | 0.38 | 0.57 |
AHQ indicates abdominal hernia-Q; HerQles, hernia-related quality of life survey; QoL, quality-of-life; SF-12, short form-12.
Discussion
The AHQ is a hernia-specific, stakeholder-informed PROM enabling hernia surgeons to assess patient QoL, in both the pre- and postoperative periods. Our group previously validated the AHQ’s ability to capture patient perspectives in the perioperative period. In this pivotal prospective follow-up, we have shown the AHQ performs with high internal stability, low response burden, appropriate sensitivity to changes in QoL after VHR, and a large effect size. Additionally, the AHQ is sensitive to important clinical outcomes, like recurrence, suggesting it can be used to monitor patients after VHR. Further bolstering its clinical utility, the AHQ captures changes in patient QoL through specific domains uniquely tailored to the pre- and postoperative experiences of patients. Considering the AHQ’s low patient burden, sensitivity to patient QoL, and our intuitional experience, this study shows the feasibility of employing the AHQ in diverse clinical settings and patient populations.
PROMs have become increasingly popular in medicine, as they allow clinicians to gather insight into patient perspectives when weighing treatment options. 39 However, reliability, or internal consistency, is essential before any clinical tool can be used to inform medical decision making. 40 Furthermore, PROMs that are utilized to assess patients on an individual basis, as opposed to a population level, generally require high reliability coefficients to be effective. 39 In this study, the AHQ showed high retest reliability, with both the pre- and postoperative instruments reaching reliability coefficients of approximately 0.9, indicating excellent agreement. 41 This result shows that the AHQ is precise in capturing PROs related to VH, and supports its use on an individual level to monitor patients with VH 30,31,33,41
Interestingly, the stability of the AHQ in the pre and postoperative periods also sheds light on the hernia-health state, itself The finding that preoperative AHQ scores are so highly correlated in restretesting, suggests that patients are indeed experiencing the complex, multi-dimensional effects of VH, and that the AHQ is accurately measuring these components 6,42 Similarly, the finding that AHQ scores remain stable in patients 6-months postoperative from VHR speaks to the dramatic impact this intervention can have in improving patient QoL Taken together, this is a highly important finding, corroborating the complexity of the hernia-health state and the importance of VHR in treating it
Given that PROMs with high burden can lead to low response rates, patient burden significantly impacts clinical usability, with time to completion reported as the most important factor 43,44 . Our results demonstrate that the AHQ exhibits very low patient burden, with median completion times of 1.1 and 2.6 minutes for the preoperative and postoperative instruments, respectively. Importantly, results were consistent across racial and socioeconomic groups. Unsurprisingly, older patients (>65 years) required significantly more time to complete the AHQ, and this is of particular concern, as patients with higher levels of cognitive impairment suffer from greater levels of patient burden. 45 However, this effect can be partially mitigated by the use of iPads, or other electronic tablets, which we found decreased the overall response time, and thereby, patient burden. Regardless, older patients completed the longer postoperative instrument with a median time of just over 3 minutes, which further demonstrates the low patient burden of the AHQ overall.
Beyond patient burden, the short response times speaks to the usability of the AHQ in surgeon's practice. In a recent survey of surgeons, implementation obstacles have been cited as one of the most significant barriers to PROM usage, with concerns that administering the PROM would disrupt clinic flow. 15 In this study, we included a description of how we have implemented departmental administration of the AHQ, with minimal disruption of flow. Notably, the EMR in our clinic allows APPs to quickly enter discrete values into pre-made templates, streamlining the process and limiting disruption to clinic flow. Additionally, we have created shortcuts within the EMR that extract longitudinal AHQ responses and display them in an easy-to-read format, allowing surgeons to asses patient trajectory using PROM data. This is consistent with recent literature suggesting that user-friendly IT systems promote the usage of PROM. 46–48
Previously, we psychometrically validated the AHQ in the pre- and immediate postoperative period, by correlating it to the HerQLes and SF-12. 22 In this study, we found that the AHQ continues to be significantly correlated to the HerQLes and SF-12 longitudinally over a year after surgery, with the exception of a single SF-12 PS window that had a small survey sample. This data suggests that the AHQ performed with high accuracy when compared to other QoL metrics and demonstrates the validity of the AHQ in capturing hernia related outcomes longitudinally over a year postoperatively. 31–33
As a proxy for clinical significance, effect size is used to measure the sensitivity of a PROM to changes in health of a given patient population. 49,50 In this study, the SF-12 PS and MS consistently demonstrated the lowest effect sizes in each postoperative time window, underscoring the low-sensitivity of generic PROMs when compared to disease-specific instruments. 22 In previous testing, we found that the AHQ demonstrated the largest effect size in the immediate perioperative period. 22 Here, we further expand on that result by showing the AHQ continues to perform with the greatest effect sizes postoperatively over a year after VHR. Importantly, the AHQ's postoperative effects sizes were all above 0.8, which is generally accepted as the cut off for large effect size, substantively demonstrating its ability to truly measure hernia-specific QoL. 49,50
The finding that the AHQ significantly correlates with the HerQLes throughout the postoperative period validates the well-documented use of the HerQLes to measure hernia-related QoL. 37,38 Although the HerQLes was not designed with stakeholder input, it seems to have arrived at a metric that captures VH QoL data, nonetheless. 26 Still, the AHQ is unique, in that it was developed systematically with patient perspectives at the forefront, bolstering its content validity. 23 The importance of this is shown through the AHQ’s sensitivity to poor clinical outcomes like complications, readmission, and recurrence, as opposed to the HerQLes which is only sensitive to changes in QoL after readmission. 49,50 This builds on findings from our initial comparison of the PROMs which showed that AHQ had superior discriminatory ability between patients with and without perioperative complications. 22 Although the QoL data for outcomes is somewhat limited, we show the AHQ outperforms the other metrics, even in this small sample. Furthermore, the fact that AHQ scores significantly decrease in patients with recurrence, suggest that it may have utility in monitoring patients for this dreaded complication, even though more rigorous testing is needed to validate this claim. Additionally, unlike the HerQLes, the AHQ provides both preoperative and postoperative instruments, with a simple scoring system, allowing for granular and easy-to-interpret QoL data. 22 The AHQ is further differentiated from the HerQLes by measuring QoL in important hernia-related domains, including body image and satisfaction with surgical care. With this in mind, we believe that the AHQ is superior in capturing VH-related QoL information, and with the results of this study, can uniquely substantiate the practicality of implementing the AHQ in a surgical practice.
Limitations
Limitations of the study to note are that the data presented for the patient burden and test-retest reliability arm and the longitudinal validation arm of the study stem from different, but sometimes overlapping, patient populations. This occurred because longitudinal data is drawn from patients for whom we were collecting AHQ responses, in addition to the HerQLes and SF-12, enabling longitudinal validation. These patients were enrolled before we set out to test the AHQ's internal reliability and quantify its patient burden. However, the authors would argue that the conclusions drawn from the data are still valid, as the 3 aspects of the AHQ being tested, are independent of each other, and are not affected by the underlying patient population. Additionally, the patient burden data is limited in generalizability by the population our hospitals serves, but with over 400 responses, we feel that the conclusions drawn from this data are likely true for other patient subsets. As a means to truly compare the sensitivity of the PROMs to a poor clinical outcome, we created 3-month window around the complication and compared it to an average of all postoperative scores for those who did not have a complication. Although we concede that this does not take into account the changes in QoL during various postoperative intervals, we believe this was necessary to account for variable survey responses. Furthermore, HerQLes and SF-12 responses for patients with complications were collected on the same day as the AHQ, and these metrics did not show discriminatory ability, underscoring the sensitivity of the AHQ.
Conclusions
The AHQ is a validated, patient-informed instrument to capture the multi-dimensional aspects of the hernia health state that can accurately quantify changes in QoL after VHR. Here, we have shown that it performs with high reliability, low user burden, and continues to accurately capture longitudinal QoL data over a year after VHR. With this, we have now completed the multi-stage cycle of PROM development, starting with foundational qualitative work to real world, prospective testing. The AHQ is now ready for dissemination and widescale adoption as the universal PROM for VH patients.
Supplementary Material
Acknowledgments
The authors thank the University of Pennsylvania Center for Human Appearance and the Harrison Department of Surgical Research for their generous support in the completion of this study. The authors express their appreciation to Dr. Jon Morris, Dr. Stephen Kovach, Dr. Sean Harbison, Dr. Steven Raper, Dr. Daniel Dempsey, Dr. Kristoffel Dumon, Dr. Najjia Mahmoud, Dr. Alan Schuricht, Dr. Noel Williams, Dr David Wernsing, and all other partners within the Department of Surgery at the University of Pennsylvania for contributing patients to the development and testing of the Abdominal Hernia-Q.
Footnotes
V.P. and J.R.c. contributed equally to this work.
Requests for Reprints: John P. Fischer, MD, MPH Division of Plastic Surgery, Department of Surgery, University of Pennsylvania Health System 51 North 39th Street, Wright Saunders Building, Philadelphia, PA 19104, (215) 662-7300, Email: John.Fischer2@pennmedicine.upenn.edu.
Justification of Authorship: Viren Patel: Study design, data collection, data analysis, manuscript drafting.
Jessica R. Cunning: Study design, data collection, data analysis, manuscript drafting.
Arturo J. Rios-Diaz: Data analysis, manuscript revising.
Jaclyn T. Mauch: Study Design, manuscript drafting.
Shelby L. Nathan: Data collection, manuscript revising.
Charles A. Messa IV: Data collection, manuscript revising.
Cutler B. Whitely: Data collection, manuscript drafting.
Geoffrey M. Kozak: Data collection, manuscript revising.
Robyn B. Broach: Study design, data analysis, manuscript revising.
John P. Fischer: Study design, data analysis, manuscript drafting.
John P. Fischer has received payments as a consultant from Baxter, Becton-Dickinson, WL Gore, and Integra Life Sciences. This research did not receive financial support for the study. The remaining authors do not have any financial disclosures.
The authors report no conflicts of interest.
Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal’s Web site (www.annalsofsurgery.com).
REFERENCES
- 1. Le Huu Nho R, Mege D, Ouaïssi M, et al. Incidence and prevention of ventral incisional hernia. J Visc Surg. 2012;149:e3–e14. [DOI] [PubMed] [Google Scholar]
- 2. Poulose BK, Shelton J, Phillips S, et al. Epidemiology and cost of ventral hernia repair: making the case for hernia research. Hernia. 2012;16:179–183. [DOI] [PubMed] [Google Scholar]
- 3. Hodges PW, Richardson CA. Contraction of the abdominal muscles associated with movement of the lower limb. Phys Ther. 1997;77:132–142. discussion 142–144. [DOI] [PubMed] [Google Scholar]
- 4. Dulin WA, Avila RA, Verheyden CN, et al. Evaluation of abdominal wall strength after TRAM flap surgery. Plast Reconstr Surg. 2004;113:1662–1665. discussion 1666–1667. [DOI] [PubMed] [Google Scholar]
- 5. Kumar T, Kumar S, Nezamuddin M, et al. Efficacy of core muscle strengthening exercise in chronic low back pain patients. J Back Musculoskelet Rehabil. 2015;28:699–707. [DOI] [PubMed] [Google Scholar]
- 6. Jensen KK, Munim K, Kjaer M, et al. Abdominal wall reconstruction for incisional hernia optimizes truncal function and quality of life: a prospective controlled study. Ann Surg. 2017;265:1235–1240. [DOI] [PubMed] [Google Scholar]
- 7. van Ramshorst GH, Eker HH, Hop WCJ, et al. Impact of incisional hernia on health-related quality of life and body image: a prospective cohort study. Am J Surg. 2012;204:144–150. [DOI] [PubMed] [Google Scholar]
- 8. Holihan JL, Alawadi Z, Martindale RG, et al. Adverse events after ventral hernia repair: the vicious cycle of complications. J Am Coll Surg. 2015;221: 478–485. [DOI] [PubMed] [Google Scholar]
- 9. Cella D, Yount S, Rothrock N, et al. The patient-reported outcomes measurement information system (PROMIS): progress of an NIH roadmap cooperative group during its first two years. Med Care. 2007;45(5 Suppl 1):S3–S11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Kerr EA, Hayward RA. Patient-centered performance management: enhancing value for patients and health care systems. JAMA. 2013;310:137–138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Evans JP, Smith A, Gibbons C, et al. The National Institutes of Health patient-reported outcomes measurement information system (PROMIS): a view from the UK. Patient Relat Outcome Meas. 2018;9:345–352. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Black N, Burke L, Forrest CB, et al. Patient-reported outcomes: pathways to better health, better services and better societies. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 2016;25:1103–1112. [DOI] [PubMed] [Google Scholar]
- 13. Khalil LS, Darrith B, Franovic S, et al. Patient-reported outcomes measurement information system (PROMIS) global health short forms demonstrate responsiveness in patients undergoing knee arthroplasty. J Arthroplasty. 2020;35:1540–1544. [DOI] [PubMed] [Google Scholar]
- 14. Carney MJ, Golden KE, Weissler JM, et al. Patient-reported outcomes following ventral hernia repair: designing a qualitative assessment tool. Patient. Published online 2018. doi: 10.1007/s40271-017-0275-3. [DOI] [PubMed]
- 15. Mou D, Sisodia RC, Castillo-Angeles M, et al. The Surgeon's perceived value of patient-reported outcome measures (PROMs): an exploratory qualitative study of 5 different surgical subspecialties. Ann Surg. 2022;275:500–505. [DOI] [PubMed] [Google Scholar]
- 16. Lagendijk M, Mittendorf E, King TA, et al. Incorporating patient-reported outcome measures into breast surgical oncology: advancing toward value-based care. Oncologist. 2020;25:384–390. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Aho JM, Nourallah A, Samaha MJ, et al. Patient-reported outcomes after laparoscopic ventral hernia repair. Am Surg. 2016;82:550–556. [PubMed] [Google Scholar]
- 18. Mier N, Helm M, Kastenmeier AS, et al. Preoperative pain in patient with an inguinal hernia predicts long-term quality of life. Surgery. 2018;163:578–581. [DOI] [PubMed] [Google Scholar]
- 19. Lawrence K, McWhinnie D, Jenkinson C, et al. Quality of life in patients undergoing inguinal hernia repair. Ann R Coll Surg Engl. 1997;79:40–45. [PMC free article] [PubMed] [Google Scholar]
- 20. Quail J, Spence D, Hannon M. Perioperative gabapentin improves patient-centered outcomes after inguinal hernia repair. MilMed. 2017;182:e2052–e2055. [DOI] [PubMed] [Google Scholar]
- 21. Heniford BT, Walters AL, Lincourt AE, et al. Comparison of generic versus specific quality-of-life scales for mesh hernia repairs. J Am Coll Surg. 2008;206:638–644. [DOI] [PubMed] [Google Scholar]
- 22. Mauch J, Enriquez F, Shea J, et al. The abdominal hernia-Q: development, psychometric evaluation and prospective testing. Ann Surg. 2020;271:949–957. [DOI] [PubMed] [Google Scholar]
- 23. Francis DO, McPheeters ML, Noud M, et al. Checklist to operationalize measurement characteristics of patient-reported outcome measures. Syst Rev. 2016;5:129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Cheng KKF, Clark AM. Qualitative methods and patient-reported outcomes: measures development and adaptation. Int J Qual Methods. 2017;16: 160940691770298. [Google Scholar]
- 25. Lasch KE, Marquis P, Vigneux M, et al. PRO development: rigorous qualitative research as the crucial foundation. Qual Life Res. 2010;19:1087–1096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Krpata DM, Schmotzer BJ, Flocke S, et al. Design and initial implementation of HerQLes: a hernia-related quality-of-life survey to assess abdominal wall function. J Am Coll Surg. 2012;215:635–642. [DOI] [PubMed] [Google Scholar]
- 27. Heniford BT, Lincourt AE, Walters AL, et al. Carolinas comfort scale as a measure of hernia repair quality of life: a reappraisal utilizing 3788 internaional patients. Ann Surg. 2018;267:171–176. [DOI] [PubMed] [Google Scholar]
- 28. Ederal Drug Adminsitration. Guidance for Industry Patient-Reported Outome Measures: Use in Medical Product Development to Support Labeling Claims. Published online December 2009. Available at: https://www.fda.gov/media/77832/download. Accessed September 1, 2020.
- 29. Squitieri L, Bozic KJ, Pusic AL. The role of patient-reported outcome measures in value-based payment reform. Value Health J Int Soc Pharmaoeconomics Outcomes Res. 2017;20:834–836. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Alrubaiy L, Hutchings HA, Williams JG. Assessing patient reported outcome measures: a practical guide for gastroenterologists. United Eur Gastroenterol J. 2014;2:463–470. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Streiner DL, Norman GR, Cairney J. Health Measurement Scales. Vol 1. Oxford, England: Oxford University Press; 2015. [Google Scholar]
- 32. Terwee CB, Bot SDM, de Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. [DOI] [PubMed] [Google Scholar]
- 33. Rothrock NE, Kaiser KA, Cella D. Developing a valid patient-reported outcome measure. Clin Pharmacol Ther. 2011;90:737–742. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Poulose BK, Adrales GL, Janis JE. Abdominal core health–a needed field in surgery. JAMA Surg. 2020;155:185–186. [DOI] [PubMed] [Google Scholar]
- 35. Income By Zip Code. Available at: https://www.incomebyzipcode.com/. Accessed September 1, 2020.
- 36. Grove TN, Muirhead LJ, Parker SG, et al. Measuring quality of life in patients with abdominal wall hernias: a systematic review of available tools. Hernia. 2021;25:491–500. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Feng MP, Baucom RB, Broman KK, et al. Early repair of ventral incisional hernia may improve quality of life after surgery for abdominal malignancy: a prospective observational cohort study. Hernia J Hernias Abdom Wall Surg. 2019;23:81–90. [DOI] [PubMed] [Google Scholar]
- 38. Alkhatib H, Tastaldi L, Krpata DM, et al. Outcomes of transversus abdominis release (TAR) with permanent synthetic retromuscular reinforcement for bridged repairs in massive ventral hernias: a retrospective review. Hernia J Hernias Abdom Wall Surg. 2020;24:341–352. [DOI] [PubMed] [Google Scholar]
- 39. Frost MH, Reeve BB, Liepa AM, et al. Mayo/FDA patient-reported outcomes consensus meeting group; what is sufficient evidence for the reliability and validity of patient-reported outcome measures? Value Health J Int Soc Pharmacoeconomics Outcomes Res. 2007;10 Suppl 2: S94–S105. [DOI] [PubMed] [Google Scholar]
- 40. Scientific Advisory Committee of the Medical Outcomes Trust. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11:193–205. [DOI] [PubMed] [Google Scholar]
- 41. Nunnally JC. Psychometric Theory. New York, NY: McGraw-Hill; 1978. [Google Scholar]
- 42. Colavita PD, Tsirline VB, Belyansky I, et al. Prospective, long-term comparison of quality of life in laparoscopic versus open ventral hernia repair. Ann Surg. 2012;256:714–723. [DOI] [PubMed] [Google Scholar]
- 43. National Health Service. Finalised Patient Reported Outcome Measures (PROMs) in England - April 2015 to March 2016. Published Online August 2017. Available at: https://digital.nhs.uk/data-and-information/publications/statistical/patient-reported-outcome-measures-proms/final-ised-patient-reported-outcome-measures-proms-in-england-april-2015-to-march-2016. cAccessed September 1, 2020.
- 44. Bodart S, Byrom B, Crescioni M, et al. Perceived burden of completion of patient-reported outcome measures in clinical trials: results of a preliminary study. Ther Innov Regul Sci. 2019;53:318–323. [DOI] [PubMed] [Google Scholar]
- 45. Atkinson TM, Schwartz CE, Goldstein L, et al. Perceptions of response burden associated with completion of patient-reported outcome assessments in oncology. Value Health J Int Soc Pharmacoeconomics Outcomes Res. 2019;22:225–230. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Schoen MW, Basch E, Hudson LL, et al. Software for administering the national cancer institute's patient-reported outcomes version of the common terminology criteria for adverse events: usability study. JMIR Hum Factors. 2018;5:e10070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Lucas AR, Bass MB, Rothrock NE, et al. Development of an eHealth system to capture and analyze patient sensor and self-report data: mixed-methods assessment of potential applications to improve cancer care delivery. JMIR Med Inform. 2018;6:e46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Gandrup J, Yazdany J. Using health information technology to support use of patient-reported outcomes in rheumatology. Rheum Dis Clin North Am. 2019;45:257–273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Cohen J. A power primer. Psychol Bull. 1992;112:155–159. [DOI] [PubMed] [Google Scholar]
- 50. Sears ED, Chung KC. A guide to interpreting a study of patient-reported outcomes. Plast Reconstr Surg. 2012;129:1200–1207. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
