Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 Nov 16;18(11):e0294449. doi: 10.1371/journal.pone.0294449

Cost savings in male circumcision post-operative care using two-way text-based follow-up in rural and urban South Africa

Yanfang Su 1,#, Rachel Mukora 2,#, Felex Ndebele 2, Jacqueline Pienaar 2,3, Calsile Khumalo 2, Xinpeng Xu 4, Hannock Tweya 1,5, Maria Sardini 3, Sarah Day 3,6, Kenneth Sherr 1, Geoffrey Setswe 2,7, Caryl Feldacker 1,5,*
Editor: Lisa Suzanne Dulli8
PMCID: PMC10653449  PMID: 37972009

Abstract

Introduction

Voluntary medical male circumcision (VMMC) clients are required to attend multiple post-operative follow-up visits in South Africa. However, with demonstrated VMMC safety, stretched clinic staff in SA may conduct more than 400,000 unnecessary reviews for males without complications, annually. Embedded into a randomized controlled trial (RCT) to test safety of two-way, text-based (2wT) follow-up as compared to routine in-person visits among adult clients, the objective of this study was to compare 2wT and routine post-VMMC care costs in rural and urban South African settings.

Methods

Activity-based costing (ABC) estimated the costs of post-VMMC care, including counselling, follow-ups, and tracing in $US dollars. Transportation for VMMC and follow-up was provided for rural clients in outreach settings but not for urban clients in static sites. Data were collected from National Department of Health VMMC forms, RCT databases, and time-and-motion surveys. Sensitivity analysis presents different follow-up scenarios. We hypothesized that 2wT would save per-client costs overall, with higher savings in rural settings.

Results

VMMC program costs were estimated from 1,084 RCT clients: 537 in routine care and 547 in 2wT. On average, 2wT saved $3.56 per client as compared to routine care. By location, 2wT saved $7.73 per rural client and increased urban costs by $0.59 per client. 2wT would save $2.16 and $7.02 in follow-up program costs if men attended one or two post-VMMC visits, respectively.

Conclusion

Quality 2wT follow-up care reduces overall post-VMMC care costs by supporting most men to heal at home while triaging clients with potential complications to timely, in-person care. 2wT saves more in rural areas where 2wT offsets transportation costs. Minimal additional 2wT costs in urban areas reflect high care quality and client engagement, a worthy investment for improved VMMC service delivery. 2wT scale-up in South Africa could significantly reduce overall VMMC costs while maintaining service quality.

Introduction

Voluntary medical male circumcision (VMMC) is one of the most successful biomedical prevention strategies to reduce HIV transmission risk [1, 2]. VMMC is also safe with reported rates of combined moderate and severe adverse events (AEs) in large VMMC programs operating at scale in Southern Africa below 2% [37], meaning that 98% of VMMC clients likely heal without any incident. The Republic of South Africa SA prioritizes VMMC as part of its comprehensive HIV prevention, treatment and care plan [8], completing over 400,000 VMMCs per year for the last 10 years [9]. National South Africa guidelines require all VMMC clients to attend two post-operative follow-up visits within 14 days after the procedure to ensure timely identification and treatment for AEs. However, these visits are costly to both the clients and the providers. To comply with guideline requirements, attendance at post-operative reviews may be overreported, potentially inflating review rates while reducing the quality of care [10, 11]. A cost-effective approach is needed to reduce unnecessary visits while maintaining care quality.

Mobile health (mHealth) is used to describe the practice of healthcare and public health supported by mobile communication devices such as cellphones. mHealth interventions are recognized as more cost-effective compared to conventional interventions and may help address persistent challenges of healthcare worker (HCW) shortages and client difficulty in accessing healthcare facilities [12, 13], including in the VMMC context [14]. From 2009 to 2019, thousands of mHealth interventions were documented and launched globally, the vast majority in resource-constrained settings, suggesting robust approval of, and desire for, digital technologies in healthcare [1517]. When implemented optimally, mHealth interventions may help reduce healthcare costs by improving the provision of health education, identifying health concerns early when illness may be less severe, reducing the duration of therapy, and minimizing transport costs [18].

In 2018, the International Training and Education Center for Health (I-TECH) in the Department of Global Health at the University of Washington (UW) and technology partner, Medic, conducted a randomized control trial (RCT) among VMMC clients in routine VMMC clinics in Zimbabwe using a two-way texting (2wT) telehealth approach between clients and nurses. 2wT is an mHealth platform for conversational messaging between VMMC clinicians and clients, providing short messaging service (SMS) for post-operative telehealth care in lieu of scheduled, in-person visits. In Zimbabwe, and likely in other VMMC programs operating at scale, in-person, post-operative visits may be burdensome for patients and providers, leading to poor attendance [10, 11]. 2wT improved the quality of post-operative care while reducing HCW visit workload [19]. The 2wT approach for VMMC follow-up in Zimbabwe reduced VMMC program costs while improving client care engagement, with a net savings of $2.10 using 2wT over routine follow-up visits [14]. 2wT was also found to be highly usable and acceptable among clients and providers [20], reaching >31,000 VMMC clients in Zimbabwe by 2023 [21].

South Africa, with reported mobile-cellular subscriptions of 161.8 per 100 population in 2020 [22] is a good candidate for exploring cost-effective mobile phone innovations, like 2wT for VMMC. To test the 2wT approach in South Africa, I-TECH conducted a pragmatic RCT to test 2wT in urban and rural settings in South Africa in partnership with the Aurum Institute, the Centre for HIV-AIDS Prevention Studies (CHAPS) and Medic. Previously, we disseminated results from clinical and usability outcomes of the 2wT RCT in South Africa where 2wT improved the quality of post-operative care in both rural and urban settings, increasing the ascertainment of AEs, engaging males in follow-up care, and showing high acceptability for clients and providers [23, 24]. In growing recognition of the importance of costing research to inform HIV prevention interventions globally and in South Africa, we embedded a costing study within the South Africa 2wT RCT.

Costing of HIV prevention interventions is gaining recognition for its importance in informing policy and scale-up. In recent reviews of costing research on HIV prevention interventions in sub-Saharan Africa, 38 out of 159 studies (24%) were conducted in South Africa [25, 26]. Although there is clear evidence for VMMC as a cost-effective HIV reduction intervention [27, 28], to our knowledge, there is no costing research on innovations to improve efficiency of VMMC care delivery in South Africa. This costing study is nested in the clinical 2wT RCT [23]. The objective of this embedded study was to estimate the costs associated with 2wT mHealth follow-up as compared to routine in-person VMMC follow-up in rural and urban South Africa. While some clients may pay for transport for VMMC services in urban areas where services are typically more convenient, in rural areas, it is common that VMMC programs provide transportation for both the VMMC procedure and follow-up visits to increase VMMC uptake [29, 30]. The VMMC program in SA operates in predominantly rural areas [23]. As with the previous Zimbabwe study [14], the payer perspective is appropriate for this analysis as it is largely the VMMC program (the payer) that bears these follow-up costs and stands to gain the most from the 2wT approach to reduce unnecessary visits. As VMMC costs are largely provided by the global donor community, including the US President’s Emergency Plan for AIDS Relief (PEPFAR), and to mirror the approach taken to assess costs benefits of 2wT for VMMC in Zimbabwe, we assessed costs from the payer perspective. This approach is also in line with recent evidence suggesting continuing donor support for VMMC costs for at least 5 additional years given the cost-effectiveness of the overall VMMC intervention for HIV prevention [31].

Materials and methods

We applied the activity-based costing (ABC) approach to estimate the costs associated with 2wT intervention. We focused on estimating the marginal cost of follow-up for an additional VMMC client using the 2wT or routine follow-up approach.

Comparators

Routine care

The VMMC implementing partner, Centre For HIV-AIDS Prevention Studies (CHAPS), followed all National Department of Health (NDoH) protocols [32] for routine VMMC services, post-operative wound care counselling, in-person follow-up visits on post-surgery days 2 and 7, and tracing. Routine VMMC data collection defines the post-operative day 2 visit window from day 1 to day 4 and the day 7 visit window from day 5 to day 10. Typically, in urban CHAPS VMMC services, clients pay for their own transportation costs to attend the VMMC procedure visit and any follow-up visits, routine or potential AE related. In rural areas, the CHAPS team typically provides transportation both for the procedure visit and any follow-up, routine or potential AE related. Exceptions to transportation generalities in either setting do occur. NDoH policy requires participant tracing by phone calls and/or home visits, for those who do not attend post-operative reviews on days 2 and 7 in routine care (Table 1).

Table 1. Activities undertaken in the 2wT study.
Activities Routine 2wT
Day of male circumcision
    Adverse event (AEs) identification counselling Yes Yes
    Counselling on SMS interactions and photos of potential AEs named in daily message No Yes
Post-operative follow-ups
    Required day 2 and day 7 in-person visits Yes  No
In-person reviews for potential AEs on any day Yes Yes
    Day 1–13 SMS No Yes
    AE treatment  Yes Yes
Tracing via phone calls and home visits for lost to follow up (LTFU) Yes Yes

2wT intervention and specific 2wT RCT procedures

The 2wT approach for VMMC follow-up was described previously [19, 21, 23]. 2wT is a hybrid mHealth model integrating both automated SMS and individualized mHealth messaging between clients and a routine VMMC nurse. On day 0, 2wT clients were enrolled into a custom 2wT software application built using the open-source Community Health Toolkit (CHT). Before leaving the VMMC clinic, 2wT clients received enhanced post-operative counselling based on global VMMC guidelines [33] using the study-specific 2wT flipbook with additional wound care guidance, photos of AE warning signs, and instructions on how to respond to the daily SMS (Table 1). 2wT specific counseling helped 2wT clients understand the automated daily message that asked about the five common complications (i.e., bleeding, swelling, pus, redness, and wound opening), preparing men to take ownership over their wound care. 2wT participants received an automated daily text on days 1–13 in either English, Setswana, or isiZulu, and could respond in any language. Daily automated text messages read, “are you experiencing any bleeding, swelling, pus, pain, redness, wound opening, or other concern? Enter 1 = Yes; 0 (Zero) = No / I’m Ok, and press send.” Receiving and sending text messages was free for the participants. The SMS prompt encouraged the clients to reply with binary answers (0 for No, there is not a problem and 1 for Yes, there is a problem). Nurses communicated further via SMS with clients who reported any concerns and also made phone calls if needed. 2wT clients were not required to attend any clinic visits but could attend the clinic at any time if they needed. For 2wT men with a potential AE or with the need for further reassurance, the nurse triaged the participants for clinical visits the following day or earlier if an emergency was suspected. If 2wT clients did not respond to text messages by day 8, phone tracing was activated by the clinical VMMC team. All 2wT participants, in both arms, were asked to return for a study-specific visit on post-operative day 14 at which point a US$7 cell phone credit was given to all participants to compensate for time and travel. Participants were not traced via home visit for missing the study-specific day 14 visit. The day 14 visit window included visits from day 13 until day 21. Participants were declared off-study after day 21 or after completion of the day 14 visit.

An Enrolled Nurse cadre level led the 2wT interaction and patient follow-up activities at the rural site while a Professional Nurse cadre level led the follow-up activities at the urban site with additional supervisory duties across study sites.

Data collection and assumptions

While exceptions do occur, in general, it is most common that VMMC clients self-paid transportation costs in urban sites and that the program paid for client transportation costs in rural areas. These transportation commonalities are reflected in the payer perspective, representing CHAPS costs as part of their overall VMMC program costs funded by the major VMMC donor, PEPFAR. This is the most prevalent model of VMMC funding and was assumed for the current approach.

For the costing study, data were collected from three main sources: 1) RCT databases of routine VMMC data including client visits, AEs, and follow-up tracing; 2) the 2wT database; and 3) time-and-motion surveys designed for the costing component of the study. The first source, the RCT databases, included de-identified routine VMMC data on the number of visits attended, the number/type/severity of AEs, and the number of traced clients, by tracing method (phone and/or home visit). Visit costs associated with the study day 14 visit were excluded since it was specific to the RCT study and not considered routine VMMC follow-up care. The 2wT database contained enrolment data including transportation costs to the clinic. The 2wT database also included counts of inbound and outbound SMS. RCT-specific activities (e.g., additional consenting, RCT monitoring forms) were also not included in time-and-motion data.

Based on Time and Motion Form (S1 File), data collection tools were created using both Epicollect5 and Microsoft Excel and were piloted before data collection. Time-and-motion studies consisted of five days of direct observations at both rural and urban sites. We collected data about distance travelled using car odometer readings as well as time spent in travelling and conducting client reviews in the rural district of Bojanala, South Africa, between 29th November 2021 and 12th January 2022. Nurses took notes to specify how time was spent in each activity, providing additional qualitative data inputs for costing analysis. We collected reception time and nurse review time at the urban district of Ekurhuleni, South Africa, between 12th January 2022 and 24th January 2022.

It is assumed that (1) all fixed costs related to post-operative follow-ups were in place, and hence we focus on analysing marginal costs in serving an additional VMMC client in the system; (2) that full-time employees worked a 40-hour workweek or 160 hours per month; (3) that nurse counselling time was 5 minutes in routine counselling and 10 minutes for 2wT counselling; (4) that the nurse spent one minute per SMS response on average, and (5) that the average phone call time with a VMMC client was 5 minutes.

Hypotheses

We tested the following two hypotheses in our costing study:

Hypothesis 1: 2wT reduces post-VMMC care costs by triaging only those in need of in-person review to care, allowing most men to heal safely at home without in-person follow-up visits.

Hypothesis 2: 2wT saves more costs in rural VMMC program settings than in urban program settings.

Data analysis: Activity-based costing

Using an ABC approach, we estimated the costs in the post-VMMC care continuum from the perspective of the payer–the VMMC program with donor support. There were four activity categories in costing: counselling on the day of male circumcision, SMS follow-ups, physical follow-up visits, and tracing. All activity-based costs were estimated for 2wT care and routine care to test the hypotheses of cost savings. We applied ranges of ±50% uncertainty interval for parameters presented in Table 2 [14]. Input data were analysed using STATA version 14.0 and costing was conducted in Microsoft Excel. Editable costing tool (S1 Table) presented our input data and costing algorithms. All parameters can be adjusted to reflect new inputs and scenarios, providing a tool for future costing studies of 2wT impact in other settings, contexts, and salary structures. All costs were collected in the South African rand (ZAR) and converted into the United States dollar (USD) using the exchange rate ZAR 1 = $0.066.

Table 2. Summary statistics by activity category in rural and urban South Africa.

Parameters Sum Average Rural Urban Source
N (Uncertainty Interval) N (UI) N (UI) N (UI)
a) Arm of randomization
Routine 537 - 268 269 RCT study logs
2wT 547 - 273 274 RCT study logs
b) Post-operative counselling—Day 0
Enrolled Nurse wage (per month) - $1,205 (602.50 to 1,807.50) $1,205 (602.50 to 1,807.50) $1,205 (602.50 to 1,807.50) NDoH pay structure
Nurse counselling time in minutes (per patient)—Routine - 5 (2.5 to 7.5) 5 (2.5 to 7.5) 5 (2.5 to 7.5) Assumption
Nurse counselling time in minutes (per patient) - 2wT - 10 (5 to 15) 10 (5 to 15) 10 (5 to 15) Assumption
c) Text service for 2wT patients
SMS aggregated set-up cost (per month) - $74.26 (37.13 to 111.39) $74.26 (37.13 to 111.39) $74.26 (37.13 to 111.39) Africa is Talking
Cost per SMS - $0.02 (0.01 to 0.03) $0.02 (0.01 to 0.03) $0.02 (0.01 to 0.03) Africa is Talking
Mean number of automated texts (per patient)—outbox - 20.1 (10.05 to 30.15) 17.9 (8.95 to 26.85) 22.3 (11.15 to 33.45) Africa is Talking
Mean number of manual texts (per patient)—outbox - 5.65 (2.83 to 8.48) 4 (2 to 6) 7.3 (3.65 to 10.95) Africa is Talking
Mean number of texts (per patient)—inbox - 14.5 (7.25 to 21.75) 13 (6.5 to 19.5) 16 (8 to 24) Africa is Talking
Duration of 2wT program (days) - 13 (6.5 to 19.5) 13 (6.5 to 19.5) 13 (6.5 to 19.5) RCT study logs
d) Follow-up visits
Average number of visits attended—Routine - 1.34 (0.67 to 2.01) 1.26 (0.63 to 1.89) 1.42 (0.71 to 2.13) RCT study logs
Average number of visits attended - 2wT - 0.22 (0.11 to 0.33) 0.14 (0.07 to 0.21) 0.3 (0.15 to 0.45) RCT study logs
Unnecessary visits (Routine vs. 2wT) 1.12 (0.56 to 1.68) 1.12 (0.56 to 1.68) 1.12 (0.56 to 1.68) RCT study logs
Administrator reception time in minutes (per patient) - 1.34 (0.67 to 2.00) 0 2.67 (1.34 to 4.01) Time-motion study
Nurse review time in minutes (per patient) - 5.43 (2.71 to 8.14) 3.79 (1.90 to 5.69) 7.06 (3.53 to 10.59) Time-motion study
Administrator wage (per month) - $319 (159.5 to 478.5) 0 $638 (319 to 957) NGO pay structure
Nurse wage (per month) - $1676.5 (838.25 to 2514.75) $1,205 (602.50 to 1,807.50) $2,148 (1,074 to 3,222) NGO pay structure
Round trip distance to patient home (km) - - 39.64 (19.82 to 59.46) - Time-motion study
Litres of petrol (per km) - 0.06 (0.03 to 0.09) 0.06 (0.03 to 0.09) - Vehicle manual
Price of petrol (per litre) - $1.33 (0.67 to 2) $1.33 (0.67 to 2) - Automobile Association
Transportation time cost in minutes (per visit) - 25.5 (12.75 to 38.25) 34 (17 to 51) - Time-motion study
Transportation cost—nurse home visits (per visit) - $5.61 (2.81 to 8.42) $7.48 (3.74 to 11.22) $3.74 (1.87 to 5.61) RCT study logs
Patients with AEs–Routine (%) 0.01(0.005 to 0.014) - 0 0.02 (0.01 to 0.03) RCT study logs
Patients with AEs - 2wT (%) 0.02 (0.01 to 0.03) - 0.01(0.005 to 0.014) 0.03 (0.02 to 0.05) RCT study logs
Material cost per AE (e.g., antiseptic ointment) - $5.28 (2.64 to 7.92) $5.28 (2.64 to 7.92) $5.28 (2.64 to 7.92) RCT study logs
e) Tracing—Phone calls
Phone call service (per minute) - $0.08 (0.04 to 0.12) $0.08 (0.04 to 0.12) $0.08 (0.04 to 0.12) Public records
Time cost per call (minutes) - 5 (2.5 to 7.5) 5 (2.5 to 7.5) 5 (2.5 to 7.5) Assumption
Number of phone call attempts in tracing—Routine and 2wT - 3(1.5 to 4.5) 3(1.5 to 4.5) 3(1.5 to 4.5) RCT study logs
Patients missed day 2 & day 7 visits—Routine (%) 0.05 (0.03 to 0.08) - 0.02 (0.01 to 0.03) 0.09 (0.05 to 0.14) RCT study logs
Patients without post MC contact - 2wT (%) 0.09 (0.05 to 0.14) - 0.06 (0.03 to 0.09) 0.11 (0.06 to 0.17) RCT study logs
f) Tracing—Home visits
Mean distance to patient home (km) - 29.73 (14.87 to 44.60) 39.64(19.82 to 59.46) 28.54 (14.27 to 42.81) Time-motion study
Litres of petrol (per km) - 0.06(0.03 to 0.09) 0.06(0.03 to 0.09) 0.06 (0.03 to 0.09) Vehicle manual
Price of petrol (per litre) - $1.33(0.67 to 2) $1.33(0.67 to 2) $1.33(0.67 to 2) Automobile Association
Traced patients with no post MC contact—Routine (%) 0.03 (0.02 to 0.05) - 0.03 (0.02 to 0.05) 0.03 (0.02 to 0.05) RCT study logs
Traced patients with no post MC contact - 2wT (%) 0.002 (0.001 to 0.003) - 0.002 (0.001 to 0.003) 0.002 (0.001 to 0.003) RCT study logs

Counselling

Each VMMC client had a counselling session directly following circumcision. The post-operative counselling cost was estimated by the average time in minutes for a counselling session and wage per minute for the nurse performing the counselling.

Counselling cost = time * wage

SMS follow-ups

There were three components in SMS follow-ups per client. The first component was the ‘Africa is Talking’ SMS aggregator monthly set-up costs. The second component was the SMS service cost, i.e., the product of SMS unit cost and average number of SMS per client. The third component was the associated personnel cost of sending a manual SMS.

SMS cost = set-up cost + SMS service cost + manual SMS time cost

Follow-up visits and AE management

The rural costing model included the estimation of transportation fuel cost, transportation time cost, and nurse review time cost per visit. In urban settings, we estimated reception time cost and nurse review time cost per visit. We used the average number of follow-up visits per client by location. Transportation cost was paid by the program in rural settings whereas patients paid for transportation in urban settings. In the rural setting, an enrolled nurse interacted with clients via 2wT and usually drove out to meet clients at their homes or workplaces to conduct any requested post-VMMC reviews. In urban settings, clients interacted with clients via 2wT and typically returned to the clinic on their own for visits when needed or desired. Reception time cost only applied to urban settings as the rural settings did not have reception.

Cumulative moderate and severe AEs as defined by global VMMC standards [33] were reported from day 1 through day 21 by randomization group and by location. The time costs in treating AEs were included in overall follow-up visits. We estimated the material costs for AE management separately.

Rural visit cost = # of visits * (transportation fuel cost + transportation time cost + review time cost)

Urban visit cost = # of visits * (reception time cost + review time cost)

In rural settings, transportation fuel cost = Round trip distance to client home (km) * Litres of petrol (per km) * Price of petrol (per litre)

AE management = probability of AE * AE material cost

Tracing

In routine care, if the client missed both day 2 and day 7 visits, three phone calls were attempted to confirm healing. In the 2wT arm, if the client had no SMS contact by day 8, the client was actively traced via phone up to three attempts. Successful calls to clients in both arms took about 5 minutes If the client was not reachable by phone, up to three home visits were attempted for both study arms. The number of clients eligible for phone tracing and home tracing was reported in the RCT [23].

Phone tracing cost = probability of phone tracing * (phone call time cost in up to 3attempts + phone call service cost of a successful completed call).

For home tracing, transportation cost was estimated in the care model that the nurse drove to the client’s home to conduct the review. Transportation fuel cost, transportation time cost, and nurse review time cost were also included. We considered the least expensive model, in which the nurse also served as the driver. The urban tracing distance is 72% of the distance in rural settings according to the survey results in our RCT [23].

Home tracing cost = probability of home tracing * (transportation time cost in all attempts + transportation fuel cost in all attempts + review time cost in successful attempt).

For all tracing attempts, phone service costs and client review costs were only recorded for the successful attempt. For instance, if the nurse made three home visits and the client was reached in the last visit, the client review cost for only the one successful visit was included.

Ethics

This Multiple Principal Investigators (MPI) study was approved by the Internal Review Boards of the University of Washington (Study 00009703, PI: Feldacker) and the University of the Witwatersrand, Human Research Ethics Committee (Ethics Reference No: 200204, PI: Setswe). All RCT participants provided written informed consent for use of individual-level data collected from both 2wT study specific sources and routine VMMC program data collection. All data obtained and utilized for the costing study was de-identified data from study databases and contained no identifying information. As part of the overall RCT IRB approvals, a waiver of consent was granted for healthcare worker observations from the time-motion study.

Results

VMMC clients

A total of 1,460 VMMC clients were recruited for the RCT, and 141 (9.7%) clients were found ineligible for 2wT: 103 (45.2%) had no cell phones, 21 (5.7%) had a language barrier, 13 (3.5%) could not read or write, 2 (0.5%) were blind, and 2 (0.5%) were unfit to consent) [23]. The costing analysis included all 1,084 enrolled clients from the RCT: 537 clients in routine care and 547 clients in 2wT intervention. Table 2 indicates key costing parameters stratified by urbanicity. Average costs per client by randomization group, cost savings, and savings by location are presented in Table 3, with illustrations in Figs 1 and 2. Costing scenarios are presented in Table 4.

Table 3. Unit cost for routine care (standard of care (SoC) and 2wT ($USD).

  Rural Urban Average Overall
Costs per patient SoC 2wT 2wT vs. SoC Routine 2wT 2wT vs. SoC SoC 2wT SoC vs. 2wT
Post-op counselling—day 0 $0.63 $1.26 $0.63 $0.63 $1.26 $0.63 $0.63 $1.26 $0.63
Two-way texting $0.00 $1.05 $1.05 $0.00 $2.30 $2.30 $0.00 $1.67 $1.67
Set-up cost $0.00 $0.06 $0.06 $0.00 $0.06 $0.06 $0.00 $0.06 $0.06
SMS service cost $0.00 $0.49 $0.49 $0.00 $0.61 $0.61 $0.00 $0.55 $0.55
Manual SMS time cost $0.00 $0.50 $0.50 $0.00 $1.63 $1.63 $0.00 $1.07 $1.07
Follow-up visits $10.04 $1.12 -$8.92 $2.50 $0.53 -$1.97 $6.26 $0.82 -$5.44
Provider transportation fuel cost $4.05 $0.45 -$3.60 $0.00 $0.00 $0.00 $2.02 $0.23 -$1.80
Provider transportation time cost $5.39 $0.60 -$4.79 $0.00 $0.00 $0.00 $2.69 $0.30 -$2.39
Provider review time cost $0.60 $0.07 -$0.53 $2.50 $0.53 -$1.97 $1.55 $0.30 -$1.25
AE treatment (materials) $0.00 $0.04 $0.04 $0.10 $0.17 $0.08 $0.05 $0.11 $0.06
Tracing—Phone calls $0.03 $0.19 $0.16 $0.30 $0.39 $0.09 $0.16 $0.29 $0.12
Tracing—Home visits $0.73 $0.04 -$0.69 $0.56 $0.03 -$0.53 $0.64 $0.04 -$0.61
Total costs $11.42 $3.69 -$7.73 $4.08 $4.67 $0.59 $7.75 $4.18 -$3.56

Fig 1. Costs in USD for routine care and 2wT per client (USD).

Fig 1

Fig 2. Cost changes by implementing 2WT compared to the routine, rural vs. urban (USD).

Fig 2

Table 4. Potential cost savings from 2wT (USD).

Cost saving (2wT vs. Routine) Rural Urban Average
Routine—One visit -$5.66 $1.33 -$2.16
Routine—1.34 visits (observed) -$7.73 $1.33 -$3.56
Routine—Two visits -$13.63 -$0.43 -$7.02

Counselling

In both settings, an enrolled nurse with a monthly salary of $1,205 was assumed to spend 5 minutes in routine post-operative counselling and 10 minutes in 2wT counselling (Table 2). There was no difference in counselling time by location.

SMS follow-ups

The SMS aggregator set-up cost charged by ‘Africa is Talking’ was $74.25 per month for the 2wT system as detailed by Table 2. Each client was sent automated text messages for 13 days in a month of 30 days and the average cost per client was proportioned to 43% of the month. With 547 clients in 2wT, the set-up cost per client was $0.14. When ‘Africa is Talking’ serves more clients in future, the set-up cost is expected to reduce.

Table 2 also indicates that a standard SMS of 160 characters cost $0.02. Each 2wT client received 20.1 (10.05 to 30.15) messages on average, including 5.65 (2.83 to 8.48) manual messages from nurses. Clients sent an average of 14.5 (7.25 to 21.75) messages, total, between day 1 and Day 13 to report daily status and any AE concerns. Urban clients were more active in 2wT, sending an average of 3 more messages than rural clients. Similarly, there were 3 more messages from the nurse on average, per client, in urban settings than in rural settings.

Follow-up visits and adverse event management

Clinic visits

As previously reported in the RCT, and as expected per RCT intervention assignment, routine clients had more clinic follow-up visits than 2wT clients. Routine clients had 1.34 (0.67 to 2.01) visits on average between day 2 and day 13: 1.26 (0.63 to 1.89) in rural areas and 1.42 (0.71 to 2.13) in urban locations. 2wT clients had 0.22 (0.11 to 0.33) visits on average, with 0.14 (0.07 to 0.21) in rural areas and 0.3 (0.15 to 0.45) in urban clinics. Urban clients, in both routine and 2wT groups, had more visits than rural clients. Post-operative engagement in care was higher among 2wT arm than control: 94% of 2wT males responded to at least one 2wT message and 80.4% of control arm males attended at least 1 in-person, post-operative visit [23].

AE material cost

The study identified a total of 16 AEs across both arms. Among 719 visits in the routine arm, there were 5 AEs identified whereas 11 AEs were identified among 118 visits in 2wT arm. Material cost per AE, including bandage, paraffin gauze, and antiseptic ointment, was estimated at $5.28.

Salary and time cost

In the rural setting, Enrolled Nurses with a monthly salary of $1,205 conducted the post-VMMC reviews with 3.79 (1.90 to 5.69) minutes per client. In urban settings, administrators with a monthly salary of $638 facilitated reception with 2.67 (1.34 to 4.01) minutes per client and a Professional Nurse with a monthly salary of $2,148 conducted the reviews with 7.06 (3.53 to 10.59) minutes per client. The routine urban Professional Nurse salary was 1.78 higher than the rural Enrolled Nurse salary.

Transportation cost

In rural settings, routine VMMC teams drove to review clients or provided transport while urban clients were largely responsible for their own transportation. It was estimated that the round–trip distance to a client’s home on average was 39.64 (19.82–9.91) kilometers in rural areas. As indicated in the vehicle manual, the average fuel consumption of the vehicle that was used for tracing was 0.06L/km (6L/100km). Information from the Automobile Association reported the fuel price of $1.33/L [34]. The transportation fuel cost was $3.21 (1.61 to 4.82) in rural areas.

From time-motion data, it was estimated that the program’s transportation time per client visit was 34 minutes in rural settings. No client transportation was provided by the program in urban settings over the observation period.

Tracing

Among routine men, 29 clients did not attend any visit and were potentially lost-to-follow-up (LTFU). Potential LTFU were traced first by phone; 17/29 were not reached by phone and were traced by home visit. For the participants in the 2wT arm, 47 had no contact by day 8 post-VMMC; 46 were reached by phone and 1 was traced by home visit.

The cost of phone call was $0.08 per minute. It was assumed that an Enrolled Nurse conducted the phone calls, and an average phone call time was 5 minutes. To trace potential LTFU clients, it was assumed that on average 3 phone calls were attempted in both routine group and 2wT group. In home tracing, the transportation fuel cost was the same as the clinic visit. The estimated tracing transportation costs on average, including fuel and personnel costs, were $0.64 and $0.04 in rural and urban areas, respectively. According to our time-motion study, it is important to note that home visits were costly both in terms of money and time, especially in rural areas. The average travel time to reach one client was 34 minutes (range: 17 to 51 minutes) and the average review time was 3.8 minutes (range: 1.9 to 5.7 minutes). On a typical day of rural tracing, the nurse spent 90% of the time driving. On average, 5 clients (range: 2.5 to 7.5 clients) would be traced in one day in rural settings.

Costs and cost savings

Table 2 shows that there were, on average, 1.12 unnecessary post-operative visits per person, reflecting the difference between average number of in-person visits in the control arm (1.34) and average number of elected visits in the 2wT arm (0.22). In the 2wT arm, visit attendance reflects demand for in-person, post-VMMC care, 0.14 and 0.3 visits in rural and urban areas, respectively.

Table 3 shows that the average cost per post-operative visit was $7.75 in routine care and $4.18 in 2wT. The cost saving of $3.56 was primarily seen in rural areas ($7.73), with no savings in urban areas (with $0.59 increased cost). Table 3 also shows the disaggregation of costs by location. The average post-operative counselling cost was $0.63 and $1.26 in routine and 2wT groups, respectively. SMS costs were only incurred among the 2wT group, with $1.67 average costs, of which $2.30 was in urban areas and $1.05 in rural areas.

Fig 1 illustrates the cost distribution across the post-VMMC care continuum. In the 2wT group, the costs were concentrated in early actions within the care continuum, including counselling ($1.26) and SMS ($1.67), which accounted for 70% of the overall costs. By contrast, in the routine group, most of the financial investment was in clinical visits, $6.26 out of $7.75 (81%), followed by counselling ($0.63). In the post-VMMC care continuum, 2wT intervention shifts the healthcare effort to preparing the client to actively engage in their healing process and to encourage them to promptly seek care via consistent daily communication with the client from day 1 to day 13.

Fig 2 demonstrates costs and savings by urbanicity. Overall, there were $0.59 cost increases in urban areas and $7.73 savings in rural area by implementing 2wT instead of utilizing routine care. Cost savings were from reduced follow-up visits ($1.97 in urban areas and $8.92 in rural areas). Savings from home visits in tracing were $0.53 in urban areas and $0.69 in rural areas. Increased costs in 2wT arm by location included counselling ($0.63, the same in each location), SMS ($2.30 in urban areas and $1.05 in rural areas), AE materials ($0.08 in urban areas and $0.04 in rural areas), and calls ($0.09 in urban areas and $0.16 in rural areas).

Other scenarios

Table 4 depicts three scenarios, by location, in comparing cost savings of using 2wT compared to routine care visits namely one visit, 1.34 visits on average, and two visits within routine care. If there had been one required visit per client in routine care, the average cost saving was calculated at $2.16 per client. In the scenario drawn from the pragmatic RCT of 1.34 visits within routine care, the average cost saving was $3.56. If two follow-up visits were required per client in routine, the average cost saving was $7.02 per client. An addition scenario with Enrolled Nurse salary applied to both rural and urban settings had little impact, with average overall savings of $3.14 using 2wT over routine with the observed visit patterns, showing the robustness of these savings over modest salary changes.

Discussion

In this costing analysis, we determined that 2wT-based VMMC follow-up saved an average of $3.56 per client across settings, with savings ranging from $2.16 to $7.02. 2wT improves the quality of post-VMMC follow-up care at lower overall cost by providing an SMS-based mHealth option for clients with access to cell phones, encouraging visits when needed instead of compulsory visits on day 2 and/or day 7. Savings using the 2wT approach were higher in rural as compared to urban areas–an important finding as the majority of VMMC program implementation occurs in rural areas [14]. Even though using 2wT costs slightly more in urban areas, the better quality of post-VMMC follow-up care justifies these additional costs. Among 2wT costs, the largest costs were for the SMS, themselves, an investment to actively engage men into quality follow-up care with a 2wT nurse for reassurance or triaging to in-person review when needed. The 2wT clients on average received 20.1 text messages and sent 14.45 text messages in the post-operative period for an SMS cost of $1.67 per client. In urban areas, males interacted more via 2wT, raising costs but also increasing direct client-to-clinician communication. Cost savings using 2wT as compared to routine post-operative care were similar in the 2wT RCT conducted in Zimbabwe that found a net savings of $2.10 from the payer (Ministry of Health or donor) perspective [14]. As attendance at routine post-operative visits may be overreported in VMMC programs operating at scale, cost savings and benefits for quality follow-up care using the 2wT approach may be underestimated.

Cost savings from 2wT vary by adherence to required attendance at post-VMMC visits and by location. Given that moderate and severe AE rates in male circumcisions are low (1%-2%) [4], it is costly to require all VMMC clients to attend one or two post-operative in-person clinic visits. 2wT can save an average of $7.02 ($13.63 savings in rural and $0.43 savings in urban) compared to the routine care with two required visits. Our study shows that routine follow-up in rural areas was expensive as the district geography is expansive. For scheduled day 2 and day 7 post-operative visits, the CHAPS rural VMMC team of a nurse and a dedicated driver, arranged to meet the clients at a convenient community location for physical client reviews or a client contacted the CHAPS VMMC team for pickup or an in-person home visit, with occasional clients returning independently to the VMMC site. In contrast, the urban model had three teams based at three static clinics. Urban clients were expected to commute for review visits, independently, at the dedicated static sites.

2wT may increase some costs that are likely offset by additional quality care benefits. Firstly, enhanced counselling incurred a minimal cost of $0.63, but enabled the clients to effectively identify and communicate AE concerns in daily SMS–a worthwhile cost. Second, daily SMS communication improved early detection of AEs and subsequent swift referral of those in need for in-person clinical visits. This triaging process led to identification of AEs earlier with less severity, likely averting costs of more severe AEs [23]. Third, only the clients with AE concerns or those desiring reassurance attended clinic visits, resulting in only 0.22 elected visits per 2wT client (Table 3), a reduction in review workload. Lastly, reduced follow-up visits could allow providers to concentrate on cases in need of medical attention and free up time to commence surgery early and on-time, potentially increasing client satisfaction.

Quality assurance likely also benefits from 2wT improvements in verification of, and supervision for, quality post-operative care. For NDoH, 2wT follow-up adhered to government regulations regarding client privacy and complied with required NDoH documentation for VMMC client follow-up. The 2wT system provides verification of timely, nurse-led, post-operative support in line with PEPFAR guidelines, facilitating quality follow-up regardless of client location. 2wT documentation also provides another layer of quality assurance to confirm program performance. Unique client verification via the 2wT system increases confidence in program productivity, providing another data source to prevent duplication in reporting. Although not formally considered in the costing analysis, supervision costs of 2wT may be lower than those for routine care. Routine monitoring of care quality via review of paper forms is time-consuming, requiring intensive efforts. However, 2wT dashboards and system-embedded hierarchies allow for remote client oversight and access to data for timely program monitoring. Supervisors can access 2wT messages, reports, tasks, and client records from multiple sites or remotely from a central location. Similarly, quality assurance activities can also take place virtually, allowing managers and program administrators to review data and provide clinical oversight, informing improvements. In future, calculation of these costs may demonstrate further benefit of the 2wT approach for routine VMMC follow-up.

Limitations

There are several assumptions and limitations in this study. First, this study focuses on the cost of the activities to serve an average client presuming that 2wT is implemented within an existing routine VMMC service. Therefore, start-up costs (e.g., developing text message library, translation to local languages, adaptation to South Africa context) and fixed costs (e.g., full-time employment dedicated to 2wT, cell phones, computers, vehicle purchase, insurance, maintenance cost) were excluded. Second, we conducted costing from the perspective of the VMMC program and current guidelines to inform feasibility of adoption by the NDoH, assuming the existing VMMC donors would continue support for at least the 5-year time frame. However, with any payer (Ministry of Health, donor, or program), and evolving guidelines, 2wT costs and comparators could change over time. Third, we used the standard workweek in South Africa, i.e., 5 days per week, from Monday to Friday. In calculating hourly wage, we used the salary of the Enrolled Nurse cadre and did not take into account that some nurses work on weekends and public holidays or may have additional days off, such as annual leave or sick leave–considerations that could affect costs. For AE management, only costs related to reportable moderate and severe cases are documented and noted in this study. We did not measure the costs to manage mild AEs such as pain. Lastly, we explored will see savings (monetary cost) in reduced transportation fuel costs that the reduced staff time required for follow-up (an opportunity cost not a monetary cost savings) means that overall monetary costs to the program are likely to increase.

Conclusion

Evidence from two RCTs in Zimbabwe and South Africa demonstrate that this 2wT approach provides high-quality VMMC follow-up as compared to required in-person reviews and lowers overall VMMC program costs. Rural savings using 2wT offset nominal increased costs in urban areas. Additional 2wT associated improvements in care quality, supervision, and verification also likely leading to longer-term savings. The health sector should invest in 2wT. In the context of National VMMC targets of 350,000 to 500,000 VMMCs per annum, employing 2wT could dramatically reduce the number of in-person post-operative reviews, resulting in concrete efficiency gains and significant annual program savings. Investing these resources back into the VMMC program could further expand VMMC access, improve care quality, and advance VMMC program goals of safe, efficient, and effective VMMC scale-up.

Supporting information

S1 File. 2wT costing study EpiCollect form.

Tool used for 2WT time-in-motion client follow-up data collection.

(PDF)

S1 Table. 2wT costing tool.

Modifiable Excel spreadsheet for 2wT scenario costing.

(XLSX)

Acknowledgments

The authors would like to thank the following: the Departments of Health of the Gauteng and Northwest Provinces, Bojanala district and the Ekurhuleni Health District Research Committee (EHDRC) for allowing us to conduct the study in their districts; implementing partner, Right to Care and the CHAPS study implementation team. The authors would like to thank the Medic team and all study participants for their involvement in the study. The authors would like to thank Lingchao Mao and Ziwei He for independent replications of the results as well as thank Simon Ding and Emily Chu for their comments.

Abbreviations

2wT

Two-way texting

AE(s)

adverse event(s)

CHAPS

Centre For HIV-AIDS Prevention Studies

VMMC

male circumcision

NDoH

National Department of Health

PEPFAR

President’s Emergency Plan for AIDS Relief

SA

South Africa

WHO

World Health Organization

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

Research reported in this publication was supported by the National Institute of Nursing Research (NINR) of the National Institutes of Health under award number 5R01NR019229, “Expanding and Scaling Two-way Texting to Reduce Unnecessary Follow-Up and Improve Adverse Event Identification Among Voluntary Medical Male Circumcision Clients in the Republic of South Africa.” There was no additional external funding received for this study. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Titus MJ, Moodley J. Male circumcision as a public health measure for the prevention of HIV transmission. Southern African Journal of Epidemiology and Infection. 2011;26(4):262–5. [Google Scholar]
  • 2.Bershteyn A, Mudimu E, Platais I, Mwalili S, Zulu JE, Mwanza WN, et al. Understanding the Evolving Role of Voluntary Medical Male Circumcision as a Public Health Strategy in Eastern and Southern Africa: Opportunities and Challenges. Curr HIV/AIDS Rep. 2022;19(6):526–36. Epub 2022/12/03. doi: 10.1007/s11904-022-00639-5 ; PubMed Central PMCID: PMC9759505. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Hellar A, Plotkin M, Lija G, Mwanamsangu A, Mkungume S, Christensen A, et al. Adverse events in a large-scale VMMC programme in Tanzania: findings from a case series analysis. J Int AIDS Soc. 2019;22(7):e25369. Epub 2019/08/02. doi: 10.1002/jia2.25369 ; PubMed Central PMCID: PMC6669321. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Muchiri E, Charalambous S, Ginindza S, Maraisane M, Maringa T, Vranken P, et al. Description of adverse events among adult men following voluntary medical male circumcision: Findings from a circumcision programme in two provinces of South Africa. PloS one. 2021;16(8):e0253960. Epub 2021/08/18. doi: 10.1371/journal.pone.0253960 ; PubMed Central PMCID: PMC8370616. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Omollo V, Marongwe P, Vernon M, Thoko M, Paidamoyo G, Farai G, et al. Adverse event trends within a large-scale, routine, voluntary medical male circumcision program in Zimbabwe, 2014–2019. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2021;88(2):173–80. doi: 10.1097/QAI.0000000000002751 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.O’Bryan G, Feldacker C, Ensminger A, Nghatanga M, Brandt L, Shepard M, et al. Adverse event profile and associated factors following surgical voluntary medical male circumcision in two regions of Namibia, 2015–2018. PloS one. 2021;16(10):e0258611. Epub 2021/10/21. doi: 10.1371/journal.pone.0258611 ; PubMed Central PMCID: PMC8528325. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Lucas T, Cooney C, Prainito A, Godfrey C, Kiggundu V, Thomas AG, et al. Consolidated Overview of Notifiable Adverse Events in the US President’s Emergency Plan for AIDS Relief’s Voluntary Medical Male Circumcision Program Through 2020. Current HIV/AIDS Reports. 2022:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.South Africa National AIDS Council. South Africa’s national strategic plan for HIV, TB and STIs 2017–2022. Pretoria: South African National AIDS Council, 2017. [Google Scholar]
  • 9.UNAIDS. Voluntary medical male circumcision. Steady progress in the scaleup of VMMC as an HIV prevention intervention in 15 eastern and southern African countries before the SARS-CoV2 pandemic. Geneva2021. [Google Scholar]
  • 10.Feldacker C, Murenje V, Makunike-Chikwinya B, Hove J, Munyaradzi T, Marongwe P, et al. Balancing competing priorities: Quantity versus quality within a routine, voluntary medical male circumcision program operating at scale in Zimbabwe. PloS one. 2020;15(10):e0240425. doi: 10.1371/journal.pone.0240425 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Marongwe P, Gonouya P, Madoda T, Murenje V, Tshimanga M, Balachandra S, et al. Trust but verify: Is there a role for active surveillance in monitoring adverse events in Zimbabwe’s large-scale male circumcision program? PloS one. 2019;14(6):e0218137. doi: 10.1371/journal.pone.0218137 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Gentili A, Failla G, Melnyk A, Puleo V, Tanna GLD, Ricciardi W, et al. The cost-effectiveness of digital health interventions: A systematic review of the literature. Front Public Health. 2022;10:787135. Epub 2022/08/30. doi: 10.3389/fpubh.2022.787135 ; PubMed Central PMCID: PMC9403754. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Iribarren SJ, Cato K, Falzon L, Stone PW. What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PloS one. 2017;12(2):e0170581. doi: 10.1371/journal.pone.0170581 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Babigumira JB, Barnhart S, Mendelsohn JM, Murenje V, Tshimanga M, Mauhy C, et al. Cost-effectiveness analysis of two-way texting for post-operative follow-up in Zimbabwe’s voluntary medical male circumcision program. PloS one. 2020;15(9):e0239915. Epub 2020/10/01. doi: 10.1371/journal.pone.0239915 ; PubMed Central PMCID: PMC7526887. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Griffee K, Martin R, Chory A, Vreeman R. A Systematic Review of Digital Interventions to Improve ART Adherence among Youth Living with HIV in sub-Saharan Africa. AIDS Research and Treatment. 2022;2022:9886306. doi: 10.1155/2022/9886306 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Grundy Q. A Review of the Quality and Impact of Mobile Health Apps. Annu Rev Public Health. 2022;43:117–34. Epub 2021/12/16. doi: 10.1146/annurev-publhealth-052020-103738 . [DOI] [PubMed] [Google Scholar]
  • 17.McCool J, Dobson R, Whittaker R, Paton C. Mobile Health (mHealth) in Low- and Middle-Income Countries. Annu Rev Public Health. 2022;43:525–39. Epub 2021/10/15. doi: 10.1146/annurev-publhealth-052620-093850 . [DOI] [PubMed] [Google Scholar]
  • 18.Iribarren SJ, Brown W 3rd, Giguere R, Stone P, Schnall R, Staggers N, et al. Scoping review and evaluation of SMS/text messaging platforms for mHealth projects or clinical interventions. Int J Med Inform. 2017;101:28–40. Epub 2017/03/30. doi: 10.1016/j.ijmedinf.2017.01.017 ; PubMed Central PMCID: PMC5398898. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Feldacker C, Murenje V, Holeman I, Xaba S, Makunike-Chikwinya B, Korir M, et al. Reducing Provider Workload While Preserving Patient Safety: A Randomized Control Trial Using 2-Way Texting for Postoperative Follow-up in Zimbabwe’s Voluntary Medical Male Circumcision Program. JAIDS Journal of Acquired Immune Deficiency Syndromes. 2020;83(1):16–23. doi: 10.1097/QAI.0000000000002198 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Feldacker C, Holeman I, Murenje V, Xaba S, Korir M, Wambua B, et al. Usability and acceptability of a two-way texting intervention for post-operative follow-up for voluntary medical male circumcision in Zimbabwe. PloS one. 2020;15(6):e0233234. Epub 2020/06/17. doi: 10.1371/journal.pone.0233234 ; PubMed Central PMCID: PMC7297350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Marongwe P, Wasunna B, Gavera J, Murenje V, Gwenzi F, Hove J, et al. Transitioning a digital health innovation from research to routine practice: Two-way texting for male circumcision follow-up in Zimbabwe. PLOS Digit Health. 2022;1(6):e0000066. Epub 2023/02/23. doi: 10.1371/journal.pdig.0000066 ; PubMed Central PMCID: PMC9931231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Statista. Number of mobile cellular subscriptions per 100 inhabitants in South Africa from 2000 to 2020 2021 [cited 2023 October 1, 2023]. Available from: https://www.statista.com/statistics/510599/mobile-cellular-subscriptions-per-100-inhabitants-in-south-africa/. [Google Scholar]
  • 23.Feldacker C, Pienaar J, Wasunna B, Ndebele F, Khumalo C, Day S, et al. Expanding the Evidence on the Safety and Efficiency of 2-Way Text Messaging–Based Telehealth for Voluntary Medical Male Circumcision Follow-up Compared With In-Person Reviews: Randomized Controlled Trial in Rural and Urban South Africa. Journal of Medical Internet Research. 2023;25:e42111. doi: 10.2196/42111 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Day S, Ncube V, Maja L, Wasunna B, Pienaar J, Setswe G, et al. Centering Frontline Health Care Workers in Digital Innovation Design to Inform the Optimization of an App for Improved Male Circumcision Follow-up in South Africa: Qualitative Usability Study. JMIR Form Res. 2023;7:e44122. Epub 2023/03/23. doi: 10.2196/44122 ; PubMed Central PMCID: PMC10131628. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Cameron DB, Mustafa Diab M, Carroll LN, Bollinger LA, DeCormier Plosky W, Levin C, et al. The state of costing research for HIV interventions in sub-Saharan Africa. African Journal of AIDS Research. 2019;18(4):277–88. doi: 10.2989/16085906.2019.1679200 [DOI] [PubMed] [Google Scholar]
  • 26.Meyer-Rath G, van Rensburg C, Chiu C, Leuner R, Jamieson L, Cohen S. The per-patient costs of HIV services in South Africa: systematic review and application in the South African HIV investment case. PloS one. 2019;14(2):e0210497. doi: 10.1371/journal.pone.0210497 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Kahn JG, Marseille E, Auvert B. Cost-effectiveness of male circumcision for HIV prevention in a South African setting. PLoS Med. 2006;3(12):e517. Epub 2006/12/30. doi: 10.1371/journal.pmed.0030517 ; PubMed Central PMCID: PMC1716193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Kripke K, Chen PA, Vazzano A, Thambinayagam A, Pillay Y, Loykissoonlal D, et al. Cost and Impact of Voluntary Medical Male Circumcision in South Africa: Focusing the Program on Specific Age Groups and Provinces. PloS one. 2016;11(7):e0157071. Epub 2016/07/15. doi: 10.1371/journal.pone.0157071 ; PubMed Central PMCID: PMC4943592. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Atkins K, Yeh PT, Kennedy CE, Fonner VA, Sweat MD, O’Reilly KR, et al. Service delivery interventions to increase uptake of voluntary medical male circumcision for HIV prevention: A systematic review. PloS one. 2020;15(1):e0227755. Epub 2020/01/14. doi: 10.1371/journal.pone.0227755 ; PubMed Central PMCID: PMC6957297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Kennedy CE, Yeh PT, Atkins K, Fonner VA, Sweat MD, O’Reilly KR, et al. Economic compensation interventions to increase uptake of voluntary medical male circumcision for HIV prevention: A systematic review and meta-analysis. PloS one. 2020;15(1):e0227623. Epub 2020/01/16. doi: 10.1371/journal.pone.0227623 ; PubMed Central PMCID: PMC6961886. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Bansi-Matharu L, Mudimu E, Martin-Hughes R, Hamilton M, Johnson L, Ten Brink D, et al. Cost-effectiveness of voluntary medical male circumcision for HIV prevention across sub-Saharan Africa: results from five independent models. Lancet Glob Health. 2023;11(2):e244–e55. Epub 2022/12/24. doi: 10.1016/S2214-109X(22)00515-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.National Department of Health of the Republic of South Africa. South African National Guidelines for Medical Male Circumcision. Department of Health of the Republic of South Africa, 2016. [Google Scholar]
  • 33.Population Services International CoSoE, Central and Southern Africa (COSECSA), U.S. Centers for Disease Control and Prevention,. Adverse Event Action Guide for Voluntary Medical Male Circumcision by Surgery or Device. 2020. December 2020. Report No. [Google Scholar]
  • 34.Automobile Association of South Africa. Fuel pricing 2022. [cited 2023 Oct 1]. Available from: https://aa.co.za/fuel-pricing/. [Google Scholar]

Decision Letter 0

Lisa Suzanne Dulli

3 Mar 2023

PONE-D-23-01844Cost savings in male circumcision post-operative care continuum in rural and urban South Africa: Evidence on the importance of initial counselling and daily SMSPLOS ONE

Dear Dr. Su,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. As you will note, the comments provided by two reviewers are significantly more substantial than the third. I ask that you carefully review all comments and either edit the paper accordingly or provide a thoughtful, rationale rebuttal to any comments with which you disagree.

Please submit your revised manuscript by Apr 17 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Lisa Suzanne Dulli, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. Thank you for stating in your Funding Statement: 

"Research reported in this publication was supported by the National Institute of Nursing Research (NINR) of the National Institutes of Health under award number 5R01NR019229, “Expanding and Scaling Two-way Texting to Reduce Unnecessary Follow-Up and Improve Adverse Event Identification Among Voluntary Medical Male Circumcision Clients in the Republic of South Africa.”

Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now.  Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement. 

Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf.

4. Thank you for stating the following financial disclosure: 

"Research reported in this publication was supported by the National Institute of Nursing Research (NINR) of the National Institutes of Health under award number 5R01NR019229, “Expanding and Scaling Two-way Texting to Reduce Unnecessary Follow-Up and Improve Adverse Event Identification Among Voluntary Medical Male Circumcision Clients in the Republic of South Africa.” The content is solely the responsibility of the authors and does not necessarily represent the official views of  the National Institutes of Health."

Please state what role the funders took in the study. If the funders had no role, please state: ""The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."" 

If this statement is not correct you must amend it as needed. 

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

5. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please ensure that your ethics statement is included in your manuscript, as the ethics statement entered into the online submission form will not be published alongside your manuscript. 

6. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: I Don't Know

Reviewer #3: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: General Comments

The authors are to be commended for designing and completing an rigorous study comparing alternative ways to handle VMMC post-op care. While the main finding of reduced use of in-person health services associated with the two-way texting (2wT) compared to routine in-person follow-up is not in question, there is some concern about who realizes the cost-savings and the implications for the health sector. As shown in Table 4, the bulk of the cost savings from 2wT comes from reduced follow-up visits (0.22 per person in the 2wT cohort (line 254) vs. 1.34 in the routine cohort (line 252)). Yet, these differences are more likely to result in financial (transport) and time savings (opportunity costs) to the clients than cost savings to the health system. I understand your attempt to monetize these as savings to the health system by considering three hypothetical scenarios, but the fact remains that these will be savings to the client and therefore it is disingenuous to talk about these as savings to the health system as you do in the conclusion. In fact, the savings within the health system are most likely going to be labor time savings (opportunity costs) and not monetary savings due to reduced use of consumable supplies. If you remove the cost of transport for follow-up visits (~$3.91 from line 287), then there would no longer be a monetary savings to the health sector. This does not mean that this type of intervention is not worth supporting as it does not lead to worse outcomes and is certainly more convenient to the clients while at the same time reducing the workload burden within the health system.

I would encourage the authors to consider presenting the results with stratification as to who bears the cost (health system or clients) rather than create the hypothetical scenario where client costs are loaded onto the health system. This would make the analysis more transparent and avoid the trap of thinking of the savings as monetary savings when the majority are opportunity cost savings as current health care staff are now available to address other needs.

Specific Comments:

Line 327: Where does the $7.6 (76%) figure come from. Looking at Table 4, should the denominator be $6.48 and the percentage 83%? Also, it is customary to report USD with 2 decimal places (applies throughout text and figure 1.

Table 4, can you include “$” in the Total cost row so it is clear that these are all USD amounts?

Fig 1: Please add a vertical axis title making it explicit that these are USD amounts in the bars.

Fig 2: Please add a vertical axis title making it explicit that these are USD amounts in the bars.

Table 5: Label second data row as Routine – 1.34 visits (observed).

Lines 387 – 394: This is where I think you are overselling your results. These will not be monetary savings that can be reprogramed to different uses. Most will be time savings for existing staff which can be repurposed as discussed in the preceding paragraph.

Lines 414-416: Rephrase this once you know where the cost savings occur (health sector or clients).

Reviewer #2: This is a well-conducted costing assessment of an SMS-based alternative to routine follow-up care for VMMC compared with standard of care, which involves several return clinic visits. The intervention is relevant and well described, and the need to assess cost and potential cost-savings is also well established. I am not an expert in costing analyses and certainly suggest that at least one reviewer be selected who is such an expert. However, based on my reading it seemed to be both well conducted and clearly presented. I found the overall manuscript to be well written and appropriately justified in each section. I did see one or two potential wording edits – for example, I would suggest that all results be reported in the past tense. However, I overall believe this is a strong manuscript and support its publication.

Reviewer #3: Please see my reviewer report attached separately. It will be easier to reach that document as formatted rather than writing more here.

Please see my reviewer report attached separately. It will be easier to reach that document as formatted rather than writing more here.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Caitlin Kennedy

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Reviewer Report -- 2wT VMMC.docx

PLoS One. 2023 Nov 16;18(11):e0294449. doi: 10.1371/journal.pone.0294449.r002

Author response to Decision Letter 0


30 Jun 2023

We thank the editor and reviewers for reviewing this paper and providing constructive comments and suggestions. Point-to-point response to each comment is provided in the attached document, and corresponding changes in the manuscript are tracked.

Best,

Yanfang, Rachel, Caryl and co-authors

Attachment

Submitted filename: Response to Reviewers 6.30.2023.docx

Decision Letter 1

Lisa Suzanne Dulli

21 Aug 2023

PONE-D-23-01844R1Cost savings in male circumcision post-operative care using two-way texting mHealth in rural and urban South AfricaPLOS ONE

Dear Dr. Su,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Only one of the previous reviewers was available to review your revisions. With my own review, it seems as though many of the comments submitted by the other reviewers were either largely addressed or you were able to explain your decision not to address the points. However, I do agree with the first reviewer that the results of the study are not being adequately contextualized and are even being "oversold" as to their importance. The manuscript does hold merit if the authors are able to make some few remaining adjustment. Specifically, the discussion section begins with a statement regarding the average cost-savings per client in this study. Two very important points are not well addressed. First, nearly all the costs savings were seen in the rural intervention setting. In fact, the 2wT intervention was more costly than routine follow-up in the urban setting. Yet, your conclusion begins "With evidence from two RCTs in Zimbabwe and South Africa demonstrating 2wT safety and cost benefits in urban and rural contexts, the health sector should invest in 2wT." Results from this study do not demonstrate a cost benefit in urban settings, and recommendations to invest in the intervention would only benefit programs with a larger rural client population, based on costs alone.  Your estimates of the potential cost benefits are predicated on your findings that included a sample with equal numbers of participants in both the urban and rural settings for both study arms. This condition needs to be made clear. Second, as one reviewer pointed out, the majority of savings are from follow-up visits and driven predominately by cost-savings in provider time (Table 3). As the first reviewer noted, "These will not be monetary savings that can be reprogramed to different uses. Most will be time savings for existing staff which can be repurposed..."  This also needs to come out more clearly in the text. Both of these points will likely be key considerations for a country or a program that might consider this intervention. Lastly, one smaller point noted by review 1 is that both figures are missing axis titles. Please add so the figures are able to stand alone and be completely understood.

Please submit your revised manuscript by Oct 05 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Lisa Suzanne Dulli, PhD

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: General Comments:

Thank you for the clarification that the PEPFAR supported programs are covering the transport costs for clients in the rural area. Also, the emphasis on looking at costs from the payer’s perspective. However, I am still concerned that while the PEPFAR-funded program (CHAPS) will see savings (monetary cost) in reduced transportation fuel costs that the reduced staff time required for follow-up (an opportunity cost not a monetary cost savings) means that overall monetary costs to the program are likely to increase. A further concern is why provider time is being assigned to transportation. If providers are leaving the clinic to visit the client at their home or somewhere else in the community, that provider is accumulating a lot of time when they are not available for other clients. In a country with shortages of skilled personnel this seems like a poor use of human resources. Why not send a driver to pick the client and return them home while the auxiliary nurse remains at the clinic to assist other clients? As mentioned on line 321, on a day of rural tracing the nurse is spending 90% of the time driving.

I am still troubled by the conclusion that the use of 2wT could yield savings of over $1.1 million per year (line 442). As stated above, the labor savings are not monetary savings so there is no budgetary reduction associated with these “savings”. Also, I’m not sure there is evidence to suggest men’s hesitancy to take up VMMC because of the need to return for follow-up visits and with more efficient follow-up that uptake would increase (lines 444-446).

Specific Comments:

Line 214 & 215 (& perhaps elsewhere) replace “Aes” with “AEs”. My guess is your word processing software was trying to be helpful .

Line 242-244: The decision to only count the cost for a successful attempt even if multiple attempts were required seems to put downward bias on tracing costs. Please justify this decision.

Line 360: According to Line 113, NDoH protocols already require two post-surgery follow-up visits. So why is this being treated as a hypothetical scenario?

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Nov 16;18(11):e0294449. doi: 10.1371/journal.pone.0294449.r004

Author response to Decision Letter 1


1 Oct 2023

Response to reviewers

PONE-D-23-01844R1

Cost savings in male circumcision post-operative care using two-way texting mHealth in rural and urban South Africa

September 29, 2023

Dear Plos ONE Editorial Team,

Thank you very much for the opportunity to revise the manuscript again to comply with these additional helpful comments. We have reviewed and updated the text, responded to the remaining suggestions, and provided an explanation for outstanding issues which we hope will alleviate any remaining issues before consideration of publication. We respond in italics to the remaining issues and provided a track changes version to review additional revisions, edits, and updates for clarity throughout.

Editor: I do agree with the first reviewer that the results of the study are not being adequately contextualized and are even being "oversold" as to their importance. The manuscript does hold merit if the authors are able to make some few remaining adjustment. Specifically, the discussion section begins with a statement regarding the average cost-savings per client in this study. Two very important points are not well addressed.

First, nearly all the costs savings were seen in the rural intervention setting. In fact, the 2wT intervention was more costly than routine follow-up in the urban setting. Yet, your conclusion begins "With evidence from two RCTs in Zimbabwe and South Africa demonstrating 2wT safety and cost benefits in urban and rural contexts, the health sector should invest in 2wT." Results from this study do not demonstrate a cost benefit in urban settings, and recommendations to invest in the intervention would only benefit programs with a larger rural client population, based on costs alone. Your estimates of the potential cost benefits are predicated on your findings that included a sample with equal numbers of participants in both the urban and rural settings for both study arms. This condition needs to be made clear. Second, as one reviewer pointed out, the majority of savings are from follow-up visits and driven predominately by cost-savings in provider time (Table 3). As the first reviewer noted, "These will not be monetary savings that can be reprogramed to different uses. Most will be time savings for existing staff which can be repurposed..." This also needs to come out more clearly in the text. Both of these points will likely be key considerations for a country or a program that might consider this intervention.

Response:

Thank you for this opportunity to provide clarity on why the rural savings would lead to overall savings in the program. Under the Aurum and CHAPS program, VMMC services are delivered predominantly in rural areas, up to 90% of the patients are from rural settings in any month as published in our clinical JMIR paper. We now added this statement in several areas of the paper, including in paragraph 5 of the introduction, “The VMMC program in SA is predominantly implemented in more rural areas [14].” We also enhanced our discussion of the savings in rural areas and explained why we think that the minimal additional costs in urban areas are a worthy investment.

We also softened and updated the language of the discussion about the cost savings, “2wT has additional benefits for cost savings that could lead to potential long-term cost-savings in post-VMMC care delivery. Firstly, enhanced counselling incurred a minimal cost of $0.63, but enabled the clients to effectively identify and communicate AE concerns in daily SMS – a worthy investment worthwhile cost. Second, daily SMS communication improved early detection of AEs and subsequent swift referral of those in need for in-person clinical visits. This triaging process led to identification of AEs earlier with less severity, likely averting costs of more severe AEs[14]. Third, only the clients with AE concerns or those desiring reassurance attended clinic visits, resulting in only 0.22 elected visits per 2wT client (Table 3), a reduction in review workload. Lastly, reduced follow-up visits allow providers to concentrate on cases in need of medical attention and free up time to commence surgery early and on-time, potentially increasing client satisfaction.”

Lastly, one smaller point noted by review 1 is that both figures are missing axis titles. Please add so the figures are able to stand alone and be completely understood.

Response:

Completed.

Reviewer #1: General Comments:

Thank you for the clarification that the PEPFAR supported programs are covering the transport costs for clients in the rural area. Also, the emphasis on looking at costs from the payer’s perspective. However, I am still concerned that while the PEPFAR-funded program (CHAPS) will see savings (monetary cost) in reduced transportation fuel costs that the reduced staff time required for follow-up (an opportunity cost not a monetary cost savings) means that overall monetary costs to the program are likely to increase.

Response:

These will be monetary savings that can be reprogramed to different uses, as we noted in the paper, like time savings for existing staff who would not be completed unnecessary reviews. In contrast, opportunity cost refers to the value of the next best alternative that one foregoes when making a decision, choosing one option always comes at the cost of not choosing another. In our study, we estimated time costs for health workers and monetize time costs by using the salary information. We didn’t estimate time savings for patients – a separate study that we did not conduct in large part as both services (VMMC) and transportation are largely provided by the program. Patient costs have been covered previously in the literature. Moreover, we look at the payer perspective since, as the reviewer notes, the provider time is being assigned to transportation – which is a wasted resource. While we agree, and we thank the reviewer, for these concerns and suggestions, it is not for the research team to interfere in the delivery of routine services nor prescribe how routine HCWs are assigned duties or duty stations. We also hope that others will view that information with an eye for applying 2wT to those settings or investigating other more efficient pathways to provide follow-up care. Using 2wT would, indeed, reduce a lot of clinician time that appears wasted in transportation time in rural areas, especially.

I am still troubled by the conclusion that the use of 2wT could yield savings of over $1.1 million per year (line 442). As stated above, the labor savings are not monetary savings so there is no budgetary reduction associated with these “savings”. Also, I’m not sure there is evidence to suggest men’s hesitancy to take up VMMC because of the need to return for follow-up visits and with more efficient follow-up that uptake would increase (lines 444-446).

Response:

Transportation and associated costs for VMMC follow-up visits are a burden to men in SA, with much literature to suggest that many men try to avoid follow up visits (from migration, employment obligations, stigma, able to heal independently) and that there is overreporting of follow-up. We added 2 additional references [10, 11] to the introduction in support of that statement. Not requiring visits but providing this telehealth opportunity to interact, appears to be a win-win for men who receive support to heal well and their nurses who can provide this care without traveling.

We rephrased the conclusion to remove the $1.1 million per year, to read, “Evidence from two RCTs in Zimbabwe and South Africa demonstrate that this 2wT approach provides high-quality VMMC follow-up as compared to required in-person reviews and lowers overall VMMC program costs. Rural savings using 2wT offset nominal increased costs in urban areas. Additional 2wT associated improvements in care quality, supervision, and verification also likely leading to longer-term savings. The health sector should invest in 2wT. In the context of National VMMC targets of 350,000 to 500,000 VMMCs per annum, employing 2wT could dramatically reduce the number of in-person post-operative reviews, resulting in concrete efficiency gains and significant annual program savings. Invested these resources back into the VMMC program could further expand VMMC access, improve care quality, and advance VMMC program goals of safe, efficient, and effective VMMC scale-up.”

Specific Comments:

Line 214 & 215 (& perhaps elsewhere) replace “Aes” with “AEs”. My guess is your word processing software was trying to be helpful .

Response: Completed.

Line 242-244: The decision to only count the cost for a successful attempt even if multiple attempts were required seems to put downward bias on tracing costs. Please justify this decision.

Response:

Documentation of attempts at tracing were poor. Therefore, we only have anecdotal support on previous attempts. This is the case and further supports the idea that 2wT could actually offset additional costs that were underestimated in this costing approach.

Line 360: According to Line 113, NDoH protocols already require two post-surgery follow-up visits. So why is this being treated as a hypothetical scenario?

Response:

Adherence to these guidelines varies widely, but the guidelines remain unchanged. With COVID19, there is also growing acceptance that telehealth or telephone follow-up may be acceptable. Although there are formal policies requiring 2 post-operative visits, we provided evidence that telehealth may be acceptable to replace in-person reviews for low risk men according to new PEPFAR documents about follow-up for low-risk men, but Low risk” has not been defined. The NDoH, PEPFAR, and the VMMC community need this evidence to further advocate for policy change – which is often slower than practice moves.

________________________________________

Attachment

Submitted filename: Response to Reviewers 9.29.23.docx

Decision Letter 2

Lisa Suzanne Dulli

2 Nov 2023

Cost savings in male circumcision post-operative care using two-way text-based follow-up  in rural and urban South Africa

PONE-D-23-01844R2

Dear Dr. Feldacker,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Lisa Suzanne Dulli, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Lisa Suzanne Dulli

7 Nov 2023

PONE-D-23-01844R2

Cost savings in male circumcision post-operative care using two-way text-based follow-up  in rural and urban South Africa

Dear Dr. Feldacker:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Lisa Suzanne Dulli

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. 2wT costing study EpiCollect form.

    Tool used for 2WT time-in-motion client follow-up data collection.

    (PDF)

    S1 Table. 2wT costing tool.

    Modifiable Excel spreadsheet for 2wT scenario costing.

    (XLSX)

    Attachment

    Submitted filename: Reviewer Report -- 2wT VMMC.docx

    Attachment

    Submitted filename: Response to Reviewers 6.30.2023.docx

    Attachment

    Submitted filename: Response to Reviewers 9.29.23.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES