Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2022 Dec 22;7:309. [Version 1] doi: 10.12688/wellcomeopenres.18317.1

A Clinically Oriented antimicrobial Resistance surveillance Network (ACORN): pilot implementation in three countries in Southeast Asia, 2019-2020

H Rogier van Doorn 1,2,a, Thyl Miliya 3, Anousone Douangnouvong 4, Ngan Ta Thi Dieu 5, Chansovannara Soputhy 3, Meymey Lem 3, Danoy Chommanam 4, Valy Keoluangkhot 6, Bandith Soumphonphakdy 6, Khaysy Rassavong 6, Khamphong Thanadabouth 6, Manoloth Sayarath 6, Vilada Chansamouth 4,6, Minh Dien Vu 5, Phu Khiem Dong 5, Van Duong Dang 5, Van Bac Tran 5, Thi Kim Yen Do 5, Thi Ngoc Ninh 5, Hong Long Nguyen 5, Ngoc Hao Kim 5, Sothea Prak 3, Manivanh Vongsouvath 4,6, Dinh Trang Van 5, Thi Kim Tuyen Nguyen 2, Hong Khanh Nguyen 2, Raph L Hamers 1,7, Clare Ling 1,8, Tamalee Roberts 4, Naomi Waithira 1,9, Prapass Wannapinij 9, Tien Viet Dung Vu 2, Olivier Celhay 9, Chanpheaktra Ngoun 10, Susath Vongphachanh 6, Ngoc Thach Pham 5, Elizabeth A Ashley 1,4, Paul Turner 1,3
PMCID: PMC10579863  PMID: 37854668

Abstract

Background: Case-based surveillance of antimicrobial resistance (AMR) provides more actionable data than isolate- or sample-based surveillance. We developed A Clinically Oriented antimicrobial Resistance surveillance Network (ACORN) as a lightweight but comprehensive platform, in which we combine clinical data collection with diagnostic stewardship, microbiological data collection and visualisation of the linked clinical-microbiology dataset. Data are compatible with WHO GLASS surveillance and can be stratified by syndrome and other metadata. Summary metrics can be visualised and fed back directly for clinical decision-making and to inform local treatment guidelines and national policy.

Methods: An ACORN pilot was implemented in three hospitals in Southeast Asia (1 paediatric, 2 general) to collect clinical and microbiological data from patients with community- or hospital-acquired pneumonia, sepsis, or meningitis. The implementation package included tools to capture site and laboratory capacity information, guidelines on diagnostic stewardship, and a web-based data visualisation and analysis platform.

Results: Between December 2019 and October 2020, 2294 patients were enrolled with 2464 discrete infection episodes (1786 community-acquired, 518 healthcare-associated and 160 hospital-acquired). Overall, 28-day mortality was 8.7%. Third generation cephalosporin resistance was identified in 54.2% (39/72) of E. coli and 38.7% (12/31) of K. pneumoniae isolates . Almost a quarter of S. aureus isolates were methicillin resistant (23.0%, 14/61). 290/2464 episodes could be linked to a pathogen, highlighting the level of enrolment required to achieve an acceptable volume of isolate data. However, the combination with clinical metadata allowed for more nuanced interpretation and immediate feedback of results.

Conclusions: ACORN was technically feasible to implement and acceptable at site level. With minor changes from lessons learned during the pilot ACORN is now being scaled up and implemented in 15 hospitals in 9 low- and middle-income countries to generate sufficient case-based data to determine incidence, outcomes, and susceptibility of target pathogens among patients with infectious syndromes.

Keywords: Antimicrobial resistance, Surveillance, Case-based surveillance

Introduction

The benefits of case-based versus isolate-based surveillance of antimicrobial resistance have recently been discussed in peer-reviewed literature. In a recent ACORN protocol manuscript, correspondence on ACORN and a review on surveillance strategies the three purposes of surveillance of antimicrobial resistance (AMR) were listed as “(i) to inform empiric treatment guidelines and clinical decision-making; (ii) to characterize trends in space and time including outbreak detection; and (iii) to provide a benchmark to measure the impact of interventions ( Turner et al., 2020).” It was stated that: “A well-coordinated network of systems, collecting standardised data, that fulfil these purposes provides the evidence base to allow for global comparative analyses and drive strategies for control” ( van Doorn et al., 2020). However, it was also stated that “current AMR surveillance systems are typically passive, pathogen-focused, and based on routine antimicrobial susceptibility testing results generated by clinical microbiology laboratories” ( Lim et al., 2021a; Turner et al., 2020).

The World Health Organization Global Antimicrobial Resistance Surveillance System (WHO GLASS) provides a platform for standardised data collection and submission allowing comparison of data between countries and regions. Sixty-six of 82 enrolled countries (as per 31st July 2019) have submitted data. Most countries submitted isolate or sample-based data, with low- and middle-income countries (LMICs) relatively underrepresented ( World Health Organisation, 2020b). The need for case-based surveillance and its superiority over isolate- or sample-based surveillance was mentioned in the GLASS manual for early implementation ( World Health Organisation, 2015). A recent publication on the burden of AMR in 2019 also mentioned the scarcity of data linking proportions of resistance of bug-drug combinations to clinical syndromes and outcome as a major limitation of data and resulting burden estimates ( Antimicrobial Resistance Collaborators, 2022).

Isolate and sample-based surveillance data without clinical denominators may have various biases favouring resistant organisms due to lack of diagnostic stewardship, underuse of diagnostic microbiology resources and a sampling preference for more severe cases or treatment failures, especially in LMICs ( Lim et al., 2021b; Teerawattanasook et al., 2017). In addition, many patients are already on antibiotics when sampled as they have access to over-the-counter antibiotics in the community or are transferred with prescribed antibiotics from lower-level clinics. Finally, isolate-based surveillance data also do not inform on impact and cost of AMR, patient, hospital and environmental risk factors or outcomes of drug resistant infections in particular patient groups ( Rempel & Laupland, 2009; Turner et al., 2020; van Doorn et al., 2020; World Health Organisation, 2016).

Other authors summarised the benefits of case-based surveillance in an opinion piece as: “(i) to allow linking of AMR profiles with patients at risk; (ii) to better inform treatment guidelines; (iii) to identify high-risk populations; (iv) to provide reliable data streams for analyses of effectiveness of interventions; and (v) to study the linkage of AMR phenotypes and burden” ( Ryu et al., 2019).

Drawing from these issues and benefits, we have developed ACORN: A Clinically-Oriented antimicrobial Resistance surveillance Network. ACORN aims to be a routine hospital activity of collecting and combining clinical and microbiology data for AMR surveillance with direct feedback and visualisation for end-users. To achieve this, five components are added to a GLASS compatible backbone of microbiology data: (i) active case-finding and provision of diagnostic stewardship materials to support correct use of microbiology diagnostics, (ii) bedside clinical data collection using a short Open Data Kit (ODK) e-questionnaire on a tablet computer, (iii) software solutions to link collected data to existing WHONET-based or other formats of laboratory data to avoid duplication of laboratory data entry, (iv) collection of 28-day mortality data, and (v) direct feedback of local data, visualised using an interactive dashboard. The main objective of ACORN is to generate data in LMICs that can be directly used to inform local treatment guidelines and national policy, in addition to inclusion in international pathogen-focused AMR surveillance systems and burden of disease studies.

Here we describe the results of a pilot in three central hospitals collaborating with the University of Oxford Tropical Network in Southeast Asia: Mahosot Hospital in Vientiane, Laos; Angkor Hospital for Children (AHC) in Siem Reap, Cambodia and the National Hospital for Tropical Diseases (NHTD) in Hanoi, Vietnam. The surveillance protocol was published previously ( Turner et al., 2020).

Methods

Surveillance design ( Figure 1)

Figure 1. Surveillance design and workflow.

Figure 1.

CAI: community-acquired infection; HAI: hospital-acquired infection.

Patients were enrolled through daily active case-finding on 3–5 participating acute admission wards per hospital using clinical diagnosis/suspicion to identify community-acquired infections plus weekly point prevalence surveys for hospital-acquired infections, using case definitions based on those of the European Centres for Disease Control (ECDC; i.e. onset of clinically-suspected infection >48 hours following admission)( European Centre for Disease Prevention and Control, 2016). Patients with clinically suspected meningitis, sepsis or pneumonia were enrolled, with capture of simple severity markers (quick sequential organ failure assessment [qSOFA] for adults and “sepsis six” for children) to enable stratification within syndromes.

Clinical data was captured using password protected Android smartphones / tablets via Open Data Kit (ODK) Collect. Clinical records and electronic hospital information systems of enrolled patients were reviewed by study doctors daily to capture ICD10 codes for infection episode (if recorded), final classification of surveillance diagnosis (confirmed, rejected, updated; for sepsis, the likely source was be captured), hospitalisation outcome (alive, dead, discharged to die at home, left against medical advice) and date and number of days admitted to an intensive care unit. The participant (or parent / legally acceptable representative) was contacted by telephone on day 28 post enrolment to determine health status (alive or dead) and date of death, if appropriate. The protocol implementation package included tools to capture site and laboratory capacity information, guidelines on diagnostic stewardship, and a web-based data visualisation and analysis platform ( Turner et al., 2020).

Site assessments

Prior to study initiation, site and laboratory assessments were conducted on-site to collect general information about the hospital, its patient population, wards ( Table 1), and on the use of clinical microbiology diagnostics and quality management of the laboratory (data not shown).

Table 1. ACORN pilot surveillance site summary.

ICU: Intensive Care Unit. ID: Infectious Diseases.

Angkor Hospital for
Children
Mahosot Hospital National Hospital for
Tropical Diseases
Hospital summary
Country Cambodia Laos Vietnam
City Siem Reap Vientiane Hanoi
Year founded 1999 1903 2006
Profile Paediatric General Specialist
Level of care Primary - Tertiary Primary - Tertiary National
Subordination Non-governmental / Charity Government Government
Year 2018 2019 2019
Admissions 4013 18392 172955
Transfers in (%) Unknown Unknown 67
Beds 82 300 550
Doctors 66 237 130
Nurses 219 400 334
Surveillance wards
Number 3 5 3
Total beds 49 94 168
Details Paediatric medical 1 Adult ID Emergency department
Paediatric medical 2 Paediatric ID Adult ICU
Paediatric ICU General paediatric Virology & Parasitology
Adult ICU
Paediatric ICU

Diagnostic stewardship

Widely used clinical definitions were used in diagnostic stewardship activities (protocol training, poster in doctor’s room, daily ward visits) to support standardisation of clinician diagnosis and specimen collection (see Extended data, Supplementary Figures 1 and 2 ( Kestelyn & Van Doorn, 2022)). Surveillance-specific specimen collection was not mandatory; however, we monitored the effectiveness of the diagnostic stewardship materials by tracking the proportion of cases with linked diagnostic specimens.

Clinical variables

Clinical variable selection was informed by a stakeholder workshop, with representation from WHO GLASS, WHONET, University of Oxford Tropical Network, International Vaccine Institute (IVI), Foundation for Innovative Diagnostics (FIND), Fleming Fund, Centre for Disease Dynamics, Economics & Policy (CDDEP), held in Bangkok in May 2019. Clinical variables in addition to age, sex, ward and date of admission included co-morbidities, date of original admission if transferred from another healthcare facility, hospitalisation and/or surgery in last three months, severity features, presence of medical devices, diagnostic blood culture taken within 24 hours of admission or symptom onset (HAI), systemic antibiotics received in 24 hours before diagnostic blood culture, and empiric antibiotic treatment received. Patients admitted with CAI were re-classified as having healthcare associated infections (HCAI) if they had hospitalisation and/or surgery in last three months. Patients admitted with active infection on transfer from another hospital were considered as a subset of CAI, given that the majority of patients were transferred early and site investigators felt that most transfers were likely escalation of care (Supplementary Figure 3 in the Extended data).

Microbiology data

Locally managed microbiology data, exported from a laboratory information management system (LIMS) or WHONET software, was matched to ACORN clinical data in an RShiny app using patient identifier and specimen collection date. For CAI / HCAI episodes, specimen data from +/- 48 hours of admission date was linked. For HAI episodes, specimen data from up to 48 hours following date of infection onset was linked. Target pathogens for further downstream analyses were the GLASS bloodstream infection relevant species Streptococcus pneumoniae, Staphylococcus aureus, Salmonella spp., Klebsiella pneumoniae, Escherichia coli, and Acinetobacter baumannii but data from all pathogens was captured to permit identification of site-specific pathogens of interest. Raw disk diffusion and minimum inhibitory concentration antimicrobial susceptibility data were interpreted using current (2021) CLSI and EUCAST guidelines ( Clinical and Laboratory Standards Institute, 2021; EUCAST, 2021).

Ethics and consent

Ethical approval was obtained through the Oxford Tropical Research Ethics Committee (OxTREC 536-19; 21-6-2019), Cambodia National Ethics Committee for Health Research (215-NECHR; 30-8-2019), Laos Ministry of Health – University of Health Sciences Ethics Committee (211/19; 23-9-2019), and NHTD Institutional Review Board, (13/HDDD-NDTU; 18-11-2019). All committees agreed to waive the need for written individual informed consent as this surveillance was defined as a minimal/negligible risk activity, consisting of implementation of accepted quality improvement tools (diagnostic stewardship) and collection and use of limited clinical data that is expected to be collected as part of standard of care. Patients were instead given an information sheet explaining the surveillance project and given the opportunity to opt out on screening and enrolment. No patient samples were collected other than for clinical diagnostic purposes. All patient identifiable data (local hospital identification number, date of birth) were removed during the clinical-laboratory data linkage procedure, rendering an anonymised dataset for analysis and onward sharing.

Preliminary data on key infection syndromes and associated pathogens was collected prior to study start. Challenges and potential solutions to implementation of the surveillance protocol were identified using a baseline AMR knowledge, attitudes, and practices (KAP) survey of clinicians working on the surveillance wards, an open call for feedback, augmented by formal requests for feedback to be presented at investigator meetings (data not shown).

Sample size and data analysis

There was no formal sample size or target. Wards were chosen based on patient population with preference for those with high proportion of acute admissions from community. The aim was to enrol all eligible and consenting patients admitted to the surveillance wards during the pilot surveillance period. Surveillance data were managed as described above. Tables, graphs, and descriptive statistics were generated using R version 4.1.0 ( R Core Team, 2021). The packages ggplot2 (version 3.3.5) and ComplexUpset (version 1.3.3) were used to plot graphical representations of key results.

Results

Admissions and infection episodes

Patients were enrolled between December 2019 and May 2020, with an extension until end October 2020 after an investigator meeting because of coronavirus disease 2019 (COVID-19) delays and quarantine of the Vietnam site ( Duy et al., 2021). ACORN captured data on a total of 2408 patient admissions for 2294 patients, including 2464 discrete infection episodes (1385 AHC, 738 Mahosot, 341 NHTD; median 1, range 1-8 per patient) and 3429 diagnostic specimens. A flowchart is shown in Figure 2 and episodes are shown broken down by month in Supplementary Figure 4 ( Extended data).

Figure 2. Flowchart of enrolled patients, admissions, episodes and blood cultures.

Figure 2.

The median age at first infection at enrolment was 1.5, 20 and 54 years, with 44.2%, 46.4% and 27.4% female patients at AHC, Mahosot and NHTD, respectively. Among 2464 recorded infection episodes, 2304 were enrolled through daily case-finding with 1786 CAI (72.5%) and 518 classified as HCAI (21.0%). Weekly point-prevalence surveys identified 160 HAI (6.5%). CAI accounted for 66.3%, 88.9% and 62.2% of cases at AHC, Mahosot and NHTD, respectively. At presentation, 253 episodes were clinically diagnosed as meningitis, 677 as pneumonia and 1534 were sepsis. On review at hospital discharge 39.9% (101/253, 1 missing response) meningitis diagnoses, 23.9% (162/677, 2 missing responses) pneumonia diagnoses and 25.7% (395/1534, 4 missing responses) sepsis diagnoses were rejected based on clinical course / diagnostic test results (e.g., radiology) by treating physicians. During the pilot, alternate final diagnoses were not recorded, and thus further results are presented here based on presentation diagnosis.

Outcomes

The discharge outcome of 83/2408 (3.5%) admissions was death, with an additional 93 (3.9%) patients discharged moribund. Seven patients had no discharge status recorded. Day-28 follow-up occurred post-discharge for 1995 admissions, at a median of 25 days after discharge (inter-quartile range 21 – 26, range 1 – 56). An additional 126 deaths were identified ( Figure 3). Mortality for adults and children and by syndrome (community-acquired) is shown in Table 2.

Figure 3. Hospital and post-discharge outcomes for 2408 patient admissions.

Figure 3.

This plot includes all patient admissions. *Clinical diagnosis denotes first infection captured by surveillance per admission. †Post-discharge outcome denotes 28-day outcome when that time-point occurred following hospital discharge. Unknown post-discharge outcome status reflects either the 28-day outcome occurring before hospital discharge or inability to contact the patient following discharge.

Table 2. Post discharge outcomes for the total 2408 admissions and per clinical syndrome (community acquired only).

Post-discharge outcome denotes 28-day outcome when that time-point occurred following hospital discharge. Unknown post-discharge outcome status reflects either the 28-day outcome occurring before hospital discharge or inability to contact the patient following discharge.

Alive Dead Unknown Total
All Admissions
Adult 473 66.2% 155 21.7% 86 12.0% 714
Child 1396 82.4% 54 3.2% 244 14.2% 1694
Total 1869 77.6% 209 8.7% 330 13.7% 2408
Sepsis – community-acquired
Adult 231 71.5% 72 22.3% 20 6.2% 323
Child 657 83.6% 22 2.8% 107 13.6% 786
Total 888 80.1% 94 8.5% 127 11.5% 1109
Pneumonia – community-acquired
Adult 94 69.6% 26 19.3% 15 11.1% 135
Child 305 88.7% 3 0.9% 36 10.5% 344
total 399 83.3% 29 6.1% 51 10.6% 479
Meningitis – community-acquired
Adult 43 64.1% 8 11.9% 16 23.9% 67
Child 120 91.6% 4 3.1% 7 5.3% 131
Total 163 82.3% 12 6.1% 23 11.6% 198

Restricting to 2287 first infection episodes where discharge status was available (i.e., each enrolled patient represented as a single infection episode and admission), 2114 (92.4%) patients were discharged alive and expected to recover with 92 patients (4.0%) discharged moribund and 81 (3.5%) whose hospital outcome was death. There were no clear differences between hospital outcome by clinical syndrome. However, a higher proportion of patients with HAI were discharged moribund (11.6%, 11/95) compared to those with CAI (3.2%, 57/1567) or HCAI (23/496, 4.6%) (Supplementary Table 1, Extended data).

Blood cultures

Data from 2123 blood cultures was captured. At least one blood culture was taken in 81.1% (1999/2464) of infection episodes in total and in 87.7% (1215), 74.8% (552) and 68.0% (232) of episodes at AHC, Mahosot and NHTD, respectively. Collected blood cultures are summarised by syndrome and origin of infection in Table 3. Where data were available (1644/1999 episodes), there was no history of antibiotics in the 24 hours preceding sample collection in 78.0% episodes (overall 1283/1644; AHC 722/903 [80.0%]; Mahosot 437/518 [84.4%]; NHTD 124/223 [55.6%]). Positive blood culture results were obtained from 75/1283 (5.8%) patients who had not received antibiotics, versus 13/361 (3.6%) of patients who had received antibiotics.

Table 3. Blood culture collection summary for 2464 infection episodes, stratified by location, patient age group, diagnosis, and infection category.

CAI: community-acquired infection; HCAI: healthcare-associated infection; HAI: hospital-acquired infection.

At least one
blood culture
collected, n (%)
AHC Mahosot NHTD
Adult Child Adult Child Adult Child
Diagnosis
Meningitis - 112 / 130 (86.2%) 30 / 30 (100.0%) 27 / 29 (93.1%) 48 / 61 (78.7%) 3 / 3 (100.0%)
Pneumonia - 283 / 376 (75.3%) 55 / 83 (66.3%) 40 / 112 (35.7%) 64 / 102 (62.7%) 3 / 4 (75.0%)
Sepsis - 820 / 879 (93.3%) 235 / 276 (85.1%) 165 / 208 (79.3%) 111 / 165 (67.3%) 3 / 6 (50.0%)
Infection timing
CAI - 800 / 918 (87.1%) 270 / 321 (84.1%) 221 / 335 (66.0%) 153 / 204 (75.0%) 5 / 8 (62.5%)
HCAI - 316 / 358 (88.3%) 46 / 63 (73.0%) 10 / 13 (76.9%) 48 / 79 (60.8%) 4 / 5 (80.0%)
HAI - 99 / 109 (90.8%) 4 / 5 (80.0%) 1 /1 (100.0%) 22 / 45 (48.9%) -

Blood cultures were reported to contain contaminants (coagulase negative staphylococci, micrococci or Gram-positive bacilli) in 70/1310 (5.3%) and 31/569 (5.4%) specimens at AHC and Mahosot, respectively. At NHTD these numbers were not available as the laboratory does not report growth of these contaminants back to the wards, often after checking with treating physicians.

In total, 192 potentially pathogenic organisms were isolated from 2123 blood cultures from 1999 infection episodes. Six out of seven of the most frequently isolated organisms were target organisms (115/192): 44 E. coli, 19 S. aureus, 18 K. pneumoniae, 12 A. baumannii (and an additional 5 Acinetobacter spp.), 14 Salmonella spp. (including 2 S. Typhi and 1 S. Paratyphi A), and 8 S. pneumoniae. At least one target organism was cultured from 110/2123 (5.2%) blood cultures. In addition, Burkholderia pseudomallei, a regionally important pathogen, was isolated from 22 blood cultures ( Figure 4, Supplementary Table 2, Extended data).

Figure 4. Potential pathogens isolated from 2123 blood cultures, by location and timing of infection onset.

Figure 4.

CAI: community-acquired infection; HCAI: healthcare-associated infection; HAI: hospital-acquired infection.

Among 1999 blood-cultured infection episodes, the incidence of blood stream infections (BSI) caused by any target organism was 51 per 1000 episodes (95% confidence interval [CI] 42 – 63): 18 (95% CI 5 – 47) for meningitis, 25 (95% CI 12 – 44) for pneumonia and 66 (95% CI 53 – 81) for sepsis. Breakdowns of BSI incidence by target organism, age group and infection timing are shown in Supplementary Tables 3 – 4 ( Extended data).

The proportion of blood cultured infection episodes rendering a target organism was positively correlated with qSOFA score (17% [9/53] of score 3, 3% [3/102] of score 0) and to a lesser extent to the number of “Sepsis 6” severity indicators in children ( Table 4). Both among children and adults the likelihood of culturing a target organism was higher among HAI than CAI and HCAI episodes ( Table 5).

Table 4. Bloodstream infection detection by clinical severity and age group.

Age group Severity
score *
Episode with
target organism
BSI (n)
Episodes with
blood culture
collected (n)
BSI (%)
Adults
qSOFA 0 3 102 2.9
1 7 201 3.5
2 20 187 10.7
3 9 53 17.0
Child
Sepsis6* 0 5 359 1.4
1 19 444 4.3
2 25 394 6.3
3 8 148 5.4
4 7 111 6.3

*Sepsis6 is not a score per se, so the number of indicator items detected is summarised

Table 5. Bloodstream infection detection by timing of infection onset and age group.

CAI: community-acquired infection; HCAI: healthcare-associated infection; HAI: hospital-acquired infection.

Age
group
Infection
category
Episode with
target organism
BSI (n)
Episodes with
blood culture
collected (n)
BSI (%)
Adult CAI 30 423 7.1
HCAI 6 94 6.4
HAI 3 26 11.5
Child CAI 34 1026 3.3
HCAI 11 330 3.3
HAI 19 100 19.0

Non-blood cultures

Data from 1306 non-blood culture specimens was captured. Cerebrospinal fluid (CSF) specimen data was captured in 58% of meningitis episodes in total and in 58% (76), 56% (33) and 58% (37) of episodes at AHC, Mahosot and NHTD, respectively. A total of 147 CSF specimens were captured from patients with clinically suspected meningitis, 14 were culture positive yielding a single potentially pathogenic isolate in each case (Supplementary Table 5, Extended data). Lower respiratory tract specimen data was captured in 6% of pneumonia episodes in total and in 4% (14), 6% (3) and 19% (20) of episodes at AHC, Mahosot and NHTD, respectively. Overall, 41 lower respiratory tract specimens were captured from patients with clinically suspected pneumonia, more frequently from hospital-acquired (9/42, 21.4%) than community-acquired (26/479, 5.4%) or healthcare-associated (5/156, 3.2%) pneumonia episodes. Of these, 13 were culture positive and 26 potentially pathogenic isolates were recovered (Supplementary Table 6, Extended data). The range of non-blood culture specimen and organism data are summarized in Supplementary Table 7 and Supplementary Figure 5 ( Extended data).

Antimicrobial susceptibility test results

Due to the small numbers of isolates generated in the pilot, detailed exploration of the data was considered inappropriate. However, examples of AST profiles were generated for the two most prevalent organisms, E. coli and S. aureus (61/80 and 54/66 isolates, first isolate per specimen type per patient with all core antibiotics tested; Figure 5A/B). Susceptibility to key antibiotic classes is summarised in Supplementary 8 ( Extended data). After deduplication to the first isolate per species per patient, there were >30 isolates for E. coli, K. pneumoniae, and S. aureus. Third generation cephalosporin resistance was identified in 54.2% (39/72) of E. coli and 38.7% (12/31) of K. pneumoniae isolates . Almost a quarter of S. aureus isolates were methicillin resistant (123.0%, 4/61).

Figure 5.

Figure 5.

Antimicrobial susceptibility profiles for ( A) 61 Escherichia coli isolates and ( B) 54 Staphylococcus aureus isolates (all site data combined). The first isolate per specimen type for each patient was included. In each panel, the top plot summarises the infection category from which isolates were obtained, as a proportion (CAI, community-acquired; HCAI, healthcare-associated; HAI, hospital-acquired); the middle bar plot indicates the specimen (and thus isolate) count coloured by specimen type; and the bottom plot shows the antimicrobial susceptibility profile for the isolates (black filled circles indicate resistance and grey filled circles indicate susceptibility). The horizontal bars (“Set size”), indicate the number of isolates testing resistant a single antibiotic / antibiotic class (e.g., top row for S. aureus is penicillin and almost all isolates are resistant).

Discussion

To overcome the biases of isolate-based surveillance and improve direct feedback of AMR surveillance data to hospitals and prescribing doctors we developed ACORN. ACORN starts with a patient rather than a pathogen, and consists of bedside collection of clinical metadata that is subsequently linked to clinical microbiology laboratory data and displayed on an online or offline dashboard. ACORN was piloted in three hospitals in Southeast Asia between December 2019 and October 2020.

We show objectives of the pilot with predefined outcome measures and how we met those in Table 6. Before and after informal satisfaction surveys among clinical and laboratory staff, and discussions at investigator meetings, showed that overall, ACORN was acceptable and feasible to implement with the provided per patient compensation for study doctors / nurses for their time and presence of site coordinators on the wards. Doctors in general appreciated the results that were generated and how they were displayed. Feedback on specific components was used to update enrolment criteria and other study procedures, discussed further below.

Table 6. Objectives, formulated outcome measures and how these were met.

Objectives Outcome Measures Result
Primary:
To develop, implement and assess a
hospital-based system for patient-centred
surveillance of Drug Resistant Infections

A protocol and guideline for
implementation of this system for
further roll-out in other sites

Feedback was collected during the pilot and on
post pilot assessment and was used to update
the protocol
Secondary:
To systematically characterize drug-resistant
infections based on important clinical
syndromes, to adequately inform treatment
guidelines

To implement clinical syndrome-guided
diagnostic stewardship of patients with
suspected infection

To determine the duration, cost of
hospitalisation and patient outcome of DRI
and non-DRI

Antimicrobial susceptibility data
with both pathogen and clinical
denominators, including predefined
subgroups

Proportion of timely and correctly
sampled patients per syndrome

Antimicrobial susceptibility data, cost
estimates, 28-day mortality data

Collection and combination of clinical and
microbiological data was feasible (all secondary
objectives), subgroup analysis showed clear
differences by antibiotic use and origin of
infection

Data were collected and used for real-time
feedback and further development of protocol

Data were collected and shown
Tertiary:
To evaluate the feasibility and acceptability
of the surveillance system and package of
tools

Results of clinician and laboratory
technician surveys

Feedback was collected using before and after
surveys and results were used to update the
protocol

Denominators of generated data and antibiograms in this pilot were too small for immediate use in clinical guidelines and definitive analyses of AMR impacts. However, the framework developed, and iterated as described below, will permit such usage during longer periods of surveillance.

Data from 2464 clinical infection episodes were collected and matched with 192 potentially pathogenic isolates from blood culture and an additional 229 potentially pathogenic isolates from other specimens. In total, 290 infection episodes (11.8%) were matched to a pathogen. Receiving antibiotics when blood culture was taken was associated with a lower proportion of positive culture results (3.6 vs. 5.8%).

In total, 83 patients died in hospital and an additional 126 deaths occurred following hospital discharge (overall mortality 8.7% [209/2408]). Of these, 93 patients were discharged moribund to die at home rather than the hospital, which is often preferred by patients and families in the cultural contexts of these three countries ( Tran et al., 2018). When broken down by age, mortality among adults was consistently higher: 21.7% among adults vs. 3.2% among children in total, and 22.3%, 19.3%, 11.9% among adults vs 2.8%, 0.9%, 3.1% among children for sepsis, pneumonia and meningitis, respectively. These percentages are very similar to the estimates from our previous sepsis study in the region ( Southeast Asia Infectious Disease Clinical Research Network, 2017).

Low numbers of lower respiratory tract samples were collected for patients with a clinical diagnosis of pneumonia, both among children and adults. Hospital-acquired pneumonia cases were sampled more frequently than community- or healthcare-associated pneumonia cases and this perhaps reflects views on clinical utility and the fact that around 50% of hospital-acquired pneumonia patients were mechanically ventilated. High quality sputum specimens from community-acquired pneumonia cases are notoriously hard to generate, resulting in culture results that frequently represent upper respiratory tract colonisation.

These results show that case-based surveillance of AMR requires collection of data from a considerably larger number of patients to achieve the same amount of isolate based information compared to strictly isolate based surveillance. However, the clinical data collected is richer and allows for stratification by syndrome, severity, origin of infection and other metadata allowing for rapid actionable feedback to clinicians and hospitals. The results from this pilot also show that ACORN is feasible to deliver, but at this stage and in these settings required dedicated clinical and data staff (time required for clinical data collection and processing / matching of data on site and centrally) and therefore funding was a prerequisite for delivery. During further roll-out we will assess to what extent ACORN surveillance can become part of routine work on site and self-sustainable.

Categorisation between CAI, HCAI and HAI was heterogeneous between three sites, reflecting differences in patient populations. Pragmatically, we disregarded transfers from lower-level hospitals because most were hospitalised <48h before transfer and this was considered escalation of care and transferred cases were classified as CAI. This may have led to some HAIs being misclassified, especially at NHTD which receives >70% of its patients from peripheral sites. Detecting HAI with weekly point-prevalence surveys but without case definitions may not have caught all infections. Conversely, some Salmonella and B. pseudomallei infections were labelled as HAI/HCAI according to protocol, which probably does not reflect their true origin of infection. Similarly, the proportion of patients with blood culture taken per site and syndrome and the proportions of rejected admission diagnoses were heterogeneous between sites, showing rigorous on-site diagnostic stewardship and clear guidance regarding case definitions is important. Clinical feedback during the pilot highlighted that several patients with a pathogenic organism grown from blood were not included in surveillance due to lack of a clearly documented clinical diagnosis. Alternative enrolment strategies were thus considered and a two-week audit of patient numbers on surveillance wards was undertaken (data not shown). We concluded that enrolment could be improved by selection of patients based on clinician antibiotic treatment choices, rather than written diagnosis.

Phase 2 of ACORN is currently being implemented, with a wider roll-out in 15-18 sites in 9 countries in Africa and Asia. After having reviewed the pilot experiences with study staff from hospitals and research units, the following changes to the protocol were made:

  • Pilot enrolment criteria were based on clinical diagnosis without requirement for specific criteria to be checked. Diagnoses could be confirmed or rejected at discharge. For ACORN2 the only requirement for patient enrolment will be the presence of a clinically suspected acute infection and the intention to commence / receipt of intravenous antibiotics on screening for eligibility. Patients will be categorised subsequently by syndrome on discharge.

  • An adapted pragmatic clinical syndrome list modified from the Global PPS protocol and the WHO attributable mortality protocol will be used ( World Health Organisation, 2020a). Study staff can choose the most appropriate clinical syndrome without the need for checking specific case definition boxes.

  • We will convene meetings with surveillance experts to discuss pragmatic syndromic definitions of community and hospital acquired infections for use in future generations of ACORN.

  • Data capture on day 28 will be more nuanced and expanded to allow for more detailed capture of ongoing morbidity and health economics analyses.

While the ACORN pilot and ACORN2 collect data in a manner that is compatible with GLASS AMR surveillance, in ACORN2 there will be a direct link with the WHO GLASS team and alignment of data capture for E. coli and S. aureus bloodstream infections with the WHO attributable mortality protocol ( World Health Organisation, 2020a).

To enhance data utilisation, linkages have been made with a range of investigators internationally to implement ACORN or ACORN like AMR surveillance, or reuse ACORN data, in projects where innovative data collection methods are employed such as Crit Care Asia, ADVANCE-ID, and other ongoing multi-country projects ( Crit Care Asia, 2020; Walker et al., 2021).

Conclusion

ACORN was feasible and generated site-usable data in a pilot phase. Lessons were learned and are being implemented in ACORN2, which will generate sufficient data to determine the incidence of GLASS target pathogen blood stream infection in range of LMIC clinical settings. Additional analyses will determine the impact of AMR on clinical outcomes and healthcare costs in such settings.

Funding Statement

This work was supported by Wellcome [215867, <a href=https://doi.org/10.35802/215867>https://doi.org/10.35802/215867</a>] awarded to Paul Turner. Wellcome had no role in in study design; in the collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the paper for publication.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 1; peer review: 2 approved]

Data availability

Underlying data

Individual participant data collected for the pilot phase of ACORN will not be made available to third parties at this stage of the devlopment of ACORN. ACORN pilot data were used internally for evaluation and proof of principle purposes, and were only presented descriptively here and not used to generate or prove hypotheses. Further downstream iterations of ACORN will have data sharing as a priority, as ultimately the purpose of ACORN is to create a better global database of clinical and laboratory AMR data. Data dictionaries, study protocol, informed consent forms and other study documents are available on publication at https://acornamr.net. Should reviewers or readers wish to access individual participant data, please contact the corresponding author at rvandoorn@oucru.org. We will work with our internal data access committee and the institutional review boards of the sites to get the appropriate approvals for sharing of suffciciently anonymised data.

Extended data

Oxford University Research Archive: ACORN (A Clinically Oriented antimicrobial Resistance Network) supplementary material. https://doi.org/10.5287/bodleian:xq89Qnvke ( Kestelyn & Van Doorn, 2022).

This project contains the following extended data:

  • -

    Supplementary figures

  • -

    Supplementary tables

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

References

  1. Antimicrobial Resistance Collaborators: Global burden of bacterial antimicrobial resistance in 2019: a systematic analysis. Lancet. 2022;399(10325):629–55. 10.1016/S0140-6736(21)02724-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Clinical and Laboratory Standards Institute: Performance Standards for Antimicrobial Susceptibility Testing M100-S31.CLSI;2021. Reference Source [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Crit Care Asia: Establishing a critical care network in Asia to improve care for critically ill patients in low- and middle-income countries. Crit Care. 2020;24(1):608. 10.1186/s13054-020-03321-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Duy C, Nong VM, Van Ngo A, et al. : Nosocomial Coronavirus Disease Outbreak Containment, Hanoi, Vietnam, March-April 2020. Emerg Infect Dis. 2021;27(1):10–17. 10.3201/eid2701.202656 [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. European Centre for Disease Prevention and Control: Point Prevalence Survey of Healthcare Associated Infections and Antimicrobial Use in European Acute Care Hospitals—Protocol Version 5.3.ECDC;2016. Reference Source [Google Scholar]
  6. European Committee on Antimicrobial Susceptibility Testing (EUCAST): Breakpoint tables for interpretation of MICs and zone diameters.V11.0;2021; [Accessed 18-08-2022]. Reference Source [Google Scholar]
  7. Kestelyn E, Van Doorn R: ACORN (A Clinically Oriented Antimicrobial Resistance Network) Supplementary Material.University of Oxford, [Dataset],2022.
  8. Lim C, Ashley EA, Hamers RL, et al. : Surveillance strategies using routine microbiology for antimicrobial resistance in low- and middle-income countries. Clin Microbiol Infect. 2021a;27(10):1391–9. 10.1016/j.cmi.2021.05.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Lim C, Hantrakun V, Teerawattanasook N, et al. : Impact of low blood culture usage on rates of antimicrobial resistance. J Infect. 2021b;82(3):355–62. 10.1016/j.jinf.2020.10.040 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. R Core Team: R: A language and environment for statistical computing.Vienna, Austria: R Foundation for Statistical Computing.;2021. [Google Scholar]
  11. Rempel OR, Laupland KB: Surveillance for antimicrobial resistant organisms: potential sources and magnitude of bias. Epidemiol Infect. 2009;137(12):1665–73. 10.1017/S0950268809990100 [DOI] [PubMed] [Google Scholar]
  12. Ryu S, Cowling BJ, Wu P, et al. : Case-based surveillance of antimicrobial resistance with full susceptibility profiles. JAC Antimicrob Resist. 2019;1(3):dlz070. 10.1093/jacamr/dlz070 [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Southeast Asia Infectious Disease Clinical Research Network: Causes and outcomes of sepsis in southeast Asia: a multinational multicentre cross-sectional study. Lancet Glob Health. 2017;5(2):e157–e67. 10.1016/S2214-109X(17)30007-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Teerawattanasook N, Tauran PM, Teparrukkul P, et al. : Capacity and Utilization of Blood Culture in Two Referral Hospitals in Indonesia and Thailand. Am J Trop Med Hyg. 2017;97(4):1257–61. 10.4269/ajtmh.17-0193 [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Tran HT, Nguyen HP, Walker SM, et al. : Validation of verbal autopsy methods using hospital medical records: a case study in Vietnam. BMC Med Res Methodol. 2018;18(1):43. 10.1186/s12874-018-0497-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Turner P, Ashley EA, Celhay OJ, et al. : ACORN (A Clinically-Oriented Antimicrobial Resistance Surveillance Network): a pilot protocol for case based antimicrobial resistance surveillance [version 2; peer review: 4 approved]. Wellcome Open Res. 2020;5:13. 10.12688/wellcomeopenres.15681.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. van Doorn HR, Ashley EA, Turner P: Case-based surveillance of antimicrobial resistance in the ACORN (A Clinically Oriented Antimicrobial Resistance Surveillance Network) study. JAC Antimicrob Resist. 2020;2(1):dlaa018. 10.1093/jacamr/dlaa018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Walker AS, White IR, Turner RM, et al. : Personalised randomised controlled trial designs-a new paradigm to define optimal treatments for carbapenem-resistant infections. Lancet Infect Dis. 2021;21(6):e175–e81. 10.1016/S1473-3099(20)30791-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. World Health Organisation: Global Antimicrobial Resistance Surveillance System - Manual for Early Implementation.Geneva: World Health Organisation;2015. Reference Source [Google Scholar]
  20. World Health Organisation: Global AMR Surveillance System: Diagnostic stewardship: A guide to implementation in antimicrobial resistance surveillance sites.Geneva: World Health Organisation;2016. Reference Source [Google Scholar]
  21. World Health Organisation: GLASS method for estimating attributable mortality of antimicrobial resistant bloodstream infections.Geneva: World Health Organisation,2020a. Reference Source [Google Scholar]
  22. World Health Organisation: Global Antimicrobial Resistance and Use Surveillance System (GLASS) Report Early implementation 2020.Geneva: World Health Organisation;2020b. Reference Source [Google Scholar]
Wellcome Open Res. 2023 Oct 16. doi: 10.21956/wellcomeopenres.20302.r65293

Reviewer response for version 1

Dickson Aruhomukama 1

I had the privilege of reviewing the ACORN II protocol, which serves as a continuation of this research, even before being proposed as the reviewer for this specific manuscript. I have observed that several changes have been implemented in the subsequent study (ACORN II), influenced by the insights from this initial study (which can be seen as the pilot for ACORN II). Due to this, I find myself more at ease with this version of the manuscript.

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Partly

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Partly

Are the conclusions drawn adequately supported by the results?

Partly

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

Clinical Microbiology, Computational Microbiology,  Clinical Bioinformatics (Genomics)

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2023 Feb 21. doi: 10.21956/wellcomeopenres.20302.r53853

Reviewer response for version 1

Frank van Leth 1

The study by van Doorn et al. describes the result of the pilot phase of the ACORN project, which has the objective to provide case-based AMR surveillance. Using the inpatient setting, the project matches clinical information, laboratory data, and outcome data from individual patients admitted at an emergency ward for suspected infections. Case-based AMR surveillance should overcome the inherent bias seen in conventional isolate- or sample-based AMR surveillance, and as such contribute better to guidance of antibiotic therapy. The authors conclude that the implementation of such a surveillance strategy is feasible and decided to scale up the project to 15-18 hospitals in the region.

The manuscript provides detailed descriptive information on the entire process from enrolment to assessing outcome data. By doing so, the authors show that the approach can lead to a rich dataset that provides insight in diagnostic stewardship, clinical record keeping, and follow-up procedures. As such, the manuscript delivers clearly on its objectives

Main comment.

There is no doubt that current surveillance is severely hampered by the approach taken. The WHO GLASS initiative is welcome but can only provide a limited view of the AMR-situation, given its sample-based approach. Case-based surveillance is urgently needed, something acknowledged by WHO, and being addressed by the ACORN project.

It is therefore somewhat surprising that the Discussion section does not further elaborate how case-based AMR  surveillance could be designed. Adding clinical data to samples submitted to the laboratory is one option, especially if this is done through active case-finding and point-prevalence surveys as in ACORN. But does this inform antibiotic use in those large number of patients not being admitted to an emergency ward? The majority of antibiotic prescription is done in an outpatient setting. The discussion section would be strengthened if the potential limitation of the inpatient setting of ACORN is discussed.

Furthermore, there are other approaches to case-based AMR surveillance being discussed in the literature. Some of these try to overcome one of the limitations of ACORN (as mentioned in the Discussion section): the need for the large number of patients to be able to decipher AMR-profiles with a reasonable level of precision. Without these profiles, guidance on (empirical) antibiotic treatment will be impossible.

Minor comments

In Table 6, the authors mention the coverage of the objective of cost assessment. I did not see this in the main text, nor in the supplemental material.

In Figure 5 middle bar chart, the Y-axis is labelled in steps of 0.5. As it refers to the number of isolates, I suggest to change this to make assessment easier.

As direct visualisation is a major objective of the project, it would be great to see an example. The shiny-app does not show anything as no data are uploaded. Could there be a screen-shot of how an actual visualisation on the dashboard would look like?

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Not applicable

Are all the source data underlying the results available to ensure full reproducibility?

Partly

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Infectious disease epidemiologist working in the field of antimicrobial resistance surveillance

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Citations

    1. Kestelyn E, Van Doorn R: ACORN (A Clinically Oriented Antimicrobial Resistance Network) Supplementary Material.University of Oxford, [Dataset],2022.

    Data Availability Statement

    Underlying data

    Individual participant data collected for the pilot phase of ACORN will not be made available to third parties at this stage of the devlopment of ACORN. ACORN pilot data were used internally for evaluation and proof of principle purposes, and were only presented descriptively here and not used to generate or prove hypotheses. Further downstream iterations of ACORN will have data sharing as a priority, as ultimately the purpose of ACORN is to create a better global database of clinical and laboratory AMR data. Data dictionaries, study protocol, informed consent forms and other study documents are available on publication at https://acornamr.net. Should reviewers or readers wish to access individual participant data, please contact the corresponding author at rvandoorn@oucru.org. We will work with our internal data access committee and the institutional review boards of the sites to get the appropriate approvals for sharing of suffciciently anonymised data.

    Extended data

    Oxford University Research Archive: ACORN (A Clinically Oriented antimicrobial Resistance Network) supplementary material. https://doi.org/10.5287/bodleian:xq89Qnvke ( Kestelyn & Van Doorn, 2022).

    This project contains the following extended data:

    • -

      Supplementary figures

    • -

      Supplementary tables

    Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES