Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2018 Sep 19;3:121. [Version 1] doi: 10.12688/wellcomeopenres.14736.1

Lessons from the first clinical trial of a non-licensed vaccine among Ugandan adolescents: a phase II field trial of the tuberculosis candidate vaccine, MVA85A

Anne Wajja 1,a, Milly Namutebi 1, Barbara Apule 1, Gloria Oduru 1, Samuel Kiwanuka 1, Mirriam Akello 1, Beatrice Nassanga 1, Joyce Kabagenyi 1, Juma Mpiima 2, Samantha Vermaak 3, Alison Lawrie 3, Iman Satti 3, Jaco Verweij 4, Stephen Cose 1,5, Jonathan Levin 1,6, Pontiano Kaleebu 1, Edridah Tukahebwa 2, Helen McShane 3,#, Alison M Elliott 1,5,#
PMCID: PMC6338128  PMID: 30687792

Abstract

Background: A more effective vaccine for tuberculosis (TB) is a global public health priority. Vaccines under development will always need evaluation in endemic settings, most of which have limited resources. Adolescents are an important target population for a new TB vaccine and for other vaccines which are relevant at school-age. However, in most endemic settings there is limited experience of trials of investigational products among adolescents, and adolescents are not routinely vaccinated.

Methods: We used Modified vaccinia Ankara-expressing Ag85A (MVA85A), a well-tolerated candidate vaccine for tuberculosis, to assess the effect of Schistosoma mansoni infection on vaccine immunogenicity among Ugandan adolescents in primary school. We describe here the challenges and lessons learned in designing and implementing this first clinical trial among Ugandan adolescents using a non-licensed vaccine.

Results: The school based immunization study was feasible and adhered to Good Clinical Practice principles.  Engagement with the community and all stakeholders was critical for successful implementation of the trial. Creative and adaptable strategies were used to address protocol-specific, operational and logistical challenges. This study provided lessons and solutions that can be applied to other trials among adolescents in similar settings elsewhere, and to school-based immunization programs.

Conclusion: Sufficient time and resources should be planned for community preparation and sensitization to ensure buy in and acceptance of a project of this kind. This trial shows that challenges to implementing early field trials in Africa are not insurmountable and that necessary well-planned high-quality ethical trials are feasible and should be encouraged.

Trial Registration: ClinicalTrials.gov NCT02178748 03/06/2014

Keywords: Tuberculosis, Vaccines, Clinical trials, Adolescents, Lessons, Challenges, Africa

List of abbreviations

AIDS           Acquired Immune Deficiency Syndrome

BCG            Bacille Calmette-Guérin

CCA            Circulating Cathodic Antigen

ELISpot        Enzyme-Linked ImmunoSpot

ESAT-6        early secretory antigen target-6

CAB            community advisory board

CFP-10        culture filtrate protein-10

Ct                 Cycle threshold

EDCTP         European and Developing Countries Clinical Trials Partnership

HIV              Human Immunodeficiency Virus

HPV             Human Papilloma Virus

IFN-γ           interferon gamma

KK               Kato Katz

LCs              Local Councils

LSHTM         London School of Hygiene & Tropical Medicine

MOH            Ministry of Health

MRC            Medical Research Council

MVA85A        Modified vaccinia Ankara-expressing Antigen 85A

NDA            National Drug Authority (NDA

PCR            Polymerase Chain Reaction

SATVI          South African TB Vaccine Initiative

S.mansoni       Schistosoma mansoni

SOP             standard operating procedures

S.T.P.W.G.o.T.V     Stop TB Partnership Working Group on TB Vaccines

SSA             Sub Saharan African

TB               Tuberculosis

UNCST       Uganda National Council for Science and Technology

UVRI           Uganda Virus Research Institute

VCD            Vector Control Division

VHT            Village Health Teams

WHO          World Health Organization

Background

Tuberculosis (TB) remains a global health problem with very high mortality and morbidity. In 2015, there were an estimated 10.4 million new TB cases 1. TB is one of the top 10 causes of death worldwide, and the leading cause of death from an infectious pathogen 1. The only licensed TB vaccine, Bacille Calmette-Guérin (BCG), prevents severe disease in childhood 2, 3 but does not protect against pulmonary TB among adolescents and adults in tropical latitudes 4. Development of a safe and effective TB vaccine is a key part of the World Health Organization (WHO) comprehensive strategy for combating the epidemic 5. An effective vaccine would revolutionise TB control 6. Candidate TB vaccines in development are designed either to replace the current BCG with more potent whole mycobacterial priming vaccines or to boost BCG given at birth. There are 15 new TB vaccine candidates and candidate combinations that are currently being evaluated in clinical trials 5. Despite the logistical and operational challenges, these vaccines will need evaluation in target populations in TB endemic countries where they are most likely to be deployed when licensed.

There is recent interest in, and need for, adolescent immunisation programs offering, for example, tetanus, hepatitis B boosting and Human Papilloma Virus (HPV) vaccination. Adolescents are therefore an increasingly important target population for school based immunization programs. In addition, adolescence is an important age group for booster TB vaccination 79 because TB re-emerges as the pulmonary (transmissible) form in adolescents and young adults, after a relatively low incidence in childhood 10. Adolescents also harbour a high prevalence and intensity of helminth infection in countries where these are endemic 11, 12. It has been suggested that co-infection with helminths may contribute to the poor immunogenicity of vaccines seen in endemic countries 1316.

Despite the importance of immunization in this age group, and the relative ease of access via school, immunization in late primary school is not always routine in Sub Saharan African (SSA) countries. There are still many opportunities to learn from studies performed in this age group.

We utilised MVA85A, a candidate TB vaccine with an excellent safety profile 1719, as a model vaccine to evaluate the effect of infection with the helminth Schistosoma mansoni ( S. mansoni) on the T cell immunogenicity induced. Immunogenicity results showed that current S. mansoni infection had no effect on the vaccine-induced T cell response 20. This was the first clinical trial of an unlicensed vaccine in adolescents in Uganda. We share here experiences and lessons learned when implementing this trial. These are important for vaccine development in low income countries and for school based immunization programs.

Methods

Study design

This was a non-randomized, open label phase II clinical trial of MVA85A among adolescents with evidence of prior BCG vaccination, and with and without S. mansoni infection.

Study setting and population

The study was conducted in primary school children on the shores of Lake Victoria in Wakiso district in Uganda. We selected schools with a high prevalence of S. mansoni based on previous surveys conducted by the Vector Control Division (VCD) of the Ministry of Health (MOH). VCD is mandated to monitor and treat helminths in schools and communities in Uganda, making this an important partnership for this project. Participants were recruited through their schools. We targeted children in upper primary classes. Preliminary visits and previous work by the VCD indicated there were sufficient numbers of 12–15 year olds in primary schools in the area. We initially selected two primary schools for the study but later added three more in order to achieve our target sample size. Enrolment challenges are discussed in the screening pool and selection criteria section.

Ethical and regulatory approval

The study was reviewed and approved by three committees in Uganda – the Research and Ethics Committee of the Uganda Virus Research Institute, the Uganda National Council for Science and Technology (UNCST) and the Uganda National Drug Authority (NDA; which approves importation of licensed and unlicensed drugs) as well as ethical committees at Oxford University and the London School of Hygiene & Tropical Medicine in the United Kingdom.

The trial was registered with ClinicalTrials.gov under trial id NCT02178748 on the 03/06/2014.

Pre-trial activities

Pre-trial activities included engagement with community leaders, district Ministry of Education and Health officials, school management and parents. We first presented and discussed the project with members of the district health service commission, which monitors all health-related matters in the district. Following this, we secured letters of approval from the district chief administrative officer on behalf of the Ministries of Health and Education introducing our team to the schools and community. We then met and discussed the trial with the head of the National TB Control Program since the study utilised a candidate vaccine for TB. At village level, we held meetings with members of the Village Health Teams (VHTs). VHTs are lay persons selected by the village and trained to provide or advise on primary or first-aid emergency care and other health related community initiatives. For example, VCD works with VHTs to distribute drugs during mass drug administration in the community, and mosquito nets. We held meetings with the chairpersons of the Local Councils (LCs) responsible for administration of the villages to make them aware of our presence and activities in their area of jurisdiction. The study area had a special population, a barracks housing prisons officers; consent for this population adhered to ethical guidelines for vulnerable groups in additional to the specific rules and requirements unique to them. For example, permission to access the barracks to provide information and to request parents or guardians to consent for their children’s participation in the study was restricted to particular times and required additional approvals from the head of the barracks.

We participated in parents’ meetings at each of the schools. Some of these were regularly-scheduled school meetings at which we were assigned a slot to present our work; others were organized solely to inform parents of our study. The project provided refreshments in the form of a soft drink at these parents’ meetings and offered travel reimbursement. The school introduced our team to the parents, and the team then explained the planned study to the parents as a group. We informed the parents of the study processes and that their children might be asked to participate following voluntary parental consent and child’s assent. We also addressed any questions raised.

Pre-screening, screening and recruitment

First, from April to June 2014, all children in the five schools were pre-screened by the VCD as part of their routine mandate to monitor and treat helminths. This involved testing stool for helminths using the Kato Katz (KK) method. In addition to recording the child’s age and sex, the VCD team assisted us by recording the presence or absence of a BCG scar.

Next, formal screening for the trial commenced in June 2014. Participants were selected for screening based on pre-screening findings for age, gender, presence of BCG scar and Kato Katz results on infection status for S. mansoni and other helminths. Assenting adolescents, with consent from any one of the parents or guardian, were screened on the school premises.

At screening, participants provided urine, two further stool samples (on separate days) and blood.

The initial laboratory investigations for screening were performed in the field by a laboratory technologist who was part of the trial team. These included tests for HIV, malaria and schistosome antigen (urine Circulating Cathodic Antigen (CCA)) using rapid diagnostic kits. If no exclusion criteria were met, samples were then transported in cold boxes approximately 20 kilometres along a busy highway from the school field site to laboratories within the Uganda Virus Research Institute (UVRI) campus in Entebbe. Efforts were made to transport the samples within two hours of collection. These were transported by the study vehicle, or by the field worker on a motorcycle when a faster delivery time was required. Sample tracking logs were used to monitor the process. Other screening tests included biochemistry, haematology, serology for hepatitis B and C, immunological assays and testing for helminths in stool by microscopy (Kato Katz) and PCR, detailed elsewhere 20. We used haematology reference ranges from a previous study conducted in Uganda, based on a healthy population, including adolescents 21.

We organized meetings with the parents and children to share results of the screening tests. At these meetings, we informed the parents individually of their child’s eligibility for the study and that we would be seeking their consent for their child’s participation. If ineligible for participation, the reasons for ineligibility were explained to both the parent and child. Ineligible participants were offered advice and/or referred to relevant facilities for treatment where needed.

Prior to vaccination, a further review was done to confirm participants’ eligibility including confirmation that both consent and assent had been given. The protocol allowed for 60 days between screening and vaccination. Eligible participants were enrolled and vaccinated on day 0 at the school premises. Enrolment was done consecutively at each school before moving to the next school. The vaccine was stored at -80°C in a secure, temperature-monitored freezer in the International AIDS Vaccine Initiative pharmacy located on the UVRI campus in Entebbe. It was transported to the field sites on dry ice on vaccination days.

Vaccination was done by the study team in the “temporary mobile clinic” set up on the school premises. The first participant was vaccinated on 11 th August 2014.

After vaccination, each participant was given a diary card to record any symptoms over a 6-day period post vaccination. They were each given a digital thermometer and a pen to take and record their temperature daily. A toll-free study-specific mobile phone line was kept with the study clinicians to advise on emergencies both during, and after, office hours. The number was available to participants, printed on the diary and study cards, and calls were received occasionally.

Vaccinated participants were again seen at the school premises on days (D) 7, 28, 42 (only for S.mansoni infected) and D56 post-vaccination. Stool samples for Kato Katz for all participants were performed at D28 and D56.

All participants were treated for helminths with praziquantel (40mg/kg) and albendazole (400 mg) under observation by trial staff. S.mansoni infected participants received two doses of praziquantel, the first on D28 (after samples were obtained) and the second one on D42, to optimise clearance of infection. Participants with no S.mansoni detected received a single dose on D56 (in accord with the annual mass treatment performed by VCD). All the pupils in the schools involved in this trial who were not enrolled in this trial were offered mass drug administration of praziquantel provided by VCD and administered with the help of staff at school using the validated standard dosing pole 22. The number of tablets given is based on the height of the participants.

Inclusion and exclusion criteria

Participants were eligible for vaccination if aged 12 to 17 years, resident in the study area, BCG-vaccinated (based on BCG scar or written documentation) and healthy by history and physical examination. Exclusion criteria were clinical, radiological, or laboratory evidence of, or previous treatment for, active or latent TB (including a positive ELISpot for early secretory antigen target (ESAT-6) or culture filtrate protein-10 (CFP-10) at screening); sharing a residence with an individual on anti-TB treatment or with culture or smear-positive pulmonary TB within the last year; positive rapid diagnostic tests for HIV [(Alere Determine™ HIV–1/2 Ag/Ab Combo Catalogue No. 7D2649), (HIV 1 /2 STAT-PAK ® DIPSTICK Assay HIV303 Catalogue No. 60-9534-0) and (Uni-GoldTM HIV Catalogue No. 1206502); positive serology for HIV (Murex Diasorin, Catalogue No. 9E25-02, HIV-1.2.0, Italy and Vironostika, Biomerieux, France), hepatitis B (surface Antigen Catalogue No. KMC 30011 and hepatitis C (Innotest HCV Ab IV Catalogue No. 80068(192T-CE), Innogenetics, Belgium); positive rapid diagnostic test for malaria (SD-Bioline Inc, Korea. Catalogue No. 05FK50); Mansonella perstans infection (modified Knott’s method); intestinal parasites other than S. mansoni; pregnancy; history of anaphylaxis or allergy likely to be exacerbated by vaccine; haematological or biochemical findings deemed clinically significant at screening and S. mansoni infection intensity of more than 2000 eggs per gram of stool (these individuals were treated immediately).

Study endpoints

The primary endpoint was T cell immunogenicity assessed by ex vivo Ag85A-specific interferon gamma (IFN-γ) ELISpot response. Secondary endpoints included the profile of cytokine responses; plasma antibody concentrations to Ag85A, Schistosome Worm and Egg Antigens as well as any adverse events 20.

Study results

Trial safety and immunogenicity data are described elsewhere 20. Here we focus on findings pertinent to the practical lessons learned.

A total of 1068 children were pre-screened by the VCD team at the five primary schools. Only 174 were within the target age group of 12–17 years and therefore approached for screening. Of these, 67 were excluded before consenting, 35 because parents/guardians did not consent; 12 had no BCG scar; 10 left school during the initial processes; five had no adult or responsible legal guardian accessible for consenting; three had recently been treated for schistosomiasis; one volunteer had known HIV-positive status; one was found to be under age at screening (11 years) despite having reported being 12 years at pre-screening. The main reason for many of the parents not consenting was unavailability due to work rather than any specific objection to the vaccine or participation in the trial.

A total of 107 participants who provided consent and assent were screened for eligibility. Only 36 (34%) of these were enrolled. A positive urine test for Schistosoma CCA, in spite of negative Kato Katz microscopy, among potential uninfected participants was the most common reason for screening failure (n=30, 42%). Other reasons included positive ELISpot at baseline indicating TB infection (n=19); positive rapid diagnostic test for malaria (n=10) and infection with other helminths (n=6). Five participants withdrew consent after screening. In three of the five instances where the reason for withdrawing consent was expressed, it was because one of the parents or the guardian (a grandfather and a brother) did not feel confident enough to take a decision for the child’s further participation in the study.

Each group had eighteen participants, although three participants in group 1, intended to be the no helminths group, had S. mansoni detected on PCR and were followed up to end of study and included in the safety analysis but excluded from the immunogenicity analysis. Infected and uninfected participants differed in age, school and hookworm ( Necator americanus) PCR status.

Figure 1 shows a summary of the challenges encountered and solutions during pre-screening, screening and follow up.

Figure 1. Summary of the challenges encountered and solutions during pre-screening, screening and follow up.

Figure 1.

Lessons learned and recommendations

Engagement of stakeholders

The pre-trial meetings with community leaders, district Ministry of Education and Health officials, school management and parents effectively engaged stakeholders in the community and schools within the district and study area. These meetings were also a good opportunity for the team to tackle misbeliefs and rumours by providing correct information. For instance, in one of the schools, a couple of parents living in the same neighbourhood expressed a concern, based on rumours, that prior vaccination campaigns had led to several deaths in this community. Using information from the Ministry of Health on previous vaccination campaigns in that area, the team were able to confirm that this rumour was unfounded. This information was relayed to the parents in a subsequent meeting. It is important to make efforts to enhance two-way communication with communities to discuss issues that may be of concern to both the researchers and the community, and in so doing, help to close the vaccine confidence gap 2326.

Given the short time-frame (2-month duration of follow up), we did not establish a community advisory board (CAB), although these have become an integral part of studies with long follow-up periods. Community engagement activities, and CABs if needed, enhance community understanding of the research objectives and procedures, leading to mutual trust and a sense of collective ownership 23, 27. Findings from a study in rural Eastern Uganda 28 that explored the stakeholder perceptions about adolescent participation in a hypothetical TB vaccine trial in Ugandan adolescents indicated willingness to participate but highlighted the need for effective communication to the community with regards to the trial, its effects, and safety data, at an appropriate literacy level and in a readily understood format. In their study 28, adolescents and parents reported that their decision to participate in a trial would hinge on the quality of information provided, the effects of the vaccine, and other benefits such as access to healthcare and compensation; this concurs with a stakeholder perception study in South Africa, reported by Mahomed et al 29.

All our pre-trial activities and meetings were carried out alongside the VCD, which routinely works and delivers annual mass drug administration within this schistosomiasis endemic area and is well known and respected in the community. As reported by others 24, 30, collaborating with both government and non-government agencies already working on the ground and establishing relationships with key opinion leaders and stakeholders is essential.

As others have reported 24, the pre-trial activities and engagement were useful for community acceptance and smooth implementation of the project. The HPV pilot vaccination program in Uganda 24 showed that community buy-in could be achieved through a comprehensive understanding of information needs and effective communication strategies.

However, we did not minute our stakeholder meetings, or formally evaluate the impact and usefulness of these activities on the trial implementation and understanding of aims by the participants, parents and community. During a site visit, inspectors from the UNCST commented that more documentation of these meetings, such as the questions and concerns raised by the parents, and whether they understood what was presented, would have been useful. Innovative methods of engaging adolescents and the community have been used by other researchers enrolling adolescents in TB vaccine trials. The South African TB Vaccine Initiative (SATVI) used drama to engage and raise awareness of TB and clinical trials among adolescents 25. They followed through by assessing the impact of the drama on the adolescents. We therefore recommend that sufficient time and resources should be planned for community preparation and sensitization to ensure community buy in and acceptance of a project of this kind, and that engagement activities are appropriately monitored and evaluated to reassure regulators and to inform future work.

Screening pool and selection criteria

The schools provided us with initial estimates, based on age, of the pool of potential participants. These turned out to be inaccurate and an overestimate. For example, one of the schools indicated that they had over 100 children in the upper primary classes (our target age group) but we found only 59 during pre-screening. We therefore quickly exhausted the pool during screening and had to alter our initial recruitment plan from two to five schools. The figures were usually based on the number of school attendees who had sat exams in the previous year, which was not always an accurate reflection of average attendance during the regular school period. Many children stay away from school doing household chores and other family activities such as farming, stone quarrying and fishing, and only show up later in the school term and closer to the examination period. Working closer to end of term rather than earlier in the school term yielded better numbers, but it was important to work with minimal interruption to the students especially during examination periods. It is important to be aware of such issues that may affect school attendance and plan accordingly.

We noted to our surprise a very high percentage of hookworm PCR positivity even for those participants that had three samples negative for hookworm on microscopy. These however had a high cycle threshold (Ct) value which is indicative of light infections that could have been hard to detect using the Kato Katz method. As described by others 31, this real-time PCR method is more sensitive than the conventional microscopic detection of hookworm infections. We had to amend the protocol to remove hookworm PCR positivity from the exclusion criteria because it would have been impossible to recruit the required number of children with S. mansoni infection and a negative hookworm PCR. We opted to adjust for hookworm PCR status in the analysis.

As reported by other African research sites 21, 32, 33, we did not have locally applicable ‘normal’ reference ranges for laboratory tests of this adolescent population. Published reference ranges are usually based on Western populations. It was agreed during protocol development to use reference ranges for haematology that catered for adolescents from a previous study 21 and to discuss abnormal screening biochemistry results in the trial management team meetings.

Our high exclusion rate meant that we encountered sample size challenges, and it was not possible to extend recruitment due to funding constraints. The original sample size proposed was 40–60 infected and 30 uninfected volunteers. We revisited the power calculations and found that enrolling approximately 12–24 children per group would still give us sufficient power (82% to 94%) to detect a two-fold reduction in immunogenicity in the S. mansoni infected group 20. A two-fold difference in immunogenicity is a minimum level of clinical and immunological significance. Our final sample size of 18 in each group was a pragmatic compromise between desired study power and logistical challenges. Whereas we acknowledge the possibility that small but potentially interesting effects may have been missed, there was no suggestion of an effect of helminth infection on vaccine immunogenicity 20.

Given the anticipated gender and age differences in the prevalence of helminths, the initial plan was to group-match by age and gender at enrolment within 6 strata (males aged 12-13, males aged 14-15, males aged 16-17 and females aged 12-13, females aged 14-15 and females aged 16-17). This proved a challenge to recruitment and a further protocol amendment was necessary to reduce this requirement to controlling for age and gender in the analysis, instead of age stratification.

Careful consideration of protocol challenges and development of well thought out amendments during the trial allowed us to adapt and respond to recruitment challenges while ensuring that the study remained scientifically sound.

Operational and logistical issues

Early-phase clinical trials are often carried out in purpose built clinics but this may not be appropriate or feasible when conducting field studies on endemic and neglected infectious diseases in the target population. For this field trial, on vaccination days, the vaccine was transported on dry ice to the field sites located about 20 kilometres along a busy and usually traffic-congested highway. The field team went to the field site first to prepare the participants, and communicated to the driver and internal monitor to bring the vaccine once the team was ready. This was a logistical challenge which was resolved with good communication and coordination within the team.

Space at the field sites was another challenge given that schools are not designed to have such activities. Necessary equipment included resuscitation tools and oxygen, and arrangements for emergency care were made with nearby hospitals. Where available, the school administration provided space or a room for study activities and secure storage for equipment and supplies. If unavailable, the team moved with these items on a daily basis. Given the set up, we did not always have a clean and private space for counselling and procedures but improvised using a tent and movable screens. We hired a local resident to work as a security guard whenever we left the erected tent onsite during the weekend.

The study had transportation needs for the vaccine, samples, staff, participants and equipment. We relied heavily on the single study vehicle and the field worker’s motorcycle and occasionally hired additional transport services when needed.

We therefore recommend that there is careful consideration of field provisions for privacy, point of care lab testing and handling of samples, provision of investigational products, equipment transport and security arrangements for study equipment and confidentiality of documents.

School specific issues

Our study required working with adolescents aged 12 to 17 years attending school. It was important to schedule our activities in parallel with the school calendar and timetable. This included planning for school holidays, examination periods, school meetings and sending letters of invitation to the parents. We tried to avoid interruption of lessons by working within the pupils’ break periods. At the onset, we also planned not to recruit participants in candidate classes for national Primary Leaving Certificate Examinations so as to avoid disrupting their studies, especially during the final examination period. Enrolled participants were reminded the day before of their next visit and in some instances collected from home by the study driver or field worker on the visit day if they had missed school. Some of the children who participated in the pre-screening and screening activities had dropped out of school by the time we returned to enrol them. The school administration, teachers, parents and children worked well together. Several teachers served as witnesses for illiterate parents during the consenting process. However, at times this encroached on their teaching responsibilities and had to be managed effectively. We emphasized to the parents that consent was voluntary and there were no consequences for declining to consent.

Other studies 26, 34 in Africa have reported similar challenges including school absenteeism and incomplete records. This can be more common during specific seasons such as rainy season for farming or fishing. Community strategies to address school absenteeism, such as encouraging attendance by providing meals, may help 26, 34. Our study paid for the school meals for the whole school on the day mass drug administration was given specifically to target side effects related to use of praziquantel on an empty stomach 35.

At the school level, collaboration with the school administration and management was key for successful implementation of the project. Careful planning in consideration of the school calendar and activities would be necessary for successful implementation of a similar school-based immunization program. Our study indicates that school based immunization programs can be made possible with minimal interruption to school activities. They also provide an opportunity for integrated healthcare services for adolescents. Our study activities were tagged to the mass drug administration to schools in schistosomiasis endemic areas done by VCD. Others have incorporated screening for alcohol and tobacco use in South Africa 36; deworming and distribution of Vitamin A in Uganda 34 and health promotion in Rwanda 37. Combining HPV vaccine delivery with other adolescent programs 24 was an efficient strategy for good use of limited resources.

Ethical and regulatory issues

The review process involved three ethics committees and two regulatory bodies (see ethical and regulatory approval) and took seven months in total. This was the first vaccine trial of a non-licensed product among the vulnerable adolescent population in Uganda, and the NDA sourced external reviewers, as well as in-house reviewers, for this content area. A meeting to explain further the study to the NDA and address queries was helpful to obtain the final approval.

It is important to anticipate such delays, especially for studies in vulnerable populations. Where acceptable, concurrent submissions can expedite the process. Extra efforts to present as much information as possible and face to face meetings can help, particularly for new study areas or populations. Several institutions and funding agencies, such as the European and Developing Countries Clinical Trials Partnership (EDCTP) and WHO, are supporting the strengthening of both ethical committees and regulatory authorities in Africa 38.

The trial had an in-house internal monitor who was also delegated by the sponsor to serve as the local safety monitor. External monitoring, meeting the expected international standards, was performed by the EDCTP-funded reciprocal monitoring scheme at a reasonably affordable cost. UNCST selected this study for a supervisory site visit because they were especially interested for purposes of benchmarking the specific use of a new investigational product in the adolescent population. They were satisfied with its conduct and documentation.

Each participant had to have both assent and consent to be enrolled. Assenting was mostly performed at school while consenting was carried out either at school or at home. In anticipation of the challenges, it was agreed up-front in the standard operating procedures (SOPs) that assent and consent did not have to be done simultaneously on the same day or time. The children provided assent independently of their parents. For the consent process, identification of suitable witnesses, where needed, was easier at school but at times posed a challenge at home.

Protocol and study specific issues

Given the many screening tests, and challenges in tracing some participants, the 60-day screening window expired before enrolment for a few participants. A decision on how to proceed on these issues was discussed and agreed during the weekly trial management team meetings on a case-by-case basis by repeating only those screening tests for which results might have changed beyond the accepted screening window period.

The field trial team was small: a project leader who is a medical doctor, a clinical officer, a nurse, a field laboratory technologist and a field worker. Each member of the team had a back-up identified and trained from within the wider host research programme at the start of the trial, although these were equally busy at their primary station and therefore not readily available. All trial team members were trained and delegated to perform the general roles such as consenting and assenting. This helped to ensure better work flow in the event that a team member was unavailable. Staffing challenges are reported in other studies 39 and creative strategies to address them should be devised.

In our setting, most people do not have birth certificates or records but report a particular age based on what their parents told them. When asked during pre-screening and screening, many children reported a slightly different age from the one calculated from their reported date of birth when completing the questionnaires. In such circumstances, the trial management team agreed to use the reported age. Mugisha et al. 34 found similar challenges and reported that determining age eligibility was easier using a grade-based strategy that relied on child’s school grade/class rather than an age based strategy which attempts recruitment based on age. Similarly, the pilot HPV vaccination program in Uganda 24 reported that it was easier to implement school based immunization programs based on grade/class in school, rather than age. Whereas this may be a practical solution during implementation of programs, it may not be acceptable for regulations and guidelines for clinical trials.

Most of our participants did not have their child health immunization card or record. For evidence of BCG vaccination, we relied on presence of BCG scar which may have excluded participants who were vaccinated but did not have a clearly visible scar.

Our study participants initially experienced some difficulties in completion of diary cards at home, with some checking off all symptoms and all severity grading. More emphasis on training the participants on how to complete the diary cards was done subsequently prior to vaccination. This required more time but was beneficial in the long run.

Conclusion

We have described the challenges and lessons learned in designing and implementing this first clinical trial among Ugandan adolescents using a non-licensed vaccine. This study provided lessons that can be applied to other trials among adolescents in similar settings, and to school-based immunization programs. The solutions we implemented will be of value in planning other trials in this vulnerable population in Uganda and in similar settings elsewhere. This trial shows the challenges in implementing early-Phase field trials in Africa are not insurmountable and well planned ethical trials are feasible and should be encouraged.

Declarations

Ethics approval, consent and assent to participate

The study was reviewed and approved by three committees in Uganda – the Research and Ethics Committee of the Uganda Virus Research Institute [Reference GC/127/14/01/444], the UgandaNational Council for Science and Technology (UNCST) [Reference HS 1565] and the Uganda National Drug Authority (NDA; which approves importation of licensed and unlicensed drugs) [Reference 198/ESR/NDA/DID-05/2014], as well as the Oxford Tropical Research Ethics Committee at the University of Oxford [Reference 1060-13] and the Observational/Interventions Research Ethics Committee at the London School of Hygiene & Tropical Medicine in the United Kingdom [Reference 7283]. Informed consent for the adolescents to participate in the trial was sought from their parents or guardians. Assent to participate was sought from the adolescents.

Data availability

The main results of this trial with full methods have been reported previously: https://doi.org/10.1371/journal.pntd.0005440 20

The datasets generated and/or analysed during the study are available without a license in the Jenner Institute, University of Oxford repository: Article ID PNTD-D-16-01618R1 http://www.jenner.ac.uk/pntd-d-16-01618r1

Acknowledgements

We acknowledge Giuseppe Pantaleo for his contribution to the concept and design of the study, and Simon Kerridge for training. We thank the participants, their parents, the school staff and the Wakiso District education authorities for supporting our work, the Vector Control Division of the Ministry of Health for arranging and conducting the initial screening for helminth infections, and the trial team for all their work.

TB036 Trial Team

Project leader: Anne Wajja. Statisticians and data managers: Jonathan Levin, Rebecca Nsubuga, Gertrude Mutonyi, Ronald Galiwango. Field team: Milly Namutebi, Barbara Apule, Gloria Oduru, Sam Kiwanuka. Immunology laboratory: Dennison Kizito, Beatrice Nassanga, Angela Nalwoga, Simon Kimuda. Parasite PCR: Barbara Nerima, Joyce Kabagenyi, Jaco Verweij. Pharmacist: Ismail Sekandi. Vector Control Programme: Edridah Tukahebwa, Juma Mpiima. University of Oxford: Samantha Vermaak, Iman Satti, Alison Lawrie, Hannah Johnson. Co-investigators: Pontiano Kaleebu, Stephen Cose. Principal Investigator: Alison Elliott. Chief Investigator: Helen McShane.

Funding Statement

This work was supported by the Wellcome Trust [095778 to AME, and 095780 to HM] This work was also supported by the European Community's Seventh Framework Programme [FP7/2007-2013] under EC-GA No 241642.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 1; referees: 1 approved, 2 approved with reservations]

References

  • 1. WHO: Global Tuberculosis Report.2016. Reference Source [Google Scholar]
  • 2. Rodrigues LC, Diwan VK, Wheeler JG: Protective effect of BCG against tuberculous meningitis and miliary tuberculosis: a meta-analysis. Int J Epidemiol. 1993;22(6):1154–8. 10.1093/ije/22.6.1154 [DOI] [PubMed] [Google Scholar]
  • 3. Trunz BB, Fine P, Dye C: Effect of BCG vaccination on childhood tuberculous meningitis and miliary tuberculosis worldwide: a meta-analysis and assessment of cost-effectiveness. Lancet. 2006;367(9517):1173–80. 10.1016/S0140-6736(06)68507-3 [DOI] [PubMed] [Google Scholar]
  • 4. Fine PE: Variation in protection by BCG: implications of and for heterologous immunity. Lancet. 1995;346(8986):1339–45. [DOI] [PubMed] [Google Scholar]
  • 5. WHO, S.T.P.W.G.o.T.V: TB vaccine pipeline.2014. [Google Scholar]
  • 6. McShane H: Tuberculosis vaccines: beyond bacille Calmette-Guerin. Philos Trans R Soc Lond B Biol Sci. 2011;366(1579):2782–9. 10.1098/rstb.2011.0097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Evans TG, Brennan MJ, Barker L, et al. : Preventive vaccines for tuberculosis. Vaccine. 2013;31 Suppl 2:B223–6. 10.1016/j.vaccine.2012.11.081 [DOI] [PubMed] [Google Scholar]
  • 8. Kaufmann SH: Tuberculosis vaccines: time to think about the next generation. Semin Immunol. 2013;25(2):172–81. 10.1016/j.smim.2013.04.006 [DOI] [PubMed] [Google Scholar]
  • 9. Weiner J, 3rd, Kaufmann SH: Recent advances towards tuberculosis control: vaccines and biomarkers. J Intern Med. 2014;275(5):467–80. 10.1111/joim.12212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Alcaïs A, Fieschi C, Abel L, et al. : Tuberculosis in children and adults: two distinct genetic diseases. J Exp Med. 2005;202(12):1617–21. 10.1084/jem.20052302 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Kabatereine NB, Brooker S, Koukounari A, et al. : Impact of a national helminth control programme on infection and morbidity in Ugandan schoolchildren. Bull World Health Organ. 2007;85(2):91–9. 10.2471/BLT.06.030353 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Muhumuza S, Olsen A, Katahoire A, et al. : Uptake of preventive treatment for intestinal schistosomiasis among school children in Jinja district, Uganda: a cross sectional study. PLoS One. 2013;8(5):e63438. 10.1371/journal.pone.0063438 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Elias D, Akuffo H, Pawlowski A, et al. : Schistosoma mansoni infection reduces the protective efficacy of BCG vaccination against virulent Mycobacterium tuberculosis. Vaccine. 2005;23(11):1326–34. 10.1016/j.vaccine.2004.09.038 [DOI] [PubMed] [Google Scholar]
  • 14. Elias D, Akuffo H, Thors C, et al. : Low dose chronic Schistosoma mansoni infection increases susceptibility to Mycobacterium bovis BCG infection in mice. Clin Exp Immunol. 2005;139(3):398–404. 10.1111/j.1365-2249.2004.02719.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Su Z, Segura M, Stevenson MM: Reduced protective efficacy of a blood-stage malaria vaccine by concurrent nematode infection. Infect Immun. 2006;74(4):2138–44. 10.1128/IAI.74.4.2138-2144.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. van Riet E, Hartgers FC, Yazdanbakhsh M: Chronic helminth infections induce immunomodulation: consequences and mechanisms. Immunobiology. 2007;212(6):475–90. 10.1016/j.imbio.2007.03.009 [DOI] [PubMed] [Google Scholar]
  • 17. Hawkridge T, Scriba TJ, Gelderbloem S, et al. : Safety and immunogenicity of a new tuberculosis vaccine, MVA85A, in healthy adults in South Africa. J Infect Dis. 2008;198(4):544–52. 10.1086/590185 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Scriba TJ, Tameris M, Mansoor N, et al. : Modified vaccinia Ankara-expressing Ag85A, a novel tuberculosis vaccine, is safe in adolescents and children, and induces polyfunctional CD4 + T cells. Eur J Immunol. 2010;40(1):279–90. 10.1002/eji.200939754 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Tameris MD, Hatherill M, Landry BS, et al. : Safety and efficacy of MVA85A, a new tuberculosis vaccine, in infants previously vaccinated with BCG: a randomised, placebo-controlled phase 2b trial. Lancet. 2013;381(9871):1021–8. 10.1016/S0140-6736(13)60177-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Wajja A, Kizito D, Nassanga B, et al. : The effect of current Schistosoma mansoni infection on the immunogenicity of a candidate TB vaccine, MVA85A, in BCG-vaccinated adolescents: An open-label trial. PLoS Negl Trop Dis. 2017;11(5):e0005440. 10.1371/journal.pntd.0005440 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Lugada ES, Mermin J, Kaharuza F, et al. : Population-based hematologic and immunologic reference values for a healthy Ugandan population. Clin Diagn Lab Immunol. 2004;11(1):29–34. 10.1128/CDLI.11.1.29-34.2004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Montresor A, Engels D, Chitsulo L, et al. : Development and validation of a 'tablet pole' for the administration of praziquantel in sub-Saharan Africa. Trans R Soc Trop Med Hyg. 2001;95(5):542–4. 10.1016/S0035-9203(01)90034-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Mwangoka G, Ogutu B, Msambichaka B, et al. : Experience and challenges from clinical trials with malaria vaccines in Africa. Malar J. 2013;12:86. 10.1186/1475-2875-12-86 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. PATH: HPV Vaccination in Africa: Lessons Learned from a Pilot Program in Uganda. 2011. Reference Source [Google Scholar]
  • 25. Schmidt BM, Abrams A, Tameris M: Engaging adolescents in tuberculosis and clinical trial research through drama. Trials. 2016;17:177. 10.1186/s13063-016-1291-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Vermandere H, Naanyu V, Degomme O, et al. : Implementation of an HPV vaccination program in Eldoret, Kenya: results from a qualitative assessment by key stakeholders. BMC Public Health. 2015;15:875. 10.1186/s12889-015-2219-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Tindana PO, Singh JA, Tracy CS, et al. : Grand Challenges in Global Health: Community Engagement in Research in Developing Countries. PLoS Med. 2007;4(9):e273. 10.1371/journal.pmed.0040273 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Buregyeya E, Kulane A, Kiguli J, et al. : Motivations and concerns about adolescent tuberculosis vaccine trial participation in rural Uganda: a qualitative study. Pan Afr Med J. 2015;22:76. 10.11604/pamj.2015.22.76.7097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Mahomed H, Shea J, Kafaar F, et al. : Are adolescents ready for tuberculosis vaccine trials? Vaccine. 2008;26(36):4725–30. 10.1016/j.vaccine.2008.06.088 [DOI] [PubMed] [Google Scholar]
  • 30. Quintiles: Challenges in conducting tuberculosis clinical trials in developing countries.2013. [Google Scholar]
  • 31. van Mens SP, Aryeetey Y, Yazdanbakhsh M, et al. : Comparison of real-time PCR and Kato smear microscopy for the detection of hookworm infections in three consecutive faecal samples from schoolchildren in Ghana. Trans R Soc Trop Med Hyg. 2013;107(4):269–71. 10.1093/trstmh/trs094 [DOI] [PubMed] [Google Scholar]
  • 32. Lubega IR, Fowler MG, Musoke PM, et al. : Considerations in using US-based laboratory toxicity tables to evaluate laboratory toxicities among healthy Malawian and Ugandan infants. J Acquir Immune Defic Syndr. 2011;55(1):58–64. 10.1097/QAI.0b013e3181db059d [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Watson-Jones D, Mugo N, Lees S, et al. : Access and Attitudes to HPV Vaccination amongst Hard-To-Reach Populations in Kenya. PLoS One. 2015;10(6):e0123701. 10.1371/journal.pone.0123701 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Mugisha E, LaMontagne DS, Katahoire AR, et al. : Feasibility of delivering HPV vaccine to girls aged 10 to 15 years in Uganda. Afr Health Sci. 2015;15(1):33–41. 10.4314/ahs.v15i1.5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Muhumuza S, Olsen A, Katahoire A, et al. : Reduced uptake of mass treatment for schistosomiasis control in absence of food: beyond a randomized trial. BMC Infect Dis. 2015;15:423. 10.1186/s12879-015-1158-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. MacPhail C, Venables E, Rees H, et al. : Using HPV vaccination for promotion of an adolescent package of care: opportunity and perspectives. BMC Public Health. 2013;13:493. 10.1186/1471-2458-13-493 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Torres-Rueda S, Rulisa S, Burchett HE, et al. : HPV vaccine introduction in Rwanda: Impacts on the broader health system. Sex Reprod Healthc. 2016;7:46–51. 10.1016/j.srhc.2015.11.006 [DOI] [PubMed] [Google Scholar]
  • 38. Nyika A, Chilengi R, Ishengoma D, et al. : Engaging diverse communities participating in clinical trials: case examples from across Africa. Malar J. 2010;9:86. 10.1186/1475-2875-9-86 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Tameris M, McShane H, McClain JB, et al. : Lessons learnt from the first efficacy trial of a new infant tuberculosis vaccine since BCG. Tuberculosis (Edinb). 2013;93(2):143–9. 10.1016/j.tube.2013.01.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2019 Jan 11. doi: 10.21956/wellcomeopenres.16054.r34468

Referee response for version 1

Dessislava V Marinova 1

The manuscript by Wajja Anne  et al., sent for publication as a research article in Wellcome Open Research Journal focuses on the lessons learned from the technical, operational and logistic challenges encountered upon conducting an open label Phase II field trial with the tuberculosis vaccine candidate MVA85A, a model candidate tuberculosis vaccine, to assess the effect of helminth  Schistosoma mansoni ( S. mansoni) infection on vaccine-induced immunogenicity (and safety) in BCG-vaccinated Ugandan adolescents.

Authors describe that this was the first clinical trial(school-based immunization study) of an unlicensed vaccine in adolescents in Uganda and show that pre-trial engagement with the community and all stakeholders, including community leaders, district Ministry of Education and Health officials, school management and parents is critical for successful implementation of a project of this kind.

This work provides lessons and solutions that can be of great value for the design and implementation of clinical trials among adolescents in similar settings, including TB vaccine clinical trials targeting specifically this age group population where incidence of pulmonary (transmissible) forms of TB is considered very high, as well as to school-based immunization programs. This article presents scientifically sound work suitable for publication in Wellcome Open Research Journal.

Comments for the authors

 

  1. Abstract and Background in main text: Although the scope of the article is the description of challenges and solutions implemented for the successful conduct of this first clinical trial in Ugandan adolescents, the specific rationale of the clinical study and relevance of the study results is not clear. Briefly describe study rationale and how results can serve the scientific community in these two sections.

 

  1. Since this study is very useful for implementing new clinical trials in adolescents in Uganda and in similar settings, it would be useful that authors comment on how it was dealt with convincing the community and stakeholders on using a candidate TB vaccine which has been shown to be ineffective against tuberculosis for the purposes of the current study.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2019 Jan 4. doi: 10.21956/wellcomeopenres.16054.r34469

Referee response for version 1

Benjamin M Kagina 1

In this manuscript, the authors document the challenges experienced and lessons learnt while conducting a phase II trial of a non-licensed TB vaccine (MVA85A) among Ugandan adolescents. The authors have shared some practical steps taken by the study teams to address the challenges encountered during the clinical trial. 

The authors have contributed useful knowledge (specifically on the operational aspects) in the field of adolescent immunisation. Research on adolescent immunisation, whether primary (with vaccines such as HPV) or booster (e.g Tdap) or catch up (e.g measles) or testing vaccines (e.g TB vaccines) is limited. Therefore, the authors must be commended for this relevant scientific contributions to the field. 

Here are some comments for the authors to consider:

1) Abstract and background- because this study was nested within a clinical trial, clarity of the current study rationale and methods is lost at the expense of the main study (clinical trial). Emphasize must be given to the rationale and methods that are relevant to the findings of this manuscript.

2) Study endpoints: this section is completely misaligned with the study findings and this affects clarity.

3) Methods/results/discussion- there are several known individual related factors that can affect adolescent vaccination (or engaging this population to participate in clinical trials). One of the factors is lack of optimal knowledge on immunisation, vaccines and VPDs by the adolescents themselves, teachers as well as their parents. If the authors never specifically investigated this factor, discussions on this and other related factors would be useful. 

4) Authors should mention if these results can be extrapolated to similar settings in Africa. Are there study limitations? Related to the study limitations, what would be the most optimal study design to investigate the challenges discussed in this study? This information can be the entry point of future follow up studies.

Minor comment: be consistent when using the term "school-based". Sometimes the term has an hyphen and other times, the term is not hyphenated.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2018 Nov 6. doi: 10.21956/wellcomeopenres.16054.r33979

Referee response for version 1

Neil French 1

The paper sets out to describe the lessons learned from performing a trial of an experimental TB vaccine in adolescents. I was anticipating a qualitative or semi-quantitative evaluation of key issues relating to recruitment and follow up of this population group, but the paper contained a more subjective description of activities, including several generic issues which are not unique to this particular study. I enjoyed the read but was not left with the feeling that the there was a clear set of recommendations that will enhance the prospects of researchers who are new to this area. The authors should consider how they might focus this down to a more specific critique of the issues for adolescent/school studies. As a minimum they should distinguish between generic clinical trial issue and those features that were specific to or interactive with this group of adolescents in all parts of the document.

Introduction: this describes the nature of the study and the rationale for undertaking a study in adolescents of this vaccine. It did not contain any reflection on clinical trials undertaken in adolescents as a whole. It would have been valuable to have some statement of what has been done in this area to date.

Methods: this describes the study recruitment intervention and follow up. This study has been published elsewhere, so the methods could have been made more concise by focusing down on specific areas that are unique to undertaking a trial in adolescents e.g. less on samples taken and more on what parts of the pre trial discussions were specific to this trial and would not be part of an adult trial. I suspect discussion with the  district health commission is something that goes on with every study, adding information to show what was unique in the methods would be very helpful. A little more information on the schools would also be helpful – size, number of teachers, catchment areas. Were these all government funded schools?

Results: the breakdown of screening and recruits and follow up by numbers and reasons is valuable. The last paragraph that indicates the status of the final recruits by helminth status is a little distracting as this has probably been reported in the main paper and doesn’t add a great deal to the paper. Were there any follow up issues?

Lessons learnt: The pre trial meetings, better description of what was specific is needed, either here or in methods. A comment is made about sufficient time and resources, could this be quantitated in some way – how many meetings, how many people involved, how much time was invested in this. What I would also like to know was if there were any issues raised by the various groups that were related to the study group.

The VCD team what specific actions did they undertake that progressed the study or was this just familiarity? Could this have worked in a negative way – this group were trusted which limited critical community review?

In figure 1 I found the mixing of generic study issues with target group specific issues unhelpful. For instance in the enrolment section challenges box issues such as machine validation and transport needs are generic issues for trials in low income settings, whereas reference ranges and school absenteeism are specific and seem of greater relevance to this paper. As a minimum please separate or sub head these. I am surprised you didn’t insert details in this table about potential recruitment assessment as this was a challenge, in so much as the figures were not accurate. Why was a secondary school not chosen for this study – this could be described in greater detail.

The paragraph on PCR positivity focuses on technical aspects and test accuracy. Could this be put in the context of the adolescent population under study? Is this likely to be specific to this population or a generic issue? As this seems to be a broadly recognised issue does it need to be in this paper? Similarly the discussion of sample size and power isn’t something generic to this study, could this not be linked to the difficulties with school registers. What is your advice for overcoming these issues in the future? Is there a more reliable way to predict likely recruitment numbers or should you arithmetically correct any school estimates?

The ethical clearance was suggested to take a long time – are there any data from other clinical trials done during this period to support this, or is this typical for the setting? If not what were the specific issue that slowed the process? Was the face to face meeting an unusual event or does this happen frequently?

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    The main results of this trial with full methods have been reported previously: https://doi.org/10.1371/journal.pntd.0005440 20

    The datasets generated and/or analysed during the study are available without a license in the Jenner Institute, University of Oxford repository: Article ID PNTD-D-16-01618R1 http://www.jenner.ac.uk/pntd-d-16-01618r1


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES