Skip to main content
PLOS Global Public Health logoLink to PLOS Global Public Health
. 2022 Aug 8;2(8):e0000581. doi: 10.1371/journal.pgph.0000581

Civil war and death in Yemen: Analysis of SMART survey and ACLED data, 2012–2019

Debarati Guha Sapir 1,2,#, Jideofor Thomas Ogbu 1,#, Sarah Elizabeth Scales 3,‡,*, Maria Moitinho de Almeida 1,, Anne-Francoise Donneau 4,, Anh Diep 4,, Robyn Bernstein 5,, Akram al-Masnai 6,, Jose Manuel Rodriguez-Llanes 7,, Gilbert Burnham 2,
Editor: Amrish Yashwant Baidjoe8
PMCID: PMC10022117  PMID: 36962390

Abstract

Conflict in Yemen has displaced millions and destroyed health infrastructure, resulting in the world’s largest humanitarian disaster. The objective of this paper is to examine mortality in Yemen to determine whether it has increased significantly since the conflict began in 2015 compared to the preceding period. We analysed 91 household surveys using the Standardized Monitoring and Assessment of Relief and Transitions methodology, covering 2,864 clusters undertaken from 2012–2019, and deaths from Armed Conflict Location & Event Data Project database covering the conflict period 2015–2019. We used a Poisson-Gamma model to estimate pre-conflict (μp, baseline value) and conflict period (μc) mean death rates using household survey data from 2012–2019. To analyse changes in the distribution of deaths and estimate nationwide excess deaths, we applied pre- and post-conflict death rates to total population numbers. Further, we tested for association between excess death and security levels by governorate. The national estimated crude death rate/10,000 in the conflict period was 0.20 (95% CI: 0.17, 0.24), which is meaningfully higher than the estimated baseline rate of 0.19 (95% CI: 0.17, 0.22). Applying the conflict period rate to the Yemeni population, we estimated 168,212 excess deaths that occurred between 2015 and 2019. There was an 17.8% increase in overall deaths above the baseline during the conflict period. A large share (67.2%) of the excess deaths were due to combat-related violence. At the governorate level, posterior crude death rate varied across the country, ranging from 0.03 to 0.63 per 10,000 per day. Hajjah, Ibb, and Al Jawf governorates presented the highest total excess deaths. Insecurity level was not statistically associated with excess deaths. The health situation in Yemen was poor before the crisis in 2015. During the conflict, intentional violence from air and ground strikes were responsible for more deaths than indirect or non-violent causes. The provision of humanitarian aid by foreign agencies may have helped contain increases in indirect deaths from the conflict.

Introduction

The 2019 United Nations Office for Coordination of Humanitarian Affairs’ (UNOCHA) Humanitarian Needs Overview on Yemen describes the plight of a country that, despite the severity of the humanitarian crisis, is infrequently at the top of news headlines or global agendas. However, more than 24 million Yemenis, or 80% of the population, require some type of humanitarian assistance, and 19.7 million lack adequate health care, including emergency services, routine vaccination, and maternity care [1]. The war has pushed nearly 10 million people to the brink of starvation, 2 million of whom are children with acute malnourishment. Further, 222 out of the 333 districts in the country are already one step away from famine [2,3]. Within two years of the declaration of the conflict, 50% of children under five years of age were stunted due to severe and sudden food insecurity [4]. By the end of 2017, health facility deaths and recorded injuries directly attributable to conflict–just the tip of the iceberg for these metrics–continued to mount [5].

News coverage of this devastation was largely ignored until Yemen was embroiled in the largest cholera outbreak in modern history. Major newspapers, (e.g., Washington Post, BBC, CNN) began reporting the outbreak at the end of August 2017, although suspected cases had already started to accelerate in April, 5 months earlier. The cumulative total from October 2016 to November 2019 reached over 2 million suspected cholera cases and 3,886 associated deaths, a case fatality rate of 0.17% [6]. Only beginning in May 2018, more than 18 months after the beginning of the outbreak, did the first cholera vaccine campaign start in Yemen. However, this devastation is not new. In 2016, the Global Burden of Disease Study (GBD) reported “conflict and terror” as the second cause of death and leading cause of premature death in Yemen [7].

The Yemeni crisis features a complex network of both internal and external forces, with multiple layers of conflict–with distinct ideological, geopolitical, sectarian, and separatist interests–occurring simultaneously [810]. The current Yemeni conflict became internationalized when Saudi Arabia and the Gulf states, with arms support from the United States and United Kingdom, began aiding the largely Sunni forces [11]. Concurrently, Iran has increasingly supported the Zaydi Houthi forces. Since 2015, Yemen has been subjected to nearly 20,000 air/drone strikes–an average of 4,000 per year. This bombardment has severely damaged the already fragile and dysfunctional health facilities and destroyed supply chains for food and medicine [12]. These impacts are further exacerbated by the ongoing blockade of foreign ports–particularly Sanaa–that have severely constrained food and aid imports into the country. Economically, Yemen–the poorest country in the Eastern Mediterranean World Health Organization (WHO) region–has largely collapsed. Foreign exchange reserves have been depleted and foreign remittances diminished [13]. The Government is now unable to pay for imports of food and other commodities and cannot meet public sector salaries.

Utilization of health care and preventive services such as immunisation or maternal services have declined, and child health indicators (e.g., on-schedule immunisation, anthropometric status, anaemia, diarrhoeal disease incidence) have worsened since 2016 [1416]. El Becheraroui et al., observed that some governorates with high levels of violence displayed worse health indicators [17]. Despite over five years of war, there have been few attempts to estimate excess mortality, and these rare efforts were made difficult by dysfunctional health information reporting or civil registration and vital statistics (CRVS) systems [18].

However, accurate mortality rates are central to inform policy and action priorities starting from, humanitarian response, credible advocacy, and short-term resource programming. It is equally important for social justice and reconciliation once peace is established. Further, estimations of human losses are crucial to legal prosecutions and reparation cases such as the DR Congo versus Uganda case in front of the International Court of Justice [19]. In this paper, we examine overall mortality in Yemen, exploring whether it has increased significantly in the period of the current conflict (2015–2019) compared to the immediate pre-conflict period. In the absence of credible vital statistics, we use Bayesian statistical methods to analyse small-scale surveys undertaken by humanitarian organisations. In addition, we examine the relationship between posterior crude mortality rates and conflict insecurity at governorate level using analysis of variance test to ascertain how mortality to ascertain how mortality at governorate level varies across the different insecurity level.

Materials and methods

Data sources

Collecting mortality data is a major challenge in conflict-affected countries. Death certification is rare. Vital events registration systems are one of the first victims of a failed state and death tolls remain obscure [20,21]. The current data published by the United Nations Statistics Division Demographic Statistics, shows that in 2007 just 12% of deaths had been recorded in Yemen’s death registry [21]. To circumvent the lack of official mortality data, we aggregated mortality statistics from 2,864 individual geographical clusters in 91 small scale mortality surveys collected by six organisations.

For this study, we utilized surveys from the Complex Emergency Database (CE-DAT), a repository of small-scale surveys undertaken by humanitarian agencies and the United Nations Office for Humanitarian Aid (UN-OCHA) [20]. The UN data include surveys undertaken by the World Food Programme (WFP), the Food and Agriculture Organisation of the United Nations (FAO), the Yemeni Ministry of Health (MoH), and the surveys done for the UN Emergency Food Security and Nutrition Assessment process (see S2 Table for characteristics of surveys included in the study). These surveys were chosen for analysis because they provide the most recent mortality data at the highest resolution. All surveys used a standard two-stage random cluster sampling method, used the Standardized Monitoring and Assessment of Relief and Transitions (SMART) methodology, and provided at least one estimate per governorate from 2012 to 2019 [22]. SMART surveys primarily collect information on nutrition and mortality (all cause and age-specific) indictors as well as information on vaccination coverage, food insecurity, and access to water and sanitation in a targeted population. It is important to note that more than half of the surveys used reported excluding areas due to inaccessibility or insecurity. For governorates without population values, we calculated denominators using population growth data from 2015 to 2019 and adjusted for displacement with data from UNICEF and the International Organization for Migration (IOM) (Table 1) [23].

Table 1. Summary characteristics of data sources for the period 2012–2019, Yemen.

Variable Source Indicator Description
Number of deaths CE-DAT & UNOCHA Mortality Total no. of deaths within the recall period of the survey. We used the number as reported in each survey or estimated based on mortality information presented in the reports.
Sample size CE-DAT & UNOCHA Mortality Mortality sample size used in calculating crude death rate. We used the number as reported or estimated based on available information in the report.
Recall period CE-DAT & UNOCHA Mortality Mortality recall period as used in the survey, in days or months.
Population estimate MoH, UNICEF, World Bank,
WorldPop & WorldOmeter
Population Governorate population from 2015–2019 projected based on 2012–2014 average pop. growth values in MoH and UNICEF reports. Country level population for 2015–2019 from World Bank and WorldOmeter. Population values were adjusted using IOM displacement data for each governorate.
Deaths from war violence ACLED &
Yemen Data project
Violence No. of deaths attributable to violent events related to conflict such as battles, explosions, remote violence, protests
Air/drone strike ACLED Violence No. of air/drone strikes reported by
ACLED

The earliest time point for which there were surveys which provided all the necessary data and used the SMART methodology was 2012. In total, we retained 91 surveys (28 from 2012–2014, and 63 from 2015–2019). The most common mortality information presented in the survey reports are for all-cause mortality are number of all-cause deaths, crude death rate (CDR), number of people included in sample, number of sampled households. Information on number of people that joined/left the household within the recall period is also provided in the report. See S2 Table for information on surveys. The Crude Death Rate is the number of people in a total population who died within a specified period of time. The unit of measure in SMART survey is deaths/10000/day. We extracted information on the number of deaths, crude death rate, mortality recall period and sample sizes from the surveys. In the absence of number of deaths, we approximated the estimate as follows: number of deaths = (CDR*recall period*sample sizes)/10 000. We combined the extracted data from the surveys to obtain our analysis dataset.

The selection process is described in Fig 1.

Fig 1. Survey selection flowchart, describing the survey selection process, inclusion/exclusion criteria, and number of surveys at each selection stage.

Fig 1

Mortality model

We used a standard approach to estimate excess mortality thus we established the national baseline crude death rate (BCDR) using surveys conducted in the three years preceding the 2015 crisis declaration, and then the posterior crude death rate (PCDR) from surveys conducted between 2015–2019. The difference is defined as the “total excess mortality.” The BCDR is the pre-conflict posterior mean estimates (μp, baseline value) and the conflict period PCDR (μc) estimates is the conflict period posterior mean estimate.

For the mortality estimate we extracted information on the number of all cause deaths, the recall period, and the sample size/targeted population. The outcome variable which is the number of all caused death within a recall period is a count variable and we assumed it follows a Poisson distribution. To estimate the pre-conflict and conflict period estimates we divided our dataset into two main periods: pre-conflict 2012–2014 and conflict period 2015–2019. We fitted a Bayesian Poisson-Gamma model, which allows us to capture the complex structure of the data by considering possible over-dispersion in the data [24]. We included person-days as an offset variable to account for difference in sample sizes and recall periods. Person-day calculation requires information on births and changes in household composition within a specified recall period of that survey (e.g., 3 or 12 months). However, since complete demographic profiles were not available for surveys, we approximated person-day values using the estimated population and mortality recall period [22].

To obtain the BCDR of the CDR (μp) and the PCDR of the CDR (μc), we used a hierarchical mixture of the Poisson-gamma model (Eq (1)) for modelling the crude number of deaths obtained in the surveys (i = 1,2,3 …, m), where m = 28 (number of surveys in pre-conflict period) or 63 (number of surveys in the crisis period). We modelled the crude number of deaths in each survey using a Poisson distribution with parameter λ:

nipois(λi)
λi=pti*θ (1)
θGamma(α,β)

where, ni is the number of observed deaths in survey i, pti is the person-days for survey i. The choice of priors for the pooled mean μ and the gamma parameter—β are a non-informative gamma prior of the gamma form (0 · 001, 0 · 001), where α is derived as the product of the pooled mean μ and β. We ran 100,000 iterations with a burn-in of 50,000 to sample from the distribution via the Markov Chain Monte Carlo simulation. We checked convergence and assessed stationarity using Geweke diagnostics [25].

We estimated total excess deaths (TED) for the whole country for the period 2015–2019 using the formula below:

TED={(μcμp)*(36510000)*n*median.adj.tot.pop}+tot.directdeaths (2)

μc = posterior mean CDR for conflict period /10000/day—(PCDR)

μp = posterior mean CDR for pre-conflict period /10000/day—(BCDR)

n = number of years (2015–2019)

median tot.pop = median of the adjusted total population

tot. direct.deaths = total direct ACLED deaths from 2015–2019

median tot.pop = median of the adjusted total population

tot. direct deaths = total direct ACLED deaths from 2015–2019

(μc)*(36510000)*n*median.adj.tot.pop is the observed number of deaths

(μp)*(36510000)*n*median.adj.tot.pop is the expected number of deaths

Total cumulative deaths = (μc)*(36510000)*n*median.adj.tot.pop+tot.directdeaths

For governorate-level estimates, we estimated the PCDR. For each governorate with a single reported CDR between 2015–2019, we used this as the reported PCDR. These were calculated using the formula below:

j=122{[(αcjμp)*(36510000)*(n*median.adj.popj)]+DDj} (3)
αcj{μcposteriorCDR(PCDR)atgovernoratelevelωcjreportedconflictperiodCDRwhenonlyonevalueisavailable

median.adj.popj = median population by governorate

DDj = direct violent deaths by governorate

The model building process is summarised in S1 Fig.

Insecurity classification index method

Since 2015, in addition to ground warfare with gunshots and explosives, Yemen absorbed a minimum of 18,481 air/drone strikes, although not all strikes were reported [12]. The most targeted governorates were Sa’dah (4,932), Sana’a (2,013), Taizz (1,978), Hajjah (1,945), and Al Hudaydah (1,755) (S1 Table).

Globally, human security indices are commonly generated by combining multi-dimensional indicators such as jailed populations, the number of homicides, ease of access to small arms, and political instability rankings [26,27]. In Yemen, such data are, in most part, missing. We therefore used publicly available data on violent deaths attributable to air/drone strikes and armed events (e.g., battles, explosions/remote violence, protests, and riots) to create a proxy index that broadly reflects the level of insecurity using the following formula:

SecurityScore=q=1n[epqr*FpqrEqr] (4)
InsecurityIndex=inf{xR:gF(SecurityScore)} (5)

The insecurity index is classified according to quantiles: 0.25 quantile as Insecure; 0.5 quantile as Serious; 0.75 quantile as Severe; and 1 quantile as Extreme. Where, epqr is the number of events q in governorate p for year r. Eqr is the sum total of events q in all governorates in year r, Fpqr is the total fatality from events q in governorate p for year r, and the Security Score is the sum of weighted fatalities in governorate p for year r, where n = 6 [28]. We matched the insecurity index obtained for each governorate for each year with the corresponding PCDR to obtain the analysis data set. To understand how the different levels of conflict insecurity in Yemen affect the overall mortality, we assessed associations between the PCDR in governorates and their insecurity index using a one-way ANOVA test. We used R Studio version 4.0.2 and packages R2jags version 0.6.1, stats, HD Intervals version 0.2.2 for our analyses. All p values were two-tailed with one degree of freedom and α = 0·05.

Results

The death rate in the conflict period (PCDR) was slightly higher than the baseline rates (BCDR) and had tighter confidence interval. The overall nation-wide excess death rate was 0.03/10,000 population. Often when baselines are not available in conflict settings, regional average mortality rates proposed by SPHERE Guidelines are used [29]. In this case, the 2011 SPHERE baseline was the average death rate in the North Africa and Middle East region i.e., 0.16—a rate that is relatively low as most of the countries are in middle or upper-middle income economic categories. In this study, we used the survey-based baseline (BCDR) as those that provided the best available estimates that reflected the specific realities of Yemen. The excess death rate–the difference between PCDR and BCDR–is presented below (Table 2).

Table 2. Excess death rate estimates using baselines and conflict period CE-DAT surveys, Yemen, 2015–2019.

Rate estimates (10000/day) [LCL, UCL] a
Total Crude Death Rate (2015–2019) 0.23 [0.19, 0.27]
Posterior Crude Death Rate (PCDR) 0.20 [0.17, 0.24]
Baseline Crude Death Rate (BCDR) 0.19 [0.17, 0.22]
Direct (Violent) Death rate 0.02b
Total Excess Death Rate (TED) 0.03 [0.00, 0.07]

a LCL: Lower credible level; UCL: Upper credible level.

b No confidence interval provided. Data source: www.acleddata.com.

Applying the conflict period rates (PCDR) to the Yemen population, we estimate 1,115,024 deaths would have occurred in the 5-year crisis period, whereas we would have expected 946,812 deaths had the estimated baseline rate (BCDR) prevailed—a 17.8% increase in deaths. Excess deaths attributable to direct and indirect causes linked to the crisis led to 168,212 more deaths, or an average of 92 excess deaths per day in the population. Of these, 67.2% were attributable to direct combat related violence and the remainder were attributable to indirect causes. At the governorate level, PCDR varied across the country ranging from 0.11 to 0.35 per 10,000 per day. The excess deaths for each governorate are calculated from their excess death rates based on their population. Hajjah, Ibb, Aden, Saada, and Al Jawf present the highest total excess deaths. Hadramaut and Al Maharah, both sparsely populated, had some of the lowest rates along with Al Hudaydah, Dhamar and Lahj (Fig 2).

Fig 2. Geographical distribution of total excess deaths based on excess death rates by governorate, Yemen, 2015–2019.

Fig 2

Source: Shape files extracted from Global Administrative Areas (2012). GADM database of Global Administrative Areas, version 2.0. [online] URL: www.gadm.org. Created using QGIS version 3.10.3.

The insecurity index was highest for the three governorates (Hajjah, Al Hudayda, Taizz) along the coastline (Fig 3) and those controlled by the Houthi faction. Sana’a was especially targeted, experiencing 4,932 attacks—about 1,000 attacks per year, on average. Sa’adah, Al Bayda, Aden and Al Dali were also exposed to high levels of violence and air strikes. All governorates in the mainland experienced air/drone strikes (S1 Table).

Fig 3. Geographic distribution of insecurity index levels, Yemen, 2015–2019.

Fig 3

We found no evidence for differences in death rates between governorates that were extremely insecure compared to those with lower levels of insecurity (Fig 4).

Fig 4. Posterior crude death rate by governorate and insecurity level, Yemen, 2015–2019.

Fig 4

Discussion

Since the beginning of the civil war in 2015, humanitarian organizations and the press have reported high death tolls in Yemen [3033] but reported qualitatively as “thousands” or “tens of thousands” of deaths. Undoubtedly many have died, but little statistical evidence has been presented to support increased death rates, reflecting the challenges the country faces in mortality surveillance [33].

When calculating a credible excess mortality estimate, the choice of baseline is an important challenge. For example, two well-known studies from Iraq used different baselines, leading to almost 100,000 deaths (5.5/1,000) in one and 405,000 (2.9/1,000 person-years) in the other [34,35]. A similar situation emerged from using different baselines when estimating mortality in the Second Congolese War (1998–2004) [36]. Excess mortality in Darfur was calculated based on World Bank reports (0.3/10,000/day), producing widely differing results from estimates by Reeves [29,3740]. We chose to construct a baseline from locally implemented mortality surveys from the pre-crises period, which provides a timely and more precise representation of mortality in Yemen.

Our results suggest that death tolls since 2015 are greater than would be expected, based on the estimated pre-war value. However, the conflict period death rate was not strikingly higher than the levels experienced by the country in the years preceding the current crisis. Prior to the beginning of the 2015 conflict, the Yemeni health system had already started a downward slide where health system broke down progressively and health status deteriorated unlike more concentrated violence and massacre witnessed in DRC [4143].

Second, a large share of excess deaths was attributable to armed violence, as recorded in ACLED and the YDP–another noticeable departure from scenarios seen in other civil conflicts where indirect deaths were by far the largest proportion of deaths [4446]. A possible explanation is the protracted nature of the conflict in Yemen. Our data and analysis seem to portray a conflict where indirect excess mortality is persistently higher at constant levels, relative to regional averages. Therefore, a sudden spike in violence by the use of different weaponry, mostly air bombardments, produces a larger contribution of direct violent deaths total excess mortality.

Third, our index of human insecurity was not correlated with the estimated conflict period deaths, which were similar in all governorates regardless of their level of insecurity. The mere threat of air strikes and violence may have been enough to halt essential health care and other critical life-sustaining activities across the country, not just in governorates specifically targeted with intense air strikes and fighting.

We found the total number of deaths that occurred in Yemen in the five years of crisis was 17.8% higher than expected–nearly 170,000 additional deaths, or about 34,000 per year of conflict on average. Other conflicts, such as in Iraq, Darfur, Syria, and the Democratic Republic of Congo have reported higher conflict-related deaths [34,36,37,47]. Despite appeals from the humanitarian community, no intervention was mounted, and overseas aid remained low (Fig 5). As early as 2004, the census reported a crude death rate of 7.5/1,000 population, substantially higher than the UN regional average of 5.3/ 1,000 population [48]. A decade later, data from the Demographic and Health Survey (DHS) reported child mortality of 53/1,000 live births, nearly twice that of the regional average [49,50]. During this period, the population received little to no support from governmental or external actors. This lack of support persisted until 2015, when increasing militarisation garnered more international attention and surged international humanitarian aid to about four times of what it was in 2014 [13]. As widespread and intense fighting and air strikes continued in the country in parallel to huge increases in humanitarian funding, practical assistance to populations was unevenly distributed as insecurity reduced the reach of aid organisations [51].

Fig 5. Humanitarian aid assistance to Yemen 2012–2019.

Fig 5

Data source: United Nations Office for the Coordination of Humanitarian Aid (UN-OCHA) [52].

Arguably, the level of excess mortality we find in our study could reflect the longstanding deterioration of health situation and non-existence of functional CRVS and health surveillance systems. Hence, when the conflict was declared in 2015, the mortality rate in the year preceding the crisis was not much different from those observed moving forward. Another explanation could also be attributable to limited access of insecure areas, which may have biased the survey results towards a better picture than in reality. While we included all violent deaths by governorate, these metrics may not be reflective of the true count. Such data from conflict countries face a universal bias as regions of high insecurity are often inaccessible to humanitarian actors and surveyors, including for DHS and other UN surveys [53]. More than 50% of the surveys used in this study specifically reported excluding areas due to inaccessibility or insecurity.

Human insecurity in mainland governorates did not correlate positively with higher death rates, despite higher numbers of air strikes and armed attacks in some governorates. Armed violence has severe implications on direct mortality and pervasively disrupts civilian lives. Even when there are no direct hits, both multi-target (e.g., bombs, grenades, shells) and single-target (e.g., targeted killings, snipers) violence profoundly disrupt access to food, markets, healthcare, and other critical commodities by seeding fear of movements. Insecurity has become deeply embedded into the realities of daily life for Yemenis.

In most conflicts, the greatest share of deaths is attributable to indirect causes such as health service breakdowns and food shortages. Direct causes do not usually contribute substantially to overall death rates [4446]. However, there are isolated occurrences where direct causes do constitute the majority of deaths, as seen in South Sudan from 2013–2018 [54]. In our study, Yemen is another rare example where almost two-thirds of excess deaths were the result of violent causes with the remaining third of deaths due to indirect causes. Almost all governorates experienced sustained air strikes, with some receiving well over a thousand during the conflict (S1 Table). Four sparsely populated governorates, including the Socotra Archipelago, have not endured commensurate levels of air raids [55]. The appreciable increase in humanitarian aid to Yemen following the formal, international recognition of the humanitarian crisis, in conjunction with the already high crude baseline death rates, may explain the observed reduction in indirect deaths.

There are a number of limitations and constraints to consider for this study. We selected a time period for analysis based on available data and the formal recognition of the conflict in Yemen. However, there were appreciable levels of conflict throughout the country prior to the 2015 start date selected for the study. By analysing the post conflict period in the aggregate, we may have missed changes in mortality experience as the intensity of the conflict has changed over time. Both of these decisions are important to consider as alternative explanations for the attenuated differences observed in this study for pre- and conflict crude death rates.

Additionally, across many conflict affected countries, sample units from insecure areas are underrepresented or excluded because of accessibility concern for the safety of personnel [56]. Predictably, this is reflected in surveys undertaken in Yemen, with more than 50% of surveys noting excluding areas due to insecurity or inaccessibility. This lack of access to zones with high violence may bias mortality rates in our, and most other, conflict-event surveys. Further, we acknowledge that the number of surveys from the pre-conflict period limits the robustness of our baseline calculations. Poor data is not unique to Yemen but is rather a persistent problem in conflict-affected countries such as Somalia, Afghanistan, amongst others [57].

Characterising these limitations proves to be both informative to the reality on the ground and provide direction for future work. Rather than discounting information collected under difficult circumstances, these data issues underscore two urgent challenges. First, we need to develop innovative methodologies to collect data in high insecurity conditions, such as using remote sensing techniques. Besson et al (2020) provides a good example of how this technique can be used to calculate excess mortality in Yemen [58]. Second, innovative approaches that build on existing structures should be explored. One such option would be to re-purpose traditional surveillance into sentinel systems in order to bridge the existing gap in data from high insecurity areas. While our study results admittedly cannot be considered definitive because of limited data on which we based our calculation, we are confident that our findings are sufficiently indicative of the reality on the ground.

In summary, massive humanitarian aid to Yemen may have plausibly blunted the humanitarian health crisis in the civil population. The barrage of air strikes and continued ground violence, on the other hand, arguably had the opposite effect on violent causes of death. While the Biden administration pledged to halt US offensive military support by limiting the US’s role in supplying weapons to Saudi Arabia and other Gulf States, these promises have not come to fruition. Given the complex history of the conflict and the positions of participating factions, the underlying issues of the conflict are not likely to be resolved soon. Further, there is great potential for increased financial support for conducting air raids over Yemen as the Global North becomes more reliant on oil exports from the Gulf States to compensate for sanctions against the Putin regime following the Russian invasion of Ukraine. As the puppet mastery of geopolitics continues to dictate morbidity and mortality patterns of Yemeni civilians, we must redouble efforts to understand the human health impacts of this sustained crisis. National health and mortality surveys to better understand the full consequences of the conflict on the Yemeni population are needed urgently if and when access to vulnerable populations improves.

Supporting information

S1 Fig. Step-by-step explanation of the calculation of excess deaths in Yemen, 2015–2019.

(PDF)

S1 Table. Distribution of air raids/drone attacks associated direct deaths, and PCDR by governorate, Yemen, January 2015 –December 2019.

The map of controlled area has been sourced from European Council on Foreign Relations website and has been adapted to include number of air raid/drone strikes. It should be considered indicative only and the page can be accessed by the link below: https://ecfr.eu/publication/talking_to_the_houthis_how_europeans_can_promote_peace_in_yemen/.

(PDF)

S2 Table. Survey characteristics, Yemen, 2015–2019.

Characteristics of 91 small-scale mortality surveys in Yemen, 2012–2019. All surveys were reviewed for mortality estimates. This information and more resources can be accessed at: https://www.humanitarianresponse.info/en/operations/yemen/nutrition.

(PDF)

S3 Table. Association between security level and PCDR, Yemen, 2015–2019.

One-way ANOVA test to describe the association between four security levels and PCDR as calculated from 91 small-scale cluster surveys. Security levels were determined by generating security scores and insecurity indices. The insecurity indices were then classified into quantiles for analysis.

(PDF)

S1 Data. Survey data, Yemen, 2015–2019.

(XLSX)

Acknowledgments

We would like to thank our Yemeni colleagues from universities in Yemen who have provided invaluable information and advice on interpretation. The circumstances at this time make it difficult for their names to appear in this paper, but their contribution remains key.

The authors would also like to thank Alexandria Williams for her excellent technical editing and Valentin Wathelet for assistance with the extraction of surveys from the CEDAT Repository.

Data Availability

CE-DAT data is available from the Centre for Research on the Epidemiology of Disasters (CRED) upon reasonable request. Armed Conflict Location and Event Data Project (ACLED) data is available for download at https://acleddata.com/data-export-tool/. A datafile is provided with the supplementary materials.

Funding Statement

The authors received no specific funding for this work.

References

PLOS Glob Public Health. doi: 10.1371/journal.pgph.0000581.r001

Decision Letter 0

Amrish Yashwant Baidjoe

21 Mar 2022

PGPH-D-21-00542

Civil war and death in Yemen: Analysis of SMART survey data, 2012 – 2019

PLOS Global Public Health

Dear Dr. Scales,

Thank you for submitting your manuscript to PLOS Global Public Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Global Public Health’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

Dear authors,

Humble apologies for the late feedback from us, it was complex to find reviewers on the stats/analyses part and I have been in/out emergencie response myself, thanks for your amazing patience and once again apologies for the incredible delay. Please see the comments from the reviewers attached, we hope you can address them. I will make sure we will move forward fast after you have addressed them.

Once again thanks for your submission and good luck with the revisions the manuscript.

Best wishes,

Amrish

==============================

Please submit your revised manuscript by May 05 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at globalpubhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pgph/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Amrish Yashwant Baidjoe, PhD.

Academic Editor

PLOS Global Public Health

Journal Requirements:

1. Please update your Competing Interests statement. If you have no competing interests to declare, please state: “The authors have declared that no competing interests exist.”

2. Please ensure that you refer to Figure 2 in your text as, if accepted, production will need this reference to link the reader to the figure.

3. Please provide us with a direct link to the base layer of the map used in Figure 4, Figure 5, S1 Figure, and ensure this location is also included in the figure legend. 

Please note that, because all PLOS articles are published under a CC BY license (creativecommons.org/licenses/by/4.0/), we cannot publish proprietary maps such as Google Maps, Mapquest or other copyrighted maps. If your map was obtained from a copyrighted source please amend the figure so that the base map used is from an openly available source.

Please note that only the following CC BY licences are compatible with PLOS licence: CC BY 4.0, CC BY 2.0  and CC BY 3.0, meanwhile such licences as CC BY-ND 3.0 and others are not compatible due to additional restrictions. If you are unsure whether you can use a map or not, please do reach out and we will be able to help you. 

The following websites are good examples of where you can source open access or public domain maps:

* U.S. Geological Survey (USGS) - All maps are in the public domain. (http://www.usgs.gov)

* PlaniGlobe - All maps are published under a Creative Commons license so please cite “PlaniGlobe, http://www.planiglobe.com, CC BY 2.0” in the image credit after the caption. (http://www.planiglobe.com/?lang=enl)

* Natural Earth - All maps are public domain. (http://www.naturalearthdata.com/about/terms-of-use/)

Additional Editor Comments (if provided):

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does this manuscript meet PLOS Global Public Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I don't know

Reviewer #2: I don't know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Global Public Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for the opportunity to review this manuscript, which addresses an important set of questions relating to the impact of conflict on mortality rates in Yemen. This is an under-researched topic, and original health research on Yemen is in any case rare, so the paper is welcome. The results presented are important and the finding regarding the proportionate share of direct and indirect deaths, in particular, is counterintuitive. The caution shown by the authors in interpreting these results in the discussion – particularly by highlighting long running population vulnerabilities in Yemen that long pre-dated the conflict – is to be commended.

I provide some general comments here, and then more detailed comments by section further down.

General comments:

1. I would recommend a statistical review for aspects of the methodology in this paper – I am not qualified to comment on the appropriateness or construction of the Poisson-gamma model used to generate the main results.

2. Of the large team that contributed to this work, only one appears to be Yemeni and none are currently based in country (if the affiliation list is complete). Given that PLOS Global Public Health has set as its mission an effort to address entrenched global health inequalities, and to give voice to those often excluded, this imbalance in contributorship to the paper is somewhat disappointing and something to be addressed for future studies.

3. An important issue in the construction of this analysis is the use of 2015 (the year in which the conflict was internationalised) as a cut-off point to distinguish BCDR from PCDR (as also indicated by table S1). The authors acknowledge this briefly in the discussion in line 373ff. While there was certainly a step-change in the intensity of conflict in that year resulting from international intervention, fighting had been ongoing internally since at least September 2014 (the point at which the Houthis entered Sanaa) and in some localised areas (especially in the North) intermittently but with some intensity to a point well before the beginning of the study time series in 2012. This may contribute to an overestimation of effects especially for governorates such as Hajjah and Al Jawf in the North where direct deaths in the pre-2015 period may have been significant, assuming that the BCDR does not account for violence-related mortality during the 2012-14 period. It may also help explain why the difference in pre-post CDRs is not that great. Do the authors have the data available from the earlier period to comment on this? What effect would incorporation of these numbers have on the TED estimate, in their view?

4. Relatedly, treating the 2015-2019 period as a single block for PCDR calculation may mask large variations in conflict intensity over time. For example, ACLED data show large spikes in reported deaths in 2015 for civilians but markedly lower rates after this point, although this is admittedly not the case for combatants (https://acleddata.com/2019/06/18/yemen-snapshots-2015-2019/). The authors may wish to consider this as a possible explanation for the small different in pre-post CDRs observed in their study, in the discussion.

5. The authors rightly point out the surprisingly high overall contribution of direct mortality to the mortality rate. However, similar results have I think been documented elsewhere (albeit for more focused time periods) and some studies suggest CDRs as high as 1 per 10,000 person-days or more (e.g. https://www.lshtm.ac.uk/south-sudan-full-report). Are the authors able to draw any conclusions based on their data and reading of the wider literature as to how conflict intensity in Yemen compares with other settings?

Specific comments:

6. Line 50-51: please provide the CIs around the BCDR and PCDR estimates here.

7. Line 55: please spell out what PCDR is (you give this in the main text, but the abstract is the first time this abbreviation is seen by the reader).

8. In some areas the phrasing is informal e.g. line 78 - “knee-deep in the largest cholera outbreak…” and could be amended without compromising the central messages that the scale and scope of conflict impact in Yemen has few contemporary precedents.

9. Line 88-99: this section reflects a general tendency to frame the conflict in Yemen as a proxy conflict between two distinct sides, identified in sectarian terms and by relationship to specific external actors. In fact the conflict in Yemen has for some years been a multi-dimensional civil war, primarily driven by internal dynamics. Fighting between groups nominally opposed to the Houthis has at times been just as intense as between the Houthis and others. There is also an important secessionist dimension to the conflict in the South. International alliances for parties in the conflict have shown considerable fluidity over time. There are a number of sources to consider citing here from close observers of Yemen, including work by Bernard Haykel, Helen Lackner and Peter Salisbury.

10. Results – line 240ff: the authors have provided brief details of included surveys in table S2 but it would be helpful to have a clearer view of the content of these. Can the authors comment on the quality of included surveys? In addition, it would be helpful to have an indication of what the reported deaths rates in these individual surveys actually were over time, to (i) build a sense of the spread of the data (including outliers) and (ii) help address point 4 above.

Reviewer #2: Please see comments in the attached file.

This manuscript could be tighter, and it needs another copy edit (which now I'm seeing PLOS won't provide, unfortunately).

I did not review the statistical calculations, outside my area of expertise.

The data really should be accessible to the reader, but were not in a supplemental file as far as I could tell.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Sharif Ismail

Reviewer #2: Yes: Amy Hagopian

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLOS Glob Public Health. doi: 10.1371/journal.pgph.0000581.r003

Decision Letter 1

Amrish Yashwant Baidjoe, Julia Robinson

7 Jun 2022

Civil war and death in Yemen: Analysis of SMART survey and ACLED data, 2012 – 2019

Civil war and death in Yemen

PGPH-D-21-00542R1

Dear Ms. Scales,

We are pleased to inform you that your manuscript 'Civil war and death in Yemen: Analysis of SMART survey and ACLED data, 2012 – 2019

Civil war and death in Yemen' has been provisionally accepted for publication in PLOS Global Public Health.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they'll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact globalpubhealth@plos.org.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Global Public Health.

Best regards,

Amrish Yashwant Baidjoe, PhD.

Academic Editor

PLOS Global Public Health

***********************************************************

Dear authors,

Thanks for addressing all comments so dilegently. I am looking forward seeing this manuscript in the the public.

Best wishes,

Amrish

Reviewer Comments (if any, and for reference):

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Step-by-step explanation of the calculation of excess deaths in Yemen, 2015–2019.

    (PDF)

    S1 Table. Distribution of air raids/drone attacks associated direct deaths, and PCDR by governorate, Yemen, January 2015 –December 2019.

    The map of controlled area has been sourced from European Council on Foreign Relations website and has been adapted to include number of air raid/drone strikes. It should be considered indicative only and the page can be accessed by the link below: https://ecfr.eu/publication/talking_to_the_houthis_how_europeans_can_promote_peace_in_yemen/.

    (PDF)

    S2 Table. Survey characteristics, Yemen, 2015–2019.

    Characteristics of 91 small-scale mortality surveys in Yemen, 2012–2019. All surveys were reviewed for mortality estimates. This information and more resources can be accessed at: https://www.humanitarianresponse.info/en/operations/yemen/nutrition.

    (PDF)

    S3 Table. Association between security level and PCDR, Yemen, 2015–2019.

    One-way ANOVA test to describe the association between four security levels and PCDR as calculated from 91 small-scale cluster surveys. Security levels were determined by generating security scores and insecurity indices. The insecurity indices were then classified into quantiles for analysis.

    (PDF)

    S1 Data. Survey data, Yemen, 2015–2019.

    (XLSX)

    Attachment

    Submitted filename: Reviewer and journal comments.docx

    Data Availability Statement

    CE-DAT data is available from the Centre for Research on the Epidemiology of Disasters (CRED) upon reasonable request. Armed Conflict Location and Event Data Project (ACLED) data is available for download at https://acleddata.com/data-export-tool/. A datafile is provided with the supplementary materials.


    Articles from PLOS Global Public Health are provided here courtesy of PLOS

    RESOURCES