Abstract
Introduction
Despite global progress on many measures of child health, rates of neonatal mortality remain high in the developing world. Evidence suggests that substantial improvements can be achieved with simple, low-cost interventions within family and community settings, particularly those designed to change knowledge and behaviour at the community level. Using social network analysis to identify structurally influential community members and then targeting them for intervention shows promise for the implementation of sustainable community-wide behaviour change.
Methods and analysis
We will use a detailed understanding of social network structure and function to identify novel ways of targeting influential individuals to foster cascades of behavioural change at a population level. Our work will involve experimental and observational analyses. We will map face-to-face social networks of 30 000 people in 176 villages in Western Honduras, and then conduct a randomised controlled trial of a friendship-based network-targeting algorithm with a set of well-established care interventions. We will also test whether the proportion of the population targeted affects the degree to which the intervention spreads throughout the network. We will test scalable methods of network targeting that would not, in the future, require the actual mapping of social networks but would still offer the prospect of rapidly identifying influential targets for public health interventions.
Ethics and dissemination
The Yale IRB and the Honduran Ministry of Health approved all data collection procedures (Protocol number 1506016012) and all participants will provide informed consent before enrolment. We will publish our findings in peer-reviewed journals as well as engage non-governmental organisations and other actors through venues for exchanging practical methods for behavioural health interventions, such as global health conferences. We will also develop a ‘toolkit’ for practitioners to use in network-based intervention efforts, including public release of our network mapping software.
Trial registration number
NCT02694679; Pre-results.
Keywords: SOCIAL MEDICINE
Strengths and limitations of this study.
The sample includes a full population of individuals in 176 villages, 30,000 people.
Measures capture comprehensive network data inclusive of a wide range of relationships.
Intervention assesses the impact of network targeting on a variety of important reproductive, maternal, neonatal and child health health outcomes.
A primary study outcome is a tool to allow interventionists to do network targeting with fewer resources.
Limitations are that study results may depend on the geographical or public health setting.
Background
Neonatal mortality in Honduras
Despite global progress on many measures of child health, rates of neonatal mortality remain high in the developing world. Neonatal mortality now accounts for about 40–50% of under -5-years child deaths.1 2 Intrapartum complications, prematurity and infections—including sepsis, pneumonia and meningitis—account for the majority of these deaths.1 3 About 75% of neonatal deaths occur in the first week of life.4
Honduras has made considerable progress in its efforts to improve the health of it population5 but it still lags behind much of Mesoamerica. In Honduras in 2008, neonatal deaths accounted for 51% of all deaths of children under 5 years of age; 40% of these deaths were attributable to premature labour6 and another 40% were attributable to asphyxia and infection. Furthermore, 57% of all births occur in rural areas where perinatal care may be insufficient or unsafe.7 Although 79% of neonates start breast feeding within an hour of birth, only 30% are exclusively breast fed for the first 6 months of life.5
Although many deaths can be prevented through provision of clinical care services, emerging evidence suggests that a substantial reduction in poor reproductive, maternal, neonatal and child health (RMNCH) outcomes can also be achieved with simple, low-cost interventions within family and community settings.8–10 The challenge is how to implement interventions in low-resource environments where health systems are often weak, and where intervention delivery is often dependent on short-term funding cycles.11 Another equally fundamental question is how these interventions might be delivered so that communities actually adopt the behaviours being promoted, and how to ensure that those behaviour changes are sustained. To promote improvements in key RMNCH behaviours, change is needed in the provision of service and also in community-level demand for service and practices.
Behaviours related to RMNCH care are often socially reinforced, and can therefore be difficult to change, particularly in traditional cultural settings.8 In these contexts, the study of norms, influence and social position are important to understand the functioning of interventions attempting to improve RMNCH outcomes. Social network analysis can be used to understand these dynamics. In particular, two distinct but interacting social network mechanisms can affect health decisions: contagion and connection.12 Contagion refers to the spread of a behaviour from individual to individual. Connection refers to the standing of the individual within the wider social structure (see figure 1). While exposure to a new idea or behaviour through social contacts can influence an individual to change one's behaviour,13 an individual's overall position within the larger network can also impact the possibility of behaviour change.14 For example, people who are on the periphery of a network may have less access to important resources, simply by virtue of where they are positioned within the network, while people at the centre of the network may be less willing to change behaviour because their actions are under greater scrutiny.15 16 In other words, social position can often promote or hinder exposure to new ideas, while the social cost inherent in adopting a new behaviour can also differ according to one's position in the network. Those most socially central, for example, may be those who are expected to uphold strongly established norms.12
Social networks are therefore a highly relevant substrate for the impact of social norms.12 17 18 A social-norms perspective on behaviour change considers the choices of individuals to be significantly affected by the behaviours and/or opinions of those in their salient reference groups, or those to whom an individual turns for expectations regarding behaviour.19 20 If social norms are the driving force behind behavioural decisions, looking at the structure of a community's social networks might help us to better understand why individually focused behavioural interventions may be ineffective. Since the transmission of norm-changing behaviour (such as those promoted by many community interventions) often requires multiple reinforced exposures, it can be initially inhibited by highly connected networks and yet also ultimately requires the reinforcement of such networks to successfully occur.21 22 The effect of injunctive norms, or what people believe is approved of within their reference group,23 may be more powerful in highly interconnected communities. The promotion of ‘acceptable’ behaviours and sanctioning of ‘unacceptable’ behaviours may be stronger.18 24–26 Yet, this dynamic also works inversely, such that when a critical mass of a highly interconnected group has adopted a behaviour, the probability that any individual in that group will adopt also increases.21 27–29
Owing to the powerful impact of social networks on human behaviour, social network targeting (where structurally influential individuals are selected for the receipt of interventions) shows great promise in the implementation of sustainable community behavioural change. Recent work by our group in a different part of Honduras has demonstrated that interventions targeting friends of randomly selected individuals might be more effective than interventions targeting those individuals themselves.30 A school-level intervention on bullying achieved the greatest reduction in student conflicts through the targeting of ‘social referents’, or those within the top 10% of individuals according to how many friendship nominations they received.31 Smoking and alcohol cessation programmes that exploit peer influences that modify the social network of the target have been shown to be more successful than those that do not.32–38
In sum, social network targeting represents a paradigm shift in how we currently implement interventions in global health settings. Many behaviour-change interventions currently seek to target all members of a population; however, face-to-face counselling for behaviour change takes time and resources. Ideally, successful social network interventions methodologies could mean that intervening in smaller segments of the populations will have the same effect as targeting 100% of the community, saving considerable time and money.
This study
Our objective is to conduct a randomised, controlled trial (RCT) of novel social network targeting techniques in order to explore how social network dynamics affect the uptake, diffusion, and group-level normative reinforcement of key RMNCH behaviours and attitudes in rural Honduras. Health behaviours will be promoted through a community-level household-based intervention that will be implemented by the Inter-American Development Bank (IDB) through the Salud Mesoamerica Initiative (SMI), with whom we are partnered for this project. We will use theoretically derived algorithms to choose a subset of structurally influential individuals from within the population to receive an intervention. Throughout this protocol the term ‘treatment’ refers only to the algorithms used to choose individuals, while the term ‘intervention’ refers only to the programme designed to promote positive RMNCH behaviours and attitudes. Our ‘treatment’ here is not the intervention we are using, but rather the algorithms used to choose a subset of structurally influential individuals from within the population receiving the intervention. We will assess whether differential network targeting results in differential uptake (ie, differential practice) of the RMNCH behaviours and attitudes promoted in the intervention.
We will randomise 176 villages using an 8×2 factorial design in which we will (1) vary the proportion of people targeted per village in 8 distinct groups and (2) compare random targeting to targeting friends of randomly selected people (see figure 2). Since we are intervening at the household level, our random targeting versus friend targeting randomisation will also be carried out at the household level. (Details regarding our randomisation strategies are outlined in Analytic Aim 2 and 3 and in online supplementary appendix 1). We will then measure changes in behavioural and attitudinal outcomes for individuals and communities including both those who got the intervention and those who did not. Our results will allow us to assess how the difference in adoption of interventions, at both the individual and community levels, varies across the various arms of the trial.
bmjopen-2016-012996supp_appendix1.pdf (651.2KB, pdf)
Specifically, we will address:
Can the structure of social networks provide clues regarding subpopulations at higher risk of experiencing RMNCH morbidity and mortality or at higher risk of being unresponsive to behaviour-change interventions?
Based on network parameters, can we exploit mathematical algorithms to identify a well-positioned set of people who exert the maximum influence on adoption of improved RMNCH care practices in the larger population, and thus have a multiplicative effect on coverage?
Can we, in parallel, identify sets of people who are responsive to such influence (ie, influenceable and not just influential, people)?
Is there a threshold effect such that when a certain proportion of the population has changed their norms around key behaviours, the rest of the population is likely to follow?
A key feature of this research is that the network data collection we are proposing is sociocentric rather than egocentric. As illustrated in figure 3, egocentric data, while it involves social network information, is collected from a sample of individuals within a given population.39 40 In contrast, sociocentric network data creates an image of a collective whole, with comprehensive data gathered on ties between all of the people within a specified population.39 40 Whereas egocentric data may help to improve the representativeness of a sample for a large population, sociocentric data allows measurement of larger network structures (like network communities) and individual-level network measures based on them.
Methods/study design
Preliminary work
As preparation for this project, we completed geographical mapping of over 200 villages in the study region, allowing us to gain a more precise understanding of the study population and field conditions, including terrain, rainfall and distances to health facilities, to inform planning and implementation. We developed an extensive survey instrument to capture the various outcomes that will be addressed through the household-level interventions that will be implemented by IDB/SMI, including use of folic acid, prenatal care utilisation, birth plan preparation, immediate breast feeding after birth, exclusive breast feeding for infants up to 6 months old, proper thermal and cord care for newborns, proper treatment of diarrhoea in children and paternal involvement in childcare. Our survey instrumentation is primarily composed of validated scales used widely to measure items related to RMNCH outcomes. We conducted an extensive review of the RMNCH literature and consulted global RMNCH experts for their advice on the inclusion of appropriate items in the survey. We also did extensive formative research, including detailed qualitative individual interviews and focus groups, and cognitive interviewing to assess our survey's cultural relevance and consider regional language variations specific to the study area. In addition, we conducted three rounds of pilot data collection involving network mapping and sociobehavioural interviews to test the network questions: our newly designed social networks data collection software, (named ‘Trellis’; see online supplementary appendix 2): and the behavioural health outcomes instrumentation (for more details on our pilot work and field operations please see online supplementary appendix 1).
bmjopen-2016-012996supp_appendix2.pdf (645KB, pdf)
Study population
Our study is being conducted in the department of Copan, Honduras, in an area of over 200 square miles of rugged mountainous terrain with an estimated total population of 92 000 people. In order to power the 8×2 design (for details please see Aim 2), we have selected 176 villages from the 238 small towns and villages located in this area. Factors like population size, accessibility and safety were considered when selecting the final list of villages. Owing to high adolescent birth rates in this population, all individuals over the age of 12 who live or work in the study villages are eligible to enrol (see online supplementary appendix 1 for more detailed information). Individuals who are cognitively impaired and unable to provide consent are excluded. We have already conducted a photographic census in the 176 study villages. Recruitment rates are high: census data show ∼32 500 eligible individuals in these villages, of whom at least 93% (N=30 460) have agreed to enrol in our study. Using the Trellis software (please see online supplementary appendix 2), we obtained demographic data, photographs and Global Positioning System coordinates of all participants who enrolled. The average age for participants is 33, and most are married or in a civil union (59%), and slightly over half (54%) are women. The total number of respondents surveyed per village range between 55 and 620 individuals and the average household size is 2.8. We have not yet begun the intervention.
Network data collection
As the photographic census is complete, we will next use bespoke software we have prepared and made publicly available (http://humannaturelab.net/resources/software/trellis/), named Trellis (see online supplementary appendix 2), to undertake the main survey, which includes a battery of ‘name generator’ questions to capture social relationships. The name generators will focus on several different types of affiliations including friendship, professional contacts, kinship, and contacts relevant to health behaviour. In this study, the boundaries of each network will be the village, so that individuals may nominate any individual from within their own village as a social contact. The photographs taken in the preliminary census will be used to validate the social contacts named by the respondents. Online supplementary appendix 1 provides additional technical details about social network measurement.
Measurements
Baseline social networks: The name generator questions to collect sociocentric data will be included in the baseline survey. From these measures, we will calculate community-level and individual-level measures of network connectivity including various measures of centrality (please see online supplementary appendix for more details). (Wave 1 2016)
Baseline RMNCH care behaviour and norms for all individuals in the villages. Specific maternal, neonatal and child health behaviour questions will be asked only of individuals who have already had a child. Norms and attitudes questions will be asked of everyone and will include attitudes towards RMNCH behaviours as well as the role of fathers in prenatal and neonatal health. (Wave 1 2016)
Concurrent norms and behaviour surveys: 1 year into the intervention, we will administer surveys to track changes in norms and behaviours as well as possible sources of intervention spread. For this survey, we will also monitor the implementation of the intervention by asking questions specific to receiving intervention activities. (Wave 2 2017)
Final outcome survey: a second round of social networks data collection, RMNCH care behaviour and norms questions for all individuals in the villages. Using this second round of social network data, we will recalculate network connectivity at the individual and community levels. (Wave 3 2018)
Contextual surveys: We will gather data on contextual factors within each village, such as the size, distance and characteristics of the nearest clinic, other intervention activities that may be taking place through local organisations or non-governmental organisations (NGOs), important geographical features, facilities and infrastructure available to residents, etc.
Health outcomes: For a subset of families, our surveyors will specifically measure and record temperature and respiratory rates for children under 5 years.
Clinic records: We will collect clinical data from birth records from the regional maternity clinic for women who give birth at this facility. We will also collect postpartum health data from the local health centres. Postpartum data is recorded by family health teams conducting home visits with postpartum women in the villages within 7 days of delivery, regardless of birth location. Postpartum health records contain information on newborn weight, respiratory rate, temperature, head circumference and signs of redness, pus or swelling in the umbilical cord,41 as well as body temperature, blood pressure readings and presence of danger signs for the mothers.
Behavioural health intervention
The implementing partner in this project, IDB through SMI, is responsible for designing and implementing an integral intervention to promote RMNCH behaviour change in Honduras. To work within the constraints of this study, the intervention had to meet specific requirements including: (1) alignment with priorities of the Ministry of Health (MOH) of Honduras, the Bill and Melinda Gates Foundation, and the needs of the population; (2) contain new messages for the targeted population to allow for detection of changes in knowledge, attitudes and practices; (3) include tracers or identifiers which could be detected during follow-up surveys; (4) not use mass-media communication techniques, including radio spots, flyers, posters, etc, as these would contaminate the network effects of the study; (5) have a strong monitoring component; and (6) have a demonstrated effectiveness in similar settings in order to test the spread of behavior from person to person. The intervention would also have to adopt the targeting strategy, focusing on network position, as opposed to targeting households with primary audiences for the behaviour change of interest. For example, the targeting algorithm could hypothetically identify a household with two grandfathers and therefore select it to receive the intervention. This household would usually not be selected for an intervention on prenatal care or neonatal practices, given that there are no pregnant women living there but we would include it.
Given these requirements, an educational package, using the Timed and Targeted Counselling (ttC) methodology42 complemented with alternative methods of face-to-face communication including songs, rhymes and riddles, was designed with World Vision and Child Fund Honduras. The social and behaviour change communication strategy for the intervention was designed using the ‘P-Process’, a tool developed by Johns Hopkins Center for Communication Programmes and used for more than 30 years for planning strategic, evidence-based health-communication programmes.43 This intervention will be delivered by trained community health workers for 24 months on a monthly basis to the households selected for the study. Timed and Targeted Counselling (ttC), has been implemented in 20 countries worldwide by World Vision.42 It is targeted in time (when it is needed), in space (by visiting in the home), and in individualised approaches (messages and strategies to remove barriers depending on the circumstances of a specific family). This methodology uses narrative and negotiation in a 1–2 hour visit with families to discuss positive and negative scenarios and create a list of agreements with families to try out new practices. It should be noted that ttC is normally implemented in households with pregnant women and/or children under 2 years, and counselling is provided to all family members based on stage of the pregnancy or age of the child.
This methodology was adjusted to include messages for topics of interest to the study based on findings from formative research conducted for intervention design (please see online supplementary appendix 3 for details) and evidence-based, cost-effective practices2 44 related to study outcomes.
bmjopen-2016-012996supp_appendix3.pdf (509.1KB, pdf)
Study outcomes include: (1) use of folic acid in women of reproductive age to prevent birth defects; (2) receiving prenatal care in the first trimester; (3) having a birth preparation plan for seeking timely prenatal care, institutional birth, postpartum care and emergencies; (4) exclusive breast feeding for infants under 6 months; (5) immediate breast feeding after birth; (6) proper thermal and cord care for newborn infants; (7) proper treatment of diarrhoea in children, including the use of zinc (which is a new component of the SMI programme, here); (8) paternal involvement in childcare, particularly for newborns; (9) use of modern family-planning methods; and (10) delaying pregnancy until 18 years of age.
While only very specific households will be targeted according to our randomisation methods, participants from target households will not be discouraged from inviting others, and a careful record of attendees will be kept. CHWs have a team of supervisors for intervention quality control and to ensure that CHWs are visiting the correct houses. The IDB/SMI team has incorporated the use of mHealth tools to aid in intervention delivery (eg, all stories are available in an animated video format), data quality and timeliness. The IDB is also currently working on supply-side interventions with the Government of Honduras through SMI and other complementary programmes, to ensure that community members seeking services receive quality care.
As part of the intervention protocol, we will keep careful track of which CHWs have visited which households in order to allow us to evaluate possible provider effects relevant to the study outcomes. For more details on intervention implementation please see online supplementary appendix 3
Figure 4 illustrates the sequence of events in our project.
Analytic aims
We have several analytic aims, as this project is analytically very complex (for details on statistical methods specific to each aim please see online supplementary appendix 1). The extensive amount of network data will allow us to undertake an unprecedented level of analysis regarding the relationship between community-level social dynamics and the uptake, diffusion and maintenance of intervention behaviours, and norms. These network data will be used to examine how attitudes and behaviours spread across network ties.
Analytic Aim 1: evaluate the extent to which behaviour change regarding RMNCH care spreads
We will use the results of the randomised controlled trial (RCT) to ascertain the extent to which beneficial or harmful RMNCH care attitudes and behaviour change in one person can potentially modify the attitudes and behaviour in other people to whom they are connected. With the longitudinal data that we will collect in this study, we will be able to track the change in attitudes and behaviour among individuals over time. By examining the correlation between the behaviour of an individual and the behaviour of those to whom she is linked, we will be able to determine to what degree the intervention effects spread beyond those who were directly exposed to those who were not exposed (a ‘cascade’ or ‘spillover’ effect).
Here, our work benefits from experimentally exposing individuals to the intervention. This randomisation will allow us to assess causal relationships between connected individuals by measuring how participants' outcomes are affected by their social contacts' (randomly assigned) exposure. Across villages, we will assess how varying the overall treatment rate causes both treated and untreated individuals to alter their behaviour.
The magnitude, and possibly even the direction, of network effects should vary according to the social distance between the actors. In general, our previous research has demonstrated weaker effects with increasing social distance, so that, for example, a behaviour change (eg, performing hygienic cord care) in a social contact would have progressively weaker effects in terms of motivating behaviour change as one moves along, say, the continuum from sibling to friend to neighbour. Among socially connected individuals, we will be able to distinguish among mutual relationships (when both nominate each other) and ‘one-way’ relationships (when nominations are not reciprocated). We expect that social contagion will be more likely between mutual relationships compared to one-way relationships.
Analytic Aim 2: test for social effects in community adoption rates
Most interventions are focused on individuals. Researchers identify a group of individuals to enrol in a project, randomly assign some to the intervention and some to control, and then test the efficacy of the intervention on treatment individuals versus control. Individuals may be chosen from one defined community or from many. The impact of the intervention on the community as a whole is usually not measured or taken into consideration. However, we know that, for behaviours with a social component, the individual is not thinking or acting in a vacuum. As more and more individuals in a community are exposed to new behaviours and new ideas, it is increasingly likely that any given individual in that community will adopt those behaviours and ideas (see figure 5). There is a threshold to this effect, however, beyond which exposing additional individuals will not increase overall adoption. Analytic aim 2 is to learn where this critical threshold lies in order to capitalise on the social effects that create it. It may be possible to achieve near-maximum adoption with substantially less effort than is currently being exerted by interventions.
We plan to test for this threshold by using an 8×2 RCT factorial design. In the first dimension of this design, we will assign villages to one of eight dosage treatments (0%, 5%, 10%, 20%, 30% 50%, 75%, 100%) indicating the percentage of households in each village that will be randomly chosen to receive the intervention package (for details on randomisation methods see online supplementary appendix 1). We will use these randomly assigned treatment percentages and observed rates of health behaviour adoption (in the entire communities) to test for this threshold. What is the minimum proportion of the population to target in order to achieve maximum levels of adoption at the community level? Since we have several outcomes on which we are intervening, we will be able to test to what degree this threshold differs (or does not differ) across behaviours, and how this may differ according to the behaviour-change mechanism we observe (with due attention to multiple comparisons).
The two mechanisms by which we believe social networks affect intervention adoption are through the spread of information and the spread of norms.21 On the one hand, the spread of information can be understood as being a process of social learning45 where people mostly observe others adopting the behaviour and assess the benefits that the early adopters may be enjoying. On the other hand, the spread of norms is more likely to occur as the result of direct social influence.45 If the innovation is in direct opposition to an ingrained norm, community members may sanction others for adopting the new behaviour. The proportion of the population that must be exposed in order to overcome that resistance might be higher than it is for a diffusion of technology or knowledge. Once a critical mass adopts, however, and a new norm has taken hold, then we would expect that social influence would switch and work strongly in support of the innovation. In figure 5, at the higher levels of adoption, there is strong upward influence pushing the community in support of the behaviour of interest.
Diffusion and norms processes will both yield the S-shaped curve shown in figure 5, though potentially occurring at differing rates. Elucidating the difference between the two is crucial; however, the intervention strategies necessary to elicit successful change will differ between the two. To further distinguish these two mechanisms, we plan to generate questions in our survey that will help us to differentiate whether a health behaviour showing a social effect is influenced more by information transmission or through social influence and social sanctions. We will also analyse social structural features that affect this (see online supplementary appendix 1).
Analytic Aim 3: test the impact of the ‘nomination’ network targeting method
If people who are initially selected to receive the intervention are socially well connected, it follows that, because their local social networks are larger (and for other topological reasons as well), the number of people who will be exposed to the intervention at an early stage, through spill over, will also be larger. Moreover, if we identify these central people through the most topically salient relationships, they might also be people with high credibility around our behaviours of interest. In other words, we anticipate that these individuals will not only have more influence in the community due to their greater level of access to others, but that the probability that any individual within their network adopts might be greater due to their higher level of general credibility.46 Theoretical network research supports both these hypotheses,47 48 but there is little empirical evidence to test these claims.30
Hence, a unique dimension of this study is that we will vary how initial targets are selected. In our 8×2 factorial design, the ‘8 conditions’ differ according to proportion of the community targeted (see Aim 2). The ‘two conditions’ differ according to how households within that community are chosen. In one condition, individual households are selected at random; in the other condition, households are selected using the ‘friendship nomination’ procedure that will identify individuals who are more connected in the village.49 50 In the friendship nomination condition, we will randomly select individuals and then, rather than intervene on those randomly selected individuals and their households, we will intervene on the household of one of their nominated social contacts. Past work suggests that the adoption curve under nomination targeting is shifted to the left relative to random targeting because friends are more central in the network and therefore spread information and norms more quickly in the early part of the intervention.30 This shifts the whole adoption curve to the left, as shown in figure 5 (the ‘Enhanced Social Effect’ shown by the solid dark blue line), and, as a result, the total percentage of individuals that need treatment to achieve nearly-maximum adoption also shifts to the left. The consequence of this left-shift is that intervention adoption increases for the same number of initial targets. This increased efficiency through the social effect is a central and overarching study objective.
Analytic Aim 4: evaluate the impact of network structural characteristics on behaviour change
We will ascertain how network structure (at the individual level and at the village level) moderates the impact of the intervention. Do people in certain parts of the network, as measured by network parameters—including centrality, transitivity and clique membership (see online supplementary appendix 1 for more details on network structural measures)—respond differentially to intervention? How does a person's location in a network, above and beyond their personal attributes, affect their response? We will also use this information to identify as-of-yet undiscovered network structural-risk factors for RMNCH morbidity and mortality. This may allow us to make important recommendations for targeting specific parts of the network in future interventions.
Since we are collecting sociocentric data (see figure 2), we will have the ability to measure a wide range of structural features to determine whether they moderate the effect of the RCT intervention. For example, is the randomly assigned intervention more effective for people in the centre of the network than it is for those in the periphery? Is the intervention more effective for those in denser parts of the network with more cross-cutting ties or for those in sparser, less-connected parts of the network? With respect to community structure, do large or small clusters in the network experience better outcomes?
Results of these analyses will include: (1) network measures for all individuals within the network and higher-order features like clusters and communities for the overall network itself; (2) information regarding the relationship between network measures and outcomes of interest, including any possibly moderating effects; and (3) recommendations for using network measures, including network position and network subgroups, for future interventions.
Analytic Aim 5: ascertain whether partial collection of network data can identify the most influential or the most influenceable people in the network
Ultimately, a key goal of this RCT is to develop means by which network approaches can be used to design, implement, and monitor health interventions most effectively. We intend to develop means by which network strategies can be incorporated into health behaviour programmes without having to map the entire network. While understanding the interaction between social relationships and intervention uptake is undoubtedly of great theoretical interest, ultimately this work is about the application of network tools to real-world projects. In real-world scenarios, the mapping of entire networks is likely to be expensive and time-consuming. A successful demonstration of the friendship nomination technique for identifying influential individuals within networks (which can be implemented without mapping the whole group) will help address this.
To further address the issue of scalability, one of our analytic aims is to use the full network data in this project to develop means by which interventionists can collect partial network data to achieve the same outcome, but at much lower cost. Recent research has suggested that, properly implemented, random network sampling can be used as a proxy for complete network information.51 For example, in our previous work, we showed that it was possible to predict an outbreak of H1N1 influenza in a population 6 weeks in advance, even without measuring the full social network.49 While health behaviour interventions probably spread differently than infectious diseases, the rationale behind using a network-based approach to disseminate an intervention, particularly one relying on central actors, has been proposed in a wide range of fields. Indeed, network-based approaches to health behaviour interventions using ‘opinion leaders’ are increasingly common in the developed world.47 52 53
Analytic Aim 6: assess the effect of the intervention on the village social networks
We will ascertain whether and how the interventions may actually modify the actual network structures of the villages. Does the introduction of a health intervention to a village change social interactions? And what are the possible effects of these changed structures on the health of communities or the population?
While programme monitoring and evaluation typically focus on the intended objectives of a given programme, interventions can have unanticipated outcomes which are rarely measured or published in the peer-reviewed literature.54–57 Nevertheless, it is critical that interventionists consider unintended outcomes, whether positive or negative, in order to integrate these outcomes into cost-benefit analyses for programme planning.58
One of the most potentially profound, but largely overlooked, peripheral outcomes of health promotion interventions is a fundamental change in social structure as a result of the intervention activities. Previous network research has demonstrated that social marginalisation can occur among people who violate the norms of their proximal networks.59 60 As norms change due to the effects of well-intentioned interventions, the social landscape of the population in question can change as well. For example, an intervention designed to increase academic performance among air force academy students failed because the intervention unintentionally created segregated clusters of very high and very low ability students, which reinforced the academic challenges of those same very low ability students that the intervention was designed to assist.61 Our past research (in the USA) has shown that social isolation of smokers increases the likelihood that they will cluster together, which further reinforces their smoking behaviour.62
It is possible that those embracing the novel behaviours in our RCT may form new connections based on their mutual interest in the intervention and, as a result, help create clusters of ‘adopters’ within the network. When adopters create clusters, non-adopters may be left to form their own clusters. Examining to what degree this occurs can inform future interventions and ameliorate any possible unintended health disparities that might result from an otherwise successful intervention. The intervention may also strengthen the social health of the community, yielding unintended but beneficial effects on a wide range of health outcomes other than RMNCH-related outcomes.
To the best of our knowledge, this will be the first large-scale evaluation of how an RCT in a developing world setting possibly modifies social interactions and what impact this modification has on health. We will assess changes in egocentric and sociocentric network structures from wave 1 to wave 3 (when the network is mapped for the second time, roughly 2 years later), and compare those changes across the different arms of the trial, examining whether there is a significant difference in the evolution of the networks for villages exposed to the intervention versus those that are not exposed. Specifically we will be looking for: (1) the emergence of clusters of intervention adopters, (2) the emergence of clusters of intervention non-adopters and (3) large-scale, and ego-centric, changes in the overall network (such as increased density).
Discussion
Our study is unusual in that it will allow us to both (1) understand the way in which social network dynamics affect the uptake of a large scale RMNCH intervention, and (2) evaluate how network-based targeting can maximise the overall impact of the same intervention. We will use a detailed understanding of social network structure and function to identify novel ways of targeting influential individuals so as to foster behavioural cascades and population-level behaviour change.
We will achieve this objective by conducting a randomised controlled trial of network targeting algorithms, to be deployed in a sample of 176 villages in Honduras, with a 2-year package of monthly RMNCH care interventions. Our work will involve both experimental as well as observational analyses, and it will be one of the largest efforts to map face-to-face networks of which we are aware (involving over 30 000 people). We will test a scalable method of network targeting that would not, in the future, require the actual mapping of social networks, but that would still offer the prospect of rapidly identifying influential targets for public health interventions. If successful, we will have developed procedures that will allow us, and others, to accelerate the change of attitudes and behaviours in entire populations much more efficiently and comprehensively.
Limitations
Our study has limitations. Our sample is limited to rural Honduras and so, while many network characteristics tend to be similar across different social and cultural contexts,63 some of the norms surrounding RMNCH care might be special. This may limit the application of some of our results within other contexts. Also, while we will use objective measures whenever possible, many of the outcomes we will be assessing will be measured using self-report. Finally, while between-village ties would strengthen our understanding of network dynamics within this population, the extensive resources involved in that level of data collection preclude our ability to collect that data (though we forecast such ties to be less relevant and less numerous).
Our intervention itself also has limitations. In the ideal scenario, we would use an evidence-based intervention for community-based neonatal health tested in rural Honduras implemented to ‘guarantee’ behaviour change among the initially targeted individuals, the ripples of which would be studied in the RTC. However, given the constraints of the study, this ‘ideal intervention’ does not exist. For example, in the ideal behavior change communication intervention, the person or group whose behaviour change is sought receives the intervention messages as many times as possible. In the typical community-based intervention, in addition to face-to-face counselling, community members would be exposed to radio messages, banners, flyers, mass text messages and other media-based communication methods to reinforce messaging. Given that the study relies on information passing through the social network, mass media communication are being excluded. The intervention team has been creative in adding tools to the intervention, and has been mindful of including a variety of behavioural changes along the continuum of pregnancy, childbirth, postnatal care and child health in order to maximise the possibility that one or more intervention components are adopted. Intervention targeting is also affected. Normally in an intervention targeted at changing behaviours in maternal and neonatal health, households would be selected depending on where pregnant women live. We could not take these criteria into consideration, given that the targeting mechanism is based on position in the network, rather than whether or not a woman in the household is pregnant.
Finally, not all aspects of the desired behaviour change rely on adequate knowledge, attitudes, and practices at the household level. A clear example is how the conditions in health centres and hospitals affect behaviours of the population. Although messaging is provided to families regarding the importance of male involvement in birth, if the hospital or health centres do not have adequate infrastructure to have private birthing rooms (the norm in Central America), men cannot be in the room during the birth if another women is also in labour. Although SMI works closely with the MOH to improve supply-side conditions, some aspects are out of the scope of the programme. The study team is aware of these limitations and is documenting them to have a clear picture of these external factors which also impact the success of the community-based behaviour change intervention.
Conclusion
This study is unique in its scale of network data collected in a developing world setting, the integration of complete network data with the results of a large RCT, and, most importantly perhaps, the testing of network algorithms as a method of boosting uptake of the intervention. With billions of dollars spent each year in attempts to achieve behaviour change in at-risk populations, we are still unsure of the best strategies for implementing these interventions in ways that maximise sustained change. This study will be an important contribution towards that goal, with results that can be applied in disparate global contexts.
We believe that the knowledge gained will have substantial practical application. Global health practitioners are beginning to understand that ignoring social reinforcements and expectations in relation to the outcomes of interest can herald less -than- optimal results. It is not clear however, how to apply that understanding to the practicalities of intervention work. By looking at behavioural and attitudinal outcomes of our intervention, we have the opportunity to take a real-world, on-the-ground intervention and analyse it in conjunction with gold-standard, complete social network data. By exploiting network insights, we will be able to develop strategies for interventionists to implement in order to shift the norms of the communities towards acceptance and uptake of the desired behaviours.
Dissemination
The primary applied aim of this project is to develop methods by which interventionists in global health settings can integrate a network approach in order to maximise the effectiveness of their programmes. The analytic aims we have outlined above are essential for achieving this goal. Analysis and publication in peer-reviewed journals alone, however, will not make this body of knowledge accessible to those for whom it is intended, namely, global health practitioners who are working in communities to achieve sustainable behaviour change. To be of more practical assistance for future implementation, we intend to engage NGOs and other actors through global health conferences and other venues for exchanging practical methods for improving health interventions.
These dissemination efforts will be more thoroughly planned during the first year of the project and will ultimately result in the development of a ‘toolkit’ for practitioners to use in network-based intervention efforts. This toolkit will provide guidelines for collecting network data; develop open-source software to collect network data and identify network targets in field settings; and develop network data-collection materials suited to project goals and social context.
Acknowledgments
Research was supported by the Bill and Melinda Gates Foundation. The authors would also like to thank our hardworking field team in Honduras, who have worked tirelessly to make this project possible, the Honduras Ministry of Health, who provide approval of intervention materials and study instruments and ensure alignment with national norms and protocols, and our implementing partners World Vision Honduras, Child Fund Honduras and Dimagi.
Footnotes
Contributors: HS, DS, AH, TK, JF and NC participated in the conception of the idea for the study and wrote the grant proposal. JN and EI wrote the intervention grant proposal. JN, EI and MF managed the design, implementation and supervision of the intervention. RN, NC, MM, JF, DS and LN helped with software development and data management. TK, RN, DS and JB managed field operations. HS, TK, RN, DS, JB and NC were responsible for survey development. HS, TK, RN, JN, NC and EI worked on the development of the RMNCH intervention. HS, DS, NC, JF, JN, AH, RN, EA and TK contributed to the discussion, writing and review of the manuscript, and HS coordinated this. All authors were responsible for the study design and provided professional, logistical or statistical support. All authors approved the final version of the manuscript.
Funding: Bill and Melinda Gates Foundation, (grant number OPP1098684).
Competing interests: None declared.
Ethics approval: This trial is registered with ClinicalTrials.gov, number NCT02694679. The Yale IRB and the Honduran Ministry of Health approved all data collection procedures (Protocol number 1506016012) and all participants will provide informed consent before enrolment in the study.
Provenance and peer review: Not commissioned; externally peer reviewed.
References
- 1.Lawn JE, Cousens S, Zupan J et al. . 4 million neonatal deaths: when? where? why? Lancet 2005;365:891–900. 10.1016/S0140-6736(05)71048-5 [DOI] [PubMed] [Google Scholar]
- 2.Black RE, Cousens S, Johnson HL et al. . Global, regional, and national causes of child mortality in 2008: a systematic analysis. Lancet 2010;375:1969–87. 10.1016/S0140-6736(10)60549-1 [DOI] [PubMed] [Google Scholar]
- 3.Baqui AH, El-Arifeen SE, Darmstadt GL et al. . Effect of community-based newborn-care intervention package implemented through two service-delivery strategies in Sylhet District, Bangladesh: a cluster-randomized controlled trial. Lancet 2008;371:1936–44. 10.1016/S0140-6736(08)60835-1 [DOI] [PubMed] [Google Scholar]
- 4.The Partnership for Maternal, Newborn, and Child Health. WHO. 2011; September. [Google Scholar]
- 5.Project description and implementation and management plan: Salud MesoAmerica 2012:10–1. [Google Scholar]
- 6.UNICEF Country profile—Honduras: maternal, newborn and child survival 2012. [Google Scholar]
- 7.The World Bank. Health systems innovations in Latin America 2005. [Google Scholar]
- 8.Kumar V, Mohanty S, Kumar A et al. . Effect of community-based behaviour change management on neonatal mortality in Shivgarh, Uttar Pradesh, Indian: a cluster-randomised controlled trial. Lancet 2008;372:1151–62. 10.1016/S0140-6736(08)61483-X [DOI] [PubMed] [Google Scholar]
- 9.Darmstadt GL, Walker N, Lawn JE et al. . Saving newborn lives in Asia and Africa: cost and impact of phased scale-up of interventions within the continuum of care. Health Policy Plan 2008;23:101–17. 10.1093/heapol/czn001 [DOI] [PubMed] [Google Scholar]
- 10.Darmstadt GL, Bhutta ZA, Cousens S et al. . Evidence-based, cost-effective interventions: how many newborn babies can we save? Lancet 2005;365:977–88. 10.1016/S0140-6736(05)71088-6 [DOI] [PubMed] [Google Scholar]
- 11.Lancet executive summary neonatal survival series.
- 12.Shakya HB, Christakis NA, Fowler JH. Social network predictors of latrine ownership. Soc Sci Med 2015;125:129–38. 10.1016/j.socscimed.2014.03.009 [DOI] [PubMed] [Google Scholar]
- 13.Christakis NA, Fowler JH. The spread of obesity in a large social network over 32 years. N Engl J Med 2007;357:370–9. 10.1056/NEJMsa066082 [DOI] [PubMed] [Google Scholar]
- 14.Gayen K, Raeside R. Social networks and contraception practice of women in rural Bangladesh. Soc Sci Med 2010;71:1584–92. 10.1016/j.socscimed.2010.08.002 [DOI] [PubMed] [Google Scholar]
- 15.Cattell V. Poor people, poor places, and poor health: the mediating role of social networks and social capital. Soc Sci Med 2001;52:1501–16. 10.1016/S0277-9536(00)00259-8 [DOI] [PubMed] [Google Scholar]
- 16.McMichael C, Manderson L. Somali women and well-being: social networks and social capital among immigrant women in Australia. Human Org 2004;63:88–99. 10.17730/humo.63.1.nwlpjdj4d4l9756l [DOI] [Google Scholar]
- 17.Shakya HB, Christakis NA, Fowler JH. Association between social network communities and health behavior: an Observational Sociocentric Network Study of Latrine Ownership in Rural India. Am J Public Health 2014;104:930–7. 10.2105/AJPH.2013.301811 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Latkin CA, Forman V, Knowlton A et al. . Norms, social networks, and HIV-related risk behaviors among urban disadvantaged drug users. Soc Sci Med 2003;56:465–76. 10.1016/S0277-9536(02)00047-3 [DOI] [PubMed] [Google Scholar]
- 19.Dubois N, ed.. A Sociocognitive Approach to Social Norms. Bristol: Routledge, 2003. [Google Scholar]
- 20.Bicchieri C. The grammar of society: the nature and dynamics of social norms. New York: Cambridge University Press, 2006. [Google Scholar]
- 21.Centola D, Macy M. Complex contagions and the weakness of long ties. Am J Soc 2007;113:702–34. 10.1086/521848 [DOI] [Google Scholar]
- 22.Centola D, Eguiluz VM, Macy MW. Cascade dynamics of complex propagation. Physica A: Statistical Mechanics and its Applications 2007;374:449–56. 10.1016/j.physa.2006.06.018 [DOI] [Google Scholar]
- 23.Cialdini RB, Kallgren CA, Reno RR. A focus theory of normative conduct: a theoretical refinement and reevaluation of the role of norms in human behavior. In: Zanna M, ed.. Advances in experimental social psychology. San Diego, CA: Academic Press, 1991:201–34. [Google Scholar]
- 24.Trotter RT, Baldwin JA, Bowen A. Network structure and proxy network measures of HIV, drug and incarceration risks for active drug users. Connections 1995;18:89–104. [Google Scholar]
- 25.Barrington C, Latkin C, Sweat MD et al. . Talking the talk, walking the walk: social network norms, communication patterns, and condom use among the male partners of female sex workers in La Romana, Dominican Republic. Soc Sci Med 2009;68:2037–44. 10.1016/j.socscimed.2009.03.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Liu H, Feng T, Feng H et al. . Egocentric network of Chinese men who have sex with men: network components, condom use norms, and safe sex. AIDS Patient Care STDS 2009;23:885–93. 10.1089/apc.2009.0043 [DOI] [PubMed] [Google Scholar]
- 27.Sunstein CR. Social norms and social roles. Columbia Law Review 1996;96:963–8. 10.2307/1123430 [DOI] [Google Scholar]
- 28.Centola D. The spread of behavior in an online sociall network experiment. Science 2010;329:1194–7. 10.1126/science.1185231 [DOI] [PubMed] [Google Scholar]
- 29.Burke MA, Young HP. Social norms. In: Bisin A, Jess B, Jackson M. Handbook of social economics. Amsterdam, North Holland, 2009:311–36. [Google Scholar]
- 30.Kim DA, Hwong AR, Stafford D et al. . Social network targeting to maximise population behaviour change: a cluster randomised controlled trial. Lancet 2015;386:145–53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Paluck EL, Shepherd H, Aronow PM. Changing climates of conflict: A social network experiment in 56 schools. Proc Natl Acad Sci 2016;113:566–71. 10.1073/pnas.1514483113 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Prince F. The relative effectiveness of a peer-led and adult-led smoking intervention program. Adolescence 1995;30:187–94. [PubMed] [Google Scholar]
- 33.Albrecht S, Payne L, Stone CA et al. . A preliminary study of the use of peer support in smoking cessation programs for pregnant adolescents. J Am Acad Nurse Pract 1998;10:119–25. 10.1111/j.1745-7599.1998.tb01205.x [DOI] [PubMed] [Google Scholar]
- 34.Malchodi CS, Onchken C, Dornelas EA et al. . The effects of peer counseling on smoking cessation and reduction. Obstet Gynecol 2003;101:504–10. [DOI] [PubMed] [Google Scholar]
- 35.McKnight AJ, McPherson K. Evaluation of peer intervention training for high school alcohol safety education. Accid Anal Prev 1986;18:339–47. 10.1016/0001-4575(86)90047-3 [DOI] [PubMed] [Google Scholar]
- 36.Valente TW, Hoffman BR, Ritt-Olson A et al. . The effects of a social network method for group assignment strategies on peer-led tobacco prevention programs in schools. Am J Public Health 2003;93:1837–43. 10.2105/AJPH.93.11.1837 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Thombs DL, Hamilton MJ. Effects of a social norm feedback campaign on the drinking norms and behavior of Division I student-athletes. J Drug Educ 2002;32:227–44. 10.2190/2UYU-6X9M-RJ65-3YYH [DOI] [PubMed] [Google Scholar]
- 38.Wechsler H, Moeykens B, Davenport A et al. . The adverse impact of heavy episodic drinkers on other college students. J Stud Alcohol 1995;56:628–34. 10.15288/jsa.1995.56.628 [DOI] [PubMed] [Google Scholar]
- 39.Marsden PV. Recent developments in network measurement. In: Carrington PJ, Scott J, Wasserman S, eds. Models and methods in social network. New York: Cambridge University Press, 2005:8–30. [Google Scholar]
- 40.Marin A, Wellman B. Social network analysis on introduction. In: Carrington PI, Scott J, eds. Handbook of social network analysis. London: Sage, 2005:11–26. [Google Scholar]
- 41.Arifeen SE, Mullany LC, Shah R et al. . The effect of cord cleansing with chlorhexidine on neonatal mortality in rural Bangladesh: a community-based, cluster-randomised trial. Lancet 2012;379:1022–8. [DOI] [PubMed] [Google Scholar]
- 42.International WV. Timed and Targeted Counseling 2016. http://www.wvi.org/health/timed-and-targeted-counseling-ttc (accessed 1 Mar 2016).
- 43.Collaborative HCC. Health COMpass 2016. http://www.thehealthcompass.org/
- 44.Campbell OM, Graham WJ, group LMSSs. Strategies for reducing maternal mortality: getting on with what works. Lancet 2006;368:1284–99. 10.1016/S0140-6736(06)69381-1 [DOI] [PubMed] [Google Scholar]
- 45.Kohler HP, Behrman JR, Watkins SC. The density of social networks and fertility decisions: evidence from South Nyanza District, Kenya. Demography 2001;38:43–58. 10.1353/dem.2001.0005 [DOI] [PubMed] [Google Scholar]
- 46.Garcia-Herranz M, Egido EM, Cebrian M et al. . Using friends as sensors to detect global-scale contagious outbreaks. PLoS ONE 2014;9:e92413 10.1371/journal.pone.0092413 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Valente TW, Ritt-Olson A, Stacy A et al. . Peer acceleration: effects of a social network tailored substance abuse prevention program among high risk adolescents. Addiction 2007;102:1804–15. 10.1111/j.1360-0443.2007.01992.x [DOI] [PubMed] [Google Scholar]
- 48.Valente TW. Network interventions. Science 2012;337:49–53. 10.1126/science.1217330 [DOI] [PubMed] [Google Scholar]
- 49.Christakis NA, Fowler JH. Social network sensors for early detection of contagious outbreaks. PLoS ONE 2010;5:e12948 10.1371/journal.pone.0012948 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Feld SL. Why your friends have more friends than you do. Am J Sociol 1991;96:1464–77. [Google Scholar]
- 51.Costenbader E, Valente TW. The stability of centrality measures when networks are sampled. Social Networks 2003;25:283–307. 10.1016/S0378-8733(03)00012-1 [DOI] [Google Scholar]
- 52.Valente TW, Pumpuang P. Identifying opinion leaders to promote behavior change. Health Educ Behav 2007;34:881–96. 10.1177/1090198106297855 [DOI] [PubMed] [Google Scholar]
- 53.Kelly JA, Amirkhanian YA, Kabakchieva E et al. . Prevention of HIV and sexually transmitted disease in high risk social networks of young Roma (Gypsy) men in Bulgaria: randomised controlled trial. BMJ 2006;333:1098 10.1136/bmj.38992.478299.55 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.McCord J. Cures that harm: unanticipated outcomes of crime prevention programs. The ANNALS of the American Academy of Political and Social Science 2003;587:16–30. 10.1177/0002716202250781 [DOI] [Google Scholar]
- 55.Chaudhuri A. Direct and indirect effects of a maternal and child health program in rural Bangladesh. J Dev Societies 2005;21:143–73. 10.1177/0169796X05053070 [DOI] [Google Scholar]
- 56.Rychetnik L, Frommer M, Hawe P et al. . Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health 2002;56:119–27. 10.1136/jech.56.2.119 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Rosenzweig MR, Wolpin KI. Governmental interventions and household behavior in a developing country: anticipating the unanticipated consequences of social programs. J Dev Econ 1982;10:209–25. 10.1016/0304-3878(82)90017-7 [DOI] [Google Scholar]
- 58.Christakis NA. Social networks and collateral health effects. BMJ 2004;329:184 10.1136/bmj.329.7459.184 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Strauss RS, Pollack HA. Social marginalization of overweight children. Arch Pediatr Adolesc Med 2003;157:746–52. 10.1001/archpedi.157.8.746 [DOI] [PubMed] [Google Scholar]
- 60.Hogg MA, Fielding KS, Darley J. Fringe dwellers: processes of deviance and marginalization in groups. The social psychology of inclusion and exclusion 2005;191–210. [Google Scholar]
- 61.Carrell S, Sacerdote B, West J. Beware of economists bearing reduced forms? An experiment in how not to improve student outcomes. Unpublished Working Paper 2010.
- 62.Christakis NA, Fowler JH. The collective dynamics of smoking in a large social network. N Engl J Med 2008;358:2249–58. 10.1056/NEJMsa0706154 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Apicella CL, Marlowe FW, Fowler JH et al. . Social networks and cooperation in hunter-gatherers. Nature 2012;481:497–501. 10.1038/nature10736 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2016-012996supp_appendix1.pdf (651.2KB, pdf)
bmjopen-2016-012996supp_appendix2.pdf (645KB, pdf)
bmjopen-2016-012996supp_appendix3.pdf (509.1KB, pdf)