Abstract
Collecting child maltreatment data is a complicated undertaking for many reasons. As a result, there is an interest by child maltreatment researchers to develop methodologies that allow for the triangulation of data sources. To better understand how social media and internet-based technologies could contribute to these approaches, we conducted a scoping review to provide an overview of social media and internet-based methodologies for health research, to report results of evaluation and validation research on these methods, and to highlight studies with potential relevance to child maltreatment research and surveillance. Many approaches were identified in the broad health literature; however, there has been limited application of these approaches to child maltreatment. The most common use was recruiting participants or engaging existing participants using online methods. From the broad health literature, social media and internet-based approaches to surveillance and epidemiologic research appear promising. Many of the approaches are relatively low cost and easy to implement without extensive infrastructure, but there are also a range of limitations for each method. Several methods have a mixed record of validation and sources of error in estimation are not yet understood or predictable. In addition to the problems relevant to other health outcomes, child maltreatment researchers face additional challenges, including the complex ethical issues associated with both internet-based and child maltreatment research. If these issues are adequately addressed, social media and internet-based technologies may be a promising approach to reducing some of the limitations in existing child maltreatment data.
Keywords: Child abuse, Social media, Internet, Epidemiology, Surveillance, Scoping review
1. Introduction
Collecting child maltreatment data is a complicated undertaking for many reasons (World Health Organization, 2016). Although governmental and other official data records are the gold standard for the data of many disciplines, official data records for child maltreatment have several significant issues. First, the definition of child maltreatment differs substantially depending on the geographic region, agency or organization, and purpose for data collection. For example, Section 3 of the United States Child Abuse Prevention and Treatment Act (CAPTA) defines child abuse and neglect as, “at a minimum, any recent act or set of acts or failure to act on the part of a parent or caretaker, which results in death, serious physical or emotional harm, sexual abuse or exploitation, or an act or failure to act, which presents an imminent risk of serious harm”(Children’s Bureau, 2010). States and other jurisdictions are free to develop their own definition, so long as it meets or exceeds the federal definition (Child Welfare Information Gateway, 2016). These differing definitions result in inconsistent reporting to The National Child Abuse and Neglect Data System (NCANDS), the official government data source in the United States for child abuse and neglect reports (Children’s Bureau, 2016). The NCANDS is also subject to changes in the jurisdictional definitions over time (Children’s Bureau, 2016). Thus, it is difficult to draw firm conclusions about trends over time or across geographical areas from official data reports. It is particularly difficult to create estimates that are sensitive enough to assess the impacts of broader social trends or interventions on child maltreatment.
Official reports are also associated with other forms of bias, including report and investigation bias. It is well-established in the literature that many factors, beyond presence of child maltreatment, contribute to referral to and investigation by the child protection system (Bunting, Lazenbatt, & Wallace, 2010; Drake, Lee, & Jonson-Reid, 2009; Lane & Dubowitz, 2007; Widom, Czaja, & DuMont, 2015). Estimates suggest that between fifty and eighty percent of child maltreatment victims are not officially reported so even without concerns about bias in the data, official reports underestimate the prevalence of child maltreatment and may not represent the true experience of children who are maltreated (Fallon et al., 2010). As a result of the introduction of these biases, the use of these data for research or evaluation is complicated.
Surveys of parents or children avoid some of the pitfalls associated with official data but introduce other issues. Approaches that require participant disclosure, whether retrospective or prospective, are subject to both random and systematic bias (Kahneman et al., 2000). Human memory is a function of various heuristic strategies so participant reports are influenced not only by characteristics of the event in question but also the experiences before, during, and after the event (Kahneman et al., 2000; Smallwood & O’Connor, 2011). In addition to these general issues with self-reported data, studies of child maltreatment may face additional limitations due to the sensitive nature of the questions. Individuals may intentionally withhold information related to child maltreatment due to social desirability, embarrassment, or concerns about confidentially and the repercussions of reporting abuse (Everson et al., 2008). Concerns about repercussions may be especially prominent when talking to parents about their children’s experiences because many institutional review boards and universities require researchers to report suspected child maltreatment to child protective services. Researchers may also directly ask minors about their experiences. This approach reduces the issues associated with retrospective report but is debated because children may not have the necessary perspective to recognize their experiences as abusive or to critically process the potential costs and benefits of disclosure (International Society for the Prevention of Child Abuse & Neglect, 2016). In addition, infants and very young children, who are unable to report experiences to researchers, have the highest rates of maltreatment so child-reported research is not possible with the subpopulation at the highest risk of maltreatment (U.S. Department of Health, and, & Human Services, 2017).
Some approaches to self-reported studies also have issues related to social changes in engagement with research and technology. Historically, survey samples drawn via random digit dialing could provide reliable measures of population health indicators (Lee et al., 2011). As cell phones have increased in popularity, more people are unreachable through a landline number. In addition, cell phone service has not been equally adopted across the population so random digit dialing is likely to miss young people, people with low socio-economic status, and males (Lee et al., 2011). In addition to these potential biases, increased telemarketing, screening calls through caller ID, and call blocking present additional challenges to an adequate, representative response (Lee et al., 2011). Because of these changes, it is difficult to adequately access a sample that is representative of the population.
Finally, child maltreatment data may be collected from child welfare professionals and other key informants. The National Incidence Study of Child Abuse and Neglect (NIS), which is conducted in the United States, works with child welfare agencies to identify children served during the three-month study period, then solicits reports from other professionals who regularly engage with children (Sedlak et al., 2010). Using complex methodology, duplicate reports are removed so the final database includes abused children who were and were not known to child welfare to provide a more comprehensive view of the prevalence of child maltreatment (Sedlak et al., 2010). The NIS funding does not allow for frequent data collection and it has only been conducted four times since 1974 (Fallon et al., 2010). Cost is a significant limitation to this data collection approach and without substantial funding increases, timeliness of the data and inability to regularly monitor trends across time are significant limitations (Fallon et al., 2010). In addition, this method relies upon professionals’ knowledge of child maltreatment so it is likely that many maltreated children are not detected.
As a result of these complexities, there is an interest in developing methodologies for child maltreatment epidemiological research and approaches to the triangulation of data resources (Leeb & Fluke, 2015). Each potential data source has relative strengths and weaknesses, but, relying on any single source of information provides an incomplete and potentially biased view of the issue of child maltreatment (Afifi et al., 2015). Researchers in other areas of health, such as infectious disease, have readily adopted social media and internet-based approaches to triangulation. These approaches may be particularly relevant to child maltreatment researchers as 98% of young people in the United States access the internet at least weekly and 93% use at least one social network site (Lenhart, 2015). However, there have been notable lapses in accuracy for some of these approaches, which highlight the importance of rigorous evaluation and validation of these new approaches, prior to adoption and throughout the process of utilization (Olson, Konty, Paladini, Viboud, & Simonsen, 2013). To that end, the field is beginning to explore how techniques that rely on the use of social media may or may not be applicable to child maltreatment epidemiology and research.
Because this is a new and rapidly developing area, we have conducted a scoping review to provide an overview of social media methodologies for health surveillance or related epidemiologic research, to report results of evaluation and validation research on these methods, and to highlight studies with potential relevance to child maltreatment research and surveillance. Scoping reviews differ from systematic reviews in that they focus on the extent, range, and nature of research in the topic area for the purpose of summarizing and disseminating findings, evaluating the feasibility of conducting a systematic review, or identifying gaps in the literature (Levac, Colquhoun, & O’Brien, 2010). This type of review is ideal for topics with emerging evidence, where it would be difficult to complete a systematic review or meta-analysis (Levac et al., 2010).
2. Literature review methods
We searched PsychInfo, PubMed, ScienceDirect, and Academic Search Elite using two search frameworks. The first framework was broadly focused on how social media and other forms of internet-based technology were used for health surveillance, which also included some broader epidemiologic research. The second framework focused on the use of social media for child maltreatment research. For each framework, one author reviewed the title and, if available, the abstract of all articles found through the search framework. Articles were considered possibly relevant if social media or internet-based approaches to health research or surveillance were discussed in the abstract. Articles with possibly relevant content were downloaded and the full text of the article was reviewed. For this review, social media was conceptualized using the Bright, Margetts, Hale, and Yasseri (2014) definition as “a means of communication, based around a website or internet service, where the content being communicated is produced by the people using the service.”
The search terms for the general health framework included, “social media” OR “social media surveillance” OR crowdsourcing OR crowdsource OR “internet surveillance” OR “online surveillance” OR Facebook OR Twitter OR Google OR Tumblr OR YikYak OR Instagram OR Youtube OR apps OR “mobile app” AND “public health surveillance” OR “bio-surveillance” OR “health surveillance”. Articles were included in this portion of the review if data collection was conducted using social media or an internet-based technology and the study focused on a health-related issue. Commentaries on the use of social media, articles in languages other than English, articles without relevance to human disease or disability (i.e., plant/animal disease), and technical reports without application to human research were excluded. In total, 2134 possibly relevant articles were identified through this process (Fig. 1 ). Of these, 147 relevant articles were included in this review. Articles were most commonly excluded because they were commentaries or they focused on the computer science aspects of technology.
The search terms for the child maltreatment portion of the search included all the technology search terms, but included “child abuse OR “child neglect” OR “child maltreatment”, instead of the surveillance search terms. Articles were included in this portion of the review if data collection was conducted using social media or an internet-based technology and the study focused on a child maltreatment-related issue. As with the first review, commentaries, articles without human relevance, and technical reports were excluded. A total of 740 articles were considered for this review (Fig. 1). Of these, 12 articles were found to be related to social media or internet-based surveillance or research. Articles were commonly excluded because they were not directly relevant to child maltreatment (i.e., internet-based pedophilia; peer-to-peer harassment) or did not use social media and/or internet-based approaches for data collection purposes (i.e., only online dissemination of findings; participant self-reported use of social media).
The initial searches for this review were completed in March of 2016. The child maltreatment-related search was repeated in August of 2017 with no additional articles found. The general health research search was not repeated because the March 2016 search results provided a comprehensive overview of methods for conducting this type of research and it was unlikely there were significant advances in these methods.
3. Results
Most of the studies and methods found through this scoping review were focused on physical health, which may be least applicable to child maltreatment research and surveillance. In the interest of brevity, we have provided an overview of the approaches, strengths, and weaknesses in Table 1 with references throughout the text. For mental health and health behavior related studies, we have provided some additional detail on the topic and approach in the text.
Table 1.
Method | Example Topics Studied | Strengths | Weaknesses |
---|---|---|---|
Active Data Collection | |||
Crowdsourcing | Infectious disease: influenza; malaria; dengue | Cost-effective; easy recruitment; geographical diversity; access to some hidden/rare subpopulations; research-driven data | Underrepresentation of people of color; volunteer bias; requirement for internet access; poor sustained participant engagement |
Non-infectious disease: cancer; asthma | |||
Health behavior/environment: availability of tobacco; cost of diverted prescriptions | |||
Online Recruitment | Infectious disease: respiratory infection Non-infectious disease: respiratory distress; diabetes | Access to previously unreachable population; research-driven data | Volunteer bias; requirement for internet access; |
Passive Data Collection | |||
Internet Search Query | Infectious disease: influenza; dengue fever; malaria; listeria; HIV; norovirus; hepatitis; tuberculosis; | Low cost; some support for real-time validity | Questionable validity; poor sustained predictive ability; limited ability to control for confounders |
Non-infectious disease: cancer; multiple sclerosis | |||
Mental health: depression; anxiety; suicide | |||
Health behavior/environment: availability of tobacco; vaccination; drug use; preconception care | |||
Media Reports | Infectious disease: H1N1 | Real-time availability; curated databases searchable by disease, location, source, and date | Resource intensive collection of reports by individuals; potential bias due to media sensitivity |
Health behavior/environment: drowning; sudden cardiac death | |||
Internet death notices | Mortality data | High correspondence to death records; nearly real-time data availability | Only applicable to mortality research |
Forums | Infectious disease: foodborne illness | Low cost | Limited information; potential lack of generalizability |
Non-infectious disease: diabetes | |||
Restaurant reviews | Infectious disease: foodborne illness | Low cost; real-time data availability | Potential confounding |
Flexible or Combined Approaches | |||
Infectious disease: influenza; H1N1; Middle East Respiratory Syndrome Coronavirus | Low cost; large number of observations; real-time data availability | Potentially missing covariates; potentially limited generalizability to overall population | |
Health behavior/environment: e-cigarettes; dental pain; cardiac arrest; drug use; suicide; vaccination | |||
Health behavior/environment: obesity; general physical health; autism; water fluoride | Low cost; large number of observations; real-time data availability | Potentially missing covariates; potentially limited generalizability to overall population | |
Mental health: autism; depression; alcohol abuse | |||
3.1. Active data collection methods
Active data collection methods include direct interaction with research participants. Although contact with participants is facilitated through the internet, the process of designing the measurement tool, collecting data through interaction with participants, and analyzing the data are similar to traditional data collection methods.
3.1.1. Crowdsourcing
Crowdsourcing is the process of obtaining services, ideas, or content from a large, undefined group of volunteers or part-time workers through a flexible open call. The volunteers and part-time workers have varying degrees of experience, knowledge, and skills. Most often, researchers use crowdsourcing to complete large, monotonous tasks or recruit large numbers of survey participants. Amazon Mechanical Turk, Google Consumer Surveys, and proprietary systems or websites are the most common methods of crowdsourcing. Amazon Mechanical Turk is an online multi-use crowdsourcing platform hosted through Amazon where users are recruited to answer surveys or complete repetitious tasks for a small amount of money. Google Consumer Surveys is another crowdsourcing platform used to recruit a large number of participants for short surveys (<10 questions) (Sell, Goldberg, & Conron, 2015). Samples may be constructed to be nationally-representative based on age, gender, and geographic distribution of respondents. However, participants tend to be younger and more technologically savvy than the general population. Participants who complete surveys receive micropayments ($1 or less) in the form of Google Play Store credit. Crowdsourcing tends to be cost-effective, facilitate easy recruitment, and allow for access to a geographically diverse sample. However, there may be bias in the results of studies using Amazon Mechanical Turk and Google Consumer Surveys related to varying access to the internet within a population so older adults, individuals with lower socioeconomic status, and others may be underrepresented (Bethlehem, 2010).
Crowdsourcing has been used to collect information on a range of physical health issues (Adler, Eames, Funk, & Edmunds, 2014; Alqahtani et al., 2014; Camacho, Eames, Adler, Funk, & Edmunds, 2013; Candido Dos Reis et al., 2015; Chunara, Chhaya et al., 2012; Harber & Leroy, 2015; Ilakkuvan et al., 2014; Kim, Lieberman, & Dench, 2015; Lwin et al., 2015; Mandl et al., 2014; Norr, Albanese, Oglesby, Allan, & Schmidt, 2015; Nyman & Biener, 2016; Paolotti et al., 2014; Smolinski et al., 2015; Zhang, Ho, Fang, Lu, & Ho, 2014). Crowd sourcing has also been used to study several health beahviors, including pedestrian behavior (Hipp, Adlakha, Eyler, Chang, & Pless, 2013); public awareness and knowledge about ovarian cancer (Carter, DiFeo, Bogie, Zhang, & Sun, 2014); and the cost of diverted prescription opioid analgesics (Dasgupta et al., 2013).
3.1.2. Online recruiting
Numerous studies have used websites and social media to recruit participants (Adler et al., 2014; Altshuler, Gerns Storey, & Prager, 2015; Barratt et al., 2015; Bauermeister et al., 2012; Ben-Ezra et al., 2013; Camacho et al., 2013; Chaulk & Jones, 2011; Dal Moro, 2013; Harris et al., 2014; Hernandez-Romieu et al., 2014; Janiec, Zielicka-Hardy, Polkowska, Rogalska, & Sadkowska-Todys, 2012; Jones, Saksvig, Grieser, & Young, 2012; Klein, Thomas, & Sutter, 2007; Moreno, Grant, Kacvinsky, Egan, & Fleming, 2012; Schumacher et al., 2014; Stein et al., 2014; Sueki, 2015; Thomas, Heysell, Houpt, Moore, & Keller, 2014; Turbow, Kent, & Jiang, 2008; van Genderen, Slobbe, Koene, Mastenbroek, & Overbosch, 2013; Zhang, Bi, Hiller, & Lv, 2008; Zheluk, Quinn, & Meylakhs, 2014). Online recruitment is a convenient method of reaching samples for rare outcomes (Schumacher et al., 2014) or hidden or difficult to reach populations (Barratt et al., 2015; Hernandez-Romieu et al., 2014). However, online recruitment may introduce bias in the sample due to disparities in technology use among minority race/ethnic groups, low socioeconomic status groups, and older adults (Bauermeister et al., 2012).
3.2. Passive data collection methods
Passive data collection methods are more similar to secondary data analysis methods than to traditional data collection. In these methods, data are created for purposes other than research. Through a variety of methods, researchers gather the existing data, manipulate it into analyzable form, and analyze it. As these data may include millions of records, novel analytic techniques and software programs, often known as big data analytics, have been developed to handle these large sets.
3.2.1. Internet search query
Internet search query analysis, specifically Google Search Trends, is one of the most common forms of online public health surveillance. Google Search Trends, a regularly updated database of aggregated search queries, provides the relative search volume of terms selected by the researcher. The relative search volume scale normalizes queries to a scale of 1–100 where 100 is the highest search proportion and 1 the lowest search proportion. In one of the earliest studies of internet search trends, Yahoo! and Google searches for cancer related terms in the US were significantly associated with estimated incidence and mortality rate of cancer (Cooper, Mallon, Leadbetter, Pollack, & Peipins, 2005). This study and another also found significant associations between cancer-related internet search and the volume of related news coverage, which may suggest at least some of the correlation is due to media coverage prompting online searches (Cooper et al., 2005; Fazeli Dehkordy, Carlos, Hall, & Dalton, 2014). For example, searches for multiple sclerosis in Italy are highest in the geographical areas with the highest rates of multiple sclerosis but may also be attributed to increased media reports in the region (Brigo, Tezzon, Lochner, & Nardone, 2014). A review from 2013 found internet search query surveillance often had comparable findings to traditional surveillance methods (Bernardo et al., 2013). However, false positive and false negative results were a common problem in many of the reviewed studies. The review authors concluded internet search query data should be used to support, rather than replace, traditional surveillance methods.
Internet search query analysis has been used to study a range of mental health issues and health behaviors, including correlations between mental health-related searches and times of economic stressors (Ayers et al., 2012); seasonality of depressive symptoms (Ayers, Althouse, Allem, Rosenquist, & Ford, 2013); suicide (Bruckner, McClure, & Kim, 2014; Page, Chang, & Gunnell, 2011); use of tobacco, e-cigarettes, and vaping (Ayers, Ribisl, & Brownstein, 2011, Ayers, Althouse, Ribisl, & Emery, 2014; Ayers et al., 2016; Cavazos-Rehg et al., 2015); vaccine use (Barak-Corren & Reis, 2015); provider prescribing behaviors (Simmering, Polgreen, & Polgreen, 2014); bath salts use (Yin & Ho, 2012); prenatal care (D’Ambrosio et al., 2015); and krokodil use (an extremely dangerous street drug) (Zheluk et al., 2014). Internet search query analysis has also been used to predict or estimate many physical health conditions (Althouse, Yih Yng, & Cummings, 2011; Carneiro & Mylonakis, 2009; Chan, Sahai, Conrad, & Brownstein, 2011; Cho et al., 2013; Cook, Conrad, Fowlkes, & Mohebbi, 2011; Cooper et al., 2005; Desai et al., 2012; Dugas et al., 2012, Dugas et al., 2013; Fazeli Dehkordy et al., 2014; Gluskin, Johansson, Santillana, & Brownstein, 2014; Martin, Xu, & Yasui, 2014; Min, Haojie, Jianfeng, Rutherford, & Fen, 2013; Ocampo, Chunara, & Brownstein, 2013; Ortiz et al., 2011; Patwardhan, Bilkovski, & Goldstein, 2012; Samaras, García-Barriocanal, & Sicilia, 2012; Timpka et al., 2014; Wilson & Brownstein, 2009; Zheluk, Quinn, Hercz, & Gillespie, 2013; Zhou et al., 2013, Zhou, Ye, & Feng, 2011).
Wikipedia, an online encyclopedia where the online community creates, edits, and modifies articles, has also been used for a modified internet search query analysis. Across several influenza seasons, the number of page views associated with influenza was significantly associated with CDC influenza diagnosis reports (McIver & Brownstein, 2014).
Despite the large number of studies supporting the use of internet search trends to predict infectious disease, search term algorithms may not perform well in the long-term. Google Flu Trend failed to predict the A/H1N1 pandemic in 2009 and greatly overestimated the A/H3N2 epidemic in 2012/2013, which may suggest changes in internet search behavior, geographical heterogeneity, and differences in age-distribution of the epidemic significantly influence the predictive power of the algorithms (Olson et al., 2013).
3.2.2. Media reports
Online media reports may also be used for public health surveillance. Individual researchers may monitor online reports or researchers may use databases that are automatically created or curated by other researchers. Examples of automated databases include HealthMap (Barboza et al., 2014; Brownstein et al., 2010; Chanlekha & Collier, 2010; Collier, 2010, 2012; Freifeld, Mandl, Reis, & Brownstein, 2008; Lyon, Nunn, Grossel, & Burgman, 2012); GENI-DB (Collier & Doan, 2012); Project Argus (Nelson, Li, Reilly, Hardin, & Hartley, 2012; Torii et al., 2011); ProMed-mail (Zhang, Dang, Chen, Thurmond, & Larson, 2009); MiTAP (Zhang et al., 2009); and BioCaster (Lyon et al., 2012).
In addition to existing databases, researchers may use text mining (Collier, 2011) or human analysts to identify media reports (Collier, 2011; Nerlich & Koteyko, 2012). Text mining of media reports may reduce the resources required for identification of articles but may not perform as well as human analysts (Collier, 2011). Human analysts have also been used to identify newspaper and website articles associated with drowning or near-drowning (Ferretti, De Angelis, Donati, & Torre, 2014; Zhu, Jiang, Li, Li, & Chen, 2015) and sudden cardiac death in athletes (Choi, Pan, Pock, & Chang, 2013).
3.2.3. Other passive data collection methods
Several other possible passive data collection methods have been examined in the literature, including internet death notices as a source of mortality surveillance data (Boak, M’Ikanatha, Day, & Harrison, 2008), forum postings (Kate, Negi, & Kalagnanam, 2014; Weitzman, Adida, Kelemen, & Mandl, 2011) and restaurant reviews and reservations (Harrison et al., 2014; Nsoesie, Kluberg, & Brownstein, 2014; Nsoesie, Buckeridge, & Brownstein, 2014)
3.3. Active or passive data collection methods
Several data collection methods may be used for active, passive, or combined types of data collection.
3.3.1. Twitter
Twitter is a microblogging site where users post messages (tweets) that are 140 characters or less. Users may “follow” other users to see their posts on the front page. Users may also respond to tweets posted by other users, share (retweet) messages posted by other users, or approve (like) other posts. Users may use hashtags to categorize their messages. When a large number of users are posting with a hashtag, the hashtag is listed on the Twitter front page and is said to be “trending.”
There are multiple methods of conducting research with Twitter, including both active and passive data collection methods. As a passive data collection method, researchers may download existing information from Twitter. Alternatively, researchers may use Twitter as a platform for reaching participants. Regardless of the collection method, there are several ways Twitter data may be used for research and surveillance. The content of individual tweets may be examined to determine how people are discussing topics and changes in trending hashtags may be examined to determine how discussions around topics change over time. Social network analysis, examination of the relationships between users, may also be conducted to determine how information moves through networks. These analytic methods can be implemented by automated algorithms (Cao et al., 2015; Denecke et al., 2013; Odlum & Yoon, 2015; Paul & Dredze, 2014; Prieto, Matos, Alvarez, Cacheda, & Oliveira, 2014; Yom-Tov, Borsa, Cox, & McKendry, 2014) or by human analysts.
These research methods are complicated by the microblogging (140-character limit) aspect of Twitter because the syntax and spelling are often altered to fit within the limit. Since these changes to language vary across users, it may be difficult for researchers to accurately categorize or recognize health information. However, Twitter recently doubled the character limit in many languages so issues with syntax and spelling may also change (Castillo, 2017). Twitter data may also be difficult to work with because they are unstructured and created at a very rapid rate. To address some of these issues, MappyHealth was created to simplify data management and analysis (Boicey, 2013). At the time of writing, it appears MappyHealth has been discontinued as the website and Twitter account are no longer active.
Twitter has been used to examine a range of health behaviors, including e-cigarettes and tobacco use (Aphinyanaphongs, Lulejian, Brown, Bonneau, & Krebs, 2016; Jo, Kornfield, Kim, Emery, & Ribisl, 2015; Myslín, Zhu, Chapman, & Conway, 2013; Sofean & Smith, 2013; Step, Bracken, Trapl, & Flocke, 2016); drug use and abuse (Cavazos-Rehg, Krauss, Grucza, & Bierut, 2014; Daniulaityte et al., 2015; Hanson et al., 2013; Katsuki, Mackey, & Cuomo, 2015); suicide (O’Dea et al., 2015); and HPV vaccination (Zhou et al., 2015). It has also been used to study a range of physical health outcomes (Aslam et al., 2014; Bosley et al., 2013; Broniatowski, Paul, & Dredze, 2013; Chew & Eysenbach, 2010; Chorianopoulos & Talvis, 2015; Collier, Son, & Nguyen, 2011; Fung et al., 2013; Gesualdo et al., 2013; Heaivilin, Gerbert, Page, & Gibbs, 2011; Jain & Kumar, 2015; Nagel et al., 2013; Signorini, Segre, & Polgreen, 2011; Velardi, Stilo, Tozzi, & Gesualdo, 2014).
It was rare in these studies to compare Twitter data to other sources of surveillance data so the validity of inferences based on Twitter data was not clear. However, three studies found the characteristics or number of tweets on a specific subject were associated with at least one validated measure of the subject (Ireland, Schwartz, Chen, Ungar, & Albarracin, 2015; Jashinsky et al., 2014; Widener & Li, 2014).
3.3.2. Facebook
Facebook is an online social networking site where users create a profile, add other users to their network, send messages to their network connections, and post messages to their profiles. Users may also join common-interest groups and communicate with businesses. Similar to Twitter, Facebook may be used for active or passive data collection. It has frequently been used to recruit participants (Altshuler et al., 2015; Barratt et al., 2015; Bauermeister et al., 2012; Ben-Ezra et al., 2013; Hernandez-Romieu et al., 2014; Schumacher et al., 2014; Stein et al., 2014; Thomas et al., 2014; van Genderen et al., 2013), but the information created by users has also been used for research.
Facebook users have the option of listing interests, such as movies, books, sports teams, or activities, on their profile. In one study, obesity prevalence in communities was predicted using Facebook interests (Chunara, Bouton, Ayers, & Brownstein, 2013). Geographical areas where a higher proportion of users endorsed activity-related interests, such as health and wellness or outdoor fitness activities, and a lower proportion of users endorsed interests in sedentary behaviors, particularly television watching, tended to have lower rates of obesity. Facebook “likes”, users’ expressions of interest or approval of posts, may also be used to predict health behaviors. The proportion of users by zip code who “like” certain categories of information is available through the advertising program interface. These data were significantly associated with life expectancy and many health conditions reported in the Behavioral Risk Factor Surveillance System (Gittelman et al., 2015).
The content of Facebook groups may also be used to assess individual health behavior. Posts, comments, and photos in Facebook profiles and groups have been used to assess social support seeking among caregivers of children with autism spectrum disorder (Mohd Roffeei, Abdullah, & Basar, 2015), depressive symptoms (Moreno et al., 2011), alcohol use (Ridout, Campbell, & Ellis, 2012) and. One study of nine public antifluoridation groups examined the connectedness between these groups and the extent to which individuals in these groups shared or endorsed posts (Seymour, Getman, Saraf, Zhang, & Kalenderian, 2015).
3.3.3. Combined approaches
Some research suggests combining multiple approaches may reduce the limitations associated with each of the single approaches. For example, media reports of outbreaks or unusual events may drive increases in social media activity as awareness increases in the population so studies may combine the two approaches to evaluate the potential effects of traditional media (Chunara, Andrews, & Brownstein, 2012). One evaluation found that models predicting influenza rates from internet-based surveillance were most accurate when they accounted for newspaper and television reports (de Lange et al., 2013). Another evaluation found the number of social media messages was more strongly correlated with the number of online news articles than the number of reported measles cases, which supports social media as a measure of public opinion, rather than disease detection (Mollema et al., 2015). The limitations associated with social media and internet-based approaches were also demonstrated during the Ebola outbreak in the US. Social media posts and internet searches increased due to the public panic surrounding the outbreak, rather than due to a high incidence of the disease (Towers et al., 2015).
Despite these limitations, social media may provide important context not available in traditional forms of surveillance and combined approaches may reduce some of the limitations associated with each approach (Powell et al., 2016). Models including Twitter data, Google search trends, and environmental sensors were able to accurately predict, in nearly real-time, asthma-related emergency department visits in the US with 70% accuracy (Ram, Zhang, Williams, & Pengetnze, 2015). Another study found models based on Twitter data, Google search trends, and a crowdsourced survey were able to create robust weekly influenza predictions (Santillana et al., 2015). A third study found the combination of Twitter and internet search data was able to estimate the influenza rate with a correlation of 0.72 to officially reported influenza diagnoses (Santos & Matos, 2014).
3.4. Approaches used for child maltreatment
There has been limited application of social media and internet-based approaches to child maltreatment surveillance (Table 2 ). The most common use found in the literature was recruiting participants or engaging existing participants through a variety of online methods. One study recruited participants through listservs, websites, groups, organizations, and clubs targeting lesbian, gay, and bisexual populations to retrospectively assess their exposure to child maltreatment (Balsam, Lehavot, Beadnell, & Circo, 2010). Another study tracked existing participants in a study of child maltreatment through social media (Nwadiuki, Isbell, Zoloto, & Kotch, 2011). Other studies have recruited adults to report their experiences or their children’s experience of childhood abuse (Brian, Schier, Schulz, Dragan, & Hardt, 2014; Caldas & Bensy, 2014; Parkinson & Bromfield, 2013; Schaefer, Mundt, Ahlers, & Bahls, 2012). A final study surveyed professionals at child protection agencies to establish the rates of reported sexual maltreatment (Maier, Mohler-Kuo, Landolt, Schnyder, & Jud, 2013).
Table 2.
Author | Year | Population | Research Purpose | Recruitment Method/Study Design |
---|---|---|---|---|
Online recruitment | ||||
Balsam, Lehavot, Beadnell, Circo | 2010 | LGB Adults | Examine relationships between child abuse and adult mental health |
|
Parkinson, Bromfield | 2013 | Young Adults | Determine if Facebook is viable for recruiting for studies on child maltreatment |
|
Schaefer, Mundt, Ahlers, Bahls | 2012 | Not restricted | Examine psychosocial impairment associated with sexual abuse |
|
Brian, Schier, Schulz, Dragan, Hardt | 2012 | Not restricted | Estimate the prevalence of childhood abuse and neglect in Germany and Poland |
|
Caldas, Bensy | 2014 | Child with disability or caregiver of child with disability | Determine risk factors and consequences of sexual maltreatment of children with disabilities |
|
Maier, Mohler-Kuo, Landholt, Schnyder, Jud | 2013 | Child sexual abuse agencies in Switzerland | Estimate the prevalence of child sexual abuse reported to agencies |
|
Nwadiuko, Isbell, Zolotor, Hussey, Kotch | 2010 | Existing cohort study participants | Evaluate Facebook and Myspace as supplementary methods of subject follow-up |
|
Electronic News Media | ||||
Lonne, Gillespie | 2014 | Media reports of child abuse | Compare media reports of child maltreatment to official reports |
|
Walklate, Petrie | 2013 | Media reports of filicide-suicide | Explore the nature of reporting on filicide-suicide in Britain and Ireland |
|
Nambu, Nasu, Nishimura, Nishimura, Fujiwara | 2011 | Media reports of fatal child abuse cases | Determine if fatal child abuse perpetrators are more harshly punished than other homicide perpetrators |
|
Caregiver Blogs | ||||
Brown, Gonzalez, Wiester, Kelley, Feldman | 2014 | Perpetrators of medical abuse | Evaluate caregiver blogs as a source of information about caregiver-fabricated illness |
|
Social Networks | ||||
Noll, Shenk, Barnes, Haralson | 2013 | Adolescent females | Determine differences in online sexual behaviors between adolescent females with and without maltreatment |
|
Media reports have also been used to research aspects of child maltreatment, but similar to other health topics, there may be some bias in media reports. Researchers have found that media reports tend to disproportionately focus on physical and sexual abuse with limited reporting on emotional abuse and neglect (Lonne & Gillespie, 2014) and often present a simplified version of the events (Walklate & Petrie, 2013). Another study used media reports to examine perpetrator, victim, and context variations in sentences for fatal child abuse (Nambu, Nasu, Nishimura, Nishimura, & Fujiwara, 2011).
There have been two other novel examples of social media and internet-based assessment of child maltreatment characteristics. One novel assessment of child maltreatment was an evaluation of caregiver blogs in caregiver-fabricated child illness (Brown, Gonzalez, Wiester, Kelley, & Feldman, 2014). Researchers found that blogs created by these caregivers tended to distort and exaggerate the medical information shared by the doctors. There were also visually graphic images of the children and frequent discussions of fundraising and charity. Although the study was limited in size, the findings suggested physicians and child protective service providers may be able to evaluate caregiver blogs for these patterns. Another study examined the profiles of youth with and without substantiated maltreatment reports to determine if there were differences in risky online behaviors and found maltreated youth tended to engage in more provocative self-presentation (Noll, Shenk, Barnes, & Haralson, 2013).
In sum, online recruitment or follow-up of participants was the most common technology-based approached to child maltreatment research. Six recent studies have used online methods to recruit participants to self-report past childhood maltreatment experiences or the more recent experiences of their children or of children with whom they have had professional contact. Child maltreatment-related internet media reports have also been examined, but there were clear biases in reporting that suggest the use of media for surveillance would be problematic. Two innovative studies about child maltreatment using social media addressed very narrow questions about the risk behaviors of a subset of children who have been maltreated and about detecting risk for child maltreatment by examining the social media of caregivers of seriously ill children. At the time of writing, there was very little peer-reviewed published work related to social media and other internet-based approaches in the study of child maltreatment.
4. Implications for child maltreatment research
From the broad technology and health literature, social media and internet-based approaches to surveillance and epidemiologic research appear promising. Several strengths were identified in the reviewed literature. First, many of the approaches are relatively low cost and easy to implement without extensive infrastructure. This is particularly true for well-established social media environments, such as Twitter, where there are existing tools for accessing and analyzing data. Second, social media may present an opportunity to reach communities or populations that would be otherwise difficult to reach through traditional approaches. Many researchers promote this claim in their work, and a small number of researchers across disciplines have conducted parallel studies using traditionally-created and online samples to compare the findings (Rindfuss, Choe, Tsuya, Bumpass, & Tamaki, 2015; Simon Rosser, Oakes, Bockting, & Miner, 2007; Temple & Brown, 2011). Although all authors agree there are some differences in the findings depending on the recruitment methods, there is disagreement about which approach best represents the underlying population. Finally, many of the technology-based approaches allow for continuous data collection in real-time or nearly real-time, which may facilitate the identification of trends or evaluation of national or community interventions.
A range of limitations for each method were also identified in the literature. Across methods, there was a mixed record of validation and sources of error in estimation were not yet understood or predictable. Studies of internet search query trends suggested that methods operated well for a time but often failed extended tests of validation. Crowdsourcing methods, which may be another source of continuous data, appeared to suffer from substantial attrition of users over time. Media reporting seemed to incur observer effects that may have created short term issues with estimates. Media reports also caused issues for other types of online surveillance because increased public awareness may contribute to inflated estimates. Other concerns included changes over time in the technology or the way the technology is used. Although not explicitly raised in the literature captured in this review, misrepresentation on social media or other internet-based methods may also result in issues with the data (Whitehead, 2007).
Overall, validation of social media and internet-based methods is a challenge across all methods. To some extent, these issues may be of little concern if social media methods are combined and correlated with other established methods. That is, so long as these new methods are part of a triangulation approach, rather than replacing existing approaches, they may have much to offer.
The use of social media methods for child maltreatment surveillance and research is promising, but there has been limited implementation, relative to other health outcomes. Based on the methods, strengths, and limitations identified in the reviewed literature, we propose several considerations for future research focused on child maltreatment. First, the strengths of social media and internet-based technologies may be leveraged to improve child maltreatment surveillance. The capacity to introduce these techniques anonymously into a range of social and professional environments (schools, community agencies, etc.) makes them potentially ideal for studying populations that are difficult to reach through traditional methods. Further, the ability to have access to these populations on a continuous basis creates the opportunity for long term monitoring, which may facilitate the identification of trends or evaluation of national or community interventions.
Validation of the epidemiological use of child maltreatment data collected via social media or other internet-related technologies poses challenges. In addition to the problems relevant to the application of these approaches to other health outcomes, child maltreatment researchers face additional challenges. Unlike many other health issues addressed in this review, complete data about child maltreatment are rarely available. For example, influenza researchers in the United States can validate their technology-based research through FluView, a weekly influenza surveillance report prepared by the Centers for Disease Control and Prevention (2017). FluView provides weekly information on influenza virus type reported by public health laboratories, mortality information, proportion of outpatient visits for influenza-like illness, and information about the geographic spread of influenza (Centers for Disease Control & Prevention, 2017). This detailed, timely information allows for reliable assessment of the underlying influenza trends and gold standard data for validity assessment. In contrast, it is well known that child maltreatment reported to authorities is not indicative of the true prevalence and other sources of data using traditional methods are rarely repeated with sufficient frequency. Further, the use of official statistics based on reported maltreatment and other existing maltreatment data to evaluate the accuracy of estimates drawn from social media is not straightforward. On the other hand, the ability to create consistently available, timely information about incidence may be the key promise of social media and internet-based methodologies, assuming issues of validity can be addressed.
Another critical consideration is the ethical issues of child maltreatment research, which are further complicated by the ethical challenges associated with social media and internet-based research. The Association of Internet Researchers suggests researchers engaging in internet-based research consider several ethical questions before beginning a study (Buchanan, 2004).
-
•
How are the researchers accessing the participant/data and what expectations are established by the method (e.g., social media site, blog, forum)?
-
•
Who is creating the data and what vulnerabilities may exist that create an obligation for the researcher to protect the data?
-
•
Should the researcher obtain informed consent and how should it be collected?
-
•
How will the data be used and could these uses create new or additional risks for participants?
In addition to these basic guidelines, a recent update to the recommendations from the Association of Internet Researchers suggests researchers consider several additional questions (Markham & Buchanan, 2012).
-
•
What is the primary purpose of the study?
-
•
How are data managed, stored, and analyzed during the study?
-
•
How are findings presented?
-
•
Who might be harmed or benefit from this study?
In reviewing and considering these questions, the Association of Internet Researchers suggest researchers broadly consider several ethical considerations that are important in all research but may be particularly challenging in technology-based studies (Markham & Buchanan, 2012). The first challenge surrounds the definition of human subjects. Regulatory bodies have often used interaction with human subjects as an indicator of need for institutional ethical review (Markham & Buchanan, 2012). Since many technology-based studies, particularly passive data collection studies, do not directly engage with human subjects, these studies have been carried out without ethical review. It may be prudent, however, to engage with the institutional review board, an ethical regulatory body, or an external advisory committee to critically process the potential harms, vulnerabilities, benefits, and so forth, even if the research does not directly engage with human subjects and thus, does not explicitly require intuitional ethics review. In addition, it may be necessary to reevaluate what constitutes engaging with a human subject (Markham & Buchanan, 2012). Direct connection with individual-level data has historically been considered engagement with a human subject, while studies with aggregated or deidentified data were not. However, recent research suggests deidentified datasets often contain sufficient personal information to potentially identify individuals (Markham & Buchanan, 2012). As a result, it may be necessary to develop an ethical review process, with or without institutional oversight, for research that involves person-based data without direct human contact. These ethical review processes should focus on reducing potential harms and vulnerabilities while balancing the benefits of the research.
The second challenge relates to definitions of public and private space (Markham & Buchanan, 2012). These expectations are often ambiguous and frequently change. As such, it is important to critically examine the potential harms and vulnerabilities associated with the context and data used in each study. Researchers must carefully consider the expectations of the individuals who are creating the data. In active data collection methods, the researcher has contact with the participants and may follow the standard informed consent process so individuals expect their data are being used for research. However, in passive data collection methods, the individual may have no knowledge that their data are being used for research. The researcher must consider if the individuals likely considered their data to be public or private. The creator of a public blog or social media profile which is viewable by anyone may have a lower expectation of privacy than in a private forum that requires log-in by members. Researchers must also consider the level of risk to participants and the potential benefits of the research to participants and other individuals. As child maltreatment is a particularly sensitive topic, it is likely that many participants would be embarrassed, hurt, or angry if their expectation of privacy did not match with that of the researcher. In addition, if the researcher has access to identifiable information and learns of child maltreatment, there may be an institutional requirement to report to child protection authorities, which has the potential to impact data collection. The researcher should also consider the expectations around research within the participants’ culture. Although it is now relatively simple to conduct online research in communities across the world, it is necessary to understand the cultural norms around research and privacy within the participants’ culture, as they may be different from those of the researcher. In some instances, communities have come together to define how non-community members should engage with them around research. In Canada, a First Nations Steering Committee representing diverse communities participating in a longitudinal health survey developed the OCAP principles (Ownership, Control, Access, Possession). OCAP is “a set of standards that establish how First Nations data should be collected, protected, used, or shared” (First Nations Information Governance Centre, 2017). Even when this type of guidance is available, it may be challenging for researchers from outside the community to fully understand the cultural expectations. When this type of explicit guidance is not available, it may be even more challenging for researchers to understand cultural norms so careful attention must be given to understanding and following community expectations.
The final ethical challenge relates to how the field will chose to make ethical decisions around social media and internet-based technology research (Markham & Buchanan, 2012). In some aspects of research, there are tensions between regulation-driven and context-specific ethical decision making. Regulations are often intended to encourage ethical research and practice, but when applied universally without consideration, regulations may inadvertently restrict important, necessary research. In child maltreatment research, ethics regulations are rarely based on empirically derived information regarding the degree to which ethical concerns emerge (International Society for the Prevention of Child Abuse & Neglect, 2015). As technology-based research moves forward, it will be important to establish firm ethical boundaries for some clearly defined issues, while encouraging flexibility and situation-based ethical decision-making for ethically grey areas.
Despite these ethical challenges, the complexity of research in child maltreatment necessitates the development and validation of novel data collection approaches. Although social media and internet-based data collection should not, due to the current limitations, replace other traditional forms of data collection, it is possible that these methods may complement existing methodologies to address the current limitations for the field. For example, analysis of child maltreatment-related internet search queries that account for media recognition may be a novel way to collect in-the-moment trends that could be used to inform tailoring and targeting of just-in-time interventions. However, these approaches should be carefully validated prior to wide scale implementation and continuously monitored for reliability and validity. Although it would be difficult to validate these approaches for child maltreatment on a large-scale due to existing data limitations, it may be possible to begin to validate in specific subpopulations. Official child protection data from a school or other geographically confined area could be paired with self-reported surveys and analysis of youth Facebook or Twitter postings during a specific time. Using this approach would reduce the limitations associated with each type of collection and could create a better source of validation data. Replicating this type of validation in other subpopulations could provide the research support for an eventual wide scale implementation based on small-area data compilation.
4.1. Limitations
This review had several limitations. First, the review excluded articles that were not published in English so important work conducted in other languages would not be included in this review. This limitation is common among reviews conducted by researchers from majority native English-speaking countries; yet, future reviews may benefit from including other languages. Second, it was possible to define social media, internet-based technology, and surveillance in various ways. Differing definitions may have resulted in a different literature base to review. Finally, the search framework resulted in the inclusion of a variety of research designs, health outcomes, and technology approaches. This variety prevented quantitative comparisons across studies. However, as previously noted, that type of analysis is outside the scoping review framework, which focused on the extent, range, and nature of research with respect to a focused topic, as well as the identification of gaps in the literature. As also noted, scoping reviews are ideal for topics with emerging evidence, such as social media.
5. Conclusions
Social media and internet-based technologies may be a promising approach to address the existing issues with child maltreatment data collection. However, it is necessary to account for the issues within each type of data collection approach and carefully validate the approach. In addition, researchers should thoughtfully consider the ethical issues associated with both child maltreatment research and internet-based research and take steps to protect participants before conducting future studies.
Footnotes
This work was supported by the Public Health Agency of Canada.
References
- Adler A.J., Eames K.T., Funk S., Edmunds W.J. Incidence and risk factors for influenza-like-illness in the UK: Online surveillance using flusurvey. BMC Infectious Disease. 2014;14:232. doi: 10.1186/1471-2334-14-232. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Afifi T.O., MacMillan H.L., Taillieu T., Cheung K., Turner S., Tonmyr L.…Hovdestad W. Relationship between child abuse exposure and reported contact with child protection organizations: Results from the Canadian community health survey. Child Abuse & Neglect. 2015;46:198–206. doi: 10.1016/j.chiabu.2015.05.001. [DOI] [PubMed] [Google Scholar]
- Alqahtani A.S., BinDhim N.F., Tashani M., Willaby H.W., Wiley K.E., Heywood A.E., Rashid H. Pilot use of a novel smartphone application to track traveller health behaviour and collect infectious disease data during a mass gathering: Hajj pilgrimage. Journal of Epidemiology and Global Health. 2014;6(3):147–155. doi: 10.1016/j.jegh.2015.07.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Althouse B.M., Yih Yng N., Cummings D.A.T. Prediction of dengue incidence using search query surveillance. PLoS Neglected Tropical Diseases. 2011;5(8):1–7. doi: 10.1371/journal.pntd.0001258. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Altshuler A.L., Gerns Storey H.L., Prager S.W. Exploring abortion attitudes of US adolescents and young adults using social media. Contraception. 2015;91(3):226–233. doi: 10.1016/j.contraception.2014.11.009. [DOI] [PubMed] [Google Scholar]
- Aphinyanaphongs Y., Lulejian A., Brown D.P., Bonneau R., Krebs P. Text classification for automatic detection of e-cigarette use and use for smoking cessation from twitter: A feasibility pilot. Pacific Symposium on Biocomputing. 2016;21:480–491. [PMC free article] [PubMed] [Google Scholar]
- Aslam A.A., Tsou M.H., Spitzberg B.H., An L., Gawron J.M., Gupta D.K., Lindsay S. The reliability of tweets as a supplementary method of seasonal influenza surveillance. Journal of Medical Internet Research. 2014;16(11) doi: 10.2196/jmir.3532. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ayers J.W., Althouse B.M., Allem J.-P., Childers M.A., Zafar W., Latkin C., Brownstein J.S. Novel surveillance of psychological distress during the great recession. Journal of Affective Disorders. 2012;142(1):323–330. doi: 10.1016/j.jad.2012.05.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ayers J.W., Althouse B.M., Allem J.-P., Leas E.C., Dredze M., Williams R.S. Revisiting the rise of electronic nicotine delivery systems using search query surveillance. American Journal of Preventive Medicine. 2016;50(6):e173–e181. doi: 10.1016/j.amepre.2015.12.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ayers J.W., Althouse B.M., Allem J.-P., Rosenquist J.N., Ford D.E. Seasonality in seeking mental health information on google. American Journal of Preventive Medicine. 2013;44(5):520–525. doi: 10.1016/j.amepre.2013.01.012. [DOI] [PubMed] [Google Scholar]
- Ayers J.W., Althouse B.M., Ribisl K.M., Emery S. Digital detection for tobacco control: Online reactions to the 2009 U.S. cigarette excise tax increase. Nicotine & Tobacco Research. 2014;16(5):576–583. doi: 10.1093/ntr/ntt186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ayers J.W., Ribisl K.M., Brownstein J.S. Tracking the rise in popularity of electronic nicotine delivery systems (electronic cigarettes) using search query surveillance. American Journal of Preventive Medicine. 2011;40(4):448–453. doi: 10.1016/j.amepre.2010.12.007. [DOI] [PubMed] [Google Scholar]
- Balsam K.F., Lehavot K., Beadnell B., Circo E. Childhood abuse and mental health indicators among ethnically diverse lesbian, gay, and bisexual adults. Journal of Counseling and Clinical Psychology. 2010;78(4):459–468. doi: 10.1037/a0018661. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barak-Corren Y., Reis B.Y. Internet activity as a proxy for vaccination compliance. Vaccine. 2015;33(21):2395–2398. doi: 10.1016/j.vaccine.2015.03.100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barboza P., Vaillant L., Le Strat Y., Hartley D.M., Nelson N.P., Mawudeku A., Astagneau P. Factors influencing performance of internet-based biosurveillance systems used in epidemic intelligence for early detection of infectious diseases outbreaks. PLoS One. 2014;9(3):1–9. doi: 10.1371/journal.pone.0090536. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barratt M.J., Potter G.R., Wouters M., Wilkins C., Werse B., Perala J., Blok T. Lessons from conducting trans-national internet-mediated participatory research with hidden populations of cannabis cultivators. International Journal of Drug Policy. 2015;26(3):238–249. doi: 10.1016/j.drugpo.2014.12.004. [DOI] [PubMed] [Google Scholar]
- Bauermeister J.A., Zimmerman M.A., Johns M.M., Glowacki P., Stoddard S., Volz E. Innovative recruitment using online networks: Lessons learned from an online study of alcohol and other drug use utilizing a web-based, respondent-driven sampling (webRDS) strategy. Journal of Studies on Alcohol and Drugs. 2012;73(5):834–838. doi: 10.15288/jsad.2012.73.834. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ben-Ezra M., Palgi Y., Aviel O., Dubiner Y., Evelyn B., Soffer Y.…Shrira A. Face it: Collecting mental health and disaster related data using facebook vs. personal interview: The case of the 2011 Fukushima nuclear disaster. Psychiatry Research. 2013;208(1):91–93. doi: 10.1016/j.psychres.2012.11.006. [DOI] [PubMed] [Google Scholar]
- Bernardo T.M., Rajic A., Young I., Robiadek K., Pham M.T., Funk J.A. Scoping review on search queries and social media for disease surveillance: A chronology of innovation. Journal of Medical Internet Research. 2013;15(7):181–193. doi: 10.2196/jmir.2740. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bethlehem J. Selection bias in web surveys. International Statistical Review. 2010;78(2):161–188. [Google Scholar]
- Boak M.B., M’Ikanatha N.M., Day R.S., Harrison L.H. Internet death notices as a novel source of mortality surveillance data. American Journal of Epidemiology. 2008;167(5):532–539. doi: 10.1093/aje/kwm331. [DOI] [PubMed] [Google Scholar]
- Boicey C. Innovations in social media: The MappyHealth experience. Nursing Management. 2013;44(3):10–11. doi: 10.1097/01.NUMA.0000427191.36468.65. [DOI] [PubMed] [Google Scholar]
- Bosley J.C., Zhao N.W., Hill S., Shofer F.S., Asch D.A., Becker L.B.…Merchant R.M. Decoding twitter: Surveillance and trends for cardiac arrest and resuscitation communication. Resuscitation. 2013;84(2):206–212. doi: 10.1016/j.resuscitation.2012.10.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brian T., Schier K., Schulz S., Dragan M., Hardt J. Childhood neglect: Exploring a short questionnaire in Poland and Germany. Psychopathology. 2014;47(1):17–23. doi: 10.1159/000348483. [DOI] [PubMed] [Google Scholar]
- Bright J., Margetts H., Hale S., Yasseri T. 2014. The use of social media for research and analysis: A feasibility study. Retrieved from https://www.gov.uk/government/publications/use-of-social-media-for-research-and-analysis. [Google Scholar]
- Brigo F., Tezzon F., Lochner P., Nardone R. “Magic google in my hand, who is the sickest in my land?” infodemiology and epidemiology of multiple sclerosis and lyme disease in Italy. The Canadian Journal of Neurological Sciences. 2014;41(4):542–543. doi: 10.1017/s0317167100018692. [DOI] [PubMed] [Google Scholar]
- Broniatowski D.A., Paul M.J., Dredze M. National and local influenza surveillance through twitter: An analysis of the 2012–2013 influenza epidemic. PLoS One. 2013;8(12):e83672. doi: 10.1371/journal.pone.0083672. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown A.N., Gonzalez G.R., Wiester R.T., Kelley M.C., Feldman K.W. Caretaker blogs in caregiver fabricated illness in a child: A window on the caretaker’s thinking? Child Abuse & Neglect. 2014;38(3):488–497. doi: 10.1016/j.chiabu.2013.12.002. [DOI] [PubMed] [Google Scholar]
- Brownstein J.S., Freifeld C.C., Chan E.H., Keller M., Sonricker A.L., Mekaru S.R.…Buckeridge D.L. Information technology and global surveillance of cases of 2009 H1N1 influenza. New England Journal of Medicine. 2010;362(18):1731–1735. doi: 10.1056/NEJMsr1002707. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bruckner T.A., McClure C., Kim Y. Google searches for suicide and risk of suicide. Psychiatric Services. 2014;65(2):271–272. doi: 10.1176/appi.ps.201300211. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buchanan E.A. 2004. Readings in virtual research ethics: Issues and controversies: IGI global. Retrieved from https://www.igi-global.com/book/readings-virtual-research-ethics/858. [Google Scholar]
- Bunting L., Lazenbatt A., Wallace I. Information sharing and reporting systems in the UK and Ireland: Professional barriers to reporting child maltreatment concerns. Child Abuse Review. 2010;19(3):187–202. [Google Scholar]
- Caldas S.J., Bensy M.L. The sexual maltreatment of students with disabilities in American school settings. Journal of Child Sexual Abuse. 2014;23(4):345–366. doi: 10.1080/10538712.2014.906530. [DOI] [PubMed] [Google Scholar]
- Camacho A., Eames K., Adler A., Funk S., Edmunds J. Estimation of the quality of life effect of seasonal influenza infection in the UK with the internet-based flusurvey cohort: An observational cohort study. The Lancet. 2013;382(Supplement 3):S8. [Google Scholar]
- Candido Dos Reis F.J., Lynn S., Ali H.R., Eccles D., Hanby A., Provenzano E., Pharoah P.D. Crowdsourcing the general public for large scale molecular pathology studies in cancer. EBioMedicine. 2015;2(7):681–689. doi: 10.1016/j.ebiom.2015.05.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cao G., Wang S., Hwang M., Padmanabhan A., Zhang Z., Soltani K. A scalable framework for spatiotemporal analysis of location-based social media data. Computers, Environment and Urban Systems. 2015;51:70–82. [Google Scholar]
- Carneiro H.A., Mylonakis E. Google trends: A web-based tool for real-time surveillance of disease outbreaks. Clinical Infectious Diseases. 2009;49(10):1557–1564. doi: 10.1086/630200. [DOI] [PubMed] [Google Scholar]
- Carter R.R., DiFeo A., Bogie K., Zhang G.Q., Sun J. Crowdsourcing awareness: Exploration of the ovarian cancer knowledge gap through amazon mechanical Turk. PLoS One. 2014;9(1):e85508. doi: 10.1371/journal.pone.0085508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Castillo M. 2017. Twitter expands tweets to 280 characters in most languages. Retrieved from https://www.cnbc.com/2017/11/07/twitter-expands-280-character-limit-to-most-languages.html. [Google Scholar]
- Cavazos-Rehg P., Krauss M., Grucza R., Bierut L. Characterizing the followers and tweets of a marijuana-focused twitter handle. Journal of Medical Internet Research. 2014;16(6):e157. doi: 10.2196/jmir.3247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cavazos-Rehg P.A., Krauss M.J., Spitznage E.L., Lowery A., Grucza R.A., Chaloupka F.J.…Bierut L.J. Monitoring of non-cigarette tobacco use using google trends. Tobacco Control. 2015;24(3):249–255. doi: 10.1136/tobaccocontrol-2013-051276. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Centers for Disease Control and Prevention . 2017. FluView: A weekly influenza surevillance report prepared by the influenza division. Retrieved from https://www.cdc.gov/flu/weekly/ [Google Scholar]
- Chan E.H., Sahai V., Conrad C., Brownstein J.S. Using web search query data to monitor dengue epidemics: A new model for neglected tropical disease surveillance. PLoS Neglected Tropical Diseases. 2011;5(5):1–6. doi: 10.1371/journal.pntd.0001206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chanlekha H., Collier N. A methodology to enhance spatial understanding of disease outbreak events reported in news articles. International Journal of Medical Informatics. 2010;79(4):284–296. doi: 10.1016/j.ijmedinf.2010.01.014. [DOI] [PubMed] [Google Scholar]
- Chaulk K., Jones T. Online obsessive relational intrusion: Further concerns about facebook. Journal of Family Violence. 2011;26(4):245–254. [Google Scholar]
- Chew C., Eysenbach G. Pandemics in the age of twitter: Content analysis of tweets during the 2009 H1N1 outbreak. PLoS One. 2010;5(11):e14118. doi: 10.1371/journal.pone.0014118. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Child Welfare Information Gateway . 2016. Definitions of child abuse and neglect. Retrieved from https://www.childwelfare.gov/pubPDFs/define.pdf. [Google Scholar]
- Children’s Bureau . 2010. The child abuse prevention and treatment act including adoption opportunities & the abandoned infants assistance act. Retrieved from https://www.acf.hhs.gov/sites/default/files/cb/capta2010.pdf. [Google Scholar]
- Children’s Bureau . 2016. NCANDS. Retrieved from https://www.acf.hhs.gov/cb/research-data-technology/reporting-systems/ncands. [Google Scholar]
- Cho S., Sohn C.H., Jo M.W., Shin S.-Y., Lee J.H., Ryoo S.M., Seo D.-W. Correlation between national influenza surveillance data and google trends in South Korea. PLoS One. 2013;8(12):1–7. doi: 10.1371/journal.pone.0081422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Choi K., Pan Y.P., Pock M., Chang R.-K.R. Active surveillance of sudden cardiac death in young athletes by periodic internet searches. Pediatric Cardiology. 2013;34(8):1816–1822. doi: 10.1007/s00246-013-0717-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chorianopoulos K., Talvis K. Flutrack.org: Open-source and linked data for epidemiology. Health Informatics Journal. 2015;22(4):962–974. doi: 10.1177/1460458215599822. [DOI] [PubMed] [Google Scholar]
- Chunara R., Andrews J.R., Brownstein J.S. Social and news media enable estimation of epidemiological patterns early in the 2010 Haitian cholera outbreak. American Journal of Tropical Medicine and Hygeine. 2012;86(1):39–45. doi: 10.4269/ajtmh.2012.11-0597. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chunara R., Bouton L., Ayers J.W., Brownstein J.S. Assessing the online social environment for surveillance of obesity prevalence. PLoS One. 2013;8(4):1–8. doi: 10.1371/journal.pone.0061373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chunara R., Chhaya V., Bane S., Mekaru S.R., Chan E.H., Freifeld C.C.…Brownstein J.S. Online reporting for malaria surveillance using micro-monetary incentives, in urban India 2010–2011. Malaria Journal. 2012;11:43. doi: 10.1186/1475-2875-11-43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collier N. What’s unusual in online disease outbreak news? Journal of Biomedical Semantics. 2010;1(1):1–18. doi: 10.1186/2041-1480-1-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collier N. Towards cross-lingual alerting for bursty epidemic events. Journal of Biomedical Semantics. 2011;2(Suppl 5):S10. doi: 10.1186/2041-1480-2-S5-S10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collier N. Uncovering text mining: A survey of current work on web-based epidemic intelligence. Global Public Health. 2012;7(7–8):731–749. doi: 10.1080/17441692.2012.699975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collier N., Doan S. GENI-DB: A database of global events for epidemic intelligence. Bioinformatics. 2012;28(8):1186–1188. doi: 10.1093/bioinformatics/bts099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collier N., Son N.T., Nguyen N.M. OMG U got flu? Analysis of shared health messages for bio-surveillance. Journal of Biomedical Semantics. 2011;2(Suppl 5):S9. doi: 10.1186/2041-1480-2-S5-S9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cook S., Conrad C., Fowlkes A.L., Mohebbi M.H. Assessing google flu trends performance in the United States during the 2009 influenza virus A (H1N1) pandemic. PLoS One. 2011;6(8):1–8. doi: 10.1371/journal.pone.0023610. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cooper C.P., Mallon K.P., Leadbetter S., Pollack L.A., Peipins L.A. Cancer internet search activity on a major search engine, United States 2001–2003. Journal of Medical Internet Research. 2005;7(3):e36. doi: 10.2196/jmir.7.3.e36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- D’Ambrosio A., Agricola E., Russo L., Gesualdo F., Pandolfi E., Bortolus R.…Tozzi A.E. Web-based surveillance of public information needs for informing preconception interventions. PLoS One. 2015;10(4):1–12. doi: 10.1371/journal.pone.0122551. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dal Moro F. Online survey on twitter: A urological experience. Journal of Medical Internet Research. 2013;15(10):296–298. doi: 10.2196/jmir.2719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Daniulaityte R., Nahhas R.W., Wijeratne S., Carlson R.G., Lamy F.R., Martins S.S., Sheth A. Vol. 155. 2015. pp. 307–311. ("Time for dabs": Analyzing twitter data on marijuana concentrates across the U.S. drug and alcohol dependence). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dasgupta N., Freifeld C., Brownstein J.S., Menone C.M., Surratt H.L., Poppish L., Dart R.C. Crowdsourcing black market prices for prescription opioids. Journal of Medical Internet Research. 2013;15(8):e178. doi: 10.2196/jmir.2810. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Lange M.M.A., Meijer A., Friesema I.H.M., Donker G.A., Koppeschaar C.E., Hooiveld M., der Hoek Wv. Comparison of five influenza surveillance systems during the 2009 pandemic and their association with media attention. BMC Public Health. 2013;13(1):1–10. doi: 10.1186/1471-2458-13-881. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Denecke K., Krieck M., Otrusina L., Smrz P., Dolog P., Nejdl W.…Velasco E. How to exploit twitter for public health monitoring? Methods of Information in Medicine. 2013;52(4):326–339. doi: 10.3414/ME12-02-0010. [DOI] [PubMed] [Google Scholar]
- Desai R., Hall A.J., Lopman B.A., Shimshoni Y., Rennick M., Efron N., Parashar U.D. Norovirus disease surveillance using google internet query share aata. Clinical Infectious Diseases. 2012;55(8):e75–e78. doi: 10.1093/cid/cis579. [DOI] [PubMed] [Google Scholar]
- Drake B., Lee S.M., Jonson-Reid M. Race and child maltreatment reporting: Are blacks overrepresented? Children and Youth Services Review. 2009;31(3):309–316. doi: 10.1016/j.childyouth.2008.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dugas A.F., Jalalpour M., Gel Y., Levin S., Torcaso F., Igusa T.…Rothman R.E. Influenza forecasting with google flu trends. PLoS One. 2013;8(2):1–7. doi: 10.1371/journal.pone.0056176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dugas A.F., Yu-Hsiang H., Levin S.R., Pines J.M., Mareiniss D.P., Mohareb A., Rothman R.E. Google flu trends: Correlation with emergency department influenza rates and crowding metrics. Clinical Infectious Diseases. 2012;54(4):463–469. doi: 10.1093/cid/cir883. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Everson M.D., Smith J.B., Hussey J.M., English D., Litrownik A.J., Dubowitz H., Runyan D.K. Concordance between adolescent reports of childhood abuse and child protective service determinations in an at-risk sample of young adolescents. Child Maltreatment. 2008;13(1):14–26. doi: 10.1177/1077559507307837. [DOI] [PubMed] [Google Scholar]
- Fallon B., Trocmé N., Fluke J., MacLaurin B., Tonmyr L., Yuan Y.-Y. Methodological challenges in measuring child maltreatment. Child Abuse & Neglect. 2010;34(1):70–79. doi: 10.1016/j.chiabu.2009.08.008. [DOI] [PubMed] [Google Scholar]
- Fazeli Dehkordy S., Carlos R.C., Hall K.S., Dalton V.K. Novel data sources for women's health research: Mapping breast screening online information seeking through google trends. Academic Radiology. 2014;21(9):1172–1176. doi: 10.1016/j.acra.2014.05.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ferretti E., De Angelis S., Donati G., Torre M. Fatal and non-fatal unintentional drownings in swimming pools in Italy: Epidemiological data derived from the public press in 2008–2012. Microchemical Journal. 2014;113:64–68. doi: 10.1016/j.microc.2013.11.009. [DOI] [Google Scholar]
- First Nations Information Governance Centre . 2017. The first nations principles of OCAP. Retrieved from http://fnigc.ca/ocap.html. [Google Scholar]
- Freifeld C.C., Mandl K.D., Reis B.Y., Brownstein J.S. HealthMap: Global infectious disease monitoring through automated classification and visualization of internet media reports. Journal of the American Medical Informatics Association. 2008;15(2):150–157. doi: 10.1197/jamia.M2544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fung I.C., Fu K.W., Ying Y., Schaible B., Hao Y., Chan C.H.…Tse Z.T. Chinese social media reaction to the MERS-CoV and avian influenza A(H7N9) outbreaks. Infectious Diseases of Poverty. 2013;2(1):31. doi: 10.1186/2049-9957-2-31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gesualdo F., Stilo G., Agricola E., Gonfiantini M.V., Pandolfi E., Velardi P.…Tozzi A.E. Influenza-like illness surveillance on twitter through automated learning of naive language. PLoS One. 2013;8(12):e82489. doi: 10.1371/journal.pone.0082489. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gittelman S., Lange V., Gotway Crawford C.A., Okoro C.A., Lieb E., Dhingra S.S.…Trimarchi E. A new source of data for public health surveillance: Facebook likes. Journal of Medical Internet Research. 2015;17(4):e98. doi: 10.2196/jmir.3970. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gluskin R.T., Johansson M.A., Santillana M., Brownstein J.S. Evaluation of internet-based dengue query data: Google dengue trends. PLoS Neglected Tropical Diseases. 2014;8(2):1–5. doi: 10.1371/journal.pntd.0002713. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanson C.L., Burton S.H., Giraud-Carrier C., West J.H., Barnes M.D., Hansen B. Tweaking and tweeting: Exploring twitter for nonmedical use of a psychostimulant drug (Adderall) among college students. Journal of Medical Internet Research. 2013;15(4):e62. doi: 10.2196/jmir.2503. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harber P., Leroy G. Assessing work-asthma interaction with amazon mechanical Turk. Journal of Occupational and Environmental Medicine. 2015;57(4):381–385. doi: 10.1097/JOM.0000000000000360. [DOI] [PubMed] [Google Scholar]
- Harris J.K., Mansour R., Choucair B., Olson J., Nissen C., Bhatt J. Health department use of social media to identify foodborne illness - Chicago, Illinois, 2013–2014. Morbidity and Mortality Weekly Report. 2014;63(32):681–685. [PMC free article] [PubMed] [Google Scholar]
- Harrison C., Jorder M., Stern H., Stavinsky F., Reddy V., Hanson H., Balter S. Using online reviews by restaurant patrons to identify unreported cases of foodborne illness—New York City, 2012–2013. Morbidity and Mortality Weekly Report. 2014;63(20):441–445. [PMC free article] [PubMed] [Google Scholar]
- Heaivilin N., Gerbert B., Page J.E., Gibbs J.L. Public health surveillance of dental pain via twitter. Journal of Dental Research. 2011;90(9):1047–1051. doi: 10.1177/0022034511415273. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hernandez-Romieu A.C., Sullivan P.S., Sanchez T.H., Kelley C.F., Peterson J.L., Del Rio C., Rosenberg E.S. The comparability of men who have sex with men recruited from venue-time-space sampling and facebook: A cohort study. JMIR Research Protocols. 2014;3(3):e37. doi: 10.2196/resprot.3342. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hipp J.A., Adlakha D., Eyler A.A., Chang B., Pless R. Emerging technologies: Webcams and crowd-sourcing to identify active transportation. American Journal of Preventive Medicine. 2013;44(1):96–97. doi: 10.1016/j.amepre.2012.09.051. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ilakkuvan V., Tacelosky M., Ivey K.C., Pearson J.L., Cantrell J., Vallone D.M., Kirchner T.R. Cameras for public health surveillance: A methods protocol for crowdsourced annotation of point-of-sale photographs. JMIR Research Protocols. 2014;3(2) doi: 10.2196/resprot.3277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- International Society for the Prevention of Child Abuse and Neglect . 2015. Ethical consideations for the collection, analysis, & publication of child maltreatment data. Retrieved from https://www.ispcan.org/wp-content/uploads/2017/03/Ethics_Report.pdf. [Google Scholar]
- International Society for the Prevention of Child Abuse and Neglect . 2016. ISPCAN child abuse screening tools (ICAST) Retrieved from http://www.ispcan.org/?page=icast. [Google Scholar]
- Ireland M.E., Schwartz H.A., Chen Q., Ungar L.H., Albarracin D. Future-oriented tweets predict lower county-level HIV prevalence in the United States. Health Psychology. 2015;34(Suppl):1252–1260. doi: 10.1037/hea0000279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jain V.K., Kumar S. An effective approach to track levels of influenza-A (H1N1) pandemic in india using twitter. Procedia Computer Science. 2015;70:801–807. [Google Scholar]
- Janiec J., Zielicka-Hardy A., Polkowska A., Rogalska J., Sadkowska-Todys M. Did public health travel advice reach EURO 2012 football fans? A social network survey. Eurosurveillance. 2012;17(31) doi: 10.2807/ese.17.31.20238-en. [DOI] [PubMed] [Google Scholar]
- Jashinsky J., Burton S.H., Hanson C.L., West J., Giraud-Carrier C., Barnes M.D.…Argyle T. Tracking suicide risk factors through twitter in the US. Crisis. 2014;35(1):51–59. doi: 10.1027/0227-5910/a000234. [DOI] [PubMed] [Google Scholar]
- Jo C.L., Kornfield R., Kim Y., Emery S., Ribisl K.M. Price-related promotions for tobacco products on twitter. Tobacco Control. 2015;25:476–479. doi: 10.1136/tobaccocontrol-2015-052260. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jones L., Saksvig B.I., Grieser M., Young D.R. Recruiting adolescent girls into a follow-up study: Benefits of using a social networking website. Contemporary Clinical Trials. 2012;33(2):268–272. doi: 10.1016/j.cct.2011.10.011. 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kahneman D. Evaluation by moments: Past and future. In: Kahneman D., Tversky A., editors. Choices, values, and frames. Cambridge University Press; New York: 2000. pp. 693–708. [Google Scholar]
- Kate K., Negi S., Kalagnanam J. Monitoring food safety violation reports from internet forums. Studies in Health Technology and Informatics. 2014;205:1090–1094. [PubMed] [Google Scholar]
- Katsuki T., Mackey T.K., Cuomo R. Establishing a link between prescription drug abuse and illicit online pharmacies: Analysis of twitter data. Journal of Medical Internet Research. 2015;17(12):e280. doi: 10.2196/jmir.5144. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim A.E., Lieberman A.J., Dench D. Crowdsourcing data collection of the retail tobacco environment: Case study comparing data from crowdsourced workers to trained data collectors. Tobacco Control. 2015;24(e1):e6–e9. doi: 10.1136/tobaccocontrol-2013-051298. [DOI] [PubMed] [Google Scholar]
- Klein J.D., Thomas R.K., Sutter E.J. Self-reported smoking in online surveys: Prevalence estimate validity and item format effects. Medical Care. 2007;45(7):691–695. doi: 10.1097/MLR.0b013e3180326145. [DOI] [PubMed] [Google Scholar]
- Lane W.G., Dubowitz H. What factors affect the identification and reporting of child abuse-related fractures? Clinical Orthopaedics and Related Research. 2007;461:219–225. doi: 10.1097/BLO.0b013e31805c0849. [DOI] [PubMed] [Google Scholar]
- Lee R., Ranaldi J., Cummings M., Crucetti J.B., Stratton H., McNutt L.-A. Given the increasing bias in random digit dial sampling, could respondent-driven sampling be a practical alternative? Annals of Epidemiology. 2011;21(4):272–279. doi: 10.1016/j.annepidem.2010.11.018. [DOI] [PubMed] [Google Scholar]
- Leeb R.T., Fluke J.D. Commentary-child maltreatment surveillance: Enumeration, monitoring, evaluation and insight. Health Promotion and Chronic Disease Prevention in Canada. 2015;35(8–9):138–140. [PMC free article] [PubMed] [Google Scholar]
- Lenhart A. Vol. 2015. 2015. http://www.pewinternet.org/2015/04/09/teens-social-media-technology-2015/ (Teens, social media & technology overview). Retrieved from. [Google Scholar]
- Levac D., Colquhoun H., O’Brien K.K. Scoping studies: Advancing the methodology. Implementation Science. 2010;5(1):69. doi: 10.1186/1748-5908-5-69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lonne B., Gillespie K. How do Australian print media representations of child abuse and neglect inform the public and system reform?: Stories place undue emphasis on social control measures and too little emphasis on social care responses. Child Abuse & Neglect. 2014;38(5):837–850. doi: 10.1016/j.chiabu.2014.04.021. [DOI] [PubMed] [Google Scholar]
- Lwin M.O., Vijaykumar S., Lim G., Fernando O.N., Rathnayake V.S., Foo S. Baseline evaluation of a participatory mobile health intervention for dengue prevention in Sri Lanka. Health Education & Behavior. 2015;43(4):471–479. doi: 10.1177/1090198115604623. [DOI] [PubMed] [Google Scholar]
- Lyon A., Nunn M., Grossel G., Burgman M. Comparison of web-based biosecurity intelligence systems: BioCaster, EpiSPIDER and HealthMap. Transboundary and Emerging Diseases. 2012;59(3):223–232. doi: 10.1111/j.1865-1682.2011.01258.x. [DOI] [PubMed] [Google Scholar]
- Maier T., Mohler-Kuo M., Landolt M.A., Schnyder U., Jud A. The tip of the iceberg. Incidence of disclosed cases of child sexual abuse in Switzerland: Results from a nationwide agency survey. International Journal ofPublic Health. 2013;58(6):875–883. doi: 10.1007/s00038-013-0498-6. [DOI] [PubMed] [Google Scholar]
- Mandl K.D., McNabb M., Marks N., Weitzman E.R., Kelemen S., Eggleston E.M.…Quinn M. Participatory surveillance of diabetes device safety: A social media-based complement to traditional FDA reporting. Journal of the American Informatics Association. 2014;21(4):687–691. doi: 10.1136/amiajnl-2013-002127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Markham A., Buchanan E. 2012. Ethical decision-making and internet research: Recommendations from the AoIR ethics working committee (version 2.0) Retrieved from http://aoir.org/reports/ethics2.pdf. [Google Scholar]
- Martin L.J., Xu B., Yasui Y. Improving google flu trends estimates for the United States through transformation. PLoS One. 2014;9(12):1–12. doi: 10.1371/journal.pone.0109209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McIver D.J., Brownstein J.S. Wikipedia usage estimates prevalence of influenza-like illness in the United States in near real-time. PLoS Computational Biology. 2014;10(4):1–8. doi: 10.1371/journal.pcbi.1003581. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Min K., Haojie Z., Jianfeng H., Rutherford S., Fen Y. Using google trends for influenza surveillance in South China. PLoS One. 2013;8(1):1–6. doi: 10.1371/journal.pone.0055205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mohd Roffeei S.H., Abdullah N., Basar S.K. Seeking social support on facebook for children with autism spectrum disorders (ASDs) International Journal of Medical Informatics. 2015;84(5):375–385. doi: 10.1016/j.ijmedinf.2015.01.015. [DOI] [PubMed] [Google Scholar]
- Mollema L., Harmsen I.A., Broekhuizen E., Clijnk R., De Melker H., Paulussen T., Das E. Disease detection or public opinion reflection? Content analysis of tweets, other social media, and online newspapers during the measles outbreak in The Netherlands in 2013. Journal of Medical Internet Research. 2015;17(5):e128. doi: 10.2196/jmir.3863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moreno M.A., Grant A., Kacvinsky L., Egan K.G., Fleming M.F. College students' alcohol displays on facebook: Intervention considerations. Journal of American College Health. 2012;60(5):388–394. doi: 10.1080/07448481.2012.663841. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moreno M.A., Jelenchick L.A., Egan K.G., Cox E., Young H., Gannon K.E.…Becker T. Feeling bad on facebook: Depression disclosures by college students on a social networking site. Depression and Anxiety. 2011;28(6):447–455. doi: 10.1002/da.20805. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Myslín M., Zhu S.-H., Chapman W., Conway M. Using twitter to examine smoking behavior and perceptions of emerging tobacco products. Journal of Medical Internet Research. 2013;15(8):387–402. doi: 10.2196/jmir.2534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nagel A.C., Tsou M.H., Spitzberg B.H., An L., Gawron J.M., Gupta D.K., Sawyer M.H. The complex relationship of realspace events and messages in cyberspace: Case study of influenza and pertussis using tweets. Journal of Medical Internet Research. 2013;15(10):e237. doi: 10.2196/jmir.2705. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nambu S., Nasu A., Nishimura S., Nishimura A., Fujiwara S. Fatal child abuse in Japan: Does a trend exist toward tougher sentencing? Journal of Injury and Violence Research. 2011;3(2):74–79. doi: 10.5249/jivr.v3i2.73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nelson N.P., Li Y., Reilly A.R., Hardin J.E., Hartley D.M. Event-based internet biosurveillance: relation to epidemiological observation. Emerging Themes in Epidemiology. 2012;9:4–16. doi: 10.1186/1742-7622-9-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nerlich B., Koteyko N. Crying wolf? Biosecurity and metacommunication in the context of the 2009 swine flu pandemic. Health & Place. 2012;18(4):710–717. doi: 10.1016/j.healthplace.2011.02.008. [DOI] [PubMed] [Google Scholar]
- Noll J.G., Shenk C.E., Barnes J.E., Haralson K.J. Association of maltreatment with high-risk internet behaviors and offline encounters. Pediatrics. 2013;131(2):e510–e517. doi: 10.1542/peds.2012-1281. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Norr A.M., Albanese B.J., Oglesby M.E., Allan N.P., Schmidt N.B. Anxiety sensitivity and intolerance of uncertainty as potential risk factors for cyberchondria. Journal of Affective Disorders. 2015;174:64–69. doi: 10.1016/j.jad.2014.11.023. [DOI] [PubMed] [Google Scholar]
- Nsoesie E.O., Buckeridge D.L., Brownstein J.S. Guess who's not coming to dinner? Evaluating online restaurant reservations for disease surveillance. Journal of Medical Internet Research. 2014;16(1):e22. doi: 10.2196/jmir.2998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nsoesie E.O., Kluberg S.A., Brownstein J.S. Online reports of foodborne illness capture foods implicated in official foodborne outbreak reports. Preventive Medicine. 2014;67:264–269. doi: 10.1016/j.ypmed.2014.08.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nwadiuki J., Isbell P., Zoloto A.J., Kotch J.B. Using social networking sites in subject tracing. Field Methods. 2011;23(1):77–85. [Google Scholar]
- Nyman A.L., Biener L. The new product watch: Successes and challenges of crowdsourcing as a method of surveillance. Journal of Public Health Management and Practice. 2016;22(1):65–67. doi: 10.1097/PHH.0b013e31829ee9dd. [DOI] [PubMed] [Google Scholar]
- O’Dea B., Wan S., Batterham P.J., Calear A.L., Paris C., Christensen H. Detecting suicidality on twitter. Internet Interventions. 2015;2(2):183–188. [Google Scholar]
- Ocampo A.J., Chunara R., Brownstein J.S. Using search queries for malaria surveillance, Thailand. Malaria Journal. 2013;12(1):1–13. doi: 10.1186/1475-2875-12-390. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Odlum M., Yoon S. What can we learn about the ebola outbreak from tweets? American Journal of Infection Control. 2015;43(6):563–571. doi: 10.1016/j.ajic.2015.02.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olson D.R., Konty K.J., Paladini M., Viboud C., Simonsen L. Reassessing google flu trends data for detection of seasonal and pandemic influenza: A comparative epidemiological study at three geographic scales. PLoS Computational Biology. 2013;9(10):1–11. doi: 10.1371/journal.pcbi.1003256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ortiz J.R., Hong Z., Shay D.K., Neuzil K.M., Fowlkes A.L., Goss C.H. Monitoring influenza activity in the United States: A comparison of traditional surveillance systems with google flu trends. PLoS One. 2011;6(4):1–9. doi: 10.1371/journal.pone.0018687. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Page A., Chang S.-S., Gunnell D. Surveillance of Australian suicidal behaviour using the internet? Australian & New Zealand Journal of Psychiatry. 2011;45(12):1020–1022. doi: 10.3109/00048674.2011.623660. [DOI] [PubMed] [Google Scholar]
- Paolotti D., Carnahan A., Colizza V., Eames K., Edmunds J., Gomes G., Vespignani A. Web-based participatory surveillance of infectious diseases: The influenzanet participatory surveillance experience. Clinical Microbiology and Infection. 2014;20(1):17–21. doi: 10.1111/1469-0691.12477. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parkinson S., Bromfield L. Recruiting young adults to child maltreatment research through facebook: A feasibility study. Child Abuse & Neglect. 2013;37(9):716–720. doi: 10.1016/j.chiabu.2013.04.009. [DOI] [PubMed] [Google Scholar]
- Patwardhan A., Bilkovski R., Goldstein E. Comparison: Flu prescription sales data from a retail pharmacy in the US with google flu trends and US ILINet (CDC) data as flu activity indicator. PLoS One. 2012;7(8):1–5. doi: 10.1371/journal.pone.0043611. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paul M.J., Dredze M. Discovering health topics in social media using topic models. PLoS One. 2014;9(8):1–11. doi: 10.1371/journal.pone.0103408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Powell G.E., Seifert H.A., Reblin T., Burstein P.J., Blowers J., Menius J.A., Dasgupta N. Social media listening for routine post-marketing safety surveillance. Drug Safety. 2016;39(5):443–454. doi: 10.1007/s40264-015-0385-6. [DOI] [PubMed] [Google Scholar]
- Prieto V.M., Matos S., Alvarez M., Cacheda F., Oliveira J.L. Twitter: A good place to detect health conditions. PLoS One. 2014;9(1):e86191. doi: 10.1371/journal.pone.0086191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ram S., Zhang W., Williams M., Pengetnze Y. Predicting asthma-related emergency department visits using big data. Journal of Biomedical and Health Informatics. 2015;19(4):1216–1223. doi: 10.1109/JBHI.2015.2404829. [DOI] [PubMed] [Google Scholar]
- Ridout B., Campbell A., Ellis L. ’Off your face(book)’: Alcohol in online social identity construction and its relation to problem drinking in university students. Drug and Alcohol Review. 2012;31(1):20–26. doi: 10.1111/j.1465-3362.2010.00277.x. [DOI] [PubMed] [Google Scholar]
- Rindfuss R.R., Choe M.K., Tsuya N.O., Bumpass L.L., Tamaki E. Do low survey response rates bias results? Evidence from Japan. Demographic Research. 2015;32:797–828. [Google Scholar]
- Samaras L., García-Barriocanal E., Sicilia M.-A. Syndromic surveillance models using web data: The case of scarlet fever in The UK. Informatics for Health & Social Care. 2012;37(2):106–124. doi: 10.3109/17538157.2011.647934. [DOI] [PubMed] [Google Scholar]
- Santillana M., Nguyen A.T., Dredze M., Paul M.J., Nsoesie E.O., Brownstein J.S. Combining search, social media, and traditional data sources to improve influenza surveillance. PLoS Computational Biology. 2015;11(10):1–15. doi: 10.1371/journal.pcbi.1004513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Santos J.C., Matos S. Analysing twitter and web queries for flu trend prediction. Theoretical Biology and Medical Modelling. 2014;11(Suppl. 1):S6. doi: 10.1186/1742-4682-11-S1-S6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schaefer G.A., Mundt I.A., Ahlers C.J., Bahls C. Child sexual abuse and psychological impairment in victims: Results of an online study initiated by victims. Journal of Child Sexual Abuse. 2012;21(3):343–360. doi: 10.1080/10538712.2012.671800. [DOI] [PubMed] [Google Scholar]
- Schumacher K.R., Stringer K.A., Donohue J.E., Yu S., Shaver A., Caruthers R.L., Russell M.W. Social media methods for studying rare diseases. Pediatrics. 2014;133(5):e1345–1353. doi: 10.1542/peds.2013-2966. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sedlak A., Mettenburg J., Basena M., Petta I., McPherson K., Greene A.…Li S. 2010. Fourth national incidence study of child abuse and neglect (NIS-4): Report to congress. Retrieved from https://www.acf.hhs.gov/sites/default/files/opre/nis4_report_congress_full_pdf_jan2010.pdf. [Google Scholar]
- Sell R., Goldberg S., Conron K. The utility of an online convenience panel for reaching rare and dispersed populations. PLoS One. 2015;10(12):1–10. doi: 10.1371/journal.pone.0144011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Seymour B., Getman R., Saraf A., Zhang L.H., Kalenderian E. When advocacy obscures accuracy online: Digital pandemics of public health misinformation through an antifluoride case study. American Journal of Public Health. 2015;105(3):517–523. doi: 10.2105/AJPH.2014.302437. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Signorini A., Segre A.M., Polgreen P.M. The use of twitter to track levels of disease activity and public concern in the U.S. during the influenza A H1N1 pandemic. PLoS One. 2011;6(5):e19467. doi: 10.1371/journal.pone.0019467. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simmering J.E., Polgreen L.A., Polgreen P.M. Web search query volume as a measure of pharmaceutical utilization and changes in prescribing patterns. Research in Social & Administrative Pharmacy. 2014;10(6):896–903. doi: 10.1016/j.sapharm.2014.01.003. [DOI] [PubMed] [Google Scholar]
- Simon Rosser B.R., Oakes J.M., Bockting W.O., Miner M. Capturing the social demographics of hidden sexual minorities: An internet study of the transgender population in the United States. Sexuality Research & Social Policy. 2007;4(2):50–64. [Google Scholar]
- Smallwood J., O’Connor R.C. Imprisoned by the past: Unhappy moods lead to a retrospective bias to mind wandering. Cognition & Emotion. 2011;25(8):1481–1490. doi: 10.1080/02699931.2010.545263. [DOI] [PubMed] [Google Scholar]
- Smolinski M.S., Crawley A.W., Baltrusaitis K., Chunara R., Olsen J.M., Wojcik O., Brownstein J.S. Flu near you: Crowdsourced symptom reporting spanning 2 influenza seasons. American Journal of Public Health. 2015;105(10):2124–2130. doi: 10.2105/AJPH.2015.302696. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sofean M., Smith M. Sentiment analysis on smoking in social networks. Studies in Health Technology and Informatics. 2013;192:1118. [PubMed] [Google Scholar]
- Stein M.L., van Steenbergen J.E., Chanyasanha C., Tipayamongkholgul M., Buskens V., van der Heijden P.G., Kretzschmar M.E. Online respondent-driven sampling for studying contact patterns relevant for the spread of close-contact pathogens: A pilot study in Thailand. PLoS One. 2014;9(1):e85256. doi: 10.1371/journal.pone.0085256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Step M.M., Bracken C.C., Trapl E.S., Flocke S.A. User and content characteristics of public tweets referencing little cigars. American Journal of Health Behavior. 2016;40(1):38–47. doi: 10.5993/AJHB.40.1.5. [DOI] [PubMed] [Google Scholar]
- Sueki H. The association of suicide-related twitter use with suicidal behaviour: A cross-sectional study of young internet users in Japan. Journal of Affective Disorders. 2015;170:155-. doi: 10.1016/j.jad.2014.08.047. [DOI] [PubMed] [Google Scholar]
- Temple E.C., Brown R.F. A comparison of internet-based participant recruitment methods: Engaging the hidden population of cannabis users in research. Journal of Research Practice. 2011;7(2) Article D2. [Google Scholar]
- Thomas T.A., Heysell S.K., Houpt E.R., Moore J.L., Keller S.J. Outbreak of pyrazinamide-monoresistant tuberculosis identified using genotype cluster and social media analysis. International Journal of Tuberculosis and Lung Disease. 2014;18(5):552–558. doi: 10.5588/ijtld.13.0663. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Timpka T., Spreco A., Dahlström Ö., Eriksson O., Gursky E., Ekberg J., Holm E. Performance of eHealth data sources in local influenza surveillance: A 5-year open cohort study. Journal of Medical Internet Research. 2014;16(4):1–10. doi: 10.2196/jmir.3099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Torii M., Yin L., Nguyen T., Mazumdar C.T., Liu H., Hartley D.M.…Nelson N.P. An exploratory study of a text classification framework for internet-based surveillance of emerging epidemics. International Journal of Medical Informatics. 2011;80(1):56–66. doi: 10.1016/j.ijmedinf.2010.10.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Towers S., Afzal S., Bernal G., Bliss N., Brown S., Espinoza B.…Castillo-Chavez C. Mass media and the contagion of fear: The case of ebola in America. PLoS One. 2015;10(6):e0129179. doi: 10.1371/journal.pone.0129179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turbow D.J., Kent E.E., Jiang S.C. Web-based investigation of water associated illness in marine bathers. Environmental Research. 2008;106(1):101–109. doi: 10.1016/j.envres.2007.06.006. [DOI] [PubMed] [Google Scholar]
- U.S. Department of Health and Human Services Administration for children and families, administration on children youth and families, & children's bureau. Child Maltreatment. 2017;2015 https://www.acf.hhs.gov/sites/default/files/cb/cm2015.pdf#page=29 Retrieved from. [Google Scholar]
- van Genderen P.J., Slobbe L., Koene H., Mastenbroek R.D., Overbosch D. Keeping venomous snakes in the Netherlands: A harmless hobby or a public health threat? The Netherlands Journal of Medicine. 2013;71(8):437–441. [PubMed] [Google Scholar]
- Velardi P., Stilo G., Tozzi A.E., Gesualdo F. Twitter mining for fine-grained syndromic surveillance. Artificial Intelligence in Medicine. 2014;61(3):153–163. doi: 10.1016/j.artmed.2014.01.002. [DOI] [PubMed] [Google Scholar]
- Walklate S., Petrie S. Witnessing the pain of suffering: Exploring the relationship between media representations, public understandings and policy responses to filicide-suicide. Crime, Media, Culture. 2013;9(3):265–279. [Google Scholar]
- Weitzman E.R., Adida B., Kelemen S., Mandl K.D. Sharing data for public health research by members of an international online diabetes social network. PLoS One. 2011;6(4):1–8. doi: 10.1371/journal.pone.0019256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Whitehead L.C. Methodological and ethical issues in internet-mediated research in the field of health: An integrated review of the literature. Social Science & Medicine. 2007;65(4):782–791. doi: 10.1016/j.socscimed.2007.03.005. [DOI] [PubMed] [Google Scholar]
- Widener M.J., Li W. Using geolocated twitter data to monitor the prevalence of healthy and unhealthy food references across the US. Applied Geography. 2014;54:189–197. [Google Scholar]
- Widom C.S., Czaja S.J., DuMont K.A. Intergenerational transmission of child abuse and neglect: Real or detection bias? Science. 2015;347(6229):1480–1485. doi: 10.1126/science.1259917. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wilson K., Brownstein J.S. Early detection of disease outbreaks using the internet. CMAJ: Canadian Medical Association Journal. 2009;180(8):829–831. doi: 10.1503/cmaj.090215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- World Health Organization . 2016. Child maltreatment. Retrieved from http://www.who.int/mediacentre/factsheets/fs150/en/ [Google Scholar]
- Yin S., Ho M. Monitoring a toxicological outbreak using internet search query data. Clinical Toxicology. 2012;50(9):818–822. doi: 10.3109/15563650.2012.729667. [DOI] [PubMed] [Google Scholar]
- Yom-Tov E., Borsa D., Cox I.J., McKendry R.A. Detecting disease outbreaks in mass gatherings using internet data. Journal of Medical Internet Research. 2014;16(6):e154. doi: 10.2196/jmir.3156. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang D., Bi P., Hiller J.E., Lv F. Web-based HIV/AIDS behavioral surveillance among men who have sex with men: Potential and challenges . International Journal of Infectious Diseases. 2008;12(2):126–131. doi: 10.1016/j.ijid.2007.06.007. [DOI] [PubMed] [Google Scholar]
- Zhang M.W., Ho C.S., Fang P., Lu Y., Ho R.C. Methodology of developing a smartphone application for crisis research and its clinical application. Technology and Health Care. 2014;22(4):547–559. doi: 10.3233/THC-140819. [DOI] [PubMed] [Google Scholar]
- Zhang Y., Dang Y., Chen H., Thurmond M., Larson C. Automatic online news monitoring and classification for syndromic surveillance. Decision Support Systems. 2009;47(4):508–517. doi: 10.1016/j.dss.2009.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zheluk A., Quinn C., Hercz D., Gillespie J.A. Internet search patterns of human immunodeficiency virus and the digital divide in the Russian Federation: Infoveillance study. Journal of Medical Internet Research. 2013;15(11):185–199. doi: 10.2196/jmir.2936. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zheluk A., Quinn C., Meylakhs P. Internet search and krokodil in the Russian Federation: An infoveillance study. Journal of Medical Internet Research. 2014;16(9):e212. doi: 10.2196/jmir.3203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhou X., Coiera E., Tsafnat G., Arachi D., Ong M.S., Dunn A.G. Using social connection information to improve opinion mining: Identifying negative sentiment about HPV vaccines on twitter. Studies in Health Technology and Informatics. 2015;216:761–765. [PubMed] [Google Scholar]
- Zhou X., Li Q., Zhu Z., Zhao H., Tang H., Feng Y. Monitoring epidemic alert levels by analyzing internet search volume. Transactions on Biomedical Engineering. 2013;60(2):446–452. doi: 10.1109/TBME.2012.2228264. [DOI] [PubMed] [Google Scholar]
- Zhou X., Ye J., Feng Y. Tuberculosis surveillance by analyzing google trends. Transactions on Biomedical Engineering. 2011;58(8):2247–2254. doi: 10.1109/TBME.2011.2132132. [DOI] [PubMed] [Google Scholar]
- Zhu Y., Jiang X., Li H., Li F., Chen J. Mortality among drowning rescuers in China, 2013: A review of 225 rescue incidents from the press. BMC Public Health. 2015;15:631. doi: 10.1186/s12889-015-2010-0. [DOI] [PMC free article] [PubMed] [Google Scholar]