Abstract
Background
Suicide is one of the major causes of death in the world, leading to approximately 1 million deaths per year. While much of what is said about suicide and its causes is still taboo in most contemporary societies and cultures, internet websites and discussion forums have become an important and controversial source of information on the subject. A great deal of ambivalence is discernible as to whether online communication about suicide primarily should be seen as an opportunity or a serious threat.
Objective
To investigate how the subject of suicide is represented on the Internet, based on hits generated by the search engine Google.
Methods
In an exploratory design, Google search results on the target word “suicide”, for the years 2005, 2009, and 2012 respectively, were systematically analyzed and compared.
Results
The study shows that web pages of institutional origin on the subject predominate, that the content provided by these institutions concerns primarily research and prevention, and that the form of communication used by these senders is almost exclusively monological. However, besides these institutional pages there are a substantial number of private senders and pages, often anti-medical and against treatment of depression and other mental problems, characterized by dialogue, confessions and narratives, and to a higher degree, an alternative pro-suicide stance.
Conclusions
To counteract the influence of anti-medical and pro-suicide information, the role of the Internet should be discussed with the patient in clinical practice. Dialogical and confessional communications provide an opportunity for the clinician to gain a deeper perspective into perceptions of patients, regarding both their afflictions and the role of medical treatment in their lives.
Keywords: suicide, internet, websites, pro-suicide, suicide-preventive
Introduction
Suicide is one of the major causes of death in the world, leading to approximately 1 million deaths per year. It is estimated that by the year 2020, this figure will have increased to 1.5 million [1,2]. While the topic of suicide is still taboo and stigmatized [3], and also often neglected in most contemporary societies and cultures [4], websites and discussion forums have become an important and sometimes controversial source of information on the subject [5,6]. It estimated that there are more than 2 billion Internet users worldwide, with about half of them living in Asia [7]. The application of the Internet in daily life is progressively enhancing. Socioeconomic gaps in Internet use are decreasing, while Internet access is available in more and more rural and remote areas.
One central aspect of the Internet is that the line between private and public communication is expunged. This also has consequences for the development of how the topic of suicide is handled in society. The Internet is not a pretend-world. It is a world populated by real people with different social and cultural backgrounds. In its virtual social environment people meet, exchange thoughts, feelings and experiences; and just like in the real world, the actions people take on the Internet affect their own and/or other people’s lives [8].
A great deal of ambivalence is discernible as to whether online communication about suicide should be seen primarily as an opportunity or a serious threat [9,10]. Some researchers have reflected on the emergence of pro-suicide websites on the Internet [11-14]. It has been pointed out that these sites recommend suicide as a solution to life’s problems and contain detailed descriptions of methods yielding the maximum effect, as well as suicide notes and pictures of people who committed suicide. They persuade and exert group pressure to fulfil suicide plans, glorifying those who have committed suicide. These websites have also given rise to a new form of suicide pact—“net suicides” [15-18]. These developments have given grounds for a fear of the Internet’s detrimental influence on peoples’ understanding and behavior towards suicide. Some authors have put forward that the Internet has a stronger “Werther effect”—ie, a greater potential to induce suicide acts—than other mediated communication forms [19]. Others point to a clear “anti-psychiatric” attitude behind the production of the pro-suicide message [20].
However, the Internet can also be seen as a key resource and a powerful communication tool for understanding and psychologically supporting potentially suicidal individuals [21-24], sometimes referred to as the “Papageno effect” [25]. For example, it may be used to identify people in the risk zone for suicidal acts and then communicate with them, thereby preventing such acts [26].
In April 2005, the word suicide generated around 27 million hits on the Google search engine. Four years later, in April 2009, the number of search hits had more than doubled, and in January 2012, the Google search engine generated about 250 million hits on the word suicide. The mere existence of so many websites on the suicide subject is not cause for alarm in itself; it means only that the word suicide is included in a variety of texts on the Web or that Google’s search algorithms are better at finding texts that include the term suicide. Without a more detailed study of these websites’ content, we cannot know what they stand for.
It has been argued that search engines like Google can be seen as meta-sources for information on various topics and that search results on a certain topic may be representative of Internet content at large: “Google search volumes reflect a large proportion of all available Internet search data on the chosen term, thereby capturing a vast amount of information” [27].
The aim of this quantitative study is to examine how the subject of suicide is represented to users on the Internet by proxy of hits for the word suicide generated by the search engine Google.
The specific research questions that the study is designed to answer are:
Who are the senders of the information about suicide on the Internet?
How is the subject of suicide communicated? Is it primarily through a monological or a dialogical communication?
What categories of content on the suicide subject appear on the Internet?
Which discourse about suicide predominates on the Internet?
Methods
In April 2005, a search was generated on Google (google.com) using the word suicide. The first 100 search hits were analyzed systematically. The rationale behind this procedure was to capture a cross-sectional sample of search results. At the heart of Google’s search engine system is the software PageRank [28]. PageRank can be described simply as a type of priority scheme in which more “valuable” and frequently visited websites are ranked higher in the search lists than the less visited and less “valuable” pages. Value is defined by terms similar to that used in the academia, ie, topic relevance and number of citations by other publications (in PageRank this corresponds to links by other websites). The first 100 search results for the word suicide should therefore be regarded as the most visited and most cited web pages in the world about suicide.
The search procedure and analysis were repeated in April 2009 and in January 2012, in order to investigate possible changes in the representation of suicide on the Internet over time.
One aspect that could be argued to influence the results of this study is changes in search engine algorithms used by Google. Such algorithms are optimized by Google frequently to enhance user experience. Changes in these algorithms may affect the search results in a way that does not reflect a change in tangible suicide-related material on the Internet. However, as the aim of this study is to capture what Internet users find on the web, as opposed to describing the complete range of suicide-related materials on the Internet (including those that cannot be found), it is argued that the representativeness of this sample is not threatened: A change in the algorithms affects the results of this study the same way as it affects the results as experienced by users.
After visiting each website, two researchers filled out a checklist with a number of items relating to four pre-specified characteristics, described below.
Senders: this variable attempted to identify the actor(s) behind the specific text or web page. Authorities associated with a government or a public body were identified, as well as Non-Governmental Organisations (NGOs) and associations, corporations, or private senders.
Form of communication: this refers to the direction of the communication on the given website. Whether users have the opportunity to discuss with each other, comment on/change the contents, or only to receive the contents without interaction.
Content: this refers to the type of information provided on the website, for example: scientific findings versus specific suicide-related events such as the death of a celebrity, or personal “confessions” and discussions about suicide.
Discourse: this variable aimed to capture how the topic of suicide was approached. The current medical-psychiatric view, where suicide is seen as harmful behavior, both for the individual and society, and something that is preventable and treatable was contrasted to views promoting/enticing the act of suicide as valid solution to problems in life, and/or suggesting methods and means to commit suicide.
Exclusion Criteria
Websites in which the word suicide was used metaphorically but that did not otherwise contain any suicide-related content were excluded. Examples of this may be references to members of parliament who have committed “political suicide”, cells in the human body that “commit suicide”. Suicide is a very powerful and symbolically charged word in our culture and is sometimes used in contexts unrelated to the suicidal subject and the act of suicide itself, probably in order to boost the effect of what is expressed [29].
Interestingly, the non-related search hits for the word suicide were especially high for the year 2009 (46%) compared to 2005 and 2012 (13% and 19% respectively) (Table 1). This reflects the volatile nature of Internet-based information content when defined in terms of Google search hits. In this study, the main cause of this increase in non-related search hits in 2009 was firstly an increase in popularity of a pornographic website called SuicideGirls, which not even after thorough examination revealed any suicide-related material; and secondly the promotional activities of the electronic punk musical duo called Suicide who were releasing a new album as well as starting a tour in 2009. Thus, websites related to both these topics were lacking suicide-related content.
Table 1.
Material | Year | |||
2005 | 2009 | 2012 | P-value | |
n = 100 | n = 100 | n = 100 | ||
Included hits | 84 | 48 | 82 | <.01 |
Exclusion (non-related) | 13 | 46 | 19 | <.01 |
Exclusion (attrition) | 3 | 6 | 0 | .05 |
Attrition
As web pages are removed or modified and because web addresses are constantly changing, the “website attrition” that occurred between period of sampling and analysis was noted in our sample. Time is an important factor affecting attrition in studies of the Internet using a cross-sectional methodology [30, 31]. All websites in this study were visited within 2 weeks of the date of sampling. An attempt was made to analyze even those websites that were unavailable at the time of the visit using Internet Archive (www.archive.org). However, due to the exclusion of non-related hits and website attrition, the sample was thus reduced to 84 hits of full material in 2005, to 48 hits in 2009 and to 82 hits in 2012 (Table 1).
Coding
Fifty randomly selected search hits were coded by two independent coders in order to test inter-rater reliability. The Cohen’s Kappa value of 0.72 was interpreted as a substantial agreement between the coders [32]. The same coders and measurements were used in the 2005, 2009 and 2012 material.
Analysis
Considering that this is not a hypothesis-driven study, but rather an attempt at mapping suicide-related content on the Internet, Fisher’s exact was used to establish an association (or the lack thereof) between time and the study variables regarding suicide-related content. Cochran-Armitage trend analysis was used to identify trends in the changes regarding suicide-related content. No significant trends were identified.
Results
Senders
The 2005 material shows that 65 (77%) of the 84 Google hits on the search term suicide come from institutional senders and 19 (23%) from private senders (Table 2). The frequencies for 2009 and 2012 confirm that institutional senders are the largest category. Yet, the 2005, 2009 and 2012 material has a large proportion of private senders in the more relevant search positions (the first ten search hits), which indicates that these senders’ websites are relatively visible and highly attended.
Table 2.
Senders |
Year | |||
2005 | 2009 | 2012 | P-value | |
n = 84 | n = 48 | n = 82 | ||
Institutional senders | 77% (65) | 71% (34) | 83% (68) | .27 (.41) |
Private senders | 23% (19) | 29% (14) | 17% (14) |
Form of Communication
The communication about the subject of suicide on the Internet is clearly dominated by the one-way communication form monologue, even though the differences between the categories are somewhat smaller in 2009 and 2012 than in 2005 (Table 3).
Table 3.
Form of communication | Year | |||
2005 | 2009 | 2012 | P-value | |
n = 84 | n = 48 | n = 82 | ||
Monologue | 93% (78) | 88% (42) | 85% (70) | .30 (.41) |
Dialogue | 7% (6) | 12% (6) | 15% (12) |
Content
Research and suicide-prevention is the most common content in the search hits on suicide in all of the studied years. In the 2005 material, 61 (73%) of the search hits fell into this category; in 2009, it was 23 (48%); and in the 2012 material, 61 (74%) of the search hits were categorized as research and suicide-prevention (Table 4).
Table 4.
Content | Year | |||
2005 | 2009 | 2012 | P-value | |
n = 84 | n = 48 | n = 82 | ||
Research /suicide prevention | 73% (61) | 48% (23) | 74% (61) | <.01 (.82) |
Suicide events | 2% (2) | 6% (3) | 9% (7) | .20 (.08) |
General reflections | 18% (15) | 21% (10) | 12% (10) | .39 (.33) |
Confessions | 6% (5) | 6% (3) | 4% (3) | .78 (.50) |
Fiction | 1% (1) | 19% (9) | 1% (1) | <.01 (.97) |
The relatively small share of personal and intimate statements and conversations about suicide, found in the category confessions, has been fairly the same for all the three years (Table 4).
Discourse
The results show that a majority of the search hits for all the studied years have a clear suicide-preventive message. In 2005, it was 63 out of 84 hits (75%); in 2009, 27 out of 48 hits (56%); and in 2012, 64 out of 82 hits (78%) (Table 5).
Table 5.
Discourse | Year | |||
2005 | 2009 | 2012 | P-values | |
n = 84 | n = 48 | n = 82 | ||
Suicide preventive | 75% (63) | 56% (27) | 78% (64) | .03 (.20) |
Pro-suicide | 6% (5) | 6% (3) | 0 | <.01 (.053) |
Both categories | 11% (9) | 21% (10) | 9% (7) | .12 (.78) |
Non-applicable | 8% (7) | 17% (8) | 13% (11) | .33 (.42) |
Discussion
Although the institutional senders quantitatively dominate the communication about suicide on the Internet, the relatively large proportion of non-institutional private senders illustrates how the Internet effects the way that suicide is communicated in today’s society.
The analysis of the relation between the variables senders and form of communication in the 2005, 2009, and 2012 material shows that communication about suicide on the Internet by institutional senders is almost entirely in a monological form, with very few instances of dialogue. In contrast to this, the proportion of the communication form dialogue for the private senders constitutes 21% in 2005, and in 2009 and 2012, the dialogue represents more than a third of the search hits (36%) for these senders. So, today there is a clear distinction between the institutional senders and the private senders in terms of how to communicate the subject of suicide.
Dialogue is thus a quite common form of communication about suicide for the private senders. The Internet, uniquely, consists of several different forms of mass communication, where the interactive multi-way communication is the part that means something qualitatively new to the suicide subject, while the one-way monological communication on the Internet stands for an extension of an already existing institutional communication about the suicide subject. The contents of the dialogic communication are based on the social reality outside the Internet. They are shaped and conventionalized according to the specific factors of the communication that occur in the virtual environment, such as a higher degree of anonymity, a greater spatial distance and, to a large extent, a text-based communication.
The most common content on the subject of suicide on the Internet is about research and suicide-prevention. The analysis of the relation between senders and content in the 2005, 2009 and 2012 material shows that communication about suicide from the institutional senders is made up mainly from texts on research and suicide-prevention (82%, 62%, 82% respectively). This content category also makes up a substantial proportion for the private senders (39%, 14%, 36% respectively), but here the categories confessions and general reflections also make up a noteworthy share (for confessions 22%, 21%, 21% respectively).
The content category confessions contain personal and intimate stories and conversations about one’s own or other people’s suicidal acts and suicidal thoughts. When reading these texts more closely, it is clear that the people writing them are asking questions about the meaning of their existence, that they are crying out for help, that they seek confirmation and understanding, and that they are trying to support and encourage each other the best they can, and in some cases even urge each other to carry out suicidal plans.
According to other studies regarding the representation of suicide on the Internet, pro-suicide websites have shown to be high up on search engines’ result lists, making them highly visible and accessible for those who are looking for suicide-related material [33,34]. These findings are congruent with this study’s results for the years 2005 and 2009, but it is not as clear in the 2012 material. Another recent study also points out that the preventive websites are more visible and accessible on the Internet today compared to those that are pro-suicide [35]. This does not necessarily mean that pro-suicide websites have declined in numbers; they’re just not as prevalent among the first 100 search results, when using the more general search term suicide. This could be due to a recent and deliberate strategy (eg, search engine optimization) from suicide-preventive actors to make their websites more reachable and popular, and thereby get a better ranking in the search results lists. Hopefully it is an increased awareness about the risks that pro-suicide websites may have on vulnerable Internet users that lies behind this strategy. These types of websites play a documented role in information on various types of suicide methods, the glorification of individuals who have committed suicide, as well as encouragement to go through with suicide plans [36-40]. Before the development of the Internet, pro-suicide texts were unusual and difficult for audiences to get hold of. The expansion of the Internet has thus enabled pro-suicide messages to spread and can consequently be received by more people today than before. Thus, for an Internet user searching for suicide-related material using a search engine, the likelihood, or risk, of unintentionally finding pro-suicide messages is lower in 2012 than in 2009 and 2005. However, users consciously aiming at finding pro-suicide material will have no problem in doing so [41].
The Challenge for Clinicians
The results show that it is institutional actors, distributing contents of research and suicide-prevention in a monological way, that dominate the communication about suicide on the Internet. But besides these institutional senders, there is a considerable proportion of private actors for which the Internet has meant the opportunity to publish material and discuss, confess and seek contact on a subject that has always been strongly taboo and therefore “belonged” to only a few voices in public discourse. This opportunity has resulted in both constructive and strongly destructive contributions, such as pro-suicide messages.
Today, it seems a very important task for clinicians to respond to the substantial amount of pro-suicide messages on the Internet and to continue to develop preventive strategies and resources for individuals at risk for suicidal acts [42]. The preventive resources should also be developed using the dialogic communication between the mental-health expertise and help-seeking individuals; unidirectional information about mental illness and suicide prevention is not enough [43]. Another important task is to raise awareness among clinicians about the risks it may pose to suicidal individuals to visit pro-suicide websites, which contain descriptions and evaluations of potent suicide methods and promote an attitude that suicide can be an acceptable way to solve life problems. A key instrument could be to establish routines in which clinicians ask their patients about their use of the Internet and also help the patients to find preventive sites with therapeutic resources.
Conclusion
Through the Internet, the dominant understanding of suicide is challenged by new voices, and the battle over definitions of “right and wrong” and perceptions of “true and false” has intensified. The possibility of reaching out to large groups of users is no longer monopolized by institutional senders. These developments brought on by the wide spread use of the Internet have posed obstacles as well as benefits in the field of suicide prevention.
Clinicians taking part in the online dialogical communication, on platforms where patients/laypersons discuss mental health-related topics, could be a helpful tool in the development of cohesion between patient and clinicians [44], and increase the understanding of the patient perspective.
Acknowledgments
The authors would like to thank Professor Jerzy Wasserman for his significant contributions to the intellectual content of the paper.
Footnotes
None declared.
References
- 1.Bertolote JM, Fleischmann A. A global perspective on the magnitude of suicide mortality. In: Wasserman D, Wasserman C, editors. Oxford Textbook of Suicidology and Suicide Prevention. Oxford: Oxford University Press; 2009. pp. 91–99. [Google Scholar]
- 2.Wasserman D. Evaluating suicide prevention: various approaches needed. World Psychiatry. 2004 Oct;3(3):153–4. [PMC free article] [PubMed] [Google Scholar]
- 3.Joiner T. Why people die by suicide. Cambridge, MA: Harvard University Press; 2005. [Google Scholar]
- 4.Anderson M, Jenkins R. The role of the state and legislation in suicide prevention. The five continents perspective. In: Wasserman D, Wasserman C, editors. Oxford Textbook of Suicidology and Suicide Prevention. Oxford: Oxford University Press; 2009. pp. 373–381. [Google Scholar]
- 5.Westerlund M. The production of pro-suicide content on the Internet: a counter-discourse activity. New Media & Society. 2011;14:764. doi: 10.1177/1461444811425221. [DOI] [Google Scholar]
- 6.Durkee T, Hadlaczky G, Westerlund M, Carli V. Internet pathways in suicidality: a review of the evidence. Int J Environ Res Public Health. 2011 Oct;8(10):3938–52. doi: 10.3390/ijerph8103938.ijerph-08-03938 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Internet World Stats. [2012-09-06]. http://www.internetworldstats.com/stats.htm.
- 8.Westerlund M, Wasserman D. The role of the Internet in suicide prevention. In: Wasserman D, Wasserman D, editors. Oxford Textbook of Suicidology and Suicide Prevention. Oxford: Oxford University Press; 2009. pp. 525–532. [Google Scholar]
- 9.Alao AO, Soderberg M, Pohl EL, Alao AL. Cybersuicide: review of the role of the internet on suicide. Cyberpsychol Behav. 2006 Aug;9(4):489–93. doi: 10.1089/cpb.2006.9.489. [DOI] [PubMed] [Google Scholar]
- 10.D'Hulster N, Van Heeringen C. [Cyber-suicide: the role of the internet in suicidal behaviour. A case study] Tijdschr Psychiatr. 2006;48(10):803–7. http://www.tijdschriftvoorpsychiatrie.nl/en/tijdschrift/artikel.php?vol=48&issue=10&page=803. [PubMed] [Google Scholar]
- 11.Baume P, Cantor CH, Rolfe A. Cybersuicide: the role of interactive suicide notes on the Internet. Crisis. 1997;18(2):73–9. doi: 10.1027/0227-5910.18.2.73. [DOI] [PubMed] [Google Scholar]
- 12.Thompson S. The Internet and its potential influence on suicide. Psychiatric Bulletin. 1999;23:449–451. doi: 10.1192/pb.23.8.449. [DOI] [Google Scholar]
- 13.Biddle L, Donovan J, Hawton K, Kapur N, Gunnell D. Suicide and the internet. BMJ. 2008 Apr 12;336(7648):800–2. doi: 10.1136/bmj.39525.442674.AD.336/7648/800 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Recupero PR, Harms SE, Noble JM. Googling suicide: surfing for suicide information on the Internet. J Clin Psychiatry. 2008 Jun;69(6):878–88.ej07m03731 [PubMed] [Google Scholar]
- 15.Lee D. Web of despair. Foreign Policy. 2003 Sep 01;138:90–91. [Google Scholar]
- 16.Rajagopal S. Suicide pacts and the internet. BMJ. 2004 Dec 4;329(7478):1298–9. doi: 10.1136/bmj.329.7478.1298.329/7478/1298 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Naito A. Internet suicide in Japan: implications for child and adolescent mental health. Clin Child Psychol Psychiatry. 2007 Oct;12(4):583–97. doi: 10.1177/1359104507080990. [DOI] [PubMed] [Google Scholar]
- 18.Ozawa-De Silva C. Shared death: self, sociality and internet group suicide in Japan. Transcult Psychiatry. 2010 Jul;47(3):392–418. doi: 10.1177/1363461510370239.47/3/392 [DOI] [PubMed] [Google Scholar]
- 19.Baume P, Cantor CH, Rolfe A. Cybersuicide: the role of interactive suicide notes on the Internet. Crisis. 1997;18(2):73–9. doi: 10.1027/0227-5910.18.2.73. [DOI] [PubMed] [Google Scholar]
- 20.Becker K, Schmidt MH. Internet chat rooms and suicide. J Am Acad Child Adolesc Psychiatry. 2004 Mar;43(3):246–7. doi: 10.1097/00004583-200403000-00002.00004583-200403000-00002 [DOI] [PubMed] [Google Scholar]
- 21.Wang YD, Phillips-Wren G, Forgionne G. E-delivery of personalised healthcare information to intermediaries for suicide prevention. Int J Electron Healthc. 2005;1(4):396–412. doi: 10.1504/IJEH.2005.006687.WCXHP073NFWY4H8E [DOI] [PubMed] [Google Scholar]
- 22.Winkel S, Groen G, Petermann F. [Social support in suicide forums] Prax Kinderpsychol Kinderpsychiatr. 2005 Nov;54(9):714–27. [PubMed] [Google Scholar]
- 23.Gilat I, Shahar G. Emotional first aid for a suicide crisis: comparison between Telephonic hotline and internet. Psychiatry. 2007;70(1):12–18. doi: 10.1521/psyc.2007.70.1.12. [DOI] [PubMed] [Google Scholar]
- 24.Baker D, Fortune S. Understanding self-harm and suicide websites: a qualitative interview study of young adult website users. Crisis. 2008;29(3):118–22. doi: 10.1027/0227-5910.29.3.118. [DOI] [PubMed] [Google Scholar]
- 25.Niederkrotenthaler T, Voracek M, Herberth A, Till B, Strauss M, Etzersdorfer E, Eisenwort B, Sonneck G. Role of media reports in completed and prevented suicide: Werther v. Papageno effects. Br J Psychiatry. 2010 Sep;197(3):234–43. doi: 10.1192/bjp.bp.109.074633. http://bjp.rcpsych.org/cgi/pmidlookup?view=long&pmid=20807970.197/3/234 [DOI] [PubMed] [Google Scholar]
- 26.Barak A. Emotional support and suicide prevention through the Internet: A field project. Computers in Human Behavior. 2007;23(2):971–984. [Google Scholar]
- 27.McCarthy MJ. Internet monitoring of suicide risk in the population. J Affect Disord. 2010 May;122(3):277–9. doi: 10.1016/j.jad.2009.08.015.S0165-0327(09)00397-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Brin S, Page L. Cite Seer X. 1998. [2011-04-24]. The anatomy of a large-scale hypertextual web search engine http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.96.2493&rep=rep1&type=pdf.
- 29.Westerlund M. Självmord och Internet: kommunikation om ett livsfarligt ämne (Suicide and the Internet: communication about a deadly topic) Stockholm: Stockholms universitet; 2010. [Google Scholar]
- 30.Paasonen S. Net years, pioneers, and flat perspectives. Internet Research Annual. 2003;2:3–13. [Google Scholar]
- 31.Foot K. Web sphere analysis and cybercultural studies. In: Silver D, Massanari A, editors. Critical cyberculture studies. New York and London: New York University Press; 2006. pp. 18–38. [Google Scholar]
- 32.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–74. [PubMed] [Google Scholar]
- 33.Biddle L, Donovan J, Hawton K, Kapur N, Gunnell D. Suicide and the internet. BMJ. 2008 Apr 12;336(7648):800–2. doi: 10.1136/bmj.39525.442674.AD.336/7648/800 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Recupero PR, Harms SE, Noble JM. Googling suicide: surfing for suicide information on the Internet. J Clin Psychiatry. 2008 Jun;69(6):878–88.ej07m03731 [PubMed] [Google Scholar]
- 35.Kemp CG, Collings SC. Hyperlinked suicide: assessing the prominence and accessibility of suicide websites. Crisis. 2011;32(3):143–51. doi: 10.1027/0227-5910/a000068.0125G37W0V623616 [DOI] [PubMed] [Google Scholar]
- 36.Adekola A, Yolles J, Armenta W. Cybersuicide: The Internet and suicide. American Journal of Psychiatry. 1999;156(11):1836–1837. [PubMed] [Google Scholar]
- 37.Baume P, Cantor CH, Rolfe A. Cybersuicide: the role of interactive suicide notes on the Internet. Crisis. 1997;18(2):73–9. doi: 10.1027/0227-5910.18.2.73. [DOI] [PubMed] [Google Scholar]
- 38.Becker K, Schmidt MH. Internet chat rooms and suicide. J Am Acad Child Adolesc Psychiatry. 2004 Mar;43(3):246–7. doi: 10.1097/00004583-200403000-00002.00004583-200403000-00002 [DOI] [PubMed] [Google Scholar]
- 39.Haut F, Morrison A. The Internet and the future of psychiatry. Psychiatric Bulletin. 1998;22(10):641–642. doi: 10.1192/pb.22.10.641-a. [DOI] [Google Scholar]
- 40.Thompson S. The Internet and its potential influence on suicide. Psychiatric Bulletin. 1999;23:449–451. doi: 10.1192/pb.23.8.449. [DOI] [Google Scholar]
- 41.Hagihara A, Miyazaki S, Abe T. Internet suicide searches and the incidence of suicide in young people in Japan. Eur Arch Psychiatry Clin Neurosci. 2012 Feb;262(1):39–46. doi: 10.1007/s00406-011-0212-8. [DOI] [PubMed] [Google Scholar]
- 42.Yang AC, Tsai SJ, Huang NE, Peng CK. Association of Internet search trends with suicide death in Taipei City, Taiwan, 2004-2009. J Affect Disord. 2011 Jul;132(1-2):179–84. doi: 10.1016/j.jad.2011.01.019.S0165-0327(11)00052-8 [DOI] [PubMed] [Google Scholar]
- 43.McMillan SJ. A four-part model of cyber-interactivity. New Media & Society. 2002;4:271–291. doi: 10.1177/146144480200400208. [DOI] [Google Scholar]
- 44.Mohr DC, Duffecy J, Jin L, Ludman EJ, Lewis A, Begale M, McCarthy M. Multimodal e-mental health treatment for depression: a feasibility trial. J Med Internet Res. 2010;12(5):e48. doi: 10.2196/jmir.1370. http://www.jmir.org/2010/5/e48/v12i5e48 [DOI] [PMC free article] [PubMed] [Google Scholar]