Abstract
Multiple Sclerosis (MS) is a chronic debilitating disease of probable autoimmune inflammatory nature, whose aetiology is not fully understood, despite the many efforts and investigations. In this manuscript, we review the concept of “Multiple Sclerosis 2.0”, that is to say the Internet usage by MS patients, for seeking health and disease-related material for self-care and self-management purposes, and we introduce a Google Trends-based approach for monitoring MS-related Google queries and searches, called MS infodemiology and infoveillance. Google Trends has already proven to be reliable for infectious diseases monitoring, and here we extend its application and potentiality in the field of neurological disorders.
1. Introduction
1.1. Multiple Sclerosis 2.0
Multiple Sclerosis (MS) is a chronic debilitating disease of probable autoimmune inflammatory nature, whose aetiology is not fully understood, despite the many efforts and investigations carried out [1, 2]. Being a chronic disorder, MS has a tremendous psycho-social burden [3, 4], and recently the concept of a Web-based aid for MS patients has emerged, collecting MS-related information and at the same time trying to reduce the stressors, enhancing the self-management of the disease, facilitating the interactions between the patients and the medical team, and accurately reporting to the physician the patients' symptoms after their online registration [5].
Gunther Eysenbach coined the terms “infodemiology” and “infoveillance”, describing a new emerging approach for public health [6, 7], based on large-scale monitoring and data mining, within the conceptual framework of e-health and health Web 2.0 [8, 9]. Even if with some limitations and concerns, the Internet and the medical informatics are paving the way for new directions in the field of the epidemiological research, indicating new trends and strategies [10]. In the shift from a paternalistic medicine (P0 model) to a patient-centered approach (P6 model, where the six Ps stay personalized, preventive, predictive, participatory, psycho cognitive, and public) [11–13], patients tend to use Internet as a source of relevant health-related information, even if not all properly validated or reliable, for health education, for finding suggestions, for coping strategies, and for self-managing their disease [14]. The Internet has blurred geographical boundaries and other barriers, making it available to lay people a wealth of medical material which was rather difficult to reach before that [15]. This material could help the patients in the process of decision making, providing understandable, clear information, and decreasing their anxiety level [15]. Patients are attracted by the possibility not only to access medical material, but also to upload and create their own contents (generally known as User-Generated Content (UGC), User-Driven Content (UDC), in specific cases termed as Patient-Generated Content (PGC)), and this is opening new unprecedented avenues and scenarios, which were before unforeseeable [14, 16]. New forms and ways of communication have modified the patient-physician relationship and have introduced the so-called “Patient 2.0 phenomenon” [17].
In the “Multiple Sclerosis 2.0” era, many MS patients would accept or already regularly make use of innovative Web technologies and electronic forms of communication, as reported by Haase and collaborators [18]. The number of MS patients who use YouTube to share their experiences, to seek for advice, and to evaluate and comment on other users videos is increasing. Fernandez-Luque and collaborators [19] found that MS patients using YouTube were surprisingly informed about the latest drugs against MS. Patients share their health-related status using platforms like “PatientsLike” and other forum/blogs, and this behavior has proven to result in better clinical outcomes [20, 21]. Atreja and coworkers [22] found that MS patients judged valuable and of vital importance for them to access the Internet for MS-related information. These findings confirmed the results obtained by Hay and collaborators [23], who reported that most MS patients consulted the Web before and after the medical visit, in order to better understand the technical terms used by the physicians. They should be aware of this aspect and try to use a more patient-friendly vocabulary, and they should know which material is available on the Web, in order to react to it by providing further information or correcting some mistakes, and to discuss it with the patient. On the other hand, patients themselves are not likely to report the Internet materials to the doctors, and some of them fear that doing so would mean a lack of trust in the physicians' skill and professional competence or a challenge to their authorities [24]. Other patients experience a lack of time or time burden and constraints during the visits [15]. Most patients, indeed, do not frequently bring the information surfed on the Internet to their clinic visits, that is to say sharing that material with their doctors or asking them questions based on the Web searches [15]. Moreover, doctors rarely advice their patients to search health-related material on the Internet [15]. Lejbkowicz and collaborators [25] found that most MS patients consult online information and that the Internet usage positively correlates with the MS status, severity, and degree of disability. Moreover, they consider online information as reliable but more accessible and understandable than the book and manual materials, and thus beneficial, without harmful effects. Marrie and coworkers [26] found similar results, and using a logistic regression model and younger age, less degree of disability, higher annual earning were predictor of the Internet usage. Therefore, neurologists should interact with the patients and provide them with a detached report of the effective quality of the Web-based material and refer them to specific websites, as the Information Rx project (http://www.medlineplus.com/)—a joint venture from the American College of Physicians and the National Library of Medicine (NLM)—recommends to explore different and new information channels. To better discuss with MS patients, doctors should know which are the most frequent hit searches and their needs or knowledge gaps [27]. For this purpose, Google Trends could play a major role.
1.2. Google Trends
Google Trends is a Web application that enables to visualize hit searches volumes [28]. Indeed, the Google-based approach has recently emerged as a new tool in the field of infodemiology and infoveillance [29]. It is particularly useful to monitor especially influenza epidemics [30–33]. SARS was discovered through monitoring search engines, since Larry Brilliant discovered a “viral” search of anti-influenza drugs in China [34].
Scholars have stressed the correlations between Internet search and the triage data, the hospital access, and the need of drugs [35, 36].
Google Trends has been usually used for monitoring infectious diseases (from influenza to tuberculosis and other emerging or drug-resistant infectious strains) [37, 38], but its enormous potentiality and applications in other fields of medicine have been noticed only recently. Gunn III and Lester surveyed suicides using search engines [39], and other scholars have replicated these findings [40, 41], while Deluca and collaborators exploited the Web for studying the epidemiology of drug addiction [42]. Internet key-word searching has been used also in the field of human sexuality, trying to better understand the dating and mating behaviors [43, 44]. another interesting application of Web hit search is the real-time detection of kidney stone diseases [45], but so far, to our knowledge, no one has explored the possibility of monitoring Google searches that refer to MS and associated concepts.
2. Materials and Methods
2.1. Google Trends
Google Trends, an online tracking system of Internet hit search volumes, recently merged with its sister project Google Insights for Search, which was accessed from 2004 to 2012, since data before 2004 were not available on searching for “sclerosi multipla” (Italian for MS) [28]. All the queries have been downloaded and analyzed. It is noteworthy to remember that Google Trends provides the user data that are scaled and normalized in such a way that the numbers reflect how many searches have been performed for a particular term or category, relative to the total number of queries carried out on Google over time, rather than representing absolute search volume numbers. For this reason, data are analyzed as NFV (normalized flux volume) or NSV (normalized search volume). Moreover, in order to avoid any bias in treating and manipulating the data, these have been rescaled and renormalized, taking into account the Digital Divide (North-South gradient in the access to the Internet and different Internet usages over the time). Corrections have been applied, using data from the ISTAT (Italian National Institute of Statistics). This has ensured robust findings.
2.2. Statistical Analysis
Autocorrelation is the correlation of a parameter with itself over the time; autocorrelation functions of this series of data, both crude and adjusted partial, were computed using R environment [46]. The wavelet transform of the time series and the wavelet power spectrum (WPS) analysis were carried out using algorithms written in Matlab accessible on http://paos.colorado.edu/research/wavelets/ [47, 48]. The multiple linear regression fitting was performed in R environment [49]. A list of MS symptoms and MS-related terms was searched in Italian language and their flux volumes were correlated with the MS hit search data. Pearson's correlation coefficient, that is to say the measure of the linear correlation between two variables, was calculated with SPSS software V21.0.0 package (IBM) and using R environment [50]. P-values were computed with SPSS, and values equal or less than 0.05 were considered statistically significant.
3. Results
3.1. MS Time Series
The pattern of Internet search volume (Figure 1) did not reveal a cyclic trend, as can be seen from the autocorrelation diagram (Figure 2). No annual or seasonal trends were found. The flux volume remained constant from 2004 to 2012, apart from a peak in 2007-2008 and another one in 2011-2012. However, multiannual (4-5 years) long-term trends were revealed by the exploratory analysis carried out with the WPS technique (Figure 3) and confirmed by the multiple linear regression (P value 0.023, intercept 28.76, sine-regression coefficient 1.07, and cosine-regression coefficient −0.73) (Figures 4(a) and 4(b)).
Figure 1.
Google Trends-based MS hit search volume over the years from 2004 to 2012 and forecast trend projected over 2013 (a), a map of labeled Italian towns with higher flux volumes (b), and a list of the most searched MS-related terms (c).
Figure 2.
Autocorrelation plot for the MS hit search (a) and partial autocorrelation plot (b), showing no annual cyclical pattern or regular trend.
Figure 3.
Exploratory spectral analysis, showing (a) MS time series and (b) the wavelet power spectrum (WPS) analysis. The contour levels are chosen so that 75%, 50%, 25%, and 5% of the wavelet power are above each level, respectively. (c) The global wavelet power spectrum (GWPS) analysis. These analysis were carried out using algorithms written in Matlab and accessible on http://paos.colorado.edu/research/wavelets/. Time unit is week; NSV stays for normalized search volume.
Figure 4.
(a) The wavelet transform of the MS time series data. (b) The multiple linear regression fit of the MS time series data.
3.2. MS-Related Google Trends Queries
MS therapy and symptoms are the most searched MS-related terms by the users. In most cases, the Pearson's correlation coefficients yielded a statistical significance (P-value <0.05) (Figure 5, Table 2). Some of these correlations have a positive sign, like MS and sexual dysfunctions, MS and depression (for the category of MS and symptoms), MS and Zamboni's intervention, MS and stem cells (for the category of MS and treatments/therapy), while others a negative one (viz., MS and interferon for the category of MS and treatments/therapy; MS and paresthesia; MS and dysphagia; MS and ophthalmologic symptoms; MS and gastrointestinal symptoms for the category of MS and symptoms).
Figure 5.
Pearson's correlation plots for some of the most important MS-related hit search terms.
Table 2.
Pearson's correlation coefficients for different hit search volumes related to MS and their statistical significance according to their two tails P value.
Hit search volume | Pearson's correlation coefficient | P value (two-tails) |
---|---|---|
MS and symptoms | ||
MS and fatigue | r = 0.02 | P = 0.66 |
MS and depression | r = 0.11 | P = 0.02* |
MS and anxiety | r = −0.04 | P = 0.44 |
MS and paresthesia | r = −0.11 | P = 0.01* |
MS and dysphagia | r = −0.10 | P = 0.03* |
Ophthalmologic manifestations of MS | r = −0.12 | P = 0.01* |
MS and dysarthria | r = −0.00 | P = 0.96 |
MS and bladder problems | r = 0.04 | P = 0.36 |
MS and gastrointestinal problems | r = −0.14 | P = 0.00* |
MS and sexual dysfunction | r = 0.10 | P = 0.03* |
| ||
MS and treatments/therapy | ||
MS and Paolo Zamboni's therapy | r = 0.35 | P = 0.00* |
MS and stem cells | r = 0.12 | P = 0.01* |
MS and methotrexate | r = −0.09 | P = 0.05 |
MS and corticosteroids | r = −0.07 | P = 0.15 |
MS and interferon | r = −0.10 | P = 0.04* |
*Statistically significant.
4. Discussion
4.1. MS Time Series
The main finding of this article is the feasibility of adopting a Google Trends-based survey for MS. The results have been compared with those present in the literature (about epidemiology, both temporal and spatial, and the Internet usage) and have been validated.
Two main peaks can be observed in the time series. The first one is related to the public disclosure of Nicoletta Mantovani of being suffering from MS. The second observed peak may be correlated with the introduction of Paolo Zamboni's therapy, which attracted a lot of media and layed public interest. Paolo Zamboni's therapy is a controversial surgical operation, devoted to cure the Chronic Cerebrospinal Venous Insufficiency (CCSVI), a new nosological entity which Zamboni suggested to be the cause or one of the causes of MS in a high percentage of MS patients [51]. As noticed by Vera et al. [52] and by Machan and collaborators [53], the number of online resources and material related to CCSVI is increasing, and peer groups are discussing this opportunity on social networks and dedicated forums. Nicoletta Mantovani herself announced she was healed after undergoing Zamboni's operation. Apart from these peaks, that can be considered as transitory bursts, the search volume remained quite constant. Other studies have validated this finding, confirming that media interests do not perturb time series which are rather robust (see, e.g., [54] and references therein).
It is controversial whether the prevalence and the incidence of MS have remained unvaried or increased in the last years, since some studies report an observed increase [55–58], while other fail to replicate these findings [59]. Some scholars have argued that the increase could be explained taking into account environmental factors, while others have stated that it is only an apparent increase which may be due to confounding biases, better diagnostic criteria and therefore better case ascertainment, and longer survival rates as well as newly introduced diagnostic criteria and definitions, incorporating more sophisticated and particularly sensitive para-clinical and preclinical tools, and availability and accessibility of qualified structures and personnel [60]. However, Google Trends data were not available before 2004 and we failed to investigate MS-related queries over a longer range.
It is interesting to notice that the Italian towns with the higher searching fluxes and volumes include Cagliari, and Sardinia is a well-known high risk area [61, 62] (Figure 1, Table 1). The other towns are equally spatially distributed; that is to say we do not observe any geographical gradient between North and South in terms of Google Trends query and search fluxes and volumes, as confirmed by many detailed epidemiological Italian surveys, which have proven to be against the “latitude theory” introduced by Millefiorini et al. [63]. However, it must be noticed that some scholars while criticizing the latitudinal gradient theory for incidence maintain that the latitudinal gradient theory for prevalence may be still valid [64].
Table 1.
A list of the towns (first column) with the higher normalized MS hit search flux volumes (NFV), as provided by Google Trends. In the third column, these crude NFV data have been rescaled taking into account the Digital Divide and North-South access to the Internet (according to the ISTAT) and re-normalized. We term these data the adjusted NFV.
City/town | Crude NFV (%) | Adjusted NFV (%) |
---|---|---|
Cagliari | 100 | 100 |
Rome | 80 | 93 |
Milan | 80 | 93 |
Turin | 74 | 86 |
Pescara | 71 | 82 |
Palermo | 69 | 66 |
Bologna | 69 | 80 |
Bari | 67 | 64 |
Cosenza | 67 | 64 |
Perugia | 66 | 77 |
Padua | 65 | 75 |
Genoa | 65 | 75 |
Catania | 64 | 61 |
Florence | 62 | 72 |
Ancona | 60 | 70 |
4.2. MS Google Trends Queries
We divided the most search terms in two categories, namely, and MS and symptoms, MS and treatments/therapy. This finding confirms a research carried out by Lejbkowicz and collaborators [25] that “understanding the disease” and “treatments” were the most viewed topics. Even though statistically significant, each MS-related term has a low Pearson's correlation coefficient, and for this reason only a panel of several words reach a good overall coefficient. This suggests that MS patients would not be limited to search for a few words, but for an array of terms. The different signs (minus and plus) of the correlations may reflect a different time pattern of MS-related queries and could help the clinicians in better understanding the patients' needs and requests.
4.3. Limitations
However, this study has some limitations. For example, we monitored the trend of the Internet searches volumes over the time, but we did not investigate the completeness nor the reliability of the Web material related to MS. For these reasons, this study should be complemented with a content analysis of the Web sites and with ad hoc surveys to MS patients, asking them their understanding and their reaction to the online material and information, as well as their Internet usage. Actually, this is a serious gap in the current Italian research. It would be clinically important to design specific Web content, in order to meet the patients needs, requests, and expectations. Moreover, this could pave the way for interventions made directly by the practitioners to interact with the patients, to post high-quality material dedicated to MS symptoms and treatments, and answer patients' doubts and questions. Lowe-Strong and McCullagh [65] implemented a Web Portal endowed with a user-friendly visual interface for pain and MS-related symptoms self-recording, while other sites enabling the self-monitoring of MS symptoms, prescriptions orders, laboratory and clinical results retrieval, online patient education, news and updates on MS research, and a timely communication with the medical staff are being designed [66]. Recently, Jones and coworkers have created a dynamic interactive Web Portal, where MS patients can record their symptoms and the quality of life [67]. Boeschoten and collaborators [68] developed a Web-based problem-solving treatment (PST) specifically designed for MS patients suffering from depressive symptoms.
5. Conclusion
In this contribution, we showed that a Google Trends-based infodemiology and infoveillance system could be successfully applied also to monitor MS-related information and Google queries and probably to other chronic degenerative disorders, and not only to infectious diseases. Even with its warranted limitations, Web-based epidemiology has a promising potentiality.
References
- 1.Tullman MJ. Overview of the epidemiology, diagnosis, and disease progression associated with multiple sclerosis. American Journal of Managed Care. 2013;19(supplement 2):S15–S20. [PubMed] [Google Scholar]
- 2.Bordi I, Umeton IR, Ricigliano VA, et al. A mechanistic, stochastic model helps understand multiple sclerosis course and pathogenesis. International Journal of Genomics. 2013;2013:10 pages. doi: 10.1155/2013/910321.910321 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Bragazzi NL. The gap in the current research on the link between health locus of control and multiple sclerosis: lessons and insights from a systematic review. Multiple Sclerosis International. 2013;2013:8 pages. doi: 10.1155/2013/972471.972471 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Del Puente G, Mahamid A, Bragazzi NL. Health locus of control and multiple sclerosis: a systematic review. Journal of Psychology and Psychotherapy. 2012;S3:p. 001. [Google Scholar]
- 5.Ford DV, Jones KH, Middleton RM, et al. The feasibility of collecting information from people with Multiple Sclerosis for the UK MS Register via a web portal: characterising a cohort of people with MS. BMC Medical Informatics and Decision Making. 2012;12:p. 73. doi: 10.1186/1472-6947-12-73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Eysenbach G. Infodemiology and infoveillance: tracking online health information and cyberbehavior for public health. American Journal of Preventive Medicine. 2011;40(5):S154–S158. doi: 10.1016/j.amepre.2011.02.006. [DOI] [PubMed] [Google Scholar]
- 7.Eysenbach G. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. Journal of Medical Internet Research. 2009;11(1):p. e11. doi: 10.2196/jmir.1157. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Burkow TM, Vognild LK, Krogstad T, et al. Studies in Health Technology and Informatics. Vol. 136. IOS Press; 2008. An easy to use and affordable home-based personal eHealth system for chronic disease management based on free open source software; pp. 83–88. [PubMed] [Google Scholar]
- 9.Giustini D. How Web 2.0 is changing medicine. British Medical Journal. 2006;333(7582):1283–1284. doi: 10.1136/bmj.39062.555405.80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lee BK. Epidemiologic research and Web 2.0-the user-driven Web. Epidemiology. 2010;21(6):760–763. doi: 10.1097/EDE.0b013e3181f5a75f. [DOI] [PubMed] [Google Scholar]
- 11.Bragazzi NL. From P0 to P6 Medicine, a model of highly participatory, narrative, interactive and “augmented” medicine: some considerations on Salvatore Iaconesi's clinical history. Patient Preference and Adherence. 2013;(7):353–359. doi: 10.2147/PPA.S38578. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Bragazzi NL. Children, adolescent and young adults participatory medicine: involving them in the health care process as a strategy for facing infertility issue. American Journal of Bioethics. 2013;13(3) doi: 10.1080/15265161.2012.760674. [DOI] [PubMed] [Google Scholar]
- 13.Bragazzi NL, Del Puente G. Why P6 medicine needs clinical psychology and a trans-cultural approach. Health Psychology Research. 2013;1(1):p. e5. doi: 10.4081/hpr.2013.e5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Burton A. YouTube-ing your way to neurological knowledge. The Lancet Neurology. 2008;7(12):1086–1087. doi: 10.1016/S1474-4422(08)70252-7. [DOI] [PubMed] [Google Scholar]
- 15.Blanch D, Sciamanna C, Lawless H, Diaz J. Effect of the internet on the doctor-patient relationship: a review of the literature. Journal on Information Technology in Healthcare. 2005;3(3):179–201. [Google Scholar]
- 16.Kim JY, Gudewicz TM, Dighe AS, Gilbertson JR. The pathology informatics curriculum wiki: harnessing the power of user-generated content. Journal of Pathology Informatics. 2010;(1):p. 10. doi: 10.4103/2153-3539.65428. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Bos L, Marsh A, Carroll D, Gupta S, Rees M. Patient 2.0 empowerment. Proceedings of International Conference on Semantic Web and Web Services (SWWS '08); July 2008; pp. 164–168. [Google Scholar]
- 18.Haase R, Schultheiss T, Kempcke R, Thomas K, Ziemssen T. Use and acceptance of electronic communication by patients with multiple sclerosis: a multicenter questionnaire study. Journal of Medical Internet Research. 2012;14(5, article e135) doi: 10.2196/jmir.2133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Fernandez-Luque L, Elahi N, Grajales FJ., III An analysis of personal medical information disclosed in youtube videos created by patients with multiple sclerosis. Proceedings of the 22nd International Conference on Medical Informatics Europe (MIE '09); September 2009; pp. 292–296. [PubMed] [Google Scholar]
- 20.Wicks P, Massagli M, Frost J, et al. Sharing health data for better outcomes on patientslikeme. Journal of Medical Internet Research. 2010;12(2) doi: 10.2196/jmir.1549. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Smith CA, Wicks PJ. PatientsLikeMe: consumer health vocabulary as a folksonomy. AMIA Annual Symposium Proceedings. 2008:682–686. [PMC free article] [PubMed] [Google Scholar]
- 22.Atreja A, Mehta N, Miller D, et al. One size does not fit all: using qualitative methods to inform the development of an Internet portal for multiple sclerosis patients. AMIA Annual Symposium Proceedings. 2005:16–20. [PMC free article] [PubMed] [Google Scholar]
- 23.Hay MC, Strathmann C, Lieber E, Wick K, Giesser B. Why patients go online: multiple sclerosis, the internet, and physician-patient communication. Neurologist. 2008;14(6):374–381. doi: 10.1097/NRL.0b013e31817709bb. [DOI] [PubMed] [Google Scholar]
- 24.Murray E, Lo B, Pollack L, et al. The impact of health information on the Internet on health care and the physician-patient relationship: National U.S. survey among 1.050 U.S. Physicians. Journal of Medical Internet Research. 2003;5(3, article e17):38–53. doi: 10.2196/jmir.5.3.e17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Lejbkowicz I, Paperna T, Stein N, Dishon S, Miller A. Internet usage by patients with multiple sclerosis: implications to participatory medicine and personalized healthcare. Multiple Sclerosis International. 2010;2010:7 pages. doi: 10.1155/2010/640749.640749 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Marrie RA, Salter AR, Tyry T, Fox RJ, Cutter GR. Preferred sources of health information in persons with multiple sclerosis: degree of trust and information sought. Journal of Medical Internet Research. 2013;15(4, article e67) doi: 10.2196/jmir.2466. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Wollin J, Dale H, Spencer N, Walsh A. The informational needs of the newly diagnosed person with multiple sclerosis and their family. International Journal of MS Care. 2000;2(3):1–12. [Google Scholar]
- 28. http://www.google.com/trends/
- 29.Khan AS, Fleischauer A, Casani J, Groseclose SL. The next public health revolution: public health information fusion and social networks. American Journal of Public Health. 2010;100(7):1237–1242. doi: 10.2105/AJPH.2009.180489. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Kang M, Zhong H, He J, et al. Using Google trends for influenza surveillance in South China. PLoS ONE. 2013;8(1) doi: 10.1371/journal.pone.0055205.e55205 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Pervaiz F, Pervaiz M, Abdur Rehman N, Saif U. FluBreaks: early epidemic detection from Google flu trends. Journal of Medical Internet Research. 2012;14(5, article e125) doi: 10.2196/jmir.2102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Cook S, Conrad C, Fowlkes AL, Mohebbi MH. Assessing Google flu trends performance in the United States during the 2009 influenza virus A (H1N1) pandemic. PLoS ONE. 2011;6(8) doi: 10.1371/journal.pone.0023610.e23610 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature. 2009;457(7232):1012–1014. doi: 10.1038/nature07634. [DOI] [PubMed] [Google Scholar]
- 34.Heymann DL, Brilliant L. Surveillance in eradication and elimination of infectious diseases: a progression through the years. Vaccine. 2011;29(4):D141–D144. doi: 10.1016/j.vaccine.2011.12.135. [DOI] [PubMed] [Google Scholar]
- 35.Dugas AF, Hsieh Y-H, Levin SR, et al. Google flu trends: correlation with emergency department influenza rates and crowding metrics. Clinical Infectious Diseases. 2012;54(4):463–469. doi: 10.1093/cid/cir883. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Malik MT, Gumel A, Thompson LH, Strome T, Mahmud SM. “Google flu trends” and emergency department triage data predicted the 2009 pandemic H1N1 waves in Manitoba. Canadian Journal of Public Health. 2011;102(4):294–297. doi: 10.1007/BF03404053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Dukic VM, David MZ, Lauderdale DS. Internet queries and methicillin-resistant staphylococcus aureus surveillance. Emerging Infectious Diseases. 2011;17(6):1068–1070. doi: 10.3201/eid1706.101451. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Zhou X, Ye J, Feng Y. Tuberculosis surveillance by analyzing Google trends. IEEE Transactions on Bio-medical Engineering. 2011;58(8):2247–2254. doi: 10.1109/TBME.2011.2132132. [DOI] [PubMed] [Google Scholar]
- 39.Gunn JF, III, Lester D. Using Google searches on the internet to monitor suicidal behavior. Journal of Affective Disorders. 2013;148(2-3):411–412. doi: 10.1016/j.jad.2012.11.004. [DOI] [PubMed] [Google Scholar]
- 40.Sueki H. Does the volume of internet searches using suicide-related search terms influence the suicide death rate: data from 2004 to 2009 in Japan. Psychiatry and Clinical Neurosciences. 2011;65(4):392–394. doi: 10.1111/j.1440-1819.2011.02216.x. [DOI] [PubMed] [Google Scholar]
- 41.Yang AC, Tsai S-J, Huang NE, Peng C-K. Association of Internet search trends with suicide death in Taipei City, Taiwan, 2004–009. Journal of Affective Disorders. 2011;132(1-2):179–184. doi: 10.1016/j.jad.2011.01.019. [DOI] [PubMed] [Google Scholar]
- 42.Deluca P, Davey Z, Corazza O, et al. Identifying emerging trends in recreational drug use; outcomes from the Psychonaut Web Mapping Project. Progress in Neuro-Psychopharmacology and Biological Psychiatry. 2012;39(2):221–226. doi: 10.1016/j.pnpbp.2012.07.011. [DOI] [PubMed] [Google Scholar]
- 43.Markey PM, Markey CN. Seasonal variation in internet keyword searches: a proxy assessment of sex mating behaviors. Archives of Sexual Behavior. 2013;42(4):515–521. doi: 10.1007/s10508-012-9996-5. [DOI] [PubMed] [Google Scholar]
- 44.Davis NF, Smyth LG, Flood HD. Detecting internet activity for erectile dysfunction using search engine query data in the Republic of Ireland. BJU International. 2012;110(11):E939–E942. doi: 10.1111/j.1464-410X.2012.11237.x. [DOI] [PubMed] [Google Scholar]
- 45.Willard SD, Nguyen MM. Internet search trends analysis tools can provide real-time data on kidney stone disease in the United States. Urology. 2013;81(1):37–42. doi: 10.1016/j.urology.2011.04.024. [DOI] [PubMed] [Google Scholar]
- 46.Wessa P. (Partial) Autocorrelation Function (v1.0.11) in Free Statistics Software (v1.1.23-r7) Office for Research Development and Education, http://www.wessa.net/rwasp_autocorrelation.wasp/
- 47.Torrence C, Compo GP. A practical guide to wavelet analysis. Bulletin of the American Meteorological Society. 1998;79(1):61–78. [Google Scholar]
- 48.Grenfell BT, Bjørnstad ON, Kappey J. Travelling waves and spatial hierarchies in measles epidemics. Nature. 2001;414(6865):716–723. doi: 10.1038/414716a. [DOI] [PubMed] [Google Scholar]
- 49.Wessa P. Multiple Regression (v1.0.26) in Free Statistics Software (v1.1.23-r7) Office for Research Development and Education, http://www.wessa.net/rwasp_multipleregression.wasp/
- 50.Wessa P. Pearson Correlation (v1.0.6) in Free Statistics Software (v1.1.23-r7) Office for Research Development and Education, http://www.wessa.net/rwasp_correlation.wasp/
- 51.Singh AV, Zamboni P. Anomalous venous blood flow and iron deposition in multiple sclerosis. Journal of Cerebral Blood Flow and Metabolism. 2009;29(12):1867–1878. doi: 10.1038/jcbfm.2009.180. [DOI] [PubMed] [Google Scholar]
- 52.Vera C, Herr A, Mandato K, Englander M, Ginsburg L, Siskin GP. Internet-based social networking and its role in the evolution of chronic cerebrospinal venous insufficiency. Techniques in Vascular and Interventional Radiology. 2012;15(2):153–157. doi: 10.1053/j.tvir.2012.02.009. [DOI] [PubMed] [Google Scholar]
- 53.Machan L, Murphy K, Traboulsee T. Multiple sclerosis and venous abnormalities: medicine in the age of social media. Canadian Association of Radiologists Journal. 2012;63:S2–S4. doi: 10.1016/j.carj.2011.12.007. [DOI] [PubMed] [Google Scholar]
- 54.Ayers JW, Althouse BM, Allem JP, Rosenquist JN, Ford DE. Seasonality in seeking mental health information on google. American Journal of Preventive Medicine. 2013;44(5):520–525. doi: 10.1016/j.amepre.2013.01.012. [DOI] [PubMed] [Google Scholar]
- 55.Puthenparampil M, Seppi D, Rinaldi F, et al. Increased incidence of multiple sclerosis in the Veneto region, Italy. Multiple Sclerosis. 2013;19(5):601–604. doi: 10.1177/1352458512461970. [DOI] [PubMed] [Google Scholar]
- 56.Nicoletti A, Lo Bartolo ML, Lo Fermo S, et al. Prevelence and incidence of multiple sclerosis in Catania, Sicily. Neurology. 2001;56(1):62–66. doi: 10.1212/wnl.56.1.62. [DOI] [PubMed] [Google Scholar]
- 57.Solaro C, Allemani C, Messmer Uccelli M, et al. The prevalence of multiple sclerosis in the north-west Italian province of Genoa. Journal of Neurology. 2005;252(4):436–440. doi: 10.1007/s00415-005-0670-x. [DOI] [PubMed] [Google Scholar]
- 58.Granieri E, Monaldini C, De Gennaro R, et al. Multiple sclerosis in the Republic of San Marino: a prevalence and incidence study. Multiple Sclerosis. 2008;14(3):325–329. doi: 10.1177/1352458507084114. [DOI] [PubMed] [Google Scholar]
- 59.Ranzato F, Perini P, Tzintzeva E, et al. Increasing frequency of multiple sclerosis in Padova, Italy: a 30 year epidemiological survey. Multiple Sclerosis. 2003;9(4):387–392. doi: 10.1191/1352458503ms920oa. [DOI] [PubMed] [Google Scholar]
- 60.Trojano M, Lucchese G, Graziano G, et al. Geographical variations in sex ratio trends over time in multiple sclerosis. PLoS ONE. 2012;7(10) doi: 10.1371/journal.pone.0048078.e48078 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Cocco E, Sardu C, Massa R, et al. Epidemiology of multiple sclerosis in south-western Sardinia. Multiple Sclerosis. 2011;17(11):1282–1289. doi: 10.1177/1352458511408754. [DOI] [PubMed] [Google Scholar]
- 62.Pugliatti M, Sotgiu S, Solinas G, et al. Multiple sclerosis epidemiology in Sardinia: evidence for a true increasing risk. Acta Neurologica Scandinavica. 2001;103(1):20–26. doi: 10.1034/j.1600-0404.2001.00207.x. [DOI] [PubMed] [Google Scholar]
- 63.Millefiorini E, Cortese A, Di Rezze S, et al. The prevalence of multiple sclerosis in central Italy. Multiple Sclerosis. 2010;16(12):1432–1436. doi: 10.1177/1352458510373263. [DOI] [PubMed] [Google Scholar]
- 64.Koch-Henriksen N, Sorensen PS. Why does the north-south gradient of incidence of multiple sclerosis seem to have disappeared on the Northern hemisphere? Journal of the Neurological Sciences. 2011;311(1-2):58–63. doi: 10.1016/j.jns.2011.09.003. [DOI] [PubMed] [Google Scholar]
- 65.Lowe-Strong A, McCullagh PJ. Monitoring of symptoms and interventions associated with multiple sclerosis. Studies in Health Technology and Informatics. 2005;117:223–228. [PubMed] [Google Scholar]
- 66.Wardell L, Laizner AM, Lapierre Y. Multiple sclerosis patients' interest in and likelihood of using online health-care services. International Journal of Multiple Sclerosis Care. 2009;11(2):79–89. [Google Scholar]
- 67.Jones KH, Ford DV, Jones PA, et al. The physical and psychological impact of multiple sclerosis using the MSIS-29 via the web portal of the UK MS Register. PLoS ONE. 2013;8(1) doi: 10.1371/journal.pone.0055422.e55422 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Boeschoten RE, Dekker J, Uitdehaag BM, et al. Internet-based self-help treatment for depression in multiple sclerosis: study protocol of a randomized controlled trial. BMC Psychiatry. 2012;12:p. 137. doi: 10.1186/1471-244X-12-137. [DOI] [PMC free article] [PubMed] [Google Scholar]