Abstract
Background
Despite the growing accessibility of web-based information related to spinal cord stimulation (SCS), the content and quality of commonly encountered websites remain unknown.
Objective
This study aimed to assess the content and quality of web-based information on SCS.
Methods
This qualitative study was prospectively registered in Open Science Framework. Google Trends was used to identify the top trending, SCS-related search queries from 2012 to 2022. Top queried terms were then entered into separate search engines. Information found on websites within the first 2 pages of results was extracted and assessed for quality using the DISCERN instrument, the Journal of the American Medical Association benchmark criteria, and the Health on the Net Foundation code of conduct certification. Website readability and SCS-related information were also assessed.
Results
After exclusions, 42 unique sites were identified (scientific resources: n=6, nonprofit: n=12, for-profit: n=20, news or media: n=2, and personal or blog: n=2). Overall, information quality was moderate (DISCERN). Few sites met all the Journal of the American Medical Association benchmark criteria (n=3, 7%) or had Health on the Net Foundation certification (n=7, 16%). On average, information was difficult to read, requiring a 9th- to 10th-grade level of reading comprehension. Sites described SCS subcategories (n=14, 33%), indications (n=38, 90%), contraindications (n=14, 33%), side effects or risks (n=28, 66%), device considerations (n=25, 59%), follow-up (n=22, 52%), expected outcomes (n=31, 73%), provided authorship details (n=20, 47%), and publication dates (n=19, 45%). The proportion of for-profit sites reporting authorship information was comparatively less than other site types (n=3, 15%). Almost all sites focused on surgically implanted SCS (n=37, 88%). On average, nonprofit sites contained the greatest number of peer-reviewed reference citations (n=6, 50%). For-profit sites showed the highest proportion of physician or clinical referrals among site types (n=17, 85%) indicating implicit bias (ie, auto-referral).
Conclusions
Overall, our findings suggest the public may be exposed to incomplete or dated information from unidentifiable sources that could put consumers and patient groups at risk.
Keywords: access to information, consumer health information, internet, spinal cord stimulation, web-based information, communication, quality, readability, Google Trends, misinformation, synthesis
Introduction
Background
Spinal cord stimulation (SCS) is an emerging therapeutic approach that has been used as an intervention to address chronic pain [1,2], paralysis, and autonomic dysfunctions [3,4] resulting from injury and disease. SCS delivers electrical stimulation to the spinal cord using invasive or noninvasive interfaces. Groundbreaking pilot studies involving individuals with paralysis after spinal cord injury have demonstrated the potential benefits of SCS for improving functional recovery [5,6], resulting in a growing demand for information related to SCS among various consumer or patient groups, their caregivers, and the general public [7]. In the absence of evidence-based guidelines and standardized treatment options, people living with long-term disease and disability are likely to turn to other sources of information (eg, web-based search results), and potentially alternative treatment options (eg, advertised devices and surgical procedures), to help manage their condition. However, web-based information on SCS has not been evaluated in depth.
Currently, the US Food and Drug Administration [8] has only approved the use of epidural spinal cord stimulation (ESCS; ie, surgically implanted) to manage failed back surgery syndrome, refractory angina pectoris, peripheral arterial disease, complex regional pain syndrome, painful diabetic neuropathy as well as nonsurgical low back pain. Whether publicly accessible websites curating information on SCS provide clear indications (or contraindications) for the intended use (or potential risk) of this therapeutic modality remains unknown. Over the next decade, medical consumerism is projected to grow as people seeking treatment become more knowledgeable and active in their care through the expansion of web-based resources and the availability of medical information [9]. As the marketing of SCS to treat or manage various conditions expands concomitantly with the fragmentation of web-based medical information [10] and the gradual erosion of routine patient-to–health care provider interactions [11], patients may become more vulnerable to predatory marketing strategies that inflate the benefits of SCS while obscuring or underreporting its potential harms [12]. This market-driven shift by which medical information is being provided and subsequently accessed may engender patient consumerism and potentially enhance the pecuniary opportunities for SCS device manufacturers and health care providers [13].
Rationale
Many internet searches are health-related (eg, 4.5% of 6.75 million daily searches in 2003) and are usually conducted using the most popular search engines (eg, Google) [14,15] rather than by directly accessing individual websites exclusively dedicated to the provision of medical information. Though the amount of published research on the topic of SCS has risen exponentially in the past decade [7], the pervasiveness of health-related misinformation on publicly accessible web-based platforms has grown in tandem [13,16]. Previous studies have shown that misinformation is commonly encountered on sites describing disease prevalence [10,17], evaluation [18], available treatment options [19], and medical management recommendations [20-22].
Misinformation may present as information that is either lacking in critical detail, misleading or factually incorrect, or out-of-date and not substantiated by current evidence [16]. The amount, quality, and relevance of the information returned by a given search engine query may vary substantially [23]. Website order in a returned search is also important, as preferential positioning determines what information (eg, medical treatment and management) is accessed first, independent of content [24] and quality [25]. Most user traffic (ie, 92%) is often confined to the top results found within the first search page, with roughly one-third of all user traffic attributed to the first listed result [26]. Furthermore, the provision of health-related information on websites with substantial user traffic is often inconsistent with evidence-based guidelines and best practice recommendations [25,27]. As the pursuit and use of web-based health-related information continues to outpace and even remodel conventional patient-to-health care provider interactions [11,13], it is important that web-based information is critically appraised.
Objectives
The objectives of this qualitative study were (1) to systematically map web-based resources containing SCS-related information using common search methods that are openly and freely available to the general public and (2) to assess the content and quality of information regarding the use of SCS for the treatment or management of health conditions or symptoms.
Methods
Ethical Considerations
Ethics approval was not required for this study, as it did not involve human participants.
Search Strategy and Inclusion Criteria
This study was prospectively registered in Open Science Framework [28]. A pilot search was conducted to identify the most popular search terms (worldwide) within the last decade (2012 to 2022) for the topic “spinal cord stimulator” using Google Trends (Figure 1). All searches were performed using a United States IP designation to standardize the country-specific origin of returned results for each search engine [17]. A detailed description of the search strategy using the highest trending search queries (ie, “spinal stimulator” and “spinal cord stimulator”) is provided in the Search Strategy section in Multimedia Appendix 1 [17,28-77].
Figure 1.
Search term identification. (A) Search terms with relevance to spinal cord stimulation were identified using Google Trends. Topic search using the term “spinal cord stimulator” was used to identify the top related queries: 1=spinal stimulator, 2=spinal cord stimulator, 3=spinal stimulation, and 4=spinal cord stimulation. Among the top queried terms, 1=spinal stimulator and 2=spinal cord stimulator ranked the highest in terms of relative search term popularity. (B) Search interest for the topic term “spinal cord stimulator” by global region indicated the United States (n=100), followed by Ireland (n=53), Laos (n=45), Australia (n=45), and United Kingdom (n=30) had the highest proportion of all queries (ie, not the highest number of queries) for this topic term within the specified timeframe (2012-2022).
This study considered publicly accessible websites providing information on SCS. Websites were categorized as scientific resources (ie, academic institutions and government organizations), nonprofit or foundations or advocacy organizations, for-profit or private sector or industry, news or media, or independent sources or personal blogs in accordance with subcategorizations previously outlined by Fisher et al [17]. Sites were not excluded on the basis of origin or date. Peer-reviewed papers or book chapters hosted by journal publisher websites were not included in the data extraction. Evidence suggests the general public may be unable to interpret or understand all scientific content found within peer-reviewed literature (ie, accessibility or readability of information) [78]. As this content has already been subjected to professional scrutiny from subject-area experts and editorial revision of considerable rigor or is altogether inaccessible (eg, paywall restricted), this information was not evaluated. Advertisement sites that did not include information relevant to SCS were also excluded.
Data Extraction
Data were extracted by 2 independent authors, and discrepancies were resolved through discussion or consensus with a third author. Extracted data included website type [17], characteristics (ie, site title, address [URL], publication date or most recent update, author names and credentials, country of origin or geographical designation, alternate accessibility options (format), and number of peer-reviewed reference citations), and SCS-related information provided (ie, SCS definition or summary, indications, contraindications, side effects or risks, device considerations, follow-up, outcomes, intended audience [consumer or caregiver, researcher or clinician, or both], and referral to a health care professional [eg, physician and therapist] or clinic).
Quality and Readability
In accordance with methods described in previous studies [17,18], the quality of the information provided on each website was assessed by 2 independent authors using the DISCERN instrument [29], the Journal of the American Medical Association (JAMA) benchmark criteria [30], and Health on the Net Foundation (HON) code of conduct certification [31]. Readability for each site was determined using the Flesch-Kincaid indices [32]. These assessments are described in detail in the Quality and Readability Assessments section in Multimedia Appendix 1.
Data Synthesis
Data extracted from websites were tabulated and aggregated according to site type. Websites were also explored for high-frequency keywords. Webpages were imported as PDF to NVivo software (version 12; QRS International Pty Ltd) and archived for further analysis using the NCapture extension in Google Chrome. Website text from imported PDF files was then used to generate word clouds and frequency tables. Descriptive analyses were performed using SPSS software (version 28; IBM Corp). Average scores and ratings for each site type are expressed as mean and SD, median and IQR, or frequencies (n) and proportions (%) for continuous, ordinal, and dichotomous levels of data, respectively.
Results
Screening and Search Term Frequency
Using the term “spinal stimulator” in the first search and “spinal cord stimulator” in the second search (Figure 1), a total of 202 results were returned (Google: n=56, Baidu: n=39, Yahoo: n=58, and Bing: n=49). After exclusions (ie, duplicates, advertisements, and sites unrelated to SCS), a total of 57 unique websites were identified. Of these, 15 were host sites for peer-reviewed journal papers (n=8), book chapters (n=4), or patent applications (n=3) and were thus excluded from the main synthesis. Of the remaining 42 sites, the majority were categorized as for-profit (n=20) followed by nonprofit (n=12), scientific resource (n=6), news or media (n=2), and personal or blog site types (n=2). A flow diagram outlining the screening procedure is provided in Table 1.
Table 1.
Search results and website selection.
| Screening procedure | Search engine | ||||
|
|
Google, n (%) | Baidu, n (%) | Yahoo, n (%) | Bing, n (%) | |
| Initial search results (n=202) | 56 (28) | 39 (19) | 58 (29) | 49 (24) | |
| Unique sites after duplicates (n=57) | 23 (40) | 15 (26) | 6 (11) | 13 (23) | |
| Eligibility criteria not met | |||||
|
|
Journal papers (n=8) | 3 (37) | 5 (63) | —a | — |
|
|
Book chapters (n=4) | 2 (50) | — | 1 (25) | 1 (25) |
|
|
Patent applications (n=3) | — | 3 (100) | — | — |
|
|
Included websites (n=42) | 18 (43) | 7 (17) | 5 (12) | 12 (28) |
aNot available.
Word frequencies for each search term used (ie, spinal, cord, and stimulator) are provided in Table 2 and Figure S1 in Multimedia Appendix 1. Word cloud and word frequency summaries are also provided in Figure S1 in Multimedia Appendix 1. Word frequency summaries showed that the occurrence of individual words comprising the search topic (ie, “spinal,” “cord,” and “stimulator”) was among the most frequent. This suggests the returned search results are likely to be an accurate representation of the web-based resources and SCS-related information that consumers would encounter irrespective of the search engine used [79,80]. Average occurrence (ie, frequency) of all 3 search terms was highest for scientific resource sites (spinal: mean 25.7, SD 16; cord: mean 23.7, SD 14.5; and stimulator: mean 13.8, SD 13.3), while proportional usage (ie, relative to all other words) was highest among personal or blog sites for the terms “spinal” (mean 4.4, SD 2.7) and “stimulator” (mean 3.5, SD 3.2) and news or media sites for the term “cord” (mean 5.4, SD 6.8).
Table 2.
Quality, readability, and search term frequency.
| Website category | Scientific resource (n=6) | Nonprofit (n=12) | For-profit (n=20) | News or media (n=2) | Personal or blog (n=2) | |||||
| DISCERN, median (IQR) | ||||||||||
|
|
Item 1 (clear aims) | 5 (5-5) | 5 (5-5) | 5 (5-5) | 5 (5-5) | 5 (5-5) | ||||
|
|
Item 2 (achieved aims) | 5 (5-5) | 5 (5-5) | 5 (5-5) | 5 (5-5) | 5 (5-5) | ||||
|
|
Item 3 (relevant) | 5 (4.5-5) | 5 (5-5) | 5 (5-5) | 5 (5-5) | 5 (5-5) | ||||
|
|
Item 4 (information source) | 1 (1-2) | 1 (1-5) | 1 (1-1) | 3 (1-3) | 1 (1-1) | ||||
|
|
Item 5 (publication date) | 2 (1-5) | 5 (1-5) | 1 (1-1) | 5 (5-5) | 1 (1-1) | ||||
|
|
Item 6 (balanced and unbiased) | 5 (3.25-5) | 5 (1.5-5) | 1.5 (1-3) | 2.5 (2-2.5) | 3 (2-3) | ||||
|
|
Item 7 (additional information sources) | 2 (1-3.5) | 3 (1-5) | 1 (1-3) | 3 (1-3) | 2.5 (1-2.5) | ||||
|
|
Item 8 (areas of uncertainty) | 3.5 (2.75-5) | 3 (1-5) | 3 (2-3.75) | 4 (4-4) | 2 (1-2) | ||||
|
|
Item 9 (defines treatment) | 5 (4.75-5) | 4 (1.25-5) | 5 (4-5) | 3 (1-3) | 3 (1-3) | ||||
|
|
Item 10 (describes benefits) | 5 (5-5) | 5 (1.5-5) | 5 (2-5) | 5 (5-5) | 5 (5-5) | ||||
|
|
Item 11 (describes risks) | 5 (1-5) | 4 (1-5) | 2 (1-5) | 3.5 (2-3.5) | 1 (1-1) | ||||
|
|
Item 12 (no treatment or usual care outcomes) | 1 (1-2) | 1 (1-4) | 1 (1-1.75) | 1 (1-1) | 3 (1-3) | ||||
|
|
Item 13 (effect on quality of life) | 5 (4.5-5) | 5 (1-5) | 5 (2.25-5) | 5 (5-5) | 5 (5-5) | ||||
|
|
Item 14 (alternative treatment choices) | 2 (1-5) | 1.5 (1-5) | 1 (1-5) | 2 (1-2) | 3 (1-3) | ||||
|
|
Item 15 (shared decision-making support) | 3 (2.75-5) | 3 (1-4) | 3 (3-3.75) | 3 (3-3) | 3 (1-3) | ||||
|
|
Item 16 (overall) | 3.5 (2.75-4) | 3 (2.25-4) | 3 (2-3) | 2 (2-2) | 2.5 (2-2.5) | ||||
| JAMAa benchmark criteria, median (IQR) | ||||||||||
|
|
Benchmark 1 (authorship) | 1 (0.38-1) | 1 (0.63-1) | 0 (0-0.38) | 1 (1-1) | 1 (1-1) | ||||
|
|
Benchmark 2 (attribution) | 0 (0-0.25) | 0 (0-1) | 0 (0-0) | 0 (0-0) | 0 (0-0) | ||||
|
|
Benchmark 3 (currency) | 1 (0.75-1) | 1 (1-1) | 1 (1-1) | 0.75 (0.5-0.75) | 1 (1-1) | ||||
|
|
Benchmark 4 (disclosure) | 0 (0-0.25) | 0.5 (0-1) | 0 (0-0.5) | 0.25 (0-0.25) | 0 (0-0) | ||||
|
|
Benchmark (total) | 2 (0.88-2.5) | 2.75 (2-3) | 1.25 (1-1.9) | 2 (1.5-2) | 2 (2-2) | ||||
| HONb code of conduct certificate, n (%) | 2 (33) | 4 (33) | 1 (5) | 0 (0) | 0 (0) | |||||
| Readability, mean (SD) | ||||||||||
|
|
Flesch reading ease score | 47.13 (11.54) | 52.19 (7.84) | 45.73 (10.66) | 43.80 (16.69) | 60.00 (19.94) | ||||
|
|
Flesch-Kincaid grade level | 8.63 (1.72) | 7.95 (1.18) | 9.39 (1.88) | 15.15 (9.26) | 6.70 (3.54) | ||||
| Search term word frequency, mean (SD) | ||||||||||
|
|
“Spinal” frequency | 25.67 (16.02) | 14.33 (13.39) | 18.65 (19.22) | 12.00 (15.56) | 11.00 (12.73) | ||||
|
|
“Spinal” (%) | 4.07 (2.18) | 2.79 (2.07) | 3.19 (1.89) | 0.85 (0.47) | 4.42 (2.71) | ||||
|
|
“Cord” frequency | 23.67 (14.51) | 13.92 (13.03) | 17.40 (17.50) | 10.50 (13.44) | 9.00 (9.90) | ||||
|
|
“Cord” (%) | 3.94 (2.26) | 2.77 (2.00) | 3.03 (1.79) | 5.36 (6.84) | 3.78 (1.81) | ||||
|
|
“Stimulator” frequency | 13.83 (13.27) | 4.83 (6.82) | 11.95 (13.26) | 9.00 (11.31) | 9.50 (12.02) | ||||
|
|
“Stimulator” (%) | 1.70 (1.48) | 0.88 (1.37) | 1.91 (1.43) | 0.70 (0.25) | 3.48 (3.15) | ||||
aJAMA: Journal of the American Medical Association.
bHON: Health on the Net Foundation.
Readability
A summary of readability is provided in Table 2 and Table S1 in Multimedia Appendix 1. Readability indices across all sites indicated that information was difficult on average and required a 9th- to 10th-grade level of reading comprehension (reading ease: mean 48.4, SD 10.8 and grade: mean 9, SD 2.7). News or media required the highest level of reading comprehension (mean 15.2, SD 9.3), and personal or blog sites required the lowest level of reading comprehension (mean 6.7, SD 3.5).
Quality
A summary of information quality (ie, DISCERN, JAMA scores, and HON code of conduct certification) is provided in Table 2 and Figure S2 and Table S2 in Multimedia Appendix 1. Based on DISCERN rating criteria, just over one-third of all sites were rated as having high overall quality (n=16, 38%), with the remainder rated as having moderate (n=19, 45%) or low (n=7, 16%) overall quality. Scientific resources (median 3.5, IQR 2-3) and news or media sites (median 2, IQR 2-2) showed the highest and lowest overall DISCERN scores, respectively. Few sites met all 4 JAMA benchmark criteria (n=3, 7%). Nonprofit (median 2.75, IQR 2-3) and for-profit sites (median 1.25, IQR 1-1.9) showed the highest and lowest benchmark totals, respectively. HON code of conduct certification was present in less than a quarter of all sites (n=7, 16%), with the majority attributed to nonprofit sites (n=4, 9%).
Website Characteristics
Tabulated website characteristics are summarized in Tables S3 and S4 in Multimedia Appendix 1. Publication dates (or latest revision date) were reported for less than half (19/42, 45%) of all websites and was proportionately lowest among for-profit sites (5/20, 25%) compared to other site types. Author names, aliases, and credentials were provided in less than half of all sites (20/42, 47%), and authorship disclosure was also proportionately lowest among for-profit sites (3/20, 15%) compared to others. Site addresses included designation in the United States (30/42, 71%), Canada (1/42, 2%), and Australia (1/42, 2%) or did not provide a location (10/42, 23%). Relative to other site types, the proportion of sites that provided a geographical designation was highest among for-profit sites (19/42, 45%). Just under half of all websites provided alternate content accessibility options (ie, PDF, audio, and video; 20/42, 47%). Some sites also featured pop-up notifications and advertisements (9/42, 21%). On average, nonprofit sites contained the greatest number of reference citations (mean 11.1, SD 27.1) followed by scientific resources (mean 1.2, SD 2.9).
Website Information
Website information is summarized in Tables S3 and S5 in Multimedia Appendix 1. Most websites were intended for consumers and caregivers (n=27, 64%), with the remainder intended to serve as resources for clinicians and researchers (n=1, 2%) or both (n=14, 33%). Site information pertained to the use of ESCS (n=37, 88%), both transcutaneous SCS and ESCS (n=2, 4%), or did not define SCS type (n=3, 7%). Sites also provided summary information or a definition of SCS (n=37, 88%) and described SCS subcategories (n=14, 33%), indications (n=38, 90%), contraindications (n=14, 33%), side effects or risks (n=28, 66%), device considerations (n=25, 59%), follow-up (n=22, 52%), and outcome-related information (n=31, 73%). Most sites featured physician or clinical referral (n=26, 61%). Relative to other site types, for-profit sites showed the highest proportion of referrals (17/20, 85%).
Discussion
Principal Findings
This study provides a novel qualitative synthesis of publicly available web-based information on the topic of SCS. For-profit websites were the most commonly encountered. Website quality ratings varied between site types suggesting that the reporting (or omission) of important quality criteria (eg, authorship, information source, and publication date) was site-type dependent. For-profit sites were rated as having relatively lower quality than nonprofit or scientific resource sites based on quality criteria (ie, JAMA benchmarks and HON code of conduct certification). The proportion of for-profit sites reporting authorship was comparatively less than nonprofit and scientific resource sites. The average number of peer-reviewed reference citations identified within for-profit sites was also comparably less frequent than that of nonprofit and scientific resource sites. These findings are largely consistent with other studies of web-based information that report similar discrepancies in the provision of authorship and information sources [17,18]. This suggests that consumers may be exposed to web-based information on SCS that originates from unidentified authors and sources. While two-thirds of all websites mentioned potential risks or side effects of SCS, only one-third described possible contraindications for SCS. Moreover, the majority of websites specifically targeted consumers or their caregivers and featured clinical or physician referral for SCS. Relative to other site types, for-profit sites constituted the largest proportion of referrals indicating potential information bias and consumer-directed marketing of SCS [13]. This is a cause for concern, as the selective provision of SCS-related information from undisclosed sources may potentially place consumers and patient groups at unnecessary risk and consequently diminish their capacity to make informed health care decisions.
Limitations
This study has several limitations. First, returned search results were limited by geographical location (ie, IP designation within the United States based on geographical trends for the search topic “spinal cord stimulator”) and may lack generalizability across regions and therefore introduce bias unintentionally. This study also incorporated the use of Baidu, the second-most commonly used search engine by international ranking at the time the search was conducted, in conjunction with other common search engines (ie, Google, Bing, and Yahoo). Although Baidu is the most commonly used web-based resource for medical information seekers following the withdrawal of Google from China in 2010 [81], the additive benefit of using this search engine and associated indices (eg, Baidu Index) to include a broader user demographic and potentially enhance search result generalizability remains inconclusive.
For-profit websites were the most commonly encountered site type, representing approximately half of all included sites (n=20, 48%). However, it is unclear whether the developers of these sites allocated funding and resources to increase user traffic and enhance website visibility through the use of strategic search engine optimization techniques (eg, content management systems; schematic data structuring; and technical optimizations to improve URL structure, loading, navigation, and internal linking). Although the results of the word frequency summary potentially suggest the use of word frequency–based ranking algorithms, the way these search engines ultimately select which resources to display in a given list of returned search results remains unknown. Future studies may investigate whether academic institutions and government and nongovernment organizations (ie, scientific resources) that curate high-quality, evidence-based medical information actually benefit from devoting funds and organizational resources to increase website user traffic and visibility via technical optimization (eg, site content and search engine compatibility) or by other means (eg, endorsement by influential people and use of slogans, catchphrases, logographic designs, and multimedia to enhance site awareness and recognition and to demonstrate expertise, authority, and trustworthiness).
Several tools were used to provide a robust quality assessment of the information encountered on various websites (ie, DISCERN, JAMA, and HON code of conduct). Although this approach is largely consistent with previous studies of web-based medical information, among these assessments, there are both redundant components (eg, authorship, attribution, and disclosure) as well as quality criteria that are unique to each of the tools used (eg, financial disclosure and advertising). Future studies may consider the use of more recent assessments comprising these and other essential criteria for evaluating the quality of information encountered on websites and web-based resources.
Additionally, the data extracted reflects publicly accessible information from the first 2 pages of returned results for 2 top trending search terms. Though not exhaustive (ie, all possible websites providing information on SCS), the search methodology used was intended to simulate scenario-specific consumer behavior (ie, seeking SCS-related information). Future studies may consider an alternate methodological approach involving divergent user-behavior scenarios.
Conclusions
Publicly available web-based information on SCS mainly targets consumers and their caregivers. We found that almost all sites focused on surgically implanted SCS with less than half providing authorship details and publication dates. Most websites mentioned risks or side effects of SCS, yet few websites described possible contraindications. Sites curated by for-profit entities featured clinical or physician referral for SCS more often than other site types indicating implicit bias. This suggests that the public is likely to be exposed to incomplete, potentially misleading, or out-of-date information from unidentified sources regarding the use of SCS. For-profit sites were also encountered more frequently than nonprofit and scientific resource sites, suggesting the content and technical format of sites featuring higher-quality medical information are not optimized to enhance user traffic and search engine visibility. To avoid the spread of misinformation that could potentially harm certain consumer or patient groups, sites featuring evidence-based information on the current use of SCS should declare authorship, ensure the evidence is frequently updated, and consider using search engine optimization techniques that enable preferential site positioning for commonly used search terms.
Acknowledgments
TM is supported by postdoctoral fellowship awards jointly funded by Michael Smith Health Research BC, the Canadian Institutes for Health Research (CIHR), and the Rick Hansen Foundation (RHF). TK is supported by a Canada Graduate Scholarship through the CIHR and a WorkSafeBC research trainee award. MC-J is supported by a Paralyzed Veterans of America (PVA) postdoctoral fellowship award and the RHF. SS is supported by a PVA postdoctoral fellowship award, the RHF, and the Wings for Life Spinal Cord Research Foundation (WFLSCRF). RM is supported by a PVA postdoctoral fellowship award, a CIHR-funded fellowship award, and the RHF. CS is supported by a PVA postdoctoral fellowship award, a CIHR postdoctoral fellowship award, and the RHF. RS is supported by the WFLSCRF and the US Department of Defense. AK is the endowed chair in the Division of Physical Medicine and Rehabilitation within the Faculty of Medicine at the University of British Columbia and is supported through grant funding provided by WFLSCRF, International Spinal Research Trust, Praxis, US Department of Defense, RHF, Onward, SpineX, Convatec, and Coloplast. Laboratory resources used for conducting the study were purchased with prior funding support from the Canadian Foundation for Innovation and the British Columbia Knowledge Translation Foundation.
Abbreviations
- ESCS
epidural spinal cord stimulation
- HON
Health on the Net Foundation
- JAMA
Journal of the American Medical Association
- SCS
spinal cord stimulation
Supplementary figures and tables.
Footnotes
Authors' Contributions: TM, RS, and AK conceptualized the study; TM, AH, TT, TK, and MC-J conducted the analyses; TM drafted the paper; and all authors reviewed and approved the final version.
Conflicts of Interest: RS is a paid consultant at SpineX Inc, a medtech startup building spinal cord stimulation devices. This author contributed to the conception and final review of the study and had no role in developing the study methodology nor in the identification, extraction, and interpretation of the study data. All other authors have no potential conflicts of interest to declare.
References
- 1.Traeger AC, Gilbert SE, Harris IA, Maher CG. Spinal cord stimulation for low back pain. Cochrane Database Syst Rev. 2023;3(3):CD014789. doi: 10.1002/14651858.CD014789.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.O'Connell NE, Ferraro MC, Gibson W, Rice AS, Vase L, Coyle D, Eccleston C. Implanted spinal neuromodulation interventions for chronic pain in adults. Cochrane Database Syst Rev. 2021;12(12):CD013756. doi: 10.1002/14651858.CD013756.pub2. https://europepmc.org/abstract/MED/34854473 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.García AM, Serrano-Muñoz D, Taylor J, Avendaño-Coy J, Gómez-Soriano J. Transcutaneous spinal cord stimulation and motor rehabilitation in spinal cord injury: a systematic review. Neurorehabil Neural Repair. 2020;34(1):3–12. doi: 10.1177/1545968319893298. https://journals.sagepub.com/doi/10.1177/1545968319893298 . [DOI] [PubMed] [Google Scholar]
- 4.Samejima S, Shackleton C, Miller T, Moritz CT, Kessler TM, Krogh K, Sachdeva R, Krassioukov AV. Mapping the iceberg of autonomic recovery: mechanistic underpinnings of neuromodulation following spinal cord injury. Neuroscientist. 2023:10738584221145570. doi: 10.1177/10738584221145570. https://journals.sagepub.com/doi/abs/10.1177/10738584221145570?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Fyfe I. Breakthrough technology restores function after complete paralysis. Nat Rev Neurol. 2022;18(4):187. doi: 10.1038/s41582-022-00632-x.10.1038/s41582-022-00632-x [DOI] [PubMed] [Google Scholar]
- 6.Angeli C, Rejc E, Boakye M, Herrity A, Mesbah S, Hubscher C, Forrest G, Harkema S. Targeted selection of stimulation parameters for restoration of motor and autonomic function in individuals with spinal cord injury. Neuromodulation. 2023:S1094-7159(23)00148-4. doi: 10.1016/j.neurom.2023.03.014. https://linkinghub.elsevier.com/retrieve/pii/S1094-7159(23)00148-4 .S1094-7159(23)00148-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Laskin JJ, Waheed Z, Thorogood NP, Nightingale TE, Noonan VK. Spinal cord stimulation research in the restoration of motor, sensory, and autonomic function for individuals living with spinal cord injuries: a scoping review. Arch Phys Med Rehabil. 2022;103(7):1387–1397. doi: 10.1016/j.apmr.2022.01.161. https://linkinghub.elsevier.com/retrieve/pii/S0003-9993(22)00234-9 .S0003-9993(22)00234-9 [DOI] [PubMed] [Google Scholar]
- 8.Indications for use. US Food and Drug Administration. 2017. [2022-12-28]. https://www.accessdata.fda.gov/cdrh_docs/pdf3/P030017S275C.pdf .
- 9.Zimlichman E, Nicklin W, Aggarwal R, Bates DW. Health care 2030: the coming transformation. NEJM Catalyst. 2021;2(2):1–11. doi: 10.1056/CAT.20.0569. https://catalyst.nejm.org/doi/full/10.1056/CAT.20.0569 . [DOI] [Google Scholar]
- 10.Cuan-Baltazar JY, Muñoz-Perez MJ, Robledo-Vega C, Pérez-Zepeda MF, Soto-Vega E. Misinformation of COVID-19 on the internet: infodemiology study. JMIR Public Health Surveill. 2020;6(2):e18444. doi: 10.2196/18444. https://publichealth.jmir.org/2020/2/e18444/ v6i2e18444 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Tan SS, Goonawardene N. Internet health information seeking and the patient-physician relationship: a systematic review. J Med Internet Res. 2017;19(1):e9. doi: 10.2196/jmir.5729. https://www.jmir.org/2017/1/e9/ v19i1e9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Donohue J. A history of drug advertising: the evolving roles of consumers and consumer protection. Milbank Q. 2006;84(4):659–699. doi: 10.1111/j.1468-0009.2006.00464.x. https://europepmc.org/abstract/MED/17096638 .MILQ464 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Khullar D, Darien G, Ness DL. Patient consumerism, healing relationships, and rebuilding trust in health care. JAMA. 2020;324(23):2359–2360. doi: 10.1001/jama.2020.12938.2774058 [DOI] [PubMed] [Google Scholar]
- 14.Fox S, Duggan M. Health online 2013. Pew Research Center. 2013. [2022-12-28]. https://www.pewresearch.org/internet/2013/01/15/health-online-2013/
- 15.Eysenbach G, Kohler C. What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the internet. AMIA Annu Symp Proc. 2003;2003:225–229. https://europepmc.org/abstract/MED/14728167 .D030003690 [PMC free article] [PubMed] [Google Scholar]
- 16.Khullar D. Social media and medical misinformation: confronting new variants of an old problem. JAMA. 2022;328(14):1393–1394. doi: 10.1001/jama.2022.17191.2796846 [DOI] [PubMed] [Google Scholar]
- 17.Fisher JH, O'Connor D, Flexman AM, Shapera S, Ryerson CJ. Accuracy and reliability of internet resources for information on idiopathic pulmonary fibrosis. Am J Respir Crit Care Med. 2016;194(2):218–225. doi: 10.1164/rccm.201512-2393OC. https://www.atsjournals.org/doi/10.1164/rccm.201512-2393OC . [DOI] [PubMed] [Google Scholar]
- 18.Kreutzer EP, Sauer S, Kriegsmann M, Staemmler H, Egerer G, Kriegsmann K. Accuracy and reliability of internet resources for information on monoclonal gammopathy of undetermined significance—what information is out there for our patients? Cancers (Basel) 2021;13(18):4508. doi: 10.3390/cancers13184508. https://www.mdpi.com/resolver?pii=cancers13184508 .cancers13184508 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Ved R, Cobbold N, Igbagiri K, Willis M, Leach P, Zaben M. Online patient information on vagus nerve stimulation: how reliable is it for facilitating shared decision making? Seizure. 2017;50:125–129. doi: 10.1016/j.seizure.2017.06.009. https://linkinghub.elsevier.com/retrieve/pii/S1059-1311(17)30421-1 .S1059-1311(17)30421-1 [DOI] [PubMed] [Google Scholar]
- 20.Borgmann H, Wölm JH, Vallo S, Mager R, Huber J, Breyer J, Salem J, Loeb S, Haferkamp A, Tsaur I. Prostate cancer on the web—expedient tool for patients' decision-making? J Cancer Educ. 2017;32(1):135–140. doi: 10.1007/s13187-015-0891-3.10.1007/s13187-015-0891-3 [DOI] [PubMed] [Google Scholar]
- 21.Bruce JG, Tucholka JL, Steffens NM, Neuman HB. Quality of online information to support patient decision-making in breast cancer surgery. J Surg Oncol. 2015;112(6):575–580. doi: 10.1002/jso.24046. https://europepmc.org/abstract/MED/26417898 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Ferreira G, Traeger AC, Machado G, O'Keeffe M, Maher CG. Credibility, accuracy, and comprehensiveness of internet-based information about low back pain: a systematic review. J Med Internet Res. 2019;21(5):e13357. doi: 10.2196/13357. https://www.jmir.org/2019/5/e13357/ v21i5e13357 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Zuccon G, Koopman B, Palotti J. Diagnose this if you can. In: Hanbury A, Kazai G, Rauber A, Fuhr N, editors. Advances in Information Retrieval. Cham: Springer; 2015. pp. 562–567. [Google Scholar]
- 24.Miller T, Stockley R, Drummond A, Watkins C, Georgiou R, Ahuja K, Bird ML. Online advice for the symptomatic management of post-stroke fatigue: a scoping review. J Psychosom Res. 2022;162:111039. doi: 10.1016/j.jpsychores.2022.111039.S0022-3999(22)00324-5 [DOI] [PubMed] [Google Scholar]
- 25.Meric F, Bernstam EV, Mirza NQ, Hunt KK, Ames FC, Ross MI, Kuerer HM, Pollock RE, Musen MA, Singletary SE. Breast cancer on the world wide web: cross sectional survey of quality of information and popularity of websites. BMJ. 2002;324(7337):577–581. doi: 10.1136/bmj.324.7337.577. https://europepmc.org/abstract/MED/11884322 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.The value of Google result positioning. Chitika. 2013. [2024-01-18]. https://chitika.com/google-positioning-value .
- 27.Peterson S, Rainey N, Weible K. Who writes this stuff? musculoskeletal information quality and authorship of popular health websites: a systematic review. Musculoskelet Sci Pract. 2022;60:102563. doi: 10.1016/j.msksp.2022.102563.S2468-7812(22)00062-5 [DOI] [PubMed] [Google Scholar]
- 28.Miller T, Hosseinzadeh A, Thordarson T, Kalimullina T, Calderón-Juárez M, Samejima S, Shackleton C, Sachdeva R, Krassioukov A. Publicly accessible web-based information on spinal cord stimulation: a scoping review. Open Science Framework. 2022. [2024-01-18]. https://osf.io/vf5dt . [DOI] [PMC free article] [PubMed]
- 29.Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53(2):105–111. doi: 10.1136/jech.53.2.105. https://jech.bmj.com/lookup/pmidlookup?view=long&pmid=10396471 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the internet: caveant lector et viewor—let the reader and viewer beware. JAMA. 1997;277(15):1244–1245. [PubMed] [Google Scholar]
- 31.Boyer C, Baujard V, Geissbuhler A. Evolution of health web certification through the HONcode experience. Stud Health Technol Inform. 2011;169:53–57. [PubMed] [Google Scholar]
- 32.Terblanche M, Burgess LJ. Examining the readability of patient-informed consent forms. Open Access J Clin Trials. 2010;2:157–162. doi: 10.2147/oajct.s13608. https://www.dovepress.com/examining-the-readability-of-patient-informed-consent-forms-peer-reviewed-fulltext-article-OAJCT . [DOI] [Google Scholar]
- 33.Nuti SV, Wayda B, Ranasinghe I, Wang S, Dreyer RP, Chen SI, Murugiah K. The use of Google Trends in health care research: a systematic review. PLoS One. 2014;9(10):e109583. doi: 10.1371/journal.pone.0109583. https://dx.plos.org/10.1371/journal.pone.0109583 .PONE-D-14-22976 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Fleiss JL, Levin B, Paik MC. Statistical Methods for Rates and Proportions. Somerset: John Wiley & Sons, Inc; 2004. The measurement of interrater agreement. [Google Scholar]
- 35.Flesch R. A new readability yardstick. J Appl Psychol. 1948;32(3):221–233. doi: 10.1037/h0057532. [DOI] [PubMed] [Google Scholar]
- 36.Sivanesan E. Spinal cord stimulator. John Hopkins Medicine. 2022. [2022-12-28]. https://www.hopkinsmedicine.org/health/treatment-tests-and-therapies/treating-pain-with-spinal-cord-stimulators .
- 37.Nichols T, Mandybur G, Orlando M. Spinal cord stimulation. Mayfield Brain & Spine. 2021. [2022-12-28]. https://mayfieldclinic.com/pe-stim.htm .
- 38.Back pain and spinal cord stimulation. WebMD. 2020. [2022-12-28]. https://www.webmd.com/pain-management/spinal-cord-stimulation .
- 39.Treating pain with spinal cord stimulators. University of Rochester Medical Center. [2022-12-28]. https://www.urmc.rochester.edu/encyclopedia/content.aspx?contenttypeid=134&contentid=126 .
- 40.Anderson WS. Spinal cord stimulator removal: Q and A with a neurosurgeon. John Hopkins Medicine. [2022-12-28]. https://www.hopkinsmedicine.org/health/treatment-tests-and-therapies/spinal-cord-stimulator-removal-qa .
- 41.Spinal cord stimulator trial and implantation. UTHealth Houston Neurosciences. [2022-12-28]. https://med.uth.edu/neurosciences/conditions-and-treatments/spine-disorders-and-back-pain/spinal-cord-stimulator-trial-and-implant/
- 42.Mehta M. Disadvantages and risks of spinal cord stimulation. Spine-health. 2016. [2022-12-28]. https://www.spine-health.com/treatment/pain-management/disadvantages-and-risks-spinal-cord-stimulation .
- 43.Anderson B, Cockroft KM. Spinal cord stimulation. American Association of Neurological Surgeons. [2022-12-28]. https://www.aans.org/en/Patients/Neurosurgical-Conditions-and-Treatments/Spinal-Cord-Stimulation .
- 44.Spinal cord stimulation (video animation) Pain Medicine Consultants. [2022-12-28]. https://www.painmedicineconsultants.com/contents/spinal-cord-stimulation-video-animation .
- 45.Spinal Cord Team Are spinal cord stimulators safe? What you need to know. SpinalCord.com. 2020. [2022-12-28]. https://www.spinalcord.com/blog/spinal-cord-stimulator-problems-to-know-about .
- 46.Spinal cord stimulator. Wikipedia. 2022. [2022-12-28]. https://en.wikipedia.org/wiki/Spinal_cord_stimulator .
- 47.Senza Spinal Cord Stimulation (SCS) system—P130022/S042. Food & Drug Administration. 2022. [2022-12-28]. https://www.fda.gov/medical-devices/recently-approved-devices/senza-spinal-cord-stimulation-scs-system-p130022s042 .
- 48.Kamhi LM. Spinal cord stimulation: risks and benefits. HealthCentral. 2017. [2022-12-27]. https://www.healthcentral.com/pain-management/spinal-cord-stimulation-advantages-risks-who-candidate .
- 49.Spinal cord stimulation for chronic back pain video. Spine-health. [2022-12-28]. https://www.spine-health.com/video/spinal-cord-stimulation-chronic-back-pain-video .
- 50.Spinal cord stimulation for chronic back and neck pain. Spine-health. 2016. [2022-12-28]. https://www.spine-health.com/treatment/pain-management/spinal-cord-stimulation-chronic-back-and-neck-pain .
- 51.McKenzie-Brown AM, Pritzlaff SG. Spinal cord stimulation: placement and management. UpToDate. 2022. [2022-12-28]. https://www.uptodate.com/contents/spinal-cord-stimulation-placement-and-management .
- 52.Spinal cord stimulation. Mount Sinai. 2022. [2022-12-28]. https://www.mountsinai.org/health-library/surgery/spinal-cord-stimulation .
- 53.Thomson S. Spinal cord stimulation's role in managing chronic disease symptoms. International Neuromodulation Society. 2019. [2022-12-28]. https://www.neuromodulation.com/spinal-cord-stimulation .
- 54.Spinal Cord Stimulator (SCS) systems. Boston Scientific. 2022. [2022-12-28]. https://www.bostonscientific.com/en-US/patients-caregivers/device-support/scs.html .
- 55.A non-opioid alternative. Medtronic. 2022. [2022-12-22]. https://www.medtronic.com/us-en/patients/treatments-therapies/spinal-cord-stimulation-chronic-pain/therapy-overview.html .
- 56.Spinal cord stimulation. Precision Brain, Spine, & Pain. 2022. [2022-12-28]. https://www.precisionhealth.com.au/healthcare-services/advanced-neurosurgery-spinal-surgery/procedures-and-surgery/spinal-cord-stimulation/
- 57.Spinal cord stimulation. UCSF Health. 2022. [2022-12-28]. https://www.ucsfhealth.org/treatments/spinal-cord-stimulation .
- 58.Spinal cord stimulator surgery—the risks and recovery time. Southern Pain Clinic. 2017. [2022-12-28]. https://southernpainclinic.com/blog/spinal-cord-stimulator-surgery-the-risks-and-recovery-time/
- 59.Spinal Cord Stimulation (SCS) Nura Precision Pain Management. 2022. [2022-12-28]. https://www.nuraclinics.com/treatments/neuromodulation/neurostimulation/spinal-cord-stimulation-scs/
- 60.Spinal cord stimulation implant. UPMC. 2022. [2022-12-28]. https://www.upmc.com/services/neurosurgery/spine/treatment/pain-management/stimulation .
- 61.Spinal cord stimulator implant in Austin, TX. Advanced Pain Care. 2022. [2024-12-28]. https://austinpaindoctor.com/spinal-cord-stimulator .
- 62.Spinal cord stimulator. Segura Neuroscience & Pain Center. 2022. [2022-12-28]. https://segurapaincenter.com/treatments/spinal-cord-stimulator/
- 63.Kamhi LM. Spinal cord stimulators: procedure and recovery. Spineuniverse. 2021. [2022-12-28]. https://www.spinediagnostic.com/blog/spinal-cord-stimulators-procedure-and-recovery/
- 64.Spinal cord stimulator. USA Spine Care & Orthopedics. 2019. [2022-12-28]. https://www.usaspinecare.com/spinal_orthopedic_procedures/spinal-cord-stimulators/
- 65.Spinal cord stimulation systems healthcare professionals. Medtronics. 2021. [2022-12-28]. https://www.medtronic.com/us-en/healthcare-professionals/products/neurological/spinal-cord-stimulation-systems.html .
- 66.What you need to know about spinal cord stimulator surgery. Florida Surgery Consultants. 2022. [2022-12-28]. https://www.floridasurgeryconsultants.com/spinal-cord-stimulator-surgery-everything-you-should-know/
- 67.Deuk Spinal cord stimulator review: disadvantages and risks of the surgery implant. Deuk Spine Institute. 2022. [2022-12-28]. https://deukspine.com/spinal-cord-stimulator-review/
- 68.Pain management with spinal cord stimulation therapy. Comprehensive Pain Management Specialists. 2022. [2022-12-28]. https://sdcpms.com/pain-management-with-spinal-cord-stimulation-therapy/
- 69.Spinal cord stimulation—surgical procedure. Krembil Brain Institute. 2022. [2022-12-28]. https://www.uhn.ca/Krembil/Treatments_Procedures/Spinal_Cord_Stimulation_Procedure/Pages/surgical_procedure.aspx .
- 70.Spinal cord stimulator trial/implants. Pain Treatment Centers of America. 2022. [2022-12-28]. https://www.ptcoa.com/spinal-cord-stimulator-trial-implants .
- 71.The next era of personalization: WaveWriter Alpha™ spinal cord stimulation system. Boston Scientific. 2022. [2022-12-28]. https://tinyurl.com/4fehueez .
- 72.Rolling Hills Medical. 2022. [2022-12-28]. https://rollinghillsmedical.com/types-of-spinal-cord-stimulators/
- 73.Living with a spinal cord stimulator: answers to FAQs. Arizona Pain. 2020. [2022-12-28]. https://arizonapain.com/living-with-a-spinal-cord-stimulator/
- 74.Spine stimulator for pain. Mayo Clinic. 2015. [2022-12-28]. https://www.youtube.com/watch?v=WCNcTfV3frY&ab_channel=MayoClinic .
- 75.Weiss M, Mohr H. Spinal-cord stimulators help some patients, injure others. NBC News. 2018. [2022-12-28]. https://www.nbcnews.com/health/health-care/spinal-cord-stimulators-help-some-patients-injure-others-n940131 .
- 76.Steeldove Anyone tried spinal cord stimulation for chronic pain? Mayo Clinic. 2018. [2024-02-09]. https://tinyurl.com/bdpsecwa .
- 77.Oxendine E. What is a spinal cord stimulator? Wisegeek. 2022. [2022-02-18]. https://www.wise-geek.com/what-is-a-spinal-cord-stimulator.htm .
- 78.Plavén-Sigray P, Matheson GJ, Schiffler BC, Thompson WH. The readability of scientific texts is decreasing over time. Elife. 2017;6:e27725. doi: 10.7554/eLife.27725. https://europepmc.org/abstract/MED/28873054 .e27725 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Wang L, Wang J, Wang M, Li Y, Liang Y, Xu D. Using internet search engines to obtain medical information: a comparative study. J Med Internet Res. 2012;14(3):e74. doi: 10.2196/jmir.1943. https://www.jmir.org/2012/3/e74/ v14i3e74 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Finkelstein L, Gabrilovich E, Matias Y, Rivlin E, Solan Z, Wolfman G. Placing search in context: the concept revisited. Proceedings of the 10th International Conference on World Wide Web; May 1-5, 2001; Hong Kong. 2001. pp. 406–414. https://dl.acm.org/doi/10.1145/371920.372094 . [DOI] [Google Scholar]
- 81.Wang T, Xia Q, Chen X, Jin X. Use of Baidu Index to track Chinese online behavior and interest in kidney stones. Risk Manag Healthc Policy. 2020;13:705–712. doi: 10.2147/RMHP.S245822. https://europepmc.org/abstract/MED/32694922 .245822 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplementary figures and tables.