Introduction
Approximately 81,000 mpox (monkeypox) cases have been confirmed globally during the ongoing 2022 outbreak [1]. Online and social media platforms can help disseminate up-to-date information on mpox but can also cause patient harm by propagating misinformation [2,3]. TikTok is currently the most downloaded app globally, with >1 billion monthly active users [4]. Recently, TikTok expanded the duration of videos to 10 minutes, increasing its potential to disseminate information, similar to other platforms such as YouTube [5]. However, there have been few studies investigating the quality of mpox content on TikTok [6]. Hence, we analyzed trending mpox content on TikTok to assess metrics affecting user engagement and content quality.
Methods
TikTok was searched for videos using the term “monkeypox” on August 27, 2022. The top videos returned by the TikTok search algorithm were analyzed. Videos unrelated to mpox, non-English videos, and duplicates were excluded. Video type, metrics, content, and content quality were collected and assessed by two independent reviewers. Content quality was assessed using DISCERN, a validated 16-item instrument to evaluate the quality of health information scored from 1 (poor) to 5 (excellent) [7]. For videos with no content on treatment options, the DISCERN section on treatment was excluded during scoring. Content accuracy was assessed using the Centers for Disease Control and Prevention mpox resource [1]. The identity of content creators was determined using biographic information on TikTok and through Google searches. Any disagreements were resolved by a dermatologist with an interest in mpox. Associations between hashtags and the number of views were evaluated with multivariable regression. Means between two groups were compared with student t test. A 2-sided P value <.05 was considered statistically significant. Statistical analyses were performed using R version 4.1.3 (R Foundation for Statistical Computing).
Results
Overall, the top 137 videos were screened to include 100 videos: 55% (n=55) originated from health care professionals or scientists, 38% (n=38) from non–health care professionals or scientists, and 7% (n=7) from news organizations. Of the accounts from health care professionals or scientists, 65% (n=36) were physicians; 15% (n=8) were physician assistants, nurse practitioners, or nurses; 5% (n=3) were epidemiologists; and 15% (n=8) were other health care professionals or scientists. Included videos had a combined 306,035,200 views and 27,785,816 likes. Hashtags related to viruses and the lesbian, gay, bisexual, transgender, queer (LGBTQ+) community were associated with a higher number of views (both P<.001; Table 1).
Table 1.
Videos, n (%) | Number of views, mean (SD) | Number of likes, mean (SD) | DISCERN score, mean (SD) | Misleading statement, n (%) | ||
Content creator | ||||||
Nonphysician | 64 (64) | 4,145,664 (3,094,378) | 375,333 (187,666) | 2.1 (1.0) | 21 (33) | |
Physician | 36 (36) | 1,130,908 (932,968) | 104,570 (131,871) | 4.0 (0.5) | 5 (14) | |
Video type | ||||||
Educational content | 82 (82) | 2,910,243 (2,652,819) | 428,883 (214,441) | 3.1 (0.8) | 19 (23) | |
Patient experience | 72 (72) | 4,957,425 (3,649,648) | 337,284 (322,406) | 2.4 (1.0) | 6 (8) | |
Entertainment | 9 (9) | 5,676,122 (3,536,727) | 795,933 (550,651) | 1.6 (1.1) | 7 (78) | |
News | 5 (5) | 1,704,400 (579,805) | 288,498 (75,700) | 3.8 (0.3) | 0 (0) | |
Hashtag categories | ||||||
Virus | 26 (26) | 4,368,069 (3,994,561) | 325,704 (355,680) | 2.5 (1.0) | 6 (23) | |
Outbreak | 17 (17) | 2,619,524 (1,790,431) | 216,393 (236,373) | 2.8 (0.9) | 3 (18) | |
Symptoms | 15 (15) | 1,273,793 (555,833) | 83,170 (66,488) | 2.8 (0.8) | 4 (27) | |
Vaccine | 13 (13) | 1,618,308 (1,445,424) | 288,437 (292,527) | 3.0 (0.9) | 0 (0) | |
LGBTQ+a | 12 (12) | 7,161,225 (5,645,119) | 139,936 (119,348) | 3.5 (0.6) | 0 (0) |
aLGBTQ+: lesbian, gay, bisexual, transgender, queer.
The mean DISCERN score was 2.8 (SD 1.0), with high interrater reliability (Cohen κ>0.8). Physician videos had a significantly higher mean DISCERN score (4.0) and lesser variation in scores (SD 0.5) compared to nonphysician videos (DISCERN score mean 2.1, SD 1.0; P<.001). Low DISCERN scores were most common on items involving sources of information and treatment choices. Only one video mentioned treatment choices, discussing tecovirimat, and no other treatments were mentioned. Similarly, fewer of the 36 physician videos had misleading statements (n=5, 14%) compared to the 64 nonphysician videos (n=21, 33%). Nonetheless, videos from nonphysicians had a higher mean number of views and likes than videos from physicians (both P<.001). Videos with misleading statements also had more views (mean 4,820,885) compared to those without (mean 2,409,196; P<.001).
Discussion
Our findings highlight that although physician-created content was of higher quality and contained fewer misleading statements, it had reduced engagement compared to non–physician-created content and rarely discussed management. Since tecovirimat is likely most effective when started early, education in this area could improve patient outcomes [1]. Limitations of our study include the cross-sectional design and that DISCERN was originally validated to assess written educational content. Owing to the lack of validated instruments for this purpose, DISCERN has recently been used by multiple studies to evaluate the quality of videos on social media [8,9]. Given the increasing use of social media for health information, there is a need for the development and validation of specific instruments for quality assessment. Physician creators posting mpox content on TikTok should consider including a discussion of treatments and using hashtags selectively to increase user engagement.
Abbreviations
- LGBTQ+
lesbian, gay, bisexual, transgender, queer.
Footnotes
Conflicts of Interest: None declared.
References
- 1.2022 outbreak cases and data. Centers for Disease Control and Prevention. [2022-11-29]. https://www.cdc.gov/poxvirus/monkeypox/response/2022/index.html .
- 2.Farahat RA, Head MG, Tharwat S, Alabdallat Y, Essar MY, Abdelazeem B, Ould Setti M. Infodemic and the fear of monkeypox: call for action. Trop Med Health. 2022 Sep 05;50(1):63. doi: 10.1186/s41182-022-00459-8. https://europepmc.org/abstract/MED/36058955 .10.1186/s41182-022-00459-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Ortiz-Martínez Y, Galvis-Cataño LM, Arias-Rodríguez D, Romero-Dager C, Bonilla-Aldana DK, Rodriguez-Morales AJ. YouTube and 2022 Monkeypox outbreak: opportunities for awareness and infection control. J Hosp Infect. 2022 Jul 11;:S0195-6701(22)00226-2. doi: 10.1016/j.jhin.2022.07.007. https://europepmc.org/abstract/MED/35835284 .S0195-6701(22)00226-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.TikTok statistics – updated Nov 2022. Wallaroo. [2022-11-04]. https://wallaroomedia.com/blog/social-media/tiktok-statistics/
- 5.Malik A. TikTok expands max video length to 10 minutes, up from 3 minutes. TechCrunch. [2023-01-11]. https://techcrunch.com/2022/02/28/tiktok-expands-max-video-length-to-10-minutes-up-from-3-minutes/
- 6.Zenone M, Caulfield T. Using data from a short video social media platform to identify emergent monkeypox conspiracy theories. JAMA Netw Open. 2022 Oct 03;5(10):e2236993. doi: 10.1001/jamanetworkopen.2022.36993. https://europepmc.org/abstract/MED/36255729 .2797457 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999 Feb;53(2):105–11. doi: 10.1136/jech.53.2.105. https://jech.bmj.com/lookup/pmidlookup?view=long&pmid=10396471 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Mansour MR, Abushukur Y, Potts GA. Keratosis pilaris on TikTok: a cross-sectional analysis of trending content. JAAD Int. 2022 Sep;8:116–117. doi: 10.1016/j.jdin.2022.06.015. https://linkinghub.elsevier.com/retrieve/pii/S2666-3287(22)00085-2 .S2666-3287(22)00085-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Rehman R, Saad M, Huq F, Oska S, Mehregan D, Daveluy S. A cross-sectional analysis of popular hidradenitis suppurativa content on TikTok. JAAD Int. 2021 Dec;5:98–100. doi: 10.1016/j.jdin.2021.09.004. https://linkinghub.elsevier.com/retrieve/pii/S2666-3287(21)00072-9 .S2666-3287(21)00072-9 [DOI] [PMC free article] [PubMed] [Google Scholar]