Skip to main content
PLOS One logoLink to PLOS One
. 2024 Apr 25;19(4):e0288223. doi: 10.1371/journal.pone.0288223

Impact of the Covid-19 pandemic on audiology service delivery: Observational study of the role of social media in patient communication

Adeel Hussain 1, Zain Hussain 2,*, Mandar Gogate 1, Kia Dashtipour 1, Dominic Ng 2, Muhammed Shaan Riaz 3, Adele Goman 1, Aziz Sheikh 4, Amir Hussain 1
Editor: Mary Diane Clark5
PMCID: PMC11045075  PMID: 38662689

Abstract

The Covid-19 pandemic has highlighted an era in hearing health care that necessitates a comprehensive rethinking of audiology service delivery. There has been a significant increase in the number of individuals with hearing loss who seek information online. An estimated 430 million individuals worldwide suffer from hearing loss, including 11 million in the United Kingdom. The objective of this study was to identify National Health Service (NHS) audiology service social media posts and understand how they were used to communicate service changes within audiology departments at the onset of the Covid-19 pandemic. Facebook and Twitter posts relating to audiology were extracted over a six week period (March 23 to April 30 2020) from the United Kingdom. We manually filtered the posts to remove those not directly linked to NHS audiology service communication. The extracted data was then geospatially mapped, and themes of interest were identified via a manual review. We also calculated interactions (likes, shares, comments) per post to determine the posts’ efficacy. A total of 981 Facebook and 291 Twitter posts were initially mined using our keywords, and following filtration, 174 posts related to NHS audiology change of service were included for analysis. The results were then analysed geographically, along with an assessment of the interactions and sentiment analysis within the included posts. NHS Trusts and Boards should consider incorporating and promoting social media to communicate service changes. Users would be notified of service modifications in real-time, and different modalities could be used (e.g. videos), resulting in a more efficient service.

Introduction

To mitigate the exponential spread of Covid-19 cases, the government took quick and decisive steps that affected healthcare services, including audiology departments in the UK. Consequently, there was a transition from in-person to teleaudiology patient care, which resulted in the cancellation of all in-person appointments for routine services. Moreover, new assessments and existing hearing aid users were no longer able to access their regular care pathways in the event of hearing difficulties [1, 2]. While infrastructure for remote audiology services had begun implementation prior to the Covid-19 pandemic, teleaudiology pathways were not yet fully established nor widely adopted in clinical practice.

Prior to the service being shifted to remote or postal services, audiology was predominantly a face-to-face facility for patients. There are several reasons for not adopting telehealth, including the absence of teleaudiology infrastructure, certain procedures necessitating face-to-face involvement (such as otoscopy), the necessity for sound-treated rooms for testing, and the multiple face-to-face appointments required for hearing aid fitting, counselling, and troubleshooting. Previous research [2, 3] has also demonstrated reticence towards teleaudiology being used in clinical settings. Eikelboom and Swanepoel [3], surveyed 269 audiologists from around the world and found that only 15% had used teleaudiology, despite being confident in using the required technology [3]. However, despite this initial reticence teleaudiology had to be increasingly utilised during national and regional lockdowns in the COVID-19 pandemic in the United Kingdom. Saunders and Roughley surveyed 120 UK-based audiologists during the Covid-19 pandemic and found that while 98% of participants used teleaudiology at the time of the study, only 30% had used it beforehand. Participants responded positively to the remote pathways, but also highlighted the need for improvements in training and infrastructure as well as the potential to impact negatively on personal interactions [4].

The ways in which clinical services communicate with patients is important in an age where patients are increasingly seeking more information and encouraged to take responsibility for managing their health. Previously, individuals with a disability or health issue would seek advice and assistance from their friends, family, or healthcare experts. However, with improved internet accessibility and social media, individuals have more autonomy in gathering information from a wide range of resources [5]. This trend was exacerbated during the Covid-19 pandemic where face-to-face communication with healthcare providers decreased. In April 2020, research studies showed that people in the United Kingdom spent an average of four hours a day online, up from three hours and 29 minutes in September 2019, further supporting the aforementioned [6]. Specifically among adults aged 59 or older, the most likely demographic to utilise audiology services, studies have demonstrated that Facebook and Twitter to be the most commonly used social media platforms [7]. Furthermore analysis of social media usage across different platforms revealed variation in usage patterns among adults aged 59 years and older. The data showed that Facebook and Twitter were the most frequently used sites by this older demographic, with 40.98% and 17.20% of respondents aged 59+ reporting that they accessed these platforms several times per day, respectively. Additionally, 23.71% and 13.98% of those aged 59+ stated that they used Facebook and Twitter everyday in comparison with other platforms such as YouTube, Instagram, and Snapchat which were accessed less frequently [8]. Social media has also been utilised previously for understanding public perceptions, information dissemination and updates during public health crises [911].

Approximately 430 million people worldwide and 11 million individuals in the United Kingdom are estimated to have some degree of hearing loss, approximately, 1 in 6 of them having severe or profound hearing loss [12]. A listener’s level of difficulty will vary based on the type of hearing loss they have, the environment they are in, whether their hearing loss has been treated, and how effectively their hearing aids are functioning. Since face-to-face communication was restricted due to the lockdown, audiology services increasingly turned towards social media to update patients on changes in their services. However, it is unclear how many services utilised social media to maintain communication with patients and how this was received by patients.

Our study is the first of its kind to investigate the role and impact of social media in engaging audiology consumers on service changes during the initial 6 weeks of the Covid-19 pandemic. The initial 6 week period was selected to ascertain the initial use of social media platforms. If the findings reveal that social media was not employed during this period, the study can provide valuable insights for future implementation. Specifically, we aim to analyse how audiology departments across health trusts in the United Kingdom utilised Facebook and Twitter, to communicate with their patients.

Materials and methods

Ethics

Due to the availability of the data used in this study in the public domain, no National Health Service (NHS) ethics review was required. As per our previous research and to ensure compliance with pertinent provisions of the General Data Protection Regulation (GDPR) [1315], a comprehensive assessment was conducted to confirm that our study presented no privacy risk to individuals. We aimed to follow best practices for user privacy by excluding private information from our dataset. In addition, to comply with privacy laws and social media policies in accordance with the GDPR, to collect data, we did not disclose or publish direct posts by individuals, quotations from individuals, or the names or locations of users who are not public organisations or entities on the Facebook CrowdTangle platform and Twitter Application Programming Interface (API) [16].

Data sources

We opted to use data from Facebook and Twitter, since they are the commonly used social media platforms [7, 8]. We utilised CrowdTangle in order to extract data from Facebook. CrowdTangle serves as a social media analytics tool, providing users with the capability to observe, analyse, and track the impact of content across various social media platforms. In addition, we leveraged the Twitter API to extract data from Twitter. The Twitter API facilitates access to Twitter’s data [17], allowing for tasks such as extracting tweets, retrieving user information, and executing various other actions on the platform.

Within the period from March 23 to April 30, 2020, we specifically targeted English-language Facebook posts from pages in the UK. This particular time frame was selected due to its alignment with the initial announcement of the first UK lockdown [13]. In order to identify which audiology departments were utilising social media to communicate service changes, we narrowed our search to only include the initial six-week period of the lockdown.

The search terms used to extract data were hearing loss, hearing, difficulty, presbycusis, tinnitus, deafness, speech impairment, hearing aids, audiology, ear wax, ear syringing, microsuction, telecare, teleaudiology remote consultations. The comprehensive range of our search terms ensured that all relevant results were included during the searches.

Our initial search yielded 981 Facebook posts and 291 Twitter posts, which were then filtered to exclude posts unrelated to the NHS audiology departments. Our team manually filtered each post for messages of service change from NHS Trusts or partners, such as libraries where repair/battery clinics had previously been held. The final dataset did not include posts about private hearing clinics, other hearing-related news, or information from news outlets. This study also omitted information from the private sector and hearing aid manufacturers.

Data analysis

CrowdTangle and Twitter API was used to calculate the frequencies of the various interactions from the filtered dataset. For the parameters of interest, specifically the number of posts and likes, data was collected and computed. Subsequently, these data points were visually represented using a heat map and circular chart. The presented heat map depicts the diverse geographical origins of the posts, with the colour and size of the circles serving as indicators of the quantity of interactions. To enhance the depth of analysis, sentiment analysis was applied to user comments accompanying the original posts [18].

In conducting sentiment analysis for Facebook messages, we employed a computational approach leveraging the TextBlob natural language processing library. TextBlob, a robust tool for sentiment analysis, utilises an algorithm to assign sentiment polarity scores. These scores are numerical representations indicating the sentiment polarity of the given text. In this context, TextBlob generates scores of -1, 0, and 1, corresponding to negative, neutral, and positive sentiments, respectively. The assigned scores function as quantitative indicators of the emotional content within the messages. A score of -1 denotes predominantly negative sentiment, +1 signifies positive sentiment, and 0 reflects a neutral message.

This methodological approach offers a systematic and objective framework for evaluating the sentiment expressed in Facebook and Twitter messages [19]. It contributes to a more nuanced understanding of sentiment dynamics within the textual content of social media interactions. The sentiment results were visually presented in the results section using a pie chart.

Results

In this study, we investigated how NHS audiology departments utilised social media to provide service updates to patients. Fig 1 illustrates that most posts were generated between the third and fifth weeks.

Fig 1. Number of weekly posts related to audiology service changes over the 6-week lockdown period.

Fig 1

Colored segments represent the quantity of Facebook and Twitter posts extracted each week. Increased number of posts are indicated by larger segment sizes.

In our investigation of digital communication practices within healthcare organizations, we observed significant variations across regions. Among the 14 NHS Boards in Scotland, seven reported changes in service information through Facebook. Likewise, among the 217 NHS trusts in England, 41 conveyed changes in service information on both Facebook and Twitter. In Wales, three out of seven trusts reported changes in service information, while in Northern Ireland, only one out of five trusts reported a change in service information.

There was a total of 3,646 interactions across 174 posts, Table 1 illustrates the responses and interactions from the different countries across the UK. To be noted, this sample represents only a fraction of 11 million hearing aid users in the UK [12], some of the interactions may not have been from directly from the hearing aid user but possibly a friend or family member who may be affected by this change of service. Interactions included likes, shares, comments, or reposts. However, the reported interaction frequencies may underestimate the full reach, as some individuals may have viewed the posts without actively engaging through likes/comments.

Table 1. Number of shares, likes and comments on posts in England, Scotland, Wales and N. Ireland.

Country Likes Shares Comments Total
England 915 856 236 2007
Scotland 415 737 323 1475
Wales 84 161 29 274
Northern Ireland 66 14 4 84

Fig 2 shows a visual representation of the geographical distribution and number of interactions of Facebook and Twitter posts.] The heat/bubble map indicates that areas with a higher number of responses corresponds to areas with a higher number of interactions. In addition, the number of responses from the areas that posted service change updates in the U.K can be visualised. Both the gradient of the filled circle and the size of the circle indicate the number of posts and the number of interactions per post using the Virdis scale (blue to yellow and small to large) showing an increasing number of interactions.

Fig 2. Heat/bubble map of interactions with posts across the UK.

Fig 2

The color gradient (blue to yellow) and circle size indicate relative quantity of interactions in that location, with darker, larger circles representing more likes, comments, shares, etc.

Fig 3 visually represents the sentiment polarity derived from comments on the original posts. Each original post underwent a filtering process to gather comments from users. Comments where users tagged friends and family without additional written comments were excluded. The remaining comments were then analyzed using TextBlob, to gain an insight into sentiment of users towards social media posts relating to audiology service changes.

Fig 3. Pie chart illustrating sentiment values extracted from user comments to service change posts.

Fig 3

Green represents positive sentiment (41%), blue represents neutral sentiment (51%) and yellow for negative sentiment (6%).

The overall sentiment within the comments was predominantly neutral (51%), with a positive sentiment accounting for 41%, and a minor portion (6%) expressing negativity. The sentiment trend exhibited stability, aligning with the sentiments mined. This suggests that social media updates on service changes were largely well-received. Some instances of negative sentiments reflected frustrations from individuals who lacked access to services. They expressed dissatisfaction with the performance of their hearing aids or devices, adding to their distress amid the lockdown and isolation during this uncertain period.

Discussion

This study delved into the utilisation of social media platforms, specifically Facebook and Twitter, to disseminate information regarding audiology service changes within the NHS during an initial six-week period in the UK characterised by heightened uncertainty. The findings reveal that, in comparison to the total number of trusts and boards across the UK, the utilisation of social media to update patients was not optimised to its full potential.

Our analysis revealed a surge in the number of posts during the mid-weeks, with weeks 3 to 5 exhibiting the highest volume of posts. The sudden enforcement of lockdown measures, prompted by a significant increase in Covid-19 cases, may have led to a scenario where audiology departments were inundated with numerous tasks within a limited time frame. Consequently, some departments may not have immediately prioritised social media updates as they grappled with the urgent demands imposed by the evolving situation. It has been shown that individuals who have hearing loss can benefit from utilising electronic media as it improves their communication abilities and reduces auditory barriers [20]. Therefore, internet usage appeals to those who prefer text-based communication [21]. Our study identifies a low utilisation of social media platforms to communicate with patients and identifies the need for audiology services to leverage social media platforms to communicated service change updates.

Furthermore, the sentiment analysis conducted on the public’s comments on the original posts indicates a predominant positive sentiment, with only a small percentage expressing a negative sentiment. This observation highlights the positive impact these posts had on the general public they reached. Additionally, Fig 2 illustrates regional disparities in the utilization of social platforms, and that significant portions of the map reflect few to no interactions, highlighting gaps in uptake of social media for patient communications during this time. In Scotland, boards in the southern part of the country demonstrated more active engagement compared to the Highlands, where posts were relatively scarce. Within England, the Midlands and northern regions exhibited a higher level of utilisation of social media compared to other parts of the country.

The current study provides evidence that sharing service change messages on reliable online platforms can effectively inform patients. However, the credibility of information shared on social media can be undermined by the circulation of false or misleading content, as indicated by previous research [7]. The failure to timely post accurate information on social media may result from the ambiguity surrounding lockdown protocols and a shortage of personnel due to the government furlough programme, which was initiated on 27 March 2020.

Strengths and limitations

Our study has multiple strengths. It is the first study to assess communication by audiology departments on social media regarding service changes during the COVID-19 pandemic. We do this by utilising the two most frequently used social media platforms in older adults, namely Facebook and Twitter. Within these platforms we also utilised a comprehensive range of search terms in order to identify all social media posts from audiology centres across the entirety of the United Kingdom. We also utilise sentiment analysis, based on established methodology in this field of study [19], in order to better gain insight into service users perspective on department communication. This allows for easier comparison and analysis as the sentiment of a post can be accurately reflected as an objective metric.

There are also some limitations to our study. Our analysis is limited by our small sample size due to the short time period over which our study is conducted. This was primarily due to issues with data access as well as resource constraints. Whilst our study utilised the naive bayes classifier from the TextBlob package other approaches utilising modern deep learning architectures may have improved the accuracy of our sentiment analysis. Furthermore, although we captured a significant proportion of communication on social media platforms we were unable to access other modes of communication with patients such as emails, SMS, and letters due to NHS data protection constraints. This means that we are unable to evaluate the communication from UK audiology centres beyond their social media platforms. Lastly, it is important to note that the demographic profile of patients engaging with these social media platforms likely diverges from that of the average service user, with a propensity towards a younger age bracket.

Future directions

This is the first study of its kind that sought to assess the use of social media platforms for monitoring communication related to changes in audiology services. In future work, we plan to extend our investigation by incorporating additional platforms, such as YouTube and other hearing aid forums, thereby enabling a more comprehensive content analysis that can be correlated with our overarching findings. To deepen our understanding of the communication strategies adopted by healthcare providers, we may consider supplementing social media-mined data with surveys distributed to various NHS trusts. These surveys will help discern the approaches employed by these trusts in notifying patients of service changes, offering insights for potential enhancements to deliver an enhanced service.

Moreover, we would also aim to analyse and compare traditional communication channels, such as emails, short messaging service, and letters, with social media updates. Conducting patient surveys will allow us to inquire about their preferred communication methods, enabling us to determine what suits both patients and clinics best. Such an approach will enable a cost-benefit analysis of traditional methods versus social media, guiding more effective allocation of resources to improve overall service and message delivery.

While our current study focused on a short initial six-week period, we aspire to extend our investigation to understand how social media was utilised before, during, and after the Covid-19 pandemic. The scope of the study, previously limited to audiology services, may be broadened to encompass cross-departmental studies, including the role of primary care. This expansion would provide insights into how other departments and sectors, such as the pharmaceutical industry, have leveraged social media, identify potential benefits, and guide strategies for enhancing audiology services based on successful practices in different healthcare domains.

Conclusion

To conclude, we sought to investigate how NHS audiology departments used social media to notify patients of service changes. This preliminary first of its kind study has shown that the potential of social media is significantly under utilised in audiology research and practice, as supported by the lack of posts or information on service changes on a number of NHS trusts’ social media platforms. This highlights the need for audiology healthcare practitioners who work with patients with hearing loss to be aware of social media as a potential platform for dissemination of information among their patient population. A well-informed workforce would provide more effective service and would in turn lead to greater patient satisfaction and improved patient outcomes.

Data Availability

The data used in this study is now available on GitHub at [https://github.com/kiadashtipour/Sentiment-Analysis-Adeel-Hussain].

Funding Statement

This research is supported by the UK EPSRC COG-MHEAR programme (Grant No. 260 EP/M026981/1).

References

  • 1. Swanepoel DW, Hall JW. Making audiology work during COVID-19 and beyond. The Hearing Journal. 2020;73(6):20–22. doi: 10.1097/01.HJ.0000669852.90548.75 [DOI] [Google Scholar]
  • 2. Parmar B, Beukes E, Rajasingam S. The impact of COVID-19 on provision of UK audiology services & on attitudes towards delivery of telehealth services. International Journal of Audiology. 2022;61(3):228–238. doi: 10.1080/14992027.2021.1921292 [DOI] [PubMed] [Google Scholar]
  • 3. Eikelboom RH, Swanepoel DW. International survey of audiologists’ attitudes toward telehealth. American Journal of Audiology. 2016;25(3S):295–298. doi: 10.1044/2016_AJA-16-0004 [DOI] [PubMed] [Google Scholar]
  • 4. Saunders GH, Roughley A. Audiology in the time of COVID-19: practices and opinions of audiologists in the UK. International Journal of Audiology. 2021;60(4):255–262. doi: 10.1080/14992027.2020.1814432 [DOI] [PubMed] [Google Scholar]
  • 5. Manchaiah V, Bellon-Harn ML, Kelly-Campbell RJ, Beukes EW, Bailey A, Pyykkő I. Media use by older adults with hearing loss: An exploratory survey. American Journal of Audiology. 2020;29(2):218–225. doi: 10.1044/2020_AJA-19-00039 [DOI] [PubMed] [Google Scholar]
  • 6.UK’s internet use surges to record levels; 2020. https://www.ofcom.org.uk/news-centre/2020/uk-internet-use-surges#:~:text=The%20proportion%20of%20UK%20adults,(from%2013%25).).
  • 7. Gupta P, Khan A, Kumar A. Social media use by patients in health care: a scoping review. International Journal of Healthcare Management. 2022;15(2):121–131. doi: 10.1080/20479700.2020.1860563 [DOI] [Google Scholar]
  • 8. Hruska J, Maresova P. Use of social media platforms among adults in the United States—behavior on social media. Societies. 2020;10(1):27. doi: 10.3390/soc10010027 [DOI] [Google Scholar]
  • 9. Saroj A, Pal S. Use of social media in crisis management: A survey. International Journal of Disaster Risk Reduction. 2020;48:101584. doi: 10.1016/j.ijdrr.2020.101584 [DOI] [Google Scholar]
  • 10. Hussain A, Tahir A, Hussain Z, Sheikh Z, Gogate M, Dashtipour K, et al. Artificial Intelligence–Enabled Analysis of Public Attitudes on Facebook and Twitter Toward COVID-19 Vaccines in the United Kingdom and the United States: Observational Study. J Med Internet Res. 2021;23(4):e26627. doi: 10.2196/26627 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Wani MA, ELAffendi M, Bours P, Imran AS, Hussain A, Abd El-Latif AA. CoDeS: A Deep Learning Framework for Identifying COVID-Caused Depression Symptoms. Cognitive Computation. 2023;16(1):305–325. doi: 10.1007/s12559-023-10190-z [DOI] [Google Scholar]
  • 12. Lee JW, Bance ML. Hearing loss. Practical neurology. 2019;19(1):28–35. doi: 10.1136/practneurol-2018-001926 [DOI] [PubMed] [Google Scholar]
  • 13. Zimmer M. “But the data is already public”: on the ethics of research in Facebook. Ethics and information technology. 2010;12:313–325. doi: 10.1007/s10676-010-9227-5 [DOI] [Google Scholar]
  • 14. Hussain Z, Sheikh Z, Tahir A, Dashtipour K, Gogate M, Sheikh A, et al. Artificial Intelligence–Enabled Social Media Analysis for Pharmacovigilance of COVID-19 Vaccinations in the United Kingdom: Observational Study. JMIR Public Health and Surveillance. 2022;8(5):e32543. doi: 10.2196/32543 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Cresswell K, Tahir A, Sheikh Z, Hussain Z, Domínguez Hernández A, Harrison E, et al. Understanding Public Perceptions of COVID-19 Contact Tracing Apps: Artificial Intelligence–Enabled Social Media Analysis. J Med Internet Res. 2021;23(5):e26618. doi: 10.2196/26618 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Timeline of UK coronavirus lockdowns, March 2020 to March 2021; 2021. https://www.instituteforgovernment.org.uk/sites/default/files/timeline-lockdown-web.pdf.
  • 17. Waterloo SF, Baumgartner SE, Peter J, Valkenburg PM. Norms of online expressions of emotion: Comparing Facebook, Twitter, Instagram, and WhatsApp. New media & society. 2018;20(5):1813–1831. doi: 10.1177/1461444817707349 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Jin Z, Tao M, Zhao X, Hu Y. Social Media Sentiment Analysis Based on Dependency Graph and Co-occurrence Graph. Cognitive Computation. 2022;14(3):1039–1054. doi: 10.1007/s12559-022-10004-8 [DOI] [Google Scholar]
  • 19.Kaur C, Sharma A. Twitter sentiment analysis on coronavirus using textblob. EasyChair2516-2314. 2020;.
  • 20. Barak A, Sadovsky Y. Internet use and personal empowerment of hearing-impaired adolescents. Computers in human behavior. 2008;24(5):1802–1815. doi: 10.1016/j.chb.2008.02.007 [DOI] [Google Scholar]
  • 21. Pilling D, Barrett P. Text communication preferences of deaf people in the United Kingdom. Journal of deaf studies and deaf education. 2008;13(1):92–103. doi: 10.1093/deafed/enm034 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Mary Diane Clark

17 Aug 2023

PONE-D-23-19309Impact of the Covid-19 Pandemic on Audiology Service Delivery: Observational Study of the Role of Social Media in Patient CommunicationPLOS ONE

Dear Dr. Hussain,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The two reviewers have suggestions and the one has suggestions about how to analyze you data in more detail. I have added more specific details in my comments in the form. It is important for acceptance that you address all of the suggestions from the three of us. Personally I find the information important but feel that it needs more detail and that your data has not yet finished telling you its story.

Please submit your revised manuscript by Oct 01 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Mary Diane Clark, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

   "This research is supported by the UK EPSRC COG-MHEAR programme (Grant No.EP/M026981/1)."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

    "The author(s) received no specific funding for this work."

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

"Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. We note that Figure 2 in your submission contain [map/satellite] images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (a) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (b) remove the figures from your submission:

a. You may seek permission from the original copyright holder of Figure 2 to publish the content specifically under the CC BY 4.0 license.  

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

Additional Editor Comments:

Thanks for submitting your paper to Plos One. It is an important topic and these impacts will most likely have long-term impacts. I have some additional concerns that are not mentioned by the two reviewers. They are listed here.

1--Please spell out NHS the first time. I know in the UK it is well known but it took me a minute to get it.

2--On line 22, please start a new paragraph

3--line 32 has a change in topic so please be sure your paragraph is internally consistent

4--Your introduction is extremely brief. COVID was not the first time that this type of service was online. I checked and there is a long history of moving towards this type of service. Please expand the introduction.

5--CrowdTangle (notice the Capital T) is not common knowledge. Therefore, you are going to need to explain that system in more detail. Also you have it spelled two different was":Crowd Tangle and Crowdtangle. Please use the correct name.

6--please define API

7--It is not clear what parameters you are targeting. Please expand on exactly what are your parameters of interest.

8--Please separate the results and discussion

9--you need a better key to explain Figure 1. I still am not clear what the colors mean

10--Table 1 is redundant to the text so please delete it. Rule is either a table or in the text--one or the other

11--You need more interpretation of your results

12--Table 2 needs to be expanded for clarity.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Reviewer comments re: "Impact of the Covid-19 Pandemic on Audiology Service Delivery: Observational Study of the Role of Social Media in Patient Communication"

See article comment bubbles for grammar and related comments.

The methodology employed in the study appears to be sound for the specific research question and objectives stated in the paper. The researchers aimed to investigate how NHS audiology departments in the UK utilized social media to communicate service changes during the Covid-19 pandemic. To achieve this goal, they collected data from Facebook and Twitter, focusing on a specific time frame (March 23 to April 30, 2020) that coincided with the initial announcement of the first UK lockdown.

The use of data extraction tools like Crowd tangle and Twitter API for collecting relevant posts aligns with the objective of analyzing social media communication. The researchers applied specific search terms to ensure comprehensive results and filtered the data manually to include only posts directly linked to NHS audiology service communication. Moreover, the study considered ethical considerations and data privacy laws, as the information was gathered from the public domain.

The geospatial mapping and interaction analysis were appropriate methods for analyzing the geographic distribution of posts and understanding user engagement with the content. The study also acknowledged its limitations, such as the inability to access private communications, which may have impacted the comprehensive understanding of all communication strategies.

Considering the research question and objectives, the methodology used allowed the researchers to gain insights into how NHS audiology departments used social media to communicate service changes during the pandemic. However, it is essential to recognize that the study's scope is specific to social media usage during a particular period and may not address all aspects of audiology service changes comprehensively.

SUGGESTIONS - To further enhance the study's depth and gain additional insights, the researchers could have considered conducting the following analyses:

Content Analysis: Instead of solely focusing on the number of interactions (likes, shares, comments), the researchers could have performed a content analysis of the posts. This analysis would involve categorizing the posts based on the type of information shared (e.g., changes in appointments, teleaudiology services, hearing aid maintenance), the tone of the messages (e.g., informative, reassuring, urgent), and the overall effectiveness of the communication.

Sentiment Analysis: By employing sentiment analysis, the researchers could assess the emotional tone of the social media posts. This analysis would help determine whether the messages conveyed by the audiology departments were perceived positively, negatively, or neutrally by the audience. Sentiment analysis can provide valuable insights into how well-received the service changes were among patients.

Comparison with Traditional Communication Channels: In addition to analyzing social media usage, the researchers could have compared the effectiveness of social media as a communication channel with more traditional methods like emails, SMS, or letters. By surveying patients who received information through different channels, the researchers could gauge the preferences and efficacy of various communication methods.

Longitudinal Analysis: The study focused on a specific six-week period during the initial announcement of the UK lockdown. A longitudinal analysis covering multiple time periods (e.g., before, during, and after the lockdown) could reveal how communication strategies evolved over time and how patients' responses changed as the pandemic progressed.

Qualitative Interviews or Surveys: To gain a more comprehensive understanding of patient perspectives and experiences, the researchers could have conducted qualitative interviews or surveys with patients who interacted with the audiology departments' social media posts. These interviews could provide valuable insights into patients' satisfaction, comprehension of information, and suggestions for improvement.

Comparison with Other Healthcare Specialties: The study focused on audiology service changes, but a broader analysis comparing social media communication practices across various healthcare specialties could highlight similarities, differences, and best practices for effective communication during a public health crisis.

Analysis of Responses to Misinformation: Since the study touched upon concerns about the credibility of information shared on social media, the researchers could have analyzed responses to misinformation related to audiology services during the pandemic. This analysis could help identify potential challenges in combating false or misleading content.

Cost-Benefit Analysis: A cost-benefit analysis of using social media as a communication channel could provide insights into the resource allocation for social media efforts compared to other communication methods. This analysis would be useful in determining the most cost-effective ways to reach and engage with patients.

By incorporating these additional analyses, the researchers could have gained a more comprehensive understanding of the role and impact of social media in engaging audiology consumers during the Covid-19 pandemic and beyond.

Reviewer #2: p. 2, lines 32-33: You cite a study concluding that Facebook and Twitter are the most commonly used types of social media. Was any effort made to determine the types of social media most commonly used by the ages and other demographics of people who tend to use audiology services more regularly than others? Given that older adults are one of the largest groups seen by audiologists and that "presbycusis" was one of your search terms, I'm wondering whether your choices of Facebook and Twitter were based at all on older adult social media use patterns.

Also on the topic of populations that use audiology services: the search terms that you list seem primarily focused on adult audiology services. Were pediatric audiology services included in the social media posts that you analyzed? Or was this study primarily about adult audiology services?

p. 3, lines 94-95: Is there a reason to believe that only hearing aid users are interacting with these posts and therefore represented in the total number of interactions? The meaning of the sentence here isn't entirely clear to me. Are you trying to point out that not all hearing aid users are being reached by social media posts? Something else?

p. 4, lines 110-111: Why is YouTube coming up this far into the paper when Facebook and Twitter were the platforms used for collecting data for the study? And if 40% of participants reported using Facebook and YouTube in the study you cite at this point in the paper, is there a reason that you didn't use YouTube as a data source? I see that later in the paper, you mention YouTube as a future direction. Still, the mention of YouTube in the Results and Discussion section is somewhat confusing.

This paper addresses an important topic for audiology services. The transition from in-person to virtual services at the beginning of the pandemic was jarring for many audiologists around the world, and understanding how different health systems used social media to keep patients informed will be helpful for improving how we use social media in audiology.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: PONE-D-23-19309_reviewer.pdf

pone.0288223.s001.pdf (513.8KB, pdf)
PLoS One. 2024 Apr 25;19(4):e0288223. doi: 10.1371/journal.pone.0288223.r002

Author response to Decision Letter 0


23 Feb 2024

Response to Editor and Reviewer Comments

We would like to thank the Editor and Reviewers for their insightful comments on our study. We believe these have improved our study, and have provided point-by-point responses below.

Editor Comments:

1--Please spell out NHS the first time. I know in the UK it is well known but it took me a minute to get it.

Response: We have now spelled out as follows, “National Health Service (NHS)” , and updated this across the paper.

2–On line 22, please start a new paragraph

Response: We have amended accordingly.

3–line 32 has a change in topic so please be sure your paragraph is internally consistent

Response: We have amended this accordingly, and separated paragraphs.

4--Your introduction is extremely brief. COVID was not the first time that this type of service was online. I checked and there is a long history of moving towards this type of service. Please expand the introduction.

Response: We agree with respectable reviewer, we have added more information to the introduction clarifying that Teleaudiology had been looked into prior to Covid but still lacked infrastructure.

5--CrowdTangle (notice the Capital T) is not common knowledge. Therefore, you are going to need to explain that system in more detail. Also you have it spelled two different was":Crowd Tangle and Crowdtangle. Please use the correct name.

Response: Thank you for this comment, we have corrected CrowdTangle spelling within report, we have also detailed what CrowdTangle is capable of for a better understanding of the reader.

6--please define API

Response: Thanks for the reviewer for highlighting this, it has now been defined appropriately within the script, Application Programming interface (API), we have also detailed what the API is capable of doing for a better understanding for the reader.

7--It is not clear what parameters you are targeting. Please expand on exactly what are your parameters of interest.

Response: We agree with respectable reviewer, we have clarified the parameters further so that they are understandable to the reader clearly

8--Please separate the results and discussion

Response: Thank you for this, we have now separated the results and discussion section.

9--you need a better key to explain Figure 1. I still am not clear what the colors mean

Response: We have explained this to further help clarify what the different colours are illustrating.

10--Table 1 is redundant to the text so please delete it. Rule is either a table or in the text--one or the other

Response: Thank you, we have removed Table 1.

11--You need more interpretation of your results

Response: We agree with this and have expanded our results and discussion sections to provide more detail.

12--Table 2 needs to be expanded for clarity.

Response: We agree with this, and have explained the table more clearly in the results.

Reviewer 1 Comments:

To further enhance the study's depth and gain additional insights, the researchers could have considered conducting the following analyses:

Content Analysis: Instead of solely focusing on the number of interactions (likes, shares, comments), the researchers could have performed a content analysis of the posts. This analysis would involve categorizing the posts based on the type of information shared (e.g., changes in appointments, teleaudiology services, hearing aid maintenance), the tone of the messages (e.g., informative, reassuring, urgent), and the overall effectiveness of the communication.

Response: We agree with the reviewer that content analysis would have been useful for further insights, however on our initial reading/scanning of interactions and comments on Facebook, we found these to be largely limited to short replies and ‘reactions’ to posts. It would be useful for us to analyse other social media sources, e.g. hearing aid user forums, twitter etc, for content analysis and correlate them to our high-level findings. We have now made reference to this in our future work and limitations section. We have however carried out sentiment analysis on the available comments, as discussed in the next response.

Sentiment Analysis: By employing sentiment analysis, the researchers could assess the emotional tone of the social media posts. This analysis would help determine whether the messages conveyed by the audiology departments were perceived positively, negatively, or neutrally by the audience. Sentiment analysis can provide valuable insights into how well-received the service changes were among patients.

Response: Thank you for this insightful comment. We agree it would be useful to understand public sentiment towards these posts. As noted earlier, most of the patient engagement was limited to short comments or ‘reactions’ to posts with different emotions. However, we have extracted available comments and performed high level sentiment analysis on them , to gain some insight into public sentiment towards the service communications.

Comparison with Traditional Communication Channels: In addition to analyzing social media usage, the researchers could have compared the effectiveness of social media as a communication channel with more traditional methods like emails, SMS, or letters. By surveying patients who received information through different channels, the researchers could gauge the preferences and efficacy of various communication methods.

Response: This is an excellent suggestion, however we feel a larger experiment would be required where we obtain consent from patients enrolled to access their other communications. We have made reference to this in our future work.

Longitudinal Analysis: The study focused on a specific six-week period during the initial announcement of the UK lockdown. A longitudinal analysis covering multiple time periods (e.g., before, during, and after the lockdown) could reveal how communication strategies evolved over time and how patients' responses changed as the pandemic progressed.

Response: This is an excellent suggestion, however we feel a larger experiment would be required where we obtain consent from patients enrolled to access their other communications. We have made reference to this in our future work.

Qualitative Interviews or Surveys: To gain a more comprehensive understanding of patient perspectives and experiences, the researchers could have conducted qualitative interviews or surveys with patients who interacted with the audiology departments' social media posts. These interviews could provide valuable insights into patients' satisfaction, comprehension of information, and suggestions for improvement.

Response: This is an excellent suggestion, however we feel a larger experiment would be required where we obtain consent from patients enrolled to access their other communications. We have made reference to this in our future work.

Comparison with Other Healthcare Specialties: The study focused on audiology service changes, but a broader analysis comparing social media communication practices across various healthcare specialties could highlight similarities, differences, and best practices for effective communication during a public health crisis.

Response: This is an excellent suggestion, however we feel a larger experiment would be required where we obtain consent from patients enrolled to access their other communications. We have made reference to this in our future work.

Analysis of Responses to Misinformation: Since the study touched upon concerns about the credibility of information shared on social media, the researchers could have analyzed responses to misinformation related to audiology services during the pandemic. This analysis could help identify potential challenges in combating false or misleading content.

Response: This is an excellent suggestion, however we feel a larger experiment would be required where we obtain consent from patients enrolled to access their other communications. We have made reference to this in our future work.

Cost-Benefit Analysis: A cost-benefit analysis of using social media as a communication channel could provide insights into the resource allocation for social media efforts compared to other communication methods. This analysis would be useful in determining the most cost-effective ways to reach and engage with patients.

Response: This is another excellent suggestion, however we feel a larger experiment would be required where we obtain consent from patients enrolled to access their other communications. We have made reference to this in our future work.

Reviewer 2 comments:

p. 2, lines 32-33: You cite a study concluding that Facebook and Twitter are the most commonly used types of social media. Was any effort made to determine the types of social media most commonly used by the ages and other demographics of people who tend to use audiology services more regularly than others? Given that older adults are one of the largest groups seen by audiologists and that "presbycusis" was one of your search terms, I'm wondering whether your choices of Facebook and Twitter were based at all on older adult social media use patterns.

Response:Thank you for this comment from the reviewer. To further support the use of Facebook and Twitter within this study another study has been cited were the authors had found that the use of facebook and twitter was larger in the older population in comparison to other social platforms.

Also on the topic of populations that use audiology services: the search terms that you list seem primarily focused on adult audiology services. Were pediatric audiology services included in the social media posts that you analyzed? Or was this study primarily about adult audiology services?

Response: Thank you for the comment from the reviewer, all terminology used within the search terms would have been appropriate for both adult and children services except “Presbycusis” which refers to age related hearing loss.

p. 3, lines 94-95: Is there a reason to believe that only hearing aid users are interacting with these posts and therefore represented in the total number of interactions? The meaning of the sentence here isn't entirely clear to me. Are you trying to point out that not all hearing aid users are being reached by social media posts? Something else?

Response: Many thanks for the reviewer for this comment, we have clarified the sentence so that it is more understandable, “some of the interactions may not have been from directly from the hearing aid user but possibly a friend or family member who may be affected by this change of service. Interactions included likes, shares, comments, or reposts. However, the reported interaction frequencies may underestimate the full reach, as some individuals may have viewed the posts without actively engaging through likes/comments.”

p. 4, lines 110-111: Why is YouTube coming up this far into the paper when Facebook and Twitter were the platforms used for collecting data for the study? And if 40% of participants reported using Facebook and YouTube in the study you cite at this point in the paper, is there a reason that you didn't use YouTube as a data source? I see that later in the paper, you mention YouTube as a future direction. Still, the mention of YouTube in the Results and Discussion section is somewhat confusing.

Response: Thank you to the reviewer for this comment. We have now ensured that the mention of specific social media platforms is now clearer and in a more appropriate order.

Attachment

Submitted filename: Response to Reviewers.pdf

pone.0288223.s002.pdf (57.3KB, pdf)

Decision Letter 1

Mary Diane Clark

4 Mar 2024

Impact of the Covid-19 Pandemic on Audiology Service Delivery: Observational Study of the Role of Social Media in Patient Communication

PONE-D-23-19309R1

Dear Dr. Hussain,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Mary Diane Clark, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Thank you for your work on this revision. I enjoyed reading this revision and believe it will make an important contribution. I have recommend acceptance.

Reviewers' comments:

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: PONE-D-23-19309_reviewer.pdf

    pone.0288223.s001.pdf (513.8KB, pdf)
    Attachment

    Submitted filename: Response to Reviewers.pdf

    pone.0288223.s002.pdf (57.3KB, pdf)

    Data Availability Statement

    The data used in this study is now available on GitHub at [https://github.com/kiadashtipour/Sentiment-Analysis-Adeel-Hussain].


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES