Skip to main content
Wiley - PMC COVID-19 Collection logoLink to Wiley - PMC COVID-19 Collection
. 2021 Mar 21;75(6):e14134. doi: 10.1111/ijcp.14134

How to spot COVID‐19 patients: Speech & sound audio analysis for preliminary diagnosis of SARS‐COV‐2 corona patients

Amit Sharma 1,2,, Ashish Baldi 3,, Dinesh Kumar Sharma 4
PMCID: PMC8250077  PMID: 33683774

Abstract

Background

The global cases of COVID‐19 increasing day by day. On 25 November 2020, a total of 59 850 910 cases reported globally with a 1 411 216 global death. In India, total cases in the country now stand at 91 77 841 including 86 04 955 recoveries and 4 38 667 active cases as on 24 November 2020, as per the data issued by ICMR. A new generation of voice/audio analysis application can tell whether the person is suffering from COVID‐19 or not.

Aims

To describe how to established a new generation of voice/audio analysis application to identify the suspected COVID‐19 hidden cases in hotspot areas with the help of an audio sample of the general public.

Materials & Methods

The different patents and data available as literature on the internet are evaluated to make a new generation of voice/audio analysis application with the help of an audio sample of the general public.

Results

The collection of the audio sample will be done from the already suffered COVID‐19 patients in (.Wave files) personally or through phone calls. The audio samples such as the sound of the cough, the pattern of breathing, respiration rate and way of speech will be recorded. The parameters will be evaluated for loudness, articulation, tempo, rhythm, melody and timbre. The analysis and interpretation of the parameters can be made through machine learning and artificial intelligence to detect corona cases with an audio sample.

Discussion

The voice/audio application current project can be merged with a mobile App called ‘AarogyaSetu’ by the Government of India. The project can be implemented in the high‐risk area of COVID‐19 in the country.

Conclusion

This new method of detecting cases will decrease the workload in the COVID‐19 laboratory.

1. BACKGROUND

The global cases of COVID‐19 increasing day by day. On 25 November 2020, a total of 59 850 910 cases reported globally with a 1 411 216 global death. 1 In India, total cases in the country now stand at 91 77 841 including 86 04 955 recoveries and 4 38 667 active cases as on 24 November 2020, as per the data issued by ICMR. 2 Around 30 000 to 47 000 daily new cases were reported for the past some days in India. 3 The Indian Council of Medical Research (ICMR) reported three cases of COVID‐19 re‐infection in India from across the country so far, whereas 24 such cases have been found globally. Around 80% of COVID‐19 patients present with mild or no symptoms. 4 Symptoms may include fever, cough, aches, pains, and weakness, all common to cold and flu. 4 It is important to note that the absence of fever does not exclude infection from COVID‐19.

2. MATERIALS & METHODS

A new generation of voice/audio analysis application which can tell whether the person is suffering from COVID‐19 is developed. 5 The voice samples can be used to find out the corona patients. 6 The software will be developed that can tell whether a person has corona by machine learning technique and artificial intelligence. 7 Using machine learning algorithms to detect corona with the audio sample is a new model which can have the accuracy of around 99% to find out the hidden causes of COVID‐19 patients in the hotspot areas. 8

3. RESULTS

The sound made by coronavirus patients is so specific that we can reveal who has the disease. 9 An audio sample of COVID‐19 patients such as the sound of the cough, a pattern of breathing, respiration rate, way of speech, intervals of their breathing will be recorded. 9 Data will be used for machine learning algorithms that analyse the audio sample for the symptoms of COVID‐19. Artificial intelligence application needs to considered multiple sound as signals to understand subtle variations in speech to suggests same one are infected with COVID‐19 or not. Breath sound may sound clear & fast as the disease progress; we hear the faint wheezing having prolonged expiratory phase, having high or low pitch. In case of mild corona infection, patients may auscultate fine, crackles, high pitch and having popping sound like firewood burning in a fireplace. 10 , 11 Whereas in severe corona patients, sounds will be similar to acute respiratory distress syndrome (ARDS). 12 , 13

Coarse rales with diffuse rhonchi will be observed in corona patients. Coarse rales have a low pitch, popping and bubbling whereas in rhonchi there is continuous low pitch, rumbling and gurgling. 12 , 13 The corona patients have cough sounds for a continuous half‐hour with two cough sounds. 14 , 15 Each episode lasts for 15‐30 seconds. 14 The presence of mucus and phlegm, the sound of sneezing and runny nose mean patients are not suffering from COVID‐19. 15 The corona patients have dry cough very consistent sound. They were triggered by a tickle in the back of the throat with a barking or hoarse sound. 14 , 16 There will be a wheezing sound if lungs or intercostal muscles are injured resulting from COVID‐19. 16

Figure 1 shows the plan layout for audio analysis for preliminary diagnosis of COVID‐19 patients. The collection of the audio sample will be done from the already suffered COVID‐19 patients in (.Wave files) personally or through phone calls. The audio samples such as the sound of the cough, the pattern of breathing, respiration rate and way of speech will be recorded. The audio sample of patients having different demographic will be collected. The obtained data can be added in a data‐based server which can be used for further analysis. The process and method of step II which are to identify the hidden or suspected COVID‐19 cases are shown in Figure 1.

FIGURE 1.

FIGURE 1

Plan layout for audio analysis for preliminary diagnosis of COVID‐19 patients

Figure 2 shows the parameters of COVID‐19 audio database, which includes audio sample, the sound of the cough, pattern of breathing, respiration rate and way of speech. All parameters will be evaluated for loudness, articulation, tempo, rhythm, melody and timbre. The analysis and interpretation of the parameters can be made through machine learning and artificial intelligence to detect corona cases with an audio sample. The data obtained by this method can be used as reference data. The information regarding the audio database will be shared with concern departments for health check of hidden COVID‐19 cases with location and mobile number.

FIGURE 2.

FIGURE 2

Parameters of COVID‐19 audio database

4. DISCUSSION

This new generation of voice/audio analysis application work is to identify the suspected COVID‐19 hidden cases in hotspot areas with the help of an audio sample of general public. 9 The voice/audio application current project can be merged with a mobile App called ‘AarogyaSetu’ by the Government of India. The project can be implemented in the high‐risk area of COVID‐19 in the country. Another advanced feature of the new generation of voice/audio analysis application is to find out the general public who is most is at risk of COVID‐19 with the help of sign and symptoms developed.

Scrutiny of the COVID‐19 patients by this method can enhance the percentage up to 50‐60. We will be closer to the suspected cases which will help to decrease the cost of utilisation of the COVID‐19 testing kits. India is still waiting for the rapid testing kits from abroad. The current test, which is available in India, has conducted in very few places and takes up to 3‐4 hours for the results.

5. CONCLUSION

This new method of detecting cases will decrease the workload in the COVID‐19 laboratory. Firstly, we can screen the patients through this app, if found suspected patients than we can proceed for the diagnosis of the COVID‐19 patients through test kits for further confirmation. There is no chance of infection to healthcare professionals, as no direct contact or physical contact with the patients.

5.1. Cost break up for setting voice/audio analysis application

The cost for the workforce can be up to 100 000/‐ INR and travel collection of the audio sample can be up to 600 000/‐ INR, whereas the server and software cost can be up to 150 000/‐ INR and setting up a control room in hotspot area with other facilities will be 150 000/‐ INR (Each). The total cost for the whole voice/audio analysis application will be 10 Lacs. Approx.

DISCLOSURE

The authors have declared that no competing interests exist.

AUTHOR CONTRIBUTIONS

AS written the manuscript and behind the idea and novel invention. AB and DKS are the major contributors in writing and drafting the manuscript. All the authors read and approved the final manuscript.

STATEMENT OF ETHICS

Not Applicable.

Sharma A, Baldi A, Kumar Sharma D. How to spot COVID‐19 patients: Speech & sound audio analysis for preliminary diagnosis of SARS‐COV‐2 corona patients. Int J Clin Pract. 2021;75:e14134. 10.1111/ijcp.14134

Contributor Information

Amit Sharma, Email: choice.amit@gmail.com.

Ashish Baldi, Email: baldiashish@gmail.com.

REFERENCES

  • 1. Johns Hopkins Coronavirus Resource Center . COVID‐19 Map. Johns Hopkins Coronavirus Resource Center‐Johns Hopkins University & Medicine; 2020. [Google Scholar]
  • 2. D'Cruz M. The ICMR bulletin on targeted hydroxychloroquine prophylaxis for Covid‐19: need to interpret with caution. Indian J Med Ethics. 2020;5:100‐102. [DOI] [PubMed] [Google Scholar]
  • 3. www.icmr.com . Indian Council of Medical Research, New Delhi 19–21; 2020.
  • 4. Culp WC. Coronavirus Disease 2019. A A Pract. 2020;14:e01218. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Schuller BW, Schuller DM, Qian K, Liu J, Zheng H, Li X. COVID‐19 and computer audition: an overview on what speech & sound analysis could contribute in the SARS‐COV‐2 corona crisis. arXiv. 2020. https://arxiv.org/pdf/2011.14445.pdf [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Batra R, Chan H, Kamath G, Ramprasad R, Cherukara MJ, Sankaranarayanan SK. Screening of therapeutic agents for COVID‐19 using machine learning and ensemble docking studies. J Phys Chem Lett. 2020;11:7058‐7065. [DOI] [PubMed] [Google Scholar]
  • 7. Randhawa GS, Soltysiak MPM, El Roz H, de Souza CPE, Hill KA, Kari L. Machine learning using intrinsic genomic signatures for rapid classification of novel pathogens: COVID‐19 case study. PLoS One. 2020;15:1‐24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Ardabili SF, Mosavi A, Ghamisi P, et al. COVID‐19 outbreak prediction with machine learning. Algorithms. 2020;13:249. [Google Scholar]
  • 9. Toma M, Toma M. Remotely diagnose coronavirus by recognizing and counting of coughs during Phone Calls. Biomed Res Rev. 2020;3:1‐3. [Google Scholar]
  • 10. Chintrakulchai P, Examiner P, Edouard PN, Examiner A, Godbold DC. (12) United States Patent. Vol. 2; 2009.
  • 11. Abburi R. (12) United States Patent. Vol. 2; 2006.
  • 12. Deshpande G, Schuller BW. An overview on audio, signal, speech, & language processing for COVID‐19. arXiv 1–5; 2020.
  • 13. Loudon R, Jr RM. Lung Sounds 1, 2. American Review of Respiratory; 1984. [DOI] [PubMed]
  • 14. Smith J, Ashurst H, Jack S, Woodcock A, Earis J. The description of cough sounds by healthcare professionals. Cough. 2006;2:1‐9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Hsu JY, Stone RA, Logan‐Sinclair RB, et al. Coughing frequency in patients with persistent cough: assessment using a 24 hour ambulatory recorder. Eur Respir J. 1994;7:1246‐1253. [DOI] [PubMed] [Google Scholar]
  • 16. Latif A, Ezehra SR, Hassan M. Post infection cough in patients of Covid 19. J Infect Dis Prev Med. 2019;8:1‐3. [Google Scholar]

Articles from International Journal of Clinical Practice are provided here courtesy of Wiley

RESOURCES