Abstract
In response to the COVID-19 pandemic, a lot of scholarly articles have been published recently and made freely available. At the same time, there is emerging need to provide reliable and adequate information, which can reinforce the efforts made in raising awareness, to carry out infallible actions to prevent the worsening of the pandemic situation. With that said the current work tackles the perennial problem of creating a deep learning system allowing answering with a high precision to questions on a determined subject.
To do this, we will use open source scientific and academic articles concerning Covid-19, then we will proceed to the selection of suitable documents which will allow us to feed a question answering system based on BERT fine-tuned on the SQuAD benchmark.
Keywords: SQuAD, BERT, COVID-19, Question Answering
References
- 1.Jalammar.github.io/illustrated-transformer/visualizing-neural-machine-translation-mechanics-of-seq2seq-models-with-attention/ May 9, 2018.
- 2.Lucy Lu Wang and Kyle Lo and Yoganand Chandrasekhar and Russell Reas and Jiangjiang Yang and Darrin Eide and Kathryn Funk and Rodney Michael Kinney and Ziyang Liu and William. Merrill and Paul Mooney and Dewey A. Murdick and Devvret Rishi and Jerry Sheehan and Zhihong Shen and Brandon Stilson and Alex D. Wade and Kuansan Wang and Christopher Wilhelm and Boya Xie and Douglas M.Raymond and Daniel S. Weld and Oren Etzioni and Sebastian Kohlmeier CORD-19: The Covid-19 Open Research Dataset/Wang2020CORD19TC journal:ArXiv, volume:abs/2004.10706.
- 3.J. Wan and S. Pan, “Performance Evaluation of Compressed Inverted Index in Lucene,” 2009 International Conference on Research Challenges in Computer Science, Shanghai, 2009, pp. 178-181, doi: 10.1109/ICRCCS.2009.53.
- 4.Peilin Yang, Hui Fang, Jimmy Lin. Anserini: Enabling the Use of Lucene for Information Retrieval Research Computer Science ECIR 201
- 5.Derek Miller, Leveraging BERT for Extractive Text Summarization on Lectures, arXiv:1906.04165, 2019.
- 6.M. Ramina, N. Darnay, C. Ludbe and A. Dhruv, “Topic level summary generation using BERT induced Abstractive Summarization Model,” 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2020, pp. 747-752, doi: 10.1109/ICICCS48265.2020.9120997.
- 7.Thilina Rajapakse, Question: How to use Transformers for Question Answering? Answer: Simple Transformers Novembre 17.2015.
- 8.Zihuan Diao, Junjie Dong, and Jiaxing Geng. Question answering on squad dataset. CS224N 2018 Winter, 2018.
- 9.Beliz Gunel and Cagan Alkan. Question answering on squad. CS224N 2018 Winter, 2018.
- 10.Beliz Gunel and Cagan Alkan. Question answering on squad. CS224N 2018 Winter, 2018.