Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
| Pre-processing step | Function |
|---|---|
| Fix abbreviations | Replace short words with full words |
| Remove irrelevant characters | Remove redundant characters including links, email IDs |
| Fix word lengthening | Removal of additional, repeated characters |
| Stopword removal | Removal of words including “the”, “an” and customized stopwords |
| SpellCheck | Fix wrong spelling |
| Punctuation removal | Remove punctuations |
| Lemmatization | Group words with similar meanings to a single item |
