Comparison of Sentences using POS Tagging Tool under Subjective Examination

Abstract

The Question answering system is used to generate the correct result that is asked by humans in natural language. In an online examination system, most of the work has been done but still, problems occur in preprocessing i.e. Part Of Speech (POS). POS tagger is used to properly tag each word in the sentences. In this paper, we used two datasets i.e. TREC DATA and data collected from the student. We apply the POS tagger to both datasets and compare the result. For generating the POS tagger we used NLTK and spaCy libraries for comparison. We observed that using those libraries the same word has a different tag. Using both tools, we computed the difference between the words and assigned the count to the POS tagging on that result, we calculate the accuracy of both libraries. The result shows that the spaCy library is best for POS tagging because it generates more correct results as compared to NLTK.