Does the vocabulary of a corpus remain the same before and after text

1.	Does the vocabulary of a corpus remain the same before and after text normalization? Why?
Answer» No, the vocabulary of a corpus does not remain the same before and after text normalization. Reasons are: ● In normalization the text is normalized through various steps and is lowered to minimum vocabulary since the machine does not require grammatically correct statements but the essence of it. ● In normalization Stop words, Special Characters and Numbers are removed. ● In stemming the affixes of words are removed and the words are converted to their base form. So, after normalization, we get the reduced vocabulary.

Does the vocabulary of a corpus remain the same before and after text normalization? Why?

Answer»

No, the vocabulary of a corpus does not remain the same before and after text normalization.

Reasons are:

● In normalization the text is normalized through various steps and is lowered to minimum vocabulary since the machine does not require grammatically correct statements but the essence of it.

● In normalization Stop words, Special Characters and Numbers are removed.

● In stemming the affixes of words are removed and the words are converted to their base form.

So, after normalization, we get the reduced vocabulary.

Discussion

No Comment Found

Related InterviewSolutions

What were the two main occupations of the Rig Vedic Aryans?
Name the two political institutions which exercised check on the powers of the King in the Rig Vedic period.
What w’as the position of women in the Rig Vedic age ?
Describe the social life of the Rig Vedic Aryans with reference to the following: (a) The Family Structure (b) Position of Women (c) Varna System
With reference to the following explain the main features of the Rig Vedic Economy: (a) Agriculture (b) Domestication of Animals (c) Trade Transactions, Crafts and Transportation
Mention any two archaeological sources to reconstruct the later Vedic Age.
Mention any two of the Ashrams in the life of a man in Aryan society.
What information do we gather from the later Vedic literature in respect of: (a) Spread of Vedic Civilization to many New Regions. (b) Role of Iron in later Vedic Economy.
Mention briefly the rituals and sacrifices of the later Vedic Aryans?
What is the message of the Bhagavad Gita?