Which approach replaces words with their dictionary form based on meaning and part of speech, turning 'better' into 'good'?

Get ready for the GARP Risk and AI Exam with flashcards and multiple choice questions. Each question comes with hints and explanations. Prepare for success!

Multiple Choice

Which approach replaces words with their dictionary form based on meaning and part of speech, turning 'better' into 'good'?

Lemmatization maps words to their canonical dictionary form by considering both meaning and grammatical role. Because it uses the language’s dictionary and part of speech to pick the true base form, it can turn inflected or derived forms into the single, dictionary form. For example, when a word is used as an adjective in its comparative form, its lemma is the base adjective: “better” becomes “good.” This accuracy comes from combining lexical knowledge with POS information, so you end up with forms that exist as dictionary entries and carry the intended meaning. This is different from stemming, which merely chops off affixes and can produce non-words or inaccurate bases (like producing “bet” or leaving “better” unchanged). It’s also not about removing common words (stop word removal) or about counting word occurrences (term frequency), both of which don’t standardize words to their dictionary forms. So lemmatization is the approach that correctly yields the dictionary form based on meaning and grammar, such as turning “better” into “good.”

Lemmatization maps words to their canonical dictionary form by considering both meaning and grammatical role. Because it uses the language’s dictionary and part of speech to pick the true base form, it can turn inflected or derived forms into the single, dictionary form. For example, when a word is used as an adjective in its comparative form, its lemma is the base adjective: “better” becomes “good.” This accuracy comes from combining lexical knowledge with POS information, so you end up with forms that exist as dictionary entries and carry the intended meaning.

This is different from stemming, which merely chops off affixes and can produce non-words or inaccurate bases (like producing “bet” or leaving “better” unchanged). It’s also not about removing common words (stop word removal) or about counting word occurrences (term frequency), both of which don’t standardize words to their dictionary forms. So lemmatization is the approach that correctly yields the dictionary form based on meaning and grammar, such as turning “better” into “good.”

More practice questions