Lemmatizer

Lemmatizer

Lemmatizer 

Description

Lemmatization usually refers to doing things properly with the use of a vocabulary and morphological analysis of words, normally aiming to remove inflectional endings only and to return the base or dictionary form of a word. 
Lemmatizer reduces the inflected words ensuring that the “root” word belongs to the language.

Why to use

Textual Analysis – Pre Processing 

When to use

When you want to get the base or dictionary form of words that has meaning. When you want to link words with similar meanings to one word.

When not to use

On numerical data.

Prerequisites

It is used on textual data. 

Input

Gone

Going

Went

Output

Go

Related algorithms

  • Case Convertor
  • Custom Words Remover
  • Frequent Words Remover
  • Punctuation Remover
  • Spelling Corrector
  • Stemmer
  • Advanced Entity Extraction
  • Word Correlation
  • Word Frequency

Alternative algorithm

Stemmer

Statistical Methods used

-


Limitations

In-depth linguistic knowledge is required to create dictionaries and look for the proper form of the word.
It can change the meaning of some textual strings.


Lemmatizer is an algorithm in morphological analysis and computational linguistics which identifies the lemma (or the dictionary form) of a word. In lemmatization, all the inflected forms of a word are grouped together so that they can be identified as a single item.
Lemmatization algorithms identify the intended part of speech as well as the meaning of a word in a sentence, as also in a larger context in the surrounding sentences and even the entire document.