Lemmatization & Punctuations

[TatianaParshina]

If you use Rasa tokenizer tokenizer_spacy, then by default it will return verbatim text content, not lemma.

You should create custom tokenizer component based on tokenizer_spacy implementation to do lemmatization.

I wrote post about it.