Tokens None from previous component(RASA custom component)

[souvikg10 (Souvik Ghosh)]

in rasa 2.6, I access tokens like this

tokens = [t.text for t in ex.get("text_tokens")]

where is ex is message object btw.

this will give you a list of tokens for every example