# Tokenization

**URL:** <https://forum.rasa.com/t/tokenization/50154>\
**Category:** Rasa Open Source\
**Created:** [December 20, 2021, 7:47am UTC](https://forum.rasa.com/t/tokenization/50154 "2021-12-20T07:47:55Z")\
**Posts on this page:** 1\
**Showing post:** 10

<div class="post-metadata">

**Author:** ![MatthiasLeimeister](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/matthiasleimeister/32/18158_2.png) [@MatthiasLeimeister](https://forum.rasa.com/u/MatthiasLeimeister)\
**Post date:** [December 22, 2021, 10:40am UTC](https://forum.rasa.com/t/tokenization/50154/10 "2021-12-22T10:40:33Z")

</div>

Actually, looking at the [documentation](https://rasa.com/docs/rasa/nlu-training-data#lookup-tables) the txt format no longer seems to be supported. Sorry for the confusion.

In Rasa 2, you can put your lookup table either in your main `nlu.yml` file, or in a separate file and put this in your `data` folder next to your `nlu.yml`. You don’t have to point to the lookup file from your `nlu.yml`, it will be found automatically. But you have to annotate some examples for the entity in your NLU file.

See [this post](http://forum.rasa.com/t/how-to-provide-the-lookup-entities-in-txt-format/4518/20) for an example folder structure.

---

_[View the full topic](https://forum.rasa.com/t/tokenization/50154)._