Hi, i am currently developing a chat bot for movie ticket booking. I want to use a lookup table for “language” entity. But my chatbot is not predicting the languages which are there in lookup table, but it is working fine with the training examples. I think my config.yml is not correct. I tried so many pipeline configurations, but none of them were working. I also tried looking in this blog but it is a outdated blog, the configurations now we have were changed compared to it. These are the files i am using. language.txt: -------------------------------------- config.yml: [Screenshot 2021-05-08 at 5.14.45 PM] ------------------ [Screenshot 2021-05-08 at 5.19.20 PM] nlu.yml: [Screenshot 2021-05-08 at 5.25.47 PM] Here is the execution: In the first message it is correctly picking the “language” entity. But in the second message it is picking “bodo” language as a movie_name. Eventhough i didn’t added urdu in my training data it is working fine, but “bodo” is not working fine. I don’t even understand whether my lookup table is working or not. [lookup] If you have any idea about this please help me. Thanks in advance

Hi! According to this post , you’d need to present your lookup format in a .yml format, so it would have to look something like this: fruits.yml: version: "2.0" nlu: - lookup: language examples: | - english - telugu - hindi You would then need to put this file in the nlu folder. Additionally, you would need to add either RegexEntityExtractor or FlashTextEntityExtractor (which works with lookups only) in your config pipeline. I’m not sure if there is a way for rasa to work with pure .txt files, but I do have a Python script which converts a .txt file (or any plaintext file) into a .yml file with the appropriate format , which you can modify based on your needs. Here it is if anyone is interested: # Insert normal .txt/.csv path here file = open(r"C:\Users\User\Desktop\Cities in the World.csv", "r") # Splits each row lines = file.read().splitlines() n = 0 # Insert target output path here file2 = open(r"C:\Users\User\Desktop\cities.yml", "w") # Writes the headers(?), remember to change the lookup name file2.write("version: \"2.0\"\nnlu:\n - lookup: city \n examples: |\n") # Adds indent and dash to each line for line in lines: file2.write(" - " + str(line) + "\n") # Closes the files file.close() file2.close() I hope this helps!

Thanks for the response i will try changing the lookup table format and use FlashTextEntityExtractor in my pipeline and will update to you

no problem, good luck and i hope this helps!

Yeah it is working fine now, once again thank you so much I’ve been searching for this for a few days but couldn’t find any documentation about this, finally made it working. I am also trying to implement fuzzyword matching, do you have any idea about this or any documentation regrading this topic.

Hi @saimanoj2826 , you can check out a livecoding session in which my coworker implements fuzzy matching here . Happy bot-building!

@fkoerner I already watched the session, she implemented it in a form to check the user messages with some mistakes, but i want to implement it as a custom component which will have to pickup entites with misspells

@saimanoj2826 you can look at the RegexEntityExtractor for inspiration. Basically, a FuzzyEntityExtractor can work similarly, except that this line will need to allow for fuzzy matches. Does that help?

sorry i didn’t understand, is there an extractor in rasa for fuzzy matching

No, you need to implement a custom one.

I was just trying to say that the custom implementation would look very similar to the RegexEntityExtractor, so you could use that as a starting point. Does that make sense?

Lookup tables configuration problem

Rasa Open Source

danangyudhatama (Danangyudhatama) June 25, 2024, 9:08am 20

can you provide the pipeline, and where did you put the RegexEntityExtractor in the pipeline?

Topic		Replies	Views
Issue getting model to pick up on lookup table values Getting Started with Rasa	8	426	August 13, 2021
Rasa 2 Lookup Table file syntax Rasa Open Source	29	5694	September 14, 2022
Lookup Tables not being detected Rasa Open Source	5	803	May 14, 2024
Unable to pick name or location from my lookup table Rasa Open Source	11	703	November 4, 2021
Lookup does not used to extract entities Rasa Open Source	3	812	June 15, 2020

Lookup tables configuration problem

Related topics