Hey all, I am having trouble using the data converter available on rasa cli due to some characters and symbols frequently used in brazilian portuguese. I already have a corpus in json that works well on previous Rasa versions. As I am starting to adapt all my routines to be compatible with newer versions (>2.0.0), I tried using the following cli command: rasa data convert nlu -f md--data=old_data --out=data (At first the conversion is to ‘md’ because it seems like I need an ‘md’ file to convert to yaml.) Things go OK and a new file is generated and seems well parsed, except from the special characters probably due to encoding changes in the middle of the proccess. The output file is then filled with strings as ‘\u00e1’ for example for some special characters. I tried the variations below with no success: rasa data convert nlu -f yaml --data=old_data --out=data -l pt rasa data convert nlu -f yaml --data=old_data --out=data -l pt-br Does anyone know a fix for this? Anyone went through this? I want to know if there is an easy way to deal with this before developing my own parser.

Doubts on using 'rasa data convert' on cli with foreign language and special characters

bayesianwannabe (Julio) December 15, 2020, 6:53pm 7

No problems at all! I am sorry for so many questions. I wonder if you are being able to use rasa x normally on linux with brazilian portuguese sentences with special characters, as I am also having an encoding problem as I posted here:

Thank you!

Topic		Replies	Views
"rasa data convert nlu" dosn't work Rasa Open Source	6	1207	February 23, 2022
Rasa data convert nlg -f yaml --data=./data --out=./data not working Rasa Open Source	6	1488	March 23, 2021
How do I convert md nlu data to yml? Rasa Open Source	4	1965	November 8, 2022
Error while migrating training data from rasa 1.10 to Rasa 2.0 Rasa Open Source	1	340	October 26, 2020
Rasa data convert Rasa Open Source	2	133	October 9, 2023

Doubts on using 'rasa data convert' on cli with foreign language and special characters

Related Topics