@nik202 Hey Nik, any ideas on how to integrate two languages in a bot, so that if someone types one language the bot is able to detect it and switch? How about adding pipelines for local languages that are not supported in rasa?

@souvikg10 Thank you very much, this is a great place to start. I am beginning with the part A. I have built a minimal bot that is able to work in English and Luganda, let me share so you can have a look. covid.yml (714 Bytes) eng.yml (574 Bytes) nlu.yml (1.7 KB) rules.yml (413 Bytes) stories.yml (2.2 KB) config.yml (1.4 KB) domain.yml (2.9 KB) This is the output: [image]

I have personally not implemented such a use case lets us take help or suggestion from chris pinging @ChrisRahme for the help. Many thanks in advance.

Please see the following posts/thread: [image] Mutlilingual bot (capturing user input and intercepting bot's output for translation) Rasa Open Source You’ll need to build a Custom Pipeline Component ( read more ) that detects the language of the input. You have 2 possibilities: 1. Understand and respond in only French and English: Introduce intents with examples in both English and French. - intent: greet examples: | - hello - bonjour etc... Your Component will only detect the language only and save it. All your responses will need to be Custom Actions ; in which you access the language and dispatch the correct message accordingly: …

Thank you @ChrisRahme Do you have any implementation examples, maybe a moodbot with the advise you gave so I can run an have some more context?

There’s my chatbot , but it doesn’t use a custom component. Instead, it asks the user which language they want to talk in at the start of the conversation. The bot will always understand 5 “languages” mentioned in the NLU, but will only respond in the language the user selected.

@ChrisRahme Thank you very much, let me have a look at it and get back to you. Thank you.

Hey @ChrisRahme I wanted to know more about the way you chose the pipeline, I actually thought I would need to build custom word embeddings for the language I want to use, or is it possible to work with the default pipeline because the alphabet is like english only missing a few letters.

Hello @atwine , before you go down the rabbit hole of building custom word embedddings? which language are you building the bot? There are already a lot of pre-trained embeddings in low resource languages available from spaCy, FastText and some variants of berts too. Also the default self supervised embeddings can work if you have decent amount of examples per intent(say about 15-20) as long as the language has words which can be split using WhitespaceTokenizer, see docs on how it splits the token.

Hello @souvikg10 Thanks, the language am trying to build for is: Luganda (Ugandan local dialect.) Ideally my bot should work for English and Luganda. Luganda does have mostly the english alphabet characters and I think a white space tokenizer would do fine. So you think I don’t have to try build custom embeddings?

You can try both A. Try the Self supervised first. see if that fits your needs then you don’t need anything else B. Enhance it with pre trained embeddings in luganda https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.lg.vec (DON"T CLICK ON THIS UNLESS YOU WANT TO DOWNLOAD THE VECTORS) and you can follow this project on how to import these vectors into your rasa project - FastTextFeaturizer - Rasa NLU Examples All fastText pretrained vectors are here [image] Wiki word vectors · fastText We are publishing pre-trained word vectors for 294 languages, trained on [*Wikipedia*](https://www.wikipedia.org) using fastText.

looks like it is working. well done!! some years back i worked on the swahili language with the same pipeline and my experience is for most short task flows, it does work quite well.

Building a bot for local language

Rasa Open Source

ChrisRahme (Chris Rahmé) January 12, 2022, 3:36pm 3

Please see the following posts/thread:

Topic		Replies	Views
Multilingual ChatBot Rasa Open Source	13	3125	March 25, 2023
Rasa bot intent accessing Rasa Open Source	2	59	October 1, 2024
Ideas: multilingual models, training, personality, GPT-2 Rasa Open Source	3	2436	August 22, 2019
Weather Bot with Multi-language Option Getting Started with Rasa	3	466	February 26, 2019
How to create multilingual Rasa bot Rasa Open Source testing	3	2092	November 20, 2023

Building a bot for local language

Related topics