We are trying to create multilingual NLU for Indian Languages. Purpose of the NLU is to understand message from users for Booking LPG Cylinder or request for Mechanic visit. But twist is users can send message in any Indian language. We are preparing different intent for each language. Below giving one example of LPG Gas booking intents in different languages. Also I have added one more intent of out_of_scope where I am putting all out of scope messages in all language that could come from users. SO simply we would reject those messages. NLU Content: - intent: GASBOOKING_gu examples: | - હું ગેસ બુક કરવા માંગુ છું - મારે સિલિન્ડર બુક કરવું છે - મારે ગેસ સિલિન્ડર બુક કરવું છે - મારા માટે ગેસ સિલિન્ડર બુક કરો - કૃપા કરીને ગેસ સિલિન્ડર બુક કરો - કૃપા કરીને ગેસ બુક કરો - ગેસ સિલિન્ડર બુક કરો - શું તમે મારા માટે સિલિન્ડર બુક કરી શકો છો? - બુક ગેસ - intent: GASBOOKING_mr examples: | - मला गॅस बुक करायचा आहे - मला सिलिंडर बुक करायचे आहे - मला गॅस सिलेंडर बुक करायचा आहे - माझ्यासाठी गॅस सिलिंडर बुक करा - कृपया माझ्यासाठी गॅस सिलिंडर बुक करा - कृपया गॅस बुक करा - कृपया गॅस सिलेंडर बुक करा - intent: GASBOOKING_hi examples: | - मैं गैस बुक करना चाहता हूं - मैं सिलेंडर बुक करना चाहता हूं - मैं गैस सिलेंडर बुक करना चाहता हूं - मेरे लिए गैस सिलेंडर बुक करो - कृपया मेरे लिए एक गैस सिलेंडर बुक करें - कृपया गैस बुक करें - कृपया गैस सिलेंडर बुक करें - intent: GASBOOKING_en examples: | - I want to book a gas - I want to book a cyl - I want to book a cylinder - I want to book a gas cylinder - Book gas cylinder for me - Book gas for me - Book a cylinder for me - Kindly Book a gas cylinder for me - intent: GASBOOKING_kn examples: | - ನಾನು ಗ್ಯಾಸ್ ಬುಕ್ ಮಾಡಲು ಬಯಸುತ್ತೇನೆ - ನಾನು ಸಿಲಿಂಡರ್ ಬುಕ್ ಮಾಡಲು ಬಯಸುತ್ತೇನೆ - ನಾನು ಗ್ಯಾಸ್ ಸಿಲಿಂಡರ್ ಅನ್ನು ಬುಕ್ ಮಾಡಲು ಬಯಸುತ್ತೇನೆ - ನನಗೆ ಗ್ಯಾಸ್ ಸಿಲಿಂಡರ್ ಬುಕ್ ಮಾಡಿ - ನನಗೆ ಗ್ಯಾಸ್ ಬುಕ್ ಮಾಡಿ - ನನಗೆ ಸಿಲಿಂಡರ್ ಬುಕ್ ಮಾಡಿ - ದಯವಿಟ್ಟು ನನಗೆ ಗ್ಯಾಸ್ ಸಿಲಿಂಡರ್ ಬುಕ್ ಮಾಡಿ - ದಯವಿಟ್ಟು ಗ್ಯಾಸ್ ಬುಕ್ ಮಾಡಿ - ದಯವಿಟ್ಟು ಗ್ಯಾಸ್ ಸಿಲಿಂಡರ್ ಅನ್ನು ಬುಕ್ ಮಾಡಿ - intent: out_of_scope examples: | - How are you - what are you doing - i need help - i want gas papers - i need to book gas papers - i am looking for my gas papers - book my ticket - ਮੇਰੀ ਟਿਕਟ ਬੁੱਕ ਕਰੋ - ਤੁਸੀ ਕਿਵੇਂ ਹੋ - Tusi kivem ho - ਤੁਹਾਡਾ ਨਾਮ ਕੀ ਹੈ - உங்கள் பெயர் என்ன - നിന്റെ പേരെന്താണ് - તું શું કરે છે - તમારું નામ શું છે - મારી પ્રિય મૂવી ડાર્ક છે - ನನಗೆ ಕ್ರಿಕೆಟ್ ನೋಡಲು ಇಷ್ಟ - ನಿನ್ನ ಹೆಸರೇನು - ನನಗೆ ನಿನ್ನ ಸಹಾಯ ಬೇಕು - எனக்கு உங்கள் உதவி தேவை Domain File NLU intents: - GASBOOKING_en - GASBOOKING_hi - GASBOOKING_mr - GASBOOKING_gu - GASBOOKING_kn - out_of_scope I am using below Pipeline as per RASA documents as you can see i am not using any pre trained model: Config File pipeline: name: WhitespaceTokenizer name: RegexFeatu…

Ok , we are sending back two type of responses: When Intent is GASBOOKING_LANGUAGE, so from the last two character of intent name, we know the language code. (e.g. GASBOOKING_hi ) In this case response should go in Hindi. When intent is out_of_scope : in my case since there is only one out_of_scope category for all the languages. I am using polyglot library for language detection & then sending a appropriate message to user in detected language. As you suggested making out_of_scope for each language, I guess that could be more effective.

Are you using a custom action that’s using polyglot to handle the responses?

Yes, using custom action which determines, language script. example: from polyglot.detect import Detector msg_text='હું બુક કરવા માંગુ છું ' detector = Detector(msg_text) print(detector.language)

hi @ASINGH i am also working on multilingual bot, just want to know is your code open source ? It would be great help if i can access it…

Hi @baval and @ASINGH , want to know if you guys were successful in creating multilingual bot, it would be a huge help if I get to see it…

Please tell me how we can connect @baval . Thank you!

Hi Baval, may you please share your github link of the multilingual chatbot, which can help me

Actually i can’t share the github right now, its client project but will make you familiar with the code

Multilingual Chatbot for Indian Languages

Rasa Open Source

baval (Bavalpreet Singh) December 21, 2021, 6:22am 15

i am looking into my schedule according to which we can meet

Topic		Replies	Views
Rasa bot intent accessing Rasa Open Source	2	71	October 1, 2024
Can we make a multilingua Rasa Chatbot Rasa Open Source	1	312	October 30, 2023
Ideas: multilingual models, training, personality, GPT-2 Rasa Open Source	3	2456	August 22, 2019
Multilingual ChatBot Rasa Open Source	13	3172	March 25, 2023
MultiLingualBot Rasa Open Source	3	863	December 28, 2020

Multilingual Chatbot for Indian Languages

Related topics