# Language Support for Bengali unicode

**URL:** <https://forum.rasa.com/t/language-support-for-bengali-unicode/13244>\
**Category:** Rasa Open Source\
**Created:** [July 21, 2019, 9:26am UTC](https://forum.rasa.com/t/language-support-for-bengali-unicode/13244 "2019-07-21T09:26:35Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![prantabiswas](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/prantabiswas/32/4097_2.png) [@prantabiswas](https://forum.rasa.com/u/prantabiswas)\
**Post date:** [July 21, 2019, 9:26am UTC](https://forum.rasa.com/t/language-support-for-bengali-unicode/13244/1 "2019-07-21T09:26:35Z")

</div>

[https://rasa.com/docs/rasa/nlu/language-support/](https://rasa.com/docs/rasa/nlu/language-support/) Myself Pranta Biswas, Tech lead and developer from Bangladesh. I’m quite new to RASA. I want to train my model with Bengali unicode letters using Tensorflow\_embeddings or supervised\_embeddings. I’ve already done training with some bengali sentence e.g.

> তুমি কেমন আছ?

But always get an intent result of ‘null0’ while interactive learning. How can I train my bot with bengali unicode?

---

<div class="post-metadata">

**Author:** ![JiteshGaikwad](https://avatars.discourse-cdn.com/v4/letter/j/77aa72/32.png) [@JiteshGaikwad](https://forum.rasa.com/u/JiteshGaikwad)\
**Post date:** [July 21, 2019, 10:31am UTC](https://forum.rasa.com/t/language-support-for-bengali-unicode/13244/2 "2019-07-21T10:31:03Z")

</div>

Hey @prantabiswas how much amount of training data you have provided, if you have given less amount of training data you won’t be able to get the expected output 😊

---

<div class="post-metadata">

**Author:** ![prantabiswas](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/prantabiswas/32/4097_2.png) [@prantabiswas](https://forum.rasa.com/u/prantabiswas)\
**Post date:** [July 21, 2019, 10:36am UTC](https://forum.rasa.com/t/language-support-for-bengali-unicode/13244/3 "2019-07-21T10:36:48Z")

</div>

Thank u for replying @JiteshGaikwadIf I train with a data and tests with the same data,shouldn’t I get my expected result? Again, is RASA able to tokenize unicode characters?

---

<div class="post-metadata">

**Author:** ![JiteshGaikwad](https://avatars.discourse-cdn.com/v4/letter/j/77aa72/32.png) [@JiteshGaikwad](https://forum.rasa.com/u/JiteshGaikwad)\
**Post date:** [July 21, 2019, 11:10am UTC](https://forum.rasa.com/t/language-support-for-bengali-unicode/13244/4 "2019-07-21T11:10:32Z")

</div>

Hey @prantabiswas you can read this blog it will answer your question

> **[Supervised Word Vectors from Scratch in Rasa NLU](https://medium.com/rasa-blog/supervised-word-vectors-from-scratch-in-rasa-nlu-6daf794efcd8)**
>
> We’ve released a new pipeline which is totally different from the standard Rasa NLU approach. It uses very little memory, handles…

---

<div class="post-metadata">

**Author:** ![prantabiswas](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/prantabiswas/32/4097_2.png) [@prantabiswas](https://forum.rasa.com/u/prantabiswas)\
**Post date:** [July 21, 2019, 11:14am UTC](https://forum.rasa.com/t/language-support-for-bengali-unicode/13244/5 "2019-07-21T11:14:17Z")

</div>

Thank u @JiteshGaikwad ,but you haven’t yet provided me the link. 🙂

---

<div class="post-metadata">

**Author:** ![JiteshGaikwad](https://avatars.discourse-cdn.com/v4/letter/j/77aa72/32.png) [@JiteshGaikwad](https://forum.rasa.com/u/JiteshGaikwad)\
**Post date:** [July 21, 2019, 11:14am UTC](https://forum.rasa.com/t/language-support-for-bengali-unicode/13244/6 "2019-07-21T11:14:57Z")

</div>

Hey @prantabiswas sorry for that I forgot to paste the link 😅
