# How does this even happen? (broken token)

**URL:** <https://forum.rasa.com/t/how-does-this-even-happen-broken-token/36007>\
**Category:** Rasa Open Source\
**Created:** [October 18, 2020, 6:49am UTC](https://forum.rasa.com/t/how-does-this-even-happen-broken-token/36007 "2020-10-18T06:49:32Z")\
**Posts on this page:** 1\
**Showing post:** 1

<div class="post-metadata">

**Author:** ![kombucha](https://avatars.discourse-cdn.com/v4/letter/k/da6949/32.png) [@kombucha](https://forum.rasa.com/u/kombucha)\
**Post date:** [October 18, 2020, 6:49am UTC](https://forum.rasa.com/t/how-does-this-even-happen-broken-token/36007/1 "2020-10-18T06:49:32Z")

</div>

Ok, I have to admit, I’m very puzzled how this even happened.

Any rasa\_nlu experts/gurus hazard a guess what the heck is going on here?

(ie. extracted entity somehow has an extra space than input, token length doesn’t match, it’s 0-3 when use input was 0-2)

???

```
Your input -> wed
2020-10-18 02:42:21 DEBUG rasa_core.tracker_store - Recreating tracker for id 'default'
2020-10-18 02:42:21 DEBUG rasa_core.processor - Received user message 'wed' with intent '{'name': 'suggest_day', 'confidence': 0.3946328298500187}' and entities '[{'start': 0, 'end': 3, 'value': 'we d', 'entity': 'Day', 'confidence': 0.8734852784259177, 'extractor': 'ner_crf'}]'
2020-10-18 02:42:21 DEBUG rasa_core.processor - Logged UserUtterance - tracker now has 20 events
2020-10-18 02:42:21 DEBUG rasa_core.processor - Current slot values:
	Day: we d

```

 ![Screen Shot 2020-10-18 at 2.45.07 AM](https://europe1.discourse-cdn.com/flex013/uploads/rasa/original/2X/0/0fae85094bbf2e50aea2e13d85ef193e3c437b21.png)

---

_[View the full topic](https://forum.rasa.com/t/how-does-this-even-happen-broken-token/36007)._