Help recognising niche entites

Rasa Open Source
1

I have a rasa bot that works in the music domain. Users can ask music related queries and the bot utilises APIs to get answers.

One problem I am encountering is that entities excluded from the NLU data are not picked up if they are niche.

Examples questions that fail when asked for ‘less popular’ entities.

  • What songs are in [album name]?
  • Tell me about [artist name]?

Are there any suggestions on how one might go about solving this problem?

Potential ideas:

  • Use an LLM for entity recognition
  • Use a lookup table - but where will I get a list of album names and artist names, etc?
  • ?

Any help is greatly appreciated! Thank you in advance

2

I think an LLM is a good option. You could also have a custom action that disambiguates the extracted entity (I would expect you might have artist and album confused at times). The action would lookup the entity in a db with album names and another lookup by artist and offer the top matches as options to the user.

3

Thanks for the ideas. Do you know of any good resources for entity extraction using LLMs? TIA!