Hi,
Hope everyone is doing well. I have a question in regards to EnterpirseSearch policy. I’m creating an FAQ element of the chatbot and it seems when I ask questions like “Can I get a discount” or “Can I cancel an order?”, the LLM doesn’t categorize it to be a knowledgebase question and instead as an action. Ultimately, it goes to “pattern_cannot_handle”. If rephrase the question as “Do you give discounts” or “do you allow the cancellation of orders” then it gives the appropriate response.
As I’m new to Rasa and CALM, I can’t really figure out how to overcome this issue. The only thing I can think of is perhaps create a custom action on pattern_cannot_handle and redirect it to use the pattern_search flow? But then what about the case where it actually can’t handle something or doesn’t find anything in the knowledgebase, wouldn’t it be a loop?
Any advice on how to approach this?
Another question in regards to the LLM, is the only way to avoid having answers that start “Based on the documents provided…”, to customise the prompt?
Apologies for the essay, but any help would be much appreciated. Kind regards