Using own LLM gateway and modify the request

Rasa CALM
1

Hi, we are trying Rasa pro and have it working locally. We have built our own LLM gateway and it’s all working fine. We want to modify the request that Rasa sends to our LLM gateway (add conversationId), we have tried many configs and approaches but nothing is working. Does anyone have experience in intercepting the Rasa request to LLM and modifying it?

Thanks

2

Can you please share what did you try? Rasa will be using the Chat Completions API endpoint and from the gateway you should be able to modify the request.