Found the problem - I was missing the following configuration in endpoints.yml:
nlg:
type: rephrase
llm:
provider: azure
deployment: gpt-4
api_type: azure
api_version: "2024-02-15-preview"
api_base: https://xyz.openai.azure.com/
After adding it the demo seems to run properly.