Hello everyone, has anyone used the textgen type llm? I have installed text-generation-webui and I run it with --extention api. Then in my endpoint.yml I have added this:
nlg:
type: rephrase
rephrase_all: true
llm:
type: textgen
model_url: "http://localhost:7860/"
but it does not work. I have also used url http://localhost:7860/api/v1/generate Can anyone help?
Thank you