You can configure any LLM supported by langchain. Most of the recent discussions I’ve seen about local models are using ollama and langchain. Here’s one that may help.