Thank you for the Ollama integration, and for all of your work on this application!
Many users on their self-host journey start with Ollama, but then grow into other method of local LLM hosting such as llama.cpp. Building an OpenAI API compatible integration would allow connection to more sophisticated self-hosted and well as cloud LLMs.
Thank you for the Ollama integration, and for all of your work on this application!
Many users on their self-host journey start with Ollama, but then grow into other method of local LLM hosting such as llama.cpp. Building an OpenAI API compatible integration would allow connection to more sophisticated self-hosted and well as cloud LLMs.