Ollama support

[razvanab]

Is your feature request related to a problem? Please describe.

Describe the solution you'd like
I would like the option to connect to an Ollama server.

Describe alternatives you've considered

Additional context

[razvanab]

Please add this.

[hennas-waifson]

this would be real cool.

[marcotama]

I think if you use reverse proxy you can set Ollama as your provider.

[2kfi]

yes you can
just add this to your reverse proxy

http://${your-ollama-IP-addr}/v1

replace ${your-ollama-IP-addr} with your ollama server IP adders
i forgot what was the second field but you can throw anything in there (leave empty if you want too)

[marcotama]

The second field is the API key, which you can leave blank as @2kfi said.

At least it works for me, using LM Studio instead of Ollama (both offer an OpenAI-like API).

[2kfi]

at least , i wish they will add a real support for Ollama , i mean am not a coder or anything but i think they already done the hard work using the proxy stuff, am i right? @marcotama

[chiefvibeoperator]

I'm going to take a crack at this. We'll see if it get's merged.

[chiefvibeoperator]

at least , i wish they will add a real support for Ollama , i mean am not a coder or anything but i think they already done the hard work using the proxy stuff, am i right? @marcotama

This should allow you to select Ollama. Please let me know if it's not working.

https://github.com/TavernAI/TavernAI/pull/271

[Ken-Michalak]

I made some improvements and fixes here: https://github.com/TavernAI/TavernAI/pull/274