OpenRouter?

[furilo]

Have you considered allowing connecting to LLMs via OpenRouter? I find it very convenient since the key, cost, limtis management is centralized in OpenRouter, and it lets you use any model.

[prvnsmpth]

Will definitely consider it! My focus so far has been on enabling companies to run this internally, and most organizations would prefer using LLMs from one of the cloud providers: Azure, AWS or GCP. But supporting OpenRouter should be a fairly straightforward change, so will definitely plan for it.

[prvnsmpth]

@furilo We have support for connecting any OpenAI-compatible API now, do check it out!