The Assistant app is the face of Nextcloud's text processing, and what a user can pick depends on which provider apps happen to be installed. Your README lays that out, with llm2 and the OpenAI/LocalAI integration covering the text tasks, text2image_stablediffusion and stt_whisper covering the rest, and NoProviderEmptyContent sending an admin to the app settings pages when the list comes back empty. Every provider named there either holds an API key the admin pastes in or runs a model on their own hardware.
The entry cost for a small instance is a vendor account before the assistant can do anything at all, and the longest thread on the tracker is a closed report of a LocalAI endpoint that would not work (#129), so pointing the assistant somewhere other than a big vendor has been rough. BlockRun is OpenAI-compatible from one base URL, with chat, image, video, music, speech and sound effects all on one payment flow, and every call settles on its own in USDC over x402, so a provider app built on it would hold no key at all and cost nothing while it sits idle. https://blockrun.ai
Would a provider app of that shape be welcome in the list your README keeps, or does every entry there have to own an account with someone? I am glad to put an app together the way the existing providers are built and open it for review, and just as happy to hear that it does not fit.
The Assistant app is the face of Nextcloud's text processing, and what a user can pick depends on which provider apps happen to be installed. Your README lays that out, with llm2 and the OpenAI/LocalAI integration covering the text tasks, text2image_stablediffusion and stt_whisper covering the rest, and NoProviderEmptyContent sending an admin to the app settings pages when the list comes back empty. Every provider named there either holds an API key the admin pastes in or runs a model on their own hardware.
The entry cost for a small instance is a vendor account before the assistant can do anything at all, and the longest thread on the tracker is a closed report of a LocalAI endpoint that would not work (#129), so pointing the assistant somewhere other than a big vendor has been rough. BlockRun is OpenAI-compatible from one base URL, with chat, image, video, music, speech and sound effects all on one payment flow, and every call settles on its own in USDC over x402, so a provider app built on it would hold no key at all and cost nothing while it sits idle. https://blockrun.ai
Would a provider app of that shape be welcome in the list your README keeps, or does every entry there have to own an account with someone? I am glad to put an app together the way the existing providers are built and open it for review, and just as happy to hear that it does not fit.