Skip to content

Support for multiple AI API backends #1

@TiagoMarinho

Description

@TiagoMarinho

Having support for KoboldAI Horde would make it possible to switch models easily and to have a higher uptime, and support for OpenAI API would also widen the choices for AI being used.

As KoboldAI-Client, KoboldAI Horde and OpenAI API have vastly different APIs it would probably require to have separate functions for abstracting each API call.

  • Separate API call from ask.mjs
  • Clean up characters and backend call to have same arguments
  • Add second backend

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions