This repository is currently experimental and may undergo significant changes. The plan is to maintain full compatibility with the OpenAI interface.
- Clone this repository
- Install dependencies with bun
bun install - Copy
.env.exampleas.envand update your OpenAI API key - Start server using
bun startorbun server.ts
- Open Settings by either: pressing Command + , or clicking on Search Bar and then Settings, or by clicking on cog icon (fullscreen mode)
- Open Advanced tab
- Add endpoint, by default it's http://localhost:3005/api/chat
- (optional but recommended) Add authorization header
- Add model you want to use on your back-end. It can't be in conflict with gpt-4o or any other model. It's a good practice to use prefix like for example — local:gpt-4o
- From the list of the models (right beneath text input on the chat) select local:gpt-4o model or any model you set in 5th step.
- When server is down and you send the message, you need to reload the app (right mouse button -> reload) or restart it.