Skip to content

tavern.ai timeout error with kobold cpp #258

Description

@accessyapps

Hi. I have a problem with tavern.ai and kobold cpp. When my chats get longer, generation of answers fails often because of "error, timeout". How ever when i look into the command prompt i see that kcpp finishes generation normaly but apparently just takes longer then tavern ai expects. Kobold then sais "Generate: The response could not be sent, maybe connection was terminated? " This sounds to me that tavern is terminating the connection to early. Is there a way to set the maximum timeout for kobold in tavern.ai?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions