Hi. I have a problem with tavern.ai and kobold cpp. When my chats get longer, generation of answers fails often because of "error, timeout". How ever when i look into the command prompt i see that kcpp finishes generation normaly but apparently just takes longer then tavern ai expects. Kobold then sais "Generate: The response could not be sent, maybe connection was terminated? " This sounds to me that tavern is terminating the connection to early. Is there a way to set the maximum timeout for kobold in tavern.ai?
Hi. I have a problem with tavern.ai and kobold cpp. When my chats get longer, generation of answers fails often because of "error, timeout". How ever when i look into the command prompt i see that kcpp finishes generation normaly but apparently just takes longer then tavern ai expects. Kobold then sais "Generate: The response could not be sent, maybe connection was terminated? " This sounds to me that tavern is terminating the connection to early. Is there a way to set the maximum timeout for kobold in tavern.ai?