When building a 'chat'-like interface, it can be a nicer experience for responses to stream in rather than waiting for it all to be ready. Implement a way to stream these responses, e.g. using server-sent events. This should be an optional feature as it will likely require additional infrastructure.
When building a 'chat'-like interface, it can be a nicer experience for responses to stream in rather than waiting for it all to be ready.
Implement a way to stream these responses, e.g. using server-sent events.
This should be an optional feature as it will likely require additional infrastructure.