Add circuit breaker functionality in case where the LLM cannot be called

[jacquicollier2-eng]

It would be very nice if the framework supported configuring a circuit breaker in the case that the LLM is down.

[johnsonr]

Good idea. What kind of behaviour would you like to see? Maybe a fallback LLM or just graceful configurable response? I guess the challenge is if the call is returning an object...what do you do then?

[jacquicollier2-eng]

I guess I'm thinking graceful configurable response but I haven't thought the full details through...