Skip to content

Fill gaps from assistant conversations: WebSocket duration and region/provider interaction - #316

Open
mintlify[bot] wants to merge 2 commits into
masterfrom
mintlify/3d28189b
Open

Fill gaps from assistant conversations: WebSocket duration and region/provider interaction#316
mintlify[bot] wants to merge 2 commits into
masterfrom
mintlify/3d28189b

Conversation

@mintlify

@mintlify mintlify Bot commented Aug 17, 2026

Copy link
Copy Markdown
Contributor

Summary

Address two recurring assistant-conversation themes where users had to infer behavior the docs did not state.

Changes

  • endpoints/websockets.mdx: added a "Session Duration" section explaining that WebSocket sessions are bounded by response_grace_period (default 900s), how to raise it, and the SIGTERM implication for custom runtimes.
  • deployments/multi-region-deployment.mdx: added a "How Region, Provider, and Compute Interact" subsection clarifying that region = "global" does not override a pinned provider or a single compute value, showing the fallback pattern with a compute list, and noting that changes apply on the next cerebrium deploy without recreating the app.

Context

Recent assistant conversations repeatedly asked how long a WebSocket can stay open and whether region = "global" auto-switches provider or GPU type. Both answers exist in the platform's behavior but were not written down on the affected pages.

@mintlify
mintlify Bot requested review from kylegani and milo157 as code owners August 17, 2026 13:07
@mintlify

mintlify Bot commented Aug 17, 2026

Copy link
Copy Markdown
Contributor Author

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
cerebrium 🟢 Ready View Preview Aug 17, 2026, 1:09 PM

@kylegani kylegani left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We're doing away with providers as a choice and our scaler automatically handles scale already. Remove the references to provider.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants