docs(deepgram): note that the Engine port must stay 8055 - #314
Merged
Conversation
Cerebrium detects that a Deepgram app is ready to serve traffic by watching the Engine's server port, so changing it in engine.toml makes requests arrive before the Engine can answer them and fail with 503 while the app starts up. Add a warning before the engine.toml block and call it out inline in both the engine.toml and api.toml snippets, since those get copied and edited.
Contributor
|
Preview deployment for your docs. Learn more about Mintlify Previews.
|
Say what keeping 8055 buys the user - startup requests are queued rather than returning 503 - rather than describing how readiness is detected.
milo157
approved these changes
Aug 11, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Self-hosted Deepgram apps take ~40s to load models on a cold start. Requests that arrive in that window are queued and served once the Engine is ready — but only if the Engine's
[server]port is left at the documented8055, which Cerebrium uses to tell when it can serve. Change it and those requests fail with503 Please try again laterinstead.engine.tomlblock: keep the port at8055, and keepapi.toml'sdriver_poolURL pointing at it.No behaviour change — documents an existing requirement.