docs(cuinterpose): explain host carriers, memory IPC, and restore ordering - #337
Draft
galletas1712 wants to merge 6 commits into
Draft
galletas1712 wants to merge 6 commits into
galletas1712 wants to merge 6 commits into
Conversation
|
Important Draft PR not reviewedDraft PRs are not automatically reviewed by default.
To automatically review draft PRs, update your CodeRabbit configuration: reviews:
auto_review:
drafts: trueComment |
This was referenced Sep 16, 2026
galletas1712
added this pull request to stack #339
September 16, 2026 22:37
This was referenced Sep 16, 2026
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 16, 2026 23:51
ca34b60 to
2d142d3
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
2 times, most recently
from
September 17, 2026 07:39
021fa19 to
4214811
Compare
1 task
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 17, 2026 09:20
fdcc21c to
d989c26
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 17, 2026 09:30
d989c26 to
3bd7205
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 17, 2026 20:53
3bd7205 to
a3b0c7f
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
2 times, most recently
from
September 18, 2026 01:13
769cf57 to
d6103b2
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 18, 2026 01:51
d6103b2 to
48a05f9
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 18, 2026 03:41
48a05f9 to
8626843
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 18, 2026 18:55
8626843 to
130fcc3
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 18, 2026 22:13
130fcc3 to
5d02180
Compare
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
2 times, most recently
from
September 18, 2026 23:34
731fa91 to
c1e9227
Compare
Refs #295. Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
…umptions Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
galletas1712
force-pushed
the
schwinns/cuinterpose-rust-12-design
branch
from
September 18, 2026 23:48
c1e9227 to
e2c9b2f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Refs #295 (approved).
Describe the implemented host-carrier-only design in concrete terms: processes, threads, CUDA calls, allocation ownership, tickets, memory costs, and failure behavior.
Review boundary
Includes capture and restore sequence diagrams, four multicast restore operations, the intercepted-API table, simplified pseudocode, namespace limits, and artifact compatibility. PageBroker/CustomStorage is separate work, not a shim backend. A two-worker example connects the fixed-layout VMM ticket and peer request to allocation/mapping records in
cuinterpose.state; additional examples show the inline IPC ticket, multicast binding, host-carrier ownership, and manifest. Binary encodings and abbreviated excerpts are labeled explicitly. All six YAML examples parse, and all four diagrams pass Mermaid 11 syntax validation.Stack and compatibility
The stack starts directly on
main; it does not depend on the PageBroker GPU-transfer branch or #323. The shim only saves shared creator bytes through host carriers. Never-shared allocations remain native CUDA state. The stack removes launch-job/jobfile support, and older jobfile-dependent or draft shim artifacts are rejected rather than migrated.PageBroker and native CustomStorage changes are separate. No PR in this stack adds that implementation.
Validation
Validation of the assembled implementation:
make checkin a clean disposable worktree.GLM testing without CustomStorage was cancelled at the user's request and is not a pass. GLM qualification uses a separate composition with CustomStorage; previous experimental GLM results are not qualification of this rebuilt stack. The installed test driver is not claimed to be a stock-driver qualification.
Tests above were run on the assembled implementation, not claimed independently for every source-only intermediate PR. The standard-library cleanup was validated with Rust workspace tests and strict Clippy, GNU/musl builds and packaged fake-driver tests, plus targeted pod-contract and CUDA-agent Go tests. Physical-GPU tests were not rerun for this cleanup; the earlier GPU results above remain attributed to the pre-cleanup implementation.