Skip to content

feat(runtime): add deterministic device-aware execution planner - #307

Draft
daniele21 wants to merge 3 commits into
devfrom
arch/ra8-execution-planner
Draft

feat(runtime): add deterministic device-aware execution planner#307
daniele21 wants to merge 3 commits into
devfrom
arch/ra8-execution-planner

Conversation

@daniele21

Copy link
Copy Markdown
Owner

RA-8A — deterministic execution planner

Introduces the pure policy boundary DeviceCapabilities + ModelProfile + ResourceState + Workload -> BackendExecutionPlan.

Safety and determinism

  • versioned policy (policyVersion=1);
  • no benchmark-time probing or hidden mutable state;
  • profile settings are only preserved or downshifted;
  • GPU layers, flash attention and mlock remain disabled unless both the profile requests them and the device explicitly declares support;
  • memory/thermal pressure deterministically downshifts approved context tiers, batch sizes and thread counts;
  • no speculative decoding, unsupported multimodal path or automatic hardware claim is introduced.

Evidence

Tests cover nominal planning, fail-closed acceleration, elevated/severe pressure downshift and exact deterministic replay for identical inputs.

Boundary

This is the software planning contract. Representative-device calibration remains a DEVICE evidence gate and is not claimed by this PR.

Gate

Keep draft until runtime-core compile/unit/Spotless/Detekt and repository validation are green on exact head/current dev.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant