cuda: add per-session mutable state rebinding #7062

Job	Run time
Get changed files / get-changed-files	3s
CI run decision / decide	30s
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job	30m 7s
export-model-cuda-windows-artifact (facebook, dinov2-small-imagenet1k-1-layer, non-quantized) / linux-job	16m 59s
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job	30m 40s
export-model-cuda-windows-artifact (nvidia, parakeet-tdt, non-quantized) / linux-job	26m 32s
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-4B-Realtime-2602, quantized-int4-tile... / linux-job	30m 38s
export-model-cuda-windows-artifact (nvidia, parakeet-tdt, quantized-int4-weight-only) / linux-job	27m 8s
test-model-cuda-windows-e2e (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / windows-job	35m 26s
test-model-cuda-windows-e2e (facebook, dinov2-small-imagenet1k-1-layer, non-quantized) / windows-job	13m 40s
test-model-cuda-windows-e2e (mistralai, Voxtral-Mini-3B-2507, non-quantized) / windows-job	35m 30s
test-model-cuda-windows-e2e (nvidia, parakeet-tdt, quantized-int4-weight-only) / windows-job	35m 50s
test-model-cuda-windows-e2e (mistralai, Voxtral-Mini-4B-Realtime-2602, quantized-int4-tile-packed) / windows-job	35m 27s
test-model-cuda-windows-e2e (nvidia, parakeet-tdt, non-quantized) / windows-job	36m 8s
	5h 54m 38s

Provide feedback