Purpose
This issue tracks review of the FlashRT multi-backend model-provider integration corresponding to Jetson-PI.
The FlashRT branch is hosted on the contributor fork because the current contributor account has read-only access to the official FlashRT repository.
Scope
The branch introduces Jetson-PI as a provider-owned llama.cpp/GGML model provider while preserving the existing FlashRT CUDA Graph path. It includes Pi0/Pi0.5, text LLM, and multimodal LLM paths; staged runtime ports; repeatable decode; memory-domain and read-only DLPack integration; production CMake packaging; and tested CPU/CUDA/Vulkan/SYCL/OpenCL capability behavior.
Review status
Development and available-backend validation are complete. This work is pending review by @diantoudedianshan. The Jetson-PI owner will decide how the private implementation should be opened and integrated; this issue only tracks the completed development branch and review handoff.
The companion Jetson-PI PR is private and is accessible only to authorized repository members.
Purpose
This issue tracks review of the FlashRT multi-backend model-provider integration corresponding to Jetson-PI.
28c3adf6c152609cb9379572b9916a53368b0420flashrt-migration-mergein the private Jetson-PI repositoryThe FlashRT branch is hosted on the contributor fork because the current contributor account has read-only access to the official FlashRT repository.
Scope
The branch introduces Jetson-PI as a provider-owned llama.cpp/GGML model provider while preserving the existing FlashRT CUDA Graph path. It includes Pi0/Pi0.5, text LLM, and multimodal LLM paths; staged runtime ports; repeatable decode; memory-domain and read-only DLPack integration; production CMake packaging; and tested CPU/CUDA/Vulkan/SYCL/OpenCL capability behavior.
Review status
Development and available-backend validation are complete. This work is pending review by @diantoudedianshan. The Jetson-PI owner will decide how the private implementation should be opened and integrated; this issue only tracks the completed development branch and review handoff.
The companion Jetson-PI PR is private and is accessible only to authorized repository members.