Add a persistent Parakeet helper for low-latency host integrations #8535

Job	Run time
test-vulkan / test-backend-linux (vulkan, operators) / linux-job	20m 57s
test-vulkan / test-backend-linux (vulkan, models) / linux-job	20m 24s
test-vulkan / test-backend-macos	0s
test-vulkan / package-golden-artifacts	3m 45s
	45m 6s

Provide feedback