Add a persistent Parakeet helper for low-latency host integrations #8651

Job	Run time
test-arm / test-backend-linux (arm_vgf_fp, models) / linux-job	17m 0s
test-arm / test-backend-linux (arm_tosa_fp, operators) / linux-job	15m 20s
test-arm / test-backend-linux (arm_tosa_fp, models) / linux-job	16m 6s
test-arm / test-backend-linux (arm_vgf_fp, operators) / linux-job	17m 39s
test-arm / test-backend-macos	0s
test-arm / package-golden-artifacts	49s
	1h 6m 54s

Provide feedback