Add a persistent Parakeet helper for low-latency host integrations #8592

Job	Run time
test-xnnpack / test-backend-macos	-1s
test-xnnpack / test-backend-linux (xnnpack, models) / linux-job	21m 34s
test-xnnpack / test-backend-linux (xnnpack, operators) / linux-job	14m 58s
test-xnnpack / package-golden-artifacts	4m 2s
	40m 33s

Provide feedback