Dtype selective build: enable in fbcode #1513

Job	Run time
apple (macos-arm64) / build	5m 49s
linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build	6m 30s
apple (pybind) / build	1h 11m 44s
linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build	5m 57s
	1h 30m 0s

Provide feedback