Add a weight-stationary INT4 GEMM for small M #8472

Job	Run time
test-xnnpack / test-backend-linux (xnnpack, models) / linux-job	20m 49s
test-xnnpack / test-backend-linux (xnnpack, operators) / linux-job	14m 41s
test-xnnpack / test-backend-macos	0s
test-xnnpack / package-golden-artifacts	4m 11s
	39m 41s

Provide feedback