Add a weight-stationary INT4 GEMM for small M #8531

Job	Run time
test-arm / test-backend-linux (arm_vgf_fp, operators) / linux-job	17m 33s
test-arm / test-backend-linux (arm_vgf_fp, models) / linux-job	16m 47s
test-arm / test-backend-linux (arm_tosa_fp, operators) / linux-job	16m 46s
test-arm / test-backend-linux (arm_tosa_fp, models) / linux-job	17m 6s
test-arm / test-backend-macos	-1s
test-arm / package-golden-artifacts	44s
	1h 8m 55s

Provide feedback