Add a weight-stationary INT4 GEMM for small M #8411

Job	Run time
test-vulkan / test-backend-linux (vulkan, models) / linux-job	7s
test-vulkan / test-backend-linux (vulkan, operators) / linux-job	7s
test-vulkan / test-backend-macos	-1s
test-vulkan / package-golden-artifacts	1s
	14s

Provide feedback