Add a weight-stationary INT4 GEMM for small M #8419

Job	Run time
test-vulkan / test-backend-linux (vulkan, operators) / linux-job	23m 29s
test-vulkan / test-backend-linux (vulkan, models) / linux-job	20m 36s
test-vulkan / test-backend-macos	0s
test-vulkan / package-golden-artifacts	3m 35s
	47m 40s

Provide feedback