Cortex-M backend: Minimize scope of cmsis_nn dependency.

Cortex-M backend: Minimize scope of cmsis_nn dependency. #77693