How to deploy Zipformer on Android

[ZhangWei125521]

I found the zipformer has been published in ai-hub-models https://aihub.qualcomm.com/models/zipformer, and now I want to deploy it on Android, how to do it?

[manupillai308]

Hey @ZhangWei125521 ,

Thanks for your interest in Zipformer. Currently the assets we have for this model is precompiled ONNX files or QAIRT bin files. So there are two ways you can integrate the model to an android app. Build and use ONNXRT in Android for android with the ONNX files or directly use QAIRT SDK with Android with the QAIRT bin files.

Unfortunately, we don't have any sample apps in ai-hub-apps that supports these usecases. You can rely on the documentation I linked above and give it a try. Let us know if you have any other questions.

[csukuangfj]

Please see
k2-fsa/sherpa-onnx#3645

[csukuangfj]

See also k2-fsa/sherpa-onnx#3654

You can run it directly on Android by downloading pre-built APK or
follow
https://k2-fsa.github.io/sherpa/onnx/qnn/build-android-demo.html
to build it by yourself.
To reduce intialization time, you can use context binary files.