Skip to content

RSDK-13440 Add support for tflite OWW models#18

Open
oliviamiller wants to merge 55 commits intoviam-modules:mainfrom
oliviamiller:tflite
Open

RSDK-13440 Add support for tflite OWW models#18
oliviamiller wants to merge 55 commits intoviam-modules:mainfrom
oliviamiller:tflite

Conversation

@oliviamiller
Copy link
Collaborator

@oliviamiller oliviamiller commented Mar 10, 2026

Summary

  • Adds .tflite model support for OpenWakeWord on linux
  • .tflite is Linux-only because tflite-runtime does not publish macOS wheels on PyPI.

Benchmarks

Measured inference time on Raspberry Pi using 500 iterations of model.predict() on a single 80ms audio chunk (1280 samples, 16kHz mono int16):

onnx: mean 5.02ms, max 5.71ms
tflite: mean 4.07ms, max 4.71ms (~19% faster on ARM)

Testing
-Added unit tests
-manually tested onnx and tflite on mac and linux

Approvals
1 approval needed.

@oliviamiller oliviamiller marked this pull request as ready for review March 10, 2026 19:22

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to remove this replace?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no we still need it to obtain the onnx models, but updated this block to also download the tflite files.

scipy==1.17.0
scikit-learn==1.8.0
tqdm==4.67.3
openwakeword==0.6.0

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[question] So tflite runtime is a dep of openwakeword?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes

Copy link

@hexbabe hexbabe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it a breaking config change if the model type suffix is now required

@oliviamiller
Copy link
Collaborator Author

is it a breaking config change if the model type suffix is now required

a suffix on the file path was was still required before it just had to be .onnx.

Copy link

@seanavery seanavery left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link

@SebastianMunozP SebastianMunozP left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants