you can update the network by using diff-mamba instead of the regular mamba it improves the backbone

[maxmelichov]

check this example that i did on hebrew: https://github.com/maxmelichov/Mamre-TTS
training code is provided