Are there any resources or documentation on how to integrate the tokenization part into Android?

[BENSAFOUAN-Abdelhalim]

I want to integrate the CamembertQuestionAnswering model to Android, do I have to change the tokenization part because it's a different language?

[twiceyuan]

I also have the same question, because I saw that there are tools such as AutoTokenizer in huggingface/transformers in Python to automatically complete the tokenization work. On Android, each type of model has a corresponding work to be implemented, so I also look forward to similar tools.

[Colin-Antony]

I would also like to see if there is a solution to this