Skip to content

Add Japanese tokenizer (fugashi) and minimal unit test - #223

Open
Naoki Kimura (supernaiter) wants to merge 1 commit into
microsoft:mainfrom
supernaiter:pr-japanese-tokenizer
Open

Add Japanese tokenizer (fugashi) and minimal unit test#223
Naoki Kimura (supernaiter) wants to merge 1 commit into
microsoft:mainfrom
supernaiter:pr-japanese-tokenizer

Add Japanese tokenizer (fugashi) and minimal unit test

953e5a0
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs