Bump sentencepiece from 0.1.96 to 0.1.97

[dependabot]

Bumps sentencepiece from 0.1.96 to 0.1.97.

Release notes

Sourced from sentencepiece's releases.

v0.1.97

Major changes

• Migrated the C++ version from C++11 to C++17.
• Migrated the CI environment from Travis-CI to Github actions
• Started using cibuildtool to build pypi wheel packages

New features

• [ALL] Support differential privacy while training. https://aclanthology.org/2022.findings-acl.171.pdf
• [ALL] Introduced APIs that return the struct of ImmutableSentencePieceText, which encodes string-token, id, and utf-8 byte offsets at once. New API is available both from C++ and Python.
• [ALL] Allow tab ‘\t’ to be included in user defined symbols.
• [ALL] Added NFKD normalization rule. NFKD rule is provided as a TSV file.
• [ALL] Added option to emit unknown symbol instead of raw symbol.
• [Python]: Batch encode/decode requests are performed in native multi-threads.
• [Python]: Supports to pass a custom log stream during training.
• [Python]: Adds module-level version variable: spm.__version__
• [Python]: Creates wheel package of Mac universal binary.

Bug fixes & minor changes

• Uses the efficient encoding algorithm by default. Removed the functionality to switch the Viterbi tokenization algorithm.
• Make the output of Encode and 1-best from NBestEncode same.
• Use std::string_view as much as possible.
• [Python] Removed pip package for ppc64le and s390x architecture as cibuiltool doesn’t support them.

Commits

• 58f256c Updated the document
• 655b944 Updated the document.
• 881229a Updated the document
• 5a53be2 support slice in pieces/nbests objects
• c14eb2e automatically detect the number of CPUs in batch processing.
• b738153 Uses property in immutable proto
• 497ee76 Fixed test failure.
• 005ad28 remove unused ifdef SWIG macro
• b82f9b9 Upgraded to MacOS-11
• 1f21d38 Adds SWIGPYTHON flag
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)