Merge Hebrew ITN staging to main

[mgrafu]

• rebase to main

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• rebase

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• rebasing

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Update Jenkinsfile (Only mount TestData from path #341)

Only mount TestData from path

• [pre-commit.ci] pre-commit suggestions ([pre-commit.ci] pre-commit suggestions #335)

updates:

• github.com/pre-commit/pre-commit-hooks: v5.0.0 → v6.0.0
• github.com/PyCQA/flake8: 7.2.0 → 7.3.0
• github.com/PyCQA/isort: 6.0.1 → 6.1.0
• https://github.com/psf/black → https://github.com/psf/black-pre-commit-mirror
• github.com/psf/black-pre-commit-mirror: 25.1.0 → 25.9.0

• Merge staging Hindi TN v2 to main (Merge staging Hindi TN v2 to main #346)

• Future Implementations for classes - Measure, Money, and Date (Future Implementations for classes - Measure, Money, and Date #258)

• Future Implementations for classes - Measure, Money, and Date

• Resolved the conflicts with mm_yyyy and date ranges and added the previously removed failing test cases.

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• removed the unused empty string implementation

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• minor fixes for the tagger files

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• reformatted decimal final graph

• incorporated the suggestion for decimal graph

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Century implementations

• Working on the yyyy format for the date class

• reverted yyyy code

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on future implementations

• working on improving the date class accuracy

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• added year prefix for the date class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on the commma cases for date class

• minor fixes

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• implemented mixed fractions

• rectified the test case

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on quarterly measurements

• reformatted the prefixes and suffixes for date tagger class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• replaced text tag with era tag for the date class

• Removed the text tag reference from date class verbalizer

---

• update jenkins cache

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Potential fix for code scanning alert no. 821: Unused local variable

• Hindi TN Future Implementations 2.0. - Fraction, Measure and Time (Hindi TN Future Implementations 2.0. - Fraction, Measure and Time #310)

• Staging hi tn (Staging hi tn #271)

• Future Implementations for classes - Measure, Money, and Date (Future Implementations for classes - Measure, Money, and Date #258)

• Future Implementations for classes - Measure, Money, and Date

• Resolved the conflicts with mm_yyyy and date ranges and added the previously removed failing test cases.

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• removed the unused empty string implementation

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• minor fixes for the tagger files

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• reformatted decimal final graph

• incorporated the suggestion for decimal graph

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Century implementations

• Working on the yyyy format for the date class

• reverted yyyy code

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on future implementations

• working on improving the date class accuracy

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• added year prefix for the date class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on the commma cases for date class

• minor fixes

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• implemented mixed fractions

• rectified the test case

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on quarterly measurements

• reformatted the prefixes and suffixes for date tagger class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• replaced text tag with era tag for the date class

• Removed the text tag reference from date class verbalizer

---

• update jenkins cache

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Potential fix for code scanning alert no. 821: Unused local variable

---

• Future Implementations

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---

• Hindi TN 2.0 - Telephone class integration from staging branch (Hindi TN 2.0 - Telephone class integration from staging branch #320)

• telephone class integration

(cherry picked from commit a7c9adf)

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Updated date in Jenkins file to the PR creation date

• Jenkins file date change

• Trying today's date

• improved country code coverage + some test cases

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Ignore test generated files

• Improved landline detection and added edge test cases for proper coverage

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Deleted gitignore file

---

• Rebase Hindi TN update: Fix Jenkinsfile for CI (Fix Jenkinsfile for CI #325) (Rebase Hindi TN update: Fix Jenkinsfile for CI (#325) #331)

• Staging hi tn (Staging hi tn #271)

• Future Implementations for classes - Measure, Money, and Date (Future Implementations for classes - Measure, Money, and Date #258)

• Future Implementations for classes - Measure, Money, and Date

• Resolved the conflicts with mm_yyyy and date ranges and added the previously removed failing test cases.

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• removed the unused empty string implementation

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• minor fixes for the tagger files

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• reformatted decimal final graph

• incorporated the suggestion for decimal graph

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Century implementations

• Working on the yyyy format for the date class

• reverted yyyy code

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on future implementations

• working on improving the date class accuracy

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• added year prefix for the date class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on the commma cases for date class

• minor fixes

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• implemented mixed fractions

• rectified the test case

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on quarterly measurements

• reformatted the prefixes and suffixes for date tagger class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• replaced text tag with era tag for the date class

• Removed the text tag reference from date class verbalizer

---

• update jenkins cache

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Potential fix for code scanning alert no. 821: Unused local variable

---

• Fix Jenkinsfile for CI (Fix Jenkinsfile for CI #325)

• Fix Jenkinsfile for CI

• Fix requirements for test

• Update paths and docker

• Fix docker name

• Fix click version

• Change path of grammars for sparrowhawk tests

• Update paths in sh_test.sh

• Update paths

• Revert paths

---

• Future Implementations for classes - Measure, Money, and Date (Future Implementations for classes - Measure, Money, and Date #258)

• Future Implementations for classes - Measure, Money, and Date

• Resolved the conflicts with mm_yyyy and date ranges and added the previously removed failing test cases.

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• removed the unused empty string implementation

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• minor fixes for the tagger files

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• reformatted decimal final graph

• incorporated the suggestion for decimal graph

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Century implementations

• Working on the yyyy format for the date class

• reverted yyyy code

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on future implementations

• working on improving the date class accuracy

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• added year prefix for the date class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on the commma cases for date class

• minor fixes

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• implemented mixed fractions

• rectified the test case

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on quarterly measurements

• reformatted the prefixes and suffixes for date tagger class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• replaced text tag with era tag for the date class

• Removed the text tag reference from date class verbalizer

---

• update jenkins cache

• Potential fix for code scanning alert no. 821: Unused local variable

• Hindi TN Future Implementations 2.0. - Fraction, Measure and Time (Hindi TN Future Implementations 2.0. - Fraction, Measure and Time #310)

• Staging hi tn (Staging hi tn #271)

• Future Implementations for classes - Measure, Money, and Date (Future Implementations for classes - Measure, Money, and Date #258)

• Future Implementations for classes - Measure, Money, and Date

• Resolved the conflicts with mm_yyyy and date ranges and added the previously removed failing test cases.

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• removed the unused empty string implementation

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• minor fixes for the tagger files

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• reformatted decimal final graph

• incorporated the suggestion for decimal graph

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Century implementations

• Working on the yyyy format for the date class

• reverted yyyy code

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on future implementations

• working on improving the date class accuracy

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• added year prefix for the date class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on the commma cases for date class

• minor fixes

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• implemented mixed fractions

• rectified the test case

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on quarterly measurements

• reformatted the prefixes and suffixes for date tagger class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• replaced text tag with era tag for the date class

• Removed the text tag reference from date class verbalizer

---

• update jenkins cache

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Potential fix for code scanning alert no. 821: Unused local variable

---

• Future Implementations

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---

• Hindi TN 2.0 - Telephone class integration from staging branch (Hindi TN 2.0 - Telephone class integration from staging branch #320)

• telephone class integration

(cherry picked from commit a7c9adf)

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Updated date in Jenkins file to the PR creation date

• Jenkins file date change

• Trying today's date

• improved country code coverage + some test cases

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Ignore test generated files

• Improved landline detection and added edge test cases for proper coverage

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Deleted gitignore file

---

• Ran tests successfuly and updated cache date to today

---

• Hindi TN: Ordinal Implementation (Hindi TN: Ordinal Implementation #343)

• Adding ordinals into staging_hi_tn

• Ordinal Cleanup

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Review changes

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---

• Hindi TN: Main to staging Fix + Cardinals (leading zero update) (Hindi TN: Main to staging Fix + Cardinals (leading zero update) #348)

• Staging hi tn (Staging hi tn #271)

• Future Implementations for classes - Measure, Money, and Date (Future Implementations for classes - Measure, Money, and Date #258)

• Future Implementations for classes - Measure, Money, and Date

• Resolved the conflicts with mm_yyyy and date ranges and added the previously removed failing test cases.

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• removed the unused empty string implementation

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• minor fixes for the tagger files

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• reformatted decimal final graph

• incorporated the suggestion for decimal graph

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Century implementations

• Working on the yyyy format for the date class

• reverted yyyy code

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on future implementations

• working on improving the date class accuracy

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• added year prefix for the date class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on the commma cases for date class

• minor fixes

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• implemented mixed fractions

• rectified the test case

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• working on quarterly measurements

• reformatted the prefixes and suffixes for date tagger class

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• replaced text tag with era tag for the date class

• Removed the text tag reference from date class verbalizer

---

• update jenkins cache

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• Potential fix for code scanning alert no. 821: Unused local variable

---

• Fix Jenkinsfile for CI (Fix Jenkinsfile for CI #325)

• Fix Jenkinsfile for CI

• Fix requirements for test

• Update paths and docker

• Fix docker name

• Fix click version

• Change path of grammars for sparrowhawk tests

• Update paths in sh_test.sh

• Update paths

• Revert paths

---

• Comma bugfix for En electronics (Comma bugfix for En electronics #332)

• fix bug with commas and electronics

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

• update jenkins

---

• Update Jenkinsfile (Only mount TestData from path #341)

Only mount TestData from path

• [pre-commit.ci] pre-commit suggestions ([pre-commit.ci] pre-commit suggestions #335)

updates:

• github.com/pre-commit/pre-commit-hooks: v5.0.0 → v6.0.0
• github.com/PyCQA/flake8: 7.2.0 → 7.3.0
• github.com/PyCQA/isort: 6.0.1 → 6.1.0
• https://github.com/psf/black → https://github.com/psf/black-pre-commit-mirror
• github.com/psf/black-pre-commit-mirror: 25.1.0 → 25.9.0

• Cardinal: Leading zero changes

---

• debug file issue

• debug ordinals error

• ci debug

• revert to original suffixes for ordinals

• CI fix: Missing init file (Hindi TN: CI fix, Missing init file #350)

• HI TN: Staging branch cleanup for main merge (HI TN: Staging branch cleanup for main merge #355)

• Review changes - cleanup

• Missed cleanup

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---

• Cache date change (Cache date change #356)

• Cache date change

• Cache date changes again

---

---

• responding to formatting pr

• isort and moving string map to string file

• [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---

What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

Before your PR is "Ready for review"

Pre checks:

• Have you signed your commits? Use git commit -s to sign.
• Do all unittests finish successfully before sending PR?
  1. pytest or (if your machine does not have GPU) pytest --cpu from the root folder (given you marked your test cases accordingly @pytest.mark.run_only_on('CPU')).
  2. Sparrowhawk tests bash tools/text_processing_deployment/export_grammars.sh --MODE=test ...
• If you are adding a new feature: Have you added test cases for both pytest and Sparrowhawk here.
• Have you added __init__.py for every folder and subfolder, including data folder which has .TSV files?
• Have you followed codeQL results and removed unused variables and imports (report is at the bottom of the PR in github review box) ?
• Have you added the correct license header Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. to all newly added Python files?
• If you copied nemo_text_processing/text_normalization/en/graph_utils.py your header's second line should be Copyright 2015 and onwards Google, Inc.. See an example here.
• Remove import guards (try import: ... except: ...) if not already done.
• If you added a new language or a new feature please update the NeMo documentation (lives in different repo).
• Have you added your language support to tools/text_processing_deployment/pynini_export.py.

PR Type:

• New Feature
• Bugfix
• Documentation
• Test

If you haven't finished some of the above items you can still open "Draft" PR.

[tbartley94]

@mgrafu Looks like this was created without a signoff?