Unable parse Wise MT940 file

[dev590t]

I'm using ofxstatement-mt940 to convert mt940 file into ofx, I get follow error:

ERROR: matching id=61 (len=75) "250107C0,92FMSCNONREF
BALANCE_CASHBACK-510151a4-4ead-46c5-05ab-99b88521063c" against
    ^
    (?P<year>\d{2})  # 6!n Value Date (YYMMDD)
    (?P<month>\d{2})
    (?P<day>\d{2})
    (?P<entry_month>\d{2}|\s{2})?
    (?P<entry_day>\d{2}|\s{2})?
    (?P<status>[A-Z]?[DC])
    (?P<funds_code>[A-Z])?
    \n?
    (?P<amount>[\d,]{1,15})
    (?P<id>[A-Z][A-Z0-9 ]{3})?
    (?P<customer_reference>.{0,34})
    (//(?P<bank_reference>.{0,16}))?
    (\n?(?P<extra_details>.{0,34}))?
    $
INFO: matched '^' against '', got: {}
INFO: matched '    (?P<year>\\d{2})  # 6!n Value Date (YYMMDD)' against '25', got: {'year': '25'}
INFO: matched '    (?P<month>\\d{2})' against '01', got: {'month': '01'}
INFO: matched '    (?P<day>\\d{2})' against '07', got: {'day': '07'}
INFO: matched '    (?P<entry_month>\\d{2}|\\s{2})?' against '', got: {'entry_month': None}
INFO: matched '    (?P<entry_day>\\d{2}|\\s{2})?' against '', got: {'entry_day': None}
INFO: matched '    (?P<status>[A-Z]?[DC])' against 'C', got: {'status': 'C'}
INFO: matched '    (?P<funds_code>[A-Z])?' against '', got: {'funds_code': None}
INFO: matched '    \\n?' against '', got: {}
INFO: matched '    (?P<amount>[\\d,]{1,15})' against '0,92', got: {'amount': '0,92'}
INFO: matched '    (?P<id>[A-Z][A-Z0-9 ]{3})?' against 'FMSC', got: {'id': 'FMSC'}
INFO: matched '    (?P<customer_reference>.{0,34})' against 'NONREF', got: {'customer_reference': 'NONREF'}
INFO: matched '    (//(?P<bank_reference>.{0,16}))?' against '', got: {'bank_reference': None}
INFO: matched '    (\\n?(?P<extra_details>.{0,34}))?' against '\nBALANCE_CASHBACK-510151a4-4ead-46c', got: {'extra_details': 'BALANCE_CASHBACK-510151a4-4ead-46c'}
ERROR: no match for '    $' against '5-05ab-99b88521063c'
..
RuntimeError: ("Unable to parse <mt940.tags.StatementASNB object at 0x7f81d06d5240> from '250107C0,92FMSCNONREF\\nBALANCE_CASHBACK-510151a4-4ead-46c5-05ab-99b88521063c'", <mt940.tags.StatementASNB object at 0x7f81d06d5240>, '250107C0,92FMSCNONREF\nBALANCE_CASHBACK-510151a4-4ead-46c5-05ab-99b88521063c')

This is a subset of my data:

..
ACCRUAL_CHECKOUT-invoice-15603402
:61:250131D600,FTRFNONREF
TRANSFER-1397347056
:61:250107C0,92FMSCNONREF
BALANCE_CASHBACK-510151a4-4ead-46c5-05ab-99b88521063c
:61:250102D0,06FMSCNONREF
..

Additional information:
version: develop branch of mt940 at date 2025-04-05

[wolph]

For some reason your bank appears to be having a much larger extra_details section. According to the standards I've seen that section should be a maximum of 34 characters, but yours is 53 characters long...

As a quick fix, try this:

from mt940 import tags

tags.Statement.pattern = r"""^
    (?P<year>\d{2})  # 6!n Value Date (YYMMDD)
    (?P<month>\d{2})
    (?P<day>\d{2})
    (?P<entry_month>\d{2}|\s{2})?  # [4!n] Entry Date (MMDD)
    (?P<entry_day>\d{2}|\s{2})?
    (?P<status>R?[DC])  # 2a Debit/Credit Mark
    (?P<funds_code>[A-Z])? # [1!a] Funds Code (3rd character of the currency
                            # code, if needed)
    [\n ]?
    (?P<amount>[\d,]{1,15})  # 15d Amount
    (?P<id>[A-Z][A-Z0-9 ]{3})?
    (?P<customer_reference>((?!//)[^\n]){0,16})
    (//(?P<bank_reference>.{0,23}))?
    (\n?(?P<extra_details>.{0,60}))?
    $"""

I don't think it will break anything if I make that section larger but I'll have to do some testing before I can make a new release with a change like that.

[dev590t]

Yes, I think many Bank don't implement rigorously the specification. It is better to have a more permissive parser.
For incorrect input file, maybe a warning or a check() function to allow user to test if input file is correct is better than reject the file.

[wolph]

Reopening — this is a real parser limitation, not a wontfix. Fixed in #124 (supplementary details may now exceed the 34-char SWIFT cap).