Support non-ASCII identifiers - #3082

Merged

soutaro merged 8 commits into

ruby:masterfrom

Shopify:non-ascii-identifiers

Aug 12, 2026

Commits on Aug 12, 2026

Rename the `word` lexer definition to `ident_char`

soutaro
and
claude
committed
82b5736
Define `ident_char` by what it excludes

soutaro
and
claude
committed
d1a4cee
Allow a non-ASCII character to start a symbol
soutaro
committed
ad8bb04
Allow a non-ASCII character in the remaining identifier rules
soutaro
committed
5f6f4b3
Allow a non-ASCII character to start a name that is not a type name
soutaro
committed
2c6f43b
Test and document non-ASCII identifiers
soutaro
committed
0536812
Refresh the Unicode tables from prism 1.9.0
soutaro
committed
9bee57c
Mark src/lexer.c as generated
soutaro
committed
b3d16a3