chore: merge lexer into tokenizer file

[bartveneman]

Lexer wasn't part of public API: vite config and package.json didn't mention it, only tokenizer.

[codecov-commenter]

Welcome to Codecov 🎉

Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.

Thanks for integrating Codecov - We've got you covered ☂️

[codecov-commenter]

Bundle Report

Changes will decrease total bundle size by 77 bytes (-0.06%) ⬇️. This is within the configured threshold ✅

Detailed changes

Bundle name	Size	Change
@projectwallace/css-parser-esm	127.33kB	-77 bytes (-0.06%) ⬇️

Affected Assets, Files, and Routes:

view changes for bundle: @projectwallace/css-parser-esm

Assets Changed:

Asset Name	Size Change	Total Size	Change (%)
parse-*.js	3 bytes	4.27kB	0.07%
parse-*.js	3 bytes	8.6kB	0.03%
parse-*.js	3 bytes	24.09kB	0.01%
parse-*.js	3 bytes	15.42kB	0.02%
parse-*.js	3 bytes	7.78kB	0.04%
tokenize.js	15.0kB	15.35kB	4298.85% ⚠️
parse.js	3 bytes	11.44kB	0.03%
lexer.js (Deleted)	-15.1kB	0 bytes	-100.0% 🗑️

Files in parse-*.js:

• ./src/parse-declaration.ts → Total Size: 3.83kB

Files in parse-*.js:

• ./src/parse-anplusb.ts → Total Size: 8.18kB

Files in parse-*.js:

• ./src/parse-selector.ts → Total Size: 22.68kB

Files in parse-*.js:

• ./src/parse-atrule-prelude.ts → Total Size: 14.83kB

Files in parse-*.js:

• ./src/parse-value.ts → Total Size: 7.2kB

Files in tokenize.js:

• ./src/tokenize.ts → Total Size: 14.79kB

Files in parse.js:

• ./src/parse.ts → Total Size: 10.83kB