Repository navigation

Fix the tokenization of `<` edge cases - #2280

Merged

iffyio merged 2 commits into

apache:mainfrom

ayman-sigma:ayman/fixLtTokenizer

Mar 26, 2026

Merged

Fix the tokenization of `<` edge cases#2280
iffyio merged 2 commits into
apache:mainfrom
ayman-sigma:ayman/fixLtTokenizer

Commits on Mar 16, 2026
- fix LT tokenizer edge cases
  ayman-sigma
  committed
  3a6f0e1
Commits on Mar 20, 2026
- address comments
  ayman-sigma
  committed
  c33b8ac