add optional special handling for hex in code tokenizer#5200

Merged

fulmicoton merged 3 commits intomainfrom trinity/code-hex-tokenizer

Jul 16, 2024

+466-37

Commits on Jul 5, 2024

better support for hex in code tokenizer
trinity-1686a
committed

Commits on Jul 9, 2024

make hex tokenization stricter
trinity-1686a
committed

Commits on Jul 16, 2024

Apply suggestions from code review
fulmicoton
authored