mirror of
https://github.com/SerenityOS/serenity
synced 2026-05-11 09:26:28 +02:00
We already convert the input to UTF-8 before starting the tokenizer, so all this patch had to do was switch the tokenizer to use an Utf8View for its input (and to emit 32-bit codepoints.)
4.7 KiB
4.7 KiB