mirror of
https://github.com/SerenityOS/serenity
synced 2026-05-10 17:12:55 +02:00
We already convert the input to UTF-8 before starting the tokenizer, so all this patch had to do was switch the tokenizer to use an Utf8View for its input (and to emit 32-bit codepoints.)
4.7 KiB
4.7 KiB