Non-ASCII in the future in the lexer

[Richard (Rikki) Andrew Cattermole]

On 02/06/2023 3:47 AM, Quirin Schroll wrote:
>     The second case that comes to mind: I was thinking about regex
>     grammars and XML’s grammar, and I think one or both can now handle
>     all kinds of unicode whitespace.
> 
> Definitely not regex. It’s not standardized at all.

Not the point of the above but related: 
https://www.unicode.org/reports/tr18/

Unicode for regex is in fact standardized :)