Let's stop parser Hell

[Philippe Sigaud]

On Wed, Aug 1, 2012 at 5:45 PM, Jonathan M Davis <jmdavisProg at gmx.com> wrote:

> "ウェブサイト"
> "\u30A6\u30A7\u30D6\u30B5\u30A4\u30C8"
>
> The encoding of the source file is irrelevant.

do you mean I can do:

string field = "ウェブサイト";

?

Geez, just tested it, it works. even writeln(field) correctly output
the japanese chars and dmd doesn't choke on it.
Bang, back to state 0: I don't get how D strings work.



> You mean make it so that Token is
>
> struct Token(R)
> {
>     TokenType    type;
>     R       str;
>     LiteralValue value
>     SourcePos    pos;
> }
>
> instead of
>
> struct Token
> {
>     TokenType    type;
>     string       str;
>     LiteralValue value
>     SourcePos    pos;
> }
>
> or do you mean something else?

Right, this.