std.d.lexer requirements

[Andrei Alexandrescu]

On 8/2/12 6:38 PM, Jonathan M Davis wrote:
> On Thursday, August 02, 2012 15:14:17 Walter Bright wrote:
>> Remember, its the consumer doing the decoding, not the input range.
>
> But that's the problem. The consumer has to treat character ranges specially
> to make this work. It's not generic.

It is generic! It's just in another dimension: it operates on any range 
of _bytes_.

Andrei