std.d.lexer: pre-voting review / discussion

[deadalnix]

On Wednesday, 11 September 2013 at 15:02:00 UTC, Dicebot wrote:
> Most important goal of this review is to determine any API / 
> design problems. Any internal implementation tweaks may happen 
> after inclusion to Phobos but it is important to assure that no 
> breaking changes will be required any time soon after module 
> will get wider usage.
>

One quick remark : we need some kind of value provider to reuse 
across different lexing, and can be used outside the lexer.

If I process a module and have to kick in a new lexing phase 
because of mixin, I want to generate identifiers out of the same 
pool.