Formal review of std.lexer

[Andrej Mitrovic]

On 2/21/14, Andrej Mitrovic <andrej.mitrovich at gmail.com> wrote:
> I've used it to learn how to use DLexer, here's my more-documented
> version of the above if it helps anyone, which also takes the D
> parser's whitespace function and uses that in order to track column
> numbers, it injects a toString like I've mentioned, and adds some
> static asserts for sanity checks:
>
> https://github.com/AndrejMitrovic/lexer-demo

Hmm, maybe I should make a pull request upstream?