Lexers (again)

[Rikki Cattermole]

On Friday, 13 December 2013 at 10:17:49 UTC, Brian Schott wrote:
> I've been working on the next attepmpt at a std.lexer / 
> std.d.lexer recently. You can follow the progress on Github 
> here: https://github.com/Hackerpilot/lexer-work

A problem I noticed was your using ubyte[] at least in the 
runlexer. Does it work with string and wstring though?
Also why is it required to pass the type to the lexer of the code 
to pass?
Is there another way to make it easier to use? Or is the only way 
to wrap the constructor in a templated function?

There also seem to be a lot of generic type method 
implementations in DLexer that I would expect to be done inside 
the Lexer super (well template I spose).

All in all looks promising.