Dscanner - It exists

[Brian Schott]

On Wednesday, 1 August 2012 at 17:36:16 UTC, Walter Bright wrote:
>
> I suggest proposing the D lexer as an addition to Phobos. But 
> if that is done, its interface would need to accept a range as 
> input, and its output should be a range of tokens.

It used to be range-based, but the performance was terrible. The 
inability to use slicing on a forward-range of characters and the 
gigantic block on KCachegrind labeled "std.utf.decode" were the 
reasons that I chose this approach. I wish I had saved the 
measurements on this....