std.d.lexer performance (WAS: std.d.lexer : voting thread)

[Brian Schott]

On Thursday, 3 October 2013 at 20:11:02 UTC, Andrei Alexandrescu 
wrote:
> I see we're considerably behind dmd. If improving performance 
> would come at the price of changing the API, it may be sensible 
> to hold off adoption for a bit.
>
> Andrei

The old benchmarks measured total program run time. I ran a new 
set of benchmarks, placing stopwatch calls around just the lexing 
code to bypass any slowness caused by druntime startup. I also 
made a similar modification to DMD.

Here's the result:

https://raw.github.com/Hackerpilot/hackerpilot.github.com/master/experimental/std_lexer/images/times5.png

I suspect that I've made an error in the benchmarking due to how 
much faster std.d.lexer is than DMD now, so I've uploaded what I 
have to Github.

https://github.com/Hackerpilot/lexerbenchmark