std.d.lexer requirements

[dennis luehring]

Am 03.08.2012 08:37, schrieb Jacob Carlborg:
> On 2012-08-03 00:01, Walter Bright wrote:
>
>> But we do have the DMD lexer which is useful as a benchmark and a guide.
>> I won't say it couldn't be made faster, but it does set a minimum bar
>> for performance.
>
> I'm not sure how easy it would be to just measure the lexing phase of
> DMD. If it's easy someone would probably already have extracted the
> lexer from DMD.
>

wouldn't it be better to extract the lexer part of dmd into its own 
(hopefully small) library - that way the lexer is still useable by dmd 
AND benchmarkable from outside - it is then even possible to replace the 
dmd lexer by an D version due to the c linkage feature of D