Request for comments: std.d.lexer

[Andrei Alexandrescu]

On 2/5/13 12:45 AM, deadalnix wrote:
> On Tuesday, 5 February 2013 at 03:22:52 UTC, Andrei Alexandrescu wrote:
>> On 2/4/13 10:19 PM, Brian Schott wrote:
>>> More optimizing:
>>> http://hackerpilot.github.com/experimental/std_lexer/images/times2.png
>>>
>>> Still only half speed. I'm becoming more and more convinced that Walter
>>> is actually a wizard.
>>
>> Suggestion: take lexer.c and convert it to D. Should take one day, and
>> you'll have performance on par.
>>
>
> DMD's lexer is not suitable for phobos IMO. It doesn't take a range as
> input and don't produce a range. It also lack the features you may want
> from a multi usage D lexer.

I looked at the code. Once converted, it's trivial to convert the lexer 
into an input range.

Andrei