std.d.lexer requirements

[Andrei Alexandrescu]

On 8/2/12 11:11 PM, Bernard Helyer wrote:
> On Friday, 3 August 2012 at 03:00:42 UTC, Andrei Alexandrescu wrote:
>> The lexer must be configurable enough to tokenize other languages than D.
>
> You're going to have to defend that one.

I wouldn't know how to. To me it's all too obvious it's better to have a 
tool that allows writing lexers for many languages (and incidentally use 
it for D), than a tool that can only tokenize D code.

Andrei