"Comment processing conceptually happens before tokenization."

[Bruno Medeiros]

Walter Bright wrote:
> Bruno Medeiros wrote:
>> Walter Bright wrote:
>>> Yours is better. I'll make the change. Thanks.
>>
>> What's the reason for this behavior BTW? Does it make 
>> parsing/tokenizing more easy? Because it seems to me the ideal 
>> behaviour is otherwise.
> 
> I think the examples in www.digitalmars.com/d/lex.html should make it 
> clear.

Huh? They make clear what the behavior is, but that I already know. 
Instead, I wanted to know the reasoning behind that.

-- 
Bruno Medeiros - MSc in CS/E student
http://www.prowiki.org/wiki4d/wiki.cgi?BrunoMedeiros#D