"Comment processing conceptually happens before tokenization."

[Walter Bright]

Bruno Medeiros wrote:
> Walter Bright wrote:
>> Yours is better. I'll make the change. Thanks.
> 
> What's the reason for this behavior BTW? Does it make parsing/tokenizing 
> more easy? Because it seems to me the ideal behaviour is otherwise.

I think the examples in www.digitalmars.com/d/lex.html should make it clear.