Let's stop parser Hell

[Timon Gehr]

On 08/01/2012 12:01 AM, Philippe Sigaud wrote:
> On Tue, Jul 31, 2012 at 11:38 PM, Dmitry Olshansky
> <dmitry.olsh at gmail.com> wrote:
>> Typically lexeres are regular as it allows them to be fast.

Regularity of the language is not required for speed.

>
> Hmm, but then it has to treat comments a one token. So no Ddoc love?

Ddoc is typically not required. By default it should be treated as
whitespace. If it is required, one token seems reasonable: The
post-processing of the doc comment is best done as a separate step.