Best practices for parsing files

[lurker]

Both suggestions are very interesting and I'll be evaluating them; but what I was
hoping was something more on the line of DMD's parser (been insanely fast): A
hand-written parser. We also thought of translating it to D just as an exercise to
learn how it works.

You see, one of my concerns (and the primary reason to use D) is parsing speed:
I'm going to parse lot's and lot's of those files and memory consumption almost
isn't an issue since we have lots of it.

Also, the tasks will be executed on a thread pool and we don't want to face
locking problems with code generated by some tool. At least if we write the code
we'll know who to blame. :D

Thanks.