Request for comments: std.d.lexer

[Jacob Carlborg]

On 2013-01-31 13:57, dennis luehring wrote:

> i would say it "can" help alot so the design should be able to use
> split-parts and combine symboles at the border
>
> and also file-based lexing should be threadable so that 16 files can be
> handled by my 16 cores system full in parallel :)

This is kind of obvious, I think. That's why I started to think at this 
less obvious case.

> but its also size dependend - it makes no sense to split in too small
> parts, could be counter-productive

Of course not. That would require some profiling as well to find a sweet 
spot.

-- 
/Jacob Carlborg