What would need to be done to get sdc.lexer to std.lexer quality?

[Jacob Carlborg]

On 2012-08-02 07:31, Jakob Ovrum wrote:

> Which is exactly why I'm pointing out the current, poor approach. Having
> a single array with contiguous Tokens for lookahead is completely doable
> even when Token is a class with some simple GC.malloc and emplace
> composition. I think SDC's Token class is too big to be useful as a
> struct, you'd pretty much never want to pass it anywhere by value.

If you change Token to a struct it takes 64bytes on a LP64 platform. I 
don't know if that is too big to be passed around by value.

-- 
/Jacob Carlborg