What would need to be done to get sdc.lexer to std.lexer quality?

[Jacob Carlborg]

On 2012-08-02 09:26, Bernard Helyer wrote:
> In my dev work I've shaved some bytes off of Token.
> I removed the filename from Location, as we don't assume
> the input is a file anymore, and I've changed to tracking
> line and column numbers as uint instead of size_t.
>
> I don't know what kind of number I _should_ be aiming for,
> but I'd imagine I'm not gonna get it that small.

I think the source location is calculated on demand based on that offset.

You can probably shave off a couple of bytes by using a (u)short or 
(u)byte instead of TokenKind. The TokenKind takes 32 bits, that's way 
more then what's actually needed.

-- 
/Jacob Carlborg