On 02/16/2012 08:36 PM, H. S. Teoh wrote: > More questions about hex floats. So we've established that hex floats > have decimal exponents. So how should the following be tokenized? > > 0x1p1E8 > > Should it be tokenized as (Float: 0x1p1)(Identifier: E8), or should it > be an error? > > > T > It should be tokenized into the two tokens. q{0x1p1E8} is a legal D token.