Phobos unit testing uncovers a CPU bug

Kagamin spam at here.lot
Mon Nov 29 13:47:17 PST 2010


Walter Bright Wrote:

> > Really? I think, the answer is neither correct nor wrong. It's approximate.
> 
> The rules for rounding the mathematical value to the representation are precise, 
> and so there is such a thing as the correctly rounded result and the wrong result.

Well, maybe, but the result fits well in machine precision (which is equal to the last bit). And if this precision is not enough for the algorithm, then the algorithm is incorrect on any x87 FPU, and its output is garbage.


More information about the Digitalmars-d-announce mailing list