Content deleted Content added
+adj categ |
|||
Line 4:
{{Expand|date=June 2007}}
'''Decimal floating point''' arithmetic refers to both a representation and operations on decimal floating point numbers. The key is preserving base 10 exponents wherever possible. The conversion to binary exponents can lead to repeat rounding errors and is therefore unsuitable for precision mathematics.▼
▲The key is preserving base 10 exponents wherever possible. The conversion to binary exponents can lead to repeat rounding errors and is therefore unsuitable for precision mathematics.
For more details on the rationale behind DFP, see [http://www2.hursley.ibm.com/decimal/IEEE-cowlishaw-arith16.pdf Decimal Floating-Point: Algorithm for Computers] in the Proceedings of the 16th IEEE Symposium on Computer Arithmetic (Cowlishaw, M. F., 2003).
Line 31 ⟶ 28:
* [[Math]]
[[Category:
|