Binary scaling: Difference between revisions

Content deleted Content added
Undid revision 943739408 by 171.232.52.108 (talk) vandalism
Overview: Corrected a math mistake. 440400 decimal divided by 2^16 is 6.71997, not 6.71999
Line 20:
To convert it back to B16, divide it by 2<sup>16</sup>.
 
This gives 440400B16, which when converted back to a floating point number (by dividing again by 2<sup>16</sup>, but holding the result as floating point) gives 6.7199971997. The correct result is 6.72.
 
==Re-scaling after multiplication==