Numeric precision in Microsoft Excel: Difference between revisions

Revision as of 18:19, 17 March 2014

Revision as of 17:53, 23 December 2014

Line 79:

</ref>

Both the "compatibility" function STDEVP and the "consistency" function STDEV.P in Excel 2010 return the 0.5 population standard deviation for the given set of values. However, numerical accuracy caninaccuracy still can be shown using this example by extending the existing figure to include 10+¹⁵, wherewhereupon the erroneous standard deviation willfound equal zero inby Excel 2010 will be zero.

===Subtraction of Subtraction Results===