Numeric precision in Microsoft Excel: Difference between revisions

Revision as of 15:22, 30 August 2020

Revision as of 16:09, 22 December 2020

Line 148:

</ref> Using Visual Basic for Applications, any of these methods can be implemented in Excel. Numerical methods use a grid where functions are evaluated. The functions may be interpolated between grid points or extrapolated to locate adjacent grid points. These formulas involve comparisons of adjacent values. If the grid is spaced very finely, round-off error will occur, and the less the precision used, the worse the round-off error. If spaced widely, accuracy will suffer. If the numerical procedure is thought of as a [[Negative feedback amplifier|feedback system]], this calculation noise may be viewed as a signal that is applied to the system, which will lead to instability unless the system is carefully designed.<ref name=Hamming>

{{cite book |author=[[Richard Hamming|R. W. Hamming]] |author-link=Richard Hamming |title=Numerical Methods for Scientists and Engineers |year= 1986 |isbn=0-486-65241-6 |url=https://archive.org/details/numericalmethods00hamm_0 |url-access=registration|publisher=Courier Dover Publications |edition=2nd}} This book discusses round-off, truncation and stability extensively. For example, see Chapter 21: [https://books.google.com/books?id=Y3YSCmWBVwoC&pg=PA357 Indefinite integrals – feedback], page 357.

</ref>

Line 160:

==References==

{{Reflist}}

<references/>

[[Category:Microsoft software]]