Nonlinear regression: Difference between revisions

Content deleted Content added
Regression statistics: Add equations for the best estimator when the model is linearly approximated.
Line 36:
compare [[generalized least squares]] with covariance matrix proportional to the unit matrix. The nonlinear regression statistics are computed and used as in linear regression statistics, but using '''J''' in place of '''X''' in the formulas.
 
When the function <math>f(x_i,\boldsymbol\beta)</math> itself is not known analytically, but needs to be [[Linear regression|linearly approximated]] from <math>n+1</math>, or more, known values (where <math>n</math> is the number of estimators), the best estimator is obtained directly from the [[Linear Template Fit]] as <ref>{{cite journal | title=The Linear Template Fit | last=Britzger | first=Daniel | journal=Eur. Phys. J. C | volume=82 | year=2022 |pages=731 | doi=10.1140/epjc/s10052-022-10581-w | eprint=2112.01548}}</ref><math display="block"> \hat{\boldsymbol\beta} = ((\mathbf{Y\tilde{M}})^\mathsf{T} \boldsymbol\Omega^{-1} \mathbf{Y\tilde{M}})^{-1}(\mathbf{Y\tilde{M}})^\mathsf{T}\boldsymbol\Omega^{-1}(\mathbf{d}-\mathbf{Y\bar{m})}</math> (see also [[Linear_least_squares#Alternative_formulations|Linear least squares]]).
 
The linear approximation introduces [[bias (statistics)|bias]] into the statistics. Therefore, more caution than usual is required in interpreting statistics derived from a nonlinear model.