Least squares adjustment

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

Least squares adjustment is a model for the solution of an overdetermined system of equations based on the principle of least squares of observation residuals. It is used extensively in the disciplines of surveying, geodesy, and photogrammetry—the field of geomatics, collectively.


There are three forms of least squares adjustment: parametric, conditional, and combined. In parametric adjustment, one can find an observation equation h(X)=Y relating observations Y explicitly in terms of parameters X (leading to the A-model below). In conditional adjustment, there exists a condition equation g(Y)=0 involving only observations Y (leading to the B-model below) — with no parameters X at all. Finally, in a combined adjustment, both parameters X and observations Y are involved implicitly in a mixed-model equation f(X,Y)=0. Clearly, parametric and conditional adjustments correspond to the more general combined case when f(X,Y)=h(X)-Y and f(X,Y)=g(Y), respectively. Yet the special cases warrant simpler solutions, as detailed below. Often in the literature, Y may be denoted L.


The equalities above only hold for the estimated parameters and observations , thus . In contrast, measured observations and approximate parameters produce a nonzero misclosure:

One can proceed to Taylor series expansion of the equations, which results in the Jacobians or design matrices: the first one,

and the second one,

The linearized model then reads:

where are estimated parameter corrections to the a priori values, and are post-fit observation residuals.

In the parametric adjustment, the second design matrix is an identity, B=-I, and the misclosure vector can be interpreted as the pre-fit residuals, , so the system simplifies to:

which is in the form of ordinary least squares. In the conditional adjustment, the first design matrix is null, A=0. For the more general cases, Lagrange multipliers are introduced to relate the two Jacobian matrices and transform the constrained least squares problem into an unconstrained one (albeit a larger one). In any case, their manipulation leads to the and vectors as well as the respective parameters and observations a posteriori covariance matrices.


Given the matrices and vectors above, their solution is found via standard least-squares methods; e.g., forming the normal matrix and applying Cholesky decomposition, applying the QR factorization directly to the Jacobian matrix, iterative methods for very large systems, etc.

Worked-out examples[edit]


Related concepts[edit]


If rank deficiency is encountered, it can often be rectified by the inclusion of additional equations imposing constraints on the parameters and/or observations, leading to constrained least squares.


  1. ^ "Gauss-Helmert Model" in: Samuel Kotz; N. Balakrishnan; Campbell Read Brani Vidakovic (2006), Encyclopedia of statistical sciences, Wiley. doi:10.1002/0471667196.ess0854
  2. ^ J Cothren (2005), "Reliability in Constrained Gauss–Markov Models", Report No. 473. Department of Civil and Environmental Engineering and Geodetic Science. The Ohio State University. [1], eq.(2.31), p.8
  3. ^ Snow, Kyle, Topics in Total Least-Squares Adjustment within the Errors-In-Variables Model: Singular Cofactor Matrices and Prior Information [pdf], vii+90 pp, December 2012. [2]


Lecture notes and Technical reports:


  • Reino Antero Hirvonen, "Adjustments by least squares in geodesy and photogrammetry", Ungar, New York. 261 p., ISBN 0804443971, ISBN 978-0804443975, 1971.
  • Edward M. Mikhail, Friedrich E. Ackermann, "Observations and least squares", University Press of America, 1982
  • Wolf, Paul R. (1995). "Survey Measurement Adjustments by Least Squares". The Surveying Handbook. pp. 383–413. doi:10.1007/978-1-4615-2067-2_16. 
  • Peter Vaníček and E.J. Krakiwsky, "Geodesy: The Concepts." Amsterdam: Elsevier. (third ed.): ISBN 0-444-87777-0, ISBN 978-0-444-87777-2; chap. 12, "Least-squares solution of overdetermined models", pp. 202–213, 1986.
  • Gilbert Strang and Kai Borre, "Linear Algebra, Geodesy, and GPS", SIAM, 624 pages, 1997.
  • Paul Wolf and Bon DeWitt, "Elements of Photogrammetry with Applications in GIS", McGraw-Hill, 2000
  • Karl-Rudolf Koch, "Parameter Estimation and Hypothesis Testing in Linear Models", 2a ed., Springer, 2000
  • P.J.G. Teunissen, "Adjustment theory, an introduction", Delft Academic Press, 2000
  • Edward M. Mikhail, James S. Bethel, J. Chris McGlone, "Introduction to Modern Photogrammetry", Wiley, 2001
  • Harvey, Bruce R., "Practical least squares and statistics for surveyors", Monograph 13, Third Edition, School of Surveying and Spatial Information Systems, University of New South Wales, 2006
  • Huaan Fan, "Theory of Errors and Least Squares Adjustment", Royal Institute of Technology (KTH), Division of Geodesy and Geoinformatics, Stockholm, Sweden, 2010, ISBN 91-7170-200-8.
  • Gielsdorf, F.; Hillmann, T. (2011). "Mathematics and Statistics". Springer Handbook of Geographic Information. p. 7. doi:10.1007/978-3-540-72680-7_2. ISBN 978-3-540-72678-4. 
  • Charles D. Ghilani, "Adjustment Computations: Spatial Data Analysis", John Wiley & Sons, 2011
  • Charles D. Ghilani and Paul R. Wolf, "Elementary Surveying: An Introduction to Geomatics", 13th Edition, Prentice Hall, 2011
  • Erik Grafarend and Joseph Awange, "Applications of Linear and Nonlinear Models: Fixed Effects, Random Effects, and Total Least Squares", Springer, 2012
  • Alfred Leick, Lev Rapoport, and Dmitry Tatarnikov, "GPS Satellite Surveying", 4th Edition, John Wiley & Sons, ISBN 9781119018612; Chapter 2, "Least-Squares Adjustments", pp. 11–79, doi:10.1002/9781119018612.ch2