Structural equation modelling

This is an old revision of this page, as edited by Jitse Niesen (talk | contribs) at 03:24, 23 August 2007 (copyvio). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Structural equation modeling (SEM) is a statistical technique for testing and estimating causal relationships using a combination of statistical data and qualitative causal assumptions. This view of SEM was articulated by the geneticist Sewal Wright (1921), the economists Trygve Haavelmo (1943) and Herbert Simon (1953), and formally defined by Judea Pearl (2000) using a calculus of counterfactuals.

Possible Copyright Infringement

If you have just labeled this page as a possible copyright infringement, please add the following to the bottom of Wikipedia:Copyright_problems/2025_September_2/Articles
* {{subst:article-cv|Structural equation modelling}} from [Asako Miura, "Can weblogs cause ...", AI & Society, 2007 [1]]. ~~~~

The previous content of this page appears to infringe on the copyright of the text from the source(s) below and is now listed on Wikipedia:Copyright problems:

Asako Miura, "Can weblogs cause ...", AI & Society, 2007 [2]

Do not edit this page until an administrator has resolved this issue.

State that you have done so on this article's discussion page.
Note that simply modifying copyrighted text is not sufficient to avoid copyright infringement—if the original copyright violation cannot be clearly identified and the article reverted to a prior version, it is best to write the article from scratch. An administrator will move the new article into place once the issue is resolved.
Explain this on this article's discussion page, then either display a notice to this effect at the site of original publication or send an e-mail from an address associated with the original publication to permissions-en at wikimedia dot org or a postal letter to the Wikimedia Foundation. These messages must explicitly permit use under the GFDL.
Note: Articles on Wikipedia must be written from a neutral point of view and must be verifiable in published third-party sources; copyright issues aside, your text may not be appropriate for inclusion in Wikipedia.
  • If this text is in the public ___domain, or is already under a license suitable for Wikipedia:
Explain this on this article's discussion page, with reference to evidence.

Unless the copyright status of the text on this page is clarified, it will be deleted one week after the time of its listing.

  • Posting copyrighted material without the express permission of the copyright holder is a violation of applicable law and of Wikipedia policy.
  • If you have questions about copyright, see Copyright FAQ.
  • Those who repeatedly post copyrighted material will be blocked from further editing.
  • Temporarily, the original posting is still accessible for viewing in the page history.
  • You are welcome to submit original contributions.
Maintenance use only: ==Copyright problem: Structural equation modelling== Hello, and [[Wikipedia:Welcome, newcomers|welcome to Wikipedia]]! We welcome and appreciate your contributions, such as [[Structural equation modelling]], but we regretfully cannot accept [[Wikipedia:Copyrights|copyrighted]] text or images borrowed from either web sites or printed material. This article appears to be a copy from Asako Miura, "Can weblogs cause ...", AI & Society, 2007 [3], and therefore a [[Wikipedia:Copyright violations|copyright violation]]. The copyrighted text has been or will soon be deleted. If you believe that the article is ''not'' a copyright violation, or if you have permission from the copyright holder to release the content freely ''under the [[GNU Free Documentation License]] (GFDL)'' then you should do one of the following: :*If you have permission from the author leave a message explaining the details at [[Talk:Structural equation modelling]] and send an email with the message to "permissions-en (at) wikimedia (dot) org". '''See [[Wikipedia:Requesting copyright permission]] for instructions.''' :*If a note on the original website states that re-use is permitted ''under the [[GFDL]] or released into the public ___domain'' leave a note at [[Talk:Structural equation modelling]] with a link to where we can find that note. :*If you own the copyright to the material: send an e-mail from an address associated with the original publication to permissions-en(at)wikimedia(dot)org ''or'' a postal message to the [http://wikimediafoundation.org/wiki/Contact_us Wikimedia Foundation] permitting re-use ''under the [[GFDL]]'', and note that you have done so on [[Talk:Structural equation modelling]]. It is also important that the text be modified to have an encyclopedic tone and that it follows [[Wikipedia:Guide to layout|Wikipedia article layout]]. For more information on Wikipedia's policies, see [[Wikipedia:Policies and guidelines|Wikipedia's policies and guidelines]]. If you would like to begin working on a new version of the article you may do so at [[Talk:Structural equation modelling/Temp]]. Leave a note at [[Talk:Structural equation modelling]] saying you have done so and an administrator will move the new article into place once the issue is resolved. Thank you, and please feel welcome to continue contributing to Wikipedia. Happy editing!<!-- Template:Nothanks-web --> ~~~~


SEM encourages confirmatory rather than exploratory modeling; thus, it is suited to theory testing rather than theory development. It usually starts with a hypothesis, represents it as a model, operationalises the constructs of interest with a measurement instrument, and tests the model. The causal assumptions embedded in the model often have falsifiable implications which can be tested against the data. With an accepted theory or otherwise confirmed model, SEM can also be used inductively by specifying the model and using data to estimate the values of free parameters. Often the initial hypothesis requires adjustment in light of model evidence, but SEM is rarely used purely for exploration.

Among its strengths is the ability to model constructs as latent variables (variables which are not measured directly, but are estimated in the model from measured variables which are assumed to 'tap into' the latent variables). This allows the modeller to explicitly capture the unreliability of measurement in the model, which in theory allows the structural relations between latent variables to be accurately estimated.

SEM should be distinguished from regression models, which are purely predictive tools, making no empirical claims whatsoever. In SEM, the qualitative causal assumptions are represented by the missing variables in each equation, as well as vanishing covariances among some error terms. These assumptions are testable in experimental studies and must be confirmed judgmentally in observational studies.

An alternative technique for specifying Structural Models using partial least squares has been implemented in software such as LVPLS (Latent Variable Partial Least Square), PLSGraph and SmartPLS (Ringle et al. 2005). Some feel this is better suited to data exploration. More ambitiously, The TETRAD project aims to develop a way to automate the search for possible causal models from data.

Steps in performing SEM analysis

Model specification

Since SEM is a confirmatory technique, the model must be specified correctly based on the type of analysis that the modeller is attempting to confirm. There are usually two main parts to SEM: the structural model showing dependencies between endogenous and exogeneous variables, and the measurement model showing the relations between the latent variables and their indicators. Confirmatory factor analysis models, for example, contain only the measurement part; while linear regression can be viewed as an SEM that only has the structural part. Specifying the model delineates relationships between variables that are thought to be related (and therefore want to be 'free' to vary) and those relationships between variables that already have an estimated relationship, which can be gathered from previous studies (these relationships are 'fixed' in the model).

Estimation of free parameters

Parameter estimation is done comparing the actual covariance matrices representing the relationships between variables and the estimated covariance matrices of the best fitting model. This is obtained through numerical maximization of a fit criterion as provided by maximum likelihood, weighted least squares or asymptotically distribution-free methods.

This is best accomplished by using a specialized SEM analysis program, such as SPSS' AMOS, EQS, LISREL, Mplus, Mx, the sem package in R, or SAS PROC CALIS. More information about SAS PROC CALIS:

Assessment of fit

Using a SEM analysis program, one can compare the estimated matrices representing the relationships between variables in the model to the actual matrices. Formal statistical tests and fit indices have been developed for this purposes. Individual parameters of the model can also be examined within the estimated model in order to see how well the proposed model fits the driving theory. Most, though not all, estimation methods make such tests of the model possible.

However, the model tests are only correct provided that the model is correct. Although this problem exists in all statistical hypothesis tests, its existence in SEM has led to a large body of discussion among SEM experts, leading to a large variety of different recommendations on the precise application of the various fit indices and hypothesis tests.

Model modification

The model may need to be modified in order to maximize the fit, thereby estimating the most likely relationships between variables.

Interpretation and communication

The model is then interpreted and claims about the constructs are made based on the best fitting model.

Caution should always be taken when making claims of causality even when experimentation or time-ordered studies have been done. The term causal model can be misleading because SEM is most commonly used with data collected at one time point through passive observation. Collecting data at multiple time points and using an experimental or quasi-experimental design can help rule out certain rival hypotheses but even a randomized experiment cannot rule out all such threats to causal inference. Good fit by a model consistent with one causal hypothesis does not rule out equally good fit by another model consistent with a different causal hypothesis. However careful research design can help distinguish such rival hypotheses.

Replication and revalidation

All model modifications should be replicated and revalidated before interpreting and communicating the results.

Comparison to other methods

In machine learning, SEM may be viewed as a generalization of Linear-Gaussian Bayesian networks which drops the acyclicity constraint, i.e. which allows causal cycles.

Advanced uses

  • Invariance
  • Multiple group comparison
  • Modeling growth
  • Relations to other types of advanced models (multilevel models; item response theory models)
  • Alternative estimation and testing techniques
  • Robust inference
  • Interface with survey estimation

See also

References

Books
  • Bartholomew, D J, and Knott, M (1999) Latent Variable Models and Factor Analysis Kendall's Library of Statistics, vol. 7. Arnold publishers, ISBN 0-340-69243-X
  • Bollen, K A (1989). Structural Equations with Latent Variables. Wiley, ISBN 0-471-01171-1
  • Bollen, K A, and Long, S J (1993) Testing Structural Equation Models. SAGE Focus Edition, vol. 154, ISBN 0-8039-4507-8
  • Byrne, B. M. (2001) Structural Equation Modeling with AMOS - Basic Concepts, Applications, and Programming.LEA, ISBN 0-8058-4104-0
  • Haavelmo, T. (1943) "The statistical implications of a system of simultaneous equations," Econometrica 11:1-2. Reprinted in D.F. Hendry and M.S. Morgan (Eds.), The Foundations of Econometric Analysis, Cambridge University Press, 477--490, 1995.
  • Hoyle, R H (ed) (1995) Structural Equation Modeling: Concepts, Issues, and Applications. SAGE, ISBN 0-8039-5318-6
  • Kaplan, D (2000) Structural Equation Modeling: Foundations and Extensions. SAGE, Advanced Quantitative Techniques in the Social Sciences series, vol. 10, ISBN 0-7619-1407-2
  • Kline, R. B. (2005) Principles and Practice of Structural Equation Modeling. The Guilford Press, ISBN 1-57230-690-4
  • Pearl, Judea (1988). Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann. ISBN 0-934613-73-7.
  • Simon, Herbert (1953), "Causal ordering and identifiability", in Hood, W.C.; Koopmans, T.C. (eds.), Studies in Econometric Method, New York: Wiley, pp. 49–74
  • Wright, Sewal S. (1921). "Correlation of causation". Journal of Agricultural Research. 20: 557–85.
Software