Latin hypercube sampling: Difference between revisions

Revision as of 17:56, 20 June 2007

Latest revision as of 10:11, 23 June 2025

(79 intermediate revisions by 60 users not shown)

Line 1:

{{Short description|Statistical sampling technique}}

The [[statistics|statistical]] method of '''Latin hypercube sampling''' ('''LHS''') wasis developeda to[[statistics|statistical]] generatemethod afor distributiongenerating ofa plausiblenear-random collectionssample of parameter values from a [[multidimensional distribution]]. The [[Sampling (statistics)|sampling method]] is often appliedused into construct [[uncertaintycomputer experiment]]s analysisor for [[Monte Carlo integration]].<ref name = "C3M"/>

LHS was described by Michael McKay of Los Alamos National Laboratory in 1979.<ref name = "C3M">{{cite journal

The technique was first described by McKay<ref>{{cite journal |last=McKay |first=M.D. |coauthors=Conover, W.J.; and Beckman, R.J. |title=A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code |year=1979 |journal=Technometrics |volume=21 |pages=239–245}}</ref> in [[1979]]. It was further elaborated by [[Ronald L. Iman]], and others<ref>{{cite journal |last=Iman |first=R.L. |coauthors=Helton, J.C.; and [[James Edward Campbell|Campbell, J.E.]] |title=An approach to sensitivity analysis of computer models, Part 1. Introduction, input variable selection and preliminary variable assessment |journal=Journal of Quality Technology |volume=13 |issue=3 |pages=174–183 |year=1981 }}</ref> in [[1981]]. Detailed computer codes and manuals were later published.<ref>{{cite book |last=Iman |first=R.L. |coauthors=Davenport, J.M. ; Zeigler, D.K. |title=Latin hypercube sampling (program user's guide) |year=1980 |id={{OSTI|5571631}}}}</ref>

| last = McKay

| first = M.D. |author2=Beckman, R.J. |author3=Conover, W.J.

|date=May 1979

| title = A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code

| journal = [[Technometrics]]

| volume = 21

| issue = 2

| pages = 239–245

| publisher = [[American Statistical Association]]

| issn = 0040-1706

| doi = 10.2307/1268522

| osti = 5236110

| jstor = 1268522

}}

The</ref> An equivalent technique was firstindependently describedproposed by McKay[[:lv:Vilnis Eglājs|Vilnis Eglājs]] in 1977.<ref>{{cite journal |last=McKay Eglajs|first=MV.D. |coauthorsauthor2=Conover,Audze W.J.; and Beckman, R.JP. |title=ANew Comparisonapproach ofto Three Methods for Selectingthe Valuesdesign of Inputmultifactor Variables in the Analysisexperiments|journal=Problems of OutputDynamics from a Computer Codeand Strengths|year=1979 1977|journalseries=Technometrics 35|volumepages=104–107|publisher=21Zinatne Publishing House|pages___location=Riga|language=239–245Russian}}</ref> in [[1979]]. It was further elaborated by [[Ronald L. Iman]], and otherscoauthors in 1981.<ref>{{cite journal |last=Iman |first=R.L. |coauthorsauthor2=Helton, J.C.; and [[James Edward Campbell|author3=Campbell, J.E.]] |title=An approach to sensitivity analysis of computer models, Part 1. Introduction, input variable selection and preliminary variable assessment |journal=Journal of Quality Technology |volume=13 |issue=3 |pages=174–183 |year=1981 |doi=10.1080/00224065.1981.11978748 }}</ref> in [[1981]]. Detailed computer codes and manuals were later published.<ref>{{cite book |last=Iman |first=R.L. |coauthorsauthor2=Davenport, J.M. ; |author3=Zeigler, D.K. |title=Latin hypercube sampling (program user's guide) |year=1980 |idosti={{OSTI|5571631}}}}</ref>

In the context of statistical sampling, a square grid containing sample positions is a [[Latin square]] if (and only if) there is only one sample in each row and each column. A '''Latin [[hypercube]]''' is the generalisation of this concept to an arbitrary number of dimensions, whereby each sample is the only one in each axis-aligned [[hyperplane]] containing it.<ref name = "C3M"/>

When sampling a function of <math>N</math> variables, the range of each variable is divided into <math>M</math> equally probable intervals. <math>M</math> sample points are then placed to satisfy the Latin hypercube requirements; note that this forces the number of divisions, <math>M</math>, to be equal for each variable. Also note that thisThis sampling scheme does not require more samples for more dimensions (variables); this independence is one of the main advantages of this sampling scheme. Another advantage is that random samples can be taken one at a time, remembering which samples were taken so far.

'''Orthogonal sampling''' adds the requirement that the entire sample space must be sampled evenly. Although more efficient, orthogonal sampling strategy is more difficult to implement since all random samples must be generated simultaneously.

[[Image:LHSsampling.png|100px|right]]

In two dimensions the difference between random sampling, Latin Hypercubehypercube sampling, and orthogonal sampling can be explained as follows:

#In '''random sampling''' new sample points are generated without taking into account the previously generated sample points. One does thus not necessarily need to know beforehand how many sample points that are needed.

#In '''Latin Hypercubehypercube sampling''' one must first decide how many sample points to use and for each sample point remember in which row and column the sample point was taken. Such configuration is similar to having N [[Rook_(chess)|rooks]] on a chess board without threatening each other.

#In '''Orthogonalorthogonal Samplingsampling''', the sample space is dividedpartitioned into equally probable subspaces, the figure above showing four subspaces. All sample points are then chosen simultaneously making sure that the total ensembleset of sample points is a Latin Hypercubehypercube sample and that each subspace is sampled with the same density.

Thus, orthogonal sampling ensures that the ensemble of random numbers is a very good representative of the real variability, LHS sampling ensures that the ensemble of random numbers is a good representative of the real variability whereas traditional random sampling (sometimes called brute force) is just an ensemble of random numbers without any guarantees.

Thus, orthogonal sampling ensures that the ensembleset of random numbers is a very good representative of the real variability, LHS sampling ensures that the ensembleset of random numbers is a good representative of the real variability whereas traditional random sampling (sometimes called brute force) is just ana ensembleset of random numbers without any guarantees.

==References==

<references/>

==Further reading==

*{{cite journal |doi=10.2307/2291282 |last=Tang |first=B. |title=Orthogonal Array-Based Latin Hypercubes |journal=Journal of the American Statistical Association |volume=88 |issue=424 |pages=1392–1397 |year=1993 |jstor=2291282 }}

*{{cite journal |last=Owen |first=A.B. |title=Orthogonal arrays for computer experiments, integration and visualization |journal=Statistica Sinica |volume=2 |pages=439–452 |year=1992 }}

*{{cite journal |doi=10.2307/2670057 |last=Ye |first=K.Q. |title=Orthogonal column Latin hypercubes and their application in computer experiments |journal=Journal of the American Statistical Association |volume=93 |issue=444 |pages=1430–1439 |year=1998 |jstor=2670057 }}

{{Experimental design}}

{{Statistics}}

[[Category:Sampling techniques]]

[[Category:Latin squares]]

[[Category:ExperimentalDesign designof experiments]]

[[Category:1979 introductions]]