Additive Schwarz method: Difference between revisions

Revision as of 07:20, 23 October 2007

Latest revision as of 13:00, 20 June 2025

(21 intermediate revisions by 18 users not shown)

Line 1:

{{No footnotes|date=December 2024}}

In mathematics, [[numerical analysis]] and numerical [[partial differential equation]]s, the '''___domain decomposition method''' solves a [[boundary value problem]] by splitting it into smaller boundary value problems.

In [[mathematics]], the '''additive Schwarz method''', named after [[Hermann Schwarz]], solves a [[boundary value problem]] for a [[partial differential equation]] approximately by splitting it into boundary value problems on smaller domains and adding the results.

== Overview ==

Partial differential equations (PDEs) are used in all hard [[science]]s to [[mathematical modelling|model]] phenomena. For the purpose of exposition, we give an example physical problem and the accompanying boundary value problem (BVP). Even if the reader is unfamiliar with the notation, the purpose is merely to show what a BVP looks like when written down.

{{block indent | em = 1.5 | text =

:'''(Model problem)''' The heat distribution in a square metal plate such that the left edge is kept at 1 degree, and the other edges are kept at 0 degree, after letting it sit for a long period of time satisfies the following boundary value problem:

<math display="block">\begin{align}

::''f''_''xx''(''x'',''y'') + ''f''_''yy''(''x'',''y'') = 0

&f_{xx}(x,y) + f_{yy}(x,y) = 0 \\

::''&f''(0,''y'') = 1; ''\; f''(''x'',0) = ''f''(''x'',1) = ''f''(1,''y'') = 0

\end{align}</math>

:where {{math|''f''}} is the unknown [[function (mathematics)|function]], {{math|''f''_''xx''}} and {{math|''f''_''yy''}} denote the second [[partial derivative]]s with respect to {{math|''x''}} and {{math|''y''}}, respectively.

}}

Here, the [[___domain (mathematicsmathematical analysis)|___domain]] is the square {{math|[0,1] &times;× [0,1]}}.

This particular problem can be solved exactly on paper, so there is no need for a computer. However, this is an exceptional case, and most BVPs cannot be solved exactly. The only possibility is to use a computer to find an approximate solution.

Line 18 ⟶ 23:

=== Solving on a computer ===

A typical way of doing this is to ''sample'' {{math|''f''}} at regular [[interval (mathematics)|intervals]]s in the [[Square (geometry)|square]] {{math|[0,1] &times;× [0,1]}}. For instance, we could take 8 samples in the {{math|''x''}} direction at {{math|1=''x'' = 0.1, 0.2, ..., 0.8 and, 0.9}}, and 8 samples in the {{math|''y''}} direction at similar [[coordinate system|coordinates]]. We would then have 64 samples of the square, at places like (0.2,0.8) and (0.6,0.6). The goal of the [[computer program]] would be to calculate the value of {{math|''f''}} at those 64 points, which seems easier than finding an abstract function of the square.

There are some difficulties, for instance it is not possible to calculate {{math|''f''_''xx''(0.5,0.5)}} knowing ''f'' at only 64 points in the square. To overcome this, one uses some sort of numerical approximation of the derivatives, see for instance the [[finite element method]] or [[finite difference]]s. We ignore these difficulties and concentrate on another aspect of the problem.

=== Solving linear problems ===

Whichever method we choose to solve this problem, we will need to solve a large [[linear system of equations]]. The reader willmay recall linear systems of equations from high school, they look like this:

{{NumBlk||<math display="block">2a + 5b = 12</math>|{{EquationRef|<nowiki>*</nowiki>}}}}

<math display="block">6a - 3b = -3</math>

This is a system of 2 equations in 2 unknowns (''{{mvar|a''}} and ''{{mvar|b''}}). If we solve the BVP above in the manner suggested, we will need to solve a system of 64 equations in 64 unknowns. This is not a hard problem for modern computers, but if we use a larger number of samples, even modern computers cannot solve the BVP very efficiently.

:2''a'' + 5''b'' = 12 (*)

:6''a'' &minus; 3''b'' = &minus;3

This is a system of 2 equations in 2 unknowns (''a'' and ''b''). If we solve the BVP above in the manner suggested, we will need to solve a system of 64 equations in 64 unknowns. This is not a hard problem for modern computers, but if we use a larger number of samples, even modern computers cannot solve the BVP very efficiently.

=== Domain decomposition ===

Which brings us to ___domain decomposition methods. If we split the ___domain {{math|[0,1] &times;× [0,1]}} into two ''subdomains'' {{math|[0,0.5] &times;× [0,1]}} and {{math|[0.5,1] &times;× [0,1]}}, each has only half of the sample points. So we can try to solve a version of our model problem on each subdomain, but this time each subdomain has only 32 sample points. Finally, given the solutions on each subdomain, we can attempt to reconcile them to obtain a solution of the original problem on {{math|[0,1] &times;× [0,1]}}.

==== Size of the problems ====

In terms of the linear systems, we're trying to split the system of 64 equations in 64 unknowns into two systems of 32 equations in 32 unknowns. This would be a clear gain, for the following reason. Looking back at system {{EquationNote|*|(*)}}, we see that there are 6 important pieces of information. They are the coefficients of ''a'' and ''b'' (2,5 on the first line and 6,&minus;3−3 on the second line), and the right hand side (which we write as 12,&minus;3−3). On the other hand, if we take two "systems" of 1 equation in 1 unknown, it might look like this:

<math display="block">2a = 12</math>

:System 1: 3''a'' = 15

<math display="block">-3b = -3</math>

:System 2: 6''b'' = &minus;4

We see that this system has only 4 important pieces of information. This means that a computer program will have an easier time solving two 1&times;11×1 systems than solving a single 2&times;22×2 system, because the pair of 1&times;11×1 systems are simpler than the single 2&times;22×2 system. While the 64&times;6464×64 and 32&times;3232×32 systems are too large to illustrate here, we could say by analogy that the 64&times;6464×64 system has 4160 pieces of information, while the 32&times;3232×32 systems each have 1056, or roughly a quarter of the 64&times;6464×64 system.

==== Domain decomposition algorithm ====

Unfortunately, for technical reasonreasons it is usually not possible to split our grid of 64 points (a 64&times;6464×64 system of linear equations) into two grids of 32 points (two 32&times;3232×32 systems of linear equations) and obtain an answer to the 64&times;6464×64 system. Instead, the following algorithm is what actually happens:

:1)# Begin with an approximate solution of the 64&times;6464×64 system.

:2)# From the 64&times;6464×64 system, create two 32&times;3232×32 systems to improve the approximate solution.

:3)# Solve the two 32&times;3232×32 systems.

:4)# Put the two 32&times;3232×32 solutions "together" to improve the approximate solution to the 64&times;6464×64 system.

:5)# If the solution isn't very good yet, repeat from 2.

There are two ways in which this can be better than solving the base 64&times;6464×64 system. First, if the number of repetitions of the algorithm is small, solving two 32&times;3232×32 systems may be more efficient than solving a 64&times;6464×64 system. Second, the two 32&times;3232×32 systems need not be solved on the same computer, so this algorithm can be run in ''parallel'' to use the power of multiple computers.

In fact, solving two 32&times;3232×32 systems instead of a 64&times;6464×64 system on a single computer (without using parallelism) is unlikely to be efficient. However, if we use more than two subdomains, the picture can change. For instance, we could use four 16&times;1616×16 problems, and there's a chance that solving these will be better than solving a single 64&times;6464×64 problem even if the ___domain decomposition algorithm needs to iterate a few times.

== A technical example ==

Line 64 ⟶ 68:

We will be solving the partial differential equation

{{NumBlk||<math display="block">u_{xx} + u_{yy} = f</math>|{{EquationRef|<nowiki>**</nowiki>}}}}

:''u''_''xx'' + ''u''_''yy'' = ''f'' (**)

TheWe boundary condition isimpose boundedness at infinity.

We decompose the ___domain {{math|'''R'''²²}} into two overlapping subdomains {{math|1=H₁ = (<nowiki>&minus;{{open-closed|−∞, ∞,1]</nowiki>}} &times;× '''R'''}} and {{math|1=H₂ = <nowiki>[{{closed-open|0, + ∞</nowiki>)}} &times;× '''R'''}}. In each subdomain, we will be solving a BVP of the form:

<math display="block"> \begin{align}

:''u''^{( ''j'' )}_''xx'' + ''u''^{( ''j'' )}_''yy'' = ''f'' in H_''j''

u_{xx}^{(j)} + u_{yy}^{(j)} &= f \;\; \text{ in } H_j \\

:''u''^{( ''j'' )}(''x''_''j'',''y'') = ''g''(''y'')

u^{(j)}(x_j, y) &= g(y)

\end{align}</math>

where {{math|1=''x''₁ = 1}} and {{math|1=''x''₂ = 0}} and taking boundedness at infinity as the other boundary condition. We denote the solution {{math|''u''^{( ''j'' )}}} of the above problem by {{math|S(''f'',''g'')}}. Note that {{math|S}} is bilinear.

The Schwarz algorithm proceeds as follows:

#Start with approximate solutions {{math|''u''^{( 1 )}₀}} and {{math|''u''^{( 2 )}₀}} of the PDE in subdomains {{math|H₁}} and {{math|H₂}} respectively. Initialize ''{{mvar|k''}} to 10.

#Calculate {{math|1=''u''^{( ''j'' )}_{''k'' + 1} = S(''f'',''u''^{(3 &minus;− ''j'')}_''k''(''x''_''j''))}} with {{math|1=''j'' = 1, 2}}.

#Increase ''{{mvar|k''}} by one and repeat 2 until sufficient precision is achieved.

== See also ==

*[[Domain decomposition method]]

*[[Schwarz alternating method]]

== References ==

* [[Multigrid method]]

{{refbegin}}

* {{cite book | first1 = Barry | last1 = Smith, | first2 = Petter | last2 = Bjørstad, | first3 = William | last3 = Gropp, | title = Domain Decomposition, Parallel Multilevel Methods for Elliptic Partial Differential Equations, | publisher = Cambridge University Press | year = 1996 | isbn = 0-521-49589-X }}

* {{cite book | first1 = Andrea | last1 = Toselli and| first2 = Olof B. | last2 = Widlund, | title = Domain Decomposition Methods - Algorithms and Theory, | series = Springer Series in Computational Mathematics, Vol. 34, | year = 2004 | isbn = 978-3-540-20696-5 }}

{{refend}}

== External links ==

* [http://www.ddm.org The official Domain Decomposition Methods page]

{{Numerical PDE}}

== References ==

* Barry Smith, Petter Bjørstad, William Gropp, Domain Decomposition, Parallel Multilevel Methods for Elliptic Partial Differential Equations, Cambridge University Press 1996

* Andrea Toselli and Olof Widlund, Domain Decomposition Methods - Algorithms and Theory, Springer Series in Computational Mathematics, Vol. 34, 2004

[[Category:NumericalDomain analysisdecomposition methods]]

[[Category:Numerical differential equations]]

[[Category:Partial differential equations]]