Parameterized complexity: Difference between revisions

Revision as of 01:39, 26 December 2015

Latest revision as of 22:27, 1 August 2025

(67 intermediate revisions by 55 users not shown)

Line 1:

{{Short description|Branch of computational complexity theory}}

In [[computer science]], '''parameterized complexity''' is a branch of [[computational complexity theory]] that focuses on classifying [[computational problems]] according to their inherent difficulty with respect to ''multiple'' parameters of the input or output. The complexity of a problem is then measured as a [[Function (mathematics)|function]] inof those parameters. This allows the classification of [[NP-hard]] problems on a finer scale than in the classical setting, where the complexity of a problem is only measured byas a function of the number of bits in the input. This appears to have been first demonstrated in {{harvtxt|Gurevich|Stockmeyer|Vishkin|1984}}. The first systematic work on parameterized complexity was done by {{harvtxt|Downey|Fellows|1999}}.

The first systematic work on parameterized complexity was done by {{harvtxt|Downey|Fellows|1999}}.

Under the assumption that [[P versus NP problem|P&nbsp;≠&nbsp;NP]], there exist many natural problems that require superpolynomialsuper-polynomial [[running time]] when complexity is measured in terms of the input size only, but that are computable in a time that is polynomial in the input size and exponential or worse in a parameter <math>{{mvar|k</math>}}. Hence, if <math>{{mvar|k</math>}} is fixed at a small value and the growth of the function over <math>{{mvar|k</math>}} is relatively small then such problems can still be considered "tractable" despite their traditional classification as "intractable".

The existence of efficient, exact, and deterministic solving algorithms for [[NP-complete]], or otherwise [[NP-hard]], problems is considered unlikely, if input parameters are not fixed; all known solving algorithms for these problems require time that is [[Exponential time|exponential]] (orso atin leastparticular superpolynomialsuper-polynomial) in the total size of the input. However, some problems can be solved by algorithms that are exponential only in the size of a fixed parameter while polynomial in the size of the input. Such an algorithm is called a [[fixed-parameter tractable]] (fpt-FPT) algorithm, because the problem can be solved efficiently (i.e., in polynomial time) for smallconstant values of the fixed parameter.

Problems in which some parameter <math>{{mvar|k</math>}} is fixed are called parameterized problems. A parameterized problem that allows for such an fpt-FPT algorithm is said to be a '''fixed-parameter tractable''' problem and belongs to the class <math>{{sans-serif|FPT</math>}}, and the early name of the theory of parameterized complexity was '''fixed-parameter tractability'''.

Many problems have the following form: given an object <math>{{mvar|x</math>}} and a nonnegative integer <math>{{mvar|k</math>}}, does <math>{{mvar|x</math>}} have some property that depends on <math>{{mvar|k</math>}}? For instance, for the [[vertex cover problem]], the parameter can be the number of vertices in the cover. In many applications, for example when modelling error correction, one can assume the parameter to be "small" compared to the total input size. Then it is interestingchallenging to see whether we can find an algorithm whichthat is exponential ''only'' in <math>{{mvar|k</math>}}, and not in the input size.

In this way, parameterized complexity can be seen as ''two-dimensional'' complexity theory. This concept is formalized as follows:

Line 14:

:A ''parameterized problem'' is a language <math>L \subseteq \Sigma^* \times \N</math>, where <math>\Sigma</math> is a finite alphabet. The second component is called the ''parameter'' of the problem.

:A parameterized problem <math>{{mvar|L</math>}} is ''fixed-parameter tractable'' if the question &ldquo;"<math>(x, k) \in L</math>?&rdquo;" can be decided in running time <math>f(k) \cdot |x|^{O(1)}</math>, where <math>{{mvar|f</math>}} is an arbitrary function depending only on <math>{{mvar|k</math>}}. The corresponding [[complexity class]] is called '''FPT'''.

:A parameterized problem uses the ''natural parameter'' when its parameter is the size of the solution to the problem.

For example, there is an algorithm whichthat solves the vertex cover problem in <math>O(kn + 1.274^k)</math> time, <ref>{{harvnb|Chen|Kanj|Xia|2006}}</ref> where <math>{{mvar|n</math>}} is the number of vertices and <math>{{mvar|k</math>}} is the size of the vertex cover. This means that vertex cover is fixed-parameter tractable with the size of the solution as the parameter (its natural parameter).

== Complexity classes ==

=== FPT ===

FPT contains the ''fixed parameter tractable'' problems, which are those that can be solved in time <math>f(k) \cdot {|x|}^{O(1)}</math> for some computable function <math>{{mvar|f</math>}}. Typically, this function is thought of as single exponential, such as <math>2^{O(k)}</math>, but the definition admits functions that grow even faster. This is essential for a large part of the early history of this class. The crucial part of the definition is to exclude functions of the form <math>f(n,k)</math>, such as <math>k^n^k</math>. The class '''FPL''' (fixed parameter linear) is the class of problems solvable in time <math>f(k) \cdot |x|</math> for some computable function <math>f</math> {{harvtxt|Grohe|1999}}. FPL is thus a subclass of FPT.

The class '''FPL''' (fixed parameter linear) is the class of problems solvable in time <math>f(k) \cdot |x|</math> for some computable function {{mvar|f}}.<ref>{{harvtxt|Grohe|1999}}</ref> FPL is thus a subclass of FPT. An example is the [[Boolean satisfiability]] problem, parameterised by the number of variables. A given formula of size <math>{{mvar|m</math>}} with <math>{{mvar|k</math>}} variables can be checked by brute force in time <math>O(2^km)</math>. A [[vertex cover]] of size <math>{{mvar|k</math>}} in a graph of order <math>{{mvar|n</math>}} can be found in time <math>O(2^kn)</math>, so thisthe vertex cover problem is also in FPTFPL.

An example of a problem that is thought not to be in FPT is [[graph coloring]] parameterised by the number of colors. It is known that 3-coloring is [[NP-hard]], and an algorithm for graph <math>{{mvar|k</math>}}-colouringcoloring in time <math>f(k)n^{O(1)}</math> for <math>k=3</math> would run in polynomial time in the size of the input. Thus, if graph coloring parameterised by the number of colors were in FPT, then [[P versus NP problem|P&nbsp;=&nbsp;NP]].

There are a number of alternative definitions of FPT. For example, the running -time requirement can be replaced by <math>f(k) + |x|^{O(1)}</math>. Also, a parameterised problem is in FPT if it has a so-called kernel. [[Kernelization]] is a preprocessing technique that reduces the original instance to its "hard kernel", a possibly much smaller instance that is equivalent to the original instance but has a size that is bounded by a function in the parameter.

FPT is closed under a parameterised notion of [[Reduction (complexity)|reductionreductions]] called '''''fpt-reductionreductions'''''. Such reductions transform an instance <math>(x,k)</math> whichof simultaneouslysome preservesproblem theinto an equivalent instance size<math>(x',k')</math> of another problem (with <math>k' \leq g(k)</math>) and thecan be computed in time <math>f(k)\cdot p(|x|)</math> where <math>p</math> is a parameterpolynomial.

Obviously, FPT contains all polynomial-time computable problems. Moreover, it contains all optimisation problems in NP that allow aan [[FullyEfficient polynomial-time approximation scheme|efficient polynomial-time approximation scheme (EPTAS)]].

=== ''W'' hierarchy ===

The '''''W'' hierarchy''' is a collection of computational complexity classes. A parameterisedparameterized problem is in the class ''W''[''i''], if every instance <math>(x, k)</math> can be transformed (in fpt-time) to a combinatorial circuit that has [[weft (circuit)|weft]] at most ''i'', such that <math>(x, k)\in L</math> if and only if there is a satisfying assignment to the inputs, whichthat assigns ''1'' to at mostexactly ''k'' inputs. The height thereby'''weft''' is the largest number of logical units with unbounded fan-in greater than two on any path from an input to the output. The total number of logical units withon boundedthe fan-inpaths on(known theas pathsdepth) must be limited by a constant that holds for all instances of the problem.

Note that <math>\mathsf{FPT&nbsp;} =&nbsp;'' W''[0]</math> and <math>W[''i''] <math>\subseteq</math> ''W''[''j'']</math> for all <math>i\le j</math>. The classes in the ''W'' hierarchy are also closed under fpt-reduction.

A complete problem for ''W''[''i''] is '''Weighted ''i''-Normalized Satisfiability''':<ref>{{cite journal |last1=Downey |first1=Rod G. |last2=Fellows |first2=Michael R. |title=Fixed-Parameter Tractability and Completeness I: Basic Results |journal=SIAM Journal on Computing |date=August 1995 |volume=24 |issue=4 |pages=873–921 |doi=10.1137/S0097539792228228 |url=https://doi.org/10.1137/S0097539792228228 |language=en |issn=0097-5397|url-access=subscription }}</ref> given a Boolean formula written as an AND of ORs of ANDs of ... of possibly negated variables, with <math>i+1</math> layers of ANDs or ORs (and ''i'' alternations between AND and OR), can it be satisfied by setting exactly ''k'' variables to 1?

Note that FPT&nbsp;=&nbsp;''W''[0] and W[''i''] <math>\subseteq</math> ''W''[''j''] for all <math>i\le j</math>. The classes in the ''W'' hierarchy are also closed under fpt-reduction.

Many natural computational problems occupy the lower levels, ''W''[1] and ''W''[2].

==== ''W''[1] ====

{{Redirect|W(1)|the mathematical constant|omega constant}}

Examples of ''W''[1]-complete problems include

* deciding if a given graph contains a [[Clique (graph theory)|clique]] of size ''k''

* deciding if a given graph contains an [[Independent set (graph theory)|independent set]] of size ''k''

* deciding if a given nondeterministic single-tape Turing machine accepts within ''k'' steps ("short Turing machine acceptance" problem). This also applies to nondeterministic [[Turing machine|Turing machines]] with ''f''(''k'') tapes and even ''f''(''k'') of ''f''(''k'')-dimensional tapes, but even with this extension, the restriction to ''f''(''k'') tape alphabet size is fixed-parameter tractable. Crucially, the branching of the Turing machine at each step is allowed to depend on ''n'', the size of the input. In this way, the Turing machine may explore ''n''^O(''k'') computation paths.

==== ''W''[2] ====

Examples of ''W''[2]-complete problems include

* deciding if a given graph contains a [[dominating set]] of size ''k''

* deciding if a given nondeterministic [[Turing machine equivalents#Multi-tape Turing machines|multi-tape Turing machine]] accepts within ''k'' steps ("short multi-tape Turing machine acceptance" problem). Crucially, the branching is allowed to depend on ''n'' (like the W[1] variant), as is the number of tapes. An alternate ''W''[2]-complete formulation allows only single-tape Turing machines, but the alphabet size may depend on ''n''.

==== ''W''[''t''] ====

<math>W[t]</math> can be defined using the family of Weighted Weft-<math>{{mvar|t</math>}}-Depth-<math>{{mvar|d</math>}} SAT problems for <math>d\geq t</math>:

<math>W[t,d]</math> is the class of parameterized problems that fpt-reduce to this problem, and <math>W[t] = \bigcup_{d\geq t} W[t,d]</math>.

Here, '''Weighted Weft-<math>{{mvar|t</math>}}-Depth-<math>{{mvar|d</math>}} SAT''' is the following problem:

* Input: A Boolean formula of depth at most <math>{{mvar|d</math>}} and weft at most <math>{{mvar|t</math>}}, and a number <math>{{mvar|k</math>}}. The ''depth'' is the maximal number of gates on any path from the root to a leaf, and the ''weft'' is the maximal number of gates ''of fan-in at least three'' on any path from the root to a leaf.

* Question: Does the formula have a satisfying assignment of [[Hamming weight]] atexactly most <math>{{mvar|k</math>}}?

It can be shown that the problem Weightedfor <math>t\geq2</math> the problem Weighted {{mvar|t}}-Normalize SAT is complete for <math>W[t]</math> under fpt-reductions.<ref>{{cite journal |authorlast1=Buss, |first1=Jonathan F, |last2=Islam, |first2=Tarique |title=Simplifying the weft hierarchy |journal=[[Theoretical Computer Science (journal)|Theoretical Computer Science]] |year=2006 |volume=351 |number=3 |pages=303–313 |publisher=Elsevier |accessdate=16 April 2014 |doi=10.1016/j.tcs.2005.10.002|doi-access=free }}</ref>

Here, '''Weighted <math>{{mvar|t</math>}}-Normalize SAT''' is the following problem:

* Input: A Boolean formula of depth at most <math>{{mvar|t</math>}} with an AND-gate on top, and a number <math>{{mvar|k</math>}}.

* Question: Does the formula have a satisfying assignment of Hamming weight atexactly most <math>{{mvar|k</math>}}?

==== ''W''[''P''] ====

''W''[''P''] is the class of problems that can be decided by a nondeterministic polynomial<math>h(k) \cdot {|x|}^{O(1)}</math>-time Turing- machine that makes at most <math>O(f(k)\cdot \log n)</math> nondeterministic choices in the computation on <math>(x,k)</math> (a ''k''-restricted Turing- machine). {{harvtxt|Flum|Grohe|2006}}

It is known that FPT is contained in W[P], and the inclusion is believed to be strict. However, resolving this issue would imply a solution to the [[P versus NP]] problem.

Other connections to unparameterised computational complexity are that FPT equals ''W''[''P''] if and only if [[circuit satisfiability]] can be decided in time <math>\exp(o(n))m^{O(1)}</math>, or if and only if there is a computable, nondecreasing, unbounded function f such that all languages recognised by a nondeterministic polynomial-time Turing machine using {{tmath|f(n)\log n}} nondeterministic choices are in&nbsp;''P''.

''W''[''P''] can be loosely thought of as the class of problems where we have a set {{mvar|S}} of {{mvar|n}} items, and we want to find a subset <math>T \subset S</math> of size {{mvar|k}} such that a certain property holds. We can encode a choice as a list of {{mvar|k}} integers, stored in binary. Since the highest any of these numbers can be is {{mvar|n}}, <math>\lceil\log_2 n\rceil</math> bits are needed for each number. Therefore <math>k \cdot \lceil\log_2 n\rceil </math> total bits are needed to encode a choice. Therefore we can select a subset <math>T\subset S</math> with <math>O(k\cdot \log n)</math> nondeterministic choices.

=== XP ===

'''XP''' is the class of parameterized problems that can be solved in time <math>n^{f(k)}</math> for some computable function <math>{{mvar|f</math>}}. These problems are called [[slicewise]] polynomial, in the sense that each "slice" of fixed k has a polynomial algorithm, although possibly with a different exponent for each k. Compare this with FPT, which merely allows a different constant prefactor for each value of k. XP contains FPT, and it is known that this containment is strict by diagonalization.

=== para-NP ===

'''para-NP''' is the class of parameterized problems that can be solved by a [[nondeterministic algorithm]] in time <math>f(k) \cdot |x|^{O(1)}</math> for some computable function {{mvar|f}}. It is known that <math>\textsf{FPT}=\textsf{para-NP}</math> if and only if <math>\textsf{P}=\textsf{NP}</math>.{{sfnp|Flum|Grohe|2006|page=39}}

A problem is '''para-NP-hard''' if it is <math>\textsf{NP}</math>-hard already for a constant value of the parameter. That is, there is a "slice" of fixed {{mvar|k}} that is <math>\textsf{NP}</math>-hard. A parameterized problem that is <math>\textsf{para-NP}</math>-hard cannot belong to the class <math>\textsf{XP}</math>, unless <math>\textsf{P}=\textsf{NP}</math>. A classic example of a <math>\textsf{para-NP}</math>-hard parameterized problem is [[graph coloring]], parameterized by the number {{mvar|k}} of colors, which is already <math>\textsf{NP}</math>-hard for <math>k=3</math> (see [[Graph coloring#Computational complexity]]).

=== A hierarchy ===

The '''A hierarchy''' is a collection of computational complexity classes similar to the W hierarchy. However, while the W hierarchy is a hierarchy contained in NP, the A hierarchy more closely mimics the [[polynomial-time hierarchy]] from classical complexity. It is known that A[1] = W[1] holds.

== See also ==

* [[Parameterized approximation algorithm]], for [[Optimization problem|optimization problems]] an algorithm running in FPT time might [[Approximation algorithm|approximate]] the solution.

{{Expand section|date=April 2011}}

== Notes ==

Line 82 ⟶ 99:

== References ==

* {{cite journalconference

|first1 = Jianer

|last1 = Chen

Line 90 ⟶ 107:

|last3 = Xia

|title = Improved Parameterized Upper Bounds for Vertex Cover

|conference = Mathematical Foundations of Computer Science

|journal = Mfcs 2006

|publisher = Springer

|publication-place = Berlin, Heidelberg

|volume = 4162

|pages = 238–249

|year = 2006

|doi = 10.1007/11821069_21

|ref isbn = harv978-3-540-37791-7

|citeseerx = 10.1.1.432.831

|volume = 4162

}}

*{{cite book

Line 113 ⟶ 133:

}}

* {{cite book

|lastlast1 = Downey

|firstfirst1 = Rod G.

|authorlink = Rod Downey

|last2 = Fellows

Line 122 ⟶ 142:

|publisher = Springer

|year = 1999

|url = httphttps://www.springer.com/sgw/cda/frontpage/0,11855,5-0-22-1519914-0,00.html?referer=www.springer.de%2Fcgi-bin%2Fsearch_book.pl%3Fisbn%3D0-387-94883-X

|isbn = 978-0-387-94883-X6

|ref = harv

}}

* {{cite book

|lastlast1 = Flum

|firstfirst1 = Jörg

|authorlink = Jörg Flum

|last2 = Grohe

Line 136 ⟶ 155:

|year = 2006

|publisher = Springer

|url = httphttps://www.springer.com/east/home/generic/search/results?SGWID=5-40109-22-141358322-0

|isbn = 978-3-540-29952-3

|ref = harv

}}

*{{cite book

|last1=Fomin|first1=Fedor V.

|last2=Lokshtanov|first2=Daniel

|last3=Saurabh|first3=Saket

|last4=Zehavi|first4=Meirav

|year=2019

|title=Kernelization: Theory of Parameterized Preprocessing

|publisher=Cambridge University Press

|isbn=978-1107057760

|doi=10.1017/9781107415157

|page=528|s2cid=263888582

}}

*{{cite book

|last1=Gurevich|first1=Yuri

|last2=Stockmeyer|first2=Larry

|last3=Vishkin|first3=Uzi

|year=1984

|title=Solving NP-hard problems on graphs that are almost trees and an application to facility ___location problems

|publisher=Journal of the ACM

|page=459-473}}

* {{cite book

|first = Rolf

|last = Niedermeier

|authorlink = Rolf Niedermeier

|title = Invitation to Fixed-Parameter Algorithms

|publisher = Oxford University Press

|year = 2006

|url = http://www.oup.com/uk/catalogue/?ci=9780198566076

|isbn = 978-0-19-856607-7 6

|ref url-status = harvdead

|archive-url = https://web.archive.org/web/20080924051521/http://www.oup.com/uk/catalogue/?ci=9780198566076

|archive-date = 2008-09-24

}}

* {{cite book

Line 161 ⟶ 201:

|volume = 1683

|year = 1999

|pages = 14-3114–31

|url = http://dx.doi.org/10.1007/3-540-48168-0_3

|isbn = 978-3-540-66536-6

|ref doi = harv10.1007/3-540-48168-0_3

|citeseerx = 10.1.1.25.9250

}}

* [[The Computer Journal]]. Volume 51, Numbers 1 and 3 (2008). [https://web.archive.org/web/20051125014940/http://comjnl.oxfordjournals.org/ The Computer Journal]. Special Double Issue on Parameterized Complexity with 15 survey articles, book review, and a Foreword by Guest Editors R. Downey, M. Fellows and M. Langston.

== External links ==

Line 172 ⟶ 212:

* [http://www.sprg.uniroma2.it/home/cesati/research/compendium/ Compendium of Parameterized Problems]

[[Category:Computational complexity theory]]

[[Category:Parameterized complexity| ]]

[[Category:Computational complexity theory]]