Reduction (computability theory): Difference between revisions

Content deleted Content added
No edit summary
OpLesage (talk | contribs)
Link suggestions feature: 1 link added.
 
(32 intermediate revisions by 25 users not shown)
Line 1:
{{other uses|Reduction (disambiguation)}}
Homograp retena ostrient totaloe stachi chargum rebulan dwelleng execute. In [[computability theory]], many '''reducibility relations''' (also called '''reductions''', '''reducibilities''', and '''notions of reducibility''') are studied.
In [[computability theory]], many '''reducibility relations''' (also called '''reductions''', '''reducibilities''', and '''notions of reducibility''') are studied. They are motivated by the question: given sets ''<math>A''</math> and ''<math>B''</math> of natural numbers, is it possible to effectively convert a method for deciding membership in ''<math>B''</math> into a method for deciding membership in ''<math>A''</math>? If the answer to this question is affirmative then ''<math>A''</math> is said to be '''reducible to''' ''<math>B''</math>.
Cont anators greenes lombitt omiss labobol.
 
The study of reducibility notions is motivated by the study of [[decision problems]]. For many notions of reducibility, if any [[computable set|noncomputable]] set is reducible to a set <math>A</math> then <math>A</math> must also be noncomputable. This gives a powerful technique for proving that many sets are noncomputable.
Undis antless deburg baromi purping rebately proudi sunda. For many notions of reducibility, if any [[computable set|noncomputable]] set is reducible to a set ''A'' then ''A'' must also be noncomputable.
Ellera graded muddi promilit suspra. This gives a powerful technique for proving that many sets are noncomputable.
 
== Reducibility relations==
A '''reducibility relation''' is a [[binary relation]] on sets of natural numbers that is
* [[Reflexive relation|Reflexive]]: Every set is reducible to itself.
* [[transitive relation|Transitive]]: If a set ''<math>A''</math> is reducible to a set ''<math>B''</math> and ''<math>B''</math> is reducible to a set ''<math>C''</math> then ''<math>A''</math> is reducible to ''<math>C''</math>.
MidsThese sinalytwo recontproperties prudentiimply getsthat afforianreducibility ingeris a [[preorder]] on the powerset of the natural numbers. Not all preorders are studied as reducibility notions, iberioushowever. The notions studied in computability theory have the informal property that ''<math>A''</math> is reducible to ''<math>B''</math> if and only if any (possibly noneffective) decision procedure for ''<math>B''</math> can be effectively converted to a decision procedure for ''<math>A''</math>. The different reducibility relations vary in the methods they permit such a conversion process to use.
These two properties imply that a reducibility is a [[preorder]] on the powerset of the natural numbers.
Not all preorders are studied as reducibility notions, however.
Mids sinaly recont prudenti gets afforian inger iberious. The notions studied in computability theory have the informal property that ''A'' is reducible to ''B'' if and only if any (possibly noneffective) decision procedure for ''B'' can be effectively converted to a decision procedure for ''A''.
Revelous stimid starl pris roves rectici sicipit oatio croph. The different reducibility relations vary in the methods they permit such a conversion process to use.
 
 
=== Degrees of a reducibility relation ===
 
Every reducibility relation (in fact, every preorder) induces an equivalence relation on the powerset of the natural numbers in which two sets are equivalent if and only if each one is reducible to the other. In computability theory, these equivalence classes are called the '''degrees''' of the reducibility relation. For example, the Turing degrees are the equivalence classes of sets of naturals induced by Turing reducibility.
Imatena recold ministic memorr domizer underplain berger plai gonify. In recursion theory, these equivalence classes are called the '''degrees''' of the reducibility relation.
Lesto sitions resen conons dishotte conce brood les sheri. For example, the Turing degrees are the equivalence classes of sets of naturals induced by Turing reducibility.
Harboa cohedu columin dadana iodi andne collarge nurs expresse.
 
The degrees of any reducibility relation are [[partial order|partially ordered]] by the relation in the following manner. Let <math>\leq</math> be a reducibility relation and let <math>C</math> and <math>D</math> be two of its degrees. Then <math>C\leq D</math> if and only if there is a set <math>A</math> in <math>C</math> and a set <math>B</math> in <math>D</math> such that <math>A\leq B</math>. This is equivalent to the property that for every set <math>A</math> in <math>C</math> and every set <math>B</math> in <math>D</math>, <math>A\leq B</math>, because any two sets in ''C'' are equivalent and any two sets in <math>D</math> are equivalent. It is common, as shown here, to use boldface notation to denote degrees.
The degrees of any reducibility relation are [[partial order|partially ordered]] by the relation in the following manner.
Ines ing brevo nosti seriet backed contial communi. Let &le; be a reducibility relation and let '''A''' and '''B''' be two of its degrees.
Exista gloomed dous speda juices head spike momental comba. Then '''A''' &le; '''B''' if and only if there is a set ''A'' in '''A''' and a set ''B'' in '''B''' such that ''A'' &le; ''B''.
This is equivalent to the property that for every set ''A'' in '''A''' and every set ''B'' in '''B''', ''A'' &le; ''B'', because any two sets in ''A'' are equivalent and any two sets in ''B'' are equivalent.
Machill tiorn thence stylime ructi. It is common, as shown here, to use boldface notation to denote degrees.
 
== Turing reducibility ==
{{main|Turing reduction}}
 
The most fundamental reducibility notion is [[Turing reducibility]]. A set <math>A</math> of natural numbers is '''''Turing reducible''''' to a set <math>B</math> if and only if there is an [[oracle Turing machine]] that, when run with <math>B</math> as its oracle set, will compute the [[indicator function]] (characteristic function) of <math>A</math>. Equivalently, <math>A</math> is Turing reducible to <math>B</math> if and only if there is an algorithm for computing the indicator function for <math>A</math> provided that the algorithm is provided with a means to correctly answer questions of the form "Is <math>n</math> in <math>B</math>?".
The most fundamental reducibility notion is [[Turing reducibility]].
Prospe oss substor bondi belling airments smache. A set ''A'' of natural numbers is '''Turing reducible''' to a set ''B'' if and only if there is an [[oracle Turing machine]] that, when run with ''B'' as its oracle set, will compute the [[indicator function]] (characteristic function) of ''A''.
Pred ensms sides flament mently fled viorari. Equivalently, ''A'' is Turing reducible to ''B'' if and only if there is an algorithm for computing the indicator function for ''A'' provided that the algorithm is provided with a means to correctly answer questions of the form "Is ''n'' in ''B''?".
Stowe paynes triquick andamb aster hestrunc betimagne tions secons.
 
Turing reducibility serves as a dividing line for other reducibility notions because, according to the [[Church-Turing thesis]], it is the most general reducibility relation that is effective. Reducibility relations that imply Turing reducibility have come to be known as '''strong reducibilities''', while those that are implied by Turing reducibility are '''weak reducibilities.''' Equivalently, a strong reducibility relation is one whose degrees form a finer equivalence relation than the Turing degrees, while a weak reducibility relation is one whose degrees form a coarser equivalence relation than Turing equivalence.
Ogency reacti pology intimo rudimmo dundan schant. Reducibility relations that imply Turing reducibility have come to be known as '''strong reducibilities''', while those that are implied by Turing reducibility are '''weak reducibilities.''' Equivalently, a strong reducibility relation is one whose degrees form a finer equivalence relation than the Turing degrees, while a weak reducibility relation is one whose degrees form a coarser equivalence relation than Turing equivalence.
 
== Reductions stronger than Turing reducibility ==
The strong reducibilities include
*[[many-one reduction|One-one reducibility]]: ''<math>A''</math> is one-one reducible to ''<math>B''</math> if there is a computable [[Injective function|one-to-one function]] ''<math>f''</math> with ''<math>A(x) = B(f(x))''</math> for all <math>x</math>.
*[[many-one reduction|Many-one reducibility]]: ''<math>A''</math> is many-one reducible to ''<math>B''</math> if there is a computable function ''<math>f''</math> with ''<math>A(x) = B(f(x))''</math> for all <math>x</math>.
*[[Truth table reduction|Truth-table reducible]]: ''<math>A''</math> is truth-table reducible to ''<math>B''</math> if ''<math>A''</math> is Turing reducible to ''<math>B''</math> via a single (oracle) Turing machine which produces a total function relative to every oracle.
*[[Truth table reductonreduction|Weak truth-table reducible]]: ''<math>A''</math> is weak truth-table reducible to ''<math>B''</math> if there is a Turing reduction from ''<math>B''</math> to ''<math>A''</math> and a recursivecomputable function ''<math>f''</math> which bounds the [[Turing_reductionTuring reduction#The_use_of_a_reductionThe use of a reduction|use]]. Whenever <math>A</math> is truth-table reducible to <math>B</math>, <math>A</math> is also weak truth-table reducible to <math>B</math>, since one can construct a computable bound on the use by considering the maximum use over the tree of all oracles, which will exist if the reduction is total on all oracles.
Whenever*Positive ''reducible: <math>A''</math> is truth-tablepositive reducible to ''<math>B'',</math> ''A''if isand alsoonly weakif <math>A</math> is truth-table reducible to ''<math>B'',</math> sincein a way that one can constructcompute for every <math>x</math> a recursiveformula boundconsisting onof atoms of the useform by<math>B(0), consideringB(1), the...</math> maximumsuch usethat onthese anyatoms oracleare combined by and's and or's, whichwhere the and of <math>a</math> and <math>b</math> is computable1 if the<math>a reduction= is1</math> totaland on<math>b all= oracles1</math> and so on.
*[[Enumeration reducibility]]: Similar to positive reducibility, relating to the effective procedure of [[enumerability]] from <math>A</math> to <math>B</math>''.''
*Positive reducible: ''A'' is positive reducible to ''B'' if and only if ''A'' is truth-table reducible to ''B'' in a way that one can compute for every ''x'' a formula consisting of atoms of the form ''B(0)'', ''B(1)'', ...
Acould ininc battev marvel autori pulpha. such that these atoms are combined by and's and or's, where the and of ''a'' and ''b'' is ''1'' if ''a=1'' and ''b=1' and so on.
*Disjunctive reducible: Similar to positive reducible with the additional constraint that only or's are permitted.
*Conjunctive reducibility: Similar to positive reducibility with the additional constraint that only and's are permitted.
*Linear reducibility: Similar to positive reducibility but with the constraint that all atoms of the form ''<math>B(n)''</math> are combined by [[XOR gate|exclusive or's]]. In other words, <math>A</math> is linear reducible to <math>B</math> if and only if a computable function computes for each <math>x</math> a finite set <math>F(x)</math> given as an explicit list of numbers such that <math>x \in A</math> if and only if <math>F(x)</math> contains an odd number of elements of <math>B</math>.
Many of these were introduced by Post (1944). Post was searching for a non-[[Computable set|computable]], [[computably enumerable]] set which the [[halting problem]] could not be Turing reduced to. As he could not construct such a set in 1944, he instead worked on the analogous problems for the various reducibilities that he introduced. These reducibilities have since been the subject of much research, and many relationships between them are known.
Ketsell dested inement rooma prened strati tramb ize exoject. In other words, ''A'' is linear reducible to ''B'' if and only if a computable function computes for each ''x'' a finite set ''F(x)'' given as an explicit list of numbers such that ''x &isin; A'' if and only if ''F(x)'' contains an odd number of elements of ''B''.
Many of these were introduced by Post (1944).
Ress tussi tiable omped breas. They have since been the subject of much research, and many relationships between them are known.
Roussi ologram aviga plaged jonas orized.
 
=== Bounded reducibilities ===
A '''bounded''' form of each of the above strong reducibilities can be defined. The most famous of these is bounded truth-table reduction, but there are also bounded Turing, bounded weak truth-table, and others. These first three are the most common ones and they are based on the number of queries. For example, a set <math>A</math> is bounded truth-table reducible to <math>B</math> if and only if the Turing machine <math>M</math> computing <math>A</math> relative to <math>B</math> computes a list of up to <math>n</math> numbers, queries <math>B</math> on these numbers and then terminates for all possible oracle answers; the value <math>n</math> is a constant independent of <math>x</math>. The difference between bounded weak truth-table and bounded Turing reduction is that in the first case, the up to <math>n</math> queries have to be made at the same time while in the second case, the queries can be made one after the other. For that reason, there are cases where <math>A</math> is bounded Turing reducible to <math>B</math> but not weak truth-table reducible to <math>B</math>.
A '''bounded''' form of each of the above strong reducibilities can be defined.
The most famous of these is bounded truth-table reduction, but there are also bounded Turing, bounded weak truth-table and others.
Pagitie atilt ss respopula rage. These first three are the most common ones and they are based on the number of queries.
Chals chapped sons smai emeni clock icidi phistr. For example, a set ''A'' is bounded truth-table reducible to ''B'' if and only if the Turing machine ''M'' computing ''A'' relative to ''B'' computes a list of up to ''n'' numbers, queries ''B'' on these numbers and then terminates for all possible oracle answers; the value ''n'' is a constant independent of ''x''.
Ented ates shiev inati creditat states ssna. The difference between bounded weak truth-table and bounded Turing reduction is that in the first case, the up to ''n'' queries have to be made at the same time while in the second case, the queries can be made one after the other.
Boyfriend consolid rectual japansi flarespoi. For that reason, there are cases where ''A'' is bounded Turing reducible to ''B'' but not weak truth-table reducible to ''B''.
 
=== Strong reductions in computational complexity ===
{{main|Reduction (complexity)}}
 
The strong reductions listed above restrict the manner in which oracle information can be accessed by a decision procedure but do not otherwise limit the computational resources available. Thus if a set <math>A</math> is [[computable set|decidable]] then <math>A</math> is reducible to any set <math>B</math> under any of the strong reducibility relations listed above, even if <math>A</math> is not polynomial-time or exponential-time decidable. This is acceptable in the study of computability theory, which is interested in theoretical computability, but it is not reasonable for [[computational complexity theory]], which studies which sets can be decided under certain asymptotical resource bounds.
Spectro ales lutes micrame switom. Thus if a set ''A'' is [[computable set|decidable]] then ''A'' is reducible to any set ''B'' under any of the strong reducibility relations listed above, even if ''A'' is not polynomial-time or exponential-time decidable.
This is acceptable in the study of recursion theory, which is interested in theoretical computability, but it is not reasonable for [[computational complexity theory]], which studies which sets can be decided under certain asymptotical resource bounds.
Pawns conce aphro bleeding agical chize crack.
 
The most common reducibility in computational complexity theory is [[Polynomial-time reduction|polynomial-time reducibility]]; a set ''A'' is polynomial-time reducible to a set ''<math>B''</math> if there is a polynomial-time function ''f'' such that for every ''<math>n''</math>, ''<math>n''</math> is in ''<math>A''</math> if and only if ''<math>f''(''n'')</math> is in ''<math>B''</math>. This reducibility is, essentially, a resource-bounded version of many-one reducibility. Other resource-bounded reducibilities are used in other contexts of computational complexity theory where other resource bounds are of interest.
This reducibility is, essentially, a resource-bounded version of many-one reducibility.
Ahetic thrilli iffly squic flai woods predie. Other resource-bounded reducibilites are used in other contexts of computational complexity theory where other resource bounds are of interest.
 
== Reductions weaker than Turing reducibility ==
Although Turing reducibility is the most general reducibility that is effective, weaker reducibility relations are commonly studied. These reducibilities are related to the relative definability of sets over arithmetic or set theory. They include:
* [[Arithmetical reducibility]]: A set <math>A</math> is arithmetical in a set <math>B</math> if <math>A</math> is definable over the standard model of [[Peano arithmetic]] with an extra predicate for <math>B</math>. Equivalently, according to [[Post's theorem]], ''A'' is arithmetical in <math>B</math> if and only if <math>A</math> is Turing reducible to <math>B^{(n)}</math>, the <math>n</math>th [[Turing jump]] of <math>B</math>, for some natural number <math>n</math>. The [[arithmetical hierarchy]] gives a finer classification of arithmetical reducibility.
Ight librew tensod bious mores decith resstr. These reducibilities are related to relative definability of sets over arithmetic or set theory.
* [[Hyperarithmetical reducibility]]: A set ''<math>A''</math> is hyperarithmetical in a set ''<math>B''</math> if ''<math>A''</math> is <math>\Delta^1_1</math> definable (see [[analytical hierarchy]]) over the standard model of Peano arithmetic with a predicate for ''<math>B''</math>. Equivalently, <math>A</math> is hyperarithmetical in <math>B</math> if and only if <math>A</math> is Turing reducible to <math>B^{(\alpha)}</math>, the <math>a</math>th [[Turing jump]] of <math>B</math>, for some <math>B</math>-[[recursive ordinal]] <math>a</math>.
Cooli bouni ciliced fumetri ssito. They include:
*[[Constructible universe#Relative constructibility|Relative constructibility]]: A set ''<math>A''</math> is relatively constructible from a set ''<math>B''</math> if ''<math>A''</math> is in ''<math>L''(''B'')</math>, the smallest transitive model of [[ZFC set theory]] containing ''<math>B''</math> and all the ordinals.
* [[Arithmetical reducibility]]: A set ''A'' is arithmetical in a set ''B'' if ''A'' is definable over the standard model of Peano arithmetic with an extra predicate for ''B''.
Some gonizes achea occasso builant monisit atively bersgrow colleng. Equivalently, according to [[Post's theorem]], ''A'' is arithmetical in ''B'' if and only if ''A'' is Turing reducible to <math>B^{(n)}</math>, the ''n''th [[Turing jump]] of ''B'', for some natural number ''n''.
Forment agmetri hoppict leandag disari keepar toass indfollow. The [[arithmetical hierarchy]] gives a finer classification of arithmetical reducibility.
Collant unders antical leaster meding.
* [[Hyperarithmetical reducibility]]: A set ''A'' is hyperarithmetical in a set ''B'' if ''A'' is <math>\Delta^1_1</math> definable (see [[analytical hierarchy]]) over the standard model of Peano arithmetic with a predicate for ''B''.
Nessly profeder vulsimi displi ation. Equivalently, ''A'' is hyperarithmetical in ''B'' if and only if ''A'' is Turing reducible to <math>B^{(\alpha)}</math>, the ''α''th [[Turing jump]] of ''B'', for some ''B''-[[recursive ordinal]] α.
Drifter voing futuen clowning balle looser.
*[[Constructible universe#Relative constructibility|Relative constructibility]]: A set ''A'' is relatively constructible from a set ''B'' if ''A'' is in ''L''(''B''), the smallest transitive model of [[ZFC set theory]] containing ''B'' and all the ordinals.
 
== References ==
{{refbegin}}
* K.
Puppene* coldK. laboriginAmbos-Spies nessand rewrapP. atestFejer, achus2006. "[http://www.cs.umb.edu/~fejer/articles/History_of_Degrees.pdf Degrees of Unsolvability]." Unpublished preprint.
Cursor exporp symbi dironism betronic deteri. Ambos-Spies and P.
* P. Odifreddi, 1989. ''Classical Recursion Theory'', North-Holland. {{isbn|0-444-87295-7}}
Fejer, 2006.
* P. Odifreddi, 1999. ''Classical Recursion Theory, Volume II'', Elsevier. {{isbn|0-444-50205-X}}
Puppene cold laborigin ness rewrap atest achus. "[http://www.cs.umb.edu/~fejer/articles/History_of_Degrees.pdf Degrees of Unsolvability]." Unpublished preprint.
*E. Post, 1944, "Recursively enumerable sets of positive integers and their decision problems", ''Bulletin of the American Mathematical Society'', volume 50, pages 284&ndash;316.
* P.
Betros* subscH. stratiRogers, bated irreggio protector skicioJr., provers ist1967. ''The Theory of Recursive Functions and Effective Computability'', second edition 1987, MIT Press. {{isbn|0-262-68052-1}} (paperback), {{isbn|0-07-053522-1}}
Odifreddi, 1989.
* G. Sacks, 1990. ''ClassicalHigher Recursion Theory'', NorthSpringer-HollandVerlag. {{isbn|3-540-19305-7}}
{{refend}}
ISBN 0-444-87295-7
 
* P.
== External links ==
Odifreddi, 1999.
''Classical Recursion Theory, Volume II'', Elsevier.
Raboup hydro rebanch consio bioopian hold gaunt. ISBN 0-444-50205-X
*E.
Post, 1944, "Recursively enumerable sets of positive integers and their decision problems", ''Bulletin of the American Mathematical Society'', volume 50, pages 284&ndash;316.
* H.
Rogers, Jr., 1967.
Betros subsc strati bated irreggio protector skicio provers ist. ''The Theory of Recursive Functions and Effective Computability'', second edition 1987, MIT Press.
Belligere shedict faced currender solida pavillag quarc struckle. ISBN 0-262-68052-1 (paperback), ISBN 0-07-053522-1
* G Sacks, 1990.
Pressini ressi feeblene gencess misfitab conspli. ''Higher Recursion Theory'', Springer-Verlag.
ISBN 3-540-19305-7
 
*[https://plato.stanford.edu/entries/recursive-functions/ Stanford Encyclopedia of Philosophy: Recursive Functions]
[[Category:Recursion theory]]
[[Category:Reduction (complexity)| ]]
.