Supermodular function: Difference between revisions

Revision as of 20:05, 8 February 2023

Latest revision as of 01:51, 24 May 2025

(7 intermediate revisions by 5 users not shown)

Line 1:

{{Short description|MathematicalClass functionof classmathematical functions}}

In mathematics, a '''supermodular function''' is a function on a [[Lattice (order)|lattice]] that, informally, has the property of being characterized by "increasing differences." Seen from the point of [[Set function|set functions]], this can also be viewed as a relationship of "increasing returns", where adding more elements to a subset increases its valuation. In [[economics]], supermodular functions are often used as a formal expression of complementarity in preferences among goods. Supermodular functions are studied and have applications in [[game theory]], [[economics]], [[Lattice (order)|lattice theory]], [[combinatorial optimization]], and [[machine learning]].

In [[mathematics]], a function

:<math>f\colon \mathbb{R}^k \to \mathbb{R}</math>

== Definition ==

is '''supermodular''' if

Let <math>(X, \preceq)</math> be a [[Lattice (order)|lattice]]. A real-valued function <math>f: X \rightarrow \mathbb{R}</math> is called '''supermodular''' if

:<math>

:<math> f(Ax \vee y) + f(Bx \wedge y) \geq f(A \cap Bx) + f(A \cup By) </math>

for all <math>x, y \in X</math>.<ref>{{Cite book |title=Supermodularity and complementarity |date=1998 |publisher=Princeton University Press |isbn=978-0-691-03244-3 |editor-last=Topkis |editor-first=Donald M. |series=Frontiers of economic research |___location=Princeton, N.J}}</ref>

If the inequality is strict, then <math>f</math> is '''strictly supermodular''' on <math>X</math>. If <math>-f</math> is (strictly) supermodular then ''f'' is called ('''strictly) submodular'''. A function that is both submodular and supermodular is called '''modular'''. This corresponds to the inequality being changed to an equality.

We can also define supermodular functions where the underlying lattice is the vector space <math>\mathbb{R}^n</math>. Then the function <math>f : \mathbb{R}^n \to \mathbb{R}</math> is '''supermodular''' if

:<math>

f(x \uparrow y) + f(x \downarrow y) \geq f(x) + f(y)

</math>

for all <math>x</math>, <math>y \isin \mathbb{R}^{k}</math>, where <math>x \uparrow y</math> denotes the componentwise maximum and <math>x \downarrow y</math> the componentwise minimum of <math>x</math> and <math>y</math>.

for all <math>x</math>, <math>y \isin \mathbb{R}^{kn}</math>, where <math>x \uparrow y</math> denotes the componentwise maximum and <math>x \downarrow y</math> the componentwise minimum of <math>x</math> and <math>y</math>.

If &minus;''f'' is supermodular then ''f'' is called '''submodular''', and if the inequality is changed to an equality the function is '''modular'''.

If ''f'' is twice continuously differentiable, then supermodularity is equivalent to the condition<ref>The equivalence between the definition of supermodularity and its calculus formulation is sometimes called [[Topkis's theorem|Topkis' characterization theorem]]. See {{cite journal |first1=Paul |last1=Milgrom |first2=John |last2=Roberts |year=1990 |title=Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities |journal=[[Econometrica]] |volume=58 |issue=6 |pages=1255–1277 [p. 1261] |jstor=2938316 |doi=10.2307/2938316 }}</ref>

Line 25 ⟶ 33:

A supermodular [[utility function]] is often related to [[complementary goods]]. However, this view is disputed.<ref>{{Cite journal|doi=10.1016/j.jet.2008.06.004 |title=Supermodularity and preferences |journal=[[Journal of Economic Theory]] |volume=144 |issue=3 |pages=1004 |year=2009 |last1=Chambers |first1=Christopher P. |last2=Echenique |first2=Federico |citeseerx=10.1.1.122.6861 }}</ref>

==SubmodularSupermodular set functions of subsets==

Supermodularity andcan submodularityalso are alsobe defined for [[Set function|set functions]], which are functions defined over subsets of a larger set. Many Intuitively,properties aof submodular[[Submodular set function|submodular overset thefunctions]] subsetscan demonstratesbe "diminishingrephrased returns".to apply Thereto aresupermodular specialized techniques for optimizing submodularset functions.

Intuitively, a supermodular function over a set of subsets demonstrates "increasing returns". This means that if each subset is assigned a real number that corresponds to its value, the value of a subset will always be less than the value of a larger subset which contains it. Alternatively, this means that as we add elements to a set, we increase its value.

=== Definition ===

Let <math>S</math> be a finite set. A set function <math>f: 2^S \to \mathbb{R}</math> is '''supermodular''' if it satifies the following (equivalent) conditions:<ref>{{Citation |last=McCormick |first=S. Thomas |title=Discrete Optimization |chapter=Submodular Function Minimization |date=2005 |series=Handbooks in Operations Research and Management Science |volume=12 |pages=321–391 |chapter-url=https://linkinghub.elsevier.com/retrieve/pii/S0927050705120076 |access-date=2024-12-12 |publisher=Elsevier |language=en |doi=10.1016/s0927-0507(05)12007-6 |isbn=978-0-444-51507-0}}</ref>

# <math> f(A)+f(B) \leq f(A \cap B) + f(A \cup B) </math> for all <math> A, B \subseteq S </math>.

# <math> f(A \cup \{v\}) - f(A) \leq f(B \cup \{v\}) - f(B) </math> for all <math> A \subset B \subset V </math>, where <math> v \notin B </math>.

A set function <math>f</math> is submodular if <math>-f</math> is supermodular, and modular if it is both supermodular and submodular.

=== Additional Facts ===

Let ''S'' be a finite set. A function <math>f\colon 2^S \to \mathbb{R}</math> is submodular if for any <math>A \subset B \subset S</math> and <math>x \in S \setminus B</math>, <math>f(A \cup \{x\})-f(A) \geq f(B \cup \{x\})-f(B)</math>. For supermodularity, the inequality is reversed.

<!--

A simple illustrative example motivates this definition of submodular. Let S be a set of different foods, <math>M \subset S</math> a meal, and <math>f(M)</math> the "goodness" of that meal. Then A above is one meal, and B is A but with even more options. Let x be ice cream. Adding ice cream to a meal is always good, but it is best if there is not already a dessert. If A and B either both have a dessert or both do not, then adding ice cream to them is comparably good. But if A does not have dessert and B does, then the effect of adding ice cream is more pronounced in A.

-->

* If <math> f </math> is modular and <math> g </math> is submodular, then <math> f-g </math> is a supermodular function.

The definition of submodularity can equivalently be formulated as

* A non-negative supermodular function is also a superadditive function.

:<math> f(A)+f(B) \geq f(A \cap B) + f(A \cup B) </math>

for all subsets ''A'' and ''B'' of ''S''.

== Optimization Techniques ==

Theory and enumeration algorithms for finding local and global maxima (minima) of submodular (supermodular) functions can be found in B. Goldengorin. European Journal of Operational Research 198(1):102-112, DOI: 10.1016/j.ejor.2008.08.022

There are specialized techniques for optimizing submodular functions. Theory and enumeration algorithms for finding local and global maxima (minima) of submodular (supermodular) functions can be found in "Maximization of submodular functions: Theory and enumeration algorithms", B. Goldengorin.<ref>{{Cite journal |last=Goldengorin |first=Boris |date=2009-10-01 |title=Maximization of submodular functions: Theory and enumeration algorithms |url=https://www.sciencedirect.com/science/article/pii/S0377221708007418 |journal=European Journal of Operational Research |language=en |volume=198 |issue=1 |pages=102–112 |doi=10.1016/j.ejor.2008.08.022 |issn=0377-2217|url-access=subscription }}</ref>

==See also==