Parallelization contract: Difference between revisions

Revision as of 22:37, 11 May 2013

Revision as of 20:59, 18 May 2013

Line 1:

{{AFC submission|d|nn|declinets=20130518205911|decliner=SarahStierch|ts=20130511223731|u=72.200.84.87|ns=5}}

{{AFC submission|t||ts=20121107133024|u=Schubi87|ns=5}} <!--- Important, do not remove this line before article has been created. --->

*{{afc comment|1=Both of the papers cited have overlaps in the authors. [[User:SarahStierch|SarahStierch]] ([[User talk:SarahStierch|talk]]) 20:59, 18 May 2013 (UTC)}}

----

The '''parallelization contract programming model''' is a generalization of the [[MapReduce]] [[programming model]] and uses [[Higher-order_function|second order functions]] to perform concurrent computations on large ([[Petabyte]]s) data sets in parallel.

== Overview ==

The '''parallelization contract programming model''' is a generalization of the [[MapReduce]] [[programming model]] and uses [[Higher-order_function|second order functions]] to perform concurrent computations on large ([[Petabyte]]s) data sets in parallel.

== Overview ==

Similar to MapReduce, arbitrary user code is handed and executed by PACTs. However, PACT generalizes a couple of MapReduce's concepts:

* Second-order Functions: PACT provides more second-order functions. Currently, five second-order functions called '''Input Contracts''' are supported. This set might be extended in the future.

Line 27 ⟶ 26:

The currently supported Input Contracts and annotation are presented and discussed in the following.

==== Input Contracts ====

Input Contracts split the input data of a PACT into independently processable subsets that are handed to the user function of the PACT.

Line 105 ⟶ 104:

For a more detailed comparison of the MapReduce and PACT programming models you can read our paper //"MapReduce and PACT - Comparing Data Parallel Programming Models"// (see our [[https://www.stratosphere.eu/index.php?q=publications|publications page]]).

== See also ==

==References==

== References ==

{{reflist}}

<!--- After listing your sources please cite them using inline citations and place them after the information they cite. Please see http://en.wikipedia.org/wiki/Wikipedia:REFB for instructions on how to add citations. --->

*

*

Line 115 ⟶ 119:

* [http://stratosphere.eu/files/NephelePACTs_10.pdf "Nephele/PACTs: A Programming Model and Execution Framework for Web-Scale Analytical Processing"] -- paper by D. Battré, S. Ewen, F. Hueske, O. Kao, V. Markl, and D. Warneke from [http://www.tu-berlin.de/menue/home/parameter/en/ TU Berlin] published in Proc. of ACM SoCC 2010. The paper introduces the PACT programming model, a generalization of MapReduce, developed in the [http://www.stratosphere.eu Stratosphere] research project.

* [http://stratosphere.eu/files/ComparingMapReduceAndPACTs_11.pdf "MapReduce and PACT - Comparing Data Parallel Programming Models"] -- paper by A. Alexandrov, S. Ewen, M. Heimel, F. Hueske, O. Kao, V. Markl, E. Nijkamp, and D. Warneke from [http://www.tu-berlin.de/menue/home/parameter/en/ TU Berlin] published in Proc. of BTW 2011.

== External links ==

* Stratosphere project home page

* Video Lecture [http://www.tele-task.de/de/archive/lecturer/1853/ Parallel Dataflow Programming]

== dhjkkddggj ==

<!-- This will add a notice to the bottom of the page and won't blank it! The new template which says that your draft is waiting for a review will appear at the bottom; simply ignore the old (grey) drafted templates and the old (red) decline templates. A bot will update your article submission. Until then, please don't change anything in this text box and press "Save page". -->

{{AFC submission|||ts=20130511223731|u=72.200.84.87|ns=5}}