Data transformation (computing): Difference between revisions

Revision as of 20:54, 16 February 2023

Revision as of 21:06, 16 February 2023

Line 84:

Additionally, companies such as Trifacta and Paxata have developed ___domain-specific transformational languages (DSL) for servicing and transforming datasets. The development of ___domain-specific languages has been linked to increased productivity and accessibility for non-technical users.<ref>{{Cite web|url=https://docs.trifacta.com/display/PE/Wrangle+Language|title=Wrangle Language - Trifacta Wrangler - Trifacta Documentation|website=docs.trifacta.com|access-date=2017-09-20}}</ref> Trifacta's “Wrangle” is an example of such a ___domain specific language.<ref name=":0">{{Cite web|url=https://conferences.oreilly.com/strata/stratany2014/public/schedule/detail/36612|title=Advantages of a Domain-Specific Language Approach to Data Transformation - Strata + Hadoop World in New York 2014|last=Kandel|first=Joe Hellerstein, Sean|website=conferences.oreilly.com|access-date=2017-09-20}}</ref>

Another advantage of the recent DSL___domain-specific transformational languages trend is that a DSL___domain-specific transformational language can abstract the underlying execution of the logic defined in the DSL,___domain-specific buttransformational language. itThey can also utilize that same logic in various processing engines, such as [[SPARK (programming language)|Spark]], [[MapReduce]], and [[Microsoft Dataflow|Dataflow]]. WithIn other words, with a DSL___domain-specific transformational language, the transformation language is not tied to the underlying engine.<ref name=":0" />

Although transformational languages are typically best suited for transformation, something as simple as [[regular expressionsexpression]]s can be used to achieve useful transformation. A [[text editor]] like [[vim (text editor)|vim]], [[emacs]] or [[Textpad|TextPad]] supports the use of regular expressions with arguments. This would allow all instances of a particular pattern to be replaced with another pattern using parts of the original pattern. For example:

<pre>

foo ("some string", 42, gCommon);