Hybrid transactional/analytical processing: Difference between revisions

Content deleted Content added
m Removing link(s) Wikipedia:Articles for deletion/GridGain Systems closed as delete (XFDcloser)
filled bare url
 
(22 intermediate revisions by 15 users not shown)
Line 1:
{{short description|Application architecture by Gartner Inc.}}
{{Use dmy dates|date=October 2017}}
'''Hybrid transaction/analytical processing (HTAP),''' a term created by [[Gartner]] Inc. – an information technology research and advisory company, in its early 2014 research report ''Hybrid Transaction/Analytical Processing Will Foster Opportunities for Dramatic Business Innovation''.<ref name="Gartner 2014">{{cite web |title=Hybrid Transaction/Analytical Processing Will Foster Opportunities for Dramatic Business Innovation |website=Gartner |date=2014-01-28 |url=https://www.gartner.com/en/documents/2657815/hybrid-transaction-analytical-processing-will-foster-opp |access-date=2021-10-04}}</ref> As defined by Gartner: <blockquote>Hybrid transaction/analytical processing (HTAP) is an emerging application architecture that "breaks the wall" between transaction processing and analytics. It enables more informed and "in business real time" decision making.<ref>{{Cite web|url=https://www.gartner.com/doc/3599217/market-guide-htapenabling-inmemory-computing|title=Market Guide for HTAP-Enabling In-Memory Computing Technologies|website=www.gartner.com|access-date=2017-04-15}}</ref><ref name="Gartner 2014" /></blockquote>
 
{{Tone|date=December 2024}}
In more recent reports Gartner has begun referring to HTAP as "augmented transactions."<ref>{{Cite web|url=https://www.gartner.com/en/documents/3955768/hype-cycle-for-data-management-2019|title=Hype Cycle for Data Management, 2019|website=Gartner}}</ref> Another analyst firm [[Forrester Research]] calls the same concept "Translytical"<ref>{{Cite web|url=https://www.forrester.com/report/The-Forrester-Wave-Translytical-Data-Platforms-Q4-2019/RES144975|title=Forrester|website=Forrester}}</ref> while [[451 Group]] calls it "Hybrid operational and analytical processing" or HOAP.<ref>https://mariadb.com/wp-content/uploads/2020/09/enterprises-turn-to-hoap-for-oltp-workloads_analyst-report_1088.pdf</ref>
 
'''Hybrid transaction/analytical processing''' ('''HTAP),''') is a term created by [[Gartner]] Inc.]], an information technology research and advisory company, in its early 2014 research report ''Hybrid Transaction/Analytical Processing Will Foster Opportunities for Dramatic Business Innovation''.<ref name="Gartner 2014">{{cite web |title=Hybrid Transaction/Analytical Processing Will Foster Opportunities for Dramatic Business Innovation |website=Gartner |date=2014-01-28 |url=https://www.gartner.com/en/documents/2657815/hybrid-transaction-analytical-processing-will-foster-opp |access-date=2021-10-04}}</ref> As defined by Gartner: <blockquote>Hybrid transaction/analytical processing (HTAP) is an emerging application architecture that "breaks the wall" between transaction processing and analytics. It enables more informed and "in business real time" decision making.<ref>{{Cite web|url=https://www.gartner.com/doc/3599217/market-guide-htapenabling-inmemory-computing|title=Market Guide for HTAP-Enabling In-Memory Computing Technologies|website=www.gartner.com|access-date=2017-04-15|archive-date=17 May 2017|archive-url=https://web.archive.org/web/20170517023940/https://www.gartner.com/doc/3599217/market-guide-htapenabling-inmemory-computing|url-status=dead}}</ref><ref name="Gartner 2014" /></blockquote>
 
In more recent reports Gartner has begun referring to HTAP as "augmented transactions."<ref>{{Cite web|url=https://www.gartner.com/en/documents/3955768/hype-cycle-for-data-management-2019|title=Hype Cycle for Data Management, 2019|website=Gartner}}</ref> Another analyst firm [[Forrester Research]] calls the same concept "Translytical"<ref>{{Cite web|url=https://www.forrester.com/report/The-Forrester-Wave-Translytical-Data-Platforms-Q4-2019/RES144975|title=Forrester|website=Forrester}}</ref> while [[451 Group]] calls it "Hybrid operational and analytical processing" or HOAP.<ref>{{cite web | title=Enterprises Turn to Hybrid Operational and Analytical Processing for OLTP Workloads | website=mariadb.com | url=https://mariadb.com/wp-content/uploads/2020/09/enterprises-turn-to-hoap-for-oltp-workloads_analyst-report_1088.pdf | access-date=24 February 2025}}</ref>
 
==Background==
In the 1960s, computer use in the [[business sector]] began with payroll transactions and later included tasks in areas such as accounting and billing. At that time, users entered data, and the system [[batch processing|processed it at a later time]]. Further development of instantaneous data processing, or [[online transaction processing]] (OLTP), led to widespread OLTP use in government and business-sector information systems.<ref name=Bog>
Bog, Anja. [https://books.google.com/books?id=fV0NAAAAQBAJ&pg=PA7&lpg=PA7&dq=hybrid+transactional/analytical%2Fanalytical+processing&sou#vpg=onepage&q=hybrid%20transactional%2Fanalytical%20processing&f=falsePA7 ''Benchmarking Transaction and Analytical Processing Systems: The Creation of a Mixed Workload Benchmark and Its Application''] Springer-Verlage Berlin Heidelberg. 2014
</ref>
 
Line 12 ⟶ 16:
 
==HTAP advantages and challenges==
There are various interpretations of HTAP other than Gartner's original definition; an "emerging architecture". These interpretations suggest different advantages, one being a database functionality. Recent advances in research, hardware, OLTP and OLAP capabilities, [[In-memory database|in-memory]] and cloud native database technologies,<ref>{{Cite web|url=https://azure.microsoft.com/en-us/blog/azure-analytics-clarity-in-an-instant/|title=Azure Analytics: Clarity in an instant|website=azure.microsoft.com|date=19 May 2020 |access-date=2020-06-20}}</ref> scalable transactional management and products enable transactional processing and analytics, or HTAP, to operate on the same database.<ref name=Pezzini /><ref name="Wolpe">Wolpe, Toby. [httphttps://www.zdnet.com/article/sql-and-nosql-fine-but-how-does-the-hybrid-database-fit-in-7000029277/ "SQL and NoSQL? Fine, but how does the hybrid database fit in?"] ZDNet. 12 May 2014</ref><ref name=Bog />
 
However, Gartner's most recent reports suggest broader advantages than a single unified database can offer. Traditional application architectures separated transactional and analytical systems. Digital business, and the need to respond to business moments, means that using "after the fact" analysis is no longer adequate. Business moments are transient opportunities that must be exploited in real time. If an organization is unable to recognize and/or respond quickly to a business moment by taking fast and well-informed decisions, then some other organization will, resulting in a missed opportunity (or a new business threat). HTAP allows advanced analytics to be run in real time on "in flight" transaction data, providing an architecture that empowers users to respond more effectively to business moments.<ref>{{Cite web|url=https://www.gartner.com/doc/3352419/enable-digital-business-innovation-hybrid|title=How to Enable Digital Business Innovation via Hybrid Transaction/Analytical Processing|website=www.gartner.com|access-date=2017-04-15}}</ref>
Line 20 ⟶ 24:
HTAP solves the issue of analytic latency in several ways, including eliminating the need for multiple copies of the same data and the requirement for data to be offloaded from [[operational database]]s to [[data warehouse]]s via [[Extract, transform, load|ETL]] processes.<ref name="Pezzini" /><ref name="Wolpe" />
 
Most applications of HTAP are enabled by in-memory technologies that can process a high volume of transactions and offer features such as forecasting and simulations. New HTAP technologies use scalable transactional processing, and do not need to rely on keeping the whole database in-memory. HTAP has the potential to change the way organizations do business by offering immediate business decision-making capabilities based on live and sophisticated analytics of large volumes of data. Government and business leaders can be informed of real-time issues, outcomes, and trends that necessitate action, such as in the areas of public safety, risk management, and fraud detection.<ref name="Pezzini" /><ref name="Baer">Baer, Tony. [https://web.archive.org/web/20120418234408/http://www.zdnet.com/blog/big-data/fast-data-hits-the-big-data-fast-lane/309 "Fast Data hits the Big Data fast lane."] ZDNet. 16 April 2012</ref>
 
Some challenges for HTAP include limited industry experience and skills, as well as undefined best practices.<ref name=Pezzini />
 
In 2020, the first paper in the industry was published by the team of [[PingCAP]] describing the practical implementation of a distributed Hybrid Transactional/Analytical Processing (HTAP) database: [[TiDB]]: A Raft-based HTAP Database.<ref>{{Cite journal |title=TiDB: A Raft-based HTAP Database |url=https://www.vldb.org/pvldb/vol13/p3072-huang.pdf |journal=Proceedings of the VLDB Endowment |volume=13 |issue=12 |pages=3072 |doi=10.14778/3415478.3415535 |s2cid=221666363 |issn=2150-8097}}</ref>
HTAP functionality is offered by database companies, such as [[MariaDB]] Enterprise,<ref>{{Cite web|url=https://mariadb.org/columnstore-native/|title=ColumnStore Native Part of MariaDB 10.5|first=Kaj|last=Arnö|date=26 June 2020}}</ref> MariaDB SkySQL,<ref>{{Cite web|url=https://www.businesswire.com/news/home/20210107005475/en/MariaDB-Releases-New-R2DBC-Connector|title=MariaDB Releases New R2DBC Connector|date=7 January 2021|website=www.businesswire.com}}</ref> [[Microsoft Azure SQL Database]], [[Microsoft Azure]] Synapse Link<ref>{{Cite web|url=https://www.zdnet.com/article/a-closer-look-at-azure-synapse-link/|title=A closer look at Azure Synapse Link|website=www.zdnet.com|access-date=2017-04-15}}</ref> for [[Cosmos DB]], DbAlibaba DRDS, [[LeanXcale]],<ref>{{Cite web|url=https://www.bloorresearch.com/research/hybrid-real-time-data-processing/|title=Hybrid real-time data processing|last=Research.|first=Bloor|website=bloorresearch.com|language=en-us|access-date=2019-10-30}}</ref> [[TiDB]],<ref>{{Cite news|url=https://www.datanami.com/2018/02/22/hybrid-database-capturing-perishable-insights-yiguo/|title=The Hybrid Database Capturing Perishable Insights at Yiguo|date=2018-02-22|work=Datanami|access-date=2018-03-02|language=en-US}}</ref><ref>{{Cite news|url=https://www.infoworld.com/article/3313327/database/how-tidb-combines-oltp-and-olap-in-a-distributed-database.html|title=How TiDB combines OLTP and OLAP in a distributed database|last=Xu|first=Kevin|work=InfoWorld|access-date=2018-11-14|language=en}}</ref> Hubble, [[ArangoDB]], [[Aerospike (database)|Aerospike]], Apache Ignite/GridGain In-Memory Data Fabric, [[IBM]] [[IBM_Db2]] IDAA,<ref>{{Cite web|url=https://www-01.ibm.com/events/wwe/grp/grp004.nsf/vLookupPDFs/02%20-%20Dan%20Wardman%20%20-%20Real%20Time%20Analytics%20with%20IDAA%20and%20Big%20Data%20on%20System%20z/$file/02%20-%20Dan%20Wardman%20%20-%20Real%20Time%20Analytics%20with%20IDAA%20and%20Big%20Data%20on%20System%20z.pdf|title="Real Time Analytics with IDAA and Big Data on System z"}}</ref> [[InterSystems]],<ref>{{Cite web|url=https://www.gartner.com/reviews/market/operational-dbms|title=Operational Database Management Systems (ODBMS) Software Reviews|last=Inc.|first=Gartner|website=Gartner|language=en-us|access-date=2018-02-14}}</ref><ref>{{Cite journal|last=Gartner|date=12 Feb 2018|title=Critical Capabilities for Operational Database Management Systems|url=https://www.gartner.com/doc/3855663?ref=SiteSearch&sthkw=Critical%20Capabilities%20for%20Operational%20Database%20Management%20Systems&fnl=search&srcId=1-3478922254|journal=Gartner}}</ref> [[Kdb+]], [[Microsoft SQL Server]], [[Neo4j]], [[TigerGraph]], [[Oracle 12c In-Memory]],<ref name="oracle.com 2018">{{cite web |title=Leading-edge Database technology now available in all environments |website=oracle.com |url=https://www.oracle.com/corporate/pressrelease/oracle-database-avail-everywhere-030617.html |archive-url=https://web.archive.org/web/20180828115603/https://www.oracle.com/corporate/pressrelease/oracle-database-avail-everywhere-030617.html |archive-date=2018-08-28 |url-status=dead}}</ref> [[SAP HANA]],<ref>{{Cite web|url = http://www.cioreview.com/cxoinsight/internet-of-everything-and-hybrid-transactional-analytical-processing--nid-12929-cid-49.html|title = Internet of Everything and Hybrid Transactional Analytical Processing|last = Review|first = CIO|website = CIOReview|access-date = 2016-03-26}}</ref><ref>{{Cite web|url = https://www.gartner.com/doc/reprints?id=1-2OW5H99&ct=151005&st=sb|title = Gartner Reprint|website = www.gartner.com|access-date = 2016-03-26}}</ref> [[SingleStore]], [[MongoDB]], [[VoltDB]], [[NuoDB]], [[OrientDB]], [[DataStax]], [[eXtremeDB]], [[Splice Machine]],<ref>{{cite web |title=The Splice Machine Data Platform |url=https://splicemachine.com/product/data-platform/ |website=Splice Machine}}</ref> [[EsgynDB]], [[Spanner (database)|Cloud Spanner]], HarperDB, [[Amazon Aurora]] (Parallel Query), BlobCity, [[Couchbase]],<ref>{{Cite web|url=https://www.datanami.com/2018/09/20/couchbase-to-deliver-parallel-json-analytics-without-the-etl/|title=Couchbase to Deliver Parallel JSON Analytics -- Without the ETL|date=20 September 2018|website=Datanami}}</ref> [[YugabyteDB]]<ref>{{Cite web|url=https://docs.yugabyte.com/latest/faq/general/|title=FAQs about YugabyteDB &#124; YugabyteDB Docs|first=Team|last=Yugabyte|website=docs.yugabyte.com}}</ref> and PostgreSQL.
 
==References==
Line 30 ⟶ 34:
 
{{DEFAULTSORT:Hybrid Transactional Analytical Processing (HTAP)}}
[[Category:Business intelligence terms]]
[[Category:Types of databases]]