Data loading: Difference between revisions

Revision as of 12:09, 10 February 2024

Latest revision as of 14:02, 29 November 2024

(5 intermediate revisions by 4 users not shown)

Line 21:

=== Tricle feed ===

Tricle feed or trickle loading means that when the source system is updated, the changes in the target system will occur almost immediately.<ref>{{Cite encyclopedia |titlechapter=Near Real-Time Data Warehousing with Multi-stage Trickle and Flip |publisher=Springer Berlin Heidelberg |chapter-url=http://link.springer.com/10.1007/978-3-642-24511-4_6 |date=2011 |volume=90 |pages=73–82 |doi=10.1007/978-3-642-24511-4_6, |author="zutersZuters, janis",Janis editor|editor1="grabisGrabis, janisJanis and kirikova|editor2=Kirikova, marite",Marite |title="near real-time data warehousing with multi-stage trickle and flip", booktitle="perspectivesPerspectives in businessBusiness informaticsInformatics research",Research year|series="2011",Lecture publisher="springerNotes berlinin heidelberg",Business address="berlin,Information heidelberg",Processing pages="73--82", abstract|quote="a data warehouse typically is a collection of historical data designed for decision support, so it is updated from the sources periodically, mostly on a daily basis. today's business however asks for fresher data. real-time warehousing is one of the trends to accomplish this, but there are a number of challenges to move towards true real-time. this paper proposes `'multi-stage trickle {\&}and flip' methodology for data warehouse refreshment. it is based on the `'trickle {\&}and flip' principle and extended in order to further insulate loading and querying activities, thus enabling both of them to be more efficient.", isbn="978-3-642-24511-4" } |isbn=978-3-642-24510-7}}</ref><ref>{{Cite web |title=Trickle Loading Data |url=https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/AdministratorsGuide/TrickleLoading/TrickleLoadingData.htm |access-date=2023-02-18}}</ref>

== Loading to systems that are in use ==

{{main|Real-time computing}}

When loading data into a system that is currently in use by users or other systems, one must decide when the system should be updated and what will happen to tables that are in use at the same time as the system is to be updated. One possible solution is to make use of [[Shadow table|shadow tables]].<ref>{{Cite web |title=Create shadow tables for synchronization - Data Management - Alibaba Cloud Documentation Center |url=https://www.alibabacloud.com/help/en/data-management-service/latest/synchronize-shadow-tables |access-date=2023-02-18}}</ref><ref>{{Cite web |date=2015-08-10 |title=Shadow tables |website=[[IBM]] |url=https://www.ibm.com/docs/en/db2/10.5?topic=tables-shadow |access-date=2023-02-18 |language=en-us}}</ref>

== See also ==

* [[Database]]

* [[Data warehouse]]

== References ==

<references/>

{{Data warehouse}}

[[Category:Extract, transform, load tools]]