In-memory processing: Difference between revisions

Revision as of 10:53, 23 December 2023

Latest revision as of 13:08, 26 August 2025

(14 intermediate revisions by 9 users not shown)

Line 1:

{{Short description|Processing data technology}}

{{advert|date=November 2018}}

{{cleanup rewrite|date=January 2020}}

The term is used for two different things:

# In [[computer science]], '''in-memory processing''', also called '''compute-in-memory''' (CIM), or '''processing-in-memory''' (PIM), is a [[computer architecture]] in which data operations are available directly on the data memory, rather than having to be transferred to [[Central processing unit|CPU]] registers first.<ref>{{Cite journal |last=Ghose |first=S. |date=November 2019 |title=Processing-in-memory: A workload-driven perspective |url=https://www.pdl.cmu.edu/PDL-FTP/associated/19ibmjrd_pim.pdf |journal=IBM Journal of Research and Development |volume=63 |issue=6 |pages=3:1–19|doi=10.1147/JRD.2019.2934048 |s2cid=202025511 }}</ref> This may improve the [[Electric power|power usage]] and [[Computer performance|performance]] of moving data between the processor and the main memory.

# In [[software engineering]], '''in-memory processing''' is a [[software architecture]] where a database is kept entirely in [[random-access memory]] (RAM) or [[flash memory]] so that usual accessaccesses, in particular read andor joinquery operations, doesdo not require access to [[disk storage]].<ref>{{cite journal|first=Hao|last=Zhang|author2=Gang Chen|author3=Beng Chin Ooi|author4=Kian-Lee Tan|author5=Meihui Zhang|title=In-Memory Big Data Management and Processing: A Survey|journal=IEEE Transactions on Knowledge and Data Engineering|date=July 2015|volume=27|issue=7|pages=1920–1948|doi=10.1109/TKDE.2015.2427795|bibcode=2015ITKDE..27.1920Z |doi-access=free}}</ref> This may allow faster data operations such as "joins", and faster reporting and decision-making in business.<ref>{{cite book|last1=Plattner|first1=Hasso|last2=Zeier|first2=Alexander|title=In-Memory Data Management: Technology and Applications|date=2012|publisher=Springer Science & Business Media|isbn=9783642295744|url=https://books.google.com/books?id=HySCgzCApsEC&q=%22in-memory%22|language=en}}</ref>

Extremely large datasets may be divided between co-operating systems as in-memory [[data grid]]s.

==Hardware (PIM)==

PIM could be implemented by:<ref>{{cite web |title=Processing-in-Memory Course: Lecture 1: Exploring the PIM Paradigm for Future Systems - Spring 2022 | website=[[YouTube]] | date=10 March 2022 |url=https://www.youtube.com/watch?v=R-sEqnOmDT4 |language=en}}</ref>

* Processing-using-Memory (PuM)

** Adding limited processing capability (e.g., floating point multiplication units, 4K row operations such as copy or zero, bitwise operations on two rows) to conventional memory modules (e.g., DIMM modules); or

** Adding processing capability to memory controllers so that the data that is accessed does not need to be forwarded to the CPU or affect the CPU' cache, but is dealt with immediately.

* Processing-near-Memory (PnM)

** New 3D arrangements of silicon with memory layers and processing layers.

=== Application of in-memory technology in everyday life ===

In-memory processing techniques are frequently used by modern smartphones and tablets to improve application performance. This can result in speedier app loading times and more enjoyable user experiences.

In-memory processing techniques are frequently used by modern smartphones and tablets to improve application performance. This can result in speedier app loading times and more enjoyable user experiences. In-memory processing may be used by gaming consoles such as the [[PlayStation]] and [[Xbox]] to improve game speed.<ref>{{Cite web |last=Park |first=Kate |date=2023-07-27 |title=Samsung extends cut in memory chip production, will focus on high-end AI chips instead |url=https://techcrunch.com/2023/07/27/samsung-extends-cut-in-memory-chip-production-will-focus-on-high-end-ai-chips-instead/ |access-date=2023-12-05 |website=TechCrunch |language=en-US}}</ref> Rapid data access is critical for providing a smooth game experience. Certain wearable devices, like smartwatches and fitness trackers, may incorporate in-memory processing to swiftly process sensor data and provide real-time feedback to users. Several commonplace gadgets use in-memory processing to improve performance and responsiveness<ref>{{Cite journal |last1=Tan |first1=Kian-Lee |last2=Cai |first2=Qingchao |last3=Ooi |first3=Beng Chin |last4=Wong |first4=Weng-Fai |last5=Yao |first5=Chang |last6=Zhang |first6=Hao |date=2015-08-12 |title=In-memory Databases: Challenges and Opportunities From Software and Hardware Perspectives |url=https://doi.org/10.1145/2814710.2814717 |journal=ACM SIGMOD Record |volume=44 |issue=2 |pages=35–40 |doi=10.1145/2814710.2814717 |s2cid=14238437 |issn=0163-5808}}</ref>.In-memory processing is used by smart TVs to enhance interface navigation and content delivery. It is used in digital cameras for real-time image processing, filtering, and effects.<ref>{{Cite book |chapter-url=https://ieeexplore.ieee.org/document/9937475 |access-date=2023-12-05 |doi=10.1109/ISCAS48785.2022.9937475 |s2cid=253462291 |chapter=Approximate In-Memory Computing using Memristive IMPLY Logic and its Application to Image Processing |title=2022 IEEE International Symposium on Circuits and Systems (ISCAS) |date=2022 |last1=Fatemieh |first1=Seyed Erfan |last2=Reshadinezhad |first2=Mohammad Reza |last3=Taherinejad |first3=Nima |pages=3115–3119 |isbn=978-1-6654-8485-5 }}</ref> Voice-activated assistants and other home automation systems may benefit from faster understanding and response to user orders. In-memory processing is also used by embedded systems in appliances and high-end digital cameras for efficient data handling. Through in-memory processing techniques, certain IoT devices prioritize fast data processing and response times.<ref>{{Cite web |title=What is processing in memory (PIM) and how does it work? |url=https://www.techtarget.com/searchbusinessanalytics/definition/processing-in-memory-PIM |access-date=2023-12-05 |website=Business Analytics |language=en}}</ref>

* In-memory processing may be used by gaming consoles such as the [[PlayStation]] and [[Xbox]] to improve game speed.<ref>{{Cite web |last=Park |first=Kate |date=2023-07-27 |title=Samsung extends cut in memory chip production, will focus on high-end AI chips instead |url=https://techcrunch.com/2023/07/27/samsung-extends-cut-in-memory-chip-production-will-focus-on-high-end-ai-chips-instead/ |access-date=2023-12-05 |website=TechCrunch |language=en-US}}</ref>{{Failed verification|date=July 2024}} Rapid data access is critical for providing a smooth game experience.

* Certain wearable devices, like smartwatches and fitness trackers, may incorporate in-memory processing to swiftly process sensor data and provide real-time feedback to users. Several commonplace gadgets use in-memory processing to improve performance and responsiveness.<ref>{{Cite journal |last1=Tan |first1=Kian-Lee |last2=Cai |first2=Qingchao |last3=Ooi |first3=Beng Chin |last4=Wong |first4=Weng-Fai |last5=Yao |first5=Chang |last6=Zhang |first6=Hao |date=2015-08-12 |title=In-memory Databases: Challenges and Opportunities From Software and Hardware Perspectives |url=https://doi.org/10.1145/2814710.2814717 |journal=ACM SIGMOD Record |volume=44 |issue=2 |pages=35–40 |doi=10.1145/2814710.2814717 |s2cid=14238437 |issn=0163-5808|url-access=subscription }}</ref>

* In-memory processing is used by smart TVs to enhance interface navigation and content delivery. It is used in digital cameras for real-time image processing, filtering, and effects.<ref>{{Cite book |doi=10.1109/ISCAS48785.2022.9937475 |s2cid=253462291 |chapter=Approximate In-Memory Computing using Memristive IMPLY Logic and its Application to Image Processing |title=2022 IEEE International Symposium on Circuits and Systems (ISCAS) |date=2022 |last1=Fatemieh |first1=Seyed Erfan |last2=Reshadinezhad |first2=Mohammad Reza |last3=Taherinejad |first3=Nima |pages=3115–3119 |isbn=978-1-6654-8485-5 }}</ref> Voice-activated assistants and other home automation systems may benefit from faster understanding and response to user orders.

* In-memory processing is also used by embedded systems in appliances and high-end digital cameras for efficient data handling. Through in-memory processing techniques, certain IoT devices prioritize fast data processing and response times.<ref>{{Cite web |title=What is processing in memory (PIM) and how does it work? |url=https://www.techtarget.com/searchbusinessanalytics/definition/processing-in-memory-PIM |access-date=2023-12-05 |website=Business Analytics |language=en}}</ref>

==Software==