Deep Learning Super Sampling: Difference between revisions

Revision as of 13:17, 31 January 2025

Revision as of 13:20, 31 January 2025

Line 33:

|4.0

|January 2025

|DLSS 4.0 adds multiMulti-frameFrame generationGeneration, new AI-model based on the [[Transformer (deep learning architecture)|transformer architecture]], improving frame stability, reduced memory usage, and increased lighting detail.<ref name=":6" /><ref>{{Cite web |last=Khan |first=Sarfraz |date=2025-01-14 |title=NVIDIA Confirms Updated DLSS Frame Generation On RTX 40 GPUs, Leads to Lower VRAM Usage & Faster Performance |url=https://wccftech.com/nvidia-dlss-frame-generation-rtx-40-gpus-new-ai-model-faster-lower-vram-requirement/ |access-date=2025-01-14 |website=Wccftech |language=en-US}}</ref>

|}

Line 99:

=== DLSS 3.0 ===

Augments DLSS 2.0 by making use of [[motion interpolation]]. The DLSS frameFrame generationGeneration algorithm takes two rendered frames from the rendering pipeline and generates a new frame that smoothly transitions between them. So for every frame rendered, one additional frame is generated.<ref name=":3" /> DLSS 3.0 makes use of a new generation Optical Flow Accelerator (OFA) included in Ada Lovelace generation RTX GPUs. The new OFA is faster and more accurate than the OFA already available in previous Turing and Ampere RTX GPUs.<ref>{{Cite web |date=2018-11-29 |title=NVIDIA Optical Flow SDK |url=https://developer.nvidia.com/opticalflow-sdk |access-date=2022-09-20 |website=NVIDIA Developer |language=en}}</ref> This results in DLSS 3.0 being exclusive for the RTX 40 Series. At release, DLSS 3.0 does not work for VR displays.{{cn|date=May 2023}}

=== DLSS 3.5 ===

Line 105:

=== DLSS 4.0 ===

The fourth generation of [[Deep Learning Super Sampling]] (DLSS) was unveiled alongside the [[GeForce 50 series]]. DLSS 4 upscaling uses a new vision [[Transformer (deep learning architecture)|transformer]]-based model for enhanced image quality with reduced ghosting and greater image stability in motion compared to the previous [[convolutional neural network]] (CNN) model.<ref>{{cite web |last1=Leadbetter |first1=Richard |date=January 7, 2025 |title=Hands-on with DLSS 4 on Nvidia's new GeForce RTX 5080 |url=https://www.eurogamer.net/digitalfoundry-2025-hands-on-with-dlss-4-on-nvidias-new-geforce-rtx-5080 |website=Eurogamer |language=en-GB |access-date=January 7, 2025}}</ref> DLSS 4 allows a greater number of frames to be generated and [[Frame interpolation|interpolated]] based on a single traditionally rendered frame. This form of frame generation called Multi-Frame Generation is exclusive to the GeForce 50 series while the [[GeForce 40 series]] is limited to one interpolated frame per traditionally rendered frame. According to Nvidia, this technique will increase performance by up to 800% while retaining low latency with [[Nvidia Reflex]].<ref name=":62">{{Cite web |title=NVIDIA Blackwell GeForce RTX 50 Series Opens New World of AI Computer Graphics |url=https://nvidianews.nvidia.com/news/nvidia-blackwell-geforce-rtx-50-series-opens-new-world-of-ai-computer-graphics |access-date=2025-01-07 |website=NVIDIA Newsroom |language=en-us}}</ref> Nvidia claims that DLSS 4's4x frameFrame generationGeneration model uses 30% less video memory with the example of ''[[Warhammer 40,000: Darktide]]'' using 400MB less memory at 4K resolution with frameFrame generationGeneration enabled.<ref>{{cite web |last1=Lin |first1=Henry |last2=Burnes |first2=Andrew |date=January 6, 2025 |title=Nvidia DLSS 4 Introduces Multi Frame Generation & Enhancements For All DLSS Technologies |url=https://www.nvidia.com/en-us/geforce/news/dlss4-multi-frame-generation-ai-innovations/ |website=Nvidia |language=en-US |access-date=January 7, 2025}}</ref> Nvidia claims that 75 games will integrate DLSS 4 Multi-Frame Generation at launch, including ''[[Alan Wake 2]]'', ''[[Cyberpunk 2077]]'', ''[[Indiana Jones and the Great Circle]]'', and ''[[Star Wars Outlaws]]''.<ref>{{cite web |last1=Mujtaba |first1=Hassan |date=January 6, 2025 |title=Nvidia DLSS 4 Delivers An Insane 8x Performance Boost Versus DLSS 3 With Multi Frame Generation Technology, Enhanced Upscaling For RTX 20 & Above |url=https://wccftech.com/nvidia-dlss-4-8x-faster-dlss-3-multi-frame-generation-enhanced-upscaling-rtx-20-above/ |website=Wccftech |language=en-US |access-date=January 7, 2025}}</ref>

{| class="wikitable plainrowheaders" style="text-align:left; font-size:90%;

Line 137:

=== Manually upgrading DLSS support ===

Users can manually replace the [[Dynamic-link library|DLLs]] in games to support a newer version of DLSS. DLSS Swapper, an [[open source]] utility, can automatically do this for all installed games.<ref>{{cite web|url=https://www.pcgamer.com/hardware/this-open-source-tool-updates-dlss-to-the-latest-version-in-all-your-games-at-once-and-no-matter-the-launcher/|title=This open source tool updates DLSS to the latest version in all your games at once and no matter the launcher|last=Edser|first=Andy|work=[[PC Gamer]]|date=2024-08-30|accessdate=2025-01-28}}</ref> Replacing DLL files can not add DLSS support or features to games that do not already implement them, though some [[Video game modding|mods]] can add frame generation support.<ref>{{cite web|url=https://www.tomshardware.com/pc-components/gpus/dlss-swapper-now-updates-fsr-xess-and-dlss-too-supports-all-major-upscaling-frame-gen-technologies|title=DLSS Swapper now updates FSR, XeSS, and DLSS, too — Supports all major upscaling/frame gen technologies|last=Nasir|first=Hassam|work=[[Tom's Hardware]]|date=2025-01-27|accessdate=2025-01-28}}</ref>

== Anti-aliasing ==

Line 149:

Particularly in early versions of DLSS, users reported blurry frames. Andrew Edelsten, an employee at Nvidia, therefore commented on the problem in a blog post in 2019 and promised that they were working on improving the technology and clarified that the DLSS AI algorithm was mainly trained with 4K image material. That the use of DLSS leads to particularly blurred images at lower resolutions, such as [[Full HD]], is due to the fact that the algorithm has far less image information available to calculate an appropriate image compared to higher resolutions like 4K.<ref>{{Cite web |title=NVIDIA DLSS: Your Questions, Answered |url=https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-your-questions-answered/ |access-date=2024-07-09 |publisher=Nvidia |language=en-us}}</ref>

The use of DLSS frameFrame generationGeneration may lead to increased [[input latency]],<ref>{{Cite web |date=2023-11-21 |title=When a high frame rate can lose you the game |url=https://www.digitaltrends.com/computing/when-frames-dont-win-games/ |access-date=2024-07-09 |website=Digital Trends |language=en}}</ref> as well as [[visual artifacts]].<ref>{{Cite web |date=2023-03-08 |title=Nvidia DLSS 3 Revisit: We Try It Out in 9 Games |url=https://www.techspot.com/article/2639-dlss-3-revisit/ |access-date=2024-07-09 |website=TechSpot |language=en-US}}</ref> It has also been criticized that by implementing DLSS in their games, game developers no longer have an incentive to optimize them so that they also run smoothly in native resolution on modern PC hardware. For example, for the game ''[[Alan Wake 2]]'' in [[4K resolution]] at the highest graphics settings with [[Ray tracing (graphics)|ray tracing]] enabled, the use of DLSS in Performance mode is recommended even with graphics cards such as the [[Nvidia GeForce RTX 4080]] in order to achieve 60 fps.<ref>{{Cite web |date=2023-10-26 |title=Alan Wake 2 on PC is an embarrassment of riches |url=https://www.digitaltrends.com/computing/alan-wake-2-pc-performance/ |access-date=2024-07-09 |website=Digital Trends |language=en}}</ref>

The transformer-based AI updcaling model introduced with DLSS 4 received praise for its improved image quality with regard to increased stability, reduced ghosting, better anti-aliasing, and higher level of detail, as well as its backward compatability and higher training scalability regarding future improvements.<ref>{{Cite news |title=NVIDIA DLSS 4 Transformer Review - Better Image Quality for Everyone |url=https://www.techpowerup.com/review/nvidia-dlss-4-transformers-image-quality/ |archive-url=http://web.archive.org/web/20250128024629/https://www.techpowerup.com/review/nvidia-dlss-4-transformers-image-quality/ |archive-date=2025-01-28 |access-date=2025-01-31 |work=TechPowerUp |language=en}}</ref><ref>{{Cite web |last=Editor |first=Richard Leadbetter Technology |last2=Foundry |first2=Digital |date=2025-01-07 |title=Hands-on with DLSS 4 on Nvidia's new GeForce RTX 5080 |url=https://www.eurogamer.net/digitalfoundry-2025-hands-on-with-dlss-4-on-nvidias-new-geforce-rtx-5080 |access-date=2025-01-31 |website=Eurogamer.net |language=en}}</ref>