Essential Video Coding: Difference between revisions

Revision as of 12:49, 14 October 2022

Latest revision as of 16:40, 29 May 2025

(22 intermediate revisions by 17 users not shown)

Line 8:

| status = Draft

| year_started = 2018 (Initial Requirements Document)

| year_finished = 2020

| version =

| version_date =

Line 19 ⟶ 20:

| ___domain = [[Video compression]]

| license =

| website = {{URL|https://mpeg.chiariglione.org/standards/mpeg-5/essential-video-coding.html}}

}}

MPEG-5 '''Essential Video Coding''' ('''EVC'''), standardized as ISO/IEC 23094-1, is a current [[video compression standard]] that has been completed in April 2020 by decision of MPEG Working Group 11 at its 130th meeting.<ref name="ibc" /><ref name="meeting125" /><ref name="intro" /> <ref>{{Cite web |title=MPEG-5 EVC gets final approval |url=https://www.csimagazine.com/csi/MPEG-5-EVC-gets-final-approval.php |website=CSImagazine.com |publisher=CSImagazine.com |access-date=6 May 2020 |ref=1}}</ref>

The standard is to consistconsists of a royalty-free subset and individually switchable enhancements.<ref name="meeting125" /><ref name="intro" /><ref name="req" />

== Concept ==

The publicly available requirements document<ref name="req"/> outlines a development process that is defensive against patent threats: Two sets of coding tools, ''base'' and ''enhanced'', are defined:

* The base consist of ''tools that were made public more than 20 years ago or for which a Type 1 declaration is received''. Type 1, or option 1, means "royalty-free", in the nomenclature used in ISO documents.<ref name="iso-speak"/>

* The "enhanced" set consists of 21<ref name="Licenses4_21Tools">{{Cite journal |last1=Samuelsson |first1=Jonatan |last2=Choi |first2=Kiho |last3=Chen |first3=Jianle |last4=Rusanovskyy |first4=Dmytro |title=MPEG-5 Part 1: Essential Video Coding |url=https://ieeexplore.ieee.org/document/9146794 |archive-url=https://web.archive.org/web/20201107221703/https://ieeexplore.ieee.org/document/9146794/ |archive-date=November 7, 2020 |journal=SMPTE Motion Imaging Journal |year=2020 |volume=129 |issue=7 |pages=10–16 |publisher=SMPTE |doi=10.5594/JMI.2020.3001795 |s2cid=225463271 |access-date=26 June 2021 |ref=Licenses21Tools21|url-access=subscription }}</ref> other tools which have passed an extra compression efficiency justification and which can be disabled individually.

Each of the 21 [[payable]] tools can have separately acquired and separately [[negotiation|negotiated]] and separately [[Trade|Traded]] [[License agreement]]s. <ref name="Licenses4_21Tools"/> Each can be individually turned off and, when necessary, replaced by a corresponding [[cost free]] baseline profile tool. This structure makes it easy to fall back to a smaller set of tools in the future, if, for example, [[License agreement|licensing]] complications occur around a specific tool, without breaking [[Computer compatibility#Software|compatibility]] with already deployed decoders. <ref name="Licenses4_21Tools"/>

This video codec is compatible with hardware accelerators - decoders originally developed for older standards such as [[H.264|AVC]]/[[HEVC]] at least in the '''Baseline profile'''.<ref>{{cite web |last1=McCann |first1=Ken |title=MPEG-5 Essential Video Coding (EVC) |url=https://www.itu.int/en/ITU-T/Workshops-and-Seminars/20191008/Documents/Ken_McCann_Presentation.pdf?trk=public_post_comment-text |website=itu.int/en/ITU-T/Workshops-and-Seminars/20191008/Documents |language=English |quote=EVC uses a novel profile structure. The Baseline profile includes only technologies that are more than 20 years old or that were submitted with a royalty‑free declaration. In contrast, the Main profile adds a small number of additional tools that can be switched off independently—allowing decoders (including hardware accelerators originally developed for older standards such as AVC/HEVC) to continue operating on the Baseline profile.}}</ref>

A proposal by [[Samsung]], [[Huawei]] and [[Qualcomm]] forms the basis of EVC.<ref name="3codecs" />

== Implementations ==

* [XEVE (eXtra-fast Essential Video Encoder)<ref>{{Cite web|url=https://github.com/mpeg5/xeve XEVE (the |title=eXtra-fast Essential Video Encoder (XEVE)]|date=January 9, 2023|via=GitHub}}</ref> is self-described as a fast open source EVC encoder. It is written in [[C99]] and supports both the baseline and main profiles of EVC. Its license is a custom [[3-clause BSD license]].

* [[FFmpeg]] version 7.1<ref>{{cite web |url=https://www.ffmpeg.org/general.html#eXtra_002dfast-Essential-Video-Encoder-_0028XEVE_0029 |title=1.29 eXtra-fast Essential Video Encoder (XEVE) |website=FFmpeg General Documentation}}</ref><ref>{{cite web |url=https://www.ffmpeg.org/general.html#eXtra_002dfast-Essential-Video-Decoder-_0028XEVD_0029 |title=1.30 eXtra-fast Essential Video Decoder (XEVD) |website=FFmpeg General Documentation}}</ref> officially supports encoding and decoding using official external library above (for encoding) and decoder library: eXtra-fast Essential Video Decoder (XEVD).<ref>{{cite web |title=eXtra-fast Essential Video Decoder (XEVD) |url=https://github.com/mpeg5/xevd |website=github}}</ref>

==MPAI-EVC standard==

'''M'''oving '''P'''icture, Audio and data Coding by '''[[Artificial Intelligence|AI]]''' uses:

==MPAI-EVC standard==

'''MPEG-5 E'''ssential '''V'''ideo '''C'''oding

MoreMPAI precieselyaims to significantly enhance the performance of MPAI-EVC '''Evidenceby Project'''improving isor justreplacing totraditional tools with [[Artificial intelligence|AI]]-based tools, with the goal of reachreaching at least 25% improvement over the baseline profile of '''EVC'''.<ref>{{Cite web |title=AI-Enhanced Video Coding (MPAI-EVC) |url=https://mpai.community/standards/mpai-evc/mpai-evc-evidence-project-status-report/ |website=Moving Picture, Audio and data Coding by Artificial Intelligence}}</ref><ref>{{Cite web |title=Basic Applications, Technologies and Benefits for Video Coding by means of Artificial Intelligence '''Slide No 10'''|url=https://mpai.community/wp-content/uploads/2022/03/HPA-V1.6_.pptx |website=mpai.community/news/presentations/#ShortPresentation|access-date=21 September 2022|date=23 February 2021}}</ref> <ref>{{Cite web |title=Video Basic Applications, Technologies and Benefits for Video Coding by means of Artificial Intelligence '''Slide No 10; Slides Content Differ'''|url=https://platform.wim.tv/embed/?vod=33d669d3-4b28-4db9-b220-2c6fda5dc19d |website=mpai.community/news/presentations/#ShortPresentation|access-date=21 September 2022|date=23 February 2021}}</ref>

in its project:

'''MPAI - E'''nhanced '''V'''ideo '''C'''oding.

This Project aims to significantly enhance the performance of the traditional video codec '''MPEG-5 EVC''' by improving or replacing traditional tools with [[AI]]-based tools.<ref>{{Cite web |title=MPAI-EVC - MPAI community |url=https://mpai.community/standards/mpai-evc/ |website=MPAI Community |access-date=2 September 2022}}</ref>

The goal of the MPAI group is to enhance '''MPEG-5 EVC''' using [[AI]]-tools to reach at least 25% improvement over the baseline profile of EVC.<ref>{{Cite web |title=AI-Enhanced Video Coding (MPAI-EVC) |url=https://mpai.community/standards/mpai-evc/mpai-evc-evidence-project-status-report/ |website=Moving Picture, Audio and data Coding by Artificial Intelligence}}</ref>

More preciesely MPAI-EVC '''Evidence Project''' is just to reach at least 25% improvement over the baseline profile of '''EVC'''.<ref>{{Cite web |title=Basic Applications, Technologies and Benefits for Video Coding by means of Artificial Intelligence '''Slide No 10'''|url=https://mpai.community/wp-content/uploads/2022/03/HPA-V1.6_.pptx |website=mpai.community/news/presentations/#ShortPresentation|access-date=21 September 2022|date=23 February 2021}}</ref> <ref>{{Cite web |title=Video Basic Applications, Technologies and Benefits for Video Coding by means of Artificial Intelligence '''Slide No 10; Slides Content Differ'''|url=https://platform.wim.tv/embed/?vod=33d669d3-4b28-4db9-b220-2c6fda5dc19d |website=mpai.community/news/presentations/#ShortPresentation|access-date=21 September 2022|date=23 February 2021}}</ref>

The main goal of MPAI-EVC propper project: '''Final Standard''' will attempt to reach at least 35-50% improvement over state of the art traditional '''EVC'''. <ref>{{Cite web |title=Basic Applications, Technologies and Benefits for Video Coding by means of Artificial Intelligence '''Slide No 24'''|url=https://mpai.community/wp-content/uploads/2022/03/HPA-V1.6_.pptx |website=mpai.community/news/presentations/#ShortPresentation|access-date=21 September 2022|date=23 February 2021}}</ref> <ref>{{Cite web |title=Video Basic Applications, Technologies and Benefits for Video Coding by means of Artificial Intelligence '''Slide No & Content Differ'''|url=https://platform.wim.tv/embed/?vod=33d669d3-4b28-4db9-b220-2c6fda5dc19d |website=mpai.community/news/presentations/#ShortPresentation|access-date=21 September 2022|date=23 February 2021}}</ref> <small>("State of the art" may suggest challenging Main Profile of EVC.)</small>

Since Base Profile is free of patents fees; therefore there should be no patent issues hindering development from legal side.

== See also ==

* [[LCEVC|MPEG-5 Part 2 / Low Complexity Enhancement Video Coding / LC EVCLCEVC]]

* [[Versatile Video Coding|H.266 / MPEG-I Part 3 / Versatile Video Coding / VVC]]

* [[AV1]]

Line 77 ⟶ 64:

<ref name="iso-speak">{{Cite web |last1=Chiariglione |first1=Leonardo |title=A crisis, the causes and a solution |url=http://blog.chiariglione.org/a-crisis-the-causes-and-a-solution/ |access-date=6 April 2019 |date=28 January 2018 |quote=I saw the danger coming and designed a strategy for it. This would create two tracks in MPEG: one track producing royalty free standards (Option 1, in ISO language) and the other the traditional Fair Reasonable and Non Discriminatory (FRAND) standards (Option 2, in ISO language).}}</ref>

<ref name="3codecs">{{Cite web |last1=Ozer |first1=Jan |title=Inside MPEG's Ambitious Plan to Launch 3 Video Codecs in 2020 |url=https://www.streamingmedia.com/Articles/ReadArticle.aspx?ArticleID=134694 |quote=Though the EVC Main profile uses royalty-bearing “tools"tools,”" these can be switched on and off with “limited"limited loss of performance.”" This was the model deployed by Divideon and their xvc codec, and, in theory, it allows those deploying the technology to pick and choose both the performance and the associated royalty cost. (…) Two proposals were submitted in response to MPEG’sMPEG's call for proposals for MPEG-5 Part 1, and MPEG selected the proposal from Samsung, Huawei, and Qualcomm |date=October 15, 2019 |access-date=June 12, 2020}}</ref>

<!-- <ref name="smpte2019">{{Cite web |url=https://www.youtube.com/watch?v=0Itt0cOvgXU |title=SMPTE 2019: MPEG-5 EVC |date=October 21, 2019 |access-date=June 12, 2020}}</ref> -->

Line 88 ⟶ 75:

* [https://www.iso.org/standard/57797.html Text of the standard on the ISO website] (feature freeze (''FDIS'' status) as of August 2020)

* [https://mpeg.chiariglione.org/standards/mpeg-5/essential-video-coding MPEG publications on EVC] (Archive)

* [https://www.mpeg.org/standards/MPEG-5/ MPEG standards page for MPEG-5]

* [https://www.divideon.com/mpeg-5-evc/ Divideon's resource page]

* [https://www.youtube.com/watch?v=0Itt0cOvgXU Video presentation by Jonatan Samuelsson (SMPTE 2019)]

{{Compression formats}}

[[Category:MPEG]]

[[Category:Video compression]]

[[Category:Video codecs]]

{{film-tech-stub}}

{{measurement-stub}}