back
183 comments
A few things - this is one step in a long, LONG path. AV2 is currently unusable in its current state (the encoder typically runs at around 1fps on good hardware), and likely will remain so til ~2028 when the first av2 hardware accelerated chips start dropping. Even then, I wouldn't expect AV2 streams to be common til 2030.

IMO, if it were just the efficiency gains on the table (which are substantial - ~20-30% over AV1), I'd say that AV2 isn't worth it. The biggest thing it does add though is multi-stream support, which will be a big win for VR and live sports. The other fun thing is you can send an alpha channel as a separate stream, which the file will then composite for proper transparent video support.

Based on AV1's trajectory, hardware encode isn't necessary (though it is nice). The current encoder is a reference encoder. Now that the spec is finalized, expect significant speed improvements from production encoders (realtime likely won't happen until we get it in hardware though)
That's fine and not anything new for codecs, they always take a long time before mass adoption.

Take a look at AV1 itself, you can't even say it's really ubiquitous on all hardware. It's quite well along in adoption compared to early days, but some mobile devices are still lacking hardware acceleration for it.

> The biggest thing it does add though is multi-stream support

I would have thought this would be a part of the container format rather than the video codec?

The way things are going, we can pretty much forget about AV2 hardware encoders in PCs anytime soon. All the newest, best chip capacity is being completely hogged by Apple and AI companies.

Unless chipmakers port the AV2 design to older, cheaper nodes, it’s just not happening for average users. We’ll probably see some Chinese TV chip makers throw in an AV2 decoder just to check a box, but as an actual encoder? I wouldn't count on it anytime soon.

> The biggest thing it does add though is multi-stream support

This was supported in H.264 MVC but only saw real use for 3D movies on physical BluRays. With almost no content available outside that.

Looking at how GPU development has been sidetracked for NPU, I worry that this is 2035 target at best. Manufacturers will push for maximising matrix operation silicon area. In the era of trillion dollar investments into datacenters, traffic cost is afterthought. The only benefitors might be YouTube, Netflix and such, but on their scale investment into ISP level caches might be cheaper.
In HW accelerated chips, what part of the calculations they usually accelerate? Could it be possible to repurpose old HW?
> The biggest thing it does add though is multi-stream support, which will be a big win for VR and live sports.

AV1 supports it too ?

I feel like in 2030 it's more likely that we send 480p and just upscale with ai on the other end
> enabling high-quality video delivery at significantly lower bitrates

> likely will remain so til ~2028 when the first av2 hardware accelerated chips start dropping

This might sound dumb, but whats the point if its intended for slower devices, but those slower devices don't even exist yet?

Where do you see information about the efficiency gains over AV1?
Does anyone know what is so costly to calculate in AV2?
>........I'd say that AV2 isn't worth it.

Unless they have hardware encoder and decoder design done in parallel, otherwise it would be 2028 before a hardware block design is done and 2030 for the earliest product to ship with it. In reality I think 2031 or 2032 is more likely.

And I have been saying the same for quite some time that 20-30% for a generational codec improvement isn't worth it. I think they originally aimed at 50%, and then 40% and then 30%.

I feel like these encoders that require acceleration are a big reason why good hardware obsoletes so quickly.
What I'm interested in is seeing how this will improve the AVIF image format. AVIF stomps the competition for low-bitrate still images (where chroma subsampling is used). For lossless images, not so much. Lossless JPEG XL and lossless WEBP make lossless AVIF look like a joke.
AVIF is for sure my favorite image format right now. No other format has the quadfecta of lossless, HDR, transparency, browser support. Plus as you said, for very compressed images it looks amazing. It blows my mind how small AVIF files can be. Also, unlike HEIC and Ultra HDR JPEG, it actually supports HDR natively as part of the file format rather than doing the hacky sidecar gain map trick. I know it doesn't matter to everyone, but I just love HDR and AVIF is the only format that I feel like really takes it seriously.
Honestly AVIF2 is the last thing we need now. There are way too many minority image formats already.
Maybe libavif will pick up AV2 support, so all one needs to do is update it to v2.0.0 or something and bam! Extra efficiency!
AV1 is being actively claim-charted by a lot of companies right now, and lawsuits are almost certainly coming. The same process is already starting for AV2, but most players are waiting for the AV1 cases to mature first.

People keep calling the AV-family codecs “royalty free,” but in practice they increasingly look like a legal and financial gamble.

People have been saying this for decades now.

I've never understood why some people seem to cheer this on like a corporation owning some maths was their local sports team.

For a while I assumed some people had put in a lot of effort on H.264 encoders and so the digital sharecroppers were angry and jealous that someone might be advocating for messy freedom.

But some people seem to just enjoy the thought of corporations putting a tax on video distribution.

Luckily those greedy corporations have repeatedly shot themselves on the foot and so their influence is waning.

How long has it been since AV1 was released? About eight years, and there's still no credible patent holder. The vultures are always circling around compression standards. You shouldn't take that too seriously. Even if a lawsuit is filed, there's a legal defence fund to protect against baseless claims.
> People keep calling the AV-family codecs “royalty free,” but in practice they increasingly look like a legal and financial gamble.

And the alternative is… ?

For H.265 there are two HEVC licensing pools you have to sign with plus at least two non-pool companies:

* https://en.wikipedia.org/wiki/High_Efficiency_Video_Coding#P...

Going with a non-AVx codec is no less complicated and fraught with lawsuit risk AFAICT.

> in practice they increasingly look like a legal and financial gamble

As opposed to what, like HEVC? Where you need to pay 3 different patent pools to be sure (which all has different terms), then there's still other patent holders that aren't in any pools and come and hit you with loyalty requests any time under terms however they like to?

There should be a stronger push to fight these trolls. AOM has enough resources to bust their garbage patents and make them pay damages for patent racketeering. At least until software patents are banned for good.
It should be not possible to patent communication standards. The opportunity for abuse through lock-in effects is just too big.
Mostly a joke... I've been waiting for the AV1 Apple TV, so now I'm just waiting for AV2 support as Apple TV as well now.
My 10 year old iPhone 7 can play 1080p AV1 video in software for more than 200 minutes with VLC. The iPhone 7 was released a year and a half before AV1 was.

So I think it's a safe bet the current Apple TV devices are capable of playing AV1 video in software. There's a VLC release for Apple TV:

https://www.videolan.org/vlc/download-appletv.html

https://apps.apple.com/us/app/vlc-media-player/id650377962?p...

Outside the apple ecosystem, AV1 is supported nearly everywhere.
AV1 already was a big leap toward efficient and open video formats. I'm awaiting AV2 since a long time.

Sure it'll take a while since it's implemented in chips and hardware so we got efficient and fast hardware encoding/decoding.

But a ~25% higher efficiency sounds very promising in times of increasing storage prices and chip crises.

Congrats!

How is the case of fighting off Dolby's patent racketeering going? They tried to attack Snapchat for using AV1.

Last update seems to be "lawsuit was filed" with zero updates since then. That stuff tends to move slowly.
Dolby's patents are garbage, and they know it. They managed to patent entropy coding somehow. This will not stand to challenges, and they managed to poke a well-resourced company.
This will always happen. There are just some entities that can't stand not seeking rent.
I'm not a expert on video encoding

But i wonder if the future could depend less on fixed-function compression methods and more on AI networks that recreate the video but weight much less that a compressed video.

Neural codecs such as github.com/Orange-OpenSource/Cool-Chic

It will probably depend on whether NPUs are universally available in smartphones, and whether we get a standard API for accessing NPUs. But I don't know whether AI-based codecs can have battery usage competitive with fixed-function hardware.
Dav2d doesn't have the same nice ring to it. I hope there's someone with a decent repo-name punning skill who'll contribute before that.

avi2ude? av2go?

It was difficult to find a nice name, with av2 :(

It works in French d2vid (Deuvid)

And how long will it take before someone implements this standard and gets sued because Adobe or Dolby or whoever wanted to get slapped down? My knowledge may be out of date but if this is as "open" as AV1, I'm very skeptical that the individual companies will actually allow that. Greed and all that.
Looking forward to a decently speedy encoder coming around. The reference one for AV1 is really not that great, and the same is true here. But as soon as we get SVT-AV2 or whatever, I'll be a very happy camper.
Now the real question: will The Industry™ again need for nerds and digital privateers to actually write and graft all the psy coding tools that makes their encoders usable (and I mean the word, using x264 as benchmark) for the quality-conscious and not just CPU-efficient VoD blurred to death with marketing yelling "PSNR! PSNR! PSNR!" at the top of their lungs? Will FGS be more usable?

Take a look at https://gitlab.com/AOMediaCodec/SVT-AV1/-/work_items/2269 for details (PS: SVT-AV1 claims to be suitable for AVIF yet doesn't support YUV444, lel)

anyone performed a encoding and decoding benchmarking with the reference codec yet? I'd expect encoding to be dreadful, but maybe the decode is already usable
It takes a few years for vendors to support hardware decoding for a new standard, so we won't see it in widespread use anytime soon.
I’m curious how much AV2 will actually help older hardware in practice.

I’m on a 2019 Intel MacBook Pro: 2.6 GHz 6-core i7, 64 GB RAM. The machine is still more than powerful enough for normal desktop work and software dev, but YouTube in Chrome has become borderline unusable for me. My internet is fine, Safari plays the same videos smoothly, and YouTube “Stats for nerds” shows plenty of buffer but the decoding makes youtube unusable in chrome for me.

Is there an AV1 2.0? I'm not using this codec if they can't do basic semantic versioning right.
Neat but the real world still, and for decades to come - lives on h264 https://www.wink.co/documentation/Why-H264-Is-Almost-Always-...