Wow. I always forget how unlike autoregressive models, diffusion models are heavier on resources (for the same number of parameters).