Any speculation why the AMD cards require twice the VRAM that Nvidia cards do? I have an RX 6700 XT and I'm disappointed that my 12 GB won't be enough.
back
3 comments
Probably no 4-bit quantization support? Or they are missing some ops that the tensor core cards have?
My guess is AMD users will eventually get low VRAM compatibility through Vulkan ports (like SHARK/Torch MLIR or Apache TVM).
Then again, the existing Vulkan ports were kinda obscure and unused with SD 1.5/2.1
You will want an optimized implementation from torch-mlir or apache tvm anyway.
We had this for SD 1.5, but it always stayed obscure and unpopular for some reason... I hope its different this time around.
Your 6700XT won't work anyway, since its not supported by ROCm
The 6000 series "unofficially" works with rocm, and that is hopefully getting more official.
That's not accurate, I was able to make my old RX 5500XT work with ROCm some months ago, only after 6 hours of compilation process though...
Its not supported, only navi 21 is supported, which is RX 6800+
It works on my 6900XT with ROCm
Because anything higher the 6800 is unofficially supported