Item — HN Reader

from the summary:

"When it is all said and done, MI300X is a very impressive piece of hardware. However, the software side suffers from a chicken-and-egg dilemma. Developers are hesitant to invest in a platform with limited adoption, but the platform also depends on their support. Hopefully the software side of the equation gets into ship shape. Should that happen, AMD would be a serious competitor to NVIDIA."

3 comments

IMO Nvidia is going to force companies to fix this, Nvidia have always made it clear they will increase prices and capture 90% of your profits when left free to do so. See any example from the GPU vendor space. There isn't infinite money to be spent per token, so it's not like the AI companies can just increase prices.

AMD can offer this product at a 40% discount and still make money tells you all you need to know.

I'm personally wondering when nVidia will open an AI AppStore, and every app that runs on nVidia hardware will have to be notarized first, and you'll have to pay 30% of your profits to nVidia.

History has shown that this idea is not as crazy as it sounds.

Oh that is a great example, just wipe out Hugging Face, Ollama, Together.ai, and probably 20 more. They can host it all themselves or require their vendors to lease some time to them at cost..

OTOH, the performance advantage compared to the H100 is super-impressive according to tfa. Things could become interesting again in the GPU market.

AMD should be giving out these units to whichever clouds are willing to host them, so they can get them in the hands of developers to induce demand via working software

You are totally right.