Tuesday, August 05, 2025

Intel's Mass Layoffs and AMD's Future

 Can Intel survive? Doubtful. AI is the future. Even Intel's new CEO realizes that inference is Intel's last chance.

There is very enthusiastic demand for AMD's RyZEN AI MAX 395, due to its memory bandwidth. The chip can run the powerful Qwen3-30b-a3b model at the highly usable speed of around 70 tokens per second. It can run the full Qwen3-225b model at about 14 tokens/second if 2-bit quantization is used. (The Apple M4 Macbooks can achieve the same speed if equipped with sufficient unified memory.) The bigger Qwen3 is on par with OpenAI's o3, at PhD level intelligence.

On the client side, AMD should focus on bringing more of such local AI capabilities. Imagine future AMD PCes come builtin with PhD level AI right in the box, people will be willing to pay premium prices.


0 Comments:

Post a Comment

<< Home