AMD's Introduced a New AI BEAST That Nvidia Can't Match on Memory!
#amd #dgxspark #localai #nvidia
⚡⚡AMD’s second-generation Ryzen AI Halo ships 192GB of unified memory against the Nvidia DGX Spark’s 128GB, matches it on token generation, and runs models the Spark physically cannot load. Announced October 12 on the Ryzen AI Max Plus Pro 495, with up to 160GB handed straight to the GPU.⚡⚡
Spotlight Moments:
⚡Matches the DGX Spark on generation speed at 56.2 tokens per second against 57.8 on GPT-OSS 120B, with 64GB more memory in the box
⚡Crushes the Spark in sustained CPU work: 39 percent faster 7-Zip compression, 85 percent faster decompression, and 108 frames per second in x265 encoding against 30
⚡Opens the 300 billion parameter class at 4-bit quantization, or lets you keep several large agents loaded at once with their own context caches
Beats an Intel Core Ultra X9 388H and an Apple M5 Pro in all 18 creative ⚡AI workloads AMD tested, by up to 32.2 and 34.3 times, with some workloads failing to load on 64GB machines at all
Games properly too, at 104 frames per second in Cyberpunk 2077 at 1080p high on the Radeon 8065S with no discrete GPU in the box
⚡The honest trade-off: cold prompt processing runs 809 tokens per second against 1,818 on the Spark, a 128,000-token context takes about nine minutes versus two, and power draw hits roughly 196 watts against 53
Suggestions for some other Technical Content:-
1.NVIDIA's $2,899 RTX Spark Just Made Its OWN $4,699 DGX Spark Pointless!
https://www.youtube.com/watch?v=vkkrscHhwAM&t=165s
2. AMD Just Built an AI Beast That Nvidia Can't Match on Memory!
https://www.youtube.com/watch?v=k4nZxgWMCy4
Channel Link for Subscription
https://www.youtube.com/@UCiwcrCY6sJe052nS77_c4lw
Chapters
00:00 192GB Versus 128GB
01:29 Unified Memory Pool
02:52 Zen 5 CPU Wins
05:14 Radeon 8065S Gaming
07:00 Token Generation Speed
08:15 Creative AI Benchmarks
09:22 ROCm And Software
10:35 Who Should Buy
#ryzenai #nvidia #aihardware #rocm #llm
Subscribe for weekly semiconductor industry breakdowns, and comment your thoughts on whether this memory-focused strategy will successfully disrupt existing market leaders.
Posted Tue at 9:26 PM
click to rate
Share this page with your family and friends.