That on-die DRAM sure sounds like a nightmare for precision timing.

I've seen what happens when memory latency jitters during a handoff. 330 GB of DRAM right on the die sounds lovely on paper, but I wonder how they keep the noise floor low enough for deterministic workload routing. Then again, maybe AI doesn't need the same guarantees as a plane vector.