Samsung LPDDR5X-PIM at Hot Chips 2026
AI-summarised brief · reviewed before publication
Samsung unveiled its LPDDR5X‑PIM at Hot Chips 2026, the first processing‑in‑memory solution built on LPDDR5X DRAM. The new memory targets AI inference, offering 16 GB per rank in a 561‑ball JEDEC package and delivering 614 GB/s bandwidth—eight times the 76.8 GB/s of conventional DRAM. It supports 15 multi‑precision data types, enabling up to 2.4 TOPS with SINT4 weights or ~1.2 TFLOPs in FP8. Samsung positioned the technology as a lower‑cost alternative to HBM, which now accounts for 63 % of AI chip component spending. The design uses a conventional DRAM controller with a mode‑change switch for PIM operation.
💡 Why It Matters
- · By integrating PIM into LPDDR5X, Samsung offers a cost‑effective, high‑bandwidth AI accelerator that could reduce reliance on expensive HBM stacks, reshaping the memory landscape for data‑center and edge deployments.