Posted on — Leave a comment

AMD’s Helios AI racks cram 32,768 Zen 6 Venice cores for agentic servers

amd hellios helion ai computer rack

AMD is turning its Zen 6 “Venice” server chips into a full-on rack-scale story with Helion, a new Open Compute Project reference design built to host massive fleets of CPUs for agentic AI and data-center workloads. In a CPU-only configuration, a single Helion rack can accommodate up to 128 EPYC 9996 processors, which translates to 32,768 Zen 6 cores dedicated to AI agents, software builds, and other high-density compute jobs.

Helion extends AMD’s push into standardized rack architectures by adopting OCP’s ORv4 spec, which uses a slightly wider 21-inch rack format to squeeze in more trays and cabling than traditional 19-inch enterprise racks. The design is laid out for 44 OpenU trays and supports both conventional air cooling and direct liquid cooling, with compliance to OCP’s DC-MHS modular hardware standard so that hyperscalers can mix and match certified components instead of being locked into a single vendor’s ecosystem. AMD is contributing Helion as a reference rather than selling finished racks, leaving OEMs and ODMs to build out actual systems based on the design, with partner names slated to be highlighted from the OCP Global Summit stage.

The heart of Helion’s headline-grabbing core count is AMD’s EPYC 9006 “Venice” family, led by the flagship EPYC 9996. This chip packs 256 compact Zen 6c cores and 512 threads, paired with 1 GB of L3 cache and a 600 W default power envelope that can be tuned between 400 W and 600 W for different deployment scenarios. AMD’s own product tables show the 9996 running at a 2.55 GHz base clock with boost speeds up to 4.1 GHz, making it one of the highest-density x86 CPUs ever offered for general-purpose servers. Across the Venice stack, EPYC 9006 brings up to 256 cores, PCIe Gen 6 support with 128 lanes, and roughly 1.6 TB/s of memory bandwidth, positioning these chips as host CPUs that can keep data flowing efficiently between agents, accelerators, and storage. Pricing for the 9996 lands just under $15,000 per socket, which means a maxed-out Helion rack filled with 128 of them represents an eye-watering amount of silicon value—and an equally serious commitment to CPU-side AI infrastructure.

Helion is explicitly aimed at the emerging “agentic AI” pattern where each user or workload gets a persistent sandbox of CPU resources, while heavy-duty inference runs on a separate pool of accelerators. AMD’s own EPYC 9006 positioning leans into this, describing Venice as a platform for running large numbers of AI agents in parallel and coordinating them with high-bandwidth connections to GPUs and networking. In practice, this looks a lot like the personal AI agent architectures already in play at companies such as Meta with its agent-style research systems and OpenAI’s explorations in multi-agent frameworks, where a host CPU slice handles orchestration, tooling, and code generation while inference is offloaded to dedicated accelerators. Helion’s CPU-only configuration is tailor-made for these sandboxes, turning a single rack into a dense farm of agent hosts that can be wired up to separate inference clusters built on GPU-centric solutions.

Helion also arrives as a counterpart to AMD’s Helios rack-scale platform, which was previously detailed as a GPU-heavy architecture built around Instinct accelerators for AI training and inference. In AMD’s broader enterprise roadmap, Helios is tied to upcoming MI400-series GPUs and high-bandwidth networking, while Venice and later Verano EPYC CPUs fill out the host side. Helion flips that emphasis: CPUs come first, but the reference design still allows for hybrid deployments with up to 16 Instinct MI350P GPUs and roughly 102 Tbps of networking per rack, trading some CPU density for an all-in-one footprint that can handle data management, AI preprocessing, and lighter inference in the same chassis. That hybrid Helion configuration targets enterprises that want a streamlined, standards-based rack they can drop into existing OCP-style data centers without rethinking their entire floor layout.

The timing lines up neatly with AMD’s Zen 6 rollout. Venice EPYC chips are slated as AMD’s first data-center products manufactured on TSMC’s N2-class process, with up to 256 cores marking a 33% jump over the current Turin generation’s 192-core compact designs. AMD’s roadmap shows Venice ramping across 2026, followed by Verano server CPUs and Instinct MI400 accelerators, all feeding into a two-year window of aggressive AI and cloud build-outs. Helion racks are scheduled to hit the market in the first half of 2027 as OEMs and hyperscalers spin AMD’s reference into production hardware, giving cloud platforms a standardized, CPU-first option for scaling agentic workloads alongside their GPU farms. For AI-focused engineers and data-center planners, the message is clear: AMD doesn’t just want to win socket share—it wants to define how entire racks are laid out for the next generation of AI-native infrastructure.

Our Sponsors

Geeks talk back