AN 1020: Using the FPGA AI Suite IP with High Bandwidth Memory on Stratix® 10 MX and Agilex™ 7 M-Series Devices
1.1. High Bandwidth Memory (HBM) Background
Both the Stratix® 10 MX and the Agilex™ 7 M-Series FPGA devices offer in-package high bandwidth memory (HBM). HBM typically offers 10x more bandwidth than external DDR memory, when compared to current discrete memory solutions.
In the Stratix® 10 MX and the Agilex™ 7 M-Series FPGA devices, HBM is integrated in the same package as the FPGA core logic die. Because of this integration, the HBM integrated into the FPGA device package is often depicted as a "near memory" solution when compared with the "far memory" solution that DRAM on the PCB with longer traces to the FPGA core logic represents. The benefits of near memory are higher bandwidth, lower power, and lower footprint on the PCB when compared to traditional external DRAM approaches as shown in the following figure.

HBM2 is typically a 3D memory multiple DRAM dies are vertically interconnected by through-silicon vias (TSVs).
Stratix® 10 MX devices integrate up to two HBM2 memory stacks with a maximum memory bandwidth of up to 512 GBps and a maximum capacity of 16 GB.
Agilex™ 7 M-Series devices integrate up to two HBM2e memory stacks with a maximum memory bandwidth of up to 1 TBps and a maximum capacity of 32 GB. Each stack has an independent associated universal interface bus (UIB) function, and each stack can either contain four or eight layers where each layer provides 2 GB of memory. Eight hard controllers provide four or eight channels per stack, and the channels are split into two pseudo channels. These pseudo channels (which are internally arbitrated on a per-layer basis) address the same memory layer and the same address space but they are separate interfaces so that an intelligent internal interface logic can reorder accesses and optimize the total bandwidth per physical channel.
Figure 2 shows the availability of Stratix® 10 MX FPGAs with up to 16 GB of HBM while Figure 3 shows the availability of Agilex™ 7 M-Series FPGAs with up to 32 GB of HBM.

