The NVIDIA Vera server features a dual-socket configuration with the Vera CPU Superchip, totaling 176 Olympus cores. The system utilizes NVIDIA's Spatial Multithreading (SMT) technology, which provides 352 threads in total. This implementation differs from traditional SMT designs by using physical partitioning of core hardware resources instead of dynamic time-slicing.
NVIDIA claims this approach improves resource utilization and provides more predictable performance, particularly for agentic AI workloads. Each core supports two threads, matching the thread-per-core count found in standard AMD and Intel processors. The SMT feature is enabled by default but can be toggled at runtime via the sysfs interface.
Testing was conducted on an NVIDIA Olympus setup running a modified Ubuntu 24.04 distribution. The environment utilized the Linux 6.17 64K kernel and the GCC 15.3 compiler. Benchmarks focused on comparing performance metrics with SMT enabled versus disabled, while also monitoring CPU power consumption and peak frequency.
