Oct 11, 2023 | 5-Min. Read
Andraž Lazič
We are excited to introduce an expansion in hardware support for EK® Fluid Works servers and workstations, featuring the integration of the state-of-the-art NVIDIA® H100 PCIe Tensor Core GPU. NVIDIA's latest release, celebrated for its remarkable performance, scalability, and security across various workloads, has found its ideal home within our Fluid Works servers and workstations.
At EK Fluid Works, we're committed to sustainability, and that's why we've transformed our systems into more eco-friendly platforms . This aligns with our dedication to a greener approach and unlocks the full potential of Large Language Models (LLM), machine learning, and AI model training. EK Fluid Works systems are now the top choice for those in search of the unleashed power of NVIDIA H100 Tensor Core GPUs, offering an impressive array of efficiency benefits:
Unparalleled returns on investment
The lowest total cost of operation (TCO/OpEx)
Minimal additional capital expenditure (CapEx)
In terms of performance, the H100 GPU surpasses its predecessor, the NVIDIA A100, by an astonishing factor of five. With its PCIe variant equipped with a substantial 80GB of HBM2e memory, this formidable GPU stands as a powerhouse, boasting remarkable specifications that excel in artificial intelligence and deep learning applications. Its exceptional performance, driven by fourth-generation Tensor Cores, is evident in its:
FP8 Tensor Core of 3,026 TFLOPS
FP16 Tensor Core of 1,513 TFLOPS
FP32 Tensor Core of 756 TFLOPS
FP64 Tensor Core of 51 TFLOPS
To complement the next-gen GPU and manage its impressive 350W of thermal dissipation, we've developed the EK-Pro NVIDIA H100 GPU WB . This innovative solution adheres to the same design language as other water blocks in our data center portfolio:
Durable high-purity materials
Open Split-Flow cooling engine
CNC-milled microchannels with minimal hydraulic flow resistance
EPDM rubber seals
Our liquid cooling solution, exemplified by the water block's exceptional thermal performance, significantly reduces GPU core and VRAM operating temperatures, even during extended, high-intensity workloads. This, coupled with its robust construction and leak-free guarantee, ensures an extended service life with uninterrupted 24/7 GPU operation, empowering users to accelerate performance and maximize profits.
Furthermore, our system boasts an impressive 560GB of total VRAM with a clock speed essential for running AI models without performance bottlenecks. This, combined with the low hydraulic flow resistance, has enabled us to support up to 7x NVIDIA H100 PCIe Tensor Core GPUs in our high-compute-density rackmount servers and high-performance workstations.
Our advanced cooling solutions and system capabilities guarantee uninterrupted performance for users in AI and high-performance computing and extend the lifespan of critical hardware, ensuring a dependable, efficient, and cost-effective solution for your most demanding workloads.
Our EK Fluid Works systems featuring the NVIDIA H100 PCIe Tensor Core GPU include:
In the workstation realm, the EK Fluid Works X7000 of the Compute Series stands as the preeminent solution, offering the unique capability to house up to 7 GPUs in a single system - an unmatched feat in the market. Typically configured with 6x H100 GPUs alongside a display card like the RTX A5000, these passively cooled GPUs necessitate EK's liquid cooling solution for quiet and efficient cooling, ideal for office environments , even when ambient temperatures exceed 40°C . Fluid Works' high-performance computing (HPC) capabilities set it apart, offering computing power that exceeds traditional workstations.
On the server front, exemplified by the X7000-RM of the Rackmount Series , systems can accommodate either 7x H100 GPUs at maximum capacity or 6x H100 GPUs alongside networking components. What sets these servers apart is their exceptional tolerance for higher temperatures, superior cooling power efficiency, and reduced power consumption while delivering equivalent or superior performance. Operating at temperatures below 50°C at 25°C ambient temperature, these servers maintain a substantial 30°C temperature advantage over air-cooled alternatives , guaranteeing peak performance and reliability.
The EK Fluid Works liquid cooling ecosystem that supports the new GPUs consists exclusively of our finest components. Multiple radiators, manifolds, and high-quality EPDM tubing, combined with QDCs, ensure the optimal balance of performance , low noise output , and easy serviceability . Read more on why liquid cooling matters .
The NVIDIA H100 PCIe Tensor Core GPU can be found in the following EK Fluid Works systems:
EK Fluid Works Compute Series
EK Fluid Works Rackmount Series
Feel free to explore our Fluid Works configurator or contact our liquid cooling experts to help you find the right solution for your applications and unique workflow.
As an additional advantage, our rackmount servers and workstations are poised to support the latest CPU platforms, including the AMD® EPYC™ Genoa/Genoa-X 9004 and Intel® Xeon® Scalable Sapphire Rapids , ensuring future-proof compatibility for cutting-edge computing needs.
A 3-year Parts and Labor Warranty covers all EK Fluid Works systems. During that period, we also provide servicing kits for regular maintenance of the liquid cooling systems and replace any failed components with prefilled assemblies (e.g., GPU and a water block with tubing and QDCs) for smooth and hassle-free operation with minimal downtime.
The EK Fluid Works systems, equipped with the latest NVIDIA H100 PCIe Tensor Core GPUs, are now available for pre-order, allowing you to reserve your spot in the queue for GPU availability.