The ideal server for self-hosting
I'm going to list the suggested configuration for a next level server for a self-hosting system for you home or small business. I will be referring to this design in future posts.
The Parts List:
Components List for Dual CPU Configuration
- Case:
- Model: Fractal Design Define 7 XL
- Type: Full Tower ATX Case
- Features: Excellent airflow, sound dampening, and ample space for components.
- Motherboard:
- Model: Supermicro X11DAC or X11DAi-N
- Socket: LGA 3647 (supports dual Intel Xeon processors)
- Form Factor: ATX
- Features: Dual CPU support, multiple PCIe slots, support for ECC memory, and enhanced networking options.
- Processors (CPUs):
- Model: Intel Xeon Gold 6230 (2x)
- Cores/Threads: 20 Cores / 40 Threads per CPU
- Base Clock: 2.1 GHz
- Turbo Boost: Up to 3.9 GHz
- TDP: 125W per CPU
- Total Cores/Threads: 40 Cores / 80 Threads
- CPU Coolers:
- Model: Noctua NH-U14S (2x)
- Type: Air Cooler
- Features: High-performance cooling with low noise, one for each CPU.
- Memory (RAM):
- Model: Corsair Vengeance LPX 256GB (8 x 32GB)
- Type: DDR4-3200
- ECC: Yes (for stability in server applications)
- Storage:
- Primary Drive (OS):
- Model: Samsung 970 EVO Plus 1TB NVMe SSD
- Type: M.2 NVMe
- Secondary Drive (Data):
- Model: Seagate IronWolf 4TB HDD
- Type: 3.5" SATA
- RPM: 5900
- Primary Drive (OS):
- Graphics Card (GPU):
- Model: NVIDIA RTX A4000
- VRAM: 16GB GDDR6
- Features: CUDA cores for accelerated computing tasks.
- Power Supply (PSU):
- Model: EVGA SuperNOVA 1200 G5
- Wattage: 1200W
- Certification: 80 Plus Gold
- Modular: Fully modular for better cable management.
- Network Card:
- Model: Intel I350-T4 (if not using integrated options)
- Type: PCIe Quad Port Gigabit Ethernet Adapter
- Features: Reliable network performance for server applications.
- Operating System:
- Distribution: Ubuntu Server 22.04 LTS
- Features: Long-term support, optimized for server use.
- Additional Cooling:
- Case Fans: Noctua NF-A14 PWM (3-pack)
- Type: 140mm fans for improved airflow.
Conclusion
The Supermicro X11DAC and X11DAi-N motherboards are excellent choices for a dual Intel Xeon setup, providing the necessary features and performance for demanding applications like running large language models, or running many containerized applications.