Supermicro 8 GPU system (4x Nvidia P40 installed) - $2,000
make / manufacturer:Supermicro
model name / number:SYS-4028GR-TRT
QR Code Link to This Post
This is a server I built to run local LLMs and other machine learning tasks.
Supermicro sys-4028gr-trt
2x Xeon(R) CPU E5-2697 v4 18 cores each 36 cores total
128gb of memory
4x Nvidia P40 with 24gb of memory each for a total of 96GB of VRAM. Great for larger LLMs
Dual 10GBase-T LAN
4x 1600W power supplies