Hacker News AI· peter_d_sherman·· 12 hr agoAI score18
Lawyer upgrades eight-V100 private AI server to run 80% of DeepSeek v4.1 Flash
Lawyer upgrades eight-V100 private AI server to run 80% of DeepSeek v4.1 Flash
AI summary
A lawyer running a private AI server on eight used Nvidia V100 GPUs moved about 80% of its work from 2-bit to 4-bit NVFP4 precision, adding 1TB of RAM and an RTX 3090. The server runs DeepSeek V4.1 Flash with a legal harness for his law practice, and code output dropped from 160–215 to 150–180 tokens per second, though the crashes that hit the new build are gone. The crashes, originally blamed on PCIe, were likely caused by a bad PSU.
Source: Hacker News AI · tomshardware.com