Hacker News AI· drakestapleton·· 19 days agoAI score58
Running Local AI on Nvidia DGX Spark Without CUDA
Running Local AI on Nvidia DGX Spark Without CUDA
AI summary
CUDA++ is a research-stage toolchain and runtime that encodes GB10 (sm_121) machine code directly, replacing nvcc, PTX and libcuda with its own encoder and a client for NVIDIA's open kernel module ioctls, while NVIDIA's kernel module and signed GSP firmware remain. It currently supports only the DGX Spark's GB10, does not compile CUDA C++ or PTX, and reports partial coverage of CUDA's libraries; a head-to-head speed comparison against llama.cpp and vLLM has not been published.
Source: Hacker News AI · github.com