iCreatAI News
Back to main site
Skip to content
Only Papers#Open source
  1. vLLM Blog72

    Zero Mismatch, Simple Async RL: REINFORCE Zero, DeepSeek-V4.1 and Kimi K3.1

    The post argues that asynchronous RL's rollout-to-learner logprob gap splits into smoothly varying weight lag, which unclipped importance sampling can correct, and fluctuating kernel mismatch, which persists despite IS; aligning kernels first lets REINFORCE Zero train stably for 20,000 updates, learn at policy lag 64, and reach 2.40× the training-step throughput of synchronous training with aligned kernels. It reports zero mismatch (bit-for-bit logprob agreement) for DeepSeek-V4.1-Flash and Kimi K3.1 on day 0, and for DeepSeek-V4-Flash and Kimi K3.1 on AMD MI355X. Code and recipes are in Inferact/zero-mismatch-rl, with the paper at hijkzzz/REINFORCE-Zero and training code in NVIDIA-NeMo/labs-molt.

    Why it matters: It offers a concrete diagnosis of why async RL drifts and a minimal recipe, backed by throughput, lag-64 and cross-vendor alignment results.

  1. The Decoder85

    GPT-6 Astra sees the matrix and reprograms other AI models directly through their weights

    Researchers describe "Weight-Space Programming," in which a language model called Astra reads and edits the raw weights of other networks without step-by-step training: it identified which of four games a network was trained to play, generated untrained game-playing weights that beat a standard baseline in Breakout (517 vs. 25 points), and changed 0.016 percent of Qwen3.5-0.8B's weights to raise MATH-500 accuracy from 7.9 to 48.1 percent. It could not measurably improve Gemma 3 270M, and Jürgen Schmidhuber called the approach "old hat," while researcher Omar Khattab said the novelty lies in how well today's language models translate between human language and a network's numerical values. Experiment logs are on GitHub and the edited Qwen model is on Hugging Face.

    Why it matters: It offers a concrete look at weight-level model editing, including benchmark numbers and a public dispute over how novel the idea really is.

  1. Hugging Face Blog60

    Same Model, Different Harness: CUGA, Hermes, and Deep Agents — When to Pick CUGA?

    IBM ran CUGA, Hermes, and Deep Agents on the same open-weight model (GLM-5.3-flash) across 90 AppWorld tasks, and task completion ranged from 30% to 81% depending only on the harness, with CUGA at 81.1% (73/90) versus Hermes at 46.7% and Deep Agents at 30.0%. CUGA is IBM's Apache 2.0 harness for enterprise API work, adding runtime-enforced policies (intent guards, tool approvals, ToolGuards, output formatting) and deployment inside sovereign or air-gapped environments. The authors note the 90-task sample, non-identical setups, and absence of policy testing as limits, and say CUGA is not the right fit for terminal coding or personal chat assistants.

    Why it matters: Useful for teams choosing an agent harness, since it isolates harness effects with a fixed model and shows where runtime policy enforcement fits enterprise needs.

  1. Hacker News AI76

    Rocky Linux Creator Built a New 'Not Linux' Kernel in 11 Days Using AI

    Gregory M. Kurtzer, creator of Rocky Linux, developed Ginux, a Rust-first x86-64 kernel and OS prototype that boots via UEFI without a Linux host kernel and runs unmodified Linux userspace inside kernel-native domains, including Rocky Linux 10 systemd reaching multi-user.target. The project was built over eleven days by one persistent OpenAI Codex task using GPT-5.6 Sol, producing roughly 139,000 retained lines of implementation and test code under a method called Human-Directed Agentic Engineering. Ginux is explicitly experimental, with incomplete Linux ABI coverage, device support, and security validation, and is not intended as a production replacement for Linux.

    Why it matters: It documents a notable experiment in AI-assisted kernel development and is candid about the resulting system's limits.

  1. Berkeley AI Research60

    From CUDA to MLX: How K-Search Brings Decades of Kernel Expertise to Apple Silicon

    IBM Research extended K-Search, an evolutionary LLM-driven kernel search framework from UC Berkeley Sky Lab, with a native MLX backend and a structured CUDA-to-MLX translation layer that maps CUDA primitives, constraints and optimization patterns onto Apple Silicon equivalents. On Apple Silicon the approach reached 0.97x the speed of the native MLX Attention kernel and up to a 20x prefill speedup over the community mlx-lm implementation on the Mamba SSM kernel, attributed largely to adding a parallel scan. The authors say the bottleneck was not the LLM's ability to write Metal code but the quality of context and constraints supplied to it.

    Why it matters: Describes a concrete method for transferring CUDA kernel expertise to non-NVIDIA hardware, with reported benchmark numbers and an open-source reproduction path.

You have reached the end