AI agents · OpenClaw · self-hosting · automation

Quick Answer

What Is Nvidia Nemotron 3.5 Lightning? (August 2026)

Published:

The Short Answer

Nemotron 3.5 Lightning is Nvidia’s free, open-weight model for autonomous agent workloads, released August 11, 2026. It’s a 30B-parameter hybrid MoE with only 3B active per token, interleaving Mamba-2 and MoE layers with attention. Nvidia claims up to 4× faster output and 30% faster task completion than comparable models — and it runs on a single consumer GPU.

Key Facts

Nemotron 3.5 Lightning
ReleasedAugust 11, 2026
Parameters30B total, ~3B active (hybrid MoE + Mamba-2 + attention)
LicenseOpenMDW-1.1 (commercial use allowed)
OpennessWeights + training data + training recipes
HardwareSingle consumer GPU
Claimed speedUp to 4× faster output, 30% faster task completion
Where to get itHugging Face, Nvidia, Ollama, LM Studio, Cline
Companion releaseNeMo Switchyard (open-source model router)

Why Nvidia Is Giving Away Models

Nvidia doesn’t sell tokens — it sells the hardware tokens run on. With Chinese labs (DeepSeek, Qwen, Z.ai, Moonshot) dominating open-weight leaderboards, Nvidia and Meta both moved in August 2026 to plant what CNBC called a “very firm flag” for US open-weight AI. A free agent model that runs great on RTX-class GPUs and DGX boxes is a hardware demand generator: every local agent loop is a GPU sale.

The Architecture Bet

Lightning’s Mamba-2 + MoE hybrid targets the specific economics of agents: long contexts read repeatedly, many small steps, latency compounding across a loop. State-space (Mamba) layers cut the cost of long-context token processing; the 3B-active MoE keeps per-step compute tiny. That’s how a 30B model claims 4× output speed on one consumer card.

Lightning + Switchyard: The Routing Pattern

Alongside the model, Nvidia launched NeMo Switchyard, an open-source router that sends each request to the most appropriate model. The intended deployment: Lightning handles the cheap, frequent agent steps locally, escalating hard steps to a frontier API. That mirrors how production teams already cut costs (see how to choose an AI model in 2026).

How It Compares

In the ~30B open agent-model class it lands directly against Meta’s Muse Glimmer 30B (Aug 10) and Qwen3.6-27B — comparison here: Nemotron 3.5 Lightning vs Muse Glimmer vs Qwen3.6-27B. Lightning’s distinctive angles: the most permissive openness of the trio (data + recipes, OpenMDW-1.1) and the speed-first architecture.

Who Should Care

  • Local-agent builders who want an always-on model on a 24GB GPU.
  • Cost engineers using small-model routing to cut frontier-API spend.
  • Enterprises needing license clarity — OpenMDW-1.1 plus published training data is unusually clean provenance.

Last verified: August 15, 2026.

Sources