Skip to content

Open models

Nvidia launches a smaller, faster Nemotron model and a router to put it to work

Written by an AI model from the linked sources and checked against them by a second model. How we work

Image: thenewstack.io

Nvidia says routing between models can cut the cost of a task to roughly a third. In its own internal tests, pairing its open models with Anthropic’s Opus 4.8 held frontier-level accuracy while spending about one third of what Opus alone would cost per task.

The plumbing for that is NeMo Switchyard, an open source Rust library for building model routers, released Tuesday. Kong, OpenRouter, and LiteLLM are already integrating it.

The same day brought Nemotron 3.5 Lightning to the open Nemotron 3 family: 30 billion parameters, mixture-of-experts. On reasoning it lands close to the larger Nemotron 3 Super, though both sit below Google’s Gemma 4 31B on Artificial Analysis’ Intelligence Index. Nvidia claims inference speeds up to 4x higher.

Nemotron 3.5 Lightning is on Hugging Face, ModelScope, and OpenRouter. Switchyard is on GitHub.

No comments yet. Be the first.

Join the conversation

Sign in to leave a comment. It appears after moderation.