NVIDIA NIM
Explore NVIDIA NIM models on TrustedRouter with current routes, token pricing, policy sources, privacy posture, regional availability, and API support.
NVIDIA NIMnvidia-nim
No provider claim
These privacy labels describe NVIDIA NIM, the upstream model provider. ZDR is a retention policy; verified confidential inference additionally requires attested provider compute and end-to-end encryption.
| Provider | NVIDIA NIM |
|---|---|
| Routing status | Active |
| Provider website | https://build.nvidia.com/ |
| Models | 13 public models |
| Credits routes | 13 |
| Zero data retention | no |
| Verified confidential inference | Not verified |
| Policy note | NVIDIA's hosted NIM API Catalog endpoints are preview services for development and prototyping. TrustedRouter exposes chat-capable models from its configured API Catalog key as Standard routes. NVIDIA requires an NVIDIA AI Enterprise entitlement for production deployments. NVIDIA does not publish hosted preview token rates, so TrustedRouter uses a conservative fallback price and excludes these routes from price indexing. Policy source |
Measured performance
27 samplesContinuously sampled across NVIDIA NIM's routed models: p50 TTFT, effective throughput, and success rate. Effective throughput uses provider-reported output tokens over complete request time. Unsupported route and probe-configuration rows are separated from provider downtime. No prompt or output content stored.
| p50 TTFT | 1675 ms |
|---|---|
| Effective throughput | 11 tok/s n=1 |
| Uptime | 33.33% |
| Model | p50 TTFT | Effective throughput | Uptime | Config excluded | Availability samples |
|---|---|---|---|---|---|
| nvidia/nemotron-3-super-120b-a12b | 649 ms | — | 100.00% | — | 4 |
| poolside/laguna-xs-2.1 | 1658 ms | — | 50.00% | — | 2 |
| openai/gpt-oss-20b | 1675 ms | — | 100.00% | — | 2 |
| mistralai/mistral-nemotron | 1698 ms | — | 33.33% | — | 3 |
| nvidia/nemotron-3-ultra-550b-a55b | 14912 ms | — | 50.00% | — | 2 |
| deepseek/deepseek-v4-flash-0731 | — | — | 0.00% | — | 2 |
| google/gemma-4-31b-it | — | 11 tok/s n=1 | 0.00% | — | 2 |
| meta-llama/llama-3.2-90b-vision-instruct | — | — | 0.00% | — | 4 |
| moonshotai/kimi-k3 | — | — | 0.00% | — | 3 |
| nvidia/nemotron-3-nano-omni-30b-a3b-reasoning | — | — | 0.00% | — | 1 |
| z-ai/glm-5.3-flash | — | — | 0.00% | — | 2 |
NVIDIA NIM performance history · Full provider & model leaderboard.
Models served by NVIDIA NIM.
Each row links to pricing, provider, benchmark, and API pages for the model.
| Model | AI IQ | Context | Input | Cached input | Output |
|---|---|---|---|---|---|
deepseek/deepseek-v4-flash-0731DeepSeek: DeepSeek V4 Flash 0731 |
— | 1,048,576 | $2.11/1M | Not published | $10.55/1M |
google/gemma-4-31b-itGoogle: Gemma 4 31B |
IQ 103#80 | 262,144 | $2.11/1M | Not published | $10.55/1M |
meta-llama/llama-3.2-11b-vision-instruct@cf/meta/llama-3.2-11b-vision-instruct |
— | 128,000 | $2.11/1M | Not published | $10.55/1M |
meta-llama/llama-3.2-90b-vision-instructmeta/llama-3.2-90b-vision-instruct |
— | 0 | $2.11/1M | Not published | $10.55/1M |
mistralai/mistral-nemotronmistralai/mistral-nemotron |
— | 0 | $2.11/1M | Not published | $10.55/1M |
moonshotai/kimi-k3MoonshotAI: Kimi K3 |
IQ 121#27 | 1,048,576 | $2.11/1M | Not published | $10.55/1M |
nvidia/nemotron-3-nano-omni-30b-a3b-reasoningnvidia/nemotron-3-nano-omni-30b-a3b-reasoning |
— | 0 | $2.11/1M | Not published | $10.55/1M |
nvidia/nemotron-3-super-120b-a12bNVIDIA: Nemotron 3 Super |
— | 262,144 | $2.11/1M | Not published | $10.55/1M |
nvidia/nemotron-3-ultra-550b-a55bNVIDIA: Nemotron 3 Ultra |
— | 262,144 | $2.11/1M | Not published | $10.55/1M |
nvidia/nemotron-3.5-lightning-30b-a3bnvidia/Nemotron-3.5-Lightning-30B-A3B |
— | 262,144 | $2.11/1M | Not published | $10.55/1M |
openai/gpt-oss-20bOpenAI: gpt-oss-20b |
IQ 93#113 | 131,072 | $2.11/1M | Not published | $10.55/1M |
poolside/laguna-xs-2.1poolside/laguna-xs-2.1 |
— | 0 | $2.11/1M | Not published | $10.55/1M |
z-ai/glm-5.3-flashZ.ai: GLM 5.3 Flash |
IQ 116#40 | 1,048,576 | $2.11/1M | Not published | $10.55/1M |
Questions
Does NVIDIA NIM have zero data retention?
TrustedRouter does not currently mark NVIDIA NIM as provider-level zero data retention. Use trustedrouter/zdr or provider.min_privacy=zdr to select a different eligible route, and review the linked policy source for changes.
Is NVIDIA NIM end-to-end encrypted?
TrustedRouter does not currently mark NVIDIA NIM as end-to-end encrypted at the provider boundary. The TrustedRouter gateway is still attested, but the selected provider normally receives the request in order to run the model. Use trustedrouter/e2e for the stronger route requirement.
Which NVIDIA NIM models are available through TrustedRouter?
This page currently lists 13 public NVIDIA NIM models, with live pricing, route count, context length, measured performance when available, and links to each model's provider and benchmark pages.