Free to start

Meta: Llama 3.1 8B Instruct

Try Llama 3.1 8B Instruct on us. Starter credit covers your first requests, then one key reaches all 5 provider routes with automatic failover.

`meta-llama/llama-3.1-8b-instruct`

open weights US providers Meta

All models

Publisher	Metameta
AI IQ	No AI IQ profile matched yet.
Context	131,072 tokens
Providers	Telnyx ZDR Novita AI Weights & Biases Nscale Databricks
Credits routes	5 provider routes
Modes	chat open weights US providers
Billing	Credits

Current route evidence

Live leaderboard

$0.0211/1MLowest Credits input price

$0.05275/1MLowest Credits output price

865 msFastest measured p50 TTFT via telnyx

not enough dataHighest measured throughput

Recent provider-route uptime spans 100.00% across 5 routes and 5 providers. Price comes from the current Credits catalog. Speed and uptime come from routed probes rather than vendor claims.

All route prices All providers

Providers serving this model

Sorted by lowest combined prompt and completion price. Use "provider": {"sort": "throughput"} in the request body (or append :nitro to the model id) to route to the fastest provider instead.

Trust boundary: TR router attestation verifies the TrustedRouter gateway only. Provider policy separately describes the upstream model host's retention, confidential compute, and E2EE posture. Company country is separate from inference location. Weight formats are source-backed declarations, not per-request proofs.

Provider	Input	Cached input	Output	Weight format	Provider policy	Company / inference location	Measured speed
Novita AInovita	$0.0211/1M	Not published	$0.05275/1M	Unknown	privacy unknown Retention details No provider-ZDR claim is tracked here. Novita's privacy policy says personal information is not used for model training; customer-content processing is governed by customer agreements. Provider policy source	Operator country: US Location details Headquarters / registered office: San Francisco, California, United States. Company location source (reviewed 2026-09-27). Inference: Shared inference API; processing countries unconfirmed, no fixed-region commitment. No exhaustive inference-country list verified for the shared model API. Novita publishes worldwide GPU rental regions, but that separate product does not establish shared serverless model placement. Region pinning through TR: Not supported by the current TrustedRouter integration. Reviewed 2026-10-28. GPU rental regions (different product) Native model catalog Full location evidence	TTFT: insufficient data Speed: insufficient data
Nscalenscale	$0.0633/1M	Not published	$0.0633/1M	Unknown	no verified privacy claim Retention details Nscale publishes a general nonlogging statement for serverless inference, but TrustedRouter has not verified a contractual zero-retention commitment for this account. These routes remain Standard and make no confidential-compute or E2EE claim. Provider policy source	Operator country: GB Location details Headquarters / registered office: Not verified. Inference: Inference location not verified; no country-specific residency commitment. No inference-location declaration has been verified for this provider. Region pinning through TR: No verified provider-specific location pin documented here. Full location evidence	TTFT: 1.78 s Speed: insufficient data Last sample: 2026-10-31T09:12:39.000Z
Telnyxtelnyx	$0.211/1M	$0.211/1M	$0.211/1M	Unknown	ZDR Retention details Telnyx's published policy states zero data retention for Telnyx-hosted /v2/ai/openai/chat/completions and /v2/ai/openai/embeddings: content is processed in memory and discarded after the response; request metadata is retained. TrustedRouter currently publishes hosted chat routes and adapts Responses to chat completions. Stateful Responses, AI Assistants with conversation history, third-party models and /v2/ai/embeddings are outside this ZDR scope. OpenAI-compatible embeddings may run in any region. DPA 3.1 restricts training of models available to others, with exceptions for written opt-in or data de-identified under 3.5. This is policy-backed ZDR, not confidential compute or verified end-to-end attestation. Provider policy source	Operator country: US Location details Headquarters / registered office: Austin, Texas, United States. Company location source (reviewed 2026-09-27). Inference: Multi-region, dynamically routed among the model's available Telnyx regions; no fixed inference-region commitment on this TrustedRouter route. Provider-wide GPU region set. Model availability is narrower; see the catalog snapshot below. Germany in the storage-locality documentation does not establish Germany as the inference country. Region pinning through TR: Not supported by the current TrustedRouter integration: it uses api.telnyx.com without Telnyx's strict region controls. Do not send Telnyx-specific region/mode fields as a TrustedRouter pin. Reviewed 2026-09-26. Inference regions and strict pinning Processing versus storage Native model catalog (authentication required) Full location evidence	TTFT: 0.86 s Speed: insufficient data Last sample: 2026-10-31T06:10:54.000Z
Weights & Biaseswandb	$0.2321/1M	Not published	$0.2321/1M	Unknown	no verified privacy claim Retention details W&B Serverless Inference runs on CoreWeave infrastructure. W&B does not publish a zero-retention, confidential-compute, or end-to-end-encryption commitment for this service, so these routes use the Standard privacy tier. TrustedRouter does not enable W&B Weave tracing for provider calls. Provider policy source	Operator country: US Location details Headquarters / registered office: Not verified. Inference: Inference location not verified; no country-specific residency commitment. No inference-location declaration has been verified for this provider. Region pinning through TR: No verified provider-specific location pin documented here. Full location evidence	TTFT: 1.15 s Speed: insufficient data Last sample: 2026-10-31T08:27:40.000Z
Databricksdatabricks	$0.15825/1M	Not published	$0.47475/1M	Unknown	no verified privacy claim Retention details Databricks Foundation Model APIs are a Designated Service and pay-per-token workloads are HIPAA compliant. Databricks may temporarily process or store inputs and outputs for abuse prevention, and may process data outside the originating cloud or region. This route is therefore standard privacy, not ZDR, confidential compute, or end-to-end encrypted. Provider policy source	Operator country: US Location details Headquarters / registered office: Not verified. Inference: Inference location not verified; no country-specific residency commitment. No inference-location declaration has been verified for this provider. Region pinning through TR: No verified provider-specific location pin documented here. Full location evidence	TTFT: 1.71 s Speed: insufficient data Last sample: 2026-10-31T08:07:47.000Z

Speed is the median (p50) from TR's recent measured requests for this exact model and provider, refreshed from the cached leaderboard. At least two timing samples are required; workload and network conditions affect results. Performance details

Compare Meta: Llama 3.1 8B Instruct

All comparisons

Meta: Llama 3.1 8B Instruct vs Z.ai: GLM 5.338 combined provider routes
Meta: Llama 3.1 8B Instruct vs Z.ai: GLM 5.237 combined provider routes
Meta: Llama 3.1 8B Instruct vs Z.ai: GLM 5.3 Flash37 combined provider routes
Meta: Llama 3.1 8B Instruct vs MoonshotAI: Kimi K333 combined provider routes
DeepSeek: DeepSeek V4 Flash 0731 vs Meta: Llama 3.1 8B Instruct31 combined provider routes
DeepSeek: DeepSeek V4.1 Flash vs Meta: Llama 3.1 8B Instruct29 combined provider routes

Questions

What model ID should I use for Meta: Llama 3.1 8B Instruct?

Use meta-llama/llama-3.1-8b-instruct as the model field with the TrustedRouter OpenAI-compatible API. Credits routing and provider fallback happen behind that model ID.

Which providers serve Meta: Llama 3.1 8B Instruct?

TrustedRouter currently lists Telnyx, Novita AI, Weights & Biases, Nscale, and Databricks for Meta: Llama 3.1 8B Instruct. Provider availability and routing eligibility can change as catalog and health data update.

How much does Meta: Llama 3.1 8B Instruct cost through TrustedRouter?

The current lowest Credits input price is $0.0211/1M and the lowest Credits output price is $0.05275/1M. Prices are per one million tokens and come from the current route catalog.

How do I require zero data retention for Meta: Llama 3.1 8B Instruct?

Set provider.min_privacy to zdr on the request. TrustedRouter considers only routes with a recorded zero-data-retention posture and fails closed if no eligible route remains.