Free to start

Meta: Llama 3.1 70B Instruct

Try Llama 3.1 70B Instruct on us. Starter credit covers your first requests, then one key reaches all 2 provider routes with automatic failover.

`meta-llama/llama-3.1-70b-instruct`

open weights US providers EU-focused Meta

All models

Publisher	Metameta
AI IQ	No AI IQ profile matched yet.
Context	131,072 tokens
Providers	Telnyx ZDR DeepInfra
Credits routes	2 provider routes
Modes	chat open weights US providers EU-focused
Billing	Credits

Current route evidence

Live leaderboard

$0.422/1MLowest Credits input price

$0.422/1MLowest Credits output price

not enough dataFastest measured p50 TTFT

not enough dataHighest measured throughput

Recent provider-route uptime spans 100.00% across 2 routes and 2 providers. Price comes from the current Credits catalog. Speed and uptime come from routed probes rather than vendor claims.

All route prices All providers

Providers serving this model

Sorted by lowest combined prompt and completion price. Use "provider": {"sort": "throughput"} in the request body (or append :nitro to the model id) to route to the fastest provider instead.

Trust boundary: TR router attestation verifies the TrustedRouter gateway only. Provider policy separately describes the upstream model host's retention, confidential compute, and E2EE posture. Company country is separate from inference location. Weight formats are source-backed declarations, not per-request proofs.

Provider	Input	Cached input	Output	Weight format	Provider policy	Company / inference location	Measured speed
DeepInfradeepinfra	$0.422/1M	Not published	$0.422/1M	Unknown	no verified privacy claim Retention details Tracked as no-store, not strict ZDR. DeepInfra documents memory-only handling and no training for ordinary inference, but reserves the right to log a small portion of requests for debugging or security. Google- and Anthropic-backed routes also inherit those vendors' terms. Provider policy source	Operator country: US Location details Headquarters / registered office: Palo Alto, California, United States. Company location source (reviewed 2026-09-27). Inference: US infrastructure plus announced Canadian capacity; model-specific residency unconfirmed. DeepInfra describes US infrastructure and announced its first international data center in Toronto on July 8, 2026. This is a provider footprint, not an exhaustive or model-specific placement list. DeepSeek V4.1 Flash placement has not been confirmed; do not declare this route US-only. Region pinning through TR: Not supported by the current TrustedRouter integration. Reviewed 2026-09-27. DeepInfra infrastructure statement DeepInfra Toronto announcement Full location evidence	TTFT: insufficient data Speed: insufficient data
Telnyxtelnyx	$0.633/1M	$0.633/1M	$0.633/1M	Unknown	ZDR Retention details Telnyx's published policy states zero data retention for Telnyx-hosted /v2/ai/openai/chat/completions and /v2/ai/openai/embeddings: content is processed in memory and discarded after the response; request metadata is retained. TrustedRouter currently publishes hosted chat routes and adapts Responses to chat completions. Stateful Responses, AI Assistants with conversation history, third-party models and /v2/ai/embeddings are outside this ZDR scope. OpenAI-compatible embeddings may run in any region. DPA 3.1 restricts training of models available to others, with exceptions for written opt-in or data de-identified under 3.5. This is policy-backed ZDR, not confidential compute or verified end-to-end attestation. Provider policy source	Operator country: US Location details Headquarters / registered office: Austin, Texas, United States. Company location source (reviewed 2026-09-27). Inference: Multi-region, dynamically routed among the model's available Telnyx regions; no fixed inference-region commitment on this TrustedRouter route. Provider-wide GPU region set. Model availability is narrower; see the catalog snapshot below. Germany in the storage-locality documentation does not establish Germany as the inference country. Region pinning through TR: Not supported by the current TrustedRouter integration: it uses api.telnyx.com without Telnyx's strict region controls. Do not send Telnyx-specific region/mode fields as a TrustedRouter pin. Reviewed 2026-09-26. Inference regions and strict pinning Processing versus storage Native model catalog (authentication required) Full location evidence	TTFT: insufficient data Speed: insufficient data Last sample: 2026-10-30T22:49:16.000Z

Speed is the median (p50) from TR's recent measured requests for this exact model and provider, refreshed from the cached leaderboard. At least two timing samples are required; workload and network conditions affect results. Performance details

Compare Meta: Llama 3.1 70B Instruct

All comparisons

DeepSeek: DeepSeek V4 Flash 0731 vs Meta: Llama 3.1 70B Instruct28 combined provider routes

Questions

What model ID should I use for Meta: Llama 3.1 70B Instruct?

Use meta-llama/llama-3.1-70b-instruct as the model field with the TrustedRouter OpenAI-compatible API. Credits routing and provider fallback happen behind that model ID.

Which providers serve Meta: Llama 3.1 70B Instruct?

TrustedRouter currently lists Telnyx, and DeepInfra for Meta: Llama 3.1 70B Instruct. Provider availability and routing eligibility can change as catalog and health data update.

How much does Meta: Llama 3.1 70B Instruct cost through TrustedRouter?

The current lowest Credits input price is $0.422/1M and the lowest Credits output price is $0.422/1M. Prices are per one million tokens and come from the current route catalog.

How do I require zero data retention for Meta: Llama 3.1 70B Instruct?

Set provider.min_privacy to zdr on the request. TrustedRouter considers only routes with a recorded zero-data-retention posture and fails closed if no eligible route remains.