Llama-3.3-70B-Instruct

The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks.

Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.

Model Card

meta/llama-3.3-70b-instruct

Organization: Meta
Family: llama
Providers: 23
Context: 128,000
Output limit: 4,096
Knowledge: 2023-12
Release: 2024-12-06
Updated: 2024-12-06
Weights: Open
Input: text
Output: text
Capabilities: Tools, Temperature

Providers

Compare every cataloged offer for this model, including its provider, route, token limits, price, and capabilities.

38 offers · USD per million tokens

Provider	Model ID	Context	Output	Input / output · 1M	Reasoning	Tools	Structured	Details
Abacus	meta-llama/Meta-Llama-3.3-70B-Instruct	131,072	8,192	$0.59 / $0.79	No	Yes	—	View
Amazon Bedrock	meta.llama3-3-70b-instruct-v1:0	128,000	4,096	$0.72 / $0.72	No	Yes	—	View
Amazon Bedrock	us.meta.llama3-3-70b-instruct-v1:0	128,000	4,096	$0.72 / $0.72	No	Yes	—	View
Cloudflare Workers AI	@cf/meta/llama-3.3-70b-instruct-fp8-fast	24,000	24,000	$0.293 / $2.253	No	Yes	No	View
CoreWeave	meta-llama/Llama-3.3-70B-Instruct	128,000	128,000	$0.71 / $0.71	No	Yes	Yes	View
Cortecs	llama-3.3-70b-instruct	131,000	131,000	$0.724 / $0.724	No	Yes	Yes	View
Crusoe	meta-llama/Llama-3.3-70B-Instruct	128,000	4,096	$0.25 / $0.75	No	Yes	—	View
DevPass (LLM Gateway)	llama-3.3-70b-instruct	131,072	4,096	$0.135 / $0.40	No	Yes	—	View
Eden AI	scaleway/llama-3.3-70b-instruct	128,000	4,096	$1.01025 / $1.01025	No	Yes	No	View
Eden AI	deepinfra/meta-llama/Llama-3.3-70B-Instruct	131,072	4,096	$0.10 / $0.32	No	Yes	Yes	View
Eden AI	ionos/meta-llama/Llama-3.3-70B-Instruct	128,000	4,096	$0.729625 / $0.729625	No	No	No	View
evroc	nvidia/Llama-3.3-70B-Instruct-FP8	128,000	4,096	$1.15 / $1.15	No	Yes	—	View
GreenPT	llama-3.3-70b-instruct	100,000	16,384	$1.254 / $1.254	No	Yes	—	View
Hugging Face	meta-llama/Llama-3.3-70B-Instruct	131,072	4,096	$0.59 / $0.79	No	Yes	Yes	View
Kilo Gateway	meta-llama/llama-3.3-70b-instruct	131,072	16,384	$0.10 / $0.32	No	Yes	Yes	View
LLM Gateway	cerebras/llama-3.3-70b-instruct	128,000	4,096	$0.85 / $1.20	No	Yes	No	View
LLM Gateway	novita/llama-3.3-70b-instruct	131,072	120,000	$0.135 / $0.40	No	Yes	No	View
Merge Gateway	meta/llama-3.3-70b-instruct	131,072	32,768	$0.22 / $0.50	No	Yes	No	View
NanoGPT	meta-llama/llama-3.3-70b-instruct	131,072	16,384	$0.05 / $0.23	No	Yes	Yes	View
Neon	meta-llama-3-3-70b-instruct	128,000	8,192	$0.50 / $1.50	No	Yes	Yes	View
OCI Generative AI	meta.llama-3.3-70b-instruct	128,000	4,096	$0.72 / $0.72	No	No	—	View
AkashMLvia OpenRouter	meta-llama/llama-3.3-70b-instruct fp8	131,072	128,000	$0.20 / $0.52	No	Yes	Yes	View
Cloudflarevia OpenRouter	meta-llama/llama-3.3-70b-instruct fp8	24,000	21,600	$0.293 / $2.253	No	No	No	View
CoreWeavevia OpenRouter	meta-llama/llama-3.3-70b-instruct fp16	128,000	115,200	$0.71 / $0.71	No	Yes	Yes	View
DeepInfravia OpenRouter	meta-llama/llama-3.3-70b-instruct fp8	131,072	16,384	$0.10 / $0.32	No	Yes	Yes	View
Googlevia OpenRouter	meta-llama/llama-3.3-70b-instruct unknown	128,000	8,192	$0.72 / $0.72	No	Yes	Yes	View
Googlevia OpenRouter	meta-llama/llama-3.3-70b-instruct unknown	128,000	115,200	$0.72 / $0.72	No	No	No	View
Groqvia OpenRouter	meta-llama/llama-3.3-70b-instruct unknown	131,072	32,768	$0.59 / $0.79	No	Yes	No	View
Novitavia OpenRouter	meta-llama/llama-3.3-70b-instruct bf16	12,288	11,059	$0.135 / $0.40	No	Yes	No	View
Parasailvia OpenRouter	meta-llama/llama-3.3-70b-instruct fp8	131,072	16,384	$0.22 / $0.50	No	No	Yes	View
PrimeIntellectvia OpenRouter	meta-llama/llama-3.3-70b-instruct unknown	131,072	16,384	$1.04 / $2.253	No	Yes	Yes	View
SambaNovavia OpenRouter	meta-llama/llama-3.3-70b-instruct unknown	131,072	3,072	$0.45 / $0.90	No	No	Yes	View
Togethervia OpenRouter	meta-llama/llama-3.3-70b-instruct unknown	131,072	2,048	$1.04 / $1.04	No	Yes	Yes	View
Pendra	llama3.3:70b	128,000	4,096	$0.00 / $0.00	No	Yes	—	View
Pioneer	meta-llama/Llama-3.3-70B-Instruct	16,384	16,384	$0.90 / $0.90	No	Yes	—	View
Snowflake Cortex	snowflake-llama3.3-70b	128,000	4,096	— / —	No	Yes	—	View
Tinfoil	llama3-3-70b	131,072	4,096	$1.75 / $2.75	No	Yes	—	View
watsonx.ai	meta-llama/llama-3-3-70b-instruct	131,072	4,096	$0.7526 / $0.7526	No	Yes	—	View

Prices and limits apply to each offer. A dash means the value is not provided. OpenRouter offers show the hosting provider and routing channel separately.

Pricing

Compare token rates and cache charges across available routes and hosting configurations.

USD per million tokens

Input from$0.00Per 1M input tokens

Output from$0.00Per 1M output tokens

Available offers38Across 23 providers

Lowest listed input and output prices across the offers above; they may belong to different providers. These are base rates, before conditional pricing, discounts or additional fees.

Endpoint price comparisonLatest observed snapshot · 10 lowest-priced configurations

InputOutput

DeepInfradeepinfra/turbo

$0.10$0.32

Novitanovita/bf16

$0.135$0.40

AkashMLakashml/fp8

$0.20$0.52

Parasailparasail/fp8

$0.22$0.50

Cloudflarecloudflare/fp8

$0.293$2.253

SambaNovasambanova-turbo

$0.45$0.90

Groqgroq

$0.59$0.79

CoreWeavecoreweave/fp16

$0.71$0.71

Googlegoogle-vertex/us-central1

$0.72$0.72

Googlegoogle-vertex

$0.72$0.72

meta-llama/llama-3.3-70b-instructObserved Oct 4, 2026, 11:31 AM UTC

Input: $0.22
Output: $0.50
Cache read: $0.11

Hosting prices through OpenRouter All endpoints and cache rates

Endpoint	Input / 1M	Output / 1M	Cache read / 1M	Cache write / 1M
AkashMLakashml/fp8	$0.20	$0.52	$0.10	—
Cloudflarecloudflare/fp8	$0.293	$2.253	—	—
CoreWeavecoreweave/fp16	$0.71	$0.71	$0.71	—
DeepInfradeepinfra/turbo	$0.10	$0.32	—	—
Googlegoogle-vertex/us-central1	$0.72	$0.72	—	—
Googlegoogle-vertex	$0.72	$0.72	—	—
Groqgroq	$0.59	$0.79	$0.295	—
Novitanovita/bf16	$0.135	$0.40	—	—
Parasailparasail/fp8	$0.22	$0.50	$0.11	—
PrimeIntellectprimeintellect	$1.04	$2.253	—	—
SambaNovasambanova-turbo	$0.45	$0.90	—	—
Togethertogether	$1.04	$1.04	—	—

Each row is a hosting configuration. Open an offer in Providers for its full pricing conditions and additional fees. Endpoint observations may differ from the routing catalog's base price.

Performance

Review reported latency and output-throughput percentiles from the latest observed rolling window.

Latest 30-minute observation

Time to first token · milliseconds

Latency distributionRolling 30-minute snapshot · 6 endpoints

P50P75P90P99

AkashMLakashml/fp8

1,359–6,016.72 ms

Cloudflarecloudflare/fp8

380–3,809.9 ms

CoreWeavecoreweave/fp16

1,108–10,493.22 ms

DeepInfradeepinfra/turbo

368–3,470.18 ms

Groqgroq

344–1,259.36 ms

Novitanovita/bf16

966–4,817.44 ms

All latency percentiles 10 endpoints

Endpoint	P50	P75	P90	P99
AkashMLakashml/fp8	1,359 ms	1,972 ms	2,714.8 ms	6,016.72 ms
Cloudflarecloudflare/fp8	380 ms	599 ms	1,035 ms	3,809.9 ms
CoreWeavecoreweave/fp16	1,108 ms	2,247.5 ms	4,943 ms	10,493.22 ms
DeepInfradeepinfra/turbo	368 ms	586 ms	1,003.9 ms	3,470.18 ms
Groqgroq	344 ms	479 ms	642 ms	1,259.36 ms
Novitanovita/bf16	966 ms	1,399 ms	1,863.6 ms	4,817.44 ms
Parasailparasail/fp8	604 ms	901 ms	1,444.9 ms	3,957.9 ms
PrimeIntellectprimeintellect	485 ms	676.25 ms	916 ms	1,331.27 ms
SambaNovasambanova-turbo	544.5 ms	782 ms	1,183.1 ms	2,337.42 ms
Togethertogether	439 ms	656.5 ms	970 ms	2,804.54 ms

Output throughput · tokens per second

Throughput distributionRolling 30-minute snapshot · 6 endpoints

P50P75P90P99

AkashMLakashml/fp8

33–49 t/s

Cloudflarecloudflare/fp8

44.5–76.83 t/s

CoreWeavecoreweave/fp16

52–85 t/s

DeepInfradeepinfra/turbo

20–30 t/s

Groqgroq

259–429.09 t/s

Novitanovita/bf16

34–48.67 t/s

All throughput percentiles 10 endpoints

Endpoint	P50	P75	P90	P99
AkashMLakashml/fp8	33 t/s	38 t/s	42 t/s	49 t/s
Cloudflarecloudflare/fp8	44.5 t/s	58 t/s	68.3 t/s	76.83 t/s
CoreWeavecoreweave/fp16	52 t/s	63 t/s	72 t/s	85 t/s
DeepInfradeepinfra/turbo	20 t/s	24 t/s	26 t/s	30 t/s
Groqgroq	259 t/s	317 t/s	355 t/s	429.09 t/s
Novitanovita/bf16	34 t/s	40 t/s	45 t/s	48.67 t/s
Parasailparasail/fp8	44 t/s	60 t/s	81 t/s	124 t/s
PrimeIntellectprimeintellect	58 t/s	68.25 t/s	87.7 t/s	219.03 t/s
SambaNovasambanova-turbo	124 t/s	169 t/s	228 t/s	301.6 t/s
Togethertogether	54 t/s	69 t/s	89.4 t/s	141.28 t/s

Percentiles describe the observed request distribution. These are snapshots of a rolling window, not a historical time series.

Uptime

Compare successful request rates across the latest 5-minute, 30-minute, and 24-hour observations.

Successful requests by window

Availability by endpointCurrent overlapping windows · 12 endpoints

Endpoint5 minutes30 minutes24 hours

AkashMLakashml/fp8Observed Oct 4, 2026, 11:31 AM UTC

94.34%

98.58%

99.51%

Cloudflarecloudflare/fp8Observed Oct 4, 2026, 11:31 AM UTC

93.07%

91.36%

95.48%

CoreWeavecoreweave/fp16Observed Oct 4, 2026, 11:31 AM UTC

97.05%

97.95%

99.59%

DeepInfradeepinfra/turboObserved Oct 4, 2026, 11:31 AM UTC

99.98%

99.91%

99.07%

Googlegoogle-vertex/us-central1Observed Oct 4, 2026, 11:31 AM UTC

—

Googlegoogle-vertexObserved Oct 4, 2026, 11:31 AM UTC

—

GroqgroqObserved Oct 4, 2026, 11:31 AM UTC

99.66%

99.8%

99.82%

Novitanovita/bf16Observed Oct 4, 2026, 11:31 AM UTC

99.46%

98.09%

96.31%

Parasailparasail/fp8Observed Oct 4, 2026, 11:31 AM UTC

99.32%

99.21%

99.14%

PrimeIntellectprimeintellectObserved Oct 4, 2026, 11:31 AM UTC

100%

98.55%

99.05%

SambaNovasambanova-turboObserved Oct 4, 2026, 11:31 AM UTC

100%

99.88%

99.44%

TogethertogetherObserved Oct 4, 2026, 11:31 AM UTC

98.28%

99.38%

97.93%

Reported by OpenRouter at the time of collection; rate-limited requests are excluded. A dash means no measurement was reported. This is not a live availability check.

Benchmarks

Review attributed evaluation results on each source's original scale.

External evaluations

meta-llama/llama-3.3-70b-instructObserved Oct 4, 2026, 11:31 AM UTC

Benchmark profileArtificial Analysis · shared source scale from 0 to 20

Coding

11.9

Sources: Artificial Analysis and Design Arena, via OpenRouter. Scores retain their original scales and are not OpenAI Suite ratings.

Detailed evaluations

Evaluation scoresAccuracy or item F1 · higher is better

tau bench verified airlineMeta: Llama 3.3 70B Instruct

34.006%

gpqa diamondMeta: Llama 3.3 70B Instruct

47.327%

Evaluation	Configuration	Source	Results	Details
tau bench verified airline	Meta: Llama 3.3 70B Instructmeta-llama/llama-3.3-70b-instruct	OpenRouter	34.006%	Details
gpqa diamond	Meta: Llama 3.3 70B Instructmeta-llama/llama-3.3-70b-instruct	OpenRouter	47.327%	Details
Composite indices	Llama 3.3 Instruct 70Bmeta-llama/llama-3.3-70b-instruct	Artificial Analysis	Intelligence — · Coding 11.9 · Agentic —	Details

Sources: Artificial Analysis, Design Arena and OpenRouter. Evaluation configurations and scales differ; results are not interchangeable. Updated Oct 4, 2026.

Apps & session costs

Compare observed median session costs for applications using this model, grouped by conversation length.

30-day sample · through Sep 27, 2026

Application	Model route	Turns	Median cost / session	Details
Hermes Agent	meta-llama/llama-3.3-70b-instruct	10–49 turns	$0.00944	Details
Hermes Agent	meta-llama/llama-3.3-70b-instruct	2–9 turns	$0.004097	Details
Hermes Agent	meta-llama/llama-3.3-70b-instruct	1 turn	$0.001918	Details

Source: OpenRouter, as of Oct 2, 2026. Published under CC BY 4.0. These are observed costs per session, not token prices or a forecast for your workload. Apps are compared separately.

Technical details & API

Explore specifications, supported parameters, reasoning controls, and API identifiers for each OpenRouter route.

Current route specifications

meta-llama/llama-3.3-70b-instructObserved Oct 4, 2026, 11:31 AM UTC

Context: 131,072
Maximum output: 16,384
Tokenizer: Llama3
Input: text
Output: text
Moderation: No
Instruction format: llama3
Knowledge cutoff: 2023-12-31
Added to OpenRouter: 2024-12-06

Base URLhttps://openrouter.ai/api/v1

Model IDmeta-llama/llama-3.3-70b-instruct

Version IDmeta-llama/llama-3.3-70b-instruct

Weights IDmeta-llama/Llama-3.3-70B-Instruct

Supported parameters

frequency_penalty
logit_bias
logprobs
max_tokens
min_p
presence_penalty
repetition_penalty
response_format
seed
stop
structured_outputs
temperature
tool_choice
tools
top_k
top_logprobs
top_p

Frequently asked questions

Answers based on the model metadata and serving offers currently in the catalog.

How much does Llama-3.3-70B-Instruct cost?

Listed rates start at $0.00 per million input tokens and $0.00 per million output tokens. Prices vary by provider and configuration; see Pricing for details.

Which providers offer Llama-3.3-70B-Instruct?

There are 38 cataloged offers across 23 providers. Compare model IDs, prices and limits in Providers.

What is the context window?

The cataloged model context is 128,000 tokens. Each serving endpoint may apply a different limit.

Does it support tools and structured output?

Tool calling: Yes. Structured output: Not reported. Support can vary by endpoint.

Resources

Hugging Face ↗

Catalog history · 2 recorded revisions

Metadata observations since this model was first cataloged. These are not model release versions.

Sep 14, 2026 · cafdb74fee26
Sep 12, 2026 · 8e4e79035892