Llama-3.1-8B-Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

meta/llama-3.1-8b-instruct

Organization: Meta
Family: llama
Providers: 9
Context: 128,000
Output limit: 4,096
Knowledge: 2023-12
Release: 2024-07-23
Updated: 2024-07-23
Weights: Open
Input: text
Output: text
Capabilities: Tools, Temperature

Providers

Compare every cataloged offer for this model, including its provider, route, token limits, price, and capabilities.

14 offers · USD per million tokens

Provider	Model ID	Context	Output	Input / output · 1M	Reasoning	Tools	Structured	Details
Amazon Bedrock	us.meta.llama3-1-8b-instruct-v1:0	128,000	4,096	$0.22 / $0.22	No	Yes	—	View
Amazon Bedrock	meta.llama3-1-8b-instruct-v1:0	128,000	4,096	$0.22 / $0.22	No	Yes	—	View
Cloudflare Workers AI	@cf/meta/llama-3.1-8b-instruct-fp8	32,000	32,000	$0.152 / $0.287	No	No	No	View
CoreWeave	meta-llama/Llama-3.1-8B-Instruct	131,072	131,072	$0.22 / $0.22	No	Yes	Yes	View
Cortecs	llama-3.1-8b-instruct	128,000	128,000	$0.167 / $0.167	Yes	Yes	Yes	View
Hugging Face	meta-llama/Llama-3.1-8B-Instruct	131,072	4,096	$0.06 / $0.06	No	Yes	Yes	View
Kilo Gateway	meta-llama/llama-3.1-8b-instruct	131,072	117,964	$0.02 / $0.04	No	Yes	Yes	View
Merge Gateway	meta/llama-3.1-8b-instruct	128,000	2,048	$0.22 / $0.22	No	Yes	No	View
NanoGPT	meta-llama/llama-3.1-8b-instruct	131,072	16,384	$0.0544 / $0.085	No	Yes	No	View
Cloudflarevia OpenRouter	meta-llama/llama-3.1-8b-instruct fp8	32,000	28,800	$0.152 / $0.287	No	No	No	View
CoreWeavevia OpenRouter	meta-llama/llama-3.1-8b-instruct bf16	131,072	117,964	$0.22 / $0.22	No	Yes	Yes	View
DeepInfravia OpenRouter	meta-llama/llama-3.1-8b-instruct fp8	131,072	16,384	$0.02 / $0.04	No	No	No	View
Groqvia OpenRouter	meta-llama/llama-3.1-8b-instruct unknown	131,072	117,964	$0.05 / $0.08	No	Yes	No	View
Novitavia OpenRouter	meta-llama/llama-3.1-8b-instruct fp8	16,384	14,745	$0.02 / $0.05	No	No	No	View

Prices and limits apply to each offer. A dash means the value is not provided. OpenRouter offers show the hosting provider and routing channel separately.

Pricing

Compare token rates and cache charges across available routes and hosting configurations.

USD per million tokens

Input from$0.02Per 1M input tokens

Output from$0.04Per 1M output tokens

Available offers14Across 9 providers

Lowest listed input and output prices across the offers above; they may belong to different providers. These are base rates, before conditional pricing, discounts or additional fees.

Endpoint price comparisonLatest observed snapshot · 5 lowest-priced configurations

InputOutput

DeepInfradeepinfra/fp8

$0.02$0.04

Novitanovita/fp8

$0.02$0.05

Groqgroq

$0.05$0.08

Cloudflarecloudflare/fp8

$0.152$0.287

CoreWeavecoreweave/bf16

$0.22$0.22

meta-llama/llama-3.1-8b-instructObserved Oct 4, 2026, 11:31 AM UTC

Input: $0.05
Output: $0.08
Cache read: $0.025

Hosting prices through OpenRouter All endpoints and cache rates

Endpoint	Input / 1M	Output / 1M	Cache read / 1M	Cache write / 1M
Cloudflarecloudflare/fp8	$0.152	$0.287	—	—
CoreWeavecoreweave/bf16	$0.22	$0.22	$0.22	—
DeepInfradeepinfra/fp8	$0.02	$0.04	—	—
Groqgroq	$0.05	$0.08	$0.025	—
Novitanovita/fp8	$0.02	$0.05	—	—

Each row is a hosting configuration. Open an offer in Providers for its full pricing conditions and additional fees. Endpoint observations may differ from the routing catalog's base price.

Performance

Review reported latency and output-throughput percentiles from the latest observed rolling window.

Latest 30-minute observation

Time to first token · milliseconds

Latency distributionRolling 30-minute snapshot · 5 endpoints

P50P75P90P99

Cloudflarecloudflare/fp8

460–1,708.04 ms

CoreWeavecoreweave/bf16

325–1,304.53 ms

DeepInfradeepinfra/fp8

565–2,932.45 ms

Groqgroq

184–637.72 ms

Novitanovita/fp8

519–2,871.41 ms

All latency percentiles 5 endpoints

Endpoint	P50	P75	P90	P99
Cloudflarecloudflare/fp8	460 ms	635.75 ms	911.5 ms	1,708.04 ms
CoreWeavecoreweave/bf16	325 ms	486 ms	577 ms	1,304.53 ms
DeepInfradeepinfra/fp8	565 ms	1,236 ms	1,651.9 ms	2,932.45 ms
Groqgroq	184 ms	245 ms	317 ms	637.72 ms
Novitanovita/fp8	519 ms	587 ms	755 ms	2,871.41 ms

Output throughput · tokens per second

Throughput distributionRolling 30-minute snapshot · 5 endpoints

P50P75P90P99

Cloudflarecloudflare/fp8

17–24 t/s

CoreWeavecoreweave/bf16

125–157 t/s

DeepInfradeepinfra/fp8

33–68 t/s

Groqgroq

283–857 t/s

Novitanovita/fp8

95–173 t/s

All throughput percentiles 5 endpoints

Endpoint	P50	P75	P90	P99
Cloudflarecloudflare/fp8	17 t/s	19 t/s	21 t/s	24 t/s
CoreWeavecoreweave/bf16	125 t/s	142 t/s	147 t/s	157 t/s
DeepInfradeepinfra/fp8	33 t/s	39 t/s	44 t/s	68 t/s
Groqgroq	283 t/s	360 t/s	525 t/s	857 t/s
Novitanovita/fp8	95 t/s	127 t/s	150 t/s	173 t/s

Percentiles describe the observed request distribution. These are snapshots of a rolling window, not a historical time series.

Uptime

Compare successful request rates across the latest 5-minute, 30-minute, and 24-hour observations.

Successful requests by window

Availability by endpointCurrent overlapping windows · 5 endpoints

Endpoint5 minutes30 minutes24 hours

Cloudflarecloudflare/fp8Observed Oct 4, 2026, 11:31 AM UTC

100%

99.7%

CoreWeavecoreweave/bf16Observed Oct 4, 2026, 11:31 AM UTC

100%

DeepInfradeepinfra/fp8Observed Oct 4, 2026, 11:31 AM UTC

99.87%

99.96%

99.93%

GroqgroqObserved Oct 4, 2026, 11:31 AM UTC

99.72%

92.74%

99.36%

Novitanovita/fp8Observed Oct 4, 2026, 11:31 AM UTC

99.31%

99.58%

99.8%

Reported by OpenRouter at the time of collection; rate-limited requests are excluded. A dash means no measurement was reported. This is not a live availability check.

Benchmarks

Review attributed evaluation results on each source's original scale.

External evaluations

meta-llama/llama-3.1-8b-instructObserved Oct 4, 2026, 11:31 AM UTC

Benchmark profileArtificial Analysis · shared source scale from 0 to 10

Coding

5.4

Sources: Artificial Analysis and Design Arena, via OpenRouter. Scores retain their original scales and are not OpenAI Suite ratings.

Detailed evaluations

Evaluation scoresAccuracy or item F1 · higher is better

gpqa diamondMeta: Llama 3.1 8B Instruct

28.577%

tau bench verified airlineMeta: Llama 3.1 8B Instruct

21.467%

Evaluation	Configuration	Source	Results	Details
gpqa diamond	Meta: Llama 3.1 8B Instructmeta-llama/llama-3.1-8b-instruct	OpenRouter	28.577%	Details
tau bench verified airline	Meta: Llama 3.1 8B Instructmeta-llama/llama-3.1-8b-instruct	OpenRouter	21.467%	Details
Composite indices	Llama 3.1 Instruct 8Bmeta-llama/llama-3.1-8b-instruct	Artificial Analysis	Intelligence — · Coding 5.4 · Agentic —	Details

Sources: Artificial Analysis, Design Arena and OpenRouter. Evaluation configurations and scales differ; results are not interchangeable. Updated Oct 4, 2026.

Apps & session costs

Compare observed median session costs for applications using this model, grouped by conversation length.

30-day sample · through Sep 27, 2026

Application	Model route	Turns	Median cost / session	Details
Hermes Agent	meta-llama/llama-3.1-8b-instruct	1 turn	$0.000238	Details
Hermes Agent	meta-llama/llama-3.1-8b-instruct	2–9 turns	$0.003684	Details

Source: OpenRouter, as of Oct 2, 2026. Published under CC BY 4.0. These are observed costs per session, not token prices or a forecast for your workload. Apps are compared separately.

Technical details & API

Explore specifications, supported parameters, reasoning controls, and API identifiers for each OpenRouter route.

Current route specifications

meta-llama/llama-3.1-8b-instructObserved Oct 4, 2026, 11:31 AM UTC

Context: 131,072
Maximum output: 117,964
Tokenizer: Llama3
Input: text
Output: text
Moderation: No
Instruction format: llama3
Knowledge cutoff: 2023-12-31
Added to OpenRouter: 2024-07-23

Base URLhttps://openrouter.ai/api/v1

Model IDmeta-llama/llama-3.1-8b-instruct

Version IDmeta-llama/llama-3.1-8b-instruct

Weights IDmeta-llama/Meta-Llama-3.1-8B-Instruct

Supported parameters

frequency_penalty
logit_bias
logprobs
max_tokens
min_p
presence_penalty
repetition_penalty
response_format
seed
stop
structured_outputs
temperature
tool_choice
tools
top_k
top_logprobs
top_p

Frequently asked questions

Answers based on the model metadata and serving offers currently in the catalog.

How much does Llama-3.1-8B-Instruct cost?

Listed rates start at $0.02 per million input tokens and $0.04 per million output tokens. Prices vary by provider and configuration; see Pricing for details.

Which providers offer Llama-3.1-8B-Instruct?

There are 14 cataloged offers across 9 providers. Compare model IDs, prices and limits in Providers.

What is the context window?

The cataloged model context is 128,000 tokens. Each serving endpoint may apply a different limit.

Does it support tools and structured output?

Tool calling: Yes. Structured output: Not reported. Support can vary by endpoint.

Resources

Hugging Face ↗

Catalog history · 2 recorded revisions

Metadata observations since this model was first cataloged. These are not model release versions.

Sep 14, 2026 · e0edcd3bbe4d
Sep 12, 2026 · 8ff1df10e4d5