Route order log in sign up
1 pick your primary route

Meta: Llama 3.1 8B Instruct

meta-llama/llama-3.1-8b-instruct · agent · 131k ctx · added 2024-07-23
$0.0363·0.0642 /M effective hit 17% 5.41B/d

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

view
openrouter/meta-llama/llama-3.1-8b-instruct
Meta: Llama 3.1 8B Instruct · agent · 131k ctx
5.41B/d 17% $0.0363·0.0642 – 2y
sticker
life 429 tok/d dp age
¢ ¢ᵉ ¢ⁱ ✓ ★
deepinfra/fp8
$0.0200·0.0400 $0.0200·0.0400ⁱ $0.0193·0.0372ᵉ 0% – – 64% ✓ 626ms 28t/s 3mo ·
novita/fp8
$0.0200·0.0500 · $0.0200·0.0500ⁱ $0.0194·0.0466ᵉ · 0% · – – – · ✓ 518ms · 60t/s · ✕1mo ·
⚡
groq
$0.0500·0.0800·0.0250 $0.0358·0.0800ⁱ $0.0421·0.0763ᵉ 45% – – 28% ✓ 255ms 521t/s 3mo ·
cloudflare/fp8
$0.1520·0.2870 $0.1520·0.2870ⁱ $0.1511·0.2810ᵉ 0% – – 0.6% ✓ 437ms 18t/s 3mo ·
♻
coreweave/bf16
$0.2200·0.2200·0.2200 $0.2200·0.2200ⁱ $0.2192·0.2181ᵉ 57% – – 7.2% ✓ 324ms 134t/s 3mo ·
requesty/meta/llama-3.1-8b-instruct
llama-3.1-8b-instruct · text · 16k ctx
– $0.0500·0.0500 – 2y
hf/meta-llama/Llama-3.1-8B-Instruct
Llama-3.1-8B-Instruct · agent · 131k ctx
– $0.0200·0.0500 – 2y
compare all models →