The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model...
text->text| Provider | Region / Tag | Context | Input/M | Output/M | Uptime 1d | Latency | Quant | Cache |
|---|---|---|---|---|---|---|---|---|
google-vertex/us-central1 | 128K | $0.720 | $0.720 | 100.00% | - | - | - | |
| WandB | wandb/fp16 | 128K | $0.710 | $0.710 | 99.68% | - | fp16 | - |
| SambaNova | sambanova-turbo | 16K | $0.450 | $0.900 | 99.35% | - | bf16 | - |
| SambaNova | sambanova/bf16 | 131K | $0.600 | $1.20 | 99.26% | - | bf16 | - |
| Groq | groq | 131K | $0.590 | $0.790 | 99.01% | - | - | - |
| Together | together/fp8 | 131K | $1.04 | $1.04 | 98.48% | - | fp8 | - |
| Parasail | parasail/fp8 | 131K | $0.220 | $0.500 | 98.37% | - | fp8 | - |
| AkashML | akashml/fp8 | 131K | $0.130 | $0.400 | 98.01% | - | fp8 | - |
| Novita | novita/bf16 | 131K | $0.135 | $0.400 | 97.15% | - | bf16 | - |
| Nebius | nebius/fp8 | 131K | $0.130 | $0.400 | 97.10% | - | fp8 | - |
| DeepInfra | deepinfra/turbo | 131K | $0.100 | $0.320 | 96.66% | - | fp8 | - |
| Cloudflare | cloudflare/fp8 | 24K | $0.293 | $2.25 | 94.16% | - | fp8 | - |
google-vertex | 128K | $0.720 | $0.720 | 93.71% | - | - | - |
| Rank | Category | Variant | Trend | Elo | Votes |
|---|---|---|---|---|---|
| #182 | Japanese | - | 1213 | 1,121 | |
| #186 | French | - | 1327 | 536 | |
| #188 | German | - | 1291 | 1,182 | |
| #194 | Spanish | - | 1300 | 590 | |
| #195 | Industry Legal And Government | - | 1342 | 3,174 | |
| #200 | Korean | - | 1212 | 847 | |
| #201 | Industry Medicine And Healthcare | - | 1340 | 2,747 | |
| #205 | English | - | 1344 | 30,156 | |
| #205 | Industry Life And Physical And Social Science | - | 1340 | 9,377 | |
| #207 | Multi Turn | - | 1317 | 9,139 | |
| #210 | Industry Entertainment And Sports And Media | - | 1285 | 9,756 | |
| #212 | Creative Writing | - | 1286 | 8,069 | |
| #212 | Industry Mathematical | - | 1302 | 5,232 | |
| #212 | Math | - | 1296 | 5,777 | |
| #216 | Hard Prompts English | - | 1338 | 10,092 | |
| #217 | Exclude Ties | - | 1262 | 36,928 | |
| #217 | Expert | - | 1294 | 2,895 | |
| #217 | Overall | - | 1318 | 54,734 | |
| #222 | Hard Prompts | - | 1321 | 17,019 | |
| #222 | Industry Business And Management And Financial Operations | - | 1304 | 6,671 | |
| #225 | Russian | - | 1292 | 5,441 | |
| #226 | Industry Writing And Literature And Language | - | 1291 | 13,835 | |
| #227 | Instruction Following | - | 1292 | 18,787 | |
| #227 | Longer Query | - | 1312 | 8,306 | |
| #228 | Coding | - | 1345 | 8,746 | |
| #228 | Industry Software And It Services | - | 1339 | 14,964 | |
| #234 | Chinese | - | 1291 | 3,408 |