Llama 3.1 8B Instant

Model details

← Back

Llama 3.1 8B Instant

Model
llama-3.1-8b-instant
Provider
groq
API
openai-completions
Base URL
https://api.groq.com/openai/v1
Input
text
Reasoning
No
Context window
131,072
Max tokens
131,072
Cost / million input
$0.05
Cost / million output
$0.08
Cost / million cache read
$0
Cost / million cache write
$0

Also available from other providers

No obvious cross-provider matches found.

Model config JSON
{
  "providers": {
    "groq": {
      "apiKey": "YOUR_API_KEY",
      "models": [
        {
          "id": "llama-3.1-8b-instant",
          "name": "Llama 3.1 8B Instant",
          "reasoning": false,
          "input": [
            "text"
          ],
          "contextWindow": 131072,
          "maxTokens": 131072,
          "cost": {
            "input": 0.05,
            "output": 0.08,
            "cacheRead": 0,
            "cacheWrite": 0
          }
        }
      ],
      "api": "openai-completions",
      "baseUrl": "https://api.groq.com/openai/v1"
    }
  }
}