- Model
llama3-8b-8192- Provider
groq- API
openai-completions- Base URL
https://api.groq.com/openai/v1- Input
- text
- Reasoning
- No
- Context window
- 8,192
- Max tokens
- 8,192
- Cost / million input
- $0.05
- Cost / million output
- $0.08
- Cost / million cache read
- $0
- Cost / million cache write
- $0
Model config JSON
{
"providers": {
"groq": {
"apiKey": "YOUR_API_KEY",
"models": [
{
"id": "llama3-8b-8192",
"name": "Llama 3 8B",
"reasoning": false,
"input": [
"text"
],
"contextWindow": 8192,
"maxTokens": 8192,
"cost": {
"input": 0.05,
"output": 0.08,
"cacheRead": 0,
"cacheWrite": 0
}
}
],
"api": "openai-completions",
"baseUrl": "https://api.groq.com/openai/v1"
}
}
}