Llama 3.1 70B Instruct

Model details

← Back

Llama 3.1 70B Instruct

Model
meta.llama3-1-70b-instruct-v1:0
Provider
amazon-bedrock
API
bedrock-converse-stream
Base URL
https://bedrock-runtime.us-east-1.amazonaws.com
Input
text
Reasoning
No
Context window
128,000
Max tokens
4,096
Cost / million input
$0.72
Cost / million output
$0.72
Cost / million cache read
$0
Cost / million cache write
$0

Also available from other providers

Model config JSON
{
  "providers": {
    "amazon-bedrock": {
      "apiKey": "YOUR_API_KEY",
      "models": [
        {
          "id": "meta.llama3-1-70b-instruct-v1:0",
          "name": "Llama 3.1 70B Instruct",
          "reasoning": false,
          "input": [
            "text"
          ],
          "contextWindow": 128000,
          "maxTokens": 4096,
          "cost": {
            "input": 0.72,
            "output": 0.72,
            "cacheRead": 0,
            "cacheWrite": 0
          }
        }
      ],
      "api": "bedrock-converse-stream",
      "baseUrl": "https://bedrock-runtime.us-east-1.amazonaws.com"
    }
  }
}