Skip to content
MetaChatllama-3.1-70b-instruct

Llama 3.1 70B Instruct

Llama 3.1 70B Instruct for OpenAI-style Chat Completions, Anthropic-style Messages, OpenAI-style Responses.

Explore Llama 3.1 70B Instruct for OpenAI-style Chat Completions, Anthropic-style Messages, OpenAI-style Responses through the unified API. Supported interfaces and current availability are shown below.

  • OpenAI-style Chat Completions
  • Anthropic-style Messages
  • OpenAI-style Responses

Model details

Context window
128K tokens
Max output
2K tokens
Input
Text
Output
Text
Capabilities
Streaming
Interfaces
OpenAI-style Chat Completions, Anthropic-style Messages, OpenAI-style Responses

Pricing

Per 1M tokens. The Cloakray price is what you are charged — no gateway fee is added on top of it.

Llama 3.1 70B Instruct pricing.
MetricPrice
Input$0.792
Cached inputPrice not published
Output$0.792

Why teams pick it

  • Llama 3.1 70B Instruct for OpenAI-style Chat Completions, Anthropic-style Messages, OpenAI-style Responses.

Call Llama 3.1 70B Instruct

Llama 3.1 70B Instruct answers on any of the APIs below — pick the one your code already speaks and just swap in your Cloakray key.

/v1/chat/completionsOpenAI-style Chat Completions · openai SDK or plain HTTP
curl https://api.cloakray.com/v1/chat/completions \
  -H "Authorization: Bearer ckr_..." \
  -H "Content-Type: application/json" \
  -d '{
  "model": "llama-3.1-70b-instruct",
  "messages": [
    {
      "role": "user",
      "content": "Hello"
    }
  ]
}'
/v1/messagesAnthropic-style Messages · @anthropic-ai/sdk SDK or plain HTTP
curl https://api.cloakray.com/v1/messages \
  -H "Authorization: Bearer ckr_..." \
  -H "Content-Type: application/json" \
  -d '{
  "model": "llama-3.1-70b-instruct",
  "max_tokens": 1024,
  "messages": [
    {
      "role": "user",
      "content": "Hello"
    }
  ]
}'
/v1/responsesOpenAI-style Responses · openai SDK or plain HTTP
curl https://api.cloakray.com/v1/responses \
  -H "Authorization: Bearer ckr_..." \
  -H "Content-Type: application/json" \
  -d '{
  "model": "llama-3.1-70b-instruct",
  "input": "Hello"
}'

Conversation compaction is also available at POST /v1/responses/compact.

More from Meta