Meta: Llama 3.1 405B Instruct

10K

The highly anticipated 400B class of Llama3 is here! Clocking in at 128k context with impressive eval scores, the Meta AI team continues to push the frontier of open-source LLMs. Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 405B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models including GPT-4o and Claude 3.5 Sonnet in evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

OpenRouter 원가 (1M 토큰)

입력$3.50

출력$3.50

합계$7.00

인보이스랩 (월 예상)

입력 0.5M + 출력 0.5M 기준

공급가액₩5,764

부가세 (10%)₩576

결제 금액₩6,342

💡 부가세 ₩576 매입공제 가능

모델 정보

기본 정보

모델 ID	meta-llama/llama-3.1-405b-instruct
제공사	Meta
컨텍스트 윈도우	10,000 토큰
모달리티	text->text

지원 기능

⚡ Function Calling📋 Structured Output📄 JSON Mode🌡️ Temperature📏 Max Tokens

API 사용법

Python (OpenAI SDK 호환)

from openai import OpenAI

client = OpenAI(
    api_key="your-dream-api-key",
    base_url="https://api.invoicedream.co.kr/v1"
)

response = client.chat.completions.create(
    model="meta-llama/llama-3.1-405b-instruct",
    messages=[
        {"role": "user", "content": "안녕하세요"}
    ]
)

print(response.choices[0].message.content)

Node.js / TypeScript

import OpenAI from 'openai';

const client = new OpenAI({
  apiKey: 'your-dream-api-key',
  baseURL: 'https://api.invoicedream.co.kr/v1'
});

const response = await client.chat.completions.create({
  model: 'meta-llama/llama-3.1-405b-instruct',
  messages: [{ role: 'user', content: '안녕하세요' }]
});

console.log(response.choices[0].message.content);

cURL

curl https://api.invoicedream.co.kr/v1/chat/completions \
  -H "Authorization: Bearer your-dream-api-key" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-405b-instruct",
    "messages": [{"role": "user", "content": "안녕하세요"}]
  }'

💡 Tip: OpenAI SDK를 그대로 사용할 수 있습니다.base_url만 변경하면 됩니다!