Llama 3.1 8B Instant

llama-3.1-8b-instant

Very low-latency chat and extraction.

Try in Playground API docs

Drop-in OpenAI compatibility

Use one model ID.

Python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.text-generator.io/v1",
    api_key="YOUR_TEXT_GENERATOR_KEY",
)

response = client.chat.completions.create(
    model="llama-3.1-8b-instant",
    messages=[{"role": "user", "content": "Hello"}],
)