Fireworks AI model
Llama 70B on Fireworks
fireworks-llama-70bProduction Llama inference on Fireworks AI.
Drop-in OpenAI compatibility
Use one model ID.
Python
from openai import OpenAI
client = OpenAI(
base_url="https://api.text-generator.io/v1",
api_key="YOUR_TEXT_GENERATOR_KEY",
)
response = client.chat.completions.create(
model="fireworks-llama-70b",
messages=[{"role": "user", "content": "Hello"}],
)