groq()

Factory function to create a Groq model instance. Groq provides ultra-fast inference for open-source models through an OpenAI-compatible API.

Signature

def groq(model_id: str, *, api_key: str | None = None) -> LanguageModel

Parameters

str

required

The Groq model identifier (e.g., “llama-3.3-70b-versatile”, “mixtral-8x7b-32768”).

str

Groq API key. Falls back to GROQ_API_KEY environment variable.

Returns

A LanguageModel instance configured for Groq.

Environment

Requires GROQ_API_KEY environment variable.

export GROQ_API_KEY="gsk_..."

Available Models

Model ID	Description
`llama-3.3-70b-versatile`	Llama 3.3 70B - best quality
`llama-3.1-8b-instant`	Llama 3.1 8B - ultra fast
`mixtral-8x7b-32768`	Mixtral 8x7B - 32k context
`gemma2-9b-it`	Gemma 2 9B - Google’s open model

Example

from ai_query import generate_text
from ai_query.providers import groq

result = await generate_text(
    model=groq("llama-3.3-70b-versatile"),
    prompt="Hello, world!"
)

Provider Options

result = await generate_text(
    model=groq("llama-3.3-70b-versatile"),
    prompt="Be creative.",
    provider_options={
        "openai": {
            "temperature": 0.9,
            "max_tokens": 1000
        }
    }
)

Core Functions

Agent Classes

Transport Layer

Providers

Types

Signature

Parameters

Returns

Environment

Available Models

Example

Provider Options

​Signature

​Parameters

​Returns

​Environment

​Available Models

​Example

​Provider Options

Signature

Parameters

Returns

Environment

Available Models

Example

Provider Options