Groq API and Dome

1. 01

   Add the connection

   The provider id is groq. Dome uses https://api.groq.com/openai/v1 and Groq's own model ids.

   $ dome models add gpt-oss-groq \
     --provider groq \
     --model openai/gpt-oss-120b \
     --api-key "$GROQ_API_KEY" \
     --attributes '{"weights":"open"}' \
     --gateway prod-gateway

2. 02

   Pool it with OpenRouter

   Groq is priority 0. Agents ask for gpt-oss-120b, the pool's name.

   $ dome models pool create gpt-oss-120b \
     --failover-max all --gateway prod-gateway
    
   $ dome models pool member add gpt-oss-120b gpt-oss-groq --priority 0
   $ dome models pool member add gpt-oss-120b gpt-oss-openrouter --priority 1

3. 03

   Point your agent at the Gateway

   Any client that speaks the OpenAI API works. Swap in the Gateway URL and a Dome agent key.

   from openai import OpenAI
    
   client = OpenAI(base_url=f"{GATEWAY_URL}/v1", api_key=DOME_AGENT_KEY)
   client.chat.completions.create(
       model="gpt-oss-120b",
       messages=[{"role": "user", "content": "Route this message: sales, support or billing."}],
   )

Commands and rules tested against a Dome workspace on October 1, 2026. For anything about Groq itself, see Groq's documentation.

forbid (principal, action == Dome::Action::"llm:invoke", resource is Dome::LLMModel)
unless { resource has weights && resource.weights == "open" };