Together AI API and Dome

1. 01

   Add the connection

   The provider id is together. Dome uses https://api.together.xyz/v1 and Together's own model ids.

   $ dome models add llama-together \
     --provider together \
     --model meta-llama/Llama-3.3-70B-Instruct-Turbo \
     --api-key "$TOGETHER_API_KEY" \
     --attributes '{"family":"llama"}' \
     --gateway prod-gateway

2. 02

   Pool it with DeepInfra

   Add the same model on DeepInfra as a second connection. Members are tried in priority order, and agents send the pool's name.

   $ dome models pool create llama-3.3-70b \
     --failover-max all --gateway prod-gateway
    
   $ dome models pool member add llama-3.3-70b llama-together --priority 0
   $ dome models pool member add llama-3.3-70b llama-deepinfra --priority 1

3. 03

   Point your agent at the Gateway

   Any OpenAI-compatible client works. The agent's Dome key replaces the Together key.

   from openai import OpenAI
    
   client = OpenAI(base_url=f"{GATEWAY_URL}/v1", api_key=DOME_AGENT_KEY)
   client.chat.completions.create(
       model="llama-3.3-70b",
       messages=[{"role": "user", "content": "Draft a reply to this support ticket."}],
   )

Commands and rules tested against a Dome workspace on October 1, 2026. For anything about Together AI itself, see Together AI's documentation.

forbid (principal, action == Dome::Action::"llm:invoke", resource is Dome::LLMModel)
unless { resource has family && resource.family == "llama" };