DeepInfra API and Dome

1. 01

   Add the connection

   The provider id is deepinfra. Dome uses https://api.deepinfra.com/v1/openai and DeepInfra's own model ids.

   $ dome models add deepseek-deepinfra \
     --provider deepinfra \
     --model deepseek-ai/DeepSeek-V4-Flash-0731 \
     --api-key "$DEEPINFRA_API_KEY" \
     --attributes '{"region":"us"}' \
     --gateway prod-gateway

2. 02

   Pool it with Together AI

   Add the same DeepSeek id on Together as a second connection. DeepInfra goes first.

   $ dome models pool create deepseek-v4-flash \
     --failover-max all --gateway prod-gateway
    
   $ dome models pool member add deepseek-v4-flash deepseek-deepinfra --priority 0
   $ dome models pool member add deepseek-v4-flash deepseek-together --priority 1

3. 03

   Point your agent at the Gateway

   Keep your OpenAI-compatible code. Point it at the Gateway and hand it the agent's Dome key.

   from openai import OpenAI
    
   client = OpenAI(base_url=f"{GATEWAY_URL}/v1", api_key=DOME_AGENT_KEY)
   client.chat.completions.create(
       model="deepseek-v4-flash",
       messages=[{"role": "user", "content": "Summarize this claim file."}],
   )

Commands and rules tested against a Dome workspace on October 1, 2026. For anything about DeepInfra itself, see DeepInfra's documentation.

forbid (principal, action == Dome::Action::"llm:invoke", resource is Dome::LLMModel)
unless { resource has region && resource.region == "us" };