DeepSeek and Dome

1. 01

   Connect Together AI and DeepInfra

   Both use the same model id. The jurisdiction attribute is your label, and rules read it.

   $ dome models add deepseek-together \
     --provider together \
     --model deepseek-ai/DeepSeek-V4-Pro-0813 \
     --api-key "$TOGETHER_API_KEY" \
     --attributes '{"family":"deepseek","jurisdiction":"us"}' \
     --gateway prod-gateway
    
   $ dome models add deepseek-deepinfra \
     --provider deepinfra \
     --model deepseek-ai/DeepSeek-V4-Pro-0813 \
     --api-key "$DEEPINFRA_API_KEY" \
     --attributes '{"family":"deepseek","jurisdiction":"us"}' \
     --gateway prod-gateway

2. 02

   Connect DeepSeek directly

   For agents with no residency limit. DeepSeek's own id for the model is deepseek-v4-pro.

   $ dome models add deepseek-direct \
     --provider deepseek \
     --model deepseek-v4-pro \
     --api-key "$DEEPSEEK_API_KEY" \
     --attributes '{"family":"deepseek","jurisdiction":"cn"}' \
     --gateway prod-gateway

3. 03

   Pool the US connections

   Only the us connections join deepseek-v4-pro. Together leads, and DeepInfra takes over when it fails.

   $ dome models pool create deepseek-v4-pro \
     --failover-max all --gateway prod-gateway
    
   $ dome models pool member add deepseek-v4-pro deepseek-together --priority 0
   $ dome models pool member add deepseek-v4-pro deepseek-deepinfra --priority 1

4. 04

   Point your agent at the Gateway

   The claims agent sends deepseek-v4-pro through the OpenAI SDK, with a Dome key and the Gateway URL.

   from openai import OpenAI
    
   client = OpenAI(base_url=f"{GATEWAY_URL}/v1", api_key=DOME_AGENT_KEY)
   client.chat.completions.create(
       model="deepseek-v4-pro",
       messages=[{"role": "user", "content": "Check this claim against the policy terms."}],
   )

5. 05

   Cap the spend

   The quota counts Together and DeepInfra together, as one US budget.

   $ dome quotas set --subject pool --pool deepseek-v4-pro \
     --unit provider_usd --limit 250 --window monthly

Commands and rules tested against a Dome workspace on October 1, 2026. For anything about DeepSeek itself, see DeepSeek's documentation.

forbid (principal, action == Dome::Action::"llm:invoke", resource is Dome::LLMModel)
unless { resource has jurisdiction && resource.jurisdiction == "us" };