API: Sandbox routing: Use Redis for client-proxy DNS instead of local map.

[jaytaylor]

API: Sandbox routing:

Use Redis for client-proxy DNS instead of local map.

It also cleans up logging a bit to be more consistent and informative about activity.

✨

Description by Callstackai

This PR refactors the DNS handling in the API to use Redis for client-proxy DNS instead of a local map. It also improves logging consistency and adds a Redis job specification.

Diagrams of code changes

sequenceDiagram
    participant Client
    participant DNS Server
    participant Redis
    participant Orchestrator
    participant Node

    Note over DNS Server: New DNS service with Redis integration

    alt Add DNS Entry
        Orchestrator->>DNS Server: Add(sandboxID, ip)
        DNS Server->>Redis: Set key-value with 24h expiration
    end

    alt DNS Query Flow
        Client->>DNS Server: Query(sandboxID)
        DNS Server->>Redis: Get(sandboxID)
        alt Found in Redis
            Redis-->>DNS Server: Return IP
        else Not Found in Redis
            DNS Server->>Orchestrator: FallbackResolver(sandboxID)
            Orchestrator-->>DNS Server: Return IP from Node
            DNS Server->>Redis: Cache IP (async)
        end
        DNS Server-->>Client: Return IP Address
    end

    alt Remove DNS Entry
        Orchestrator->>DNS Server: Remove(sandboxID)
        DNS Server->>Redis: Delete key
    end

Loading

Files Changed

File	Summary
.terraform.lock.hcl	Updated provider constraints and added new hashes.
packages/api/internal/dns/server.go	Refactored DNS handling to use Redis for storage and improved logging.
packages/api/internal/orchestrator/cache.go	Updated DNS removal and addition to handle errors properly.
packages/api/internal/orchestrator/orchestrator.go	Initialized Redis client and fallback resolver function for DNS.
packages/nomad/main.tf	Added a new Nomad job for Redis.
packages/nomad/redis.hcl	Created a new configuration file for the Redis job.

This PR includes files in programming languages that we currently do not support. We have not reviewed files with the extensions .hcl, .tf. See list of supported languages.

[ValentaTomas]

The PR looks good!
I'm changing it to draft for now—we will return to it when we start changing the other parts of the API to use Redis.