Per request configuration / Multi Tenants with multiple api_keys

[gamecreature]

I have a multi-tenant rails application (running in a threaded Puma server).
We would love to have the possibility to use a different api-key per client.

This doesn't seem possible with the current global RubyLLM.config. What's the recommended way to way achieve this (if possible)?

(So basically I'm looking for a per-request configuration option).

Btw thanks for this nice gem! 🙏🏻

[gamecreature]

For the moment I've implemented a monkey patch for the Rails project. (place this in the config/initializers)
This is not a real answer but a workaround for the issue with different API configurations per thread.
Please be warned, I don't know the library good enough, so it's possible there are more places affected.

  require 'ruby_llm'

  module RubyLLM
    class Current < ActiveSupport::CurrentAttributes
      attribute :config
    end

    @@config_mutex = Mutex.new

    def self.config
      @@config_mutex.synchronize {
        Current.config ||= Configuration.new
      }
    end
  end

[gamecreature]

This PR will resolves this question #66 👍