You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Not sure if this is the intended behavior or not, but I had to spend an hour chasing this down when I was expecting my code to make independent generations so I figured I'd mention it in case anyone else ran into this issue
The default value of None for the cache parameter in OpenAIWrapper suggests that caching is disabled by default. (I believe the documentation also suggests that caching has to be explicitly added to be enabled)
However, the default value of LEGACY_DEFAULT_CACHE_SEED for cache_seed in OpenAIWrapper.create() leads cache_client be set by default.
Again, I'm not sure if this is the intended behavior, but either way I think it would be helpful if the documentation were more clear about cache behavior.
The text was updated successfully, but these errors were encountered:
Not sure if this is the intended behavior or not, but I had to spend an hour chasing this down when I was expecting my code to make independent generations so I figured I'd mention it in case anyone else ran into this issue
The default value of None for the
cache
parameter in OpenAIWrapper suggests that caching is disabled by default. (I believe the documentation also suggests that caching has to be explicitly added to be enabled)However, the default value of LEGACY_DEFAULT_CACHE_SEED for
cache_seed
inOpenAIWrapper.create()
leadscache_client
be set by default.Again, I'm not sure if this is the intended behavior, but either way I think it would be helpful if the documentation were more clear about cache behavior.
The text was updated successfully, but these errors were encountered: