Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memorious session information expiration #203

Open
monneyboi opened this issue Apr 5, 2022 · 1 comment
Open

Memorious session information expiration #203

monneyboi opened this issue Apr 5, 2022 · 1 comment

Comments

@monneyboi
Copy link

I'm running a crawler that does a lot of recursion, so much that at some point, the stored session information in Redis expires, and the scraper stops using the configured proxy.

This could be solved by increasing the expiration time:

conn.set(key, session, ex=REDIS_SHORT)

@sunu
Copy link
Contributor

sunu commented Apr 5, 2022

In that case, we can make REDIS_SHORT configurable in servicelayer: https://github.com/alephdata/servicelayer/blob/d1bac4c8f1991f07a2df2720099ea4e7466228c7/servicelayer/settings.py#L7

@Rosencrantz Rosencrantz added this to Aleph Nov 2, 2022
@Rosencrantz Rosencrantz moved this to 🏷️ Triage in Aleph Nov 2, 2022
@Rosencrantz Rosencrantz moved this from 🏷️ Triage to 📋 Backlog in Aleph Nov 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Status: 📋 Backlog
Development

No branches or pull requests

2 participants