Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible solution to concurrent instances working? #312

Open
Wintersunner opened this issue Jul 18, 2024 · 0 comments
Open

Possible solution to concurrent instances working? #312

Wintersunner opened this issue Jul 18, 2024 · 0 comments

Comments

@Wintersunner
Copy link

Wintersunner commented Jul 18, 2024

I've noticed an issue with having multiple jobs queued in environments with more than one instance. Specifically, if a job cycle exceeds 70 seconds (the default _interval + 10), the lock expires, allowing another instance to start enqueuing jobs, which results in duplicate jobs in the queues.

Using a single instance to avoid this problem is not ideal due to its slow performance and being a single point of failure.

Is there a solution to make rqscheduler horizontally scalable? Not just for failover but to operate simultaneously and increase throughput?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant