Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SQS Message handling settings don't work. #105

Open
alexgleith opened this issue Apr 13, 2022 · 0 comments
Open

SQS Message handling settings don't work. #105

alexgleith opened this issue Apr 13, 2022 · 0 comments

Comments

@alexgleith
Copy link
Contributor

It should be possible to use Statistician configuration parameters for crop mask like this:

          # SQS Message Handling
          max_processing_time: 0    # Take as long as you want
          job_queue_max_lease: 600  # Lease for 10 minutes at a time
          renew_safety_margin: 30   # Extend with 30 seconds remaining
          future_poll_interval: 10  # Check every 10 seconds

But this doesn't work, as evidenced by the weird behaviour in messages below.

What I think is happening is that messages are going back on the queue and being retried, so that they end up being run multiple times in parallel... this should not happen as it's extremely wasteful of resources.

The solution is to use long timeouts, which slows down retries for real failures.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant