Skip to content

Increase Gunicorn workers, threads and timeout for large uploads - #70

Merged
jkalayan merged 1 commit into
mainfrom
69-bug-extraction-stops-after-30-seconds
Oct 8, 2026
Merged

jkalayan merged 1 commit into
mainfrom
69-bug-extraction-stops-after-30-seconds

Conversation

@jkalayan

@jkalayan jkalayan commented Oct 8, 2026

Copy link
Copy Markdown
Collaborator

Summary

This pull request makes improvements to the Gunicorn server configuration for better performance and reliability.

Dependency installation improvements:

  • Combined the installation of setuptools and gunicorn into a single pip install command.

Gunicorn server configuration enhancements:

  • Updated the default CMD in the docker/Dockerfile to launch Gunicorn with the gthread worker class, 2 workers, 4 threads per worker, and a 900-second timeout, which should improve concurrency and prevent premature timeouts for long-running requests.

Impact

  • Ensures data upload and extraction has enough time and resource to complete.

@jkalayan jkalayan linked an issue Oct 8, 2026 that may be closed by this pull request
@jkalayan
jkalayan requested a review from jimboid October 8, 2026 10:50

@jimboid jimboid left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removing multistep install reduces installation ambiguities. Adding multithreaded workers and increasing worker timeout is a double pronged fix to timeout and worker killing seen in the production deployment.

@jkalayan jkalayan changed the title fix: increase Gunicorn workers, threads and timeout for large uploads Increase Gunicorn workers, threads and timeout for large uploads Oct 8, 2026
@jkalayan
jkalayan merged commit 4f183c0 into main Oct 8, 2026
12 checks passed
@coveralls

Copy link
Copy Markdown

Coverage Report for CI Build 37766081537

Coverage remained the same at 91.609%

Details

  • Coverage remained the same as the base build.
  • Patch coverage: No coverable lines changed in this PR.
  • No coverage regressions found.

Uncovered Changes

No uncovered changes found.

Coverage Regressions

No coverage regressions found.


Coverage Stats

Coverage Status
Relevant Lines: 727
Covered Lines: 666
Line Coverage: 91.61%
Coverage Strength: 8.24 hits per line

💛 - Coveralls

@jkalayan
jkalayan deleted the 69-bug-extraction-stops-after-30-seconds branch October 8, 2026 16:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: Extraction stops after 30 seconds

3 participants