Skip to content

Implement resource guard extension point and worker limiter - #43

Open
cottsay wants to merge 1 commit into
masterfrom
cottsay/resource_guard
Open

Implement resource guard extension point and worker limiter#43
cottsay wants to merge 1 commit into
masterfrom
cottsay/resource_guard

Conversation

@cottsay

@cottsay cottsay commented Sep 3, 2026

Copy link
Copy Markdown
Member

The point of this extension point is to support extension points which affect what jobs can be run by the parallel executor at what times.

The primary motivation here is to support a GNU-style jobserver, but the extension point is designed such that it could use historical build data to determine which jobs to run to reduce the "long tail" of the build, improving resource utilization.

The limiting of how many total package-level jobs are allowed to run was moved into this extension, and can therefore now be disabled as any extension could.

@cottsay cottsay self-assigned this Sep 3, 2026
@cottsay cottsay added the enhancement New feature or request label Sep 3, 2026
@cottsay
cottsay force-pushed the cottsay/resource_guard branch from 3640265 to f6e2529 Compare September 4, 2026 16:04
@codecov-commenter

codecov-commenter commented Sep 4, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 93.75000% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 95.78%. Comparing base (bb4e553) to head (31a3231).

Files with missing lines Patch % Lines
...olcon_parallel_executor/resource_guard/__init__.py 90.41% 6 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master      #43      +/-   ##
==========================================
- Coverage   97.38%   95.78%   -1.61%     
==========================================
  Files           4        7       +3     
  Lines         153      261     +108     
  Branches       41       52      +11     
==========================================
+ Hits          149      250     +101     
- Misses          1        7       +6     
- Partials        3        4       +1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@cottsay
cottsay force-pushed the cottsay/resource_guard branch from f6e2529 to 9565593 Compare September 11, 2026 02:32
Base automatically changed from cottsay/parallel-executor-fixes to master September 11, 2026 20:21
@cottsay
cottsay force-pushed the cottsay/resource_guard branch from 9565593 to 31a3231 Compare September 11, 2026 20:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants