Skip to content

[SYSTEMDS-3989] Multi-objective Optimization in Representation Optimizers - #2632

Merged
christinadionysio merged 9 commits into
apache:mainfrom
christinadionysio:multiobjective
Nov 4, 2026
Merged

christinadionysio merged 9 commits into
apache:mainfrom
christinadionysio:multiobjective

Conversation

@christinadionysio

@christinadionysio christinadionysio commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

This PR adds the capability for multi-objective optimization in all stages of the optimization process (unimodal, hpo, multimodal). We collect the time it takes for a representation to be created and how long inference for that representation takes on a test set instance. The optimizers can then handle multiple objectives like minimizing runtime while maximizing accuracy.

AssistedBy: AI

@codecov

codecov Bot commented Nov 4, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 87.68657% with 66 lines in your changes missing coverage. Please review.
✅ Project coverage is 75.83%. Comparing base (75d3941) to head (9730a6d).
⚠️ Report is 2 commits behind head on main.

Files with missing lines Patch % Lines
...in/python/systemds/scuro/drsearch/node_executor.py 69.81% 16 Missing ⚠️
...hon/systemds/scuro/drsearch/test_set_evaluation.py 50.00% 11 Missing ⚠️
.../main/python/systemds/scuro/drsearch/objectives.py 91.52% 10 Missing ⚠️
src/main/python/systemds/scuro/drsearch/task.py 75.60% 10 Missing ⚠️
...on/systemds/scuro/drsearch/hyperparameter_tuner.py 88.23% 6 Missing ⚠️
...n/systemds/scuro/drsearch/split_aware_evaluator.py 81.81% 6 Missing ⚠️
...on/systemds/scuro/drsearch/multimodal_optimizer.py 50.00% 3 Missing ⚠️
src/main/python/systemds/scuro/models/fused_mlp.py 25.00% 3 Missing ⚠️
src/main/python/tests/scuro/test_inference_cost.py 99.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2632      +/-   ##
==========================================
+ Coverage   75.66%   75.83%   +0.16%     
==========================================
  Files         454      457       +3     
  Lines       29966    30441     +475     
==========================================
+ Hits        22674    23084     +410     
- Misses       7292     7357      +65     
Flag Coverage Δ
python 75.83% <87.68%> (+0.16%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@christinadionysio
christinadionysio merged commit bc87924 into apache:main Nov 4, 2026
10 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in SystemDS PR Queue Nov 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant