Skip to content

Remove the legacy Miles engine - #252

Merged
michaellchung merged 3 commits into
mainfrom
s23-pr-11-remove-legacy-engine
Oct 14, 2026
Merged

michaellchung merged 3 commits into
mainfrom
s23-pr-11-remove-legacy-engine

Conversation

@michaellchung

@michaellchung michaellchung commented Oct 14, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Deletes yeto/rl/adapters/miles/legacy/ and rollout_legacy_port.py (about 9.3k lines) and every rl_engine branch; ports is the only Miles engine.

Motivation

rl-code-quality-cleanup 1.7b.4, 1.8, 1.10. All workloads (LoRA, dense, SAO, DSV4) now run on ports (PRs 01-05).

What changed

  • Rename sync preset dense-full -> full-parameter; dense-full stays an alias (P0-1.7b.2-Q2).
  • Miles checkout checks -> adapters/miles/revision.py; tape writes via engine.events.
  • Delete legacy engine, agentenv pins (MILES_COMMIT, MILES_IMAGE, SGLANG_COMMIT, ...), vendored bundles, external SGLang router, legacy DSV4 switches. Launcher reads the overlay through the backend registry; import allowlist drops to 8 entries (P0-W).
  • New check forbids importing the removed modules. Legacy-only tests deleted; others moved to ports.

Behavior changes / compatibility

Tests

Local CPU tests: every test file this PR adds or changes: 3 failed, 1189 passed, 6 skipped, 5 deselected, 6 warnings in 146.36s (0:02:26). The failure(s) are in the expected set below.

Known expected failures until the ports image is rebuilt for the new Miles pin (P0-1.11 GPU run): test_rl_ports_image (2), test_rl_backend_identity::test_golden_samples_keep_both_old_hashes_and_carry_the_identity, and 8 test_decoupling_golden samples (golden is regenerated after the rebuild).

Depends on

#251.

Not verified on GPU

None of this PR has run on GPU yet. The regression GPU run for the S23 stack is P0-1.11 GPU run (in progress at the time of writing); results will be linked here before merge.

🤖 Generated with Claude Code

chowhsu and others added 3 commits October 14, 2026 11:31
…as an alias

The preset names the full-parameter transport, not which parameters train:
DeepSeek V4 expert-full rides it too (P0-1.7b.2-Q2). Both the CLI
--rl-sync-preset and the island --sync-preset resolve the old name through
selection.canonical_sync_preset, so commands and syncers only ever see the
new name.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
verify_miles_revision and miles_execution_source_sha256 move to
adapters/miles/revision.py (default pins: MILES_NEXT_PINS); the ports
composition root writes tape events through engine.events.append_tape_event
instead of the legacy engine's re-export.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…1.10)

Delete yeto/rl/adapters/miles/legacy/ and models/rollout_legacy_port.py,
their only callers being the legacy translation (_legacy_miles_argv,
build_miles_argv) and the yeto_policy_sync external-hook path of the island
entry. With them go: the agentenv pins (MILES_COMMIT, MILES_BASE_COMMIT,
bundle, MILES_IMAGE, MILES_LEGACY_PINS, SGLANG_COMMIT) and the vendored
bundles, the external SGLang router, the before-train-step LR/grad-audit
hooks, the legacy DSV4 runtime switches, publish._policy_token, the
teacher-forcing legacy token and every rl_engine branch in the launcher,
SSH harness, export, benchmark and run config.

--rl-engine keeps parsing but accepts only ports and is no longer
forwarded. backend_identity() takes no engine. The SecRLEnv rollout errors
move into harness/codex/reward.py. The launcher reads the Miles overlay
through the backend registry (role 'overlay'), so the import allowlist
drops to 8 entries; a new check forbids importing the removed modules.

selection.ports_rejections keeps only combinations no engine runs, each
with its reason, and no longer points at --rl-engine legacy.

Legacy-only tests are deleted (old test runs do not resume, P0-D5); the
rest are moved to the ports path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@michaellchung
michaellchung marked this pull request as ready for review October 14, 2026 11:31
@michaellchung
michaellchung force-pushed the s23-pr-11-remove-legacy-engine branch from 0cb2801 to 5637d41 Compare October 14, 2026 11:31
@michaellchung
michaellchung merged commit f47a5b7 into main Oct 14, 2026
1 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants