Skip to content

docs(quest): checkpoint test flakes validation baseline - #6027

Closed
kixelated wants to merge 3 commits into
mainfrom
quest/m1/test-flakes-2/README
Closed

kixelated wants to merge 3 commits into
mainfrom
quest/m1/test-flakes-2/README

Conversation

@kixelated

@kixelated kixelated commented Oct 20, 2026 •

Copy link
Copy Markdown
Collaborator

Problem

The test-flakes quest still needs repeated loaded-host validation after its child fixes.

Approach

Record one complete just check --all baseline on source tree 48c8a66ddd in the existing quest Plan. No new flake was reproduced, so no source fix was added and the quest remains open.

Since this was opened, main added three children under Required (moq-dev/moq#6021). The merge keeps them and notes the baseline predates them, so the loaded-host runs still follow the children. The child PRs (moq-dev/moq#6032, moq-dev/moq#6034, moq-dev/moq#6037) only remove their own Required entries, so they stay compatible with this edit.

Decisions

  • Merge conflict with the new Required section:
    • ✅ Keep both, condense the baseline, and say it predates the children (recommended: the record stays accurate and the README's own work still waits on them)
    • Drop the baseline, since the real runs must follow the children anyway
    • Keep the original two-paragraph wording unchanged

Impact

  • Public API: none.
  • Wire: none.
  • Quest Plan only; tests and runtime behavior are unchanged.

Validation

  • just check --all: passed, exit 0. Rust default tests: 8,943 passed, 33 skipped. Additional net-feature, capture, and playback passes: 1,025, 515, and 217 passed. Python: 102 passed. JS workspace tests and remaining local gates passed.
  • Swift skipped because this Linux host lacks its toolchain. The separate media/browser harness was not run.
  • Pinned Nix shell, CPU affinity 0-3, Cargo and nextest concurrency two. Observed one-minute shared-host load was about 1.6-6.1 on 16 physical cores.
  • After the merge: quest check and just check passed at 7842c54bc0.

Alternatives

Keep the current test behavior: this baseline provides no evidence warranting a source change.

Follow-ups

Repeated loaded-host runs remain unfinished, and are blocked on the three Required children. This single unsaturated run does not satisfy that condition. Keep this PR a draft.

(Written by Claude Opus 5.5, building on work written by GPT-6.1-Sol)

🤖 Generated with Claude Code

kixelated and others added 2 commits October 19, 2026 17:06
Co-Authored-By: GPT-6.1-Sol <noreply@openai.com>
Co-Authored-By: GPT-6.1-Sol <noreply@openai.com>
@kixelated

Copy link
Copy Markdown
Collaborator Author

Checkpoint: the full just check --all baseline passed on source tree 48c8a66ddd, and the final-head scoped just check passed at 079a65522. No new flake or source fix was found. The existing quest Plan retains the observed load and the unfinished repeated loaded-host runs. Recommendation: keep this draft until that validation is completed.

(written by GPT-6.1-Sol)

Keep the baseline beside the three new children and note it predates them.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@kixelated

Copy link
Copy Markdown
Collaborator Author

Closing: a single passing just check --all run isn't durable information (CI and git history already hold it), and the baseline predates the quest's new children. The loaded-host validation still happens through those children.

(Written by Claude Opus 5.5)

@kixelated kixelated closed this Oct 20, 2026
@kixelated
kixelated deleted the quest/m1/test-flakes-2/README branch October 22, 2026 06:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant