Skip to content

Surface Spec human gates early and provide actionable continuation instructions #586

Description

@JacobStephens2

This was generated by AI during triage.

Problem

In the 17-hour Spec run on #427, the final notification listed #550–#552 as “unready: labelled needs-triage.” Their specs already explained the required human decision: grade trial findings, choose the Security review mode, write the choice into the Tickets, then relabel them.

The operator needs this information before a long run ends, and needs concrete instructions for continuing afterward. Thirdshift already preserves failed work and supports Continuations; improving visibility should build on that behavior.

Proposed behavior

  • At startup, summarize known human gates and their affected Tickets while allowing independent ready Tickets to run.
  • Refresh the summary when graph re-reads reveal that gates changed.
  • On an incomplete outcome, provide a correctly quoted continuation command that preserves the relevant original Command options.
  • Explain the required human actions using available issue context and links. Distinguish observable facts, such as labels and blocker edges, from a decision description that requires interpretation.
  • Separate execution failures, blocked dependents, and human-gated work in the final notification, with links to the affected issues, PRs, and logs.
  • Describe relabelling as an operator action after a decision is made; do not change readiness automatically.

Decisions needed

  • Where should early gate summaries appear: Command output, Spec PR checklist, an early notification, or a combination?
  • How should a decision's description be obtained reliably without adding an agent session just to interpret Ticket prose?
  • Which original options must a continuation command retain, and how should an unavailable Model or Harness be handled?
  • Should this be implemented independently of the proposed waiting outcome? Clear reporting should still work with current Failed spec run semantics.

Validation targets

  • A Spec with both ready and human-gated Tickets reports its gates before starting long-running Ticket sessions, and still runs independent work.
  • Removing or adding a gate while Tickets run is reflected after the next graph re-read.
  • The final continuation command targets the original issue and preserves the agreed Command options without exposing credentials.
  • A continuation reuses existing work and skips closed Tickets; it does not imply starting over.
  • Human actions are linked to their source issues, and inferred decision descriptions are clearly distinguished from observed tracker state.
  • No extra confirmation or human response is required for the ongoing run to continue its independent work.

Scope

Operator visibility and recovery instructions. No automatic human decisions, readiness changes, daemon, or change to completion and merge requirements.

Evidence and related work

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestneeds-triageMaintainer needs to evaluate this issue

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions