Repository navigation

Record simulation runs and report runs, and their outcomes when Modal reports a call ended - #950

Draft

anth-volk wants to merge 38 commits into

v2plan/1b-105-simulations-and-reportsfrom

v2plan/1b-106-runs-and-recording

Draft

Record simulation runs and report runs, and their outcomes when Modal reports a call ended#950
anth-volk wants to merge 38 commits into
v2plan/1b-105-simulations-and-reportsfrom
v2plan/1b-106-runs-and-recording

Commits on Oct 27, 2026
- Add simulation runs and report runs, found or created per catalog version and year
  
  anth-volk
  and
  claude
  committed
  f4bf51c
- Change run statuses only with conditional updates, so a second writer changes nothing
  
  anth-volk
  and
  claude
  committed
  289ff98
- Start each run's Modal call exactly once from the Simulation Entrypoint
  
  anth-volk
  and
  claude
  committed
  06204f5
- Record Modal call outcomes on runs in a background loop in each instance
  
  anth-volk
  and
  claude
  committed
  6002eba
- Keep CPU allocated and always mount sim's Modal token for the recording loop
  
  anth-volk
  and
  claude
  committed
  58b992d
- Load-check the recording loop's conditional writes on PostgreSQL
  
  anth-volk
  and
  claude
  committed
  a50d081
- Cancel a Modal call whose runs cannot record it
  
  anth-volk
  and
  claude
  committed
  a418cd5
- Fail a comparison step whose simulation run failed
  
  anth-volk
  and
  claude
  committed
  6839761
- Leave a finished call of a kind without a recorder for a later check
  
  anth-volk
  and
  claude
  committed
  6ce4d6e
- Leave database connections for requests, and log comparisons as comparisons
  
  anth-volk
  and
  claude
  committed
  4f7e51c
- Load-check household pairs and stalled dispatches too
  
  anth-volk
  and
  claude
  committed
  e03f440
- Contain a failed check within its pass, and retry client-side Modal errors
  
  anth-volk
  and
  claude
  committed
  6e9a45a
- Index pending comparison steps for the recording pass
  
  anth-volk
  and
  claude
  committed
  06f5531
- Read a call's outcome by where Modal raised it, not by the exception's type
  
  anth-volk
  and
  claude
  committed
  4ad7605
- Keep the recording loop running whatever a check or pass raises
  
  anth-volk
  and
  claude
  committed
  3060b9d
- Retry a failed output download instead of failing the run
  
  anth-volk
  and
  claude
  committed
  3f7c117
- Keep a call whose record committed although its reply was lost
  
  anth-volk
  and
  claude
  committed
  58aec6a
- Pass on a shutdown that arrives while the recording loop stops
  
  anth-volk
  and
  claude
  committed
  106518d
- Keep backing off for a call checked more than 46 times
  
  anth-volk
  and
  claude
  committed
  7eddb15
- Store a failed dispatch's error without claiming the call was cancelled
  
  anth-volk
  and
  claude
  committed
  a1fee05
- Stop recording outcomes in a background loop in each instance
  
  anth-volk
  and
  claude
  committed
  d64da40
- Define the report a Modal call sends sim when it ends
  
  anth-volk
  and
  claude
  committed
  7856197
- Check that a request comes from sim's call-report Modal function
  
  anth-volk
  and
  claude
  committed
  3e0e4db
- Check a running call again when its claim's lease ends, without backoff
  
  anth-volk
  and
  claude
  committed
  fe94717
- Record a call's outcome when its Modal function reports that it ended
  
  anth-volk
  and
  claude
  committed
  9bc28bb
- Accept call-ended reports from sim's call-report Modal function
  
  anth-volk
  and
  claude
  committed
  25cd7a5
- Add the safety check: one recording pass per execution of a job
  
  anth-volk
  and
  claude
  committed
  9958515
- Deploy the entrypoint with the Modal caller its reports must come from
  
  anth-volk
  and
  claude
  committed
  41315cc
- Deploy the safety check from the promoted revision, on a schedule
  
  anth-volk
  and
  claude
  committed
  4a33fbc
- Add the sender a v2 Modal call uses to report that it ended
  
  anth-volk
  and
  claude
  committed
  8164f55
- Declare report_call_ended in the v2 Modal app with sim's main URL
  
  anth-volk
  and
  claude
  committed
  46fd2cd
- Store dispatch errors that say only what is known
  
  anth-volk
  and
  claude
  committed
  68afe8c
- Describe the load check and the conditional writes for reported calls
  
  anth-volk
  and
  claude
  committed
  fe1f5e8
- Answer a report with a wait whenever Modal's keys cannot be read
  
  anth-volk
  and
  claude
  committed
  42a0c93
- Pause the safety check rather than run an image without it
  
  anth-volk
  and
  claude
  committed
  2ab3e3a
- Log the safety check's passes through the observability runtime
  
  anth-volk
  and
  claude
  committed
  dc5eb07
- Describe the dispatch, the report function and other_call as they work
  
  anth-volk
  and
  claude
  committed
  76bec96
- Let modal deploy import the v2 app: drop the check of report_call_ended's name
  
  anth-volk
  and
  claude
  committed
  283ac6d

Commits

Commits on Oct 27, 2026