Repository navigation

Run v2 on fresh Microcosm households in judged batches - #240

Draft

MaxGhenis wants to merge 17 commits into

mainfrom

v2-microcosm-batches

Draft

Run v2 on fresh Microcosm households in judged batches#240
MaxGhenis wants to merge 17 commits into
mainfrom
v2-microcosm-batches

Commits on Oct 22, 2026
- Build fresh household sets and run the tool pilot on them
  
  MaxGhenis
  and
  claude
  committed
  cee4ee4
- Judge each household-set batch with the reference adversary
  
  MaxGhenis
  and
  claude
  committed
  c62b48d
- Let the Claude adversary runner bill a declared API key
  
  MaxGhenis
  and
  claude
  committed
  078cafc
- Let a judge exclude the blocked domains by operator
  
  MaxGhenis
  and
  claude
  committed
  879fd2b
Commits on Oct 23, 2026
- Build test household sets on a named dataset; v2 needs a certified pair
  
  MaxGhenis
  and
  claude
  committed
  b6d835a
- Add calculator tool version 2 (the pe2 arm)
  
  MaxGhenis
  and
  claude
  committed
  6e1578f
- Judge a batch from any model set
  
  MaxGhenis
  and
  claude
  committed
  5bbd571
- Calculator features one at a time: tool v3 and ablation arms
  
  MaxGhenis
  and
  claude
  committed
  e881a6a
- Read facts as the prompt labels them (labels feature)
  
  MaxGhenis
  and
  claude
  committed
  b3ec406
- Labels: read the v2-pilot relabelings; flat: names optional
  
  MaxGhenis
  and
  claude
  committed
  fd3f5d0
- Flat: a household of one's person fact goes to that person
  
  MaxGhenis
  and
  claude
  committed
  5c0f3ec
- Keep tool version 2's request as it was: detail only under concise
  
  MaxGhenis
  and
  claude
  committed
  9c43f4f
- Tool v3 review r1: frame, resume, labels, flat and text fixes
  
  MaxGhenis
  and
  claude
  committed
  6478e8f
Commits on Oct 24, 2026
- Tool v3 review r2: report malformed repeats, resumable harness errors
  
  MaxGhenis
  and
  claude
  committed
  d570b8e
- Format the r2 fix
  
  MaxGhenis
  and
  claude
  committed
  fb35d82
- Tool v3 review r3: check every record's treatment, at resume and at score
  
  MaxGhenis
  and
  claude
  committed
  6b00a6f
- Tool v3: calculator features one at a time, for the ablation pilot (#243)
  MaxGhenis
  authored
  5d807bb

Commits

Commits on Oct 22, 2026

Commits on Oct 23, 2026

Commits on Oct 24, 2026