Skip to content

Update bundled macOS and Linux TAXSIM test binaries to the October 27, 2026 build - #1206

Draft
PavelMakarchuk wants to merge 11 commits into
mainfrom
codex/update-taxsim-test-september
Draft

PavelMakarchuk wants to merge 11 commits into
mainfrom
codex/update-taxsim-test-september

Conversation

@PavelMakarchuk

@PavelMakarchuk PavelMakarchuk commented Sep 23, 2026 •

Copy link
Copy Markdown
Collaborator

Update the emulator's bundled NBER TAXSIM test executables for macOS and Linux to build cd2026102718 (October 27, 2026). This is the build that the TAXSIM-35 census audit now uses. Windows stays at the August build (see below).

Platform On main Updated Source
macOS cd2026081819 cd2026102718 https://taxsim.nber.org/out2psl/osx
Linux cd2026081819 cd2026102718 https://taxsim.nber.org/out2psl/linux
Windows cd2026081318 cd2026081318 (kept) https://taxsim.nber.org/taxsimtest/taxsimtest.exe

Why this build

Changes

Validation

Other open questions about this build are in the TAXSIM-35 audit issues (for example #1446, #1448, #1461, #1472, #1473, #1482 and #1483). Benchmarks and dashboard runs stay pinned to their binary hash. Comparisons made before and after this update can differ even with the same PolicyEngine code.

🤖 Generated with Claude Code

@vercel

vercel Bot commented Sep 23, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
policyengine-taxsim Ready Ready Preview Oct 28, 2026 12:28pm UTC

Request Review

PavelMakarchuk and others added 2 commits October 13, 2026 12:37
All three platforms now carry build cd2026100817 (macOS and Linux from
out2psl, Windows from taxsimtest/taxsimtest.exe), the build the census
audit uses. Manifest, README table and changelog fragment updated.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
cd2026100817 prints " d1   <value>" before Minnesota 2024-2025
records; the parser counted them as records with no taxsimid, so a
5,000-record 2024 batch came back with 10,496 rows.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- AddMed: cd2026100817 keeps AddMed out of 2013-2023 fiitax (taxsim
  #1225), so the strict xfail is removed and the notes in the module,
  test_performance.py, the README and PolicyEngineRunner are updated.
- taxsim #1416: the build starts the EITC phase-out at $0 for some
  filers. tests/taxsim_known_regressions.py lets a test tolerate the
  exact values it changes (MFS head-of-household v25, nonprop 6000,
  6001 and 7005, MD record 7, dependent-count records 5, 6 and 9);
  any other difference still fails, and the test fails again once
  #1416 is fixed so the entries are removed.
- CA 2021 nonprop records 25-27 re-pinned: the build lowers CA tax
  before credits by $0.72-$1.27 (cause not established).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@PavelMakarchuk PavelMakarchuk changed the title Update TAXSIM test binaries to September 2026 builds Update bundled TAXSIM test binaries to the October 8, 2026 builds Oct 13, 2026
On macOS 27 with Rosetta 2 reinstalled, cd2026100817 gives IL 2021-2023
and IN 2021-2022 returns state credits (v39) that it did not give on
macOS 26 with the same inputs. The probe prints each runner's bundled-build
output before the tests run, so the hosted Linux, Windows and macOS runners
show whether the values depend on the platform. It never fails the job.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
NBER's October 8 Windows build returns different values from the macOS
and Linux builds of the same stamp (the CI probe: Indiana 2024 v39 63.20
where they give 0.00; fiitax gaps in the itemized and dependent-count
tests), so Windows stays at cd2026081318. tests/taxsim_known_regressions.py
reads the platform's bundled build stamp; the #1416 and CA 2021 known
values and the AddMed xfail now apply only to the build they describe.
The CA 2021 pins return to the earlier builds' values. The temporary
IL/IN probe is removed: the hosted Linux and macOS runners return 0.00
for those credits, so the spurious values were local to one Mac.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@PavelMakarchuk PavelMakarchuk changed the title Update bundled TAXSIM test binaries to the October 8, 2026 builds Update bundled macOS and Linux TAXSIM test binaries to the October 8, 2026 build Oct 14, 2026
PavelMakarchuk and others added 2 commits October 28, 2026 07:57
cd2026102718 (osx a369f622, linux 87f6e656) replaces cd2026100817. The
two builds give identical output on all 15,000 records of the CPS
comparison sample, and each repeats exactly across runs (8 runs on macOS
for the IA/CO batches, 3 on a hosted Linux runner). The October 8 Linux
build stopped with SIGFPE on some batches, and the October 24 macOS build
gave different IA 2021-22 results across runs. Windows stays at the
August build; NBER's Windows download is still the October 22 upload.

The build still keeps the Additional Medicare Tax out of fiitax in every
year (2015, 2022 and 2024 checked) and passes the VA 2021 opt(30) probe
(siitax 2068.05, srebate 500).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
PavelMakarchuk added a commit that referenced this pull request Oct 28, 2026
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- Parse the build's " d1 <integer> <integer>" debug lines, printed before
  Colorado 2021 records. The parser accepted only one value after "d1",
  so every Colorado 2021 batch failed (1,476 records in the dashboard's
  TAXSIM-only run 40684445967).
- tests/taxsim_known_regressions.py keys known differences on the
  current build (cd2026102718). The #1416 EITC phase-out values of
  cd2026100817 match the pinned values again, so the MD and MFS guards
  return to their main versions and the #1416 lists are removed.
- New known differences: taxsim #1482 (nonprop counted twice in AGI
  before 2024) in the nonprop guard, and taxsim #1461 (NY 2024 Empire
  State child credit x0.33 a second time) for dependent-count record 9.
  The emulator keeps the pinned values; only the binary moved.
- The 2013-2023 AddMed test xfails only for builds before
  cd2026100817, so it passes on the new build.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
PavelMakarchuk added a commit that referenced this pull request Oct 28, 2026
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The October 27 build gives the student-status row 2 (2024, joint, two
children, a $400 child care credit) actc 528.00 instead of the Schedule
8812 line 27 amount of 928.00, so its fiitax is -672.98, not the pinned
-1072.98. The emulator keeps -1072.98. The guard now lists that one value
as a known difference of the current build (taxsim #1483) and fails on
any other change.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@PavelMakarchuk PavelMakarchuk changed the title Update bundled macOS and Linux TAXSIM test binaries to the October 8, 2026 build Update bundled macOS and Linux TAXSIM test binaries to the October 27, 2026 build Oct 28, 2026

This branch was successfully deployed

1 active deployment
Preview — 429b7412 Deployed Oct 28, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant