Repository navigation
Update bundled macOS and Linux TAXSIM test binaries to the October 27, 2026 build - #1206
Draft
PavelMakarchuk wants to merge 11 commits into
Draft
PavelMakarchuk wants to merge 11 commits into
PavelMakarchuk wants to merge 11 commits into
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This was referenced Sep 24, 2026
This was referenced Sep 24, 2026
This was referenced Sep 24, 2026
All three platforms now carry build cd2026100817 (macOS and Linux from out2psl, Windows from taxsimtest/taxsimtest.exe), the build the census audit uses. Manifest, README table and changelog fragment updated. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
cd2026100817 prints " d1 <value>" before Minnesota 2024-2025 records; the parser counted them as records with no taxsimid, so a 5,000-record 2024 batch came back with 10,496 rows. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- AddMed: cd2026100817 keeps AddMed out of 2013-2023 fiitax (taxsim #1225), so the strict xfail is removed and the notes in the module, test_performance.py, the README and PolicyEngineRunner are updated. - taxsim #1416: the build starts the EITC phase-out at $0 for some filers. tests/taxsim_known_regressions.py lets a test tolerate the exact values it changes (MFS head-of-household v25, nonprop 6000, 6001 and 7005, MD record 7, dependent-count records 5, 6 and 9); any other difference still fails, and the test fails again once #1416 is fixed so the entries are removed. - CA 2021 nonprop records 25-27 re-pinned: the build lowers CA tax before credits by $0.72-$1.27 (cause not established). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
On macOS 27 with Rosetta 2 reinstalled, cd2026100817 gives IL 2021-2023 and IN 2021-2022 returns state credits (v39) that it did not give on macOS 26 with the same inputs. The probe prints each runner's bundled-build output before the tests run, so the hosted Linux, Windows and macOS runners show whether the values depend on the platform. It never fails the job. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
NBER's October 8 Windows build returns different values from the macOS and Linux builds of the same stamp (the CI probe: Indiana 2024 v39 63.20 where they give 0.00; fiitax gaps in the itemized and dependent-count tests), so Windows stays at cd2026081318. tests/taxsim_known_regressions.py reads the platform's bundled build stamp; the #1416 and CA 2021 known values and the AddMed xfail now apply only to the build they describe. The CA 2021 pins return to the earlier builds' values. The temporary IL/IN probe is removed: the hosted Linux and macOS runners return 0.00 for those credits, so the spurious values were local to one Mac. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
cd2026102718 (osx a369f622, linux 87f6e656) replaces cd2026100817. The two builds give identical output on all 15,000 records of the CPS comparison sample, and each repeats exactly across runs (8 runs on macOS for the IA/CO batches, 3 on a hosted Linux runner). The October 8 Linux build stopped with SIGFPE on some batches, and the October 24 macOS build gave different IA 2021-22 results across runs. Windows stays at the August build; NBER's Windows download is still the October 22 upload. The build still keeps the Additional Medicare Tax out of fiitax in every year (2015, 2022 and 2024 checked) and passes the VA 2021 opt(30) probe (siitax 2068.05, srebate 500). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
PavelMakarchuk
added a commit
that referenced
this pull request
Oct 28, 2026
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- Parse the build's " d1 <integer> <integer>" debug lines, printed before Colorado 2021 records. The parser accepted only one value after "d1", so every Colorado 2021 batch failed (1,476 records in the dashboard's TAXSIM-only run 40684445967). - tests/taxsim_known_regressions.py keys known differences on the current build (cd2026102718). The #1416 EITC phase-out values of cd2026100817 match the pinned values again, so the MD and MFS guards return to their main versions and the #1416 lists are removed. - New known differences: taxsim #1482 (nonprop counted twice in AGI before 2024) in the nonprop guard, and taxsim #1461 (NY 2024 Empire State child credit x0.33 a second time) for dependent-count record 9. The emulator keeps the pinned values; only the binary moved. - The 2013-2023 AddMed test xfails only for builds before cd2026100817, so it passes on the new build. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
PavelMakarchuk
added a commit
that referenced
this pull request
Oct 28, 2026
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The October 27 build gives the student-status row 2 (2024, joint, two children, a $400 child care credit) actc 528.00 instead of the Schedule 8812 line 27 amount of 928.00, so its fiitax is -672.98, not the pinned -1072.98. The emulator keeps -1072.98. The guard now lists that one value as a known difference of the current build (taxsim #1483) and fails on any other change. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Update the emulator's bundled NBER TAXSIM test executables for macOS and Linux to build
cd2026102718(October 27, 2026). This is the build that the TAXSIM-35 census audit now uses. Windows stays at the August build (see below).cd2026081819cd2026102718cd2026081819cd2026102718cd2026081318cd2026081318(kept)Why this build
Changes
v39of $63.20 where they gave $0.00. On October 28,taxsimtest/taxsimtest.exewas still the October 22 upload. Sotaxsimtest-windows.exestays atcd2026081318, with a note in the manifest and the README.manifest.jsonrecords the URLs, build stamps, sizes, last-modified dates and SHA-256 checksums. The README table is updated.d1 <value>before Minnesota 2024–2025 records (October 8 build), andd1 <integer> <integer>before Colorado 2021 records (October 27 build).TaxsimRunnerskips these exact shapes, and only these shapes. Without the second shape, every Colorado 2021 batch failed. Tests cover both shapes.cd2026100817, TAXSIM keeps the Additional Medicare Tax out offiitaxin every year, the correction reported on Does taxsimtest count the Additional Medicare Tax twice (in fiitax and in fica/tfica)? #1225. The new build does the same (2015, 2022 and 2024 checked). The 2013–2023 test now xfails only for builds beforecd2026100817, which keeps the Windows build's behaviour.tests/taxsim_known_regressions.pyreads the platform's bundled build stamp. A test can then tolerate the exact values that the current build changes, and it fails if any other value changes. When TAXSIM fixes a listed difference, the test fails again, so that the entry is removed. Three differences apply to this build. In each, the emulator keeps the pinned values and only the binary moved:nonproptwice in AGI before 2024? #1482:nonpropis counted twice in federal AGI in every year before 2024 (1990–2023 checked), and in the state AGI that starts from it. This affects the pre-2024 records of the nonprop guard.sctc108.90 instead of 330), so dependent-count record 9 hassiitax−791.50 instead of −1,012.60.actc528.00 instead of 928.00 andfiitax−672.98 instead of −1,072.98.siitaxchange first seen incd2026100817($0.72 at CA taxable income $45,197). The cause is not established.cd2026100817(Does the current executable start the federal EITC phase-out at zero income? #1416) match the pinned values again in this build. So the MD and MFS guard tests return to theirmainversions, and the Does the current executable start the federal EITC phase-out at zero income? #1416 lists are removed.Validation
cd2026102718.opt(30)probe givessiitax2068.05 andsrebate500. A single filer with $400,000 of wages givesfiitax=v28in 2015, 2022 and 2024.nonproptwice in AGI before 2024? #1482 and Does the current TAXSIM executable leave the child care credit out of Credit Limit Worksheet A for the 2024–2025 additional child tax credit? #1483 above, plus the existingotheritemdivergence. The 8 skips are the hosted end-to-end suite (6) and the Docker wrapper tests (2).Other open questions about this build are in the TAXSIM-35 audit issues (for example #1446, #1448, #1461, #1472, #1473, #1482 and #1483). Benchmarks and dashboard runs stay pinned to their binary hash. Comparisons made before and after this update can differ even with the same PolicyEngine code.
🤖 Generated with Claude Code