Skip to content

bench: re-measure the macOS reference profile on the published plan - #747

Merged
Exoridus merged 1 commit into
nextfrom
bench/reference-run-macos-webkit
Sep 15, 2026
Merged

Exoridus merged 1 commit into
nextfrom
bench/reference-run-macos-webkit

Conversation

@Exoridus

Copy link
Copy Markdown
Owner

What

Re-measures the macOS profile (m3-max-macos-27-beta-webkit.json) on next after #745, from three separate WebKit runs pooled with bench:compare --profile. verify:bench-results is green.

Why it shrinks

The profile drops from 253 rendering cells to 108, and the overdraw archetype disappears. That is the point of the change rather than a loss.

#733 published this machine on the full ladder. full is the development matrix — it exists so no historical cell stops being reachable — and it carries the ExoJS-internal probes (overdraw, split-screen, the material and mesh rows, instanced-batch) that the published catalog leaves out on purpose: a competitor arm renders some other scene on those, so they are development rows and never a published comparison. Publishing them states a comparison the harness itself does not claim.

reference is the published plan, and the site filters nothing — it carries display labels for those probe archetypes and shows whatever a profile contains. So this run puts macOS back on the same plan Windows uses: 108 cells against 107, first time both machines answer the same matrix.

Follow-up worth having

Nothing stops a full profile from being committed again. Either the benchmarks page should refuse archetypes outside the published catalog, or verify:bench-results should reject a profile that contains them. Not in this PR.

https://claude.ai/code/session_013jqQeGU6gwsQhYDFrKiN1A

@Exoridus
Exoridus enabled auto-merge (squash) September 15, 2026 02:04
@codecov

codecov Bot commented Sep 15, 2026

Copy link
Copy Markdown

Bundle Report

Changes will decrease total bundle size by 202.93kB (-0.39%) ⬇️. This is within the configured threshold ✅

Detailed changes
Bundle name Size Change
site-server-esm 34.03MB -202.93kB (-0.59%) ⬇️

Affected Assets, Files, and Routes:

view changes for bundle: site-server-esm

Assets Changed:

Asset Name Size Change Total Size Change (%)
chunks/bench-profiles_DT8UmwSE.mjs (New) 363.3kB 363.3kB 100.0% 🚀
prerender-entry.DsRATGCm.mjs (New) 232.96kB 232.96kB 100.0% 🚀
chunks/BenchFullResultsPage_DeT1EY70.mjs (New) 36.23kB 36.23kB 100.0% 🚀
chunks/BenchmarksPage_BXS4Lj07.mjs (New) 35.6kB 35.6kB 100.0% 🚀
chunks/BenchMethodologyPage_CaLVSrjK.mjs (New) 14.86kB 14.86kB 100.0% 🚀
chunks/index_BMo1ZL2X.mjs (New) 1.08kB 1.08kB 100.0% 🚀
chunks/index_Dtan6yux.mjs (New) 1.08kB 1.08kB 100.0% 🚀
chunks/index_DQoPEnsf.mjs (New) 1.03kB 1.03kB 100.0% 🚀
chunks/index_uMhzrZtF.mjs (New) 1.03kB 1.03kB 100.0% 🚀
chunks/index_DD37mAkN.mjs (New) 992 bytes 992 bytes 100.0% 🚀
chunks/index_TcStoHAU.mjs (New) 992 bytes 992 bytes 100.0% 🚀
chunks/bench-profiles_B1KhN2SV.mjs (Deleted) -566.23kB 0 bytes -100.0% 🗑️
prerender-entry.BKZnCRxi.mjs (Deleted) -232.96kB 0 bytes -100.0% 🗑️
chunks/BenchFullResultsPage_YOdljKNV.mjs (Deleted) -36.23kB 0 bytes -100.0% 🗑️
chunks/BenchmarksPage_D1KBB3RS.mjs (Deleted) -35.6kB 0 bytes -100.0% 🗑️
chunks/BenchMethodologyPage_BDvgHhqA.mjs (Deleted) -14.86kB 0 bytes -100.0% 🗑️
chunks/index_2-HHg7kR.mjs (Deleted) -1.08kB 0 bytes -100.0% 🗑️
chunks/index_CPSt5qeP.mjs (Deleted) -1.08kB 0 bytes -100.0% 🗑️
chunks/index_CA1bUddt.mjs (Deleted) -1.03kB 0 bytes -100.0% 🗑️
chunks/index_YboxNPKC.mjs (Deleted) -1.03kB 0 bytes -100.0% 🗑️
chunks/index_0dRstkDw.mjs (Deleted) -992 bytes 0 bytes -100.0% 🗑️
chunks/index_sO6q0t8K.mjs (Deleted) -992 bytes 0 bytes -100.0% 🗑️

@Exoridus
Exoridus merged commit 399aa52 into next Sep 15, 2026
13 checks passed
@Exoridus
Exoridus deleted the bench/reference-run-macos-webkit branch September 15, 2026 02:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant