Repository navigation
issues: the 2026-11-11 scoreboard, ToyOS against Linux on both benches at ad5db5a65 - #1217
Conversation
Review r1 of #1217 at 82976d7 (base ad5db5a; main is 422915e)SEND BACK. The arithmetic is right and the evidence is clean; four things in the records are not. AssessmentRecords only: 14 files under What I verified
BLOCKERS
These are wake-path costs (the two
SUGGESTIONS
For the orchestrator (PR description)
|
…both benches Four osbench boots a bench interleaved with five Linux runs, the Linux reference taken in the same session on the same machine. The T14 reads 70 rows behind Linux, 52 ahead, 7 at parity and 5 unresolved; the AMD bench 35, 76, 8 and 15. The home record carries every row behind, ranked, with the record that owns it. Four rows behind had no record and get one: a clock read on the T14, a wake onto a busy CPU on both benches, the T14's 4- and 64-waiter storm drains, and the one-group all-CPU total. The yield record's row is measured now (3.41x on the T14, 1.13x on the AMD bench), so it is a defect under a slug that says so. The spawn, memory-filesystem, file-server, small-message, ping-pong, memcpy and user-memory records gain this session's table. The T14's durable-write record is left to #1215, which rewrites it; this session read its slow mode in four boots of four. Evidence: https://github.com/ToyOSOrg/evidence/tree/d44ebdae1f9f584d7b826e1498dbfd791a8d2339 Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
…x row that held no park, and records under headings their tables bear out - The home record is the scoreboard's, under a heading and exit that say so, and cites nothing but records and evidence. Tier 0 is stated in its own words, as proxies, with battery life named as absent. One record owns each row behind. The AMD table is ordered by the ratio against Linux's two TSC runs, with what a clean reading needs and what "76 ahead" carries (mitigations on Linux's system-call path; Linux's clock after block-and-wake rows). `crunch.single.parse` on the AMD bench, measured by two Linux runs, has no verdict: 35, 76, 8 and 14 of 133. - Eight timer rows a bench count ahead against a Linux that pads each sleep by 50 us. Against its slack-free rows three are behind on the T14 and one on the AMD bench; they are stated, ranked as exploratory, and owned by a new record. Later scoreboards judge against the slack-free rows. - `pingpong.futex.cross_core` held no park in three T14 boots; where it did it is 1.37x behind as on 2026-10-28. The record's exit asks for a park count per round. - The memory-filesystem and spawn records are renamed to what their tables read (35x, 147x), their stale sentences corrected, and citations moved. - The T14 durable-write record, the created-fsynced-unlinked record and the shootdown record gain this session's figures; the speed track says its AMD matmul reading has been 1.03x twice. Evidence: https://github.com/ToyOSOrg/evidence/tree/784d15e532d89aaa178162a1546024af1fc851df Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
82976d7 to
0c1cb24
Compare
Review r2 of #1217 at 0c1cb24 (base 422915e)LAND. The four blockers of r1 are resolved and every suggestion taken checks out against the raw run files. One sentence of the home record is inexact; it moves no verdict, rank, count or owner, so it is a suggestion. AssessmentRecords only: 25 files under I recomputed from the raw Blockers of r1
The AMD row against its two TSC runs is 49,110 / 11,364 = 4.32x. The other twelve cells of the two slack tables match too, as do "all eight count ahead against the default rows" on each bench (p 0.016 each) and the 2026-10-28 figures the record cites (4,387, 3,024 and 17,815 ns).
Suggestions taken, checked
SUGGESTIONS
r1's 22 is the 23 less the first of these, where ToyOS's median was under 2 GHz as well. That is my reconstruction from the data; r1's script is not kept. The "4.2 to 4.3 GHz" was r1's wording and was loose there too. Suggested: "after 23 of the 76 ... 1.37 to 1.9 GHz; after 19 of those ToyOS's read 4.2 to 4.3 GHz, and after the other four ToyOS's own reading was low in some boots". Also "in the median run" is the median of the five runs' readings; the run that supplied the median p50 gives 21 rows. The same sentence is in the PR body and the evidence README's appended section.
For the orchestrator
LAND |
Records only: a fresh scoreboard of ToyOS against Linux on both benches at main
ad5db5a65. It measures and records; it fixes nothing and changes no manual page.What it reads
Per bench, one reserved session: four
osbenchboots interleaved with five Linuxosbench allruns (L1 T1 L2 T2 L3 T3 L4 T4 L5). A row is behind or ahead when the committed compare's exact two-sided Mann-Whitney test gives p under 0.05 (at four against five: no inversion, or one; every row behind has none), at parity when unresolved with medians within 1.10, unresolved otherwise.The largest gaps, in the hotness order the home record states (its own, since the tree declares no hot rows; its first tier stands on proxies for build throughput and application launch):
proc.spawn_wait.large147x on the T14 and 45x on the AMD bench (8.1 and 12.6 ms against 55 and 279 µs);work.build_shapedat every CPU 2.22x and 2.57x; the other T14 process rows 1.38x to 2.17x. The spawn rows are ad5db5a's; A child's arguments and environment are memory its parent lays out #1200 has since changed how a child's arguments are laid out, unmeasured here.fs.diskmetadata 5x to 44x andfs.mem6x to 35x; a 4 KiB write at an offset 31x on DATA and 14.6x in memory; 4 KiB sequential writes 3.5x and 8.2x. On the AMD bench the same rows are 1.7x to 19x behind Linux's two TSC-timed runs.time.yield3.41x,pingpong.futex.same_cpu1.78x,wake.onto_busy1.74x (1.80x on the AMD bench, 2.16x against its TSC runs),ipc.reqrep.81.71x,pingpong.pipe.cross_core1.56x,time.now1.47x.time.sleep_late.100us2.85x,wake.periodic.loaded1.53x,wake.periodic.idle1.18x; AMDtime.timer_1ms.late2.03x. Later scoreboards judge against the slack-free rows.persist.seq_write_fsyncis 2.01x behind (260 against 523 MB/s), its 4 KiB durable writes ahead.Every row behind, ranked, with the one record that owns it, is in
issues/toyos-against-linux-on-both-benches-the-scoreboard.md.Records
no-published-run-compares-toyos-with-linux-on-one-machinewith its citations: the rule, the session's rows behind, and the gaps.pingpong.futex.cross_coreheld no park in three of the T14's four boots; where it did it reads 1.37x behind, as on 2026-10-28. The ping-pong record's exit now asks the row for a park count per round.persist.seq_write_fsyncis owned by the record open PR A reserved write's bytes go to the device at once, at the session's depth #1216 adds, named as such.Evidence and checks
-r2successors, the slack-free timer tables, the judge logs, the request with the rule set before the runs, the method). Its README states the session and, appended, its corrections after review r1.osbenchandclock_holds_over_minutesrows pass for each.boot:benchcasealso selects two I219 rows of another boot sharing the label, so those judge logs end exit 1 on those two alone;clock_holds_over_minutesby name exits 0 for all eight.no_tracked_file_identifies_a_machine_or_its_network,every_pending_exception_cites_an_issue_that_exists,every_committed_binary_file_is_declared), exit 0 at the head's tree. The full host suite was not run: nothing butissues/changed.Limits
Corrected after review r1
The first description said #1215 rewrites the T14 durable-write record (it added a pointer and a finding; this PR now adds the four slow boots there), that the AMD bench's "ahead" count flatters ToyOS (the count stands; the ratios were understated), and counted the timer rows ahead without the slack-free reading. The evidence README's "1.6% resolve by chance" is 3.2%, and its "bimodal per boot" for the futex row was wrong; both are corrected by an appended section.
🤖 Generated with Claude Code