Repository navigation
Probes: Lance 13 source pruning (D-TELEPORT-2) and 64 resident populations (D-PHOTO-0) - #1489
Merged
Merged
Conversation
Measures whether Lance 13's existing scanner and index paths prune source reads before the Quack/mask-risc fold, with identical answers. Arms: full scan + mask-risc fold, row-range prefilter (sorted only), zone-map filter, B-tree filter, and B-tree COUNT with an empty projection. Layouts sorted, partial, periodic and shuffled, with and without NULLs; a deletion pass checks COUNT stays exact. Every arm is asserted against the oracle. Findings: on ordered data the B-tree reads bytes proportional to selectivity; the zone map prunes only what clustering allows; on shuffled data at 50% the B-tree reads a third of the bytes and is ~9x slower than the full scan; index-only COUNT reads no data columns (index I/O is not in Lance's bytes_read counter). No new primitive is needed; the open item is a scan-vs-take cost choice. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015JH7YkXs5us6g3tG8NiFfP
64 populations x 1,048,576 addresses in four regimes (sparse, dense, clustered, 256 archetypes). Compares quack-fused and in-place plane lowering, single-range extents, per-address u64 signatures and signature-equivalence classes on COUNT, Any, SUM and Rows; the canonical expression plus 20 random ones equal the oracle in every arm. Also measures transpose, class build, 1,000-address updates and spill/reload. Bit-sliced planes answer in ~0.03-0.05 ms per query regardless of data; signatures lose by 250-600x; classes win only at a few hundred classes and cost 30-100x more per update. Board: entries for D-TELEPORT-2 and D-PHOTO-0, D-TELEPORT-1 marked shipped (#1487). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015JH7YkXs5us6g3tG8NiFfP
|
Warning Review limit reachedYour organization has reached its usage spending cap. Adjust your spending cap in the billing tab. Next included review available in 41 minutes. View limit details
Warning Billing warning: we have not been able to collect payment for this subscription for more than 72 hours. Please update the payment method or pay any pending invoices in Billing to avoid service interruption. Comment |
AdaWorldAPI
marked this pull request as ready for review
October 11, 2026 12:51
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Two measurement probes. No production code changes. Every arm in both probes is asserted against an oracle.
D-TELEPORT-2 —
crates/lance-graph-benches/examples/lance_source_probe.rsQuestion: can Lance 13's existing scanner and index paths prune source reads before the Quack/mask-risc fold?
Setup
Findings
bytes_readcounter.D-PHOTO-0 —
crates/lance-graph-quack/examples/photo_probe.rsQuestion: which representation answers boolean queries fastest over 64 populations × 1 Mi addresses?
Setup
Findings
AlphaMask.Board: two entries, three STATUS_BOARD rows, with D-TELEPORT-1 marked shipped (#1487).
Validation:
cargo clippy -p lance-graph-quack -p lance-graph-benches --examples -- -D warningsis clean, andcargo fmt --checkpasses.🤖 Generated with Claude Code
https://claude.ai/code/session_015JH7YkXs5us6g3tG8NiFfP
Generated by Claude Code