Repository navigation
Conversation
|
sorry for bringing this here, but maybe someone could help with similar request: #8202 |
|
Spec changes need to go through the dev list. |
I agree, adding kll in the puffin spec would be helpful. Can someone please helpout with this request ? |
|
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions. |
Theta sketch computation for NDV column statistics is slow in some workloads, causing a 10-20% insert slowdown in Trino.
That PR adds an HLL option but has to store it as an engine-specific blob type, because the Puffin spec has no standard HLL type. This adds
apache-datasketches-hll-v1, a compact Apache DataSketches HLL sketch with anndvproperty, so engines can share HLL-based NDV statistics.