Conversation
58333f2 to
9e86827
Compare
dddd7d7 to
db7ca99
Compare
|
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that's incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions. |
db7ca99 to
1c20827
Compare
|
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that's incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions. |
1c20827 to
92c4f16
Compare
Rationale for this change
apache-datasketches-theta-v1was already listed as a valid blob type in PuffinBlobMetadata and BlobMetadata, but pyiceberg had no way to read the actual sketch data. This implements deserialization so callers can access NDV estimates stored in statistics Puffin files written by engines like Spark.Are these changes tested?
Yes.
Are there any user-facing changes?
Yes. New
pyiceberg/table/theta_sketch.pywith ThetaSketch class andtheta_sketches_from_puffin_filefunction. New optional dependencydatasketchesunder the datasketches extra.