Repository navigation
[Epic] Parquet Modular Encryption Support #7278
Description
This ticket tracks the work to implement Parquet Modular Encryption
See the prior discussion / question here:
Related items
- Support reading parquet with modular encryption #7296
- Use parquet crate for decoding Parquet data into Arrow arrays datafusion-comet#1040
- Update Implementation Status to note that arrow-rs now supports modular encryption (R) parquet-site#107
- Add Parquet Modular decryption (read) support +
encryptionflag #6637 - Support writing Parquet with modular encryption #7327
- Support the AES-GCM-CTR-V1 encryption algorithm for Parquet modular encryption #7258
- Verify footer tags when reading encrypted Parquet files with plaintext footers #7255
- Allow retrieving Parquet decryption keys based on the key metadata #7257
-
Support Parquet key management tools #7256 - Consolidate encryption parquet tests #7280
- Add example for how to read/write encrypted parquet files #7281
- Add decryption support for column index and offset index #7390
- Support writing encrypted Parquet files with plaintext footers #7320
- Include footer key metadata when writing encrypted Parquet with a plaintext footer #7600
- Support multi-threaded writing of Parquet files with modular encryption #7359
- [Parquet] Provide only encrypted column stats in plaintext footer #8304
- [Parquet] Concurrent writes with ArrowWriter.get_column_writers should parallelize across row groups #8115
- Use a "SecureString" like type to store Parquet encryption keys #7373
- [Parquet] Support async Parquet encryption key retrieval #8238
Activity
Bukhtawar commentedon Jul 31, 2025
@alamb : Is encrypted footer support also supported/tracked https://github.com/apache/parquet-format/blob/master/Encryption.md#54-encrypted-footer-mode
adamreeve commentedon Jul 31, 2025
Hi @Bukhtawar, footers are encrypted by default, but files can optionally use plaintext footers by calling
EncryptionPropertiesBuilder::with_plaintext_footer(true)when creatingFileEncryptionProperties.