corwinjoy commented on PR #16649:
URL: https://github.com/apache/datafusion/pull/16649#issuecomment-3026163921
## Pull Request Overview from Copilot
This PR introduces an optional `parquet_encryption` feature that wires
encryption/decryption properties through the Parquet reader and writer layers
and updates workspace dependencies.
- Gate encryption/decryption logic behind `parquet_encryption` in
`source.rs`, `opener.rs`, and `file_format.rs`
- Expose and stub `FileEncryptionProperties`/`FileDecryptionProperties`
types in `common/src/config.rs`
- Add optional `hex` crate and define the `parquet_encryption` feature in
multiple `Cargo.toml` files
<details>
<summary>Show a summary per file</summary>
| File | Description
|
| ------------------------------------------------------------ |
---------------------------------------------------------------- |
| datafusion/datasource-parquet/src/source.rs | Fallback
`file_decryption_properties` when encryption is off |
| datafusion/datasource-parquet/src/opener.rs |
Conditionally pass decryption props to `ArrowReaderOptions` |
| datafusion/datasource-parquet/src/file_format.rs | Apply cfg
guards around decryption props for schema/statistics |
| datafusion/datasource-parquet/Cargo.toml | Add
optional `hex` and define `parquet_encryption` feature |
| datafusion/core/tests/parquet/encryption.rs | Gate
round-trip encryption test behind feature flag |
| datafusion/core/src/dataframe/parquet.rs | Gate
dataframe encryption test behind feature flag |
| datafusion/core/Cargo.toml | Enable
`parquet_encryption` in workspace default features |
| datafusion/common/src/file_options/parquet_writer.rs |
Conditionally add encryption props in writer builder |
| datafusion/common/src/config.rs | Publicly
expose and stub encryption types based on cfg |
| datafusion/common/Cargo.toml | Add
optional `hex` under `parquet_encryption` |
| Cargo.toml | Introduce
`hex` dependency (always enabled) |
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
