manuzhang opened a new pull request, #5324: URL: https://github.com/apache/datafusion-comet/pull/5324
## Which issue does this PR close? Supersedes #5288. ## Rationale for this change PR #5288 upgrades `opendal` to 0.58.1 while leaving `object_store_opendal` at 0.57.0. This introduces incompatible `Operator` types from two OpenDAL versions and breaks native compilation. OpenDAL 0.58 also returns a completed `Operator` from `Operator::new`, so the previous `.finish()` calls no longer compile. ## What changes are included in this PR? - Upgrade `opendal` to 0.58.1 and the compatible, non-yanked `object_store_opendal` release to 0.58.0. - Update HDFS operator construction for the OpenDAL 0.58 API. - Box the larger OpenDAL operator in `ParquetWriter::Remote` to keep the enum within Clippy's size threshold. - Refresh `Cargo.lock` while retaining Iceberg's independent OpenDAL 0.57 dependency. ## How are these changes tested? - `cargo check --locked -p datafusion-comet --features hdfs-opendal` - `cargo fmt --all -- --check` - `cargo clippy --all-targets --all-features -- -D warnings` The pre-commit Scala compile was also attempted, but Maven could not resolve `org.scalameta:semanticdb-scalac_2.13.17:4.13.6` in the local environment. The changes are Rust-only. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
