andygrove opened a new issue, #48: URL: https://github.com/apache/datafusion-spark/issues/48
This repo starts from the point where DataFusion `branch-56` was cut. Two PRs landed on `main` after that: - apache/datafusion#27049: short Apache header migration (already included here, no functional effect) - apache/datafusion#26703: \"perf: stop dictionary work growing with the group count\" #26703 changed `crates/spark/src/function/math/hex.rs` to use `datafusion_common::utils::map_dictionary_values`, which does not exist on `branch-56`. It was reverted in #45 so the crate builds against `branch-56`. Follow-up: - [ ] Once the DataFusion 56 crates are released, switch the git dependencies in `Cargo.toml` to the released crates. - [ ] Re-apply the `hex.rs` change from #26703 once the crate depends on a DataFusion release (57+) that includes `map_dictionary_values`. - [ ] Check for any other spark changes that landed on DataFusion `main` after the branch-56 cut. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
