yihua opened a new issue, #710: URL: https://github.com/apache/hudi-rs/issues/710
The workspace is several majors behind on its Arrow-side dependencies: arrow 57, parquet 57, object_store 0.12, DataFusion 52, pyo3 0.26, and Lance 4.0.1 (Lance is now at 11.0.0). Lance sets the ceiling for how far this can go. Every published `lance-*` release requires `arrow ^58`, and so does lance's unreleased `main` (12.0.0-beta), so arrow 58 is the highest the workspace can take while keeping the Lance base-file reader compiling. That in turn caps DataFusion at 54, which requires arrow 58.3. So this issue covers the move to arrow 58 / parquet 58 / object_store 0.13 / DataFusion 54 / Lance 11, plus the pyo3 0.28 that `arrow/pyarrow` forces on the way. DataFusion 55 needs arrow 59 and is out of reach until Lance publishes an arrow-59 release; datafusion-python is also still on 54, so the `hudi[datafusion]` FFI extra has no matching pin at 55 either. That is what blocks #698. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
