JingsongLi opened a new issue, #1046: URL: https://github.com/apache/paimon-rust/issues/1046
### Problem Java Data Evolution can generate an aligned `.row` auxiliary file for each normal data file and select it for sparse row-id reads. Rust already has the ROW codec, but its table writer does not register these auxiliary files and its table reader does not select them. PyPaimon consequently falls back to Python when `data-evolution.row-sidecar.enabled` is enabled or ROW extra files are present. ### Expected behavior Support the existing Java table properties in Rust core: - Generate and track aligned ROW sidecars during normal Data Evolution writes and partial column updates. - Select the sidecar using the original requested row ranges and Java's selection thresholds, independently of file indexes, deletion vectors and LIMIT. - Honor missing-file fallback and external data paths, retain prepared files after ownership is handed off, and include known abandoned sidecars in explicit abort cleanup. - Preserve logical ROW encoding, including inline BLOB payloads and VECTOR values; keep dedicated BLOB/vector writers' sidecar exclusion. This allows PyPaimon's batch/stream write, read and update paths to remain Native without changing its Rust binding API. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
