16pierre commented on PR #7307: URL: https://github.com/apache/arrow-rs/pull/7307#issuecomment-3307738470
> row numbers are a pretty fundamental feature that's very hard to emulate in higher layers if the parquet reader doesn't support them +1 on this painpoint, working around this lack of capability from a client perspective is very challenging and comes with a bunch of correctness risks (e.g. we can write some rowIndex column client-side, but then we have to be 100% sure that the emitted rowIndex will perfectly match the Parquet files, which can get quite tricky especially in multi-threaded executions etc.) Would love to this feature landing in Arrow-rs + Datafusion -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
