alamb commented on issue #10655: URL: https://github.com/apache/arrow-rs/issues/10655#issuecomment-5656070939
> ----------- // with your suggestion : ---------------------- yes that is roughly what I was suggesting > Yes for row by row use case, we have a parquet reader over a file and we can advance to a particular doc at any given time and read N rows I see -- the window part is what I was missing (as in the reader reads some larger batch, rather than a single row) Can you help me understand the usecase for reading the `window` (block of rows)? My example above was just a set of ids (single rows) and then your `advance()` method seems to also go to an exact row, but then read a batch of rows. Can you explain what the usecase is for getting the window of rows? Is there some clustering ? or are you trying to find context of the row (e.g. if they were log lines, etc)? BTW perhaps a call would be easier -- feel free to email me at [email protected] and we can set up a time to do a video call. Thank you for your engagement with this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
