hcrosse commented on PR #1585:
URL: https://github.com/apache/arrow-go/pull/1585#issuecomment-6929801421

   @zeroshade Thanks. For the release notes: the typed `Skip` methods in 
`parquet/file` used to return the requested count even when they stopped early. 
They now return a lower count when the column ends first, and after an error 
they return the rows skipped before the step that failed.
   
   I reproduced the repeated column case with hand built V1 pages where the 
third row starts on one page and continues onto the next. `Skip(3)` returns 3 
with no error, and the next `ReadBatch` starts at the tail of that row. Because 
of #1521, that tail also comes back with repetition level 0, so it looks like a 
new row. I'll fix #1521 first and then open an issue for this.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to