zeroshade commented on issue #278: URL: https://github.com/apache/arrow-go/issues/278#issuecomment-2741136394
When using `SeekToRow` one of two things will occur: 1. If the file has an offset index populated, then it will use the offset index to find the right location to start reading from. so it will *only* load the relevant records. 2. If the file doesn't have an offset index then it will still need to read the page headers to find the right page to start reading from. So it'll avoid reading the body of the pages that are skipped. That all said, this is specifically if you have BufferedStreamEnabled set in the reader properties (so that it uses buffered IO). If you do not enable the buffered stream, it will always read the entire column into memory before it starts skipping. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
