jiangshifu commented on issue #50548: URL: https://github.com/apache/arrow/issues/50548#issuecomment-5029036388
> I have some issue understanding the scope here. > > > [problem] for a page with 6w int，when call record_reader->SkipRecords(59000); it consume about 1.1ms > > What is `6w int`? > > > ``` > > 1. for a batch(1024), call FindMinMax, will compute 2048 times(1024 min, 1024 max) > > ``` > > Where does 1024 comes from here? > > Also what version of Arrow is this on? We recently made changes here so I am wondering if this is referring to a regression, or if this was existing behavior. 6w is 60000 rows int 1024 is constexpr int64_t kSkipScratchBatchSize = 1024; -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
