FelixYBW commented on PR #10787: URL: https://github.com/apache/incubator-gluten/pull/10787#issuecomment-3324936545
data source add split time counts the time to add a split to table scan in main thread. The split may or may not be prefetched. data source read time counts the time to read a page from parquet in table scan in main thread. The page may or maynot be prefetched. it count the decompress time as well. It doesn't count the time for lazy read. Lazy read is counted in following operators or when we do flatten. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
