xianjingfeng commented on issue #407: URL: https://github.com/apache/incubator-uniffle/issues/407#issuecomment-1350559999
> Do you mean `OptimizeSkewInRebalancePartitions`? I just checked the code and I believe the optimization rule is only applied when user rebalances output and there's indeed some skew partitions. Yes. Reduce task will read all index files of all partitions. You can try to run a job and trace the logs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@uniffle.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
