zhli1142015 commented on PR #7003: URL: https://github.com/apache/incubator-gluten/pull/7003#issuecomment-2309680098
> > > > From above I actually can't repro the issue. I think maybe this is because of the hardware differences, but with more partitions, we actually observe the latency increasing. > > > > > > > > > Did you final get 10000+ FilePartitions for sql or only have one partition? > > > > > > 6k+ partitions for 10K values, and 60k+ partitions for 120k values.  > >  > > Greate, could you try 30 sqls in one Application to check if you can reproduce? OOM happens with 120K values, but there is no event dropped logs.  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
