akupchinskiy commented on PR #2167: URL: https://github.com/apache/datafusion-comet/pull/2167#issuecomment-3208043464
> Thanks @akupchinskiy I checked it failed now on main > > ``` > org.apache.comet.CometRuntimeException: Partition number mismatch: 3 != 4 > ``` > > Any reason the first partition number is taken? Can it be an issue if this value would be too small/large comparing to others? I believe it just picks the first from plan traversal output which might even be undetermined at least in cases when AQE is on. In simple scenarios, there is only one non-broadcast plan in the list - so usually it is no issue. The more explicit way to reproduce it is to run TPCDS query set on comet build for spark 4.0: ~15 queries fail with the same error, and all of them run with no error on the patched version. I have not figured out the root cause of this regression though -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
