jayshrivastava commented on issue #22098:
URL: https://github.com/apache/datafusion/issues/22098#issuecomment-5546385988
Seeing this in datafusion-distributed for tpch-q21 at sf100 after the df55
upgrade. We've actually been OOMing on this query since then (12 pods,
17GB/7CPUs each).
This optimizer rule swaps the join from `LeftAnti` to `RightAnti`, causing
>10x more memory usage.
```
- Selective side: 19,200 rows, 1,914,387 bytes
- Broad side: 119,331 rows, 1,909,296 bytes
```
[q21-743bd0a-df55.plan.txt](https://github.com/user-attachments/files/31850295/q21-743bd0a-df55.plan.txt)
[q21-ee561b5-df54.plan.txt](https://github.com/user-attachments/files/31850296/q21-ee561b5-df54.plan.txt)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
