xumingming commented on issue #1693:
URL: https://github.com/apache/auron/issues/1693#issuecomment-3615272385

   > Since it is not easy to distinguish between unintentional and intentional 
causes, ensuring these SQL queries run successfully whenever possible will 
enhance Auron’s robustness, resilience, and user experience.
   
   Totally agree with you. After some digging I find the root cause of this 
issue is: 
https://github.com/apache/auron/blob/027cffa52b7a2ce44dd4fbafb360448a7733a1df/native-engine/datafusion-ext-plans/src/joins/smj/full_join.rs#L163-L166
   
   It is accumulating huge batches here without checking batchSize, I think we 
should fix it here.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to