lifulong opened a new pull request, #8415: URL: https://github.com/apache/incubator-gluten/pull/8415
…ec node ## What changes were proposed in this pull request? implement doCanonicalize in ColumnarPartialProjectExec node, for reuse exchange contains ColumnarPartialProjectExec (same kind problem as https://github.com/apache/incubator-gluten/issues/3154) (Fixes: \#8414) ## How was this patch tested? manual test in our product env <img width="610" alt="image" src="https://github.com/user-attachments/assets/264c7c99-5fe9-4fbc-8945-fe726b17b7f0"; /> the biggest table read four times before implement doCanonicalize in ColumnarPartialProjectExec <img width="633" alt="image" src="https://github.com/user-attachments/assets/2cdb045a-81a2-4129-8cca-6061029f3fec"; /> the biggest table read one times before implement doCanonicalize in ColumnarPartialProjectExec <img width="650" alt="image" src="https://github.com/user-attachments/assets/1d54f48d-49b4-405b-a142-7918b7dee87a"; /> we can also see the stage reuse multi times after implement doCanonicalize in ColumnarPartialProjectExec in spark plan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
