waynexia commented on issue #4575: URL: https://github.com/apache/arrow-datafusion/issues/4575#issuecomment-1352517537
Appreciate the investigation @alex-natzka :heart: > - This changes the output schema, because we don't project out the column again. > > The last point is the problem IMO. I guess common_sub_expression_eliminate would need to add another projection after the filter that gets rid of the extra column. This point sounds reasonable to me. I revisited the unit tests in `common_sub_expression_eliminate`, and looks like I only used the plans that have their own output schema like `Projection` or `Aggregator`. Which will ignore the additional column by itself. I plan to look into it this week (and sorry for the late reply 🥲). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
