Dandandan commented on pull request #8797: URL: https://github.com/apache/arrow/pull/8797#issuecomment-735376628
Would it make sense to have a test strategy that makes it easy to test the optimizer? I think it can be really easy to introduce some bugs in optimization passes/rules that are not covered in a unit test. Basically in the end we want to verify that: `execute(optimize(logical_plan), data) = execute(logical_plan, data)` So in the tests we could have some queries / datasets and verify this property by checking whether the outcome is equal. Do we have something like that already? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org