[GitHub] [spark] mingjialiu commented on pull request #29430: [SPARK-32609] Incorrect exchange reuse with DataSourceV2

2020-08-14 Thread GitBox
mingjialiu commented on pull request #29430: URL: https://github.com/apache/spark/pull/29430#issuecomment-674302449 > I think it might make sense to add a test with a self join between the two dfs yields the correct results to mirror the issue observed The issue observed cannot be

[GitHub] [spark] mingjialiu commented on pull request #29430: [SPARK-32609] Incorrect exchange reuse with DataSourceV2

2020-08-14 Thread GitBox
mingjialiu commented on pull request #29430: URL: https://github.com/apache/spark/pull/29430#issuecomment-674230500 > This is against 2.4. Could you also check whether the master branch still has such an issue? I cannot repro the issue at master branch. 3.0. in unit test.