HeartSaVioR edited a comment on issue #23757: [SPARK-24211][SPARK-24239][SQL][BRANCH-2.3] Fix streaming join/kafka continuous mode test flakiness on branch-2.3 URL: https://github.com/apache/spark/pull/23757#issuecomment-462226477 I'm finalizing the PR via minimizing the change between origin and cherry-picked (mostly SPARK-23408). I was right: there was incompatibility on DSv2 between Spark 2.3 and Spark 2.4 so I had to fix them. Will update the PR description once I sort out and rebase. Regarding relevant of SPARK-23408 and SPARK-23491 / SPARK-23416, now I'm not 100% sure of relevant between them, because I just realized the test failure can hide other test failures which are not relevant. If we really want to split out PRs via relevance, we might be able to have two individual PRs, but need more times to split them and test them individually, so not sure about needs it cause this is just a matter of porting back.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
