Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/14214 Thanks for working on this, but I'm tempted to close this as "won't fix". Its likely we are going to have to rewrite the incremental planner completely for 2.1 and this is just a minor inefficiency if I understand correctly. In a more general comments: - There's no tests - If you find yourself needing to reference a bug/JIRA in several different places throughout the code, perhaps we need to reexamine the problem more holistically, rather than continue to pile on hacks.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org