Github user zecevicp commented on the issue: https://github.com/apache/spark/pull/21109 @mgaido91 Regarding the amount of code, maybe you can suggest how to reduce it? Because I don't see a way... I think the code is well contained (mostly in separate new classes) and is not contaminating the existing codebase. There is a simple switch (parameter) that turns off the whole thing. Some code also went into the use cases which contribute to the amount of changes. I believe that the potentially significant speedup justifies the line count.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org