Github user mbautin commented on the pull request:
https://github.com/apache/spark/pull/11036#issuecomment-178903997
@cloud-fan : the whole design for the feature this is needed for (query
fragment RDD reuse) is at https://issues.apache.org/jira/browse/SPARK-11838,
but this seems
GitHub user mbautin opened a pull request:
https://github.com/apache/spark/pull/11036
[SPARK-12291] [SQL] Establish a link between SparkPlan and LogicalPlan nodes
This is a prerequisite for reusing RDDs corresponding to shared query
fragments between different Spark SQL queries
Github user mbautin commented on the pull request:
https://github.com/apache/spark/pull/11036#issuecomment-179025654
Even in that case, we could still obtain RDDs corresponding to SparkPlan
nodes at stage boundaries, right? We would still find that useful in our query
workload
Github user mbautin commented on the pull request:
https://github.com/apache/spark/pull/11036#issuecomment-178902964
Sorry -- linked to the wrong JIRA ticket. Should be
https://issues.apache.org/jira/browse/SPARK-12991.
---
If your project is set up for it, you can reply
Github user mbautin commented on the pull request:
https://github.com/apache/spark/pull/9308#issuecomment-159099184
@rxin updated -- sorry for the delay.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user mbautin commented on a diff in the pull request:
https://github.com/apache/spark/pull/9308#discussion_r45291382
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
---
@@ -1870,4 +1870,19 @@ class SQLQuerySuite extends QueryTest
Github user mbautin commented on a diff in the pull request:
https://github.com/apache/spark/pull/8494#discussion_r43467362
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala
---
@@ -135,16 +135,25 @@ abstract class LogicalPlan
GitHub user mbautin opened a pull request:
https://github.com/apache/spark/pull/9308
[SPARK-10707] [SQL] Fix nullability computation in union output
Conflicts:
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mbautin/spark SPARK
