[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212795284 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala --- @@ -130,10 +133,22 @@ object

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212795255 --- Diff: python/pyspark/sql/tests.py --- @@ -6394,6 +6394,17 @@ def test_invalid_args(self): df.withColumn('mean_v',

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212795238 --- Diff: python/pyspark/sql/tests.py --- @@ -6394,6 +6394,17 @@ def test_invalid_args(self): df.withColumn('mean_v',

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212676265 --- Diff: python/pyspark/sql/tests.py --- @@ -6394,6 +6394,17 @@ def test_invalid_args(self): df.withColumn('mean_v',

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212497182 --- Diff: python/pyspark/sql/tests.py --- @@ -6394,6 +6394,17 @@ def test_invalid_args(self): df.withColumn('mean_v',

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212496291 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala --- @@ -130,10 +133,22 @@ object

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212489210 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala --- @@ -130,10 +133,22 @@ object

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212488758 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala --- @@ -130,10 +133,22 @@ object

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212488439 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala --- @@ -130,10 +133,22 @@ object

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212488266 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala --- @@ -130,10 +133,22 @@ object

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/22206#discussion_r212484229 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala --- @@ -130,10 +133,22 @@ object

[GitHub] spark pull request #22206: SPARK-25213: Add project to v2 scans before pytho...

GitHub user rdblue opened a pull request: https://github.com/apache/spark/pull/22206 SPARK-25213: Add project to v2 scans before python filters. ## What changes were proposed in this pull request? The v2 API always adds a projection when converting to physical plan to