TobiasP created SPARK-16994:
-------------------------------
Summary: Filter and limit are illegally permuted.
Key: SPARK-16994
URL: https://issues.apache.org/jira/browse/SPARK-16994
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.0.0
Reporter: TobiasP
{noformat}
scala> spark.createDataset(1 to 100).limit(10).filter($"value" % 10 ===
0).explain
== Physical Plan ==
CollectLimit 10
+- *Filter ((value#875 % 10) = 0)
+- LocalTableScan [value#875]
scala> spark.createDataset(1 to 100).limit(10).filter($"value" % 10 ===
0).collect
res23: Array[Int] = Array(10, 20, 30, 40, 50, 60, 70, 80, 90, 100)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
