Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22524#discussion_r220039084
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/BufferedRowIterator.java
---
@@ -38,6 +38,11 @@
protected int partitionIndex = -1;
+ // This indicates whether the query execution should be stopped even the
input rows are still
+ // available. This is used in limit operator. When it reaches the given
number of rows to limit,
+ // this flag is set and the execution should be stopped.
+ protected boolean isStopEarly = false;
--- End diff --
what if there are 2 limits in the query?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
