Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21662#discussion_r200532939
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala ---
@@ -354,6 +355,27 @@ abstract class SparkStrategies extends
QueryPlanner[SparkPlan] {
}
}
+ /**
+ * Used to plan the streaming global limit operator.
+ * We need to check for either a direct Limit or a Limit wrapped in a
ReturnAnswer operator,
+ * following the example of the SpecialLimits Strategy above, because we
want to use
+ * the normal limit exec for streams that are not in Append mode.
--- End diff --
Can you also add comments on why we handle only append mode?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
