Michael Armbrust created SPARK-17813:
----------------------------------------
Summary: Maximum data per trigger
Key: SPARK-17813
URL: https://issues.apache.org/jira/browse/SPARK-17813
Project: Spark
Issue Type: Sub-task
Components: SQL
Reporter: Michael Armbrust
At any given point in a streaming query execution, we process all available
data. This maximizes throughput at the cost of latency. We should add
something similar to the {{maxFilesPerTrigger}} option available for files.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
