Tathagata Das created SPARK-18670:

             Summary: Limit the number of 
StreamingQueryListener.StreamProgressEvent when there is no data
                 Key: SPARK-18670
                 URL: https://issues.apache.org/jira/browse/SPARK-18670
             Project: Spark
          Issue Type: Bug
            Reporter: Tathagata Das
            Assignee: Shixiong Zhu

When a StreamingQuery is not receiving any data, and no processing trigger is 
set, it attempts to run a trigger every 10 ms. This would generate 
StreamingQueryListener events at a very high rate. This should be limited such 
that as long as data is not being received, it should generate events once 
every X seconds.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to