Thomas Groh created BEAM-690:
--------------------------------

             Summary: Backoff in the DirectRunner Monitor if no work is 
Available
                 Key: BEAM-690
                 URL: https://issues.apache.org/jira/browse/BEAM-690
             Project: Beam
          Issue Type: Bug
          Components: runner-direct
            Reporter: Thomas Groh
            Assignee: Thomas Groh


When a Pipeline has no elements available to process, the Monitor Runnable will 
be repeatedly scheduled. Given that there is no work to be done, this will loop 
over the steps in the transform looking for timers, and prompt the sources to 
perform additional work, even though there is no work to be done. This consumes 
the entirety of a single core.

Add a bounded backoff to rescheduling the monitor runnable if no work has been 
done since it last ran. This will reduce resource consumption on low-throughput 
Pipelines.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to