Xinyu Liu created SAMZA-1021:

             Summary: Remove the redundent poll waiting inside AsyncRunLoop 
                 Key: SAMZA-1021
             Project: Samza
          Issue Type: Bug
    Affects Versions: 0.11
            Reporter: Xinyu Liu
            Assignee: Xinyu Liu

The waiting inside AsyncRunLoop is redundent given systemconsumers will block 
on polling for empty partition. Empty partitions happens when chooser returns 
null envelope and at the same time some task worker is avaliable to pick up 
messages. In this case we should rely on the systemconsumers.poll() to block 
instead of blocking in scheduling.

The redundent waiting has been seen in our production job where both choose_ns 
and block_ns are high at the same time.

This message was sent by Atlassian JIRA

Reply via email to