Alan Zhang created SAMZA-2444:
---------------------------------

             Summary: JobModel save in CoordinatorStreamStore resulting flush 
for each message
                 Key: SAMZA-2444
                 URL: https://issues.apache.org/jira/browse/SAMZA-2444
             Project: Samza
          Issue Type: Improvement
            Reporter: Alan Zhang


JobModelManager uses CoordinatorStreamStore.put() to save job model information 
which does flush for each message.

The flush operation in CoordinatorStreamStore is very heavy, so it may take 
over a very long time for AM to save the information in a run.

We should use CoordinatorStreamStore's batch put instead of single put.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to