Alan Zhang created SAMZA-2444:
---------------------------------
Summary: JobModel save in CoordinatorStreamStore resulting flush
for each message
Key: SAMZA-2444
URL: https://issues.apache.org/jira/browse/SAMZA-2444
Project: Samza
Issue Type: Improvement
Reporter: Alan Zhang
JobModelManager uses CoordinatorStreamStore.put() to save job model information
which does flush for each message.
The flush operation in CoordinatorStreamStore is very heavy, so it may take
over a very long time for AM to save the information in a run.
We should use CoordinatorStreamStore's batch put instead of single put.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)