[GitHub] [samza] mynameborat opened a new pull request #1433: SAMZA-2593: Update task callback to store only necessary fields instead of the message envelope

Wed, 23 Sep 2020 14:46:15 -0700 


mynameborat opened a new pull request #1433:
URL: https://github.com/apache/samza/pull/1433


   **Problem**: TaskCallbackImpl currently stores the entire message envelope. 
In case of jobs that have 1000s of pending callbacks, this adds up to 
significant memory pressure. The only use for message envelope is to trace the 
SSP information and the offset associated with it so that we commit the right 
offset during our commit cycle.
   
   
![image](https://user-images.githubusercontent.com/46942335/94072332-4e691a80-fdaa-11ea-8e5b-556c586da838.png)
   
   **Changes**: Modify TaskCallbackImpl to only store SSP and Offset 
information.
   **API Changes**: None
   **Tests**: None
   **Upgrade Instructions**: None
   **Usage Instructions**: None


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to