[
https://issues.apache.org/jira/browse/SAMZA-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199422#comment-16199422
]
Xinyu Liu commented on SAMZA-719:
---------------------------------
[~realdinghao]: [~tbma] and his students at National Univ of Singapore is
continuing this work. It will be really helpful if you can give us more details
about your use cases, e.g. your data processing flow and the requirements you
have for for auto-scaling. We don't have a timeline for this feature to be
available in Samza releases yet, but with [~snoghabi]'s existing work, I expect
this may happen in the next few months. Thanks.
> Auto-scaling containers in Samza
> --------------------------------
>
> Key: SAMZA-719
> URL: https://issues.apache.org/jira/browse/SAMZA-719
> Project: Samza
> Issue Type: New Feature
> Reporter: Shadi A. Noghabi
> Assignee: Shadi A. Noghabi
> Labels: design
> Attachments: DESIGN-SAMZA-719-v2.md, DESIGN-SAMZA-719-v2.pdf,
> DESIGN-SAMZA-719.pdf
>
>
> Currently, a fixed number of containers is assigned to a job as an input
> configuration parameter. However, with this design jobs can fail due to lack
> of enough resources (such as memory), or they can become a bottleneck in a
> workflow containing many jobs. While auto-scaling is much broader term, the
> goal of this project will be to enable a Samza job to automatically scale its
> containers such that there is improved job performance.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
