[
https://issues.apache.org/jira/browse/SAMZA-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lakshmi Manasa Gaduputi updated SAMZA-2688:
-------------------------------------------
Description:
Introduce config: task.elasticity.factor which defaults to 1. If elasticity
factor = 1 then each task consumes the whole input SSP. If elasticity factor =
X, then each task is split into X elastic tasks and each elastic task consumes
1/X th of the input SSP. Each of the 1/X th of the input SSP is referred to as
the sub-SSP.
Additionally, introduce sub-SSP concept as SystemStreamParitionKeyHash where
each SSP has X KeyHashes.
was:
Introduce config: task.elasticity.factor which defaults to 1. If elasticity
factor = 1 then each task consumes the whole input SSP. If elasticity factor =
X, then each task is split into X virtual tasks and each virtual task consumes
1/X th of the input SSP. Each of the 1/X th of the input SSP is referred to as
the sub-SSP.
Additionally, introduce sub-SSP concept as SystemStreamParitionKeyHash where
each SSP has X KeyHashes.
> Elasticity: introduce configs and sub-partition concept
> -------------------------------------------------------
>
> Key: SAMZA-2688
> URL: https://issues.apache.org/jira/browse/SAMZA-2688
> Project: Samza
> Issue Type: Sub-task
> Reporter: Lakshmi Manasa Gaduputi
> Assignee: Lakshmi Manasa Gaduputi
> Priority: Major
>
> Introduce config: task.elasticity.factor which defaults to 1. If elasticity
> factor = 1 then each task consumes the whole input SSP. If elasticity factor
> = X, then each task is split into X elastic tasks and each elastic task
> consumes 1/X th of the input SSP. Each of the 1/X th of the input SSP is
> referred to as the sub-SSP.
> Additionally, introduce sub-SSP concept as SystemStreamParitionKeyHash where
> each SSP has X KeyHashes.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
