[
https://issues.apache.org/jira/browse/SAMZA-123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986761#comment-13986761
]
Jakob Homan commented on SAMZA-123:
-----------------------------------
OK, I think we're good to go.
* Cohort: I still believe there's value in this term, but it's not worth
holding the entire JIRA up over. Task name seems to be acceptable to most.
Let's go with that.
* Pluggable: We've reached consensus on this. The interface will be public and
pluggable.
* IntoNSets: Since the interface is pluggable, it'll work to hold off on
including this strategy in the current patch and open a new JIRA to add it.
That way if users want it, they'll have an easy place to register their
interest and we can commit it quickly.
* ConfigLog vs Checkpoint Log: The general agreement is that the checkpoint log
will shortly undergo significant changes (via KAFKA-1000). Additionally, we're
pretty clear that we're going to need some type of more general log that may or
may not include some of the checkpoint log's current functionality. Let's move
the whole discussion of what that config log will look like into another JIRA
and stash the state-log related info necessary this JIRA into the checkpoint
log (this is assuming it's easy to tie the state log into the checkpoint log in
a not overly ugly way).
> Move topic partition grouping to the AM and generalize
> ------------------------------------------------------
>
> Key: SAMZA-123
> URL: https://issues.apache.org/jira/browse/SAMZA-123
> Project: Samza
> Issue Type: Sub-task
> Components: container
> Affects Versions: 0.6.0
> Reporter: Jakob Homan
> Assignee: Jakob Homan
> Attachments: SAMZA-123-design-doc.md, SAMZA-123-design-doc.pdf
>
>
> Currently the AM sends a set of all the topics and partitions to the
> container, which then groups them by partition and assigns each set to a task
> instance. By moving the grouping to the AM, we can assign arbitrary groups to
> task instances, which will allow more partitioning strategies, as discussed
> in SAMZA-71.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
