[
https://issues.apache.org/jira/browse/SAMZA-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14595476#comment-14595476
]
Yan Fang commented on SAMZA-720:
--------------------------------
[~theduderog], you are right. The bootstrapping list contains all the
partitions of the bootstrapping stream, while the task will only update the
partition assigned to it. Other partitions remain "unbootstrapped". That's why
the bootstrap hangs. You can try the patch. It should fix this problem.
RB: https://reviews.apache.org/r/35723/
Thanks.
> Bootstrap hangs
> ----------------
>
> Key: SAMZA-720
> URL: https://issues.apache.org/jira/browse/SAMZA-720
> Project: Samza
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Roger Hoover
> Priority: Blocker
> Attachments: SAMZA-720.patch, SAMZA-720.patch
>
>
> To reproduce:
> Create a job that reads from two topics with equal number of partitions > 1.
> Configure the job to bootstrap from one of the topics and set
> yarn.container.count > 1.
> Observed outcome:
> You'll see that the container completes bootstrapping for the partitions
> assigned to it's tasks but never finishes bootstrapping for the remaining
> partitions that are assigned to other containers.
> Expected outcome:
> When each task as finished bootstrapping the partitions it's responsible for,
> bootstrapping should be considered complete.
> Debug logs available here:
> https://mail-archives.apache.org/mod_mbox/samza-dev/201506.mbox/%3CCAPOm%3DTN88YSbn_pzpb-%2BwGxc619LsE%3D-XAfaydBKmLrTLOf4QA%40mail.gmail.com%3E
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
