[
https://issues.apache.org/jira/browse/SAMZA-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roger Hoover updated SAMZA-720:
-------------------------------
Description:
To reproduce:
Create a job that reads from two topics with equal number of partitions > 1.
Configure the job to bootstrap from one of the topics and set
yarn.container.count > 1.
Observed outcome:
You'll see that the container completes bootstrapping for the partitions
assigned to it's tasks but never finishes bootstrapping for the remaining
partitions that are assigned to other containers.
Expected outcome:
When each task as finished bootstrapping the partitions it's responsible for,
bootstrapping should be considered complete.
Debug logs available here:
https://mail-archives.apache.org/mod_mbox/samza-dev/201506.mbox/%3CCAPOm%3DTN88YSbn_pzpb-%2BwGxc619LsE%3D-XAfaydBKmLrTLOf4QA%40mail.gmail.com%3E
was:
To reproduce:
Created a job that reads from two topics with equal number of partitions > 1.
Configure the job to bootstrap from one of the topics and set
yarn.container.count > 1.
Observed outcome:
You'll see that the container completes bootstrapping for the partitions
assigned to it's tasks but never finishes bootstrapping for the remaining
partitions that are assigned to other containers.
Expected outcome:
When each task as finished bootstrapping the partitions it's responsible for,
bootstrapping should be considered complete.
Debug logs available here:
https://mail-archives.apache.org/mod_mbox/samza-dev/201506.mbox/%3CCAPOm%3DTN88YSbn_pzpb-%2BwGxc619LsE%3D-XAfaydBKmLrTLOf4QA%40mail.gmail.com%3E
> Bootstrap hangs
> ----------------
>
> Key: SAMZA-720
> URL: https://issues.apache.org/jira/browse/SAMZA-720
> Project: Samza
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Roger Hoover
> Priority: Blocker
>
> To reproduce:
> Create a job that reads from two topics with equal number of partitions > 1.
> Configure the job to bootstrap from one of the topics and set
> yarn.container.count > 1.
> Observed outcome:
> You'll see that the container completes bootstrapping for the partitions
> assigned to it's tasks but never finishes bootstrapping for the remaining
> partitions that are assigned to other containers.
> Expected outcome:
> When each task as finished bootstrapping the partitions it's responsible for,
> bootstrapping should be considered complete.
> Debug logs available here:
> https://mail-archives.apache.org/mod_mbox/samza-dev/201506.mbox/%3CCAPOm%3DTN88YSbn_pzpb-%2BwGxc619LsE%3D-XAfaydBKmLrTLOf4QA%40mail.gmail.com%3E
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
