[
https://issues.apache.org/jira/browse/SAMZA-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Nishimura updated SAMZA-2046:
------------------------------------
Description:
The job coordinators need to call the
StartpointManager#fanOutStartpointsToTasks method that handles the re-mapping.
What needs to be implemented is when this method should be called in the job
coordinators.
YARN - ClusterBasedJobCoordinator should call the method before starting the
processing containers.
Standalone - The job coordinator should call the method when the leader is
elected and before the other processors begin processing.
was:
The job coordinators need to call the StartpointManager#groupStartpointsPerTask
method that handles the re-mapping. What needs to be implemented is when this
method should be called in the job coordinators.
YARN - ClusterBasedJobCoordinator should call the method before starting the
processing containers.
Standalone - The job coordinator should call the method when the leader is
elected and before the other processors begin processing.
> Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName
> ------------------------------------------------------------------
>
> Key: SAMZA-2046
> URL: https://issues.apache.org/jira/browse/SAMZA-2046
> Project: Samza
> Issue Type: New Feature
> Affects Versions: 1.1
> Reporter: Daniel Nishimura
> Assignee: Daniel Nishimura
> Priority: Major
>
> The job coordinators need to call the
> StartpointManager#fanOutStartpointsToTasks method that handles the
> re-mapping. What needs to be implemented is when this method should be called
> in the job coordinators.
> YARN - ClusterBasedJobCoordinator should call the method before starting the
> processing containers.
> Standalone - The job coordinator should call the method when the leader is
> elected and before the other processors begin processing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
