[
https://issues.apache.org/jira/browse/GOBBLIN-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kuai Yu updated GOBBLIN-490:
----------------------------
Description: This new job launcher will forward the original job to one of
the GobblinTaskRunner(s). Instead of executing the task driver logic on
GobblinClusterManager, the task driver logic now can be run on
GobblinTaskRunner. (was: This new job launcher will submit original job to
Helix instead of the generated work units. This will allow Helix to
re-distribute the original jobs to different worker nodes. Each worker then
process the original jobs and launch its own GobblinHelixJobLauncher. By doing
this, we will relieve manager node because the task driver logic (mainly
generate work units) is now distributed to worker nodes.)
> Add planning job execution launcher
> ------------------------------------
>
> Key: GOBBLIN-490
> URL: https://issues.apache.org/jira/browse/GOBBLIN-490
> Project: Apache Gobblin
> Issue Type: New Feature
> Reporter: Kuai Yu
> Assignee: Kuai Yu
> Priority: Major
>
> This new job launcher will forward the original job to one of the
> GobblinTaskRunner(s). Instead of executing the task driver logic on
> GobblinClusterManager, the task driver logic now can be run on
> GobblinTaskRunner.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
