[
https://issues.apache.org/jira/browse/GOBBLIN-739?focusedWorklogId=228540&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-228540
]
ASF GitHub Bot logged work on GOBBLIN-739:
------------------------------------------
Author: ASF GitHub Bot
Created on: 16/Apr/19 16:19
Start Date: 16/Apr/19 16:19
Worklog Time Spent: 10m
Work Description: asfgit commented on pull request #2606: [GOBBLIN-739]
Add a way to propagate the Azkaban job config to Gobbli…
URL: https://github.com/apache/incubator-gobblin/pull/2606
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 228540)
Time Spent: 20m (was: 10m)
> Add a way to propagate the Azkaban job config to Gobblin on YARN
> ----------------------------------------------------------------
>
> Key: GOBBLIN-739
> URL: https://issues.apache.org/jira/browse/GOBBLIN-739
> Project: Apache Gobblin
> Issue Type: Task
> Reporter: Hung Tran
> Assignee: Hung Tran
> Priority: Major
> Fix For: 0.15.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The AzkabanGobblinYarnAppLauncher can be used to launch a Gobblin application
> master on YARN, which then loads configuration from an application.conf file.
> Currently, the application.conf is pre-generated and packaged with the
> Azkaban job zip. This results in duplication of config between the Azkaban
> job properties and the application.conf file. It also doesn't allow user
> overrides in the Azkaban UI to be propagated to the app master and containers.
> A config should be added to specify an output path to write the Azkaban job
> config to in HOCON format. The gobblin yarn config such as
> gobblin.yarn.app.master.files.local and gobblin.yarn.container.files.local
> can be set to point to the output file.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
