[jira] [Updated] (GOBBLIN-711) stopping the master in cluster mode fails the job

2019-04-02 Thread Jay Sen (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-711: Description: stopping the master process in cluster mode has some issues # graceful shutdown takes more

Re: Gobblin on Yarn ?

2019-04-02 Thread Sudarshan Vasudevan
Hi Jay, For your immediate use case, will the MR mode work? If that is the case, you can take a look at Hive Distcp: https://gobblin.readthedocs.io/en/latest/case-studies/Hive-Distcp/ For GOBBLIN-714, can you attach any relevant stacktraces that you see in the cluster logs that indicate the

Re: Gobblin on Yarn ?

2019-04-02 Thread Jay Sen
Thanks Sudarshan for sharing the info. I started playing around gobblin cluster ( master/worker) mode and came across some weird issues, ( GOBBLIN-714 & GOBBLIN-711 ). I assume the standalone

[jira] [Work logged] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

2019-04-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-707?focusedWorklogId=222117=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-222117 ] ASF GitHub Bot logged work on GOBBLIN-707: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] jhsenjaliya commented on a change in pull request #2578: [GOBBLIN-707] rewrite gobblin script to combine all modes and command

2019-04-02 Thread GitBox
jhsenjaliya commented on a change in pull request #2578: [GOBBLIN-707] rewrite gobblin script to combine all modes and command URL: https://github.com/apache/incubator-gobblin/pull/2578#discussion_r271550178 ## File path: gobblin-docs/user-guide/Gobblin-CLI.md ## @@

[jira] [Work logged] (GOBBLIN-712) Add version strategy for configbased dataset copy

2019-04-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-712?focusedWorklogId=221887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-221887 ] ASF GitHub Bot logged work on GOBBLIN-712: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] ibuenros commented on a change in pull request #2579: [GOBBLIN-712] Add version strategy pickup for ConfigBasedDataset distcp workflow

2019-04-02 Thread GitBox
ibuenros commented on a change in pull request #2579: [GOBBLIN-712] Add version strategy pickup for ConfigBasedDataset distcp workflow URL: https://github.com/apache/incubator-gobblin/pull/2579#discussion_r271429375 ## File path:

[GitHub] [incubator-gobblin] ibuenros commented on issue #2584: Filter Out Empty MultiWorkUnits

2019-04-02 Thread GitBox
ibuenros commented on issue #2584: Filter Out Empty MultiWorkUnits URL: https://github.com/apache/incubator-gobblin/pull/2584#issuecomment-479122691 +1 This is an automated message from the Apache Git Service. To respond to