[GitHub] [incubator-gobblin] fabi54 commented on a change in pull request #2542: [GOBBLIN-672] add EventHub source

2019-08-15 Thread GitBox
fabi54 commented on a change in pull request #2542: [GOBBLIN-672] add EventHub source URL: https://github.com/apache/incubator-gobblin/pull/2542#discussion_r314376192 ## File path:

Re: Read locality on gobblin jobs

2019-08-15 Thread Jay Sen
Hi Kuai, looks like the inout to the mapreduce is the workunit file, not the actual data, which will be fetched by the mapper gobblin task onces the mapper container is spinned up. which make sense given the data is not available before the task executes, but in case the data is local in the

[GitHub] [incubator-gobblin] jack-moseley commented on issue #2709: [GOBBLIN-853] Support multiple paths specified in flow config

2019-08-15 Thread GitBox
jack-moseley commented on issue #2709: [GOBBLIN-853] Support multiple paths specified in flow config URL: https://github.com/apache/incubator-gobblin/pull/2709#issuecomment-521724792 @sv2000 please review This is an

[GitHub] [incubator-gobblin] jack-moseley commented on issue #2715: [GOBBLIN-860] Process flow-level events for setting/retrieving flow status

2019-08-15 Thread GitBox
jack-moseley commented on issue #2715: [GOBBLIN-860] Process flow-level events for setting/retrieving flow status URL: https://github.com/apache/incubator-gobblin/pull/2715#issuecomment-521724843 @arjun4084346 please review

[jira] [Work logged] (GOBBLIN-853) Support multiple paths specified in flow config

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-853?focusedWorklogId=295602=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295602 ] ASF GitHub Bot logged work on GOBBLIN-853: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-860) Process flow-level events for setting/retrieving flow status

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-860?focusedWorklogId=295603=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295603 ] ASF GitHub Bot logged work on GOBBLIN-860: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-672) Add EventHub source

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-672?focusedWorklogId=295514=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295514 ] ASF GitHub Bot logged work on GOBBLIN-672: -- Author: ASF GitHub Bot

Re: Read locality on gobblin jobs

2019-08-15 Thread Kuai Yu
Yes, your understanding is correct. From: Jay Sen Sent: Thursday, August 15, 2019 11:05 AM To: dev@gobblin.incubator.apache.org Subject: Re: Read locality on gobblin jobs Hi Kuai, looks like the inout to the mapreduce is the workunit file, not the actual data,

[jira] [Work logged] (GOBBLIN-857) Extending getTopicsFromConfigStore to accept topicName directly

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-857?focusedWorklogId=295850=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295850 ] ASF GitHub Bot logged work on GOBBLIN-857: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] codecov-io edited a comment on issue #2713: [GOBBLIN-857] Extending getTopicsFromConfigStore to accept topicName directly

2019-08-15 Thread GitBox
codecov-io edited a comment on issue #2713: [GOBBLIN-857] Extending getTopicsFromConfigStore to accept topicName directly URL: https://github.com/apache/incubator-gobblin/pull/2713#issuecomment-521373562 # [Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/2713?src=pr=h1)

[GitHub] [incubator-gobblin] codecov-io commented on issue #2704: [GOBBLIN-835] Date Converter

2019-08-15 Thread GitBox
codecov-io commented on issue #2704: [GOBBLIN-835] Date Converter URL: https://github.com/apache/incubator-gobblin/pull/2704#issuecomment-521758283 # [Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/2704?src=pr=h1) Report > Merging

[jira] [Work logged] (GOBBLIN-835) add date transformation converter

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-835?focusedWorklogId=295689=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295689 ] ASF GitHub Bot logged work on GOBBLIN-835: -- Author: ASF GitHub Bot

[jira] [Created] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread Zihan Li (JIRA)
Zihan Li created GOBBLIN-861: Summary: Skip getPartition() call to Hive Metastore when a partition already exists Key: GOBBLIN-861 URL: https://issues.apache.org/jira/browse/GOBBLIN-861 Project: Apache

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=296038=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296038 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
sv2000 commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314572835 ## File path:

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=296036=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296036 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
sv2000 commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314572693 ## File path:

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=296039=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296039 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
sv2000 commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314572770 ## File path:

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
sv2000 commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314571989 ## File path:

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=296037=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296037 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-857) Extending getTopicsFromConfigStore to accept topicName directly

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-857?focusedWorklogId=296072=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296072 ] ASF GitHub Bot logged work on GOBBLIN-857: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] asfgit closed pull request #2713: [GOBBLIN-857] Extending getTopicsFromConfigStore to accept topicName directly

2019-08-15 Thread GitBox
asfgit closed pull request #2713: [GOBBLIN-857] Extending getTopicsFromConfigStore to accept topicName directly URL: https://github.com/apache/incubator-gobblin/pull/2713 This is an automated message from the Apache Git

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314566577 ## File path:

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=295979=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295979 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=295982=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295982 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=295981=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295981 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=295980=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295980 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=295978=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295978 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314565883 ## File path:

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314567012 ## File path:

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314566770 ## File path:

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
autumnust commented on a change in pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#discussion_r314566652 ## File path:

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=295927=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295927 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] ZihanLi58 commented on issue #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
ZihanLi58 commented on issue #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716#issuecomment-521852126 @sv2000 @autumnust Can you take a look at this change? Thanks.

[GitHub] [incubator-gobblin] ZihanLi58 opened a new pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e…

2019-08-15 Thread GitBox
ZihanLi58 opened a new pull request #2716: [GOBBLIN-861]Skip getPartition() call to Hive Metastore when a partition already e… URL: https://github.com/apache/incubator-gobblin/pull/2716 …xists GOBBLIN-861 Dear Gobblin maintainers, Please accept this PR. I understand that it

[jira] [Work logged] (GOBBLIN-861) Skip getPartition() call to Hive Metastore when a partition already exists

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-861?focusedWorklogId=295926=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295926 ] ASF GitHub Bot logged work on GOBBLIN-861: -- Author: ASF GitHub Bot