[jira] [Work logged] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?focusedWorklogId=231807=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231807 ] ASF GitHub Bot logged work on GOBBLIN-707: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-753) Refactor HiveRegistrationPolicyBase to make ConfigStore object available in extending class

[ https://issues.apache.org/jira/browse/GOBBLIN-753?focusedWorklogId=231809=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231809 ] ASF GitHub Bot logged work on GOBBLIN-753: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] autumnust commented on issue #2618: [GOBBLIN-753] Refactor HiveRegistrationPolicyBase to surface configStore object

autumnust commented on issue #2618: [GOBBLIN-753] Refactor HiveRegistrationPolicyBase to surface configStore object URL: https://github.com/apache/incubator-gobblin/pull/2618#issuecomment-486025154 @ibuenros @htran1 Can you take a look ? Thanks.

[jira] [Work logged] (GOBBLIN-753) Refactor HiveRegistrationPolicyBase to make ConfigStore object available in extending class

[ https://issues.apache.org/jira/browse/GOBBLIN-753?focusedWorklogId=231808=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231808 ] ASF GitHub Bot logged work on GOBBLIN-753: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] autumnust opened a new pull request #2618: [GOBBLIN-753] Refactor HiveRegistrationPolicyBase to surface configStore object

autumnust opened a new pull request #2618: [GOBBLIN-753] Refactor HiveRegistrationPolicyBase to surface configStore object URL: https://github.com/apache/incubator-gobblin/pull/2618 Dear Gobblin maintainers, Please accept this PR. I understand that it will not be reviewed until I

[jira] [Created] (GOBBLIN-753) Refactor HiveRegistrationPolicyBase to make ConfigStore object available in extending class

Lei Sun created GOBBLIN-753: --- Summary: Refactor HiveRegistrationPolicyBase to make ConfigStore object available in extending class Key: GOBBLIN-753 URL: https://issues.apache.org/jira/browse/GOBBLIN-753

[GitHub] [incubator-gobblin] jhsenjaliya commented on issue #2578: [GOBBLIN-707] rewrite gobblin script to combine all modes and command

jhsenjaliya commented on issue #2578: [GOBBLIN-707] rewrite gobblin script to combine all modes and command URL: https://github.com/apache/incubator-gobblin/pull/2578#issuecomment-486024787 @autumnust , updated docs and also added new info in doc regarding the usage of gobblin.sh, please

[jira] [Work logged] (GOBBLIN-752) Throttling server incorrectly marks permit numbers as unsatisfiable

[ https://issues.apache.org/jira/browse/GOBBLIN-752?focusedWorklogId=231791=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231791 ] ASF GitHub Bot logged work on GOBBLIN-752: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-746) Loading FlowSpecs asynchronously while initializing GobblinServiceManager

[ https://issues.apache.org/jira/browse/GOBBLIN-746?focusedWorklogId=231787=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231787 ] ASF GitHub Bot logged work on GOBBLIN-746: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-751) Make enforced file size matching to be configurable

[ https://issues.apache.org/jira/browse/GOBBLIN-751?focusedWorklogId=231786=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231786 ] ASF GitHub Bot logged work on GOBBLIN-751: -- Author: ASF GitHub Bot

[jira] [Resolved] (GOBBLIN-752) Throttling server incorrectly marks permit numbers as unsatisfiable

[ https://issues.apache.org/jira/browse/GOBBLIN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Issac Buenrostro resolved GOBBLIN-752. -- Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request #2617

[GitHub] [incubator-gobblin] asfgit closed pull request #2617: [GOBBLIN-752] Fix a bug in QPS throttling policy where it was incorrectly indicatin…

asfgit closed pull request #2617: [GOBBLIN-752] Fix a bug in QPS throttling policy where it was incorrectly indicatin… URL: https://github.com/apache/incubator-gobblin/pull/2617 This is an automated message from the Apache

[jira] [Work logged] (GOBBLIN-746) Loading FlowSpecs asynchronously while initializing GobblinServiceManager

[ https://issues.apache.org/jira/browse/GOBBLIN-746?focusedWorklogId=231789=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231789 ] ASF GitHub Bot logged work on GOBBLIN-746: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-746) Loading FlowSpecs asynchronously while initializing GobblinServiceManager

[ https://issues.apache.org/jira/browse/GOBBLIN-746?focusedWorklogId=231788=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231788 ] ASF GitHub Bot logged work on GOBBLIN-746: -- Author: ASF GitHub Bot

[jira] [Created] (GOBBLIN-752) Throttling server incorrectly marks permit numbers as unsatisfiable

Issac Buenrostro created GOBBLIN-752: Summary: Throttling server incorrectly marks permit numbers as unsatisfiable Key: GOBBLIN-752 URL: https://issues.apache.org/jira/browse/GOBBLIN-752 Project:

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2611: [GOBBLIN-746] Async loading FlowSpec

sv2000 commented on a change in pull request #2611: [GOBBLIN-746] Async loading FlowSpec URL: https://github.com/apache/incubator-gobblin/pull/2611#discussion_r277892394 ## File path: gobblin-runtime/src/main/java/org/apache/gobblin/runtime/api/SpecSerDeException.java ##

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2611: [GOBBLIN-746] Async loading FlowSpec

sv2000 commented on a change in pull request #2611: [GOBBLIN-746] Async loading FlowSpec URL: https://github.com/apache/incubator-gobblin/pull/2611#discussion_r277917952 ## File path:

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2611: [GOBBLIN-746] Async loading FlowSpec

sv2000 commented on a change in pull request #2611: [GOBBLIN-746] Async loading FlowSpec URL: https://github.com/apache/incubator-gobblin/pull/2611#discussion_r277899864 ## File path: gobblin-runtime/src/main/java/org/apache/gobblin/runtime/api/SpecStore.java ## @@

[GitHub] [incubator-gobblin] ibuenros commented on issue #2616: [GOBBLIN-751] Make enforced file size matching to be configurable

ibuenros commented on issue #2616: [GOBBLIN-751] Make enforced file size matching to be configurable URL: https://github.com/apache/incubator-gobblin/pull/2616#issuecomment-486020826 +1 This is an automated message from the

[jira] [Work logged] (GOBBLIN-751) Make enforced file size matching to be configurable

[ https://issues.apache.org/jira/browse/GOBBLIN-751?focusedWorklogId=231780=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231780 ] ASF GitHub Bot logged work on GOBBLIN-751: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-751) Make enforced file size matching to be configurable

[ https://issues.apache.org/jira/browse/GOBBLIN-751?focusedWorklogId=231777=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231777 ] ASF GitHub Bot logged work on GOBBLIN-751: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] yukuai518 commented on a change in pull request #2616: [GOBBLIN-751] Make enforced file size matching to be configurable

yukuai518 commented on a change in pull request #2616: [GOBBLIN-751] Make enforced file size matching to be configurable URL: https://github.com/apache/incubator-gobblin/pull/2616#discussion_r277915613 ## File path:

[jira] [Work logged] (GOBBLIN-751) Make enforced file size matching to be configurable

[ https://issues.apache.org/jira/browse/GOBBLIN-751?focusedWorklogId=231779=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231779 ] ASF GitHub Bot logged work on GOBBLIN-751: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] ibuenros commented on a change in pull request #2616: [GOBBLIN-751] Make enforced file size matching to be configurable

ibuenros commented on a change in pull request #2616: [GOBBLIN-751] Make enforced file size matching to be configurable URL: https://github.com/apache/incubator-gobblin/pull/2616#discussion_r277914931 ## File path:

[jira] [Work logged] (GOBBLIN-751) Make enforced file size matching to be configurable

[ https://issues.apache.org/jira/browse/GOBBLIN-751?focusedWorklogId=231776=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231776 ] ASF GitHub Bot logged work on GOBBLIN-751: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-752) Throttling server incorrectly marks permit numbers as unsatisfiable

[ https://issues.apache.org/jira/browse/GOBBLIN-752?focusedWorklogId=231778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231778 ] ASF GitHub Bot logged work on GOBBLIN-752: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] ibuenros opened a new pull request #2617: [GOBBLIN-752] Fix a bug in QPS throttling policy where it was incorrectly indicatin…

ibuenros opened a new pull request #2617: [GOBBLIN-752] Fix a bug in QPS throttling policy where it was incorrectly indicatin… URL: https://github.com/apache/incubator-gobblin/pull/2617 …g permits were impossible to satisfy. Dear Gobblin maintainers, Please accept this PR. I

[GitHub] [incubator-gobblin] yukuai518 commented on issue #2616: [GOBBLIN-751] Make enforced file size matching to be configurable

yukuai518 commented on issue #2616: [GOBBLIN-751] Make enforced file size matching to be configurable URL: https://github.com/apache/incubator-gobblin/pull/2616#issuecomment-486016085 @ibuenros please help review this. This will help us onboard a few datasets for some validation while

[GitHub] [incubator-gobblin] yukuai518 opened a new pull request #2616: [GOBBLIN-751] Make enforced file size matching to be configurable

yukuai518 opened a new pull request #2616: [GOBBLIN-751] Make enforced file size matching to be configurable URL: https://github.com/apache/incubator-gobblin/pull/2616 Make enforced file size matching to be configurable. Dear Gobblin maintainers, Please accept this PR. I

[jira] [Created] (GOBBLIN-751) Make enforced file size matching to be configurable

Kuai Yu created GOBBLIN-751: --- Summary: Make enforced file size matching to be configurable Key: GOBBLIN-751 URL: https://issues.apache.org/jira/browse/GOBBLIN-751 Project: Apache Gobblin Issue

Data Lineage in Gobblin

Hi, I see there is a concept of gathering and storing lineage info into WorkStates, but i cant find how one can use the lineage info from the stored state. Can someone please shade more light on the overall lineage feature? Thanks Jay

[GitHub] [incubator-gobblin] jhsenjaliya opened a new pull request #2615: Gobblin 750

jhsenjaliya opened a new pull request #2615: Gobblin 750 URL: https://github.com/apache/incubator-gobblin/pull/2615 Dear Gobblin maintainers, Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below! ### JIRA - [ ]

[jira] [Updated] (GOBBLIN-750) remove usage of depricated DatasetResolver and DatasetResolverFactory

[ https://issues.apache.org/jira/browse/GOBBLIN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-750: Description: {{DatasetResolver}} and {{DatasetResolverFactory}} both are marked as deprecated. should

[jira] [Resolved] (GOBBLIN-747) Set expected schema when creating workunits

[ https://issues.apache.org/jira/browse/GOBBLIN-747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hung Tran resolved GOBBLIN-747. --- Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request #2612

[jira] [Work logged] (GOBBLIN-747) Set expected schema when creating workunits

[ https://issues.apache.org/jira/browse/GOBBLIN-747?focusedWorklogId=231753=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231753 ] ASF GitHub Bot logged work on GOBBLIN-747: -- Author: ASF GitHub Bot

[jira] [Created] (GOBBLIN-750) remove usage of depricated DatasetResolver and DatasetResolverFactory

Jay Sen created GOBBLIN-750: --- Summary: remove usage of depricated DatasetResolver and DatasetResolverFactory Key: GOBBLIN-750 URL: https://issues.apache.org/jira/browse/GOBBLIN-750 Project: Apache Gobblin

[GitHub] [incubator-gobblin] asfgit closed pull request #2612: [GOBBLIN-747]Check schema

asfgit closed pull request #2612: [GOBBLIN-747]Check schema URL: https://github.com/apache/incubator-gobblin/pull/2612 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (GOBBLIN-748) Craftsmanship code cleaning in GaaS

[ https://issues.apache.org/jira/browse/GOBBLIN-748?focusedWorklogId=231744=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231744 ] ASF GitHub Bot logged work on GOBBLIN-748: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2613: [GOBBLIN-748]Craftsmanship code cleaning in Gobblin Service Code

sv2000 commented on a change in pull request #2613: [GOBBLIN-748]Craftsmanship code cleaning in Gobblin Service Code URL: https://github.com/apache/incubator-gobblin/pull/2613#discussion_r277524878 ## File path:

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2613: [GOBBLIN-748]Craftsmanship code cleaning in Gobblin Service Code

sv2000 commented on a change in pull request #2613: [GOBBLIN-748]Craftsmanship code cleaning in Gobblin Service Code URL: https://github.com/apache/incubator-gobblin/pull/2613#discussion_r277525100 ## File path:

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #2613: [GOBBLIN-748]Craftsmanship code cleaning in Gobblin Service Code

sv2000 commented on a change in pull request #2613: [GOBBLIN-748]Craftsmanship code cleaning in Gobblin Service Code URL: https://github.com/apache/incubator-gobblin/pull/2613#discussion_r277525235 ## File path:

[jira] [Work logged] (GOBBLIN-748) Craftsmanship code cleaning in GaaS

[ https://issues.apache.org/jira/browse/GOBBLIN-748?focusedWorklogId=231743=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231743 ] ASF GitHub Bot logged work on GOBBLIN-748: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-748) Craftsmanship code cleaning in GaaS

[ https://issues.apache.org/jira/browse/GOBBLIN-748?focusedWorklogId=231742=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231742 ] ASF GitHub Bot logged work on GOBBLIN-748: -- Author: ASF GitHub Bot

[jira] [Resolved] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-744. - Resolution: Fixed > Support cancellation of a Helix workflow via a DELETE Spec

[jira] [Updated] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-744: Issue resolved by PR: [https://github.com/apache/incubator-gobblin/pull/2609] >

[jira] [Closed] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-744. --- > Support cancellation of a Helix workflow via a DELETE Spec >

[jira] [Work logged] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?focusedWorklogId=231723=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231723 ] ASF GitHub Bot logged work on GOBBLIN-744: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] asfgit closed pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec.

asfgit closed pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec. URL: https://github.com/apache/incubator-gobblin/pull/2609 This is an automated message from the Apache Git Service.

[jira] [Work logged] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?focusedWorklogId=231637=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231637 ] ASF GitHub Bot logged work on GOBBLIN-744: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] htran1 commented on issue #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec.

htran1 commented on issue #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec. URL: https://github.com/apache/incubator-gobblin/pull/2609#issuecomment-485930900 +1 This is an automated message

[GitHub] [incubator-gobblin] ibuenros commented on issue #2582: UnitTest for KafkaSource

ibuenros commented on issue #2582: UnitTest for KafkaSource URL: https://github.com/apache/incubator-gobblin/pull/2582#issuecomment-485887447 +1 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-gobblin] ibuenros commented on a change in pull request #2612: Check schema

ibuenros commented on a change in pull request #2612: Check schema URL: https://github.com/apache/incubator-gobblin/pull/2612#discussion_r26259 ## File path: gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/CopySource.java ## @@ -357,6

[jira] [Work logged] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?focusedWorklogId=231462=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231462 ] ASF GitHub Bot logged work on GOBBLIN-744: -- Author: ASF GitHub Bot

[jira] [Resolved] (GOBBLIN-749) Better access logging for throttling server

[ https://issues.apache.org/jira/browse/GOBBLIN-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Issac Buenrostro resolved GOBBLIN-749. -- Resolution: Fixed Fix Version/s: 0.15.0 Issue resolved by pull request #2614

[jira] [Work logged] (GOBBLIN-749) Better access logging for throttling server

[ https://issues.apache.org/jira/browse/GOBBLIN-749?focusedWorklogId=231489=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231489 ] ASF GitHub Bot logged work on GOBBLIN-749: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] asfgit closed pull request #2614: [GOBBLIN-749] Add logging to limiter server.

asfgit closed pull request #2614: [GOBBLIN-749] Add logging to limiter server. URL: https://github.com/apache/incubator-gobblin/pull/2614 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Work logged] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?focusedWorklogId=231456=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231456 ] ASF GitHub Bot logged work on GOBBLIN-744: -- Author: ASF GitHub Bot

[jira] [Work logged] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?focusedWorklogId=231464=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231464 ] ASF GitHub Bot logged work on GOBBLIN-744: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] shirshanka commented on a change in pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec.

shirshanka commented on a change in pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec. URL: https://github.com/apache/incubator-gobblin/pull/2609#discussion_r277741264 ## File path:

[GitHub] [incubator-gobblin] shirshanka commented on a change in pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec.

shirshanka commented on a change in pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec. URL: https://github.com/apache/incubator-gobblin/pull/2609#discussion_r277740598 ## File path:

[jira] [Work logged] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

[ https://issues.apache.org/jira/browse/GOBBLIN-744?focusedWorklogId=231461=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-231461 ] ASF GitHub Bot logged work on GOBBLIN-744: -- Author: ASF GitHub Bot

[GitHub] [incubator-gobblin] shirshanka commented on a change in pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec.

shirshanka commented on a change in pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec. URL: https://github.com/apache/incubator-gobblin/pull/2609#discussion_r277739662 ## File path:

[GitHub] [incubator-gobblin] shirshanka commented on a change in pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec.

shirshanka commented on a change in pull request #2609: GOBBLIN-744: Support cancellation of a Helix workflow via a DELETE Spec. URL: https://github.com/apache/incubator-gobblin/pull/2609#discussion_r277737062 ## File path: