[jira] [Updated] (GOBBLIN-339) Example to illustrate how to build custom source and extractor in Gobblin.

2017-12-08 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-339: Priority: Minor (was: Major) > Example to illustrate how to build custom source

[jira] [Created] (GOBBLIN-339) Example to illustrate how to build custom source and extractor in Gobblin.

2017-12-08 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-339: --- Summary: Example to illustrate how to build custom source and extractor in Gobblin. Key: GOBBLIN-339 URL: https://issues.apache.org/jira/browse/GOBBLIN-339

[jira] [Created] (GOBBLIN-491) Create a FlowGraph representation for multi-hop support in Gobblin-as-a-Service

2018-05-10 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-491: --- Summary: Create a FlowGraph representation for multi-hop support in Gobblin-as-a-Service Key: GOBBLIN-491 URL: https://issues.apache.org/jira/browse/GOBBLIN-491

[jira] [Created] (GOBBLIN-505) Implement a Git-based FlowGraph Monitor

2018-05-25 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-505: --- Summary: Implement a Git-based FlowGraph Monitor Key: GOBBLIN-505 URL: https://issues.apache.org/jira/browse/GOBBLIN-505 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-511) Fix Findbugs warnings in Gobblin Service

2018-06-06 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-511: --- Summary: Fix Findbugs warnings in Gobblin Service Key: GOBBLIN-511 URL: https://issues.apache.org/jira/browse/GOBBLIN-511 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-368) Add configuration property to allow application of filters to directory paths

2018-01-11 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-368: --- Summary: Add configuration property to allow application of filters to directory paths Key: GOBBLIN-368 URL: https://issues.apache.org/jira/browse/GOBBLIN-368

[jira] [Created] (GOBBLIN-397) Create a new dataset version selection policy for filtering dataset versions that have "hidden" paths

2018-01-30 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-397: --- Summary: Create a new dataset version selection policy for filtering dataset versions that have "hidden" paths Key: GOBBLIN-397 URL:

[jira] [Closed] (GOBBLIN-381) Add ability to filter hidden directories for ConfigBasedDatasets

2018-02-01 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-381. --- Assignee: Sudarshan Vasudevan (was: Issac Buenrostro) > Add ability to filter

[jira] [Resolved] (GOBBLIN-381) Add ability to filter hidden directories for ConfigBasedDatasets

2018-02-01 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-381. - Resolution: Fixed > Add ability to filter hidden directories for

[jira] [Closed] (GOBBLIN-365) Add lookback days config property for CopyableGlobDatasetFinder

2018-02-01 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-365. --- > Add lookback days config property for CopyableGlobDatasetFinder >

[jira] [Commented] (GOBBLIN-381) Add ability to filter hidden directories for ConfigBasedDatasets

2018-02-01 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349484#comment-16349484 ] Sudarshan Vasudevan commented on GOBBLIN-381: - Issue resolved by pull request:

[jira] [Created] (GOBBLIN-415) Check for the value of configuration key flow.runImmediately in Job config.

2018-02-20 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-415: --- Summary: Check for the value of configuration key flow.runImmediately in Job config. Key: GOBBLIN-415 URL: https://issues.apache.org/jira/browse/GOBBLIN-415

[jira] [Created] (GOBBLIN-554) Change signature of SpecCompiler#compileFlow() to return a DAG of JobSpecs instead of a HashMap.

2018-08-02 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-554: --- Summary: Change signature of SpecCompiler#compileFlow() to return a DAG of JobSpecs instead of a HashMap. Key: GOBBLIN-554 URL:

[jira] [Created] (GOBBLIN-552) Add multicast option to the MultiHopFlowCompiler

2018-08-01 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-552: --- Summary: Add multicast option to the MultiHopFlowCompiler Key: GOBBLIN-552 URL: https://issues.apache.org/jira/browse/GOBBLIN-552 Project: Apache

[jira] [Created] (GOBBLIN-559) Implement FlowGraph as a concurrent data structure.

2018-08-07 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-559: --- Summary: Implement FlowGraph as a concurrent data structure. Key: GOBBLIN-559 URL: https://issues.apache.org/jira/browse/GOBBLIN-559 Project: Apache

[jira] [Updated] (GOBBLIN-561) Handle data completeness checks for data partitions with no records

2018-08-12 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-561: Summary: Handle data completeness checks for data partitions with no records

[jira] [Created] (GOBBLIN-561) Handle data completeness checks for Kafka topics with no records

2018-08-12 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-561: --- Summary: Handle data completeness checks for Kafka topics with no records Key: GOBBLIN-561 URL: https://issues.apache.org/jira/browse/GOBBLIN-561

[jira] [Created] (GOBBLIN-573) Add option to use finer level granularity at the hour level for TimeAwareDatasetfinder

2018-08-29 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-573: --- Summary: Add option to use finer level granularity at the hour level for TimeAwareDatasetfinder Key: GOBBLIN-573 URL:

[jira] [Created] (GOBBLIN-528) Multihop Flow Compiler for Gobblin-as-a-Service (GaaS)

2018-07-08 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-528: --- Summary: Multihop Flow Compiler for Gobblin-as-a-Service (GaaS) Key: GOBBLIN-528 URL: https://issues.apache.org/jira/browse/GOBBLIN-528 Project: Apache

[jira] [Created] (GOBBLIN-381) Add ability to filter hidden directories for ConfigBasedDatasets

2018-01-22 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-381: --- Summary: Add ability to filter hidden directories for ConfigBasedDatasets Key: GOBBLIN-381 URL: https://issues.apache.org/jira/browse/GOBBLIN-381

[jira] [Updated] (GOBBLIN-418) Change Gobblin Service behavior to not call addSpec for pre-existing specs on start up

2018-02-28 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-418: Summary: Change Gobblin Service behavior to not call addSpec for pre-existing

[jira] [Updated] (GOBBLIN-418) Change Gobblin Service behavior to not call addSpec for pre-existing specs on FlowCatalog start up

2018-02-28 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-418: Summary: Change Gobblin Service behavior to not call addSpec for pre-existing

[jira] [Created] (GOBBLIN-464) Enhance LoopingDatasetFinderSource to support global watermark and per-dataset watermark

2018-04-11 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-464: --- Summary: Enhance LoopingDatasetFinderSource to support global watermark and per-dataset watermark Key: GOBBLIN-464 URL:

[jira] [Created] (GOBBLIN-474) Add end-of-datasets marker to workunit correctly to avoid an additional run when end of datasets is reached.

2018-04-24 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-474: --- Summary: Add end-of-datasets marker to workunit correctly to avoid an additional run when end of datasets is reached. Key: GOBBLIN-474 URL:

[jira] [Created] (GOBBLIN-420) Refactor code to avoid code duplication between FlowCatalog and TopologyCatalog

2018-03-02 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-420: --- Summary: Refactor code to avoid code duplication between FlowCatalog and TopologyCatalog Key: GOBBLIN-420 URL: https://issues.apache.org/jira/browse/GOBBLIN-420

[jira] [Created] (GOBBLIN-604) Map dependencies in job templates to the job names in compiled JobSpecs.

2018-10-07 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-604: --- Summary: Map dependencies in job templates to the job names in compiled JobSpecs. Key: GOBBLIN-604 URL: https://issues.apache.org/jira/browse/GOBBLIN-604

[jira] [Created] (GOBBLIN-603) Add ServiceManager to manage GitFlowGraphMonitor in multihop flow compiler

2018-10-05 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-603: --- Summary: Add ServiceManager to manage GitFlowGraphMonitor in multihop flow compiler Key: GOBBLIN-603 URL: https://issues.apache.org/jira/browse/GOBBLIN-603

[jira] [Created] (GOBBLIN-612) Disable commit hash checkpointing for GitFlowGraphMonitor

2018-10-12 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-612: --- Summary: Disable commit hash checkpointing for GitFlowGraphMonitor Key: GOBBLIN-612 URL: https://issues.apache.org/jira/browse/GOBBLIN-612 Project:

[jira] [Created] (GOBBLIN-611) Ensure node events are processed before edge events in GitFlowGraphMonitor

2018-10-11 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-611: --- Summary: Ensure node events are processed before edge events in GitFlowGraphMonitor Key: GOBBLIN-611 URL: https://issues.apache.org/jira/browse/GOBBLIN-611

[jira] [Created] (GOBBLIN-614) Allow multiple flow failure options in DagManager

2018-10-18 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-614: --- Summary: Allow multiple flow failure options in DagManager Key: GOBBLIN-614 URL: https://issues.apache.org/jira/browse/GOBBLIN-614 Project: Apache

[jira] [Created] (GOBBLIN-616) Add ability to fork jobs when concatenating Dags.

2018-10-19 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-616: --- Summary: Add ability to fork jobs when concatenating Dags. Key: GOBBLIN-616 URL: https://issues.apache.org/jira/browse/GOBBLIN-616 Project: Apache

[jira] [Created] (GOBBLIN-624) Handle dataset retention in multi-hop flow compiler

2018-10-31 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-624: --- Summary: Handle dataset retention in multi-hop flow compiler Key: GOBBLIN-624 URL: https://issues.apache.org/jira/browse/GOBBLIN-624 Project: Apache

[jira] [Created] (GOBBLIN-629) Skip updating statistics for Kafka partitions in KafkaExtractor when topic is skipped.

2018-11-13 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-629: --- Summary: Skip updating statistics for Kafka partitions in KafkaExtractor when topic is skipped. Key: GOBBLIN-629 URL:

[jira] [Created] (GOBBLIN-627) Allow files in task output directory to be overwritten when renaming files with record count.

2018-11-05 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-627: --- Summary: Allow files in task output directory to be overwritten when renaming files with record count. Key: GOBBLIN-627 URL:

[jira] [Created] (GOBBLIN-605) Avoid setting the flowExecutionId twice during path finding in Multi-hop flow compilation.

2018-10-08 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-605: --- Summary: Avoid setting the flowExecutionId twice during path finding in Multi-hop flow compilation. Key: GOBBLIN-605 URL:

[jira] [Created] (GOBBLIN-606) Fix duplicate addition of FlowEdge to path for single-hop paths in Multi-hop flow compiler

2018-10-08 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-606: --- Summary: Fix duplicate addition of FlowEdge to path for single-hop paths in Multi-hop flow compiler Key: GOBBLIN-606 URL:

[jira] [Created] (GOBBLIN-600) Fix build issue due to duplicate method signatures in FlowStatusTest

2018-10-02 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-600: --- Summary: Fix build issue due to duplicate method signatures in FlowStatusTest Key: GOBBLIN-600 URL: https://issues.apache.org/jira/browse/GOBBLIN-600

[jira] [Created] (GOBBLIN-610) Add support for secure access to Git in GitMonitoringService

2018-10-10 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-610: --- Summary: Add support for secure access to Git in GitMonitoringService Key: GOBBLIN-610 URL: https://issues.apache.org/jira/browse/GOBBLIN-610 Project:

[jira] [Created] (GOBBLIN-665) Throw an exception if job orchestration fails on a SpecExecutor

2019-01-16 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-665: --- Summary: Throw an exception if job orchestration fails on a SpecExecutor Key: GOBBLIN-665 URL: https://issues.apache.org/jira/browse/GOBBLIN-665

[jira] [Created] (GOBBLIN-667) Pass encrypt.key.loc configuration to GitFlowGraphMonitor

2019-01-18 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-667: --- Summary: Pass encrypt.key.loc configuration to GitFlowGraphMonitor Key: GOBBLIN-667 URL: https://issues.apache.org/jira/browse/GOBBLIN-667 Project:

[jira] [Created] (GOBBLIN-658) Submit a JobFailed event when an exception is encountered during Job orchestration in Gobblin service.

2018-12-20 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-658: --- Summary: Submit a JobFailed event when an exception is encountered during Job orchestration in Gobblin service. Key: GOBBLIN-658 URL:

[jira] [Created] (GOBBLIN-659) Ensure MultiHopFlowCompiler is properly initialized before attempting flow orchestration.

2018-12-21 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-659: --- Summary: Ensure MultiHopFlowCompiler is properly initialized before attempting flow orchestration. Key: GOBBLIN-659 URL:

[jira] [Created] (GOBBLIN-651) Ensure ordered delivery of Kafka events from KeyValueProducerPusher for kafka-08.

2018-12-11 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-651: --- Summary: Ensure ordered delivery of Kafka events from KeyValueProducerPusher for kafka-08. Key: GOBBLIN-651 URL: https://issues.apache.org/jira/browse/GOBBLIN-651

[jira] [Created] (GOBBLIN-653) Create JobSucceededTimer tracking event to accurately track successful Gobblin jobs.

2018-12-11 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-653: --- Summary: Create JobSucceededTimer tracking event to accurately track successful Gobblin jobs. Key: GOBBLIN-653 URL:

[jira] [Created] (GOBBLIN-650) Ensure ordered delivery of Kafka events from KeyValueProducerPusher.

2018-12-11 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-650: --- Summary: Ensure ordered delivery of Kafka events from KeyValueProducerPusher. Key: GOBBLIN-650 URL: https://issues.apache.org/jira/browse/GOBBLIN-650

[jira] [Created] (GOBBLIN-654) Fix the argument order of JobStatusRetriever APIs to reflect actual usage.

2018-12-11 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-654: --- Summary: Fix the argument order of JobStatusRetriever APIs to reflect actual usage. Key: GOBBLIN-654 URL: https://issues.apache.org/jira/browse/GOBBLIN-654

[jira] [Created] (GOBBLIN-646) Refactor MultiHopFlowCompiler to use SpecExecutor configs from TopologySpecMap

2018-12-06 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-646: --- Summary: Refactor MultiHopFlowCompiler to use SpecExecutor configs from TopologySpecMap Key: GOBBLIN-646 URL: https://issues.apache.org/jira/browse/GOBBLIN-646

[jira] [Created] (GOBBLIN-635) Add metadata tags to Gobblin Tracking Event for Azkaban jobs triggered using Gobblin-as-a-Service (GaaS)

2018-11-24 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-635: --- Summary: Add metadata tags to Gobblin Tracking Event for Azkaban jobs triggered using Gobblin-as-a-Service (GaaS) Key: GOBBLIN-635 URL:

[jira] [Created] (GOBBLIN-637) Create dag checkpoint dir on initialization to avoid NPE

2018-11-25 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-637: --- Summary: Create dag checkpoint dir on initialization to avoid NPE Key: GOBBLIN-637 URL: https://issues.apache.org/jira/browse/GOBBLIN-637 Project:

[jira] [Created] (GOBBLIN-633) Provide HOCON support for flow requests to GaaS

2018-11-20 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-633: --- Summary: Provide HOCON support for flow requests to GaaS Key: GOBBLIN-633 URL: https://issues.apache.org/jira/browse/GOBBLIN-633 Project: Apache

[jira] [Created] (GOBBLIN-638) Submit more timing events from GaaS to accurately track flow/job status

2018-11-26 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-638: --- Summary: Submit more timing events from GaaS to accurately track flow/job status Key: GOBBLIN-638 URL: https://issues.apache.org/jira/browse/GOBBLIN-638

[jira] [Created] (GOBBLIN-636) Use FS scheme and relative URIs for specifying job template locations in GaaS.

2018-11-25 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-636: --- Summary: Use FS scheme and relative URIs for specifying job template locations in GaaS. Key: GOBBLIN-636 URL: https://issues.apache.org/jira/browse/GOBBLIN-636

[jira] [Created] (GOBBLIN-663) Fix Typesafe config resolution failure for non-HOCON strings

2019-01-10 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-663: --- Summary: Fix Typesafe config resolution failure for non-HOCON strings Key: GOBBLIN-663 URL: https://issues.apache.org/jira/browse/GOBBLIN-663 Project:

[jira] [Created] (GOBBLIN-662) Enhance SSH-based access to Git to enable/disable host key checking

2019-01-10 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-662: --- Summary: Enhance SSH-based access to Git to enable/disable host key checking Key: GOBBLIN-662 URL: https://issues.apache.org/jira/browse/GOBBLIN-662

[jira] [Created] (GOBBLIN-590) Implement Workflow Manager in Gobblin-as-a-Service (GaaS)

2018-09-17 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-590: --- Summary: Implement Workflow Manager in Gobblin-as-a-Service (GaaS) Key: GOBBLIN-590 URL: https://issues.apache.org/jira/browse/GOBBLIN-590 Project:

[jira] [Created] (GOBBLIN-696) Provide an "explain" option to return a compiled flow when a flow config is added.

2019-03-05 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-696: --- Summary: Provide an "explain" option to return a compiled flow when a flow config is added. Key: GOBBLIN-696 URL: https://issues.apache.org/jira/browse/GOBBLIN-696

[jira] [Created] (GOBBLIN-698) Enhance logging to print job and flow details when a job is orchestrated by GaaS

2019-03-05 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-698: --- Summary: Enhance logging to print job and flow details when a job is orchestrated by GaaS Key: GOBBLIN-698 URL: https://issues.apache.org/jira/browse/GOBBLIN-698

[jira] [Created] (GOBBLIN-692) Add support to query last K flow executions in Gobblin-as-a-Service (GaaS)

2019-02-26 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-692: --- Summary: Add support to query last K flow executions in Gobblin-as-a-Service (GaaS) Key: GOBBLIN-692 URL: https://issues.apache.org/jira/browse/GOBBLIN-692

[jira] [Created] (GOBBLIN-688) Make FsJobStatusRetriever config more scoped

2019-02-20 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-688: --- Summary: Make FsJobStatusRetriever config more scoped Key: GOBBLIN-688 URL: https://issues.apache.org/jira/browse/GOBBLIN-688 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-708) Create SqlDatasetDescriptor for JDBC-source datasets

2019-03-22 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-708: --- Summary: Create SqlDatasetDescriptor for JDBC-source datasets Key: GOBBLIN-708 URL: https://issues.apache.org/jira/browse/GOBBLIN-708 Project: Apache

[jira] [Updated] (GOBBLIN-708) Create SqlDatasetDescriptor for JDBC-sourced datasets

2019-03-22 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-708: Summary: Create SqlDatasetDescriptor for JDBC-sourced datasets (was: Create

[jira] [Created] (GOBBLIN-709) Provide an option to disallow concurrent flow executions in Gobblin-as-a-Service

2019-03-22 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-709: --- Summary: Provide an option to disallow concurrent flow executions in Gobblin-as-a-Service Key: GOBBLIN-709 URL: https://issues.apache.org/jira/browse/GOBBLIN-709

[jira] [Created] (GOBBLIN-678) Make flow.executionId available in the GaaS Flow config for use in job templates

2019-02-07 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-678: --- Summary: Make flow.executionId available in the GaaS Flow config for use in job templates Key: GOBBLIN-678 URL: https://issues.apache.org/jira/browse/GOBBLIN-678

[jira] [Created] (GOBBLIN-682) Create a new constructor for DatasetCleanerJob

2019-02-12 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-682: --- Summary: Create a new constructor for DatasetCleanerJob Key: GOBBLIN-682 URL: https://issues.apache.org/jira/browse/GOBBLIN-682 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-684) Ensure buffered messages are flushed before close() in KafkaProducerPusher

2019-02-14 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-684: --- Summary: Ensure buffered messages are flushed before close() in KafkaProducerPusher Key: GOBBLIN-684 URL: https://issues.apache.org/jira/browse/GOBBLIN-684

[jira] [Created] (GOBBLIN-687) Pass TopologySpec map to DagManager

2019-02-19 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-687: --- Summary: Pass TopologySpec map to DagManager Key: GOBBLIN-687 URL: https://issues.apache.org/jira/browse/GOBBLIN-687 Project: Apache Gobblin

[jira] [Updated] (GOBBLIN-687) Pass TopologySpec map to DagManager to allow reuse of SpecExecutors during DAG deserialization

2019-02-19 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-687: Summary: Pass TopologySpec map to DagManager to allow reuse of SpecExecutors

[jira] [Created] (GOBBLIN-674) Skip initialization of GitMonitoringService when gobblin template dirs is empty

2019-01-29 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-674: --- Summary: Skip initialization of GitMonitoringService when gobblin template dirs is empty Key: GOBBLIN-674 URL: https://issues.apache.org/jira/browse/GOBBLIN-674

[jira] [Created] (GOBBLIN-673) Implement a FS based JobStatusRetriever for GaaS Flows.

2019-01-28 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-673: --- Summary: Implement a FS based JobStatusRetriever for GaaS Flows. Key: GOBBLIN-673 URL: https://issues.apache.org/jira/browse/GOBBLIN-673 Project: Apache

[jira] [Created] (GOBBLIN-675) Enhance FSDatasetDescriptor definition to include partition config, encryption level and compaction config.

2019-01-30 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-675: --- Summary: Enhance FSDatasetDescriptor definition to include partition config, encryption level and compaction config. Key: GOBBLIN-675 URL:

[jira] [Created] (GOBBLIN-727) Skip commit in CloseOnFlushWriterWrapper if a commit has already been invoked on the underlying writer.

2019-04-08 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-727: --- Summary: Skip commit in CloseOnFlushWriterWrapper if a commit has already been invoked on the underlying writer. Key: GOBBLIN-727 URL:

[jira] [Updated] (GOBBLIN-733) Instrument Avro Converters to allow converter metrics emission in both batch and streaming modes

2019-04-12 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-733: Summary: Instrument Avro Converters to allow converter metrics emission in both

[jira] [Created] (GOBBLIN-733) Instrument Avro Converters to allow converter metrics emission in both batch and streaming mode

2019-04-12 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-733: --- Summary: Instrument Avro Converters to allow converter metrics emission in both batch and streaming mode Key: GOBBLIN-733 URL:

[jira] [Created] (GOBBLIN-795) Make jobCatalog optional for FsJobConfigurationManager

2019-06-04 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-795: --- Summary: Make jobCatalog optional for FsJobConfigurationManager Key: GOBBLIN-795 URL: https://issues.apache.org/jira/browse/GOBBLIN-795 Project: Apache

[jira] [Updated] (GOBBLIN-795) Make JobCatalog optional for FsJobConfigurationManager

2019-06-04 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-795: Summary: Make JobCatalog optional for FsJobConfigurationManager (was: Make

[jira] [Resolved] (GOBBLIN-789) Implement a FileSystem based SpecProducer

2019-06-05 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-789. - Resolution: Fixed > Implement a FileSystem based SpecProducer >

[jira] [Closed] (GOBBLIN-789) Implement a FileSystem based SpecProducer

2019-06-05 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-789. --- > Implement a FileSystem based SpecProducer > -

[jira] [Resolved] (GOBBLIN-795) Make JobCatalog optional for FsJobConfigurationManager

2019-06-05 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-795. - Resolution: Fixed > Make JobCatalog optional for FsJobConfigurationManager >

[jira] [Closed] (GOBBLIN-795) Make JobCatalog optional for FsJobConfigurationManager

2019-06-05 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-795. --- > Make JobCatalog optional for FsJobConfigurationManager >

[jira] [Created] (GOBBLIN-789) Implement a FileSystem based SpecProducer

2019-05-30 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-789: --- Summary: Implement a FileSystem based SpecProducer Key: GOBBLIN-789 URL: https://issues.apache.org/jira/browse/GOBBLIN-789 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-776) Add a utility method to return Helix WorflowId given a Gobblin job name

2019-05-20 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-776: --- Summary: Add a utility method to return Helix WorflowId given a Gobblin job name Key: GOBBLIN-776 URL: https://issues.apache.org/jira/browse/GOBBLIN-776

[jira] [Created] (GOBBLIN-742) Implement a FileSystem based JobConfigurationManager

2019-04-18 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-742: --- Summary: Implement a FileSystem based JobConfigurationManager Key: GOBBLIN-742 URL: https://issues.apache.org/jira/browse/GOBBLIN-742 Project: Apache

[jira] [Updated] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

2019-04-20 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-744: Summary: Support cancellation of a Helix workflow via a DELETE Spec (was:

[jira] [Created] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE JobSpec

2019-04-20 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-744: --- Summary: Support cancellation of a Helix workflow via a DELETE JobSpec Key: GOBBLIN-744 URL: https://issues.apache.org/jira/browse/GOBBLIN-744 Project:

[jira] [Resolved] (GOBBLIN-765) Remove a duplicate leading period character from the config key for SqlDataNode

2019-05-03 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-765. - Resolution: Fixed > Remove a duplicate leading period character from the config

[jira] [Closed] (GOBBLIN-765) Remove a duplicate leading period character from the config key for SqlDataNode

2019-05-03 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-765. --- > Remove a duplicate leading period character from the config key for > SqlDataNode >

[jira] [Created] (GOBBLIN-815) Avoid eager resolution of configs when loading job templates from template catalog

2019-06-27 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-815: --- Summary: Avoid eager resolution of configs when loading job templates from template catalog Key: GOBBLIN-815 URL: https://issues.apache.org/jira/browse/GOBBLIN-815

[jira] [Closed] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

2019-04-23 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-744. --- > Support cancellation of a Helix workflow via a DELETE Spec >

[jira] [Updated] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

2019-04-23 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-744: Issue resolved by PR: [https://github.com/apache/incubator-gobblin/pull/2609] >

[jira] [Resolved] (GOBBLIN-744) Support cancellation of a Helix workflow via a DELETE Spec

2019-04-23 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-744. - Resolution: Fixed > Support cancellation of a Helix workflow via a DELETE Spec

[jira] [Created] (GOBBLIN-816) Implement a workaround to abort Helix TaskDriver#getWorkflows() after a timeout

2019-06-28 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-816: --- Summary: Implement a workaround to abort Helix TaskDriver#getWorkflows() after a timeout Key: GOBBLIN-816 URL: https://issues.apache.org/jira/browse/GOBBLIN-816

[jira] [Created] (GOBBLIN-817) Implement a workaround for Helix Workflow being stuck in STOPPING state

2019-06-28 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-817: --- Summary: Implement a workaround for Helix Workflow being stuck in STOPPING state Key: GOBBLIN-817 URL: https://issues.apache.org/jira/browse/GOBBLIN-817

[jira] [Closed] (GOBBLIN-846) Enhance LogCopier service to handle continuous YARN log aggregation

2019-08-13 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-846. --- Resolution: Fixed > Enhance LogCopier service to handle continuous YARN log

[jira] [Created] (GOBBLIN-876) Expose metrics() API in GobblinKafkaConsumerClient to allow consume metrics to be reported

2019-09-09 Thread Sudarshan Vasudevan (Jira)
Sudarshan Vasudevan created GOBBLIN-876: --- Summary: Expose metrics() API in GobblinKafkaConsumerClient to allow consume metrics to be reported Key: GOBBLIN-876 URL:

[jira] [Created] (GOBBLIN-875) Emit container health metrics when running in cluster mode

2019-09-09 Thread Sudarshan Vasudevan (Jira)
Sudarshan Vasudevan created GOBBLIN-875: --- Summary: Emit container health metrics when running in cluster mode Key: GOBBLIN-875 URL: https://issues.apache.org/jira/browse/GOBBLIN-875 Project:

[jira] [Created] (GOBBLIN-878) Implement a Metric Regex filter based on whitelist/blacklist patterns.

2019-09-09 Thread Sudarshan Vasudevan (Jira)
Sudarshan Vasudevan created GOBBLIN-878: --- Summary: Implement a Metric Regex filter based on whitelist/blacklist patterns. Key: GOBBLIN-878 URL: https://issues.apache.org/jira/browse/GOBBLIN-878

[jira] [Created] (GOBBLIN-846) Enhance LogCopier service to handle continuous YARN log aggregation

2019-08-07 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-846: --- Summary: Enhance LogCopier service to handle continuous YARN log aggregation Key: GOBBLIN-846 URL: https://issues.apache.org/jira/browse/GOBBLIN-846

[jira] [Created] (GOBBLIN-836) Expose container logs location via system property to be used in log4j configuration for Gobblin-on-Yarn applications

2019-07-26 Thread Sudarshan Vasudevan (JIRA)
Sudarshan Vasudevan created GOBBLIN-836: --- Summary: Expose container logs location via system property to be used in log4j configuration for Gobblin-on-Yarn applications Key: GOBBLIN-836 URL:

[jira] [Resolved] (GOBBLIN-836) Expose container logs location via system property to be used in log4j configuration for Gobblin-on-Yarn applications

2019-07-26 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-836. - Resolution: Fixed > Expose container logs location via system property to be

[jira] [Closed] (GOBBLIN-836) Expose container logs location via system property to be used in log4j configuration for Gobblin-on-Yarn applications

2019-07-26 Thread Sudarshan Vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-836. --- > Expose container logs location via system property to be used in log4j >

  1   2   3   >