[jira] [Created] (GOBBLIN-930) Add number of topic partitions of a topic in each workunit

Sudarshan Vasudevan created GOBBLIN-930: --- Summary: Add number of topic partitions of a topic in each workunit Key: GOBBLIN-930 URL: https://issues.apache.org/jira/browse/GOBBLIN-930 Project: Apac

[jira] [Created] (GOBBLIN-945) Refactor Kafka extractor statistics tracking to allow code reuse across both batch and streaming execution modes

Sudarshan Vasudevan created GOBBLIN-945: --- Summary: Refactor Kafka extractor statistics tracking to allow code reuse across both batch and streaming execution modes Key: GOBBLIN-945 URL: https://issues.apache

[jira] [Resolved] (GOBBLIN-945) Refactor Kafka extractor statistics tracking to allow code reuse across both batch and streaming execution modes

[ https://issues.apache.org/jira/browse/GOBBLIN-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-945. - Resolution: Fixed > Refactor Kafka extractor statistics tracking to allow code r

[jira] [Resolved] (GOBBLIN-876) Expose metrics() API in GobblinKafkaConsumerClient to allow consume metrics to be reported

[ https://issues.apache.org/jira/browse/GOBBLIN-876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-876. - Resolution: Fixed > Expose metrics() API in GobblinKafkaConsumerClient to allow

[jira] [Resolved] (GOBBLIN-875) Emit container health metrics when running in cluster mode

[ https://issues.apache.org/jira/browse/GOBBLIN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-875. - Resolution: Fixed > Emit container health metrics when running in cluster mode >

[jira] [Created] (GOBBLIN-955) Expose a method to get average record size in KafkaExtractorStatsTracker

Sudarshan Vasudevan created GOBBLIN-955: --- Summary: Expose a method to get average record size in KafkaExtractorStatsTracker Key: GOBBLIN-955 URL: https://issues.apache.org/jira/browse/GOBBLIN-955

[jira] [Created] (GOBBLIN-966) Check if no partitions have been processed by KafkaExtractor in close() method to avoid ArrayIndexOutOfBoundsException

Sudarshan Vasudevan created GOBBLIN-966: --- Summary: Check if no partitions have been processed by KafkaExtractor in close() method to avoid ArrayIndexOutOfBoundsException Key: GOBBLIN-966 URL: https://issues

[jira] [Created] (GOBBLIN-970) Pass metric context from the KafkaSource to the KafkaWorkUnitPacker for emission of metrics from the packer

Sudarshan Vasudevan created GOBBLIN-970: --- Summary: Pass metric context from the KafkaSource to the KafkaWorkUnitPacker for emission of metrics from the packer Key: GOBBLIN-970 URL: https://issues.apache.org/

[jira] [Created] (GOBBLIN-973) Increase timeout for copying Gobblin workunits to the workunit state store in GobblinHelixJobLauncher

Sudarshan Vasudevan created GOBBLIN-973: --- Summary: Increase timeout for copying Gobblin workunits to the workunit state store in GobblinHelixJobLauncher Key: GOBBLIN-973 URL: https://issues.apache.org/jira/b

[jira] [Created] (GOBBLIN-976) Add dynamic config to the state before instantiating metrics reporter in MRJobLauncher

Sudarshan Vasudevan created GOBBLIN-976: --- Summary: Add dynamic config to the state before instantiating metrics reporter in MRJobLauncher Key: GOBBLIN-976 URL: https://issues.apache.org/jira/browse/GOBBLIN-9

[jira] [Closed] (GOBBLIN-970) Pass metric context from the KafkaSource to the KafkaWorkUnitPacker for emission of metrics from the packer

[ https://issues.apache.org/jira/browse/GOBBLIN-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-970. --- > Pass metric context from the KafkaSource to the KafkaWorkUnitPacker for > emission of

[jira] [Resolved] (GOBBLIN-973) Increase timeout for copying Gobblin workunits to the workunit state store in GobblinHelixJobLauncher

[ https://issues.apache.org/jira/browse/GOBBLIN-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-973. - Resolution: Fixed > Increase timeout for copying Gobblin workunits to the workun

[jira] [Resolved] (GOBBLIN-970) Pass metric context from the KafkaSource to the KafkaWorkUnitPacker for emission of metrics from the packer

[ https://issues.apache.org/jira/browse/GOBBLIN-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-970. - Resolution: Fixed > Pass metric context from the KafkaSource to the KafkaWorkUni

[jira] [Closed] (GOBBLIN-973) Increase timeout for copying Gobblin workunits to the workunit state store in GobblinHelixJobLauncher

[ https://issues.apache.org/jira/browse/GOBBLIN-973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-973. --- > Increase timeout for copying Gobblin workunits to the workunit state store in > Gobbl

[jira] [Closed] (GOBBLIN-966) Check if no partitions have been processed by KafkaExtractor in close() method to avoid ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/GOBBLIN-966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-966. --- > Check if no partitions have been processed by KafkaExtractor in close() > method to a

[jira] [Resolved] (GOBBLIN-966) Check if no partitions have been processed by KafkaExtractor in close() method to avoid ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/GOBBLIN-966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-966. - Resolution: Fixed > Check if no partitions have been processed by KafkaExtractor

[jira] [Closed] (GOBBLIN-878) Implement a Metric Regex filter based on whitelist/blacklist patterns.

[ https://issues.apache.org/jira/browse/GOBBLIN-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-878. --- Resolution: Won't Fix > Implement a Metric Regex filter based on whitelist/blacklist

[jira] [Resolved] (GOBBLIN-955) Expose a method to get average record size in KafkaExtractorStatsTracker

[ https://issues.apache.org/jira/browse/GOBBLIN-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-955. - Resolution: Fixed > Expose a method to get average record size in KafkaExtractor

[jira] [Closed] (GOBBLIN-875) Emit container health metrics when running in cluster mode

[ https://issues.apache.org/jira/browse/GOBBLIN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-875. --- > Emit container health metrics when running in cluster mode > -

[jira] [Closed] (GOBBLIN-945) Refactor Kafka extractor statistics tracking to allow code reuse across both batch and streaming execution modes

[ https://issues.apache.org/jira/browse/GOBBLIN-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-945. --- > Refactor Kafka extractor statistics tracking to allow code reuse across both > batch

[jira] [Closed] (GOBBLIN-955) Expose a method to get average record size in KafkaExtractorStatsTracker

[ https://issues.apache.org/jira/browse/GOBBLIN-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-955. --- > Expose a method to get average record size in KafkaExtractorStatsTracker > ---

[jira] [Closed] (GOBBLIN-876) Expose metrics() API in GobblinKafkaConsumerClient to allow consume metrics to be reported

[ https://issues.apache.org/jira/browse/GOBBLIN-876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-876. --- > Expose metrics() API in GobblinKafkaConsumerClient to allow consume metrics > to be r

[jira] [Created] (GOBBLIN-978) Use job start time instead of flow start time to kill jobs stuck in ORCHESTRATED state

Sudarshan Vasudevan created GOBBLIN-978: --- Summary: Use job start time instead of flow start time to kill jobs stuck in ORCHESTRATED state Key: GOBBLIN-978 URL: https://issues.apache.org/jira/browse/GOBBLIN-9

[jira] [Resolved] (GOBBLIN-978) Use job start time instead of flow start time to kill jobs stuck in ORCHESTRATED state

[ https://issues.apache.org/jira/browse/GOBBLIN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-978. - Resolution: Fixed > Use job start time instead of flow start time to kill jobs s

[jira] [Resolved] (GOBBLIN-976) Add dynamic config to the state before instantiating metrics reporter in MRJobLauncher

[ https://issues.apache.org/jira/browse/GOBBLIN-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-976. - Resolution: Fixed > Add dynamic config to the state before instantiating metrics

[jira] [Closed] (GOBBLIN-978) Use job start time instead of flow start time to kill jobs stuck in ORCHESTRATED state

[ https://issues.apache.org/jira/browse/GOBBLIN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-978. --- > Use job start time instead of flow start time to kill jobs stuck in > ORCHESTRATED st

[jira] [Closed] (GOBBLIN-976) Add dynamic config to the state before instantiating metrics reporter in MRJobLauncher

[ https://issues.apache.org/jira/browse/GOBBLIN-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-976. --- > Add dynamic config to the state before instantiating metrics reporter in > MRJobLaunc

[jira] [Created] (GOBBLIN-989) Track and report record level SLA in Gobblin Kafka Extractor tracking event

Sudarshan Vasudevan created GOBBLIN-989: --- Summary: Track and report record level SLA in Gobblin Kafka Extractor tracking event Key: GOBBLIN-989 URL: https://issues.apache.org/jira/browse/GOBBLIN-989

[jira] [Created] (GOBBLIN-996) Add support for managed Helix clusters for Gobblin-on-Yarn applications

Sudarshan Vasudevan created GOBBLIN-996: --- Summary: Add support for managed Helix clusters for Gobblin-on-Yarn applications Key: GOBBLIN-996 URL: https://issues.apache.org/jira/browse/GOBBLIN-996

[jira] [Closed] (GOBBLIN-996) Add support for managed Helix clusters for Gobblin-on-Yarn applications

[ https://issues.apache.org/jira/browse/GOBBLIN-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-996. --- > Add support for managed Helix clusters for Gobblin-on-Yarn applications >

[jira] [Resolved] (GOBBLIN-996) Add support for managed Helix clusters for Gobblin-on-Yarn applications

[ https://issues.apache.org/jira/browse/GOBBLIN-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-996. - Resolution: Fixed > Add support for managed Helix clusters for Gobblin-on-Yarn a

[jira] [Resolved] (GOBBLIN-989) Track and report record level SLA in Gobblin Kafka Extractor tracking event

[ https://issues.apache.org/jira/browse/GOBBLIN-989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-989. - Resolution: Fixed > Track and report record level SLA in Gobblin Kafka Extractor

[jira] [Closed] (GOBBLIN-989) Track and report record level SLA in Gobblin Kafka Extractor tracking event

[ https://issues.apache.org/jira/browse/GOBBLIN-989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-989. --- > Track and report record level SLA in Gobblin Kafka Extractor tracking event >

[jira] [Created] (GOBBLIN-1000) Add min and max LogAppendTime to tracking events emitted from Gobblin Kafka Extractor

Sudarshan Vasudevan created GOBBLIN-1000: Summary: Add min and max LogAppendTime to tracking events emitted from Gobblin Kafka Extractor Key: GOBBLIN-1000 URL: https://issues.apache.org/jira/browse/GOBBLIN

[jira] [Closed] (GOBBLIN-1000) Add min and max LogAppendTime to tracking events emitted from Gobblin Kafka Extractor

[ https://issues.apache.org/jira/browse/GOBBLIN-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1000. > Add min and max LogAppendTime to tracking events emitted from Gobblin Kafka > Extr

[jira] [Resolved] (GOBBLIN-1000) Add min and max LogAppendTime to tracking events emitted from Gobblin Kafka Extractor

[ https://issues.apache.org/jira/browse/GOBBLIN-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1000. -- Resolution: Fixed > Add min and max LogAppendTime to tracking events emitted

[jira] [Created] (GOBBLIN-1002) Set state id when deserializing state from Gobblin state store

Sudarshan Vasudevan created GOBBLIN-1002: Summary: Set state id when deserializing state from Gobblin state store Key: GOBBLIN-1002 URL: https://issues.apache.org/jira/browse/GOBBLIN-1002 Proj

[jira] [Closed] (GOBBLIN-1002) Set state id when deserializing state from Gobblin state store

[ https://issues.apache.org/jira/browse/GOBBLIN-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1002. > Set state id when deserializing state from Gobblin state store > --

[jira] [Resolved] (GOBBLIN-1002) Set state id when deserializing state from Gobblin state store

[ https://issues.apache.org/jira/browse/GOBBLIN-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1002. -- Resolution: Fixed > Set state id when deserializing state from Gobblin state

[jira] [Created] (GOBBLIN-1016) Send shutdown request and token file updated messages to ADMINISTRATOR instance type when Helix cluster is managed

Sudarshan Vasudevan created GOBBLIN-1016: Summary: Send shutdown request and token file updated messages to ADMINISTRATOR instance type when Helix cluster is managed Key: GOBBLIN-1016 URL: https://issues.a

[jira] [Updated] (GOBBLIN-1016) Send shutdown request and token file updated messages to PARTICIPANT instance type when Helix cluster is managed

[ https://issues.apache.org/jira/browse/GOBBLIN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-1016: - Summary: Send shutdown request and token file updated messages to PARTICIPANT i

[jira] [Updated] (GOBBLIN-1016) Send shutdown request and token file updated messages to PARTICIPANT instance type when Helix cluster is managed

[ https://issues.apache.org/jira/browse/GOBBLIN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-1016: - Description: In the managed cluster mode, the Gobblin Yarn Application Master j

[jira] [Updated] (GOBBLIN-1016) Allow Gobblin Application Master to join Helix cluster in PARTICIPANT mode when Helix cluster is managed.

[ https://issues.apache.org/jira/browse/GOBBLIN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-1016: - Summary: Allow Gobblin Application Master to join Helix cluster in PARTICIPANT

[jira] [Updated] (GOBBLIN-1016) Allow Gobblin Application Master to join Helix cluster in PARTICIPANT mode when Helix cluster is managed

[ https://issues.apache.org/jira/browse/GOBBLIN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-1016: - Summary: Allow Gobblin Application Master to join Helix cluster in PARTICIPANT

[jira] [Created] (GOBBLIN-1018) Report GC counts and durations from Gobblin containers metrics service

Sudarshan Vasudevan created GOBBLIN-1018: Summary: Report GC counts and durations from Gobblin containers metrics service Key: GOBBLIN-1018 URL: https://issues.apache.org/jira/browse/GOBBLIN-1018

[jira] [Created] (GOBBLIN-1029) Maintain the last GC stats to accurately report the difference in each interval

Sudarshan Vasudevan created GOBBLIN-1029: Summary: Maintain the last GC stats to accurately report the difference in each interval Key: GOBBLIN-1029 URL: https://issues.apache.org/jira/browse/GOBBLIN-1029

[jira] [Created] (GOBBLIN-1030) Expose helixClusterManaged config in AbstractYarnSecurityManager

Sudarshan Vasudevan created GOBBLIN-1030: Summary: Expose helixClusterManaged config in AbstractYarnSecurityManager Key: GOBBLIN-1030 URL: https://issues.apache.org/jira/browse/GOBBLIN-1030 Pr

[jira] [Updated] (GOBBLIN-1030) Refactor AbstractYarnSecurityManager to expose method for sending token file update message

[ https://issues.apache.org/jira/browse/GOBBLIN-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-1030: - Summary: Refactor AbstractYarnSecurityManager to expose method for sending toke

[jira] [Updated] (GOBBLIN-1030) Refactor AbstractYarnSecurityManager to expose method for sending token file update message

[ https://issues.apache.org/jira/browse/GOBBLIN-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-1030: - Description: Current implementation has this method in YarnAppSecurityManagerWi

[jira] [Created] (GOBBLIN-1032) Provide Helix instance tags config to GobblinYarnTaskRunner during container start up

Sudarshan Vasudevan created GOBBLIN-1032: Summary: Provide Helix instance tags config to GobblinYarnTaskRunner during container start up Key: GOBBLIN-1032 URL: https://issues.apache.org/jira/browse/GOBBLIN

[jira] [Created] (GOBBLIN-1034) Ensure underlying writers are expired from the PartitionedDataWriter cache to avoid accumulation of writers for long running Gobblin jobs

Sudarshan Vasudevan created GOBBLIN-1034: Summary: Ensure underlying writers are expired from the PartitionedDataWriter cache to avoid accumulation of writers for long running Gobblin jobs Key: GOBBLIN-1034

[jira] [Created] (GOBBLIN-1036) Add hadoop override configurations when instantiating FileSystem object in GobblinTaskRunner and GobblinClusterManager

Sudarshan Vasudevan created GOBBLIN-1036: Summary: Add hadoop override configurations when instantiating FileSystem object in GobblinTaskRunner and GobblinClusterManager Key: GOBBLIN-1036 URL: https://issu

[jira] [Created] (GOBBLIN-1043) Implement a Helix assigned participant check as a CommitStep

Sudarshan Vasudevan created GOBBLIN-1043: Summary: Implement a Helix assigned participant check as a CommitStep Key: GOBBLIN-1043 URL: https://issues.apache.org/jira/browse/GOBBLIN-1043 Projec

[jira] [Created] (GOBBLIN-1047) Add Helix and Yarn container metadata to all task events emitted by Gobblin Helix tasks

Sudarshan Vasudevan created GOBBLIN-1047: Summary: Add Helix and Yarn container metadata to all task events emitted by Gobblin Helix tasks Key: GOBBLIN-1047 URL: https://issues.apache.org/jira/browse/GOBBL

[jira] [Created] (GOBBLIN-1048) Provide an option to pass and set System properties via Gobblin Cluster application config

Sudarshan Vasudevan created GOBBLIN-1048: Summary: Provide an option to pass and set System properties via Gobblin Cluster application config Key: GOBBLIN-1048 URL: https://issues.apache.org/jira/browse/GO

[jira] [Resolved] (GOBBLIN-1047) Add Helix and Yarn container metadata to all task events emitted by Gobblin Helix tasks

[ https://issues.apache.org/jira/browse/GOBBLIN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1047. -- Resolution: Fixed > Add Helix and Yarn container metadata to all task events

[jira] [Closed] (GOBBLIN-1043) Implement a Helix assigned participant check as a CommitStep

[ https://issues.apache.org/jira/browse/GOBBLIN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1043. > Implement a Helix assigned participant check as a CommitStep >

[jira] [Closed] (GOBBLIN-1047) Add Helix and Yarn container metadata to all task events emitted by Gobblin Helix tasks

[ https://issues.apache.org/jira/browse/GOBBLIN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1047. > Add Helix and Yarn container metadata to all task events emitted by Gobblin > Heli

[jira] [Resolved] (GOBBLIN-1043) Implement a Helix assigned participant check as a CommitStep

[ https://issues.apache.org/jira/browse/GOBBLIN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1043. -- Resolution: Fixed > Implement a Helix assigned participant check as a CommitS

[jira] [Resolved] (GOBBLIN-1030) Refactor AbstractYarnSecurityManager to expose method for sending token file update message

[ https://issues.apache.org/jira/browse/GOBBLIN-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1030. -- Resolution: Fixed > Refactor AbstractYarnSecurityManager to expose method for

[jira] [Resolved] (GOBBLIN-1036) Add hadoop override configurations when instantiating FileSystem object in GobblinTaskRunner and GobblinClusterManager

[ https://issues.apache.org/jira/browse/GOBBLIN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1036. -- Resolution: Fixed > Add hadoop override configurations when instantiating Fil

[jira] [Resolved] (GOBBLIN-1032) Provide Helix instance tags config to GobblinYarnTaskRunner during container start up

[ https://issues.apache.org/jira/browse/GOBBLIN-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1032. -- Resolution: Fixed > Provide Helix instance tags config to GobblinYarnTaskRunn

[jira] [Closed] (GOBBLIN-1032) Provide Helix instance tags config to GobblinYarnTaskRunner during container start up

[ https://issues.apache.org/jira/browse/GOBBLIN-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1032. > Provide Helix instance tags config to GobblinYarnTaskRunner during container > sta

[jira] [Resolved] (GOBBLIN-1018) Report GC counts and durations from Gobblin containers metrics service

[ https://issues.apache.org/jira/browse/GOBBLIN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1018. -- Resolution: Fixed > Report GC counts and durations from Gobblin containers me

[jira] [Closed] (GOBBLIN-1034) Ensure underlying writers are expired from the PartitionedDataWriter cache to avoid accumulation of writers for long running Gobblin jobs

[ https://issues.apache.org/jira/browse/GOBBLIN-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1034. > Ensure underlying writers are expired from the PartitionedDataWriter cache to > av

[jira] [Closed] (GOBBLIN-1036) Add hadoop override configurations when instantiating FileSystem object in GobblinTaskRunner and GobblinClusterManager

[ https://issues.apache.org/jira/browse/GOBBLIN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1036. > Add hadoop override configurations when instantiating FileSystem object in > Gobbl

[jira] [Closed] (GOBBLIN-1029) Maintain the last GC stats to accurately report the difference in each interval

[ https://issues.apache.org/jira/browse/GOBBLIN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1029. > Maintain the last GC stats to accurately report the difference in each > interval

[jira] [Closed] (GOBBLIN-1030) Refactor AbstractYarnSecurityManager to expose method for sending token file update message

[ https://issues.apache.org/jira/browse/GOBBLIN-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1030. > Refactor AbstractYarnSecurityManager to expose method for sending token file > upd

[jira] [Resolved] (GOBBLIN-1029) Maintain the last GC stats to accurately report the difference in each interval

[ https://issues.apache.org/jira/browse/GOBBLIN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1029. -- Resolution: Fixed > Maintain the last GC stats to accurately report the diffe

[jira] [Resolved] (GOBBLIN-1034) Ensure underlying writers are expired from the PartitionedDataWriter cache to avoid accumulation of writers for long running Gobblin jobs

[ https://issues.apache.org/jira/browse/GOBBLIN-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1034. -- Resolution: Fixed > Ensure underlying writers are expired from the Partitione

[jira] [Closed] (GOBBLIN-1018) Report GC counts and durations from Gobblin containers metrics service

[ https://issues.apache.org/jira/browse/GOBBLIN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1018. > Report GC counts and durations from Gobblin containers metrics service >

[jira] [Closed] (GOBBLIN-1016) Allow Gobblin Application Master to join Helix cluster in PARTICIPANT mode when Helix cluster is managed

[ https://issues.apache.org/jira/browse/GOBBLIN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1016. > Allow Gobblin Application Master to join Helix cluster in PARTICIPANT mode > when

[jira] [Resolved] (GOBBLIN-1016) Allow Gobblin Application Master to join Helix cluster in PARTICIPANT mode when Helix cluster is managed

[ https://issues.apache.org/jira/browse/GOBBLIN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1016. -- Resolution: Fixed > Allow Gobblin Application Master to join Helix cluster in

[jira] [Closed] (GOBBLIN-1048) Provide an option to pass and set System properties via Gobblin Cluster application config

[ https://issues.apache.org/jira/browse/GOBBLIN-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1048. > Provide an option to pass and set System properties via Gobblin Cluster > applicat

[jira] [Resolved] (GOBBLIN-1048) Provide an option to pass and set System properties via Gobblin Cluster application config

[ https://issues.apache.org/jira/browse/GOBBLIN-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1048. -- Resolution: Fixed > Provide an option to pass and set System properties via G

[jira] [Created] (GOBBLIN-1052) Create a spec consumer path if it does not exist in FS SpecConsumer

Sudarshan Vasudevan created GOBBLIN-1052: Summary: Create a spec consumer path if it does not exist in FS SpecConsumer Key: GOBBLIN-1052 URL: https://issues.apache.org/jira/browse/GOBBLIN-1052

[jira] [Created] (GOBBLIN-1067) Add SFTP DataNode type in Gobblin-as-a-Service (GaaS) FlowGraph

Sudarshan Vasudevan created GOBBLIN-1067: Summary: Add SFTP DataNode type in Gobblin-as-a-Service (GaaS) FlowGraph Key: GOBBLIN-1067 URL: https://issues.apache.org/jira/browse/GOBBLIN-1067 Pr

[jira] [Created] (GOBBLIN-1076) Make Gobblin cluster working directories configurable

Sudarshan Vasudevan created GOBBLIN-1076: Summary: Make Gobblin cluster working directories configurable Key: GOBBLIN-1076 URL: https://issues.apache.org/jira/browse/GOBBLIN-1076 Project: Apach

[jira] [Created] (GOBBLIN-1087) Track and report histogram of observed lag from Gobblin Kafka pipeline

Sudarshan Vasudevan created GOBBLIN-1087: Summary: Track and report histogram of observed lag from Gobblin Kafka pipeline Key: GOBBLIN-1087 URL: https://issues.apache.org/jira/browse/GOBBLIN-1087

[jira] [Created] (GOBBLIN-1091) Pass Yarn application id as part of AppMaster and YarnTaskRunner's start up command

Sudarshan Vasudevan created GOBBLIN-1091: Summary: Pass Yarn application id as part of AppMaster and YarnTaskRunner's start up command Key: GOBBLIN-1091 URL: https://issues.apache.org/jira/browse/GOBBLIN-1

[jira] [Created] (GOBBLIN-1099) Handle orphaned Yarn containers in Gobblin-on-Yarn clusters

Sudarshan Vasudevan created GOBBLIN-1099: Summary: Handle orphaned Yarn containers in Gobblin-on-Yarn clusters Key: GOBBLIN-1099 URL: https://issues.apache.org/jira/browse/GOBBLIN-1099 Project

[jira] [Created] (GOBBLIN-1107) Lazily initialize Helix TaskStateModelFactory in GobblinTaskRunner

Sudarshan Vasudevan created GOBBLIN-1107: Summary: Lazily initialize Helix TaskStateModelFactory in GobblinTaskRunner Key: GOBBLIN-1107 URL: https://issues.apache.org/jira/browse/GOBBLIN-1107

[jira] [Closed] (GOBBLIN-1107) Lazily initialize Helix TaskStateModelFactory in GobblinTaskRunner

[ https://issues.apache.org/jira/browse/GOBBLIN-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1107. > Lazily initialize Helix TaskStateModelFactory in GobblinTaskRunner > --

[jira] [Resolved] (GOBBLIN-1107) Lazily initialize Helix TaskStateModelFactory in GobblinTaskRunner

[ https://issues.apache.org/jira/browse/GOBBLIN-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1107. -- Resolution: Fixed > Lazily initialize Helix TaskStateModelFactory in GobblinT

[jira] [Resolved] (GOBBLIN-1087) Track and report histogram of observed lag from Gobblin Kafka pipeline

[ https://issues.apache.org/jira/browse/GOBBLIN-1087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1087. -- Resolution: Fixed > Track and report histogram of observed lag from Gobblin K

[jira] [Resolved] (GOBBLIN-1076) Make Gobblin cluster working directories configurable

[ https://issues.apache.org/jira/browse/GOBBLIN-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1076. -- Resolution: Fixed > Make Gobblin cluster working directories configurable > -

[jira] [Closed] (GOBBLIN-1087) Track and report histogram of observed lag from Gobblin Kafka pipeline

[ https://issues.apache.org/jira/browse/GOBBLIN-1087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1087. > Track and report histogram of observed lag from Gobblin Kafka pipeline > --

[jira] [Resolved] (GOBBLIN-1099) Handle orphaned Yarn containers in Gobblin-on-Yarn clusters

[ https://issues.apache.org/jira/browse/GOBBLIN-1099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1099. -- Resolution: Fixed > Handle orphaned Yarn containers in Gobblin-on-Yarn cluste

[jira] [Resolved] (GOBBLIN-1091) Pass Yarn application id as part of AppMaster and YarnTaskRunner's start up command

[ https://issues.apache.org/jira/browse/GOBBLIN-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1091. -- Resolution: Fixed > Pass Yarn application id as part of AppMaster and YarnTas

[jira] [Closed] (GOBBLIN-1099) Handle orphaned Yarn containers in Gobblin-on-Yarn clusters

[ https://issues.apache.org/jira/browse/GOBBLIN-1099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1099. > Handle orphaned Yarn containers in Gobblin-on-Yarn clusters > -

[jira] [Closed] (GOBBLIN-1091) Pass Yarn application id as part of AppMaster and YarnTaskRunner's start up command

[ https://issues.apache.org/jira/browse/GOBBLIN-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1091. > Pass Yarn application id as part of AppMaster and YarnTaskRunner's start up > comm

[jira] [Closed] (GOBBLIN-1076) Make Gobblin cluster working directories configurable

[ https://issues.apache.org/jira/browse/GOBBLIN-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1076. > Make Gobblin cluster working directories configurable > ---

[jira] [Resolved] (GOBBLIN-1067) Add SFTP DataNode type in Gobblin-as-a-Service (GaaS) FlowGraph

[ https://issues.apache.org/jira/browse/GOBBLIN-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1067. -- Resolution: Fixed > Add SFTP DataNode type in Gobblin-as-a-Service (GaaS) Flo

[jira] [Resolved] (GOBBLIN-1052) Create a spec consumer path if it does not exist in FS SpecConsumer

[ https://issues.apache.org/jira/browse/GOBBLIN-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan resolved GOBBLIN-1052. -- Resolution: Fixed > Create a spec consumer path if it does not exist in FS Sp

[jira] [Closed] (GOBBLIN-1052) Create a spec consumer path if it does not exist in FS SpecConsumer

[ https://issues.apache.org/jira/browse/GOBBLIN-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1052. > Create a spec consumer path if it does not exist in FS SpecConsumer > -

[jira] [Closed] (GOBBLIN-1067) Add SFTP DataNode type in Gobblin-as-a-Service (GaaS) FlowGraph

[ https://issues.apache.org/jira/browse/GOBBLIN-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan closed GOBBLIN-1067. > Add SFTP DataNode type in Gobblin-as-a-Service (GaaS) FlowGraph >

[jira] [Created] (GOBBLIN-1112) Create a new HttpMethodRetryHandler implementation that allows retrying a HTTP method on transient network errors

Sudarshan Vasudevan created GOBBLIN-1112: Summary: Create a new HttpMethodRetryHandler implementation that allows retrying a HTTP method on transient network errors Key: GOBBLIN-1112 URL: https://issues.ap

[jira] [Updated] (GOBBLIN-1112) Implement a new HttpMethodRetryHandler that allows retrying a HTTP method on transient network errors

[ https://issues.apache.org/jira/browse/GOBBLIN-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudarshan Vasudevan updated GOBBLIN-1112: - Summary: Implement a new HttpMethodRetryHandler that allows retrying a HTTP met

[jira] [Created] (GOBBLIN-1116) Avoid registering schema with schema registry during MetricReporting initialization from cluster workers

Sudarshan Vasudevan created GOBBLIN-1116: Summary: Avoid registering schema with schema registry during MetricReporting initialization from cluster workers Key: GOBBLIN-1116 URL: https://issues.apache.org/

[jira] [Created] (GOBBLIN-1120) Reinitialize HelixManager when Helix participant check throws an exception when reading

Sudarshan Vasudevan created GOBBLIN-1120: Summary: Reinitialize HelixManager when Helix participant check throws an exception when reading Key: GOBBLIN-1120 URL: https://issues.apache.org/jira/browse/GOBB

  1   2   3   >