[jira] [Resolved] (GOBBLIN-1090) distinguish compiled_skip from compiled_failed metrics
[ https://issues.apache.org/jira/browse/GOBBLIN-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1090. --- Resolution: Fixed > distinguish compiled_skip from compiled_failed metrics > -- > > Key: GOBBLIN-1090 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1090 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1086) update gaas job start timer using events coming from job execution
[ https://issues.apache.org/jira/browse/GOBBLIN-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1086. --- Resolution: Fixed > update gaas job start timer using events coming from job execution > -- > > Key: GOBBLIN-1086 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1086 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1085) fix compaction source initialization
[ https://issues.apache.org/jira/browse/GOBBLIN-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1085. --- Resolution: Fixed > fix compaction source initialization > > > Key: GOBBLIN-1085 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1085 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1041) send metrics for workunit creation time
[ https://issues.apache.org/jira/browse/GOBBLIN-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1041. --- Resolution: Fixed > send metrics for workunit creation time > --- > > Key: GOBBLIN-1041 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1041 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-958) make hive flow edge accept multiple tables
[ https://issues.apache.org/jira/browse/GOBBLIN-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-958. -- Resolution: Fixed > make hive flow edge accept multiple tables > -- > > Key: GOBBLIN-958 > URL: https://issues.apache.org/jira/browse/GOBBLIN-958 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1082) compile a flow before storing it in spec catalog
[ https://issues.apache.org/jira/browse/GOBBLIN-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1082. --- Resolution: Fixed > compile a flow before storing it in spec catalog > > > Key: GOBBLIN-1082 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1082 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-948) add hive data node and hive descriptor for gobblin service
[ https://issues.apache.org/jira/browse/GOBBLIN-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-948. -- Resolution: Fixed > add hive data node and hive descriptor for gobblin service > -- > > Key: GOBBLIN-948 > URL: https://issues.apache.org/jira/browse/GOBBLIN-948 > Project: Apache Gobblin > Issue Type: New Feature >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1027) monitor number of jobs submitted by users
[ https://issues.apache.org/jira/browse/GOBBLIN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1027. --- Resolution: Fixed > monitor number of jobs submitted by users > - > > Key: GOBBLIN-1027 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1027 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 2h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1035) make hive dataset descriptor accepts regexed db and tables
[ https://issues.apache.org/jira/browse/GOBBLIN-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1035. --- Resolution: Fixed > make hive dataset descriptor accepts regexed db and tables > -- > > Key: GOBBLIN-1035 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1035 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 2h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1063) add some more info to logs
[ https://issues.apache.org/jira/browse/GOBBLIN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1063. --- Resolution: Fixed > add some more info to logs > -- > > Key: GOBBLIN-1063 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1063 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-922) fix start sla time unit conversion issue
[ https://issues.apache.org/jira/browse/GOBBLIN-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-922. -- Resolution: Fixed > fix start sla time unit conversion issue > > > Key: GOBBLIN-922 > URL: https://issues.apache.org/jira/browse/GOBBLIN-922 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-914) accept more tracking event in gobblin service job status monitor
[ https://issues.apache.org/jira/browse/GOBBLIN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-914. -- Resolution: Fixed > accept more tracking event in gobblin service job status monitor > > > Key: GOBBLIN-914 > URL: https://issues.apache.org/jira/browse/GOBBLIN-914 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-917) gaas jobs not able to report status should be killed after some time
[ https://issues.apache.org/jira/browse/GOBBLIN-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-917. -- Resolution: Fixed > gaas jobs not able to report status should be killed after some time > > > Key: GOBBLIN-917 > URL: https://issues.apache.org/jira/browse/GOBBLIN-917 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-919) fix bad import
[ https://issues.apache.org/jira/browse/GOBBLIN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-919. -- Resolution: Fixed > fix bad import > -- > > Key: GOBBLIN-919 > URL: https://issues.apache.org/jira/browse/GOBBLIN-919 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-892) fix a bug where we are setting/getting props in dataset state. it is not a supported operation.
[ https://issues.apache.org/jira/browse/GOBBLIN-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-892. -- Resolution: Fixed > fix a bug where we are setting/getting props in dataset state. it is not a > supported operation. > --- > > Key: GOBBLIN-892 > URL: https://issues.apache.org/jira/browse/GOBBLIN-892 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Assignee: Arjun Singh Bora >Priority: Major > Time Spent: 1h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-886) add callbak to kafka
[ https://issues.apache.org/jira/browse/GOBBLIN-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-886. -- Resolution: Fixed > add callbak to kafka > > > Key: GOBBLIN-886 > URL: https://issues.apache.org/jira/browse/GOBBLIN-886 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-864) add job error message in job state
[ https://issues.apache.org/jira/browse/GOBBLIN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-864. -- Resolution: Fixed > add job error message in job state > -- > > Key: GOBBLIN-864 > URL: https://issues.apache.org/jira/browse/GOBBLIN-864 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Minor > Time Spent: 1h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (GOBBLIN-892) fix a bug where we are setting/getting props in dataset state. it is not a supported operation.
[ https://issues.apache.org/jira/browse/GOBBLIN-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on GOBBLIN-892 started by Arjun Singh Bora. > fix a bug where we are setting/getting props in dataset state. it is not a > supported operation. > --- > > Key: GOBBLIN-892 > URL: https://issues.apache.org/jira/browse/GOBBLIN-892 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Assignee: Arjun Singh Bora >Priority: Major > Time Spent: 1h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-855) persist the dag after addSpec to spec producer
[ https://issues.apache.org/jira/browse/GOBBLIN-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-855. -- Resolution: Fixed > persist the dag after addSpec to spec producer > -- > > Key: GOBBLIN-855 > URL: https://issues.apache.org/jira/browse/GOBBLIN-855 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-847) add a flow level sla in gaas flows
[ https://issues.apache.org/jira/browse/GOBBLIN-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-847. -- Resolution: Fixed > add a flow level sla in gaas flows > -- > > Key: GOBBLIN-847 > URL: https://issues.apache.org/jira/browse/GOBBLIN-847 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 5.5h > Remaining Estimate: 0h > > add a flow level sla in gaas flows, because sometimes azkaban jobs may not > start and hence send any tracking event, or azkaban maybe down. in all those > cases, we might have to kill the job so we can start a new job -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-856) make job status monitor top level service
[ https://issues.apache.org/jira/browse/GOBBLIN-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-856. -- Resolution: Fixed > make job status monitor top level service > - > > Key: GOBBLIN-856 > URL: https://issues.apache.org/jira/browse/GOBBLIN-856 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-841) make some field public to de duplicate strings
[ https://issues.apache.org/jira/browse/GOBBLIN-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-841. -- Resolution: Fixed > make some field public to de duplicate strings > -- > > Key: GOBBLIN-841 > URL: https://issues.apache.org/jira/browse/GOBBLIN-841 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-840) avoid creating a flow execution id by both master and slave gaas
[ https://issues.apache.org/jira/browse/GOBBLIN-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-840. -- Resolution: Fixed > avoid creating a flow execution id by both master and slave gaas > > > Key: GOBBLIN-840 > URL: https://issues.apache.org/jira/browse/GOBBLIN-840 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-808) implement azkaban job cancellation in Gobblin Service
[ https://issues.apache.org/jira/browse/GOBBLIN-808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-808. -- Resolution: Fixed > implement azkaban job cancellation in Gobblin Service > - > > Key: GOBBLIN-808 > URL: https://issues.apache.org/jira/browse/GOBBLIN-808 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 8.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-837) refactor FlowConfigV2Client and FlowStatusClient to allow child classes modify respective RequestBuilders
[ https://issues.apache.org/jira/browse/GOBBLIN-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-837. -- Resolution: Fixed > refactor FlowConfigV2Client and FlowStatusClient to allow child classes > modify respective RequestBuilders > - > > Key: GOBBLIN-837 > URL: https://issues.apache.org/jira/browse/GOBBLIN-837 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > > so linkedin we can send requests to internal services whose name differ from > the open source service name -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-779) make job status retriever configurable
[ https://issues.apache.org/jira/browse/GOBBLIN-779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-779. -- Resolution: Fixed > make job status retriever configurable > -- > > Key: GOBBLIN-779 > URL: https://issues.apache.org/jira/browse/GOBBLIN-779 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-792) submit a GobblinTrackingEvent when jobs are compiled but not yet orchestrated
[ https://issues.apache.org/jira/browse/GOBBLIN-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-792. -- Resolution: Fixed > submit a GobblinTrackingEvent when jobs are compiled but not yet orchestrated > - > > Key: GOBBLIN-792 > URL: https://issues.apache.org/jira/browse/GOBBLIN-792 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-771) emit a few metrics for gobblin service
[ https://issues.apache.org/jira/browse/GOBBLIN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-771. -- Resolution: Fixed > emit a few metrics for gobblin service > -- > > Key: GOBBLIN-771 > URL: https://issues.apache.org/jira/browse/GOBBLIN-771 > Project: Apache Gobblin > Issue Type: Task >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-802) register Gauge in innerMetricsContext
[ https://issues.apache.org/jira/browse/GOBBLIN-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-802. -- Resolution: Fixed > register Gauge in innerMetricsContext > - > > Key: GOBBLIN-802 > URL: https://issues.apache.org/jira/browse/GOBBLIN-802 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-730) include job start and end time in GaaS job status
[ https://issues.apache.org/jira/browse/GOBBLIN-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-730. -- Resolution: Fixed > include job start and end time in GaaS job status > - > > Key: GOBBLIN-730 > URL: https://issues.apache.org/jira/browse/GOBBLIN-730 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1105) make MysqlJobStatusStateStore implements DatasetStateStore
[ https://issues.apache.org/jira/browse/GOBBLIN-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1105. --- Resolution: Fixed > make MysqlJobStatusStateStore implements DatasetStateStore > -- > > Key: GOBBLIN-1105 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1105 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 3h 10m > Remaining Estimate: 0h > > make MysqlJobStatusStateStore implements DatasetStateStore so that we can use > existing cleaners/dataset finders/version finders to clean job status -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1092) do not store explain flowConfig requests to spec catalog
[ https://issues.apache.org/jira/browse/GOBBLIN-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1092. --- Resolution: Fixed > do not store explain flowConfig requests to spec catalog > > > Key: GOBBLIN-1092 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1092 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1110) handle runtime exceptions in executeCancellation implementation of GobblinHelixJobLauncher
[ https://issues.apache.org/jira/browse/GOBBLIN-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1110. --- Resolution: Fixed > handle runtime exceptions in executeCancellation implementation of > GobblinHelixJobLauncher > --- > > Key: GOBBLIN-1110 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1110 > Project: Apache Gobblin > Issue Type: Task >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1109) partial rollback of PR#2836
[ https://issues.apache.org/jira/browse/GOBBLIN-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1109. --- Resolution: Fixed > partial rollback of PR#2836 > --- > > Key: GOBBLIN-1109 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1109 > Project: Apache Gobblin > Issue Type: Task >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1106) do not remove requester list from flow config
[ https://issues.apache.org/jira/browse/GOBBLIN-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1106. --- Resolution: Fixed > do not remove requester list from flow config > - > > Key: GOBBLIN-1106 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1106 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1141) provide an option for common configs in cluster
[ https://issues.apache.org/jira/browse/GOBBLIN-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1141. --- Resolution: Fixed > provide an option for common configs in cluster > --- > > Key: GOBBLIN-1141 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1141 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1150) change spec store table to use json type
[ https://issues.apache.org/jira/browse/GOBBLIN-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1150. --- Resolution: Fixed > change spec store table to use json type > > > Key: GOBBLIN-1150 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1150 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 2h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1152) HelixException in enabling helix instance
[ https://issues.apache.org/jira/browse/GOBBLIN-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1152. --- Resolution: Fixed > HelixException in enabling helix instance > - > > Key: GOBBLIN-1152 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1152 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > stacktrace of the error > [_] Handling new session, session id: 100281140780065, instance: > abora-xyz.com_1234, instanceTye: ADMINISTRATOR, cluster: > GobblinStandaloneClusterDev 2020/05/13 18:33:16.287 INFO [ZKHelixAdmin] > [Thread-28] [_] Enable instance abora-xyz.com_1234 in cluster > GobblinStandaloneClusterDev. 2020/05/13 18:33:25.368 ERROR > [GobblinTaskRunner] [Thread-28] [_] HelixManager failed to connect > org.apache.helix.HelixException: Cluster GobblinStandaloneClusterDev, > instance: abora-xyz.com_1234, instance config does not exist at > org.apache.helix.manager.zk.ZKHelixAdmin.enableSingleInstance(ZKHelixAdmin.java:1487) > at > org.apache.helix.manager.zk.ZKHelixAdmin.enableInstance(ZKHelixAdmin.java:236) > at > org.apache.gobblin.cluster.GobblinTaskRunner.connectHelixManager(GobblinTaskRunner.java:372) > at > org.apache.gobblin.cluster.GobblinTaskRunner.start(GobblinTaskRunner.java:295) > at > com.linkedin.gobblin.offspring.GobblinClusterWorkerFactory$1.run(GobblinClusterWorkerFactory.java:81) > at java.lang.Thread.run(Thread.java:748) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1145) add table/partition path in serde props
[ https://issues.apache.org/jira/browse/GOBBLIN-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1145. --- Resolution: Fixed > add table/partition path in serde props > --- > > Key: GOBBLIN-1145 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1145 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1157) handle non string type config values
[ https://issues.apache.org/jira/browse/GOBBLIN-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1157. --- Resolution: Fixed > handle non string type config values > > > Key: GOBBLIN-1157 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1157 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1160) do not delete spec on compilation failures at startup
[ https://issues.apache.org/jira/browse/GOBBLIN-1160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1160. --- Resolution: Fixed > do not delete spec on compilation failures at startup > - > > Key: GOBBLIN-1160 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1160 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 2h 20m > Remaining Estimate: 0h > > do not delete spec on compilation failures at service startup, because git > flow graph and topology services might not have started yet. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1144) move spec store delete to gobblinservice job scheduler
[ https://issues.apache.org/jira/browse/GOBBLIN-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1144. --- Resolution: Fixed > move spec store delete to gobblinservice job scheduler > -- > > Key: GOBBLIN-1144 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1144 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1198) use DatasetCleanerTask to clean job status
[ https://issues.apache.org/jira/browse/GOBBLIN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1198. --- Resolution: Fixed > use DatasetCleanerTask to clean job status > -- > > Key: GOBBLIN-1198 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1198 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > use DatasetCleanerTask to clean job status, because the old way, using > StateStoreCleanerRunnable, is deprecated -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1168) create InstrumentedSpecStore
[ https://issues.apache.org/jira/browse/GOBBLIN-1168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1168. --- Resolution: Fixed > create InstrumentedSpecStore > > > Key: GOBBLIN-1168 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1168 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > > create InstrumentedSpecStore to add metrics in all SpecStore implementations -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1199) convert seconds to ms because helix api take time in ms
[ https://issues.apache.org/jira/browse/GOBBLIN-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1199. --- Resolution: Fixed > convert seconds to ms because helix api take time in ms > --- > > Key: GOBBLIN-1199 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1199 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1196) add support to search flow configs using multiple configs and other params
[ https://issues.apache.org/jira/browse/GOBBLIN-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1196. --- Resolution: Fixed > add support to search flow configs using multiple configs and other params > -- > > Key: GOBBLIN-1196 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1196 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1219) do not schedule a flow spec from a slave instance of GobblinServiceJobScheduler
[ https://issues.apache.org/jira/browse/GOBBLIN-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1219. --- Resolution: Fixed > do not schedule a flow spec from a slave instance of > GobblinServiceJobScheduler > --- > > Key: GOBBLIN-1219 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1219 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1220) reduce helix job initialization timeout from long.maxval to 5 minutes
[ https://issues.apache.org/jira/browse/GOBBLIN-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1220. --- Resolution: Fixed > reduce helix job initialization timeout from long.maxval to 5 minutes > - > > Key: GOBBLIN-1220 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1220 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1217) add a few map/reduce task related configs in building metric reporter
[ https://issues.apache.org/jira/browse/GOBBLIN-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1217. --- Resolution: Fixed > add a few map/reduce task related configs in building metric reporter > - > > Key: GOBBLIN-1217 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1217 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 1h 10m > Remaining Estimate: 0h > > one of the use case can be that each mapper/reducer's metrics can be analyzed > separately > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (GOBBLIN-1218) deserialize flow config properties using old method for backward compatibility
[ https://issues.apache.org/jira/browse/GOBBLIN-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora closed GOBBLIN-1218. - Resolution: Fixed > deserialize flow config properties using old method for backward compatibility > -- > > Key: GOBBLIN-1218 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1218 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (GOBBLIN-1218) deserialize flow config properties using old method for backward compatibility
[ https://issues.apache.org/jira/browse/GOBBLIN-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162418#comment-17162418 ] Arjun Singh Bora commented on GOBBLIN-1218: --- [https://github.com/apache/incubator-gobblin/commit/d208c0336a7d4e8e91b723ee7fc3bef6326aec21] > deserialize flow config properties using old method for backward compatibility > -- > > Key: GOBBLIN-1218 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1218 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1220) reduce helix job initialization timeout from long.maxval to 5 minutes
Arjun Singh Bora created GOBBLIN-1220: - Summary: reduce helix job initialization timeout from long.maxval to 5 minutes Key: GOBBLIN-1220 URL: https://issues.apache.org/jira/browse/GOBBLIN-1220 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1219) do not schedule a flow spec from a slave instance of GobblinServiceJobScheduler
Arjun Singh Bora created GOBBLIN-1219: - Summary: do not schedule a flow spec from a slave instance of GobblinServiceJobScheduler Key: GOBBLIN-1219 URL: https://issues.apache.org/jira/browse/GOBBLIN-1219 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1218) deserialize flow config properties using old method for backward compatibility
Arjun Singh Bora created GOBBLIN-1218: - Summary: deserialize flow config properties using old method for backward compatibility Key: GOBBLIN-1218 URL: https://issues.apache.org/jira/browse/GOBBLIN-1218 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1217) add a few map/reduce task related configs in building metric reporter
Arjun Singh Bora created GOBBLIN-1217: - Summary: add a few map/reduce task related configs in building metric reporter Key: GOBBLIN-1217 URL: https://issues.apache.org/jira/browse/GOBBLIN-1217 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora one of the use case can be that each mapper/reducer's metrics can be analyzed separately -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1199) convert seconds to ms because helix api take time in ms
Arjun Singh Bora created GOBBLIN-1199: - Summary: convert seconds to ms because helix api take time in ms Key: GOBBLIN-1199 URL: https://issues.apache.org/jira/browse/GOBBLIN-1199 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1196) add support to search flow configs using multiple configs and other params
Arjun Singh Bora created GOBBLIN-1196: - Summary: add support to search flow configs using multiple configs and other params Key: GOBBLIN-1196 URL: https://issues.apache.org/jira/browse/GOBBLIN-1196 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1198) use DatasetCleanerTask to clean job status
Arjun Singh Bora created GOBBLIN-1198: - Summary: use DatasetCleanerTask to clean job status Key: GOBBLIN-1198 URL: https://issues.apache.org/jira/browse/GOBBLIN-1198 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora use DatasetCleanerTask to clean job status, because the old way, using StateStoreCleanerRunnable, is deprecated -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1187) cancel a gaas flow when the dag manager is disabled
Arjun Singh Bora created GOBBLIN-1187: - Summary: cancel a gaas flow when the dag manager is disabled Key: GOBBLIN-1187 URL: https://issues.apache.org/jira/browse/GOBBLIN-1187 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1168) create InstrumentedSpecStore
Arjun Singh Bora created GOBBLIN-1168: - Summary: create InstrumentedSpecStore Key: GOBBLIN-1168 URL: https://issues.apache.org/jira/browse/GOBBLIN-1168 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora create InstrumentedSpecStore to add metrics in all SpecStore implementations -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1160) do not delete spec on compilation failures at startup
Arjun Singh Bora created GOBBLIN-1160: - Summary: do not delete spec on compilation failures at startup Key: GOBBLIN-1160 URL: https://issues.apache.org/jira/browse/GOBBLIN-1160 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora do not delete spec on compilation failures at service startup, because git flow graph and topology services might not have started yet. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1157) handle non string type config values
Arjun Singh Bora created GOBBLIN-1157: - Summary: handle non string type config values Key: GOBBLIN-1157 URL: https://issues.apache.org/jira/browse/GOBBLIN-1157 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GOBBLIN-1151) use gson in place of jackson for serialize/deserialize requester list in gobblin service
[ https://issues.apache.org/jira/browse/GOBBLIN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1151. --- Resolution: Fixed > use gson in place of jackson for serialize/deserialize requester list in > gobblin service > > > Key: GOBBLIN-1151 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1151 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > this will make the list readable -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (GOBBLIN-1151) use gson in place of jackson for serialize/deserialize requester list in gobblin service
[ https://issues.apache.org/jira/browse/GOBBLIN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108811#comment-17108811 ] Arjun Singh Bora commented on GOBBLIN-1151: --- closed with [https://github.com/apache/incubator-gobblin/commit/199210d12ccbd86c6f65742d825c79fe832f938c] > use gson in place of jackson for serialize/deserialize requester list in > gobblin service > > > Key: GOBBLIN-1151 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1151 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > this will make the list readable -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1151) use gson in place of jackson for serialize/deserialize requester list in gobblin service
Arjun Singh Bora created GOBBLIN-1151: - Summary: use gson in place of jackson for serialize/deserialize requester list in gobblin service Key: GOBBLIN-1151 URL: https://issues.apache.org/jira/browse/GOBBLIN-1151 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora this will make the list readable -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1150) change spec store table to use json type
Arjun Singh Bora created GOBBLIN-1150: - Summary: change spec store table to use json type Key: GOBBLIN-1150 URL: https://issues.apache.org/jira/browse/GOBBLIN-1150 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1145) add table/partition path in serde props
Arjun Singh Bora created GOBBLIN-1145: - Summary: add table/partition path in serde props Key: GOBBLIN-1145 URL: https://issues.apache.org/jira/browse/GOBBLIN-1145 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1144) move spec store delete to gobblinservice job scheduler
Arjun Singh Bora created GOBBLIN-1144: - Summary: move spec store delete to gobblinservice job scheduler Key: GOBBLIN-1144 URL: https://issues.apache.org/jira/browse/GOBBLIN-1144 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1141) provide an option for common configs in cluster
Arjun Singh Bora created GOBBLIN-1141: - Summary: provide an option for common configs in cluster Key: GOBBLIN-1141 URL: https://issues.apache.org/jira/browse/GOBBLIN-1141 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (GOBBLIN-1135) flow remove feature for spec executors when dag manager is not enabled
[ https://issues.apache.org/jira/browse/GOBBLIN-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora closed GOBBLIN-1135. - Resolution: Fixed > flow remove feature for spec executors when dag manager is not enabled > -- > > Key: GOBBLIN-1135 > URL: https://issues.apache.org/jira/browse/GOBBLIN-1135 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Arjun Singh Bora >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1135) flow remove feature for spec executors when dag manager is not enabled
Arjun Singh Bora created GOBBLIN-1135: - Summary: flow remove feature for spec executors when dag manager is not enabled Key: GOBBLIN-1135 URL: https://issues.apache.org/jira/browse/GOBBLIN-1135 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1132) move logic of requester list validation to RequesterService implementation
Arjun Singh Bora created GOBBLIN-1132: - Summary: move logic of requester list validation to RequesterService implementation Key: GOBBLIN-1132 URL: https://issues.apache.org/jira/browse/GOBBLIN-1132 Project: Apache Gobblin Issue Type: Task Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1110) handle runtime exceptions in executeCancellation implementation of GobblinHelixJobLauncher
Arjun Singh Bora created GOBBLIN-1110: - Summary: handle runtime exceptions in executeCancellation implementation of GobblinHelixJobLauncher Key: GOBBLIN-1110 URL: https://issues.apache.org/jira/browse/GOBBLIN-1110 Project: Apache Gobblin Issue Type: Task Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1109) partial rollback of PR#2836
Arjun Singh Bora created GOBBLIN-1109: - Summary: partial rollback of PR#2836 Key: GOBBLIN-1109 URL: https://issues.apache.org/jira/browse/GOBBLIN-1109 Project: Apache Gobblin Issue Type: Task Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1108) bump up mysql-connector
Arjun Singh Bora created GOBBLIN-1108: - Summary: bump up mysql-connector Key: GOBBLIN-1108 URL: https://issues.apache.org/jira/browse/GOBBLIN-1108 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1106) do not remove requester list from flow config
Arjun Singh Bora created GOBBLIN-1106: - Summary: do not remove requester list from flow config Key: GOBBLIN-1106 URL: https://issues.apache.org/jira/browse/GOBBLIN-1106 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1105) make MysqlJobStatusStateStore implements DatasetStateStore
Arjun Singh Bora created GOBBLIN-1105: - Summary: make MysqlJobStatusStateStore implements DatasetStateStore Key: GOBBLIN-1105 URL: https://issues.apache.org/jira/browse/GOBBLIN-1105 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora make MysqlJobStatusStateStore implements DatasetStateStore so that we can use existing cleaners/dataset finders/version finders to clean job status -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1092) do not store explain flowConfig requests to spec catalog
Arjun Singh Bora created GOBBLIN-1092: - Summary: do not store explain flowConfig requests to spec catalog Key: GOBBLIN-1092 URL: https://issues.apache.org/jira/browse/GOBBLIN-1092 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1090) distinguish compiled_skip from compiled_failed metrics
Arjun Singh Bora created GOBBLIN-1090: - Summary: distinguish compiled_skip from compiled_failed metrics Key: GOBBLIN-1090 URL: https://issues.apache.org/jira/browse/GOBBLIN-1090 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1086) update gaas job start timer using events coming from job execution
Arjun Singh Bora created GOBBLIN-1086: - Summary: update gaas job start timer using events coming from job execution Key: GOBBLIN-1086 URL: https://issues.apache.org/jira/browse/GOBBLIN-1086 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1085) fix compaction source initialization
Arjun Singh Bora created GOBBLIN-1085: - Summary: fix compaction source initialization Key: GOBBLIN-1085 URL: https://issues.apache.org/jira/browse/GOBBLIN-1085 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1082) compile a flow before storing it in spec catalog
Arjun Singh Bora created GOBBLIN-1082: - Summary: compile a flow before storing it in spec catalog Key: GOBBLIN-1082 URL: https://issues.apache.org/jira/browse/GOBBLIN-1082 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1079) use config extract.is.full
Arjun Singh Bora created GOBBLIN-1079: - Summary: use config extract.is.full Key: GOBBLIN-1079 URL: https://issues.apache.org/jira/browse/GOBBLIN-1079 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1063) add some more info to logs
Arjun Singh Bora created GOBBLIN-1063: - Summary: add some more info to logs Key: GOBBLIN-1063 URL: https://issues.apache.org/jira/browse/GOBBLIN-1063 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1041) send metrics for workunit creation time
Arjun Singh Bora created GOBBLIN-1041: - Summary: send metrics for workunit creation time Key: GOBBLIN-1041 URL: https://issues.apache.org/jira/browse/GOBBLIN-1041 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-1035) make hive dataset descriptor accepts regexed db and tables
Arjun Singh Bora created GOBBLIN-1035: - Summary: make hive dataset descriptor accepts regexed db and tables Key: GOBBLIN-1035 URL: https://issues.apache.org/jira/browse/GOBBLIN-1035 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-958) make hive flow edge accept multiple tables
Arjun Singh Bora created GOBBLIN-958: Summary: make hive flow edge accept multiple tables Key: GOBBLIN-958 URL: https://issues.apache.org/jira/browse/GOBBLIN-958 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-948) add hive data node and hive descriptor for gobblin service
Arjun Singh Bora created GOBBLIN-948: Summary: add hive data node and hive descriptor for gobblin service Key: GOBBLIN-948 URL: https://issues.apache.org/jira/browse/GOBBLIN-948 Project: Apache Gobblin Issue Type: New Feature Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-922) fix start sla time unit conversion issue
Arjun Singh Bora created GOBBLIN-922: Summary: fix start sla time unit conversion issue Key: GOBBLIN-922 URL: https://issues.apache.org/jira/browse/GOBBLIN-922 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-919) fix bad import
Arjun Singh Bora created GOBBLIN-919: Summary: fix bad import Key: GOBBLIN-919 URL: https://issues.apache.org/jira/browse/GOBBLIN-919 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-917) gaas jobs not able to report status should be killed after some time
Arjun Singh Bora created GOBBLIN-917: Summary: gaas jobs not able to report status should be killed after some time Key: GOBBLIN-917 URL: https://issues.apache.org/jira/browse/GOBBLIN-917 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-914) accept more tracking event in gobblin service job status monitor
Arjun Singh Bora created GOBBLIN-914: Summary: accept more tracking event in gobblin service job status monitor Key: GOBBLIN-914 URL: https://issues.apache.org/jira/browse/GOBBLIN-914 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-907) implement a StateCleanerSource to clean states (not dataset state or dataset)
Arjun Singh Bora created GOBBLIN-907: Summary: implement a StateCleanerSource to clean states (not dataset state or dataset) Key: GOBBLIN-907 URL: https://issues.apache.org/jira/browse/GOBBLIN-907 Project: Apache Gobblin Issue Type: New Feature Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-892) fix a bug where we are setting/getting props in dataset state. it is not a supported operation.
Arjun Singh Bora created GOBBLIN-892: Summary: fix a bug where we are setting/getting props in dataset state. it is not a supported operation. Key: GOBBLIN-892 URL: https://issues.apache.org/jira/browse/GOBBLIN-892 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-886) add callbak to kafka
Arjun Singh Bora created GOBBLIN-886: Summary: add callbak to kafka Key: GOBBLIN-886 URL: https://issues.apache.org/jira/browse/GOBBLIN-886 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GOBBLIN-871) make this.scheduledFlowSpecs a concurrent map
Arjun Singh Bora created GOBBLIN-871: Summary: make this.scheduledFlowSpecs a concurrent map Key: GOBBLIN-871 URL: https://issues.apache.org/jira/browse/GOBBLIN-871 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (GOBBLIN-864) add job error message in job state
Arjun Singh Bora created GOBBLIN-864: Summary: add job error message in job state Key: GOBBLIN-864 URL: https://issues.apache.org/jira/browse/GOBBLIN-864 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (GOBBLIN-856) make job status monitor top level service
Arjun Singh Bora created GOBBLIN-856: Summary: make job status monitor top level service Key: GOBBLIN-856 URL: https://issues.apache.org/jira/browse/GOBBLIN-856 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (GOBBLIN-855) persist the dag after addSpec to spec producer
Arjun Singh Bora created GOBBLIN-855: Summary: persist the dag after addSpec to spec producer Key: GOBBLIN-855 URL: https://issues.apache.org/jira/browse/GOBBLIN-855 Project: Apache Gobblin Issue Type: Bug Reporter: Arjun Singh Bora -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (GOBBLIN-847) add a flow level sla in gaas flows
Arjun Singh Bora created GOBBLIN-847: Summary: add a flow level sla in gaas flows Key: GOBBLIN-847 URL: https://issues.apache.org/jira/browse/GOBBLIN-847 Project: Apache Gobblin Issue Type: Improvement Reporter: Arjun Singh Bora add a flow level sla in gaas flows, because sometimes azkaban jobs may not start and hence send any tracking event, or azkaban maybe down. in all those cases, we might have to kill the job so we can start a new job -- This message was sent by Atlassian JIRA (v7.6.14#76016)
