[jira] [Resolved] (GOBBLIN-1090) distinguish compiled_skip from compiled_failed metrics

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1090. --- Resolution: Fixed > distinguish compiled_skip from compiled_failed metrics >

[jira] [Resolved] (GOBBLIN-1086) update gaas job start timer using events coming from job execution

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1086. --- Resolution: Fixed > update gaas job start timer using events coming from job

[jira] [Resolved] (GOBBLIN-1085) fix compaction source initialization

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1085. --- Resolution: Fixed > fix compaction source initialization >

[jira] [Resolved] (GOBBLIN-1041) send metrics for workunit creation time

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1041. --- Resolution: Fixed > send metrics for workunit creation time >

[jira] [Resolved] (GOBBLIN-958) make hive flow edge accept multiple tables

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-958. -- Resolution: Fixed > make hive flow edge accept multiple tables >

[jira] [Resolved] (GOBBLIN-1082) compile a flow before storing it in spec catalog

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1082. --- Resolution: Fixed > compile a flow before storing it in spec catalog >

[jira] [Resolved] (GOBBLIN-948) add hive data node and hive descriptor for gobblin service

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-948. -- Resolution: Fixed > add hive data node and hive descriptor for gobblin service >

[jira] [Resolved] (GOBBLIN-1027) monitor number of jobs submitted by users

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1027. --- Resolution: Fixed > monitor number of jobs submitted by users >

[jira] [Resolved] (GOBBLIN-1035) make hive dataset descriptor accepts regexed db and tables

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1035. --- Resolution: Fixed > make hive dataset descriptor accepts regexed db and tables >

[jira] [Resolved] (GOBBLIN-1063) add some more info to logs

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1063. --- Resolution: Fixed > add some more info to logs > -- > >

[jira] [Resolved] (GOBBLIN-922) fix start sla time unit conversion issue

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-922. -- Resolution: Fixed > fix start sla time unit conversion issue >

[jira] [Resolved] (GOBBLIN-914) accept more tracking event in gobblin service job status monitor

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-914. -- Resolution: Fixed > accept more tracking event in gobblin service job status monitor

[jira] [Resolved] (GOBBLIN-917) gaas jobs not able to report status should be killed after some time

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-917. -- Resolution: Fixed > gaas jobs not able to report status should be killed after some

[jira] [Resolved] (GOBBLIN-919) fix bad import

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-919. -- Resolution: Fixed > fix bad import > -- > > Key:

[jira] [Resolved] (GOBBLIN-892) fix a bug where we are setting/getting props in dataset state. it is not a supported operation.

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-892. -- Resolution: Fixed > fix a bug where we are setting/getting props in dataset state. it

[jira] [Resolved] (GOBBLIN-886) add callbak to kafka

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-886. -- Resolution: Fixed > add callbak to kafka > > >

[jira] [Resolved] (GOBBLIN-864) add job error message in job state

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-864. -- Resolution: Fixed > add job error message in job state >

[jira] [Work started] (GOBBLIN-892) fix a bug where we are setting/getting props in dataset state. it is not a supported operation.

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on GOBBLIN-892 started by Arjun Singh Bora. > fix a bug where we are setting/getting props in dataset state. it is

[jira] [Resolved] (GOBBLIN-855) persist the dag after addSpec to spec producer

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-855. -- Resolution: Fixed > persist the dag after addSpec to spec producer >

[jira] [Resolved] (GOBBLIN-847) add a flow level sla in gaas flows

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-847. -- Resolution: Fixed > add a flow level sla in gaas flows >

[jira] [Resolved] (GOBBLIN-856) make job status monitor top level service

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-856. -- Resolution: Fixed > make job status monitor top level service >

[jira] [Resolved] (GOBBLIN-841) make some field public to de duplicate strings

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-841. -- Resolution: Fixed > make some field public to de duplicate strings >

[jira] [Resolved] (GOBBLIN-840) avoid creating a flow execution id by both master and slave gaas

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-840. -- Resolution: Fixed > avoid creating a flow execution id by both master and slave gaas

[jira] [Resolved] (GOBBLIN-808) implement azkaban job cancellation in Gobblin Service

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-808. -- Resolution: Fixed > implement azkaban job cancellation in Gobblin Service >

[jira] [Resolved] (GOBBLIN-837) refactor FlowConfigV2Client and FlowStatusClient to allow child classes modify respective RequestBuilders

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-837. -- Resolution: Fixed > refactor FlowConfigV2Client and FlowStatusClient to allow child

[jira] [Resolved] (GOBBLIN-779) make job status retriever configurable

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-779. -- Resolution: Fixed > make job status retriever configurable >

[jira] [Resolved] (GOBBLIN-792) submit a GobblinTrackingEvent when jobs are compiled but not yet orchestrated

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-792. -- Resolution: Fixed > submit a GobblinTrackingEvent when jobs are compiled but not yet

[jira] [Resolved] (GOBBLIN-771) emit a few metrics for gobblin service

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-771. -- Resolution: Fixed > emit a few metrics for gobblin service >

[jira] [Resolved] (GOBBLIN-802) register Gauge in innerMetricsContext

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-802. -- Resolution: Fixed > register Gauge in innerMetricsContext >

[jira] [Resolved] (GOBBLIN-730) include job start and end time in GaaS job status

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-730. -- Resolution: Fixed > include job start and end time in GaaS job status >

[jira] [Resolved] (GOBBLIN-1105) make MysqlJobStatusStateStore implements DatasetStateStore

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1105. --- Resolution: Fixed > make MysqlJobStatusStateStore implements DatasetStateStore >

[jira] [Resolved] (GOBBLIN-1092) do not store explain flowConfig requests to spec catalog

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1092. --- Resolution: Fixed > do not store explain flowConfig requests to spec catalog >

[jira] [Resolved] (GOBBLIN-1110) handle runtime exceptions in executeCancellation implementation of GobblinHelixJobLauncher

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1110. --- Resolution: Fixed > handle runtime exceptions in executeCancellation

[jira] [Resolved] (GOBBLIN-1109) partial rollback of PR#2836

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1109. --- Resolution: Fixed > partial rollback of PR#2836 > --- > >

[jira] [Resolved] (GOBBLIN-1106) do not remove requester list from flow config

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1106. --- Resolution: Fixed > do not remove requester list from flow config >

[jira] [Resolved] (GOBBLIN-1141) provide an option for common configs in cluster

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1141. --- Resolution: Fixed > provide an option for common configs in cluster >

[jira] [Resolved] (GOBBLIN-1150) change spec store table to use json type

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1150. --- Resolution: Fixed > change spec store table to use json type >

[jira] [Resolved] (GOBBLIN-1152) HelixException in enabling helix instance

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1152. --- Resolution: Fixed > HelixException in enabling helix instance >

[jira] [Resolved] (GOBBLIN-1145) add table/partition path in serde props

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1145. --- Resolution: Fixed > add table/partition path in serde props >

[jira] [Resolved] (GOBBLIN-1157) handle non string type config values

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1157. --- Resolution: Fixed > handle non string type config values >

[jira] [Resolved] (GOBBLIN-1160) do not delete spec on compilation failures at startup

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1160. --- Resolution: Fixed > do not delete spec on compilation failures at startup >

[jira] [Resolved] (GOBBLIN-1144) move spec store delete to gobblinservice job scheduler

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1144. --- Resolution: Fixed > move spec store delete to gobblinservice job scheduler >

[jira] [Resolved] (GOBBLIN-1198) use DatasetCleanerTask to clean job status

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1198. --- Resolution: Fixed > use DatasetCleanerTask to clean job status >

[jira] [Resolved] (GOBBLIN-1168) create InstrumentedSpecStore

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1168. --- Resolution: Fixed > create InstrumentedSpecStore > >

[jira] [Resolved] (GOBBLIN-1199) convert seconds to ms because helix api take time in ms

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1199. --- Resolution: Fixed > convert seconds to ms because helix api take time in ms >

[jira] [Resolved] (GOBBLIN-1196) add support to search flow configs using multiple configs and other params

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1196. --- Resolution: Fixed > add support to search flow configs using multiple configs and

[jira] [Resolved] (GOBBLIN-1219) do not schedule a flow spec from a slave instance of GobblinServiceJobScheduler

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1219. --- Resolution: Fixed > do not schedule a flow spec from a slave instance of >

[jira] [Resolved] (GOBBLIN-1220) reduce helix job initialization timeout from long.maxval to 5 minutes

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1220. --- Resolution: Fixed > reduce helix job initialization timeout from long.maxval to 5

[jira] [Resolved] (GOBBLIN-1217) add a few map/reduce task related configs in building metric reporter

2020-07-24 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1217. --- Resolution: Fixed > add a few map/reduce task related configs in building metric

[jira] [Closed] (GOBBLIN-1218) deserialize flow config properties using old method for backward compatibility

2020-07-21 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora closed GOBBLIN-1218. - Resolution: Fixed > deserialize flow config properties using old method for backward

[jira] [Commented] (GOBBLIN-1218) deserialize flow config properties using old method for backward compatibility

2020-07-21 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162418#comment-17162418 ] Arjun Singh Bora commented on GOBBLIN-1218: ---

[jira] [Created] (GOBBLIN-1220) reduce helix job initialization timeout from long.maxval to 5 minutes

2020-07-21 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1220: - Summary: reduce helix job initialization timeout from long.maxval to 5 minutes Key: GOBBLIN-1220 URL: https://issues.apache.org/jira/browse/GOBBLIN-1220

[jira] [Created] (GOBBLIN-1219) do not schedule a flow spec from a slave instance of GobblinServiceJobScheduler

2020-07-21 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1219: - Summary: do not schedule a flow spec from a slave instance of GobblinServiceJobScheduler Key: GOBBLIN-1219 URL: https://issues.apache.org/jira/browse/GOBBLIN-1219

[jira] [Created] (GOBBLIN-1218) deserialize flow config properties using old method for backward compatibility

2020-07-21 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1218: - Summary: deserialize flow config properties using old method for backward compatibility Key: GOBBLIN-1218 URL: https://issues.apache.org/jira/browse/GOBBLIN-1218

[jira] [Created] (GOBBLIN-1217) add a few map/reduce task related configs in building metric reporter

2020-07-20 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1217: - Summary: add a few map/reduce task related configs in building metric reporter Key: GOBBLIN-1217 URL: https://issues.apache.org/jira/browse/GOBBLIN-1217

[jira] [Created] (GOBBLIN-1199) convert seconds to ms because helix api take time in ms

2020-06-16 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1199: - Summary: convert seconds to ms because helix api take time in ms Key: GOBBLIN-1199 URL: https://issues.apache.org/jira/browse/GOBBLIN-1199 Project: Apache

[jira] [Created] (GOBBLIN-1196) add support to search flow configs using multiple configs and other params

2020-06-16 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1196: - Summary: add support to search flow configs using multiple configs and other params Key: GOBBLIN-1196 URL: https://issues.apache.org/jira/browse/GOBBLIN-1196

[jira] [Created] (GOBBLIN-1198) use DatasetCleanerTask to clean job status

2020-06-16 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1198: - Summary: use DatasetCleanerTask to clean job status Key: GOBBLIN-1198 URL: https://issues.apache.org/jira/browse/GOBBLIN-1198 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-1187) cancel a gaas flow when the dag manager is disabled

2020-06-10 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1187: - Summary: cancel a gaas flow when the dag manager is disabled Key: GOBBLIN-1187 URL: https://issues.apache.org/jira/browse/GOBBLIN-1187 Project: Apache

[jira] [Created] (GOBBLIN-1168) create InstrumentedSpecStore

2020-05-29 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1168: - Summary: create InstrumentedSpecStore Key: GOBBLIN-1168 URL: https://issues.apache.org/jira/browse/GOBBLIN-1168 Project: Apache Gobblin Issue

[jira] [Created] (GOBBLIN-1160) do not delete spec on compilation failures at startup

2020-05-26 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1160: - Summary: do not delete spec on compilation failures at startup Key: GOBBLIN-1160 URL: https://issues.apache.org/jira/browse/GOBBLIN-1160 Project: Apache

[jira] [Created] (GOBBLIN-1157) handle non string type config values

2020-05-21 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1157: - Summary: handle non string type config values Key: GOBBLIN-1157 URL: https://issues.apache.org/jira/browse/GOBBLIN-1157 Project: Apache Gobblin

[jira] [Resolved] (GOBBLIN-1151) use gson in place of jackson for serialize/deserialize requester list in gobblin service

2020-05-15 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora resolved GOBBLIN-1151. --- Resolution: Fixed > use gson in place of jackson for serialize/deserialize

[jira] [Commented] (GOBBLIN-1151) use gson in place of jackson for serialize/deserialize requester list in gobblin service

2020-05-15 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108811#comment-17108811 ] Arjun Singh Bora commented on GOBBLIN-1151: --- closed with 

[jira] [Created] (GOBBLIN-1151) use gson in place of jackson for serialize/deserialize requester list in gobblin service

2020-05-15 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1151: - Summary: use gson in place of jackson for serialize/deserialize requester list in gobblin service Key: GOBBLIN-1151 URL:

[jira] [Created] (GOBBLIN-1150) change spec store table to use json type

2020-05-15 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1150: - Summary: change spec store table to use json type Key: GOBBLIN-1150 URL: https://issues.apache.org/jira/browse/GOBBLIN-1150 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-1145) add table/partition path in serde props

2020-05-08 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1145: - Summary: add table/partition path in serde props Key: GOBBLIN-1145 URL: https://issues.apache.org/jira/browse/GOBBLIN-1145 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-1144) move spec store delete to gobblinservice job scheduler

2020-05-06 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1144: - Summary: move spec store delete to gobblinservice job scheduler Key: GOBBLIN-1144 URL: https://issues.apache.org/jira/browse/GOBBLIN-1144 Project: Apache

[jira] [Created] (GOBBLIN-1141) provide an option for common configs in cluster

2020-05-02 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1141: - Summary: provide an option for common configs in cluster Key: GOBBLIN-1141 URL: https://issues.apache.org/jira/browse/GOBBLIN-1141 Project: Apache Gobblin

[jira] [Closed] (GOBBLIN-1135) flow remove feature for spec executors when dag manager is not enabled

2020-04-30 Thread Arjun Singh Bora (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Singh Bora closed GOBBLIN-1135. - Resolution: Fixed > flow remove feature for spec executors when dag manager is not

[jira] [Created] (GOBBLIN-1135) flow remove feature for spec executors when dag manager is not enabled

2020-04-30 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1135: - Summary: flow remove feature for spec executors when dag manager is not enabled Key: GOBBLIN-1135 URL: https://issues.apache.org/jira/browse/GOBBLIN-1135

[jira] [Created] (GOBBLIN-1132) move logic of requester list validation to RequesterService implementation

2020-04-27 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1132: - Summary: move logic of requester list validation to RequesterService implementation Key: GOBBLIN-1132 URL: https://issues.apache.org/jira/browse/GOBBLIN-1132

[jira] [Created] (GOBBLIN-1110) handle runtime exceptions in executeCancellation implementation of GobblinHelixJobLauncher

2020-04-06 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1110: - Summary: handle runtime exceptions in executeCancellation implementation of GobblinHelixJobLauncher Key: GOBBLIN-1110 URL:

[jira] [Created] (GOBBLIN-1109) partial rollback of PR#2836

2020-04-06 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1109: - Summary: partial rollback of PR#2836 Key: GOBBLIN-1109 URL: https://issues.apache.org/jira/browse/GOBBLIN-1109 Project: Apache Gobblin Issue Type:

[jira] [Created] (GOBBLIN-1108) bump up mysql-connector

2020-04-03 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1108: - Summary: bump up mysql-connector Key: GOBBLIN-1108 URL: https://issues.apache.org/jira/browse/GOBBLIN-1108 Project: Apache Gobblin Issue Type:

[jira] [Created] (GOBBLIN-1106) do not remove requester list from flow config

2020-04-01 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1106: - Summary: do not remove requester list from flow config Key: GOBBLIN-1106 URL: https://issues.apache.org/jira/browse/GOBBLIN-1106 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-1105) make MysqlJobStatusStateStore implements DatasetStateStore

2020-03-31 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1105: - Summary: make MysqlJobStatusStateStore implements DatasetStateStore Key: GOBBLIN-1105 URL: https://issues.apache.org/jira/browse/GOBBLIN-1105 Project:

[jira] [Created] (GOBBLIN-1092) do not store explain flowConfig requests to spec catalog

2020-03-19 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1092: - Summary: do not store explain flowConfig requests to spec catalog Key: GOBBLIN-1092 URL: https://issues.apache.org/jira/browse/GOBBLIN-1092 Project: Apache

[jira] [Created] (GOBBLIN-1090) distinguish compiled_skip from compiled_failed metrics

2020-03-18 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1090: - Summary: distinguish compiled_skip from compiled_failed metrics Key: GOBBLIN-1090 URL: https://issues.apache.org/jira/browse/GOBBLIN-1090 Project: Apache

[jira] [Created] (GOBBLIN-1086) update gaas job start timer using events coming from job execution

2020-03-16 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1086: - Summary: update gaas job start timer using events coming from job execution Key: GOBBLIN-1086 URL: https://issues.apache.org/jira/browse/GOBBLIN-1086

[jira] [Created] (GOBBLIN-1085) fix compaction source initialization

2020-03-12 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1085: - Summary: fix compaction source initialization Key: GOBBLIN-1085 URL: https://issues.apache.org/jira/browse/GOBBLIN-1085 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-1082) compile a flow before storing it in spec catalog

2020-03-11 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1082: - Summary: compile a flow before storing it in spec catalog Key: GOBBLIN-1082 URL: https://issues.apache.org/jira/browse/GOBBLIN-1082 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-1079) use config extract.is.full

2020-03-10 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1079: - Summary: use config extract.is.full Key: GOBBLIN-1079 URL: https://issues.apache.org/jira/browse/GOBBLIN-1079 Project: Apache Gobblin Issue Type:

[jira] [Created] (GOBBLIN-1063) add some more info to logs

2020-02-27 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1063: - Summary: add some more info to logs Key: GOBBLIN-1063 URL: https://issues.apache.org/jira/browse/GOBBLIN-1063 Project: Apache Gobblin Issue Type:

[jira] [Created] (GOBBLIN-1041) send metrics for workunit creation time

2020-02-05 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1041: - Summary: send metrics for workunit creation time Key: GOBBLIN-1041 URL: https://issues.apache.org/jira/browse/GOBBLIN-1041 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-1035) make hive dataset descriptor accepts regexed db and tables

2020-01-29 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-1035: - Summary: make hive dataset descriptor accepts regexed db and tables Key: GOBBLIN-1035 URL: https://issues.apache.org/jira/browse/GOBBLIN-1035 Project:

[jira] [Created] (GOBBLIN-958) make hive flow edge accept multiple tables

2019-11-12 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-958: Summary: make hive flow edge accept multiple tables Key: GOBBLIN-958 URL: https://issues.apache.org/jira/browse/GOBBLIN-958 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-948) add hive data node and hive descriptor for gobblin service

2019-11-05 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-948: Summary: add hive data node and hive descriptor for gobblin service Key: GOBBLIN-948 URL: https://issues.apache.org/jira/browse/GOBBLIN-948 Project: Apache

[jira] [Created] (GOBBLIN-922) fix start sla time unit conversion issue

2019-10-22 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-922: Summary: fix start sla time unit conversion issue Key: GOBBLIN-922 URL: https://issues.apache.org/jira/browse/GOBBLIN-922 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-919) fix bad import

2019-10-18 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-919: Summary: fix bad import Key: GOBBLIN-919 URL: https://issues.apache.org/jira/browse/GOBBLIN-919 Project: Apache Gobblin Issue Type: Bug

[jira] [Created] (GOBBLIN-917) gaas jobs not able to report status should be killed after some time

2019-10-17 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-917: Summary: gaas jobs not able to report status should be killed after some time Key: GOBBLIN-917 URL: https://issues.apache.org/jira/browse/GOBBLIN-917

[jira] [Created] (GOBBLIN-914) accept more tracking event in gobblin service job status monitor

2019-10-16 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-914: Summary: accept more tracking event in gobblin service job status monitor Key: GOBBLIN-914 URL: https://issues.apache.org/jira/browse/GOBBLIN-914 Project:

[jira] [Created] (GOBBLIN-907) implement a StateCleanerSource to clean states (not dataset state or dataset)

2019-10-11 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-907: Summary: implement a StateCleanerSource to clean states (not dataset state or dataset) Key: GOBBLIN-907 URL: https://issues.apache.org/jira/browse/GOBBLIN-907

[jira] [Created] (GOBBLIN-892) fix a bug where we are setting/getting props in dataset state. it is not a supported operation.

2019-10-01 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-892: Summary: fix a bug where we are setting/getting props in dataset state. it is not a supported operation. Key: GOBBLIN-892 URL:

[jira] [Created] (GOBBLIN-886) add callbak to kafka

2019-09-24 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-886: Summary: add callbak to kafka Key: GOBBLIN-886 URL: https://issues.apache.org/jira/browse/GOBBLIN-886 Project: Apache Gobblin Issue Type:

[jira] [Created] (GOBBLIN-871) make this.scheduledFlowSpecs a concurrent map

2019-09-06 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-871: Summary: make this.scheduledFlowSpecs a concurrent map Key: GOBBLIN-871 URL: https://issues.apache.org/jira/browse/GOBBLIN-871 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-864) add job error message in job state

2019-08-22 Thread Arjun Singh Bora (Jira)
Arjun Singh Bora created GOBBLIN-864: Summary: add job error message in job state Key: GOBBLIN-864 URL: https://issues.apache.org/jira/browse/GOBBLIN-864 Project: Apache Gobblin Issue

[jira] [Created] (GOBBLIN-856) make job status monitor top level service

2019-08-14 Thread Arjun Singh Bora (JIRA)
Arjun Singh Bora created GOBBLIN-856: Summary: make job status monitor top level service Key: GOBBLIN-856 URL: https://issues.apache.org/jira/browse/GOBBLIN-856 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-855) persist the dag after addSpec to spec producer

2019-08-13 Thread Arjun Singh Bora (JIRA)
Arjun Singh Bora created GOBBLIN-855: Summary: persist the dag after addSpec to spec producer Key: GOBBLIN-855 URL: https://issues.apache.org/jira/browse/GOBBLIN-855 Project: Apache Gobblin

[jira] [Created] (GOBBLIN-847) add a flow level sla in gaas flows

2019-08-08 Thread Arjun Singh Bora (JIRA)
Arjun Singh Bora created GOBBLIN-847: Summary: add a flow level sla in gaas flows Key: GOBBLIN-847 URL: https://issues.apache.org/jira/browse/GOBBLIN-847 Project: Apache Gobblin Issue

  1   2   >