[jira] [Created] (GOBBLIN-198) Configuration to disable switching the Kafka topic's and Avro schema's names before registering schema
Jennifer Zheng created GOBBLIN-198: -- Summary: Configuration to disable switching the Kafka topic's and Avro schema's names before registering schema Key: GOBBLIN-198 URL: https://issues.apache.org/jira/browse/GOBBLIN-198 Project: Apache Gobblin Issue Type: Bug Reporter: Jennifer Zheng Currently, LiKafkaSchemaRegistry switches the Avro schema name with the Kafka topic name before registering the schema. However, this will result in an incorrectly named schema if the name of the schema stored in Kafka does not match the topic name. Add an optional Kafka Schema Registry Configuration Key to set if the names should be switched before registering the schema. If the configuration is set to false, then the names will not be switched. An additional parameter will also be added to the Post request for registering the schema to specify the Kafka topic name. This is due to Kafka using the Avro schema name by default to register the schema. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Closed] (GOBBLIN-185) Design for gobblin job level gracefully shutdown
[ https://issues.apache.org/jira/browse/GOBBLIN-185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhixiong Chen closed GOBBLIN-185. - Resolution: Fixed > Design for gobblin job level gracefully shutdown > > > Key: GOBBLIN-185 > URL: https://issues.apache.org/jira/browse/GOBBLIN-185 > Project: Apache Gobblin > Issue Type: Task >Reporter: Zhixiong Chen >Assignee: Zhixiong Chen > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (GOBBLIN-183) Gobblin data management copy empty directories
[ https://issues.apache.org/jira/browse/GOBBLIN-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhixiong Chen resolved GOBBLIN-183. --- Resolution: Fixed > Gobblin data management copy empty directories > -- > > Key: GOBBLIN-183 > URL: https://issues.apache.org/jira/browse/GOBBLIN-183 > Project: Apache Gobblin > Issue Type: Task >Reporter: Zhixiong Chen >Assignee: Zhixiong Chen > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GOBBLIN-197) Modify JDBCExtractor to support reading clob columns as strings
Jennifer Zheng created GOBBLIN-197: -- Summary: Modify JDBCExtractor to support reading clob columns as strings Key: GOBBLIN-197 URL: https://issues.apache.org/jira/browse/GOBBLIN-197 Project: Apache Gobblin Issue Type: Bug Reporter: Jennifer Zheng The current JDBCExtractor calls getString on a column in parseColumnAsString if it holds a clob, however this does not deserialize the clob into a readable string. Implement an improvement that checks if the column's type is a clob. If so, get the Clob object from the result set and extract the Clob object's string by using its member function, getSubString. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (GOBBLIN-195) Ability to switch Avro schema namespace switch before registering with Kafka Avro Schema registry
[ https://issues.apache.org/jira/browse/GOBBLIN-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hung Tran resolved GOBBLIN-195. --- Resolution: Fixed Issue resolved by pull request #2049 [https://github.com/apache/incubator-gobblin/pull/2049] > Ability to switch Avro schema namespace switch before registering with Kafka > Avro Schema registry > - > > Key: GOBBLIN-195 > URL: https://issues.apache.org/jira/browse/GOBBLIN-195 > Project: Apache Gobblin > Issue Type: Improvement >Reporter: Abhishek Tiwari >Assignee: Abhishek Tiwari > > Ability to switch Avro schema namespace switch before registering with Kafka > Avro Schema registry. This is useful when we want to maintain backward > compatibility with the schema registered in the registry since registry does > not allows for difference in namespace. > This however has no impact on write / read of actual Avro bytes for the event > because they are mapped back to the fields irrespective of namespace. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (GOBBLIN-186) Add support for using the Kerberos authentication plugin without a GobblinDriverInstance
[ https://issues.apache.org/jira/browse/GOBBLIN-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hung Tran resolved GOBBLIN-186. --- Resolution: Fixed Issue resolved by pull request #2041 [https://github.com/apache/incubator-gobblin/pull/2041] > Add support for using the Kerberos authentication plugin without a > GobblinDriverInstance > > > Key: GOBBLIN-186 > URL: https://issues.apache.org/jira/browse/GOBBLIN-186 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Hung Tran >Assignee: Hung Tran > > Instantiating the HadoopKerberosKeytabAuthenticationPlugin requires a > GobblinInstanceDriver. There are instances where a GobblinInstanceDriver is > not available. This plugin should be able to be instantiated with only > configuration. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GOBBLIN-196) Properties saved to JobState cannot be retrieved from DatasetState
Joel Baranick created GOBBLIN-196: - Summary: Properties saved to JobState cannot be retrieved from DatasetState Key: GOBBLIN-196 URL: https://issues.apache.org/jira/browse/GOBBLIN-196 Project: Apache Gobblin Issue Type: Bug Reporter: Joel Baranick In 0.6.0, properties could be saved to JobState and then retrieved from DatasetState via a `getProp()` call. From 0.9.0 on, properties can no longer be retrieved from DatasetState because `getProp()` (and other methods) have been overridden to throw `UnsupportedOperationException`.This is a backwards incompatible change and makes it hard for solutions to be developed on top of Gobblin that require state that is persisted across job runs. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (GOBBLIN-184) Call the flush method of CloseOnFlushWriterWrapper when a FlushControlMessage is received
[ https://issues.apache.org/jira/browse/GOBBLIN-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hung Tran resolved GOBBLIN-184. --- Resolution: Fixed Issue resolved by pull request #2040 [https://github.com/apache/incubator-gobblin/pull/2040] > Call the flush method of CloseOnFlushWriterWrapper when a FlushControlMessage > is received > - > > Key: GOBBLIN-184 > URL: https://issues.apache.org/jira/browse/GOBBLIN-184 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Hung Tran >Assignee: Hung Tran > > When the close on flush functionality is enabled, the > CloseOnFlushWriterWrapper's flush method should be invoked when a > FlushControlMessage is received. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (GOBBLIN-186) Add support for using the Kerberos authentication plugin without a GobblinDriverInstance
[ https://issues.apache.org/jira/browse/GOBBLIN-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari updated GOBBLIN-186: Sprint: Apache Gobblin 170807 > Add support for using the Kerberos authentication plugin without a > GobblinDriverInstance > > > Key: GOBBLIN-186 > URL: https://issues.apache.org/jira/browse/GOBBLIN-186 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Hung Tran >Assignee: Hung Tran > > Instantiating the HadoopKerberosKeytabAuthenticationPlugin requires a > GobblinInstanceDriver. There are instances where a GobblinInstanceDriver is > not available. This plugin should be able to be instantiated with only > configuration. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (GOBBLIN-193) AbstractAvroToOrcConverter throws NoObjectException when trying to fetch partition info from table when partition doesn't exist
[ https://issues.apache.org/jira/browse/GOBBLIN-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari updated GOBBLIN-193: Sprint: Apache Gobblin 170807 > AbstractAvroToOrcConverter throws NoObjectException when trying to fetch > partition info from table when partition doesn't exist > --- > > Key: GOBBLIN-193 > URL: https://issues.apache.org/jira/browse/GOBBLIN-193 > Project: Apache Gobblin > Issue Type: Bug >Reporter: Aditya Sharma >Assignee: Aditya Sharma > > AbstractAvroToOrcConverter is throwing NoSuchObjectException when trying to > get partition information from a table while partition doesn't exist. This > exception should be handled to avoid job from failing -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GOBBLIN-195) Ability to switch Avro schema namespace switch before registering with Kafka Avro Schema registry
Abhishek Tiwari created GOBBLIN-195: --- Summary: Ability to switch Avro schema namespace switch before registering with Kafka Avro Schema registry Key: GOBBLIN-195 URL: https://issues.apache.org/jira/browse/GOBBLIN-195 Project: Apache Gobblin Issue Type: Improvement Reporter: Abhishek Tiwari Assignee: Abhishek Tiwari Ability to switch Avro schema namespace switch before registering with Kafka Avro Schema registry. This is useful when we want to maintain backward compatibility with the schema registered in the registry since registry does not allows for difference in namespace. This however has no impact on write / read of actual Avro bytes for the event because they are mapped back to the fields irrespective of namespace. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
