[jira] [Resolved] (GOBBLIN-234) Add a ControlMessageInjector that generates metadata update control messages

2017-09-20 Thread Hung Tran (JIRA)

 [ 
https://issues.apache.org/jira/browse/GOBBLIN-234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hung Tran resolved GOBBLIN-234.
---
Resolution: Fixed

Issue resolved by pull request #2107
[https://github.com/apache/incubator-gobblin/pull/2107]

> Add a ControlMessageInjector that generates metadata update control messages
> 
>
> Key: GOBBLIN-234
> URL: https://issues.apache.org/jira/browse/GOBBLIN-234
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Hung Tran
>Assignee: Hung Tran
>
> Some converters use the latest registered schema at the time of converter 
> initialization. This schema may change and the converter chain may need to be 
> updated. A control message can be used to update the converters and notify 
> writers of schema changes.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GOBBLIN-259) Support writing Kafka messages to db/table file path

2017-09-20 Thread Hung Tran (JIRA)

 [ 
https://issues.apache.org/jira/browse/GOBBLIN-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hung Tran resolved GOBBLIN-259.
---
Resolution: Fixed

Issue resolved by pull request #2111
[https://github.com/apache/incubator-gobblin/pull/2111]

> Support writing Kafka messages to db/table file path
> 
>
> Key: GOBBLIN-259
> URL: https://issues.apache.org/jira/browse/GOBBLIN-259
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Zhixiong Chen
>Assignee: Zhixiong Chen
>  Labels: Writer:HDFS
>
> - Add a new write file path type `DB_TABLE`, which writes records from an 
> `Extract` to folder /. 
> - A gobblin job which uses the `KafkSource` and `AvroHdfsDataWriter` will 
> write records to 'dbName/tableName' with the following configurations:
> {code:java}
> extract.namespace=dbName
> extract.table.name=tableName
> writer.file.path.type=db_table
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)