[ 
https://issues.apache.org/jira/browse/FLUME-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949805#comment-14949805
 ] 

Hudson commented on FLUME-2781:
-------------------------------

UNSTABLE: Integrated in Flume-trunk-hbase-1 #129 (See 
[https://builds.apache.org/job/Flume-trunk-hbase-1/129/])
FLUME-2781. Kafka Channel with parseAsFlumeEvent=true should write data 
(hshreedharan: 
[http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=67ed62aa18df3675b68369d0d00c8f0dcbdfb970])
* 
flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java
* 
flume-ng-channels/flume-kafka-channel/src/test/java/org/apache/flume/channel/kafka/TestKafkaChannel.java


> A Kafka Channel defined as parseAsFlumeEvent=false cannot be correctly used 
> by a Flume source
> ---------------------------------------------------------------------------------------------
>
>                 Key: FLUME-2781
>                 URL: https://issues.apache.org/jira/browse/FLUME-2781
>             Project: Flume
>          Issue Type: Improvement
>    Affects Versions: v1.6.0
>            Reporter: Gonzalo Herreros
>            Assignee: Gonzalo Herreros
>              Labels: easyfix, patch
>         Attachments: FLUME-2781.patch
>
>
> When a Kafka channel is configured as parseAsFlumeEvent=false, the channel 
> will read events from the topic as text instead of serialized Avro Flume 
> events.
> This is useful so Flume can read from an existing Kafka topic, where other 
> Kafka clients publish as text.
> However, if you use a Flume source on that channel, it will still write the 
> events as Avro so it will create an inconsistency and those events will fail 
> to be read correctly.
> Also, this would allow a Flume source to write to a Kafka channel and any 
> Kafka subscriber to listen to Flume events passing through without binary 
> dependencies.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to