Ragu created FLUME-3238:
---------------------------
Summary: TailDir Source + Kafka Sink + Memory Channel - Couldn't
identify event source filename
Key: FLUME-3238
URL: https://issues.apache.org/jira/browse/FLUME-3238
Project: Flume
Issue Type: Question
Affects Versions: 1.8.0
Reporter: Ragu
Attachments: exmple1.log, exmple2.log, taildir_flume.conf.txt
I am using Taildir to consume my log event and send it to kafka sink for
further processing before its indexed to a table for any analytics.
The events received in kafka topic doesn't carry which file the event belongs
to and also couldn't trace back to the actual file the event really occurred.
i tried so many config attribute as per the documentation, but the output
doesnt change, it carries the raw event only to kafka topic.
Did anyone had similar requirement and able to achieve it?
As per the ticket# [https://issues.cloudera.org/browse/FLUME-258] they say its
resolved. But doesnt seem to be available in new versions.
I have included my sample config and input files, if anyone tried similar
implementation, please let me know how to achieve this.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
