Andre created FLUME-2829:
----------------------------
Summary: Taildir Source doesn't populate Filename
Key: FLUME-2829
URL: https://issues.apache.org/jira/browse/FLUME-2829
Project: Flume
Issue Type: Improvement
Components: Sinks+Sources
Affects Versions: v1.7.0
Reporter: Andre
JIRA issue FLUME-2498 mentions taildir source should be able to populate
Filename key in the header, however, this doesn't seem to be available yet.
Moreover, given the near certainty of taildir sources being used to tail
dynamic filenames such as {{$hostname-$year-$month-$day.log}} it would be great
to expose the regex groups to the generated headers in a fashion similar to the
Regex Extractor Interceptor:
{code}
a1.sources.r1.filegroups.f1 =
/path/to/my/logfile/([^-]+)-([^-]+)-([^-]+)-([^-]+).log
a1.sources.r1.filegroups.f1.regexgroups = s1 s2 s3 s4
a1.sources.r1.filegroups.f1.regexgroups.s1.header = hostname
a1.sources.r1.filegroups.f1.regexgroups.s2.header = year
a1.sources.r1.filegroups.f1.regexgroups.s3.header = month
a1.sources.r1.filegroups.f1.regexgroups.s4.header = day
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
