[
https://issues.apache.org/jira/browse/FLUME-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inder SIngh updated FLUME-1097:
-------------------------------
Description:
As discussed on the flume threads we want to support adding/modifying headers
at flume agents through configuration.
Primary use-case as of now -
Use HDFSEventSink to publish data in paths like /flume-data/YYYY/mm/DD/HH/MM
wherein timestamp is of agent running HDFSEventSink.
What's not there today
-------------------------
1. headers are put by clientLIB and can't be added/modified in flight by agents.
was:
Folks,
i have a requirement to generate data at HDFS in format -
/flume/data/YYYY/MM/DD/HH/MN based on the arrival time-stamp of data at agent.
Current Support
---------------
1. HDFSEventSink uses the timestamp sent in the header. This may be good if you
want data produced time as path.
What would the best approach to plugin this support. Thoughts/Recommendations?
Summary: Support modification of event Headers through configuration
(was: Support destinationPath based on agent arrival time-stamp in
HDFSEventSink)
> Support modification of event Headers through configuration
> -----------------------------------------------------------
>
> Key: FLUME-1097
> URL: https://issues.apache.org/jira/browse/FLUME-1097
> Project: Flume
> Issue Type: New Feature
> Reporter: Inder SIngh
> Assignee: Inder SIngh
> Priority: Minor
>
> As discussed on the flume threads we want to support adding/modifying headers
> at flume agents through configuration.
> Primary use-case as of now -
> Use HDFSEventSink to publish data in paths like /flume-data/YYYY/mm/DD/HH/MM
> wherein timestamp is of agent running HDFSEventSink.
> What's not there today
> -------------------------
> 1. headers are put by clientLIB and can't be added/modified in flight by
> agents.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
