[
https://issues.apache.org/jira/browse/CHUKWA-185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719758#action_12719758
]
Ari Rabkin commented on CHUKWA-185:
-----------------------------------
What I was planning to do was this. DTA takes a time cut-off, and will not
stream files last modified before the cutoff. So if you specify the epoch, you
get everything. Whenever DTA does a scan of the directory, it updates that
cutoff to the time when the scan started. So for a file that isn't being
modified, DTA will start tailing it at most once.
Time windowing for shutdown should be addressed by CHUKWA-204.
It might be reasonable to build a command line tool or script that stops all
FTAs in a given subdirectory. There's no need for that to be coupled to this
patch in any way. But I think we should have real use cases before we hack on
it.
> ability to tail a whole directory
> ---------------------------------
>
> Key: CHUKWA-185
> URL: https://issues.apache.org/jira/browse/CHUKWA-185
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: data collection
> Affects Versions: 0.1.2, 0.2.0
> Reporter: Ari Rabkin
> Assignee: Ari Rabkin
> Fix For: 0.3.0
>
> Attachments: CHUKWA-185.patch
>
>
> Right now, FileTailingAdaptors watch particular files. It'd be great to be
> able to watch a whole path: to say something like /var/logs/*, where new logs
> created in that directory get picked up.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
