[
https://issues.apache.org/jira/browse/CHUKWA-185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719007#action_12719007
]
Ari Rabkin commented on CHUKWA-185:
-----------------------------------
Proposal:
DirTailingAdaptor should take two parameters; a directory and an optional date.
It will periodically scan the directory and all subdirs, and then start
filetailing adaptors on any file modified since that date, if none is running.
Date defaults to the epoch.
Combined with CHUKWA-204, this will prevent adaptor count from rising without
bound, while still making it easy to snarf a whole directory tree.
I assume this is going into trunk, not 0.2?
> ability to tail a whole directory
> ---------------------------------
>
> Key: CHUKWA-185
> URL: https://issues.apache.org/jira/browse/CHUKWA-185
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Affects Versions: 0.1.2
> Reporter: Ari Rabkin
> Assignee: Ari Rabkin
>
> Right now, FileTailingAdaptors watch particular files. It'd be great to be
> able to watch a whole path: to say something like /var/logs/*, where new logs
> created in that directory get picked up.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
