[
https://issues.apache.org/jira/browse/CHUKWA-185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719671#action_12719671
]
Ari Rabkin commented on CHUKWA-185:
-----------------------------------
I had figured we'd solve the expiration problem in FTA, rather than here. We
already have CHUKWA-204 open for this. However, my patch does need to do
something with time windows to make sure it doesn't restart the adaptors after
they stop themselves. I'll fix that in the next version.
I'm happy to revisit the TerminatorThread mechanism, but again, that's an FTA
problem, and there's no need to solve that problem and this one at the same
time.
As to duplicate data. Once DirTailer starts a FileTailer, that FileTailer gets
checkpointed in the usual way. And exactly one tailer can get started for each
file. This patch shouldn't create any duplicate-data issues we didn't already
have.
> ability to tail a whole directory
> ---------------------------------
>
> Key: CHUKWA-185
> URL: https://issues.apache.org/jira/browse/CHUKWA-185
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: data collection
> Affects Versions: 0.1.2, 0.2.0
> Reporter: Ari Rabkin
> Assignee: Ari Rabkin
> Fix For: 0.3.0
>
> Attachments: CHUKWA-185.patch
>
>
> Right now, FileTailingAdaptors watch particular files. It'd be great to be
> able to watch a whole path: to say something like /var/logs/*, where new logs
> created in that directory get picked up.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
