[
https://issues.apache.org/jira/browse/MAPREDUCE-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800696#action_12800696
]
Amar Kamat commented on MAPREDUCE-1358:
---------------------------------------
Todd, I think as per the documentation, _Utils.OutputLogFilter()_ is supposed
to filter out job-log-dir under the job-output-dir as opposed to detect if the
path belongs to some log folder. The example given in the documentation is
{code}
Path[] fileList = FileUtil.stat2Paths(fs.listStatus(outDir, new
OutputFilesFilter()));
{code}
So, if passed a value _/foo/_logs/bar_ then it essentially means that _bar_ is
a directory in the job output folder _/foo/_logs/_.
> Utils.OutputLogFilter incorrectly filters for _logs
> ---------------------------------------------------
>
> Key: MAPREDUCE-1358
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1358
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: mapreduce-1358.txt
>
>
> OutputLogFilter checks if the path contains _logs. This would incorrectly
> filter out all contents of a directory called server_logs, for example.
> Instead it should check for a path component exactly equal to _logs
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
