[
https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221242#comment-15221242
]
Konstantin Shaposhnikov commented on HDFS-10234:
------------------------------------------------
Another way to make the job output more useful is to have separate counters for
copied files and directories. Currently even if a directory exists on target
COPY counter is incremented. So if I run distcp with -update option it still
reports large number in COPY counter even though the number of copied files is
0.
> DistCp log output should contain copied and deleted files and directories
> -------------------------------------------------------------------------
>
> Key: HDFS-10234
> URL: https://issues.apache.org/jira/browse/HDFS-10234
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: distcp
> Affects Versions: 2.7.1
> Reporter: Konstantin Shaposhnikov
> Assignee: Lin Yiqun
> Attachments: HDFS-10234.001.patch
>
>
> DistCp log output (specified via {{-log}} command line option) currently
> contains only skipped and failed (when failures are ignored via {{-i}}) files.
> It will be more useful if it also contains copied and deleted files and
> created directories.
> This should be fixed in
> https://github.com/apache/hadoop/blob/branch-2.7.1/hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyMapper.java
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
