[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400911#comment-16400911 ] Hudson commented on HADOOP-15209: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13845 (See

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400841#comment-16400841 ] Aaron Fabbri commented on HADOOP-15209: --- My testing all looked good. +1 from me. > DistCp to

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400261#comment-16400261 ] Steve Loughran commented on HADOOP-15209: - hmm. I can see the appeal but, hyphens and equals

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-15 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400153#comment-16400153 ] Ewan Higgs commented on HADOOP-15209: - {code:java} + * We do not rely on parent entries being added

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399897#comment-16399897 ] Aaron Fabbri commented on HADOOP-15209: --- Nice work here [~ste...@apache.org]. I did a quick

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397670#comment-16397670 ] Steve Loughran commented on HADOOP-15209: - Thanks for testing, you are set up nicely for those

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-13 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397153#comment-16397153 ] Ewan Higgs commented on HADOOP-15209: - I tried this out on a directory with 6995 files (a hadoop

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-09 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393591#comment-16393591 ] genericqa commented on HADOOP-15209: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393356#comment-16393356 ] Steve Loughran commented on HADOOP-15209: - Testing: local, s3a, adl, wasb IT tests, command line

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392729#comment-16392729 ] Steve Loughran commented on HADOOP-15209: - I cancelled because I want to simplify that retry

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392299#comment-16392299 ] Aaron Fabbri commented on HADOOP-15209: --- Noticed you just mentioned cancelling the patch,

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392038#comment-16392038 ] Aaron Fabbri commented on HADOOP-15209: --- I will try to review / test this today. > DistCp to

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391846#comment-16391846 ] Steve Loughran commented on HADOOP-15209: - yes, as jenkins never runs any of the store

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391647#comment-16391647 ] Íñigo Goiri commented on HADOOP-15209: -- The ADL related tests seem ignored

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391493#comment-16391493 ] Steve Loughran commented on HADOOP-15209: - FWIW, managed to fail distcp if you run it against an

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390359#comment-16390359 ] Steve Loughran commented on HADOOP-15209: - checkstyle are on method length and a line being 84

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388206#comment-16388206 ] genericqa commented on HADOOP-15209: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386777#comment-16386777 ] genericqa commented on HADOOP-15209: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386731#comment-16386731 ] Steve Loughran commented on HADOOP-15209: - + pull in HADOOP-8233, which skips the checksum check

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386708#comment-16386708 ] Steve Loughran commented on HADOOP-15209: - And manual distcp to s3 london of hadoop-auth

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-03-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386597#comment-16386597 ] Steve Loughran commented on HADOOP-15209: - Patch 005. * improve copycommitter logging *

[jira] [Commented] (HADOOP-15209) DistCp to eliminate needless deletion of files under already-deleted directories

2018-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379095#comment-16379095 ] Steve Loughran commented on HADOOP-15209: - FWIW, I just timed a (remote) delete of 8000 files