[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841467#comment-16841467 ] Sahil Takiar commented on HADOOP-13600: --- No longer working on this, so marking as unassigned. >

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795343#comment-16795343 ] Hadoop QA commented on HADOOP-13600: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795337#comment-16795337 ] Steve Loughran commented on HADOOP-13600: - I'm reviewing this again. Nominally, the S3 transfer

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554959#comment-16554959 ] genericqa commented on HADOOP-13600: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324733#comment-16324733 ] genericqa commented on HADOOP-13600: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324725#comment-16324725 ] Steve Loughran commented on HADOOP-13600: - Not looked at this for a while, I'll try and take a

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166384#comment-16166384 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on the issue:

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165997#comment-16165997 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on the issue:

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165701#comment-16165701 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on the issue:

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165696#comment-16165696 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165698#comment-16165698 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165697#comment-16165697 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165695#comment-16165695 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165693#comment-16165693 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165694#comment-16165694 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165689#comment-16165689 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165690#comment-16165690 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164662#comment-16164662 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on the issue:

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164660#comment-16164660 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164658#comment-16164658 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164656#comment-16164656 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164657#comment-16164657 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164655#comment-16164655 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164651#comment-16164651 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164647#comment-16164647 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163364#comment-16163364 ] Hadoop QA commented on HADOOP-13600: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163348#comment-16163348 ] Sahil Takiar commented on HADOOP-13600: --- [~ste...@apache.org] thanks for taking a look! * Thanks

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160040#comment-16160040 ] Steve Loughran commented on HADOOP-13600: - Just had a quick look at things other than the core

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160038#comment-16160038 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160037#comment-16160037 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160033#comment-16160033 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160030#comment-16160030 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160028#comment-16160028 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160027#comment-16160027 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160024#comment-16160024 ] Steve Loughran commented on HADOOP-13600: - you don't need dynamo db account for the s3guard

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16159377#comment-16159377 ] Sahil Takiar commented on HADOOP-13600: --- Rebased this patch and made some bug fixes: * Details of

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754712#comment-15754712 ] ASF GitHub Bot commented on HADOOP-13600: - Github user thodemoor commented on a diff in the pull

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752159#comment-15752159 ] Sahil Takiar commented on HADOOP-13600: --- [~ste...@apache.org], [~thodemoor] Do you both have some

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752152#comment-15752152 ] ASF GitHub Bot commented on HADOOP-13600: - Github user sahilTakiar commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743379#comment-15743379 ] ASF GitHub Bot commented on HADOOP-13600: - Github user thodemoor commented on a diff in the pull

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15708259#comment-15708259 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran closed the pull request at:

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707670#comment-15707670 ] Sahil Takiar commented on HADOOP-13600: --- Sounds good Steve. I rebased the PR and created a

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706370#comment-15706370 ] Steve Loughran commented on HADOOP-13600: - sahil, unless you object, I'm assigning this to you;

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705228#comment-15705228 ] Steve Loughran commented on HADOOP-13600: - yeah, looking at my patch I'm not sure if there's

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704351#comment-15704351 ] Sahil Takiar commented on HADOOP-13600: --- Will take a look at HADOOP-13823 Addressed a few of the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702191#comment-15702191 ] Steve Loughran commented on HADOOP-13600: - @stakier -could you take a look at HADOOP-13823 and

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702187#comment-15702187 ] Steve Loughran commented on HADOOP-13600: - # S3A instrumentation should a gauge of pending copy

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702172#comment-15702172 ] ASF GitHub Bot commented on HADOOP-13600: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693551#comment-15693551 ] Steve Loughran commented on HADOOP-13600: - I've just stuck up my nov 10 patch as a PR too. Mine

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693525#comment-15693525 ] ASF GitHub Bot commented on HADOOP-13600: - GitHub user steveloughran opened a pull request:

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654993#comment-15654993 ] Sahil Takiar commented on HADOOP-13600: --- [~ste...@apache.org] I created a Pull Request:

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654967#comment-15654967 ] ASF GitHub Bot commented on HADOOP-13600: - GitHub user sahilTakiar opened a pull request:

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506465#comment-15506465 ] Steve Loughran commented on HADOOP-13600: - If we do this using the same thread pool as for block

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490020#comment-15490020 ] Steve Loughran commented on HADOOP-13600: - Rather than naively issuing the copy calls in the