[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-16872: - Attachment: HADOOP-16872.001.patch > Performance improvement when distcp files in large dir

[jira] [Commented] (HADOOP-16869) mvn findbugs:findbugs fails

[ https://issues.apache.org/jira/browse/HADOOP-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039800#comment-17039800 ] Masatake Iwasaki commented on HADOOP-16869: --- I can reproduce the issue by using Maven 3.6.0.

[jira] [Created] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

liuxiaolong created HADOOP-16872: Summary: Performance improvement when distcp files in large dir with -direct option Key: HADOOP-16872 URL: https://issues.apache.org/jira/browse/HADOOP-16872

[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-16872: - Description: We use distcp with -direct option to copy a file between two large directories.

[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-16872: - Description: We use distcp with -direct option to copy a file between two large directories.

[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-16872: - Description: We use distcp with -direct option to copy a file between two large directories.

[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-16872: - Attachment: optimise before.png > Performance improvement when distcp files in large dir with

[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-16872: - Attachment: optimise after.png > Performance improvement when distcp files in large dir with

[GitHub] [hadoop] kihwal commented on a change in pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec…

kihwal commented on a change in pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec… URL: https://github.com/apache/hadoop/pull/1758#discussion_r381361709 ## File path:

[GitHub] [hadoop] kihwal commented on a change in pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec…

kihwal commented on a change in pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec… URL: https://github.com/apache/hadoop/pull/1758#discussion_r381340045 ## File path:

[GitHub] [hadoop] bgaborg commented on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries

bgaborg commented on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries URL: https://github.com/apache/hadoop/pull/1851#issuecomment-588209054 Added test and removed the violation fix method impl from subclasses.

[GitHub] [hadoop] hadoop-yetus commented on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries

hadoop-yetus commented on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries URL: https://github.com/apache/hadoop/pull/1851#issuecomment-588239207 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Comment Edited] (HADOOP-16206) Migrate from Log4j1 to Log4j2

[ https://issues.apache.org/jira/browse/HADOOP-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040136#comment-17040136 ] Sourabh Sarvotham Parkala edited comment on HADOOP-16206 at 2/19/20 3:02 PM:

[jira] [Commented] (HADOOP-16206) Migrate from Log4j1 to Log4j2

[ https://issues.apache.org/jira/browse/HADOOP-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040136#comment-17040136 ] Sourabh Sarvotham Parkala commented on HADOOP-16206: Request for the actual release

[GitHub] [hadoop] hadoop-yetus commented on issue #1839: HADOOP-16848. Refactoring: initial layering

hadoop-yetus commented on issue #1839: HADOOP-16848. Refactoring: initial layering URL: https://github.com/apache/hadoop/pull/1839#issuecomment-588225353 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-13980) S3Guard CLI: Add fsck check and fix commands

[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-13980: Summary: S3Guard CLI: Add fsck check and fix commands (was: S3Guard CLI: Add fsck check

[GitHub] [hadoop] sodonnel commented on a change in pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec…

sodonnel commented on a change in pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec… URL: https://github.com/apache/hadoop/pull/1758#discussion_r381356059 ## File path:

[GitHub] [hadoop] jojochuang commented on a change in pull request #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmd

jojochuang commented on a change in pull request #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#discussion_r381477751 ## File

[GitHub] [hadoop] hadoop-yetus commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

hadoop-yetus commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-588444854 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] mukund-thakur edited a comment on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

mukund-thakur edited a comment on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-588400930 > Two tests are failing. Will debug. Also will rebase from trunk and fix merge conflicts. Fixed

[GitHub] [hadoop] mukund-thakur commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

mukund-thakur commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-588400930 > Two tests are failing. Will debug. Also will rebase from trunk and fix merge conflicts. Fixed merge

[GitHub] [hadoop] jojochuang commented on a change in pull request #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmd

jojochuang commented on a change in pull request #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#discussion_r381478385 ## File

[GitHub] [hadoop] jojochuang commented on a change in pull request #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmd

jojochuang commented on a change in pull request #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#discussion_r381478346 ## File

[GitHub] [hadoop] hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-588473900 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-588482038 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Moved] (HADOOP-16874) For AzureNativeFS, when BlockCompaction is enabled, FileSystem.create(path).close() would throw exception.

[ https://issues.apache.org/jira/browse/HADOOP-16874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang moved HDFS-15183 to HADOOP-16874: - Component/s: (was: fs/azure)

[jira] [Commented] (HADOOP-16647) Support OpenSSL 1.1.1 LTS

[ https://issues.apache.org/jira/browse/HADOOP-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040320#comment-17040320 ] Luca Toscano commented on HADOOP-16647: --- Should 

[GitHub] [hadoop] mukund-thakur commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

mukund-thakur commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-588323865 Two tests are failing. Will debug. Also will rebase from trunk and fix merge conflicts. > [INFO] Running

[jira] [Commented] (HADOOP-16206) Migrate from Log4j1 to Log4j2

[ https://issues.apache.org/jira/browse/HADOOP-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040264#comment-17040264 ] Wei-Chiu Chuang commented on HADOOP-16206: -- Unless there's a big push for this, it is likely

[jira] [Commented] (HADOOP-16868) ipc.Server readAndProcess threw NullPointerException

[ https://issues.apache.org/jira/browse/HADOOP-16868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040332#comment-17040332 ] Tsz-wo Sze commented on HADOOP-16868: - [~weichiu], thanks a lot for the quick review and commit. >

[GitHub] [hadoop] hadoop-yetus commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

hadoop-yetus commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-588572835 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1854: Hadoop 16864: TEST - NOT FOR CHECKIN

hadoop-yetus commented on issue #1854: Hadoop 16864: TEST - NOT FOR CHECKIN URL: https://github.com/apache/hadoop/pull/1854#issuecomment-588580290 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:|

[jira] [Assigned] (HADOOP-16869) mvn findbugs:findbugs fails

[ https://issues.apache.org/jira/browse/HADOOP-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-16869: -- Assignee: Akira Ajisaka > mvn findbugs:findbugs fails > ---

[jira] [Updated] (HADOOP-16869) mvn findbugs:findbugs fails

[ https://issues.apache.org/jira/browse/HADOOP-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16869: --- Component/s: build > mvn findbugs:findbugs fails > --- > >

[jira] [Updated] (HADOOP-16869) mvn findbugs:findbugs fails

[ https://issues.apache.org/jira/browse/HADOOP-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16869: --- Status: Patch Available (was: Open) > mvn findbugs:findbugs fails >

[GitHub] [hadoop] aajisaka opened a new pull request #1855: HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure

aajisaka opened a new pull request #1855: HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure URL: https://github.com/apache/hadoop/pull/1855 JIRA: https://issues.apache.org/jira/browse/HADOOP-16869

[GitHub] [hadoop] hadoop-yetus commented on issue #1855: HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure

hadoop-yetus commented on issue #1855: HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure URL: https://github.com/apache/hadoop/pull/1855#issuecomment-588596493 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move et

hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#issuecomment-588542045 :broken_heart: **-1 overall**

[GitHub] [hadoop] snvijaya commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-588568589 @steveloughran @ThomasMarquardt - Have updated the review based on the recent suggestions form Thomas. Test results are as pasted above.

[GitHub] [hadoop] hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move et

hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#issuecomment-588509498 :broken_heart: **-1 overall**

[GitHub] [hadoop] snvijaya commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-588568283 With namespace enabled account (East US 2) `[INFO] Tests run: 52, Failures: 0, Errors: 0, Skipped: 0` `[WARNING] Tests run: 407,

[GitHub] [hadoop] hadoop-yetus commented on issue #1854: Hadoop 16864: TEST - NOT FOR CHECKIN

hadoop-yetus commented on issue #1854: Hadoop 16864: TEST - NOT FOR CHECKIN URL: https://github.com/apache/hadoop/pull/1854#issuecomment-588568391 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:|

[GitHub] [hadoop] snvijaya opened a new pull request #1854: Hadoop 16864: TEST - NOT FOR CHECKIN

snvijaya opened a new pull request #1854: Hadoop 16864: TEST - NOT FOR CHECKIN URL: https://github.com/apache/hadoop/pull/1854 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] hadoop-yetus commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

hadoop-yetus commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-588688524 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Resolved] (HADOOP-16864) ABFS: Test code with Delegation SAS generation logic

[ https://issues.apache.org/jira/browse/HADOOP-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan resolved HADOOP-16864. Release Note: Container SAS or DSAS or directory SAS will be handled alike in

[GitHub] [hadoop] hadoop-yetus commented on issue #1853: HADOOP-16873 - Upgrade to Apache ZooKeeper 3.5.7

hadoop-yetus commented on issue #1853: HADOOP-16873 - Upgrade to Apache ZooKeeper 3.5.7 URL: https://github.com/apache/hadoop/pull/1853#issuecomment-588155756 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16869) mvn findbugs:findbugs fails

[ https://issues.apache.org/jira/browse/HADOOP-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039896#comment-17039896 ] Tsuyoshi Ozawa commented on HADOOP-16869: - Marking this as a blocking issue of HADOOP-16866

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1839: HADOOP-16848. Refactoring: initial layering

hadoop-yetus removed a comment on issue #1839: HADOOP-16848. Refactoring: initial layering URL: https://github.com/apache/hadoop/pull/1839#issuecomment-583900610 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-16872: - Description: We use distcp with -direct option to copy a file between two large directories.

[jira] [Updated] (HADOOP-16873) Upgrade to Apache ZooKeeper 3.5.7

[ https://issues.apache.org/jira/browse/HADOOP-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norbert Kalmár updated HADOOP-16873: Description: Apache ZooKeeper 3.5.7 has been released, which contains some important

[GitHub] [hadoop] nkalmar opened a new pull request #1853: HADOOP-16873 - Upgrade to Apache ZooKeeper 3.5.7

nkalmar opened a new pull request #1853: HADOOP-16873 - Upgrade to Apache ZooKeeper 3.5.7 URL: https://github.com/apache/hadoop/pull/1853 Apache ZooKeeper 3.5.7 has been released, which contains some important fixes including third party CVE, possible split brain and data loss in some

[jira] [Assigned] (HADOOP-16873) Upgrade to Apache ZooKeeper 3.5.7

[ https://issues.apache.org/jira/browse/HADOOP-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norbert Kalmár reassigned HADOOP-16873: --- Assignee: Norbert Kalmár > Upgrade to Apache ZooKeeper 3.5.7 >

[jira] [Created] (HADOOP-16873) Upgrade to Apache ZooKeeper 3.5.7

Norbert Kalmár created HADOOP-16873: --- Summary: Upgrade to Apache ZooKeeper 3.5.7 Key: HADOOP-16873 URL: https://issues.apache.org/jira/browse/HADOOP-16873 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-16873) Upgrade to Apache ZooKeeper 3.5.7

[ https://issues.apache.org/jira/browse/HADOOP-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norbert Kalmár updated HADOOP-16873: Status: Patch Available (was: Open) > Upgrade to Apache ZooKeeper 3.5.7 >

[jira] [Commented] (HADOOP-16873) Upgrade to Apache ZooKeeper 3.5.7

[ https://issues.apache.org/jira/browse/HADOOP-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039853#comment-17039853 ] Norbert Kalmár commented on HADOOP-16873: - release notes: