[GitHub] [hadoop] dhirajh opened a new pull request #1964: HDFS-15281: Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address

2020-04-18 Thread GitBox
dhirajh opened a new pull request #1964: HDFS-15281: Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address URL: https://github.com/apache/hadoop/pull/1964 Details of the issue is here: https://issues.apache.org/jira/browse/HDFS-15281 ## NOTICE Please create an

[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086690#comment-17086690 ] Hadoop QA commented on HADOOP-16959: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-18 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086669#comment-17086669 ] YangY commented on HADOOP-16959: Copy the dependencies of the Hadoop-cos into the ${project.build}/lib

[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-18 Thread YangY (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.005.patch > Resolve hadoop-cos dependency conflict >

[GitHub] [hadoop] goiri merged pull request #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-18 Thread GitBox
goiri merged pull request #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] goiri commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-18 Thread GitBox
goiri commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-615947142 Thanks @brfrn169 for the benchmark, I think this is safe enough. We've also been on this for a while so I guess

[jira] [Commented] (HADOOP-17000) [Test] Use Yetus 0.12.0 in precommit job

2020-04-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086635#comment-17086635 ] Hadoop QA commented on HADOOP-17000: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-17000) [Test] Use Yetus 0.12.0 in precommit job

2020-04-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086584#comment-17086584 ] Hadoop QA commented on HADOOP-17000: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-17000) [Test] Use Yetus 0.12.0 in precommit job

2020-04-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17000: --- Status: Patch Available (was: Open) Test patch to kick hadoop precommit job. > [Test]

[jira] [Updated] (HADOOP-17000) [Test] Use Yetus 0.12.0 in precommit job

2020-04-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17000: --- Attachment: HADOOP-17000.01.patch > [Test] Use Yetus 0.12.0 in precommit job >

[jira] [Created] (HADOOP-17000) [Test] Use Yetus 0.12.0 in precommit job

2020-04-18 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17000: -- Summary: [Test] Use Yetus 0.12.0 in precommit job Key: HADOOP-17000 URL: https://issues.apache.org/jira/browse/HADOOP-17000 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-16944) Use Yetus 0.12.0 in GitHub PR

2020-04-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16944: --- Summary: Use Yetus 0.12.0 in GitHub PR (was: Use Yetus 0.12.0-SNAPSHOT for precommit

[jira] [Commented] (HADOOP-16944) Use Yetus 0.12.0-SNAPSHOT for precommit jobs

2020-04-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086573#comment-17086573 ] Akira Ajisaka commented on HADOOP-16944: I'll cherry-pick this to the lower branches after

[jira] [Commented] (HADOOP-16944) Use Yetus 0.12.0-SNAPSHOT for precommit jobs

2020-04-18 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086566#comment-17086566 ] Hudson commented on HADOOP-16944: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18162 (See

[jira] [Commented] (HADOOP-16971) testFileContextResolveAfs creates dangling link and fails for subsequent runs

2020-04-18 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086564#comment-17086564 ] Ctest commented on HADOOP-16971: Yes, I pushed a patch that ensures the symlink will be deleted before

[jira] [Commented] (HADOOP-16944) Use Yetus 0.12.0-SNAPSHOT for precommit jobs

2020-04-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086552#comment-17086552 ] Akira Ajisaka commented on HADOOP-16944: Merged the PR into trunk. Thanks [~ayushtkn] for the

[jira] [Updated] (HADOOP-16944) Use Yetus 0.12.0-SNAPSHOT for precommit jobs

2020-04-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16944: --- Fix Version/s: 3.4.0 > Use Yetus 0.12.0-SNAPSHOT for precommit jobs >

[GitHub] [hadoop] aajisaka merged pull request #1917: HADOOP-16944. Use Yetus 0.12.0 in GitHub PR

2020-04-18 Thread GitBox
aajisaka merged pull request #1917: HADOOP-16944. Use Yetus 0.12.0 in GitHub PR URL: https://github.com/apache/hadoop/pull/1917 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] brfrn169 edited a comment on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-18 Thread GitBox
brfrn169 edited a comment on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-615893744 I did microbenchmarking with JMH. The microbenchmarking code is as follows:

[GitHub] [hadoop] brfrn169 commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log

2020-04-18 Thread GitBox
brfrn169 commented on issue #1954: HDFS-15217 Add more information to longest write/read lock held log URL: https://github.com/apache/hadoop/pull/1954#issuecomment-615893744 I did microbenchmarking with JMH. The code is as follows:

[jira] [Created] (HADOOP-16999) ABFS: Reuser DSAS fetched in ABFS Input and Output stream

2020-04-18 Thread Sneha Vijayarajan (Jira)
Sneha Vijayarajan created HADOOP-16999: -- Summary: ABFS: Reuser DSAS fetched in ABFS Input and Output stream Key: HADOOP-16999 URL: https://issues.apache.org/jira/browse/HADOOP-16999 Project:

[jira] [Updated] (HADOOP-16999) ABFS: Reuse DSAS fetched in ABFS Input and Output stream

2020-04-18 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-16999: --- Summary: ABFS: Reuse DSAS fetched in ABFS Input and Output stream (was: ABFS:

[jira] [Commented] (HADOOP-16647) Support OpenSSL 1.1.1 LTS

2020-04-18 Thread Luca Toscano (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086475#comment-17086475 ] Luca Toscano commented on HADOOP-16647: --- [~iwasakims] thanks a lot for the commit, I am wondering

[jira] [Deleted] (HADOOP-16996) ---

2020-04-18 Thread Gavin McDonald (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gavin McDonald deleted HADOOP-16996: > --- > --- > > Key: HADOOP-16996 > URL:

[jira] [Commented] (HADOOP-16971) testFileContextResolveAfs creates dangling link and fails for subsequent runs

2020-04-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086402#comment-17086402 ] Ayush Saxena commented on HADOOP-16971: --- bq. but it accidentally made the symlink into a

[jira] [Commented] (HADOOP-16977) in javaApi, UGI params should be overidden through FileSystem conf

2020-04-18 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086367#comment-17086367 ] Hongbing Wang commented on HADOOP-16977: Thank [~ste...@apache.org] , thank you for your

[jira] [Created] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

2020-04-18 Thread Anoop Sam John (Jira)
Anoop Sam John created HADOOP-16998: --- Summary: WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted Key: HADOOP-16998 URL:

[jira] [Commented] (HADOOP-13435) Add thread local mechanism for aggregating file system storage stats

2020-04-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086346#comment-17086346 ] Hadoop QA commented on HADOOP-13435: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HADOOP-13031) Rack-aware read bytes stats should be managed by HFDS specific StorageStatistics

2020-04-18 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-13031: -- Target Version/s: (was: 3.4.0) Assignee: (was: Mingliang Liu)

[jira] [Assigned] (HADOOP-13435) Add thread local mechanism for aggregating file system storage stats

2020-04-18 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-13435: -- Target Version/s: (was: 3.4.0) Affects Version/s: (was: 2.9.0)

[jira] [Assigned] (HADOOP-13032) Refactor FileSystem$Statistics to use StorageStatistics

2020-04-18 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-13032: -- Assignee: (was: Mingliang Liu) Un-assigning since I'm not working on this now.

[GitHub] [hadoop] liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers

2020-04-18 Thread GitBox
liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers URL: https://github.com/apache/hadoop/pull/1861#discussion_r410651379 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/DirectoryPolicyImpl.java

[GitHub] [hadoop] liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers

2020-04-18 Thread GitBox
liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers URL: https://github.com/apache/hadoop/pull/1861#discussion_r410645571 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ##

[GitHub] [hadoop] liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers

2020-04-18 Thread GitBox
liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers URL: https://github.com/apache/hadoop/pull/1861#discussion_r410640648 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/StatusProbeEnum.java

[GitHub] [hadoop] liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers

2020-04-18 Thread GitBox
liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers URL: https://github.com/apache/hadoop/pull/1861#discussion_r410635387 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ##

[GitHub] [hadoop] liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers

2020-04-18 Thread GitBox
liuml07 commented on a change in pull request #1861: HADOOP-13230. Optionally retain directory markers URL: https://github.com/apache/hadoop/pull/1861#discussion_r410650058 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ##