[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0

2021-04-03 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314414#comment-17314414 ] Viraj Jasani commented on HADOOP-17612: --- Thanks for inputs [~ayushtkn] [~eolivelli]. Keeping an

[GitHub] [hadoop] virajjasani commented on pull request #2860: Test Pre-Commits.

2021-04-03 Thread GitBox
virajjasani commented on pull request #2860: URL: https://github.com/apache/hadoop/pull/2860#issuecomment-812976534 Thanks for this PR @ayushtkn . TestBlockRecovery is consistently failing and fix in-progress here: #2844 Let me see if I can also take up some other flakies or

[jira] [Work logged] (HADOOP-17619) Fix DelegationTokenRenewer#updateRenewalTime java doc error.

2021-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17619?focusedWorklogId=576524=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-576524 ] ASF GitHub Bot logged work on HADOOP-17619: --- Author: ASF GitHub Bot

[GitHub] [hadoop] qizhu-lucas commented on a change in pull request #2846: HADOOP-17619: Fix DelegationTokenRenewer#updateRenewalTime java doc e…

2021-04-03 Thread GitBox
qizhu-lucas commented on a change in pull request #2846: URL: https://github.com/apache/hadoop/pull/2846#discussion_r606750017 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegationTokenRenewer.java ## @@ -107,7 +107,7 @@ public

[GitHub] [hadoop] virajjasani commented on a change in pull request #2844: HDFS-15940. Fixing and refactoring tests specific to Block recovery

2021-04-03 Thread GitBox
virajjasani commented on a change in pull request #2844: URL: https://github.com/apache/hadoop/pull/2844#discussion_r606748973 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery2.java ## @@ -0,0 +1,464 @@ +/* +

[GitHub] [hadoop] qizhu-lucas commented on pull request #2829: HDFS-15930: Fix some @param errors in DirectoryScanner.

2021-04-03 Thread GitBox
qizhu-lucas commented on pull request #2829: URL: https://github.com/apache/hadoop/pull/2829#issuecomment-812964703 Thanks @ayushtkn for commit and review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] hadoop-yetus commented on pull request #2860: Test Pre-Commits.

2021-04-03 Thread GitBox
hadoop-yetus commented on pull request #2860: URL: https://github.com/apache/hadoop/pull/2860#issuecomment-812963302 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-16206) Migrate from Log4j1 to Log4j2

2021-04-03 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314385#comment-17314385 ] Duo Zhang commented on HADOOP-16206: [~ahussein] So you suggest we do a benchmark first to get a

[jira] [Commented] (HADOOP-17612) Bump default Zookeeper version to 3.7.0

2021-04-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314362#comment-17314362 ] Ayush Saxena commented on HADOOP-17612: --- bq. The best we can do as of this point is bump up

[jira] [Work logged] (HADOOP-17619) Fix DelegationTokenRenewer#updateRenewalTime java doc error.

2021-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17619?focusedWorklogId=576501=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-576501 ] ASF GitHub Bot logged work on HADOOP-17619: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2846: HADOOP-17619: Fix DelegationTokenRenewer#updateRenewalTime java doc e…

2021-04-03 Thread GitBox
ayushtkn commented on a change in pull request #2846: URL: https://github.com/apache/hadoop/pull/2846#discussion_r606714993 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/DelegationTokenRenewer.java ## @@ -107,7 +107,7 @@ public boolean

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2833: HDFS-15934: Make DirectoryScanner reconcile blocks batch size and int…

2021-04-03 Thread GitBox
ayushtkn commented on a change in pull request #2833: URL: https://github.com/apache/hadoop/pull/2833#discussion_r606714508 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml ## @@ -873,6 +873,22 @@ + +

[GitHub] [hadoop] ayushtkn commented on pull request #2829: HDFS-15930: Fix some @param errors in DirectoryScanner.

2021-04-03 Thread GitBox
ayushtkn commented on pull request #2829: URL: https://github.com/apache/hadoop/pull/2829#issuecomment-812929534 Thanx @qizhu-lucas for the contribution, @Hexiaoqiao for the review. @qizhu-lucas, I missed your message, sorry. -- This is an automated message from the Apache Git

[GitHub] [hadoop] ayushtkn merged pull request #2829: HDFS-15930: Fix some @param errors in DirectoryScanner.

2021-04-03 Thread GitBox
ayushtkn merged pull request #2829: URL: https://github.com/apache/hadoop/pull/2829 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2844: HDFS-15940. Fixing and refactoring tests specific to Block recovery

2021-04-03 Thread GitBox
ayushtkn commented on a change in pull request #2844: URL: https://github.com/apache/hadoop/pull/2844#discussion_r606712644 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockRecovery1.java ## @@ -336,191 +322,194 @@

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2831: HDFS-15920.Solve the problem that the value of SafeModeMonitor#RECHECK_INTERVAL can be configured.

2021-04-03 Thread GitBox
ayushtkn commented on a change in pull request #2831: URL: https://github.com/apache/hadoop/pull/2831#discussion_r606710952 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManagerSafeMode.java ## @@ -640,7 +644,18

[GitHub] [hadoop] hadoop-yetus commented on pull request #2860: Test Pre-Commits.

2021-04-03 Thread GitBox
hadoop-yetus commented on pull request #2860: URL: https://github.com/apache/hadoop/pull/2860#issuecomment-812922960 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] ayushtkn commented on pull request #2852: MAPREDUCE-7287. Distcp will delete exists file , If we use "--delete …

2021-04-03 Thread GitBox
ayushtkn commented on pull request #2852: URL: https://github.com/apache/hadoop/pull/2852#issuecomment-812918934 Apart from the checkstyle issue, changes LGTM. Removal of code shouldn't bother, it is used in ``validatePaths`` which won't break by passing the actual dest. In the

[GitHub] [hadoop] steveloughran commented on pull request #2852: MAPREDUCE-7287. Distcp will delete exists file , If we use "--delete …

2021-04-03 Thread GitBox
steveloughran commented on pull request #2852: URL: https://github.com/apache/hadoop/pull/2852#issuecomment-812887968 going to have to pull in people who know more of the distcp code to review this, in particular, someone needs to understand what the code being removed is meant to be

[jira] [Work logged] (HADOOP-17615) ADLFS: Update SDK version from 2.3.6 to 2.3.9

2021-04-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17615?focusedWorklogId=576435=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-576435 ] ASF GitHub Bot logged work on HADOOP-17615: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2842: HADOOP-17615. ADLS Gen1: Update adls SDK to 2.3.9

2021-04-03 Thread GitBox
steveloughran commented on pull request #2842: URL: https://github.com/apache/hadoop/pull/2842#issuecomment-812877682 what's causing the test failures? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] ayushtkn opened a new pull request #2860: Test Pre-Commits.

2021-04-03 Thread GitBox
ayushtkn opened a new pull request #2860: URL: https://github.com/apache/hadoop/pull/2860 Checking HDFS Pre-Commit builds, to get hold of the flaky tests. Please ignore for reviewing. If any fix is found for any test, please push directly to the PR, or drop a comment. -- This is

[GitHub] [hadoop] hadoop-yetus commented on pull request #2859: HDFS-15951. Remove unused parameters in NameNodeProxiesClient

2021-04-03 Thread GitBox
hadoop-yetus commented on pull request #2859: URL: https://github.com/apache/hadoop/pull/2859#issuecomment-812868839 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2856: HDFS-15947. Replace deprecated protobuf APIs

2021-04-03 Thread GitBox
hadoop-yetus commented on pull request #2856: URL: https://github.com/apache/hadoop/pull/2856#issuecomment-812863295 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [hadoop] tomscut opened a new pull request #2859: HDFS-15951. Remove unused parameters in NameNodeProxiesClient

2021-04-03 Thread GitBox
tomscut opened a new pull request #2859: URL: https://github.com/apache/hadoop/pull/2859 JIRA: [HDFS-15951](https://issues.apache.org/jira/browse/HDFS-15951) Remove unused parameters in org.apache.hadoop.hdfs.NameNodeProxiesClient. -- This is an automated message from the Apache

[GitHub] [hadoop] hadoop-yetus commented on pull request #1971: MAPREDUCE-7276 fix hadoop job fast fail not working issue

2021-04-03 Thread GitBox
hadoop-yetus commented on pull request #1971: URL: https://github.com/apache/hadoop/pull/1971#issuecomment-812846675 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2858: HDFS-15950. Remove unused hdfs.proto import

2021-04-03 Thread GitBox
hadoop-yetus commented on pull request #2858: URL: https://github.com/apache/hadoop/pull/2858#issuecomment-812842463 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2857: HDFS-15949. Fix integer overflow

2021-04-03 Thread GitBox
hadoop-yetus commented on pull request #2857: URL: https://github.com/apache/hadoop/pull/2857#issuecomment-812833238 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2858: HDFS-15950. Remove unused hdfs.proto import

2021-04-03 Thread GitBox
GauthamBanasandra commented on pull request #2858: URL: https://github.com/apache/hadoop/pull/2858#issuecomment-812832629 This PR fixes a warning reported in PR https://github.com/apache/hadoop/pull/2792. ``` inotify.proto:35:1: warning: Import hdfs.proto is unused. ``` --

[GitHub] [hadoop] GauthamBanasandra opened a new pull request #2858: HDFS-15950. Remove unused hdfs.proto import

2021-04-03 Thread GitBox
GauthamBanasandra opened a new pull request #2858: URL: https://github.com/apache/hadoop/pull/2858 * hdfs.proto is imported in inotify.proto and is unused. Thus, removing it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2857: HDFS-15949. Fix integer overflow

2021-04-03 Thread GitBox
GauthamBanasandra commented on pull request #2857: URL: https://github.com/apache/hadoop/pull/2857#issuecomment-812820177 We can observe that `Max int64_t + 1` and `Min int64_t` are equal. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2857: HDFS-15949. Fix integer overflow

2021-04-03 Thread GitBox
GauthamBanasandra commented on pull request #2857: URL: https://github.com/apache/hadoop/pull/2857#issuecomment-812820088 I was able to verify this change using the following standalone C++ program - ```cpp #include #include #include int main(int argc, char *argv[]) {

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2857: HDFS-15949. Fix integer overflow

2021-04-03 Thread GitBox
GauthamBanasandra commented on pull request #2857: URL: https://github.com/apache/hadoop/pull/2857#issuecomment-812819946 This PR fixes some warnings reported as part of https://github.com/apache/hadoop/pull/2792. ``` [ 63%] Building CXX object

[GitHub] [hadoop] GauthamBanasandra opened a new pull request #2857: HDFS-15949. Fix integer overflow

2021-04-03 Thread GitBox
GauthamBanasandra opened a new pull request #2857: URL: https://github.com/apache/hadoop/pull/2857 * There are some instance where the overflow is deliberately done in order to get the lower bound. This results in an overflow warning. * We fix this by using the min