[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-10 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r486548053 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java ## @@ -77,6

[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-10 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r486535639 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@

[GitHub] [hadoop] goiri commented on a change in pull request #2296: HDFS-15568. namenode start failed to start when dfs.namenode.max.snapshot.limit set.

2020-09-10 Thread GitBox
goiri commented on a change in pull request #2296: URL: https://github.com/apache/hadoop/pull/2296#discussion_r486579348 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java ## @@ -508,6 +508,10 @@ FSNamesystem

[jira] [Work logged] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17244?focusedWorklogId=481541=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481541 ] ASF GitHub Bot logged work on HADOOP-17244: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #2280: HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-10 Thread GitBox
steveloughran merged pull request #2280: URL: https://github.com/apache/hadoop/pull/2280 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-10 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r486549682 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@

[GitHub] [hadoop] szetszwo commented on a change in pull request #2296: HDFS-15568. namenode start failed to start when dfs.namenode.max.snapshot.limit set.

2020-09-10 Thread GitBox
szetszwo commented on a change in pull request #2296: URL: https://github.com/apache/hadoop/pull/2296#discussion_r486594478 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/SnapshotManager.java ## @@ -448,22 +455,31

[GitHub] [hadoop] viirya opened a new pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
viirya opened a new pull request #2297: URL: https://github.com/apache/hadoop/pull/2297 See https://issues.apache.org/jira/browse/HADOOP-17125 for details. Offline discussed with @dbtsai and submitted this based on #2201.

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481670=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481670 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-10 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r486545111 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java ## @@ -77,6

[jira] [Resolved] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17244. - Fix Version/s: 3.3.1 Resolution: Fixed > HADOOP-17244. S3A directory delete

[jira] [Commented] (HADOOP-17254) Upgrade hbase to 1.4.13 on branch-2.10

2020-09-10 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193707#comment-17193707 ] Mingliang Liu commented on HADOOP-17254: +1 Thanks! > Upgrade hbase to 1.4.13 on branch-2.10

[GitHub] [hadoop] steveloughran commented on pull request #2280: HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-10 Thread GitBox
steveloughran commented on pull request #2280: URL: https://github.com/apache/hadoop/pull/2280#issuecomment-690402713 repeatedly tested against london with options showing the error and the -Dkeep option *and unguarded*. Some transient failures related to local network issues, addressed

[jira] [Work logged] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17244?focusedWorklogId=481539=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481539 ] ASF GitHub Bot logged work on HADOOP-17244: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r486686483 ## File path: hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/snappy/SnappyCompressor.c ## @@ -1,166 +0,0 @@ -/*

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481781=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481781 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] fengnanli commented on pull request #2266: HDFS-15554. RBF: force router check file existence in destinations before adding/updating mount points

2020-09-10 Thread GitBox
fengnanli commented on pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#issuecomment-690809794 The TestRouterRpcMultiDestination test passed locally. @goiri Can you help commit it? Thanks a lot! This is

[GitHub] [hadoop] dbtsai closed pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
dbtsai closed pull request #2201: URL: https://github.com/apache/hadoop/pull/2201 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] smengcl commented on a change in pull request #2258: HDFS-15539. When disallowing snapshot on a dir, throw exception if its trash root is not empty

2020-09-10 Thread GitBox
smengcl commented on a change in pull request #2258: URL: https://github.com/apache/hadoop/pull/2258#discussion_r486694935 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java ## @@ -2442,4 +2442,38 @@ public void

[GitHub] [hadoop] umamaheswararao opened a new pull request #2298: HDFS-15532: listFiles on root/InternalDir will fail if fallback root has file.

2020-09-10 Thread GitBox
umamaheswararao opened a new pull request #2298: URL: https://github.com/apache/hadoop/pull/2298 https://issues.apache.org/jira/browse/HDFS-15532 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2266: HDFS-15554. RBF: force router check file existence in destinations before adding/updating mount points

2020-09-10 Thread GitBox
hadoop-yetus commented on pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#issuecomment-690766821 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 33m

[jira] [Work logged] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?focusedWorklogId=481873=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481873 ] ASF GitHub Bot logged work on HADOOP-17222: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481778 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17254) Upgrade hbase to 1.4.13 on branch-2.10

2020-09-10 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17254: -- Fix Version/s: 2.10.1 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Work logged] (HADOOP-17254) Upgrade hbase to 1.4.13 on branch-2.10

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17254?focusedWorklogId=481797=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481797 ] ASF GitHub Bot logged work on HADOOP-17254: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims merged pull request #2290: HADOOP-17254. Upgrade hbase to 1.4.13 on branch-2.10.

2020-09-10 Thread GitBox
iwasakims merged pull request #2290: URL: https://github.com/apache/hadoop/pull/2290 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] liuml07 commented on pull request #2241: HADOOP-17222. Create socket address combined with URI cache

2020-09-10 Thread GitBox
liuml07 commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-690850909 I see `TestNameNodeRetryCacheMetrics.testRetryCacheMetrics` and ` TestMultipleNNPortQOP.testMultipleNNPortOverwriteDownStream` fail on my Linux machine with the patch. Will

[jira] [Work logged] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?focusedWorklogId=481876=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481876 ] ASF GitHub Bot logged work on HADOOP-17222: --- Author: ASF GitHub Bot

[GitHub] [hadoop] 1996fanrui commented on pull request #2241: HADOOP-17222. Create socket address combined with URI cache

2020-09-10 Thread GitBox
1996fanrui commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-690855787 > I see `TestNameNodeRetryCacheMetrics.testRetryCacheMetrics` and ` TestMultipleNNPortQOP.testMultipleNNPortOverwriteDownStream` fail on my Linux machine with the patch. Will

[GitHub] [hadoop] dbtsai commented on pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
dbtsai commented on pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#issuecomment-690780546 Closing this PR in favor of https://github.com/apache/hadoop/pull/2297 This is an automated message from the

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481776=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481776 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481775=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481775 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
hadoop-yetus commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-690812236 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481835=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481835 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17257) pid file delete when service stop (secure datanode ) show cat no directory

2020-09-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193954#comment-17193954 ] zhuqi commented on HADOOP-17257: cc [~boky01]  Yeah , but i am not the contributor of hadoop-common

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481753=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481753 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
hadoop-yetus commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-690765839 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] iwasakims commented on pull request #2290: HADOOP-17254. Upgrade hbase to 1.4.13 on branch-2.10.

2020-09-10 Thread GitBox
iwasakims commented on pull request #2290: URL: https://github.com/apache/hadoop/pull/2290#issuecomment-690791721 Thanks, @liuml07. I merged this. This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-17254) Upgrade hbase to 1.4.13 on branch-2.10

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17254?focusedWorklogId=481796=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481796 ] ASF GitHub Bot logged work on HADOOP-17254: --- Author: ASF GitHub Bot

[GitHub] [hadoop] YaYun-Wang commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-10 Thread GitBox
YaYun-Wang commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r486716810 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java ## @@ -77,6 +77,9 @@

[GitHub] [hadoop] YaYun-Wang commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-10 Thread GitBox
YaYun-Wang commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r486716471 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@

[GitHub] [hadoop] liuml07 commented on pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-10 Thread GitBox
liuml07 commented on pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#issuecomment-690839476 Will check again later this week. Ideally we can get a clean QA. Could you check the test failures and make sure they are not related? Thanks,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2258: HDFS-15539. When disallowing snapshot on a dir, throw exception if its trash root is not empty

2020-09-10 Thread GitBox
hadoop-yetus commented on pull request #2258: URL: https://github.com/apache/hadoop/pull/2258#issuecomment-690845948 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] dbtsai commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
dbtsai commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r486685241 ## File path: hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/snappy/SnappyCompressor.c ## @@ -1,166 +0,0 @@ -/*

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481779=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481779 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dbtsai commented on pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
dbtsai commented on pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#issuecomment-690781897 Thanks @viirya for taking over my https://github.com/apache/hadoop/pull/2201 , and continue working on it. This

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=481786=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481786 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #2297: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-10 Thread GitBox
viirya commented on a change in pull request #2297: URL: https://github.com/apache/hadoop/pull/2297#discussion_r486688702 ## File path: hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/io/compress/snappy/SnappyCompressor.c ## @@ -1,166 +0,0 @@ -/*

[GitHub] [hadoop] huangtianhua commented on pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-09-10 Thread GitBox
huangtianhua commented on pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#issuecomment-690829884 @liuml07 and @brahmareddybattula So if all of the codes are ok, would you please to approve? Thanks. This

[GitHub] [hadoop] smengcl commented on pull request #2258: HDFS-15539. When disallowing snapshot on a dir, throw exception if its trash root is not empty

2020-09-10 Thread GitBox
smengcl commented on pull request #2258: URL: https://github.com/apache/hadoop/pull/2258#issuecomment-690847462 > Thanks @smengcl for working on this,. The test failures like TestDistributedFileSystem#testGetTrashRoots look related. Can you plz verify? I'm checking. Probably need to

[GitHub] [hadoop] hemanthboyina commented on pull request #2267: HDFS-15555. RBF: Refresh cacheNS when SocketException occurs.

2020-09-10 Thread GitBox
hemanthboyina commented on pull request #2267: URL: https://github.com/apache/hadoop/pull/2267#issuecomment-690878265 any update here @aajisaka , as HDFS-15543 was modifying same part of code This is an automated message

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481883=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481883 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17222) Create socket address leveraging URI cache

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?focusedWorklogId=481898=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481898 ] ASF GitHub Bot logged work on HADOOP-17222: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17222) Create socket address leveraging URI cache

2020-09-10 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-17222: --- Summary: Create socket address leveraging URI cache (was: Create socket address combined

[GitHub] [hadoop] liuml07 commented on pull request #2241: HADOOP-17222. Create socket address combined with URI cache

2020-09-10 Thread GitBox
liuml07 commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-690885275 Failing tests are not related and all pass locally in my laptop except `TestNameNodeRetryCacheMetrics` which is known flaky see

[GitHub] [hadoop] umamaheswararao commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread GitBox
umamaheswararao commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-690863729 +1 on the latest patch. Thanks again for your great work @JohnZZGithub Test failures are unrelated. I think we are 3 line crossed for a warning. Looks like it's

[jira] [Updated] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HADOOP-15891: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481887 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] JohnZZGithub commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread GitBox
JohnZZGithub commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-690866308 @umamaheswararao Thanks a lot! This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?focusedWorklogId=481897=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481897 ] ASF GitHub Bot logged work on HADOOP-17222: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?focusedWorklogId=481896=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481896 ] ASF GitHub Bot logged work on HADOOP-17222: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17222) Create socket address leveraging URI cache

2020-09-10 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-17222: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop] liuml07 edited a comment on pull request #2241: HADOOP-17222. Create socket address combined with URI cache

2020-09-10 Thread GitBox
liuml07 edited a comment on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-690850909 I see `TestNameNodeRetryCacheMetrics.testRetryCacheMetrics` and ` TestMultipleNNPortQOP.testMultipleNNPortOverwriteDownStream` fail on my Linux machine with the patch.

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481885=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481885 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] umamaheswararao merged pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread GitBox
umamaheswararao merged pull request #2185: URL: https://github.com/apache/hadoop/pull/2185 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] aajisaka commented on pull request #2267: HDFS-15555. RBF: Refresh cacheNS when SocketException occurs.

2020-09-10 Thread GitBox
aajisaka commented on pull request #2267: URL: https://github.com/apache/hadoop/pull/2267#issuecomment-690880934 HI @hemanthboyina I don't have any updates here. This is an automated message from the Apache Git Service.

[GitHub] [hadoop] LeonGao91 opened a new pull request #2299: HDFS-15456. TestExternalStoragePolicySatisfier fails intermittently

2020-09-10 Thread GitBox
LeonGao91 opened a new pull request #2299: URL: https://github.com/apache/hadoop/pull/2299 One-liner fix of this UT. Ignore datanode load so block placement can successfully pick fallback storage type. This is an

[jira] [Updated] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread liuxiaolong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-17256: - Attachment: image-2020-09-10-17-45-16-998.png > DistCp -update option will be invalid when

[jira] [Resolved] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17256. - Resolution: Duplicate caused by HADOOP-8143, which has now been rolled back everywhere

[jira] [Work logged] (HADOOP-11452) Make FileSystem.rename(path, path, options) public, specified, tested

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11452?focusedWorklogId=481375=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481375 ] ASF GitHub Bot logged work on HADOOP-11452: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #743: HADOOP-11452 make rename/3 public

2020-09-10 Thread GitBox
hadoop-yetus removed a comment on pull request #743: URL: https://github.com/apache/hadoop/pull/743#issuecomment-685019888 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec |

[jira] [Work logged] (HADOOP-17253) Upgrade zookeeper to 3.4.14 on branch-2.10

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17253?focusedWorklogId=481376=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481376 ] ASF GitHub Bot logged work on HADOOP-17253: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2289: HADOOP-17253. Upgrade zookeeper to 3.4.14 on branch-2.10.

2020-09-10 Thread GitBox
steveloughran commented on pull request #2289: URL: https://github.com/apache/hadoop/pull/2289#issuecomment-690175258 LGTM +1 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=481381=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481381 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=481382=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481382 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-10 Thread GitBox
hadoop-yetus removed a comment on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-687718737 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] steveloughran commented on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-10 Thread GitBox
steveloughran commented on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-690188077 Happy with all the changes. Still unsure about the full implications. Can I still run "mvn verify" at the command line and individual tests in the IDE? + @mehakmeet

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=481386=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481386 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17253) Upgrade zookeeper to 3.4.14 on branch-2.10

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17253?focusedWorklogId=481394=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481394 ] ASF GitHub Bot logged work on HADOOP-17253: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims commented on pull request #2289: HADOOP-17253. Upgrade zookeeper to 3.4.14 on branch-2.10.

2020-09-10 Thread GitBox
iwasakims commented on pull request #2289: URL: https://github.com/apache/hadoop/pull/2289#issuecomment-690200705 Thanks, @steveloughran. I merged this. This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread liuxiaolong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193566#comment-17193566 ] liuxiaolong commented on HADOOP-17256: -- Thanks, I try to roll back HADOOP-8143,  it's ok now

[jira] [Updated] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread liuxiaolong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-17256: - Attachment: image-2020-09-10-17-33-50-505.png > DistCp -update option will be invalid when

[jira] [Updated] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread liuxiaolong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-17256: - Attachment: image-2020-09-10-17-52-32-290.png > DistCp -update option will be invalid when

[GitHub] [hadoop] hadoop-yetus commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread GitBox
hadoop-yetus commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-690147488 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 28m

[GitHub] [hadoop] bshashikant commented on pull request #2295: HDFS-15563. Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a snapshottable dir

2020-09-10 Thread GitBox
bshashikant commented on pull request #2295: URL: https://github.com/apache/hadoop/pull/2295#issuecomment-690161198 Thanks @smengcl for the contribution. This is an automated message from the Apache Git Service. To respond

[jira] [Issue Comment Deleted] (HADOOP-9331) Hadoop crypto codec framework and crypto codec implementations

2020-09-10 Thread nikhil panchal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nikhil panchal updated HADOOP-9331: --- Comment: was deleted (was: Hello, I have ORC data stored in HDFS. I have one use case,

[jira] [Updated] (HADOOP-17253) Upgrade zookeeper to 3.4.14 on branch-2.10

2020-09-10 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17253: -- Fix Version/s: 2.10.1 Hadoop Flags: Reviewed Resolution: Fixed

[GitHub] [hadoop] hadoop-yetus commented on pull request #2296: HDFS-15568. namenode start failed to start when dfs.namenode.max.snapshot.limit set.

2020-09-10 Thread GitBox
hadoop-yetus commented on pull request #2296: URL: https://github.com/apache/hadoop/pull/2296#issuecomment-690215954 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 40m

[jira] [Updated] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread liuxiaolong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-17256: - Attachment: image-2020-09-10-19-48-38-574.png > DistCp -update option will be invalid when

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-10 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193563#comment-17193563 ] Masatake Iwasaki commented on HADOOP-16918: --- Thanks, [~symat]. Hadoop 3.3.0 and above already

[jira] [Commented] (HADOOP-13238) pid handling is failing on secure datanode

2020-09-10 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193575#comment-17193575 ] zhuqi commented on HADOOP-13238: cc [~boky01]  [~aw] If i can take it, recent i am using the new

[jira] [Updated] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread liuxiaolong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-17256: - Attachment: image-2020-09-10-17-25-46-354.png > DistCp -update option will be invalid when

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-10 Thread Mate Szalay-Beko (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193492#comment-17193492 ] Mate Szalay-Beko commented on HADOOP-16918: --- Hello guys! I'm missing the context here a

[jira] [Updated] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread liuxiaolong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-17256: - Attachment: image-2020-09-10-17-47-01-653.png > DistCp -update option will be invalid when

[jira] [Updated] (HADOOP-17256) DistCp -update option will be invalid when distcp files from hdfs to S3

2020-09-10 Thread liuxiaolong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaolong updated HADOOP-17256: - Description: We use distcp with -update option to copy a dir from hdfs to S3. When we run

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481364=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481364 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-9331) Hadoop crypto codec framework and crypto codec implementations

2020-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193549#comment-17193549 ] Steve Loughran commented on HADOOP-9331: bq. I have ORC data stored in HDFS. I have one use

[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

2020-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16872: Affects Version/s: 3.3.0 3.2.1 > Performance improvement when

[jira] [Updated] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

2020-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16872: Component/s: tools/distcp > Performance improvement when distcp files in large dir with

[jira] [Commented] (HADOOP-16872) Performance improvement when distcp files in large dir with -direct option

2020-09-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193548#comment-17193548 ] Steve Loughran commented on HADOOP-16872: - missed this. Could you submit it as a github PR, as

  1   2   >