[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115661#comment-17115661 ] Yang Yun commented on HDFS-15188: - Thanks [~ayushtkn] for the review. Updated to HDFS-15188.004.patch

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Status: Open (was: Patch Available) > Add option to set Write/Read timeout extension for different

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Attachment: HDFS-15188.004.patch Status: Patch Available (was: Open) > Add option to set

[jira] [Updated] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-24 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: HDFS-15346.002.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115611#comment-17115611 ] Lisheng Sun commented on HDFS-15373: the v01 patch LGFM. > Fix number of threads in

[jira] [Updated] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

2020-05-24 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15289: --- Summary: Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

[jira] [Updated] (HDFS-15289) Allow viewfs mounts with hdfs/HCFS scheme and centralized mount table

2020-05-24 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15289: --- Summary: Allow viewfs mounts with hdfs/HCFS scheme and centralized mount table

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115466#comment-17115466 ] Hadoop QA commented on HDFS-15368: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115424#comment-17115424 ] Ayush Saxena commented on HDFS-15368: - The error trace changed now, the append operation is failing

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115395#comment-17115395 ] Hadoop QA commented on HDFS-15368: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115375#comment-17115375 ] Ayush Saxena commented on HDFS-15373: - Test failures seems not related > Fix number of threads in

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115369#comment-17115369 ] Hadoop QA commented on HDFS-15346: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115357#comment-17115357 ] Hadoop QA commented on HDFS-15373: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115348#comment-17115348 ] Ayush Saxena commented on HDFS-15188: - * Give a check to this. {code:java} - * DFSClient can connect

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115332#comment-17115332 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your information. Just check the changes

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15368: --- Attachment: HDFS-15368.002.patch > TestBalancerWithHANameNodes#testBalancerWithObserver failed

[jira] [Commented] (HDFS-15374) Add documentation for command `fedbalance`

2020-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115323#comment-17115323 ] Hadoop QA commented on HDFS-15374: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115311#comment-17115311 ] Ayush Saxena commented on HDFS-15368: - [~hexiaoqiao] I had a quick check and suspect it may be

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115305#comment-17115305 ] Ayush Saxena commented on HDFS-15368: - Was able to repro this on trunk, added the logs wrt trunk code

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15368: Attachment: TestBalancerWithHANameNodes.testBalancerObserver.log >

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115300#comment-17115300 ] Ayush Saxena commented on HDFS-15288: - The BPP can have local node optimization too, I added that in

[jira] [Updated] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15288: Attachment: HDFS-15288-Addendum-01.patch > Add Available Space Rack Fault Tolerant BPP >

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-24 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115297#comment-17115297 ] Jinglun commented on HDFS-15346: Upload v01, pending jenkins. > RBF: Balance data across federation

[jira] [Updated] (HDFS-15374) Add documentation for command `fedbalance`

2020-05-24 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15374: --- Attachment: HDFS-15374.001.patch Assignee: Jinglun Status: Patch Available (was: Open) Upload

[jira] [Created] (HDFS-15374) Add documentation for command `fedbalance`

2020-05-24 Thread Jinglun (Jira)
Jinglun created HDFS-15374: -- Summary: Add documentation for command `fedbalance` Key: HDFS-15374 URL: https://issues.apache.org/jira/browse/HDFS-15374 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-15369) Refactor method VolumeScanner#runLoop()

2020-05-24 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115293#comment-17115293 ] Hudson commented on HDFS-15369: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18294 (See

[jira] [Updated] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-24 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: HDFS-15346.001.patch Status: Patch Available (was: Open) > RBF: Balance data across

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115289#comment-17115289 ] Hudson commented on HDFS-15355: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18293 (See

[jira] [Updated] (HDFS-15369) Refactor method VolumeScanner#runLoop()

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15369: Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-15369) Refactor method VolumeScanner#runLoop()

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115288#comment-17115288 ] Ayush Saxena commented on HDFS-15369: - Committed to trunk and branch-3.3 Thanx [~hadoop_yangyun] for

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115283#comment-17115283 ] Ayush Saxena commented on HDFS-15355: - Committed to trunk. Thanx [~hadoop_yangyun] for the

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115282#comment-17115282 ] Ayush Saxena commented on HDFS-15355: - v013 LGTM +1 > Make the default block storage policy ID

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Status: Patch Available (was: Open) > Fix number of threads in

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Attachment: HDFS-15373-01.patch > Fix number of threads in IPCLoggerChannel#createParallelExecutor

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115156#comment-17115156 ] Hadoop QA commented on HDFS-15355: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15373: --- Summary: Fix number of threads in IPCLoggerChannel#createParallelExecutor Key: HDFS-15373 URL: https://issues.apache.org/jira/browse/HDFS-15373 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115126#comment-17115126 ] Ayush Saxena commented on HDFS-15288: - Will check later today and reopen this to fix. > Add

[jira] [Comment Edited] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115122#comment-17115122 ] hemanthboyina edited comment on HDFS-15288 at 5/24/20, 11:07 AM: - Good

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115122#comment-17115122 ] hemanthboyina commented on HDFS-15288: -- Good work [~ayushtkn] , just a small doubt  > Add Available

[jira] [Commented] (HDFS-15198) RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode

2020-05-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115104#comment-17115104 ] Hadoop QA commented on HDFS-15198: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-15198) RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode

2020-05-24 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-15198: --- Attachment: HDFS-15198.006.patch > RBF: Add test for MountTableRefresherService failed to refresh

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115078#comment-17115078 ] Yang Yun commented on HDFS-15355: - Thanks [~ayushtkn] for the review. Updated to HDFS-15355.013.patch to

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: HDFS-15355.013.patch Status: Patch Available (was: Open) > Make the default block

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Status: Open (was: Patch Available) > Make the default block storage policy ID configurable >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115072#comment-17115072 ] Ayush Saxena commented on HDFS-13183: - Thanx [~hexiaoqiao] and [~Jim_Brennan] for the quick fix. +1

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115068#comment-17115068 ] Ayush Saxena commented on HDFS-15355: - Thanx [~hadoop_yangyun] for the patch, Minor nit :

[jira] [Commented] (HDFS-15369) Refactor method VolumeScanner#runLoop()

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115066#comment-17115066 ] Ayush Saxena commented on HDFS-15369: - Test failures seems not related. v001 LGTM +1 > Refactor