[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115785#comment-17115785 ] Ayush Saxena commented on HDFS-15368: - Tried this with Addendum patch of HDFS-13183, It works well.

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115791#comment-17115791 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your confirm. Sorry not attach the result

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115796#comment-17115796 ] Hadoop QA commented on HDFS-15346: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-25 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115911#comment-17115911 ] Yang Yun commented on HDFS-15188: - Updated to HDFS-15188.004.patch for checkstyle issues. > Add option

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-25 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Status: Open (was: Patch Available) > Add option to set Write/Read timeout extension for different

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-25 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Attachment: HDFS-15188.005.patch Status: Patch Available (was: Open) > Add option to set

[jira] [Commented] (HDFS-15371) Nonstandard characters exist in NameNode.java

2020-05-25 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115897#comment-17115897 ] Zhao Yi Ming commented on HDFS-15371: - Based on the comments create a new pr 2032 for this minor fix.

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115826#comment-17115826 ] Hadoop QA commented on HDFS-15188: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-25 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15375: Summary: Reconstruction Work should not happen for Corrupt Block Key: HDFS-15375 URL: https://issues.apache.org/jira/browse/HDFS-15375 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-25 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115996#comment-17115996 ] Jinglun commented on HDFS-15346: The timeout of the unit test is not long enough. Extend the timeout in

[jira] [Updated] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-25 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: HDFS-15346.003.patch > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Updated] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-25 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15375: - Attachment: HDFS-15375-testrepro.patch > Reconstruction Work should not happen for Corrupt Block

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116075#comment-17116075 ] Hadoop QA commented on HDFS-15188: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15375) Reconstruction Work should not happen for Corrupt Block

2020-05-25 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15375: - Description: In BlockManager#updateNeededReconstructions , while updating the

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-25 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116161#comment-17116161 ] Íñigo Goiri commented on HDFS-15373: Can you give some background here? I also see you added

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-25 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15373: --- Description: The number of threads in IPCLoggerChannel#createParallelExecutor is elastic right now,

[jira] [Issue Comment Deleted] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2020-05-25 Thread vishal.rajan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vishal.rajan updated HDFS-6870: --- Comment: was deleted (was: even after upgrading we are seeing this issue.) > Blocks and INodes could

[jira] [Issue Comment Deleted] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2020-05-25 Thread vishal.rajan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vishal.rajan updated HDFS-6870: --- Comment: was deleted (was: How can this be fixed, or can we remove inodes from namenode.) > Blocks

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116145#comment-17116145 ] Hadoop QA commented on HDFS-15346: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Attachment: HDFS-15373-02.patch > Fix number of threads in IPCLoggerChannel#createParallelExecutor

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15355: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116168#comment-17116168 ] Ayush Saxena commented on HDFS-15373: - The {{numThreads}} was not getting used only, the queue limit

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2020-05-25 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116280#comment-17116280 ] Íñigo Goiri commented on HDFS-13274: The policy we follow is the same as for the Namenode which is to

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116257#comment-17116257 ] Hadoop QA commented on HDFS-15373: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-25 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116276#comment-17116276 ] Íñigo Goiri commented on HDFS-15373: OK, this is the from the ThreadPoolExecutor

[jira] [Commented] (HDFS-15374) Add documentation for command `fedbalance`

2020-05-25 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116277#comment-17116277 ] Íñigo Goiri commented on HDFS-15374: Thanks [~LiJinglun] for adding the doc. It may make sense to

[jira] [Commented] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

2020-05-25 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116383#comment-17116383 ] Zhao Yi Ming commented on HDFS-14984: -   [~hemanthboyina]  I think [~SouryakantaDwivedy] means the

[jira] [Created] (HDFS-15376) Fix POST and PUT errors in httpfs documentation

2020-05-25 Thread bianqi (Jira)
bianqi created HDFS-15376: - Summary: Fix POST and PUT errors in httpfs documentation Key: HDFS-15376 URL: https://issues.apache.org/jira/browse/HDFS-15376 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15364) Support sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Status: Open (was: Patch Available) > Support sort the output according to the number of occurrences of the

[jira] [Updated] (HDFS-15376) Fix POST and PUT errors in httpfs documentation

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15376: -- Status: Patch Available (was: Open) > Fix POST and PUT errors in httpfs documentation >

[jira] [Commented] (HDFS-15376) Fix POST and PUT errors in httpfs documentation

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116406#comment-17116406 ] bianqi commented on HDFS-15376: --- upload patch,  please review  thanks~  > Fix POST and PUT errors in

[jira] [Commented] (HDFS-15376) Update the error about command line POST in httpfs documentation

2020-05-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116425#comment-17116425 ] Hadoop QA commented on HDFS-15376: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-25 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116443#comment-17116443 ] Yiqun Lin commented on HDFS-15346: -- Will give have a review this week, [~LiJinglun]. > RBF: Balance

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-25 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116357#comment-17116357 ] Jinglun commented on HDFS-15346: Hi [~linyiqun], would you help reviewing v03, thanks very much ! > RBF:

[jira] [Updated] (HDFS-15376) Fix POST and PUT errors in httpfs documentation

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15376: -- Description:    In the official Hadoop documentation, there is an exception when executing the following

[jira] [Resolved] (HDFS-15364) Support sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi resolved HDFS-15364. --- Resolution: Invalid > Support sort the output according to the number of occurrences of the opcode > for

[jira] [Comment Edited] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2020-05-25 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116408#comment-17116408 ] Janus Chow edited comment on HDFS-13274 at 5/26/20, 4:02 AM: - Checked the JMX

[jira] [Updated] (HDFS-15376) Fix POST and PUT errors in httpfs documentation

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15376: -- Attachment: HDFS-15376.001.patch > Fix POST and PUT errors in httpfs documentation >

[jira] [Updated] (HDFS-15376) Fix POST and PUT errors in httpfs documentation

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15376: -- Description:    In the official Hadoop documentation, there is an exception when executing the following

[jira] [Updated] (HDFS-15376) Fix POST and PUT errors in httpfs documentation

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15376: -- Description:    In the official Hadoop documentation, there is an exception when executing the following

[jira] [Updated] (HDFS-15376) Fix POST and PUT errors in httpfs documentation

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15376: -- Description:    In the official Hadoop documentation, there is an exception when executing the following

[jira] [Updated] (HDFS-15376) Update the error about command line POST in httpfs documentation

2020-05-25 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15376: -- Summary: Update the error about command line POST in httpfs documentation (was: Fix POST and PUT errors in

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2020-05-25 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116408#comment-17116408 ] Janus Chow commented on HDFS-13274: --- Attached a JMX stat file of detailed activity for port of a