[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

2020-06-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140176#comment-17140176 ] Hadoop QA commented on HDFS-15404: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14941) Potential editlog race condition can cause corrupted file

2020-06-18 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140156#comment-17140156 ] Kihwal Lee commented on HDFS-14941: --- This change causes incremental block report leak. The last set of

[jira] [Updated] (HDFS-15416) DataStorage#addStorageLocations() should add more reasonable information verification.

2020-06-18 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15416: Summary: DataStorage#addStorageLocations() should add more reasonable information verification.

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

2020-06-18 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140052#comment-17140052 ] Chen Liang commented on HDFS-15404: --- Upload v002 patch to fix the bug that caused failed tests. The bug

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

2020-06-18 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Attachment: HDFS-15404.002.patch > ShellCommandFencer should expose info about source >

[jira] [Commented] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

2020-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139990#comment-17139990 ] Íñigo Goiri commented on HDFS-15378: +1 on [^HDFS-15378.001.patch]. >

[jira] [Commented] (HDFS-14546) Document block placement policies

2020-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139991#comment-17139991 ] Íñigo Goiri commented on HDFS-14546: +1 on [^HDFS-14546-09.patch]. > Document block placement

[jira] [Commented] (HDFS-15416) The addStorageLocations() method in the DataStorage class is not perfect.

2020-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139988#comment-17139988 ] Íñigo Goiri commented on HDFS-15416: Please update the title to be a little more specific. > The

[jira] [Updated] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

2020-06-18 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15418: --- Status: Patch Available (was: Open) > ViewFileSystemOverloadScheme should represent

[jira] [Comment Edited] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

2020-06-18 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139983#comment-17139983 ] Uma Maheswara Rao G edited comment on HDFS-15418 at 6/18/20, 8:46 PM:

[jira] [Commented] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

2020-06-18 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139983#comment-17139983 ] Uma Maheswara Rao G commented on HDFS-15418: Updated PR for review! By default

[jira] [Updated] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15419: --- Summary: RBF: Router should retry communicate with NN when cluster is unavailable using configurable

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

2020-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139961#comment-17139961 ] Íñigo Goiri commented on HDFS-15410: I think we should refer to this in the documentation too. > Add

[jira] [Updated] (HDFS-15417) RBF: Lazy get the datanode report for federation WebHDFS operations

2020-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15417: --- Summary: RBF: Lazy get the datanode report for federation WebHDFS operations (was: Lazy get the

[jira] [Commented] (HDFS-15417) Lazy get the datanode report for federation WebHDFS operations

2020-06-18 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139554#comment-17139554 ] Chao Sun commented on HDFS-15417: - I think this addresses the same issue in HDFS-15014. Internally we

[jira] [Commented] (HDFS-13965) hadoop.security.kerberos.ticket.cache.path setting is not honored when KMS encryption is enabled.

2020-06-18 Thread LOKESKUMAR VIJAYAKUMAR (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139552#comment-17139552 ] LOKESKUMAR VIJAYAKUMAR commented on HDFS-13965: --- Hello Team! Can anyone please help here?

[jira] [Commented] (HDFS-15420) approx scheduled blocks not reseting over time

2020-06-18 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139468#comment-17139468 ] hemanthboyina commented on HDFS-15420: -- thanks [~maxmzkr] for providing the report , a quick

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2020-06-18 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139441#comment-17139441 ] Hudson commented on HDFS-15372: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18363 (See

[jira] [Commented] (HDFS-15420) approx scheduled blocks not reseting over time

2020-06-18 Thread Max Mizikar (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139440#comment-17139440 ] Max Mizikar commented on HDFS-15420: We are forking and switching the order in which currApprox and

[jira] [Created] (HDFS-15420) approx scheduled blocks not reseting over time

2020-06-18 Thread Max Mizikar (Jira)
Max Mizikar created HDFS-15420: -- Summary: approx scheduled blocks not reseting over time Key: HDFS-15420 URL: https://issues.apache.org/jira/browse/HDFS-15420 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2020-06-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139432#comment-17139432 ] Wei-Chiu Chuang commented on HDFS-15372: Accidentally committed version 004 instead of the last,

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139379#comment-17139379 ] Stephen O'Donnell commented on HDFS-15406: -- Committed this to all active 3.x branches with no

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15406: - Resolution: Fixed Status: Resolved (was: Patch Available) > Improve the speed

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15406: - Fix Version/s: 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139351#comment-17139351 ] Yuxuan Wang commented on HDFS-15419: [~ayushtkn] But router will retry or failover once currently in

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-18 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139346#comment-17139346 ] Hudson commented on HDFS-15406: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18362 (See

[jira] [Commented] (HDFS-15417) Lazy get the datanode report for federation WebHDFS operations

2020-06-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139299#comment-17139299 ] Ayush Saxena commented on HDFS-15417: - It indeed makes sense to minimize the the getDatanodeReport()

[jira] [Commented] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139292#comment-17139292 ] Ayush Saxena commented on HDFS-15419: - I think this has been somewhere discussed before as well.

[jira] [Commented] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139275#comment-17139275 ] Yuxuan Wang commented on HDFS-15419: Hi~[~bhji123] If router retry more times and longer, but

[jira] [Assigned] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang reassigned HDFS-15419: -- Assignee: (was: Yuxuan Wang) > Router should retry communicate with NN when cluster is

[jira] [Assigned] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang reassigned HDFS-15419: -- Assignee: Yuxuan Wang > Router should retry communicate with NN when cluster is unavailable

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

2020-06-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139216#comment-17139216 ] Hadoop QA commented on HDFS-15410: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

2020-06-18 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15410: --- Attachment: HDFS-15410.001.patch Status: Patch Available (was: Open) > Add separated config file

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

2020-06-18 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139148#comment-17139148 ] Jinglun commented on HDFS-15374: Hi [~linyiqun], thanks your comments ! Upload v02 and the image

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

2020-06-18 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15374: --- Attachment: BalanceProcedureScheduler.png > Add documentation for fedbalance tool >

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

2020-06-18 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15374: --- Attachment: HDFS-15374.002.patch > Add documentation for fedbalance tool >

[jira] [Updated] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread bhji123 (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bhji123 updated HDFS-15419: --- Description: When cluster is unavailable, router -> namenode communication will only retry once without any

[jira] [Updated] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread bhji123 (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bhji123 updated HDFS-15419: --- Summary: Router should retry communicate with NN when cluster is unavailable using configurable time

[jira] [Work started] (HDFS-15416) The addStorageLocations() method in the DataStorage class is not perfect.

2020-06-18 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15416 started by jianghua zhu. --- > The addStorageLocations() method in the DataStorage class is not perfect. >

[jira] [Work stopped] (HDFS-15416) The addStorageLocations() method in the DataStorage class is not perfect.

2020-06-18 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15416 stopped by jianghua zhu. --- > The addStorageLocations() method in the DataStorage class is not perfect. >

[jira] [Work started] (HDFS-15416) The addStorageLocations() method in the DataStorage class is not perfect.

2020-06-18 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15416 started by jianghua zhu. --- > The addStorageLocations() method in the DataStorage class is not perfect. >