[jira] [Commented] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140277#comment-17140277 ] Yuxuan Wang commented on HDFS-15419: [~ayushtkn] Thanks for your reply. IIRC, now rou

[jira] [Comment Edited] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140258#comment-17140258 ] Ayush Saxena edited comment on HDFS-15419 at 6/19/20, 6:48 AM:

[jira] [Commented] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140258#comment-17140258 ] Ayush Saxena commented on HDFS-15419: - The present code is to have failover is becaus

[jira] [Commented] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140249#comment-17140249 ] Yuxuan Wang commented on HDFS-15419: [~bhji123] Well, I more agree with [~ayushtkn].

[jira] [Commented] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140242#comment-17140242 ] bhji123 commented on HDFS-15419: hi, Yuxuan. In this case, if clients timeout and nn is

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140240#comment-17140240 ] Jinglun commented on HDFS-15410: Hi [~elgoiri], thanks your nice comments ! Refer the fed

[jira] [Updated] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15410: --- Attachment: HDFS-15410.002.patch > Add separated config file fedbalance-default.xml for fedbalance tool > ---

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140176#comment-17140176 ] Hadoop QA commented on HDFS-15404: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14941) Potential editlog race condition can cause corrupted file

[ https://issues.apache.org/jira/browse/HDFS-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140156#comment-17140156 ] Kihwal Lee commented on HDFS-14941: --- This change causes incremental block report leak.

[jira] [Updated] (HDFS-15416) DataStorage#addStorageLocations() should add more reasonable information verification.

[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15416: Summary: DataStorage#addStorageLocations() should add more reasonable information verification. (w

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140052#comment-17140052 ] Chen Liang commented on HDFS-15404: --- Upload v002 patch to fix the bug that caused faile

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Attachment: HDFS-15404.002.patch > ShellCommandFencer should expose info about source > ---

[jira] [Commented] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139990#comment-17139990 ] Íñigo Goiri commented on HDFS-15378: +1 on [^HDFS-15378.001.patch]. > TestReconstru

[jira] [Commented] (HDFS-14546) Document block placement policies

[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139991#comment-17139991 ] Íñigo Goiri commented on HDFS-14546: +1 on [^HDFS-14546-09.patch]. > Document block

[jira] [Commented] (HDFS-15416) The addStorageLocations() method in the DataStorage class is not perfect.

[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139988#comment-17139988 ] Íñigo Goiri commented on HDFS-15416: Please update the title to be a little more spec

[jira] [Updated] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15418: --- Status: Patch Available (was: Open) > ViewFileSystemOverloadScheme should represent

[jira] [Comment Edited] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139983#comment-17139983 ] Uma Maheswara Rao G edited comment on HDFS-15418 at 6/18/20, 8:46 PM: -

[jira] [Commented] (HDFS-15418) ViewFileSystemOverloadScheme should represent mount links as non symlinks

[ https://issues.apache.org/jira/browse/HDFS-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139983#comment-17139983 ] Uma Maheswara Rao G commented on HDFS-15418: Updated PR for review! By defau

[jira] [Updated] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15419: --- Summary: RBF: Router should retry communicate with NN when cluster is unavailable using configurable

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139961#comment-17139961 ] Íñigo Goiri commented on HDFS-15410: I think we should refer to this in the documenta

[jira] [Updated] (HDFS-15417) RBF: Lazy get the datanode report for federation WebHDFS operations

[ https://issues.apache.org/jira/browse/HDFS-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15417: --- Summary: RBF: Lazy get the datanode report for federation WebHDFS operations (was: Lazy get the data

[jira] [Commented] (HDFS-15417) Lazy get the datanode report for federation WebHDFS operations

[ https://issues.apache.org/jira/browse/HDFS-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139554#comment-17139554 ] Chao Sun commented on HDFS-15417: - I think this addresses the same issue in HDFS-15014. I

[jira] [Commented] (HDFS-13965) hadoop.security.kerberos.ticket.cache.path setting is not honored when KMS encryption is enabled.

[ https://issues.apache.org/jira/browse/HDFS-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139552#comment-17139552 ] LOKESKUMAR VIJAYAKUMAR commented on HDFS-13965: --- Hello Team! Can anyone ple

[jira] [Commented] (HDFS-15420) approx scheduled blocks not reseting over time

[ https://issues.apache.org/jira/browse/HDFS-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139468#comment-17139468 ] hemanthboyina commented on HDFS-15420: -- thanks [~maxmzkr] for providing the report ,

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139441#comment-17139441 ] Hudson commented on HDFS-15372: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-15420) approx scheduled blocks not reseting over time

[ https://issues.apache.org/jira/browse/HDFS-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139440#comment-17139440 ] Max Mizikar commented on HDFS-15420: We are forking and switching the order in which

[jira] [Created] (HDFS-15420) approx scheduled blocks not reseting over time

Max Mizikar created HDFS-15420: -- Summary: approx scheduled blocks not reseting over time Key: HDFS-15420 URL: https://issues.apache.org/jira/browse/HDFS-15420 Project: Hadoop HDFS Issue Type: Bu

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139432#comment-17139432 ] Wei-Chiu Chuang commented on HDFS-15372: Accidentally committed version 004 inste

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139379#comment-17139379 ] Stephen O'Donnell commented on HDFS-15406: -- Committed this to all active 3.x bra

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15406: - Resolution: Fixed Status: Resolved (was: Patch Available) > Improve the speed of

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15406: - Fix Version/s: 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139351#comment-17139351 ] Yuxuan Wang commented on HDFS-15419: [~ayushtkn] But router will retry or failover on

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139346#comment-17139346 ] Hudson commented on HDFS-15406: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-15417) Lazy get the datanode report for federation WebHDFS operations

[ https://issues.apache.org/jira/browse/HDFS-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139299#comment-17139299 ] Ayush Saxena commented on HDFS-15417: - It indeed makes sense to minimize the the getD

[jira] [Commented] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139292#comment-17139292 ] Ayush Saxena commented on HDFS-15419: - I think this has been somewhere discussed befo

[jira] [Commented] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139275#comment-17139275 ] Yuxuan Wang commented on HDFS-15419: Hi~[~bhji123] If router retry more times and lo

[jira] [Assigned] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang reassigned HDFS-15419: -- Assignee: (was: Yuxuan Wang) > Router should retry communicate with NN when cluster is una

[jira] [Assigned] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang reassigned HDFS-15419: -- Assignee: Yuxuan Wang > Router should retry communicate with NN when cluster is unavailable us

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139216#comment-17139216 ] Hadoop QA commented on HDFS-15410: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15410: --- Attachment: HDFS-15410.001.patch Status: Patch Available (was: Open) > Add separated config file fed

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139148#comment-17139148 ] Jinglun commented on HDFS-15374: Hi [~linyiqun], thanks your comments ! Upload v02 and th