[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-01-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741525#comment-16741525 ] He Xiaoqiao commented on HDFS-14201: [~surmountian] is it possible to check the namenode if in

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741509#comment-16741509 ] He Xiaoqiao commented on HDFS-14186: as mentioned above, the core issue: namenode uses blocks number

[jira] [Comment Edited] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741318#comment-16741318 ] He Xiaoqiao edited comment on HDFS-14186 at 1/12/19 3:31 PM: - Hi [~elgoiri],

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741318#comment-16741318 ] He Xiaoqiao commented on HDFS-14186: Hi [~elgoiri], {quote}I'm guessing that the lifeline doesn't

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740073#comment-16740073 ] He Xiaoqiao commented on HDFS-14186: I think safe mode extension could cover the issue in small or

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2019-01-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739067#comment-16739067 ] He Xiaoqiao commented on HDFS-13473: ping [~daryn], do you mind to recheck this feature and feedback

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739046#comment-16739046 ] He Xiaoqiao commented on HDFS-14186: after checking trunk branch, I believe this issue still exists.

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737252#comment-16737252 ] He Xiaoqiao commented on HDFS-14186: attached a quick-and-dirty demonstration patch

[jira] [Updated] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14186: --- Attachment: HDFS-14186.001.patch > blockreport storm slow down namenode restart seriously in large

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737101#comment-16737101 ] He Xiaoqiao commented on HDFS-14186: Note logs about namenode and one datanode which is marked dead

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736838#comment-16736838 ] He Xiaoqiao commented on HDFS-14186: [~kihwal] Thanks for your comments. {quote}I think nodes are

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735167#comment-16735167 ] He Xiaoqiao commented on HDFS-14186: Would like to offer more details: 1. when namenode restart, all

[jira] [Created] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-05 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14186: -- Summary: blockreport storm slow down namenode restart seriously in large cluster Key: HDFS-14186 URL: https://issues.apache.org/jira/browse/HDFS-14186 Project: Hadoop

[jira] [Commented] (HDFS-14181) Suspect there is a bug in NetworkTopology.java chooseRandom function.

2019-01-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731828#comment-16731828 ] He Xiaoqiao commented on HDFS-14181: [~sihai], Thanks for your work, as you mentioned before, read

[jira] [Commented] (HDFS-14181) Suspect there is a bug in NetworkTopology.java chooseRandom function.

2019-01-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731749#comment-16731749 ] He Xiaoqiao commented on HDFS-14181: [~elgoiri][~sihai] Thanks for your corrected comments.

[jira] [Commented] (HDFS-14181) Suspect there is a bug in NetworkTopology.java chooseRandom function.

2018-12-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730958#comment-16730958 ] He Xiaoqiao commented on HDFS-14181: [~sihai] Thanks for your reporting, I think it may be not bug,

[jira] [Commented] (HDFS-9198) Coalesce IBR processing in the NN

2018-12-21 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726664#comment-16726664 ] He Xiaoqiao commented on HDFS-9198: --- Thanks [~daryn] for the nice work, and it is very useful for me. I

[jira] [Commented] (HDFS-14109) Improve hdfs auditlog format and support federation friendly

2018-12-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712348#comment-16712348 ] He Xiaoqiao commented on HDFS-14109: Thanks [~xkrogen],[~kihwal] for discussing this issue. {quote}I

[jira] [Commented] (HDFS-14109) Improve hdfs auditlog format and support federation friendly

2018-11-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702689#comment-16702689 ] He Xiaoqiao commented on HDFS-14109: [~kihwal] Thanks for your comments firstly. {quote}NN audit log

[jira] [Updated] (HDFS-14109) Improve hdfs auditlog format and support federation friendly

2018-11-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14109: --- Status: Patch Available (was: Open) submit v0 patch and trigger jenkins. > Improve hdfs auditlog

[jira] [Updated] (HDFS-14109) Improve hdfs auditlog format and support federation friendly

2018-11-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14109: --- Attachment: HDFS-14109.patch > Improve hdfs auditlog format and support federation friendly >

[jira] [Created] (HDFS-14109) Improve hdfs auditlog format and support federation friendly

2018-11-28 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14109: -- Summary: Improve hdfs auditlog format and support federation friendly Key: HDFS-14109 URL: https://issues.apache.org/jira/browse/HDFS-14109 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-11-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16691701#comment-16691701 ] He Xiaoqiao commented on HDFS-10943: [~daryn],[~kihwal],[~zhz],[~yzhangal] Unfortunately, I meet this

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-11-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16691520#comment-16691520 ] He Xiaoqiao commented on HDFS-12749: [~kihwal],[~xkrogen] do you mind anymore review to push this

[jira] [Commented] (HDFS-12862) CacheDirective may invalidata,when NN restart or make a transition to Active.

2018-11-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16691458#comment-16691458 ] He Xiaoqiao commented on HDFS-12862: LGTM for [^HDFS-12862-trunk.003.patch] , ping

[jira] [Commented] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

2018-09-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614411#comment-16614411 ] He Xiaoqiao commented on HDFS-13915: hi [~yangjiandan], I wonder which version do you encounter this

[jira] [Commented] (HDFS-13833) Failed to choose from local rack (location = /default); the second replica is not found, retry choosing ramdomly

2018-08-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16584630#comment-16584630 ] He Xiaoqiao commented on HDFS-13833: IIUC I think inconsistent {{stats}} is the main reason about

[jira] [Commented] (HDFS-12862) CacheDirective may invalidata,when NN restart or make a transition to Active.

2018-08-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579299#comment-16579299 ] He Xiaoqiao commented on HDFS-12862: Thanks [~Wang XL], for reporting and working on this, some minor

[jira] [Comment Edited] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-08-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576102#comment-16576102 ] He Xiaoqiao edited comment on HDFS-13668 at 8/10/18 11:00 AM: -- {quote}We

[jira] [Commented] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-08-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576102#comment-16576102 ] He Xiaoqiao commented on HDFS-13668: {quote}We usually call miniDFS.getFileSystem() instead. But this

[jira] [Updated] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-08-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13668: --- Attachment: HDFS-13668-trunk.003.patch > FSPermissionChecker may throws AIOOE when check if inode

[jira] [Commented] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-08-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575813#comment-16575813 ] He Xiaoqiao commented on HDFS-13668: ping [~drankye],[~jojochuang],[~shashikant], any further more

[jira] [Commented] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-08-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574874#comment-16574874 ] He Xiaoqiao commented on HDFS-13668: Thanks [~jojochuang] {quote}We should probably revisit ACL

[jira] [Commented] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-08-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574498#comment-16574498 ] He Xiaoqiao commented on HDFS-13668: [~drankye],[~shashikant], check failed

[jira] [Commented] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-08-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574300#comment-16574300 ] He Xiaoqiao commented on HDFS-13668: Thanks [~drankye],[~shashikant] for your suggestions, submit

[jira] [Updated] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-08-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13668: --- Attachment: HDFS-13668-trunk.002.patch > FSPermissionChecker may throws AIOOE when check if inode

[jira] [Created] (HDFS-13760) improve ZKFC fencing action when network of ZKFC interrupt

2018-07-23 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13760: -- Summary: improve ZKFC fencing action when network of ZKFC interrupt Key: HDFS-13760 URL: https://issues.apache.org/jira/browse/HDFS-13760 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515693#comment-16515693 ] He Xiaoqiao commented on HDFS-13473: upload v005 patch to fix bug about auto-update block token keys

[jira] [Comment Edited] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515693#comment-16515693 ] He Xiaoqiao edited comment on HDFS-13473 at 6/18/18 1:24 PM: - upload v005

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.005.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514861#comment-16514861 ] He Xiaoqiao commented on HDFS-13473: re-upload v004 patch, fix compile fail and kick on jenknis

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.004.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: (was: HDFS-13473-trunk.004.patch) > DataNode update BlockKeys using mode PULL rather

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.004.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514831#comment-16514831 ] He Xiaoqiao commented on HDFS-13473: [~daryn], Thanks for your review. In v003, update logic about

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.003.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Updated] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-06-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13668: --- Status: Patch Available (was: Open) submit v0 patch and trigger jenkins. > FSPermissionChecker may

[jira] [Updated] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-06-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13668: --- Attachment: HDFS-13668-trunk.001.patch > FSPermissionChecker may throws AIOOE when check if inode

[jira] [Created] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-06-10 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13668: -- Summary: FSPermissionChecker may throws AIOOE when check if inode has permission Key: HDFS-13668 URL: https://issues.apache.org/jira/browse/HDFS-13668 Project: Hadoop

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504601#comment-16504601 ] He Xiaoqiao commented on HDFS-13473: [~daryn] any further comments and suggestions? > DataNode

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503271#comment-16503271 ] He Xiaoqiao commented on HDFS-13183: Thanks [~elgoiri] and [~shv] for your comments. {quote} If we

[jira] [Commented] (HDFS-13638) DataNode Can't replicate block because NameNode thinks the length is 9223372036854775807

2018-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494689#comment-16494689 ] He Xiaoqiao commented on HDFS-13638: [~jojochuang], I met this problem in apache-2.7.1, IIUC, it may

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491812#comment-16491812 ] He Xiaoqiao commented on HDFS-12749: thanks [~kihwal], v005 patch is with test case following your

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Attachment: HDFS-12749-trunk.005.patch > DN may not send block report to NN after NN restart >

[jira] [Commented] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2018-05-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465250#comment-16465250 ] He Xiaoqiao commented on HDFS-13529: submit v001 patch and trigger jenkins. > Fix default trash

[jira] [Updated] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2018-05-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13529: --- Status: Patch Available (was: Open) > Fix default trash policy emptier trigger time correctly >

[jira] [Updated] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2018-05-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13529: --- Attachment: HDFS-13529-trunk.001.patch > Fix default trash policy emptier trigger time correctly >

[jira] [Created] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2018-05-06 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13529: -- Summary: Fix default trash policy emptier trigger time correctly Key: HDFS-13529 URL: https://issues.apache.org/jira/browse/HDFS-13529 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-04-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447173#comment-16447173 ] He Xiaoqiao commented on HDFS-13473: Patch V2 is following [~daryn]'s suggestion, and DataNode's

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-04-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.002.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-04-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445837#comment-16445837 ] He Xiaoqiao commented on HDFS-10943: hi [~daryn], I wonder is there any condition to make sure that

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-04-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445377#comment-16445377 ] He Xiaoqiao commented on HDFS-10943: Correct: {quote}1. only 2/3 JournalNodes active at that time

[jira] [Comment Edited] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-04-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445363#comment-16445363 ] He Xiaoqiao edited comment on HDFS-10943 at 4/20/18 6:23 AM: - I would like to

[jira] [Comment Edited] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-04-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445363#comment-16445363 ] He Xiaoqiao edited comment on HDFS-10943 at 4/20/18 6:22 AM: - I would like to

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-04-20 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445363#comment-16445363 ] He Xiaoqiao commented on HDFS-10943: I would like to provide more detail information: A. NameNode logs

[jira] [Issue Comment Deleted] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-04-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10943: --- Comment: was deleted (was: Plz ignore my latest comments. HDFS-11292 is related for this issue and I

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-04-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444051#comment-16444051 ] He Xiaoqiao commented on HDFS-10943: Plz ignore my latest comments. HDFS-11292 is related for this

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2018-04-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443671#comment-16443671 ] He Xiaoqiao commented on HDFS-10943: hi [~zhz],[~daryn],[~yzhangal],[~kihwal] is this issue still

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442942#comment-16442942 ] He Xiaoqiao commented on HDFS-12749: ping [~kihwal],[~daryn],[~arpitagarwal],[~ajayydv] do you mind

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442934#comment-16442934 ] He Xiaoqiao commented on HDFS-13473: Thanks [~daryn] for your comments. {quote}What about something

[jira] [Assigned] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao reassigned HDFS-13473: -- Assignee: He Xiaoqiao > DataNode update BlockKeys using mode PULL rather than PUSH from

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442732#comment-16442732 ] He Xiaoqiao commented on HDFS-13473: submit initial patch and use {{NamenodeProtocol#getBlockKeys}}

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Status: Patch Available (was: Open) > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-04-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.001.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Created] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-04-18 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13473: -- Summary: DataNode update BlockKeys using mode PULL rather than PUSH from NameNode Key: HDFS-13473 URL: https://issues.apache.org/jira/browse/HDFS-13473 Project: Hadoop

[jira] [Comment Edited] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440798#comment-16440798 ] He Xiaoqiao edited comment on HDFS-13441 at 4/17/18 12:17 PM: -- {quote}Let

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440798#comment-16440798 ] He Xiaoqiao commented on HDFS-13441: {quote}Let DataNode pull Block Key from NameNode is one choice,

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-15 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438968#comment-16438968 ] He Xiaoqiao commented on HDFS-13441: [~zhaoyunjiong] it is my misunderstand above One minor suggestion

[jira] [Comment Edited] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438448#comment-16438448 ] He Xiaoqiao edited comment on HDFS-13441 at 4/14/18 6:09 PM: - [~zhaoyunjiong],

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438448#comment-16438448 ] He Xiaoqiao commented on HDFS-13441: [~zhaoyunjiong], If I understand correctly, this issue was caused

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436754#comment-16436754 ] He Xiaoqiao commented on HDFS-13441: the detailed analysis ref:

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436752#comment-16436752 ] He Xiaoqiao commented on HDFS-13441: hi [~zhaoyunjiong],[~jojochuang] we meet the similar problem in

[jira] [Commented] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-04-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429409#comment-16429409 ] He Xiaoqiao commented on HDFS-12976: [~csun] is this issue still going on? > Introduce

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-04-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424184#comment-16424184 ] He Xiaoqiao commented on HDFS-12749: update patch v4 and fix bug based comments and without testcase.

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-04-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Attachment: HDFS-12749-trunk.004.patch > DN may not send block report to NN after NN restart >

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-04-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422668#comment-16422668 ] He Xiaoqiao commented on HDFS-12749: [~kihwal] Thanks for your feedback. I misunderstood your idea

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-03-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417802#comment-16417802 ] He Xiaoqiao commented on HDFS-12749: Thanks [~kihwal] for your detailed comment. {quote}You can keep

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394755#comment-16394755 ] He Xiaoqiao commented on HDFS-13234: Thanks [~kihwal] for your detailed comments. It is interesting

[jira] [Commented] (HDFS-13096) HDFS group quota

2018-03-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391236#comment-16391236 ] He Xiaoqiao commented on HDFS-13096: [~Tagar], is this issue going on? > HDFS group quota >

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390739#comment-16390739 ] He Xiaoqiao commented on HDFS-13234: Thanks [~kihwal],[~elgoiri] for your comments. {quote}How big is

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389346#comment-16389346 ] He Xiaoqiao commented on HDFS-13234: upload patch v1 for trunk and pending jenkins. > Remove renew

[jira] [Updated] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13234: --- Attachment: HDFS-13234.001.patch > Remove renew configuration instance in

[jira] [Created] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-05 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13234: -- Summary: Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client Key: HDFS-13234 URL:

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-03-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386430#comment-16386430 ] He Xiaoqiao commented on HDFS-12749: [~kihwal] could you help to review or give some suggestions? >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-03-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383114#comment-16383114 ] He Xiaoqiao commented on HDFS-13183: [~xkrogen] {quote}if the SbNN goes down, the ANN is not aware of

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-03-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382040#comment-16382040 ] He Xiaoqiao commented on HDFS-12749: Thanks [~xkrogen] for your review all the same. {quote}I am not

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-03-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381922#comment-16381922 ] He Xiaoqiao commented on HDFS-13183: [~xkrogen] Thanks for your comments and correct me. In patch

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-03-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13183: --- Attachment: HDFS-13183-trunk.003.patch > Standby NameNode process getBlocks request to reduce Active

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380179#comment-16380179 ] He Xiaoqiao commented on HDFS-12749: ping [~xkrogen],[~kihwal] any suggestions or feedback for this

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380139#comment-16380139 ] He Xiaoqiao commented on HDFS-13183: [~xkrogen] Thanks for your detailed comments, and sorry for slow

<    2   3   4   5   6   7   8   9   >