[jira] [Updated] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13915: - Attachment: HDFS-13915.003.patch > replace datanode failed because of

[jira] [Commented] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689199#comment-16689199 ] Jiandan Yang commented on HDFS-13915: -- There may be something wrong with Jenkins, uploading

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687599#comment-16687599 ] Jiandan Yang commented on HDFS-14045: -- Failed UTs are not caused by [^HDFS-14045.011.patch], and I

[jira] [Commented] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687587#comment-16687587 ] Jiandan Yang commented on HDFS-13915: -- Uploading [^HDFS-13915.002.patch] to fix checkstyle,

[jira] [Updated] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13915: - Attachment: HDFS-13915.002.patch > replace datanode failed because of

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687437#comment-16687437 ] Jiandan Yang edited comment on HDFS-14045 at 11/15/18 3:20 AM: Hi,

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.011.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687437#comment-16687437 ] Jiandan Yang commented on HDFS-14045: -- Hi, [~elgoiri], I see what you mean. {quote} For the

[jira] [Updated] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13915: - Attachment: (was: HDFS-13915.001.patch) > replace datanode failed because of

[jira] [Updated] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13915: - Attachment: HDFS-13915.001.patch > replace datanode failed because of

[jira] [Updated] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13915: - Assignee: Jiandan Yang Status: Patch Available (was: Open) > replace datanode failed

[jira] [Updated] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13915: - Attachment: HDFS-13915.001.patch > replace datanode failed because of

[jira] [Comment Edited] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686177#comment-16686177 ] Jiandan Yang edited comment on HDFS-13915 at 11/14/18 8:01 AM: I add a

[jira] [Commented] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686177#comment-16686177 ] Jiandan Yang commented on HDFS-13915: -- I add a case in [^HDFS-13915.001.patch] based on trunk to

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686140#comment-16686140 ] Jiandan Yang edited comment on HDFS-14045 at 11/14/18 6:49 AM: There are

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686140#comment-16686140 ] Jiandan Yang commented on HDFS-14045: -- There are many "[ERROR] Error occurred in starting fork,

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.010.patch > Use different metrics in DataNode to better measure latency

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686134#comment-16686134 ] Jiandan Yang edited comment on HDFS-14045 at 11/14/18 6:41 AM: Thanks

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686134#comment-16686134 ] Jiandan Yang edited comment on HDFS-14045 at 11/14/18 6:38 AM: Thanks

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686134#comment-16686134 ] Jiandan Yang commented on HDFS-14045: -- Thanks [~elgoiri] for you comments. {quota}

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.009.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684619#comment-16684619 ] Jiandan Yang commented on HDFS-14045: -- Hi, [~xkrogen] I have updated patch according to your

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682726#comment-16682726 ] Jiandan Yang commented on HDFS-14045: -- TestNameNodeMXBean running failed is not related with this

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.008.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682395#comment-16682395 ] Jiandan Yang commented on HDFS-14045: -- Thanks [~xkrogen] for your comments very much. {quote} Can

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681024#comment-16681024 ] Jiandan Yang commented on HDFS-14045: -- Failed ut is not related with this patch, I run successfully

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.006.patch > Use different metrics in DataNode to better measure latency

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.007.patch > Use different metrics in DataNode to better measure latency

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.005.patch > Use different metrics in DataNode to better measure latency

[jira] [Comment Edited] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679222#comment-16679222 ] Jiandan Yang edited comment on HDFS-14045 at 11/8/18 3:01 AM: --- Hi,

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679413#comment-16679413 ] Jiandan Yang commented on HDFS-14045: -- Hi, [~cheersyang] and [~xkrogen], thanks for your

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679807#comment-16679807 ] Jiandan Yang commented on HDFS-14045: -- There may be something wrong in jenkins. Fix checkstyle

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679222#comment-16679222 ] Jiandan Yang commented on HDFS-14045: -- Hi, [~elgoiri], I do agree with you. Setting interval and

[jira] [Commented] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677737#comment-16677737 ] Jiandan Yang commented on HDFS-13984: -- upload patch3 to trigger running test > getFileInfo of

[jira] [Updated] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13984: - Attachment: HDFS-13984.003.patch > getFileInfo of libhdfs call NameNode#getFileStatus twice >

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677695#comment-16677695 ] Jiandan Yang commented on HDFS-14045: -- Thanks [~xkrogen] for your suggest and reminding about

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.004.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677647#comment-16677647 ] Jiandan Yang commented on HDFS-14045: -- Hi, [~elgoiri] * Sorry for forgetting to fix checkstyle

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676151#comment-16676151 ] Jiandan Yang commented on HDFS-14045: -- Hi [~cheersyang], 

[jira] [Commented] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676077#comment-16676077 ] Jiandan Yang commented on HDFS-13984: -- Hi, [~jzhuge] The failed unit is not caused by this patch,

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.003.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676059#comment-16676059 ] Jiandan Yang commented on HDFS-14045: -- Thanks [~elgoiri] for your review comments. * I'v add

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.002.patch > Use different metrics in DataNode to better measure latency

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675084#comment-16675084 ] Jiandan Yang commented on HDFS-14045: -- Hi, [~cheersyang],[~elgoiri] and [~xkrogen] Thanks very much

[jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672683#comment-16672683 ] Jiandan Yang commented on HDFS-14045: -- [~cheersyang] Would you please help me review this patch? >

[jira] [Commented] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672654#comment-16672654 ] Jiandan Yang commented on HDFS-13984: -- [~jzhuge] Could you help me review this patch? >

[jira] [Updated] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-14045: - Attachment: HDFS-14045.001.patch Status: Patch Available (was: Open) > Use different

[jira] [Assigned] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

[ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang reassigned HDFS-14045: Assignee: Jiandan Yang > Use different metrics in DataNode to better measure latency of

[jira] [Created] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN

Jiandan Yang created HDFS-14045: Summary: Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN Key: HDFS-14045 URL:

[jira] [Updated] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13984: - Attachment: HDFS-13984.002.patch > getFileInfo of libhdfs call NameNode#getFileStatus twice >

[jira] [Updated] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13984: - Attachment: (was: HDFS-13984.002.patch) > getFileInfo of libhdfs call NameNode#getFileStatus

[jira] [Updated] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13984: - Attachment: HDFS-13984.002.patch > getFileInfo of libhdfs call NameNode#getFileStatus twice >

[jira] [Updated] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13984: - Description: getFileInfo in hdfs.c calls *FileSystem#exists* first, then calls

[jira] [Updated] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13984: - Description: getFileInfo in hdfs.c calls *FileSystem#exists* first, then calls

[jira] [Updated] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13984: - Status: Patch Available (was: Open) > getFileInfo of libhdfs call NameNode#getFileStatus twice

[jira] [Updated] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

[ https://issues.apache.org/jira/browse/HDFS-13984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13984: - Attachment: HDFS-13984.001.patch > getFileInfo of libhdfs call NameNode#getFileStatus twice >

[jira] [Created] (HDFS-13984) getFileInfo of libhdfs call NameNode#getFileStatus twice

Jiandan Yang created HDFS-13984: Summary: getFileInfo of libhdfs call NameNode#getFileStatus twice Key: HDFS-13984 URL: https://issues.apache.org/jira/browse/HDFS-13984 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617092#comment-16617092 ] Jiandan Yang commented on HDFS-13915: -- [~hexiaoqiao] 2.6.5, and I found trunk also have the same

[jira] [Assigned] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang reassigned HDFS-13915: Assignee: (was: Jiandan Yang ) > replace datanode failed because of

[jira] [Updated] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13915: - Description: Consider following situation: 1. create a file with ALLSSD policy 2. return

[jira] [Updated] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

[ https://issues.apache.org/jira/browse/HDFS-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-13915: - Description: Consider following situation: 1. create a file with ALLSSD policy 2. return

[jira] [Created] (HDFS-13915) replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo

Jiandan Yang created HDFS-13915: Summary: replace datanode failed because of NameNodeRpcServer#getAdditionalDatanode returning excessive datanodeInfo Key: HDFS-13915 URL:

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385686#comment-16385686 ] Jiandan Yang commented on HDFS-9666: - [~jzhuge] [~vinayrpet] Could you help me review it. > Enable

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383667#comment-16383667 ] Jiandan Yang commented on HDFS-9666: - Failed UTs are not caused by this patch, and I run these UTs

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383359#comment-16383359 ] Jiandan Yang commented on HDFS-9666: - upload v4 patch: set refetchIfRequired=true when chooseDataNode

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Attachment: HDFS-9666.004.patch > Enable hdfs-client to read even remote SSD/RAM prior to local disk

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Attachment: HDFS-9666.003.patch > Enable hdfs-client to read even remote SSD/RAM prior to local disk

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383168#comment-16383168 ] Jiandan Yang commented on HDFS-9666: - fix compiler error and upload v2 patch > Enable hdfs-client to

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Attachment: HDFS-9666.002.patch > Enable hdfs-client to read even remote SSD/RAM prior to local disk

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Status: Patch Available (was: Open) > Enable hdfs-client to read even remote SSD/RAM prior to local

[jira] [Assigned] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang reassigned HDFS-9666: --- Assignee: Jiandan Yang (was: ade) > Enable hdfs-client to read even remote SSD/RAM prior to

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383083#comment-16383083 ] Jiandan Yang commented on HDFS-9666: - upload v1 patch based trunk > Enable hdfs-client to read even

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Attachment: HDFS-9666.001.patch > Enable hdfs-client to read even remote SSD/RAM prior to local disk

[jira] [Commented] (HDFS-11942) make new chooseDataNode policy work in more operation like seek, fetch

[ https://issues.apache.org/jira/browse/HDFS-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379902#comment-16379902 ] Jiandan Yang commented on HDFS-11942: -- [~whisper_deng] This patch is very important for HBase, Why

[jira] [Updated] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12814: - Attachment: HDFS-12814.002.patch > Add blockId when warning slow mirror/disk in BlockReceiver >

[jira] [Commented] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254631#comment-16254631 ] Jiandan Yang commented on HDFS-12814: -- Thanks [~cheersyang] and [~msingh] for review. I will add the

[jira] [Updated] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12814: - Status: Patch Available (was: Open) > Add blockId when warning slow mirror/disk in BlockReceiver

[jira] [Updated] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12814: - Attachment: HDFS-12814.001.patch > Add blockId when warning slow mirror/disk in BlockReceiver >

[jira] [Created] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

Jiandan Yang created HDFS-12814: Summary: Add blockId when warning slow mirror/disk in BlockReceiver Key: HDFS-12814 URL: https://issues.apache.org/jira/browse/HDFS-12814 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252859#comment-16252859 ] Jiandan Yang edited comment on HDFS-12754 at 11/15/17 2:41 AM:

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252859#comment-16252859 ] Jiandan Yang commented on HDFS-12754: -- [~xiaochen] Thank you for reviewing. The fix here is to

[jira] [Comment Edited] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252859#comment-16252859 ] Jiandan Yang edited comment on HDFS-12754 at 11/15/17 2:35 AM:

[jira] [Comment Edited] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252859#comment-16252859 ] Jiandan Yang edited comment on HDFS-12754 at 11/15/17 2:34 AM:

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243633#comment-16243633 ] Jiandan Yang commented on HDFS-12754: -- v2 patch fixes dead lock and looks good to me, [~elgoiri]

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237063#comment-16237063 ] Jiandan Yang commented on HDFS-12754: -- Hi, [~kshukla], thanks for you patch. This patch could

[jira] [Updated] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12757: - Attachment: HDFS-12757.patch upload a UT to reproduce issue > DeadLock Happened Between

[jira] [Updated] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12757: - Description: Java stack is : {code:java} Found one Java-level deadlock:

[jira] [Created] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

Jiandan Yang created HDFS-12757: Summary: DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException Key: HDFS-12757 URL:

[jira] [Created] (HDFS-12748) Standby NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY

Jiandan Yang created HDFS-12748: Summary: Standby NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY Key: HDFS-12748 URL: https://issues.apache.org/jira/browse/HDFS-12748 Project: Hadoop

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-7060: Attachment: HDFS-7060.003.patch > Avoid taking locks when sending heartbeats from the DataNode >

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-7060: Attachment: (was: HDFS-7060-003.patch) > Avoid taking locks when sending heartbeats from the

[jira] [Comment Edited] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221789#comment-16221789 ] Jiandan Yang edited comment on HDFS-7060 at 10/30/17 2:55 AM: --- We have

[jira] [Comment Edited] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221789#comment-16221789 ] Jiandan Yang edited comment on HDFS-7060 at 10/27/17 6:38 AM: --- We have

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-7060: Attachment: complete_failed_qps.png sendHeartbeat.png > Avoid taking locks when

[jira] [Comment Edited] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221789#comment-16221789 ] Jiandan Yang edited comment on HDFS-7060 at 10/27/17 6:36 AM: --- We have

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221789#comment-16221789 ] Jiandan Yang commented on HDFS-7060: - We have deploy Hadoop including patch of HDFS-7060-003.patch,

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221765#comment-16221765 ] Jiandan Yang commented on HDFS-7060: - upload HDFS-7060-003.patch > Avoid taking locks when sending

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-7060: Attachment: HDFS-7060-003.patch > Avoid taking locks when sending heartbeats from the DataNode >

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212333#comment-16212333 ] Jiandan Yang commented on HDFS-7060: - [~xinwei] [~brahmareddy] [~jojochuang] We encountered the same

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Status: Patch Available (was: Open) > NameNode exits due to ReplicationMonitor thread received

  1   2   >