[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253354#comment-15253354 ] Walter Su commented on HDFS-10220: -- You are right. The only question I have is I have no idea if the

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.004.patch > Implement asynchronous rename for

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253339#comment-15253339 ] Hadoop QA commented on HDFS-10313: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253325#comment-15253325 ] Haohui Mai commented on HDFS-8872: -- I think it is a good to call it either way, just need to make sure

[jira] [Commented] (HDFS-10322) DomianSocket error lead to more and more DataNode thread waiting

[ https://issues.apache.org/jira/browse/HDFS-10322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252124#comment-15252124 ] Chris Nauroth commented on HDFS-10322: -- Hello [~chenfolin]. In addition to HADOOP-11802, there have

[jira] [Updated] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10207: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252320#comment-15252320 ] Zhe Zhang commented on HDFS-9806: - Thanks Chris, I think we were drafting comments at same time :) Looking

[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

[ https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10319: - Hadoop Flags: Reviewed +1 for the patch. The test failures look unrelated. Thank you,

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252292#comment-15252292 ] Hudson commented on HDFS-10207: --- FAILURE: Integrated in Hadoop-trunk-Commit #9644 (See

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252118#comment-15252118 ] Hadoop QA commented on HDFS-9958: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252213#comment-15252213 ] Chris Douglas commented on HDFS-9806: - We started down that path, citing similar reasoning. [~jghoman]

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252105#comment-15252105 ] Chris Nauroth commented on HDFS-9806: - Hello [~zhz]. Have you seen HADOOP-12077? It's very similar to

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252179#comment-15252179 ] Nicolas Fraison commented on HDFS-10220: [~walter.k.su] 1. I think that it simplify the code 2. Ok

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252312#comment-15252312 ] Zhe Zhang commented on HDFS-9806: - Thanks [~cnauroth] for the discussion! Yes, HADOOP-12077 and my PoC are

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252413#comment-15252413 ] Yongjun Zhang commented on HDFS-9732: - Hi [~ste...@apache.org], Thanks a lot for your review, all good

[jira] [Commented] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252475#comment-15252475 ] Colin Patrick McCabe commented on HDFS-10301: - Hmm. This is a challenging one.

[jira] [Commented] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252493#comment-15252493 ] Hadoop QA commented on HDFS-9894: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9670) DistCp throws NPE when source is root

[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9670: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252521#comment-15252521 ] Ravi Prakash commented on HDFS-10220: - Anyway! I am not going to be a stickler on this. In the

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root

[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252525#comment-15252525 ] Yongjun Zhang commented on HDFS-9670: - Committed to trunk, branch-2, branch-2.8. Thanks [~jzhuge] much

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9869: --- Attachment: HDFS-9869-007.patch > Erasure Coding: Rename replication-based names in BlockManager to more >

[jira] [Commented] (HDFS-10224) Implement an asynchronous DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252494#comment-15252494 ] Hadoop QA commented on HDFS-10224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9732: Attachment: HDFS-9732.004.patch > Remove DelegationTokenIdentifier.toString() —for better logging

[jira] [Updated] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9732: Attachment: HDFS-9732.004.patch > Remove DelegationTokenIdentifier.toString() —for better logging

[jira] [Commented] (HDFS-10224) Implement an asynchronous DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252424#comment-15252424 ] Xiaobing Zhou commented on HDFS-10224: -- I posted patch v003: 1. removed unnecessary usage of Future,

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root

[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252527#comment-15252527 ] John Zhuge commented on HDFS-9670: -- Thanks [~yzhangal] for reporting, reviewing, and committing the jira.

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root

[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252531#comment-15252531 ] Hudson commented on HDFS-9670: -- FAILURE: Integrated in Hadoop-trunk-Commit #9647 (See

[jira] [Commented] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252377#comment-15252377 ] Konstantin Shvachko commented on HDFS-10301: Hey Walter, your patch looks good by itself, but

[jira] [Updated] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9732: Attachment: (was: HDFS-9732.004.patch) > Remove DelegationTokenIdentifier.toString() —for better

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252438#comment-15252438 ] Rakesh R commented on HDFS-9869: Attached new patch, where I've changed the way of deprecation. [~zhz]

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Attachment: HDFS-10311.HDFS-8707.002.patch New patch addressing [~bobhansen]'s comments -got

[jira] [Updated] (HDFS-10224) Implement an asynchronous DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.003.patch > Implement an asynchronous DistributedFileSystem >

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252453#comment-15252453 ] Steve Loughran commented on HDFS-9732: -- I'm happy with this, you've done some great work here. [~aw]

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252517#comment-15252517 ] Ravi Prakash commented on HDFS-10220: - bq. It's about implemention detail I've heard that argument

[jira] [Commented] (HDFS-9943) Support reconfiguring namenode replication confs

[ https://issues.apache.org/jira/browse/HDFS-9943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252601#comment-15252601 ] Xiaobing Zhou commented on HDFS-9943: - Patch v003 is rebased on trunk. There are some refactoring

[jira] [Updated] (HDFS-9943) Support reconfiguring namenode replication confs

[ https://issues.apache.org/jira/browse/HDFS-9943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9943: Attachment: HDFS-9943-HDFS-9000.003.patch > Support reconfiguring namenode replication confs >

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252705#comment-15252705 ] Arpit Agarwal commented on HDFS-10264: -- That's odd. Are you sure your repo is synced? branch-2:

[jira] [Updated] (HDFS-10224) Implement an asynchronous DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.003.patch > Implement an asynchronous DistributedFileSystem >

[jira] [Updated] (HDFS-10224) Implement an asynchronous DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: (was: HDFS-10224-HDFS-9924.003.patch) > Implement an asynchronous

[jira] [Updated] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10301: Attachment: HDFS-10301.002.patch > Blocks removed by thousands due to falsely

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252796#comment-15252796 ] Tsz Wo Nicholas Sze commented on HDFS-10224: Thanks for working on this. Some comments on the

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252797#comment-15252797 ] Mingliang Liu commented on HDFS-10175: -- Hi [~cmccabe], I think you proposed an innovative idea for

[jira] [Commented] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252611#comment-15252611 ] Stephen commented on HDFS-10311: +1. Though it may be a good idea to release the mutex before logging.

[jira] [Commented] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252612#comment-15252612 ] Colin Patrick McCabe commented on HDFS-10301: - I have posted a new patch, which I posted as

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252696#comment-15252696 ] Konstantin Shvachko commented on HDFS-10264: Hey [~arpitagarwal], it looks like you committed

[jira] [Resolved] (HDFS-10305) Hdfs audit shouldn't log mkdir operaton if the directory already exists.

[ https://issues.apache.org/jira/browse/HDFS-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah resolved HDFS-10305. --- Resolution: Won't Fix Closing this as Won't Fix > Hdfs audit shouldn't log mkdir operaton if

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252709#comment-15252709 ] Konstantin Shvachko commented on HDFS-10264: Sorry, please ignore the above: it is in 2.7.3.

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10224: --- Description: This is proposed to implement an asynchronous DistributedFileSystem

[jira] [Commented] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252581#comment-15252581 ] Hadoop QA commented on HDFS-10311: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10260) TestFsDatasetImpl#testCleanShutdownOfVolume often fails

[ https://issues.apache.org/jira/browse/HDFS-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252606#comment-15252606 ] Rushabh S Shah commented on HDFS-10260: --- [~jojochuang]: do you have any additional comments on this

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252710#comment-15252710 ] Konstantin Shvachko commented on HDFS-10264: My bad. > Logging improvements in

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252790#comment-15252790 ] Hadoop QA commented on HDFS-9958: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252804#comment-15252804 ] Tsz Wo Nicholas Sze commented on HDFS-10224: - Please also update statistics. > Implement

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252813#comment-15252813 ] Yongjun Zhang commented on HDFS-10313: -- Hi [~linyiqun], Thanks for the new rev. A few more minor

[jira] [Updated] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10264: - Fix Version/s: 2.7.3 > Logging improvements in FSImageFormatProtobuf.Saver >

[jira] [Updated] (HDFS-6515) testPageRounder (org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)

[ https://issues.apache.org/jira/browse/HDFS-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6515: -- Priority: Major (was: Blocker) I'm downgrading the priority of this issue, since lack of PPC support is

[jira] [Commented] (HDFS-9943) Support reconfiguring namenode replication confs

[ https://issues.apache.org/jira/browse/HDFS-9943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252986#comment-15252986 ] Hadoop QA commented on HDFS-9943: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10264: --- Fix Version/s: (was: 2.7.3) 2.6.5 Committed to branch 2.6. >

[jira] [Updated] (HDFS-10323) transient deleteOnExit failure in ViewFileSystem due to close() ordering

[ https://issues.apache.org/jira/browse/HDFS-10323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Podgursky updated HDFS-10323: - Description: After switching to using a ViewFileSystem, fs.deleteOnExit calls began failing

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10301: Summary: BlockReport retransmissions may lead to storages falsely being declared

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252894#comment-15252894 ] Arpit Agarwal commented on HDFS-10264: -- Thanks for the backport [~shv]. I added back 2.7.3 to 'Fix

[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

[ https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10319: --- Resolution: Fixed Fix Version/s: 2.7.3 Status: Resolved (was: Patch

[jira] [Created] (HDFS-10323) transient deleteOnExit failure in ViewFileSystem due to close() ordering

Ben Podgursky created HDFS-10323: Summary: transient deleteOnExit failure in ViewFileSystem due to close() ordering Key: HDFS-10323 URL: https://issues.apache.org/jira/browse/HDFS-10323 Project:

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252937#comment-15252937 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10309: --- Resolution: Fixed Status: Resolved (was: Patch Available) I have committed

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252969#comment-15252969 ] Hadoop QA commented on HDFS-9732: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252913#comment-15252913 ] Hadoop QA commented on HDFS-9869: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10309) Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10309: --- Summary: Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo),

[jira] [Commented] (HDFS-10319) Balancer should not try to pair storages with different types

[ https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252960#comment-15252960 ] Hudson commented on HDFS-10319: --- FAILURE: Integrated in Hadoop-trunk-Commit #9650 (See

[jira] [Commented] (HDFS-10309) Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252959#comment-15252959 ] Hudson commented on HDFS-10309: --- FAILURE: Integrated in Hadoop-trunk-Commit #9650 (See

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253181#comment-15253181 ] Walter Su commented on HDFS-10301: -- bq. Enabling HDFS-9198 will fifo process BRs. It doesn't solve this

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++:

[jira] [Commented] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253186#comment-15253186 ] James Clampffer commented on HDFS-10311: I've committed this to HDFS-8707, thanks for the reviews

[jira] [Commented] (HDFS-10317) dfs.domain.socket.path is not set in TestShortCircuitLocalRead.testReadWithRemoteBlockReader

[ https://issues.apache.org/jira/browse/HDFS-10317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253201#comment-15253201 ] Li Bo commented on HDFS-10317: -- I use Intellij IDEA to run the test and the problem occurs, but it will not

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253204#comment-15253204 ] Walter Su commented on HDFS-10301: -- The handler threads will wait anyway, either waiting the queue

[jira] [Commented] (HDFS-6515) testPageRounder (org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)

[ https://issues.apache.org/jira/browse/HDFS-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253226#comment-15253226 ] Hadoop QA commented on HDFS-6515: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253236#comment-15253236 ] Walter Su commented on HDFS-10301: -- I like your idea of counting storages with same reportId, and no

[jira] [Updated] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9894: Component/s: (was: tools) > Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[jira] [Updated] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9894: Labels: (was: 2.8.0) > Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives >

[jira] [Updated] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9894: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was:

[jira] [Resolved] (HDFS-9544) DiskBalancer : Command utitlities

[ https://issues.apache.org/jira/browse/HDFS-9544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-9544. Resolution: Duplicate > DiskBalancer : Command utitlities > - > >

[jira] [Updated] (HDFS-9545) DiskBalancer : Add Plan Command

[ https://issues.apache.org/jira/browse/HDFS-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9545: --- Attachment: HDFS-9545-HDFS-1312.001.patch depends on HDFS-9543. Posting here for early code review. >

[jira] [Updated] (HDFS-9545) DiskBalancer : Add Plan Command

[ https://issues.apache.org/jira/browse/HDFS-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9545: --- Attachment: (was: HDFS-9545-HDFS-1312.001.patch) > DiskBalancer : Add Plan Command >

[jira] [Updated] (HDFS-9545) DiskBalancer : Add Plan Command

[ https://issues.apache.org/jira/browse/HDFS-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9545: --- Attachment: HDFS-9545-HDFS-1312.001.patch > DiskBalancer : Add Plan Command >

[jira] [Commented] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253156#comment-15253156 ] Hadoop QA commented on HDFS-10300: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253163#comment-15253163 ] Hudson commented on HDFS-9894: -- FAILURE: Integrated in Hadoop-trunk-Commit #9651 (See

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10301: Attachment: HDFS-10301.003.patch added a unit test > BlockReport retransmissions

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253008#comment-15253008 ] Tsz Wo Nicholas Sze commented on HDFS-8057: --- Thanks for the new patch. - We should not change

[jira] [Updated] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10300: -- Labels: quality test (was: ) Status: Patch Available (was: In Progress) > TestDistCpSystem should

[jira] [Updated] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10300: -- Attachment: HDFS-10300.001.patch Patch 001: * Share a MiniDFSCluster in test cases * Switch to JUnit 4

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253076#comment-15253076 ] Hadoop QA commented on HDFS-10224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: HDFS-10313.003.patch Update the patch for the latest comments, pending jenkins. > Distcp

[jira] [Commented] (HDFS-10322) DomianSocket error lead to more and more DataNode thread waiting

[ https://issues.apache.org/jira/browse/HDFS-10322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253284#comment-15253284 ] ChenFolin commented on HDFS-10322: -- Hello Chris Nautoth Thanks for your reply. I see all bugs

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253309#comment-15253309 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-10301: - Assignee: (was: Walter Su) > Blocks removed by thousands due to falsely detected zombie storages >

[jira] [Commented] (HDFS-10304) Implement moveToLocal

[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251769#comment-15251769 ] Steve Loughran commented on HDFS-10304: --- oops. hit return. "enough for jenkins failures to be

[jira] [Commented] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251814#comment-15251814 ] Bob Hansen commented on HDFS-10311: --- SafeDisconnect should log some details at DEBUG level if there was

[jira] [Commented] (HDFS-10304) Implement moveToLocal

[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251766#comment-15251766 ] Steve Loughran commented on HDFS-10304: --- Looks pretty good # does that post-process operation only

[jira] [Created] (HDFS-10322) DomianSocket error lead to more and more DataNode thread waiting

ChenFolin created HDFS-10322: Summary: DomianSocket error lead to more and more DataNode thread waiting Key: HDFS-10322 URL: https://issues.apache.org/jira/browse/HDFS-10322 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10322) DomianSocket error lead to more and more DataNode thread waiting

[ https://issues.apache.org/jira/browse/HDFS-10322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251390#comment-15251390 ] ChenFolin commented on HDFS-10322: -- May call The native method doPoll0 had got stuck.. >

  1   2   >