[jira] [Commented] (HDFS-10575) webhdfs fails with filenames including semicolons

[ https://issues.apache.org/jira/browse/HDFS-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436327#comment-15436327 ] Yongjun Zhang commented on HDFS-10575: -- Thanks [~bobhansen] and [~yuanbo]. I resolved it as duplicate

[jira] [Resolved] (HDFS-10575) webhdfs fails with filenames including semicolons

[ https://issues.apache.org/jira/browse/HDFS-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-10575. -- Resolution: Duplicate > webhdfs fails with filenames including semicolons >

[jira] [Resolved] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-10788. -- Resolution: Duplicate Thanks guys, I'm marking it as duplicate of HDFS-9958. > fsck

[jira] [Commented] (HDFS-10748) TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout

[ https://issues.apache.org/jira/browse/HDFS-10748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436304#comment-15436304 ] Hadoop QA commented on HDFS-10748: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10794) Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

Rakesh R created HDFS-10794: --- Summary: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work Key: HDFS-10794 URL: https://issues.apache.org/jira/browse/HDFS-10794

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436247#comment-15436247 ] Jingcheng Du commented on HDFS-9668: Thanks a lot for the comments! [~eddyxu] bq. AutoCloseableLock

[jira] [Updated] (HDFS-10748) TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout

[ https://issues.apache.org/jira/browse/HDFS-10748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10748: - Attachment: HDFS-10748.002.patch I found this issue is very similar to HDFS-8729, and there is already a

[jira] [Commented] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

[ https://issues.apache.org/jira/browse/HDFS-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436161#comment-15436161 ] Manoj Govindassamy commented on HDFS-10793: --- Had a chat with [~andrew.wang] and here is the

[jira] [Commented] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436157#comment-15436157 ] Hadoop QA commented on HDFS-4210: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

[ https://issues.apache.org/jira/browse/HDFS-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436131#comment-15436131 ] Manoj Govindassamy commented on HDFS-10793: --- Here is a test showing the problem. -- Set the

[jira] [Commented] (HDFS-10791) Delete block meta file when the block file is missing

[ https://issues.apache.org/jira/browse/HDFS-10791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436085#comment-15436085 ] Yiqun Lin commented on HDFS-10791: -- Hi, [~szetszwo], this issue seems has been fixed, the related codes:

[jira] [Commented] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436050#comment-15436050 ] John Zhuge commented on HDFS-4210: -- [~clamb]/[~cwl], I am taking over the jira in order to push it over

[jira] [Assigned] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-4210: Assignee: John Zhuge (was: Charles Lamb) > NameNode Format should not fail for DNS resolution on

[jira] [Resolved] (HDFS-9028) Create accessor methods for DataNode#data and DataNode#isBlockTokenEnabled

[ https://issues.apache.org/jira/browse/HDFS-9028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo resolved HDFS-9028. Resolution: Won't Fix The original motivation for creating these accessor methods is no longer

[jira] [Updated] (HDFS-9028) Create accessor methods for DataNode#data and DataNode#isBlockTokenEnabled

[ https://issues.apache.org/jira/browse/HDFS-9028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-9028: --- Assignee: (was: Chris Trezzo) > Create accessor methods for DataNode#data and

[jira] [Commented] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

[ https://issues.apache.org/jira/browse/HDFS-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436022#comment-15436022 ] Hadoop QA commented on HDFS-10792: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10475) Adding metrics for long FSD lock

[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10475: -- Summary: Adding metrics for long FSD lock (was: Adding metrics and warn/debug logs for long FSD lock)

[jira] [Commented] (HDFS-10475) Adding metrics and warn/debug logs for long FSD lock

[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435977#comment-15435977 ] Xiaoyu Yao commented on HDFS-10475: --- Thanks [~zhz] for the heads up. This log part is covered by

[jira] [Updated] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

[ https://issues.apache.org/jira/browse/HDFS-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10793: --- Assignee: Manoj Govindassamy > Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184 >

[jira] [Created] (HDFS-10793) Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184

Andrew Wang created HDFS-10793: -- Summary: Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184 Key: HDFS-10793 URL: https://issues.apache.org/jira/browse/HDFS-10793 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435950#comment-15435950 ] Hadoop QA commented on HDFS-10652: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10475) Adding metrics and warn/debug logs for long FSD lock

[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435932#comment-15435932 ] Zhe Zhang commented on HDFS-10475: -- [~xyao] Is this proposal partially overlapped with HDFS-9145? Thanks.

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435895#comment-15435895 ] Ravi Prakash commented on HDFS-9205: Thanks for the change Nicholas! Should this line be modified?

[jira] [Updated] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

[ https://issues.apache.org/jira/browse/HDFS-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10792: --- Status: Patch Available (was: Open) > RedundantEditLogInputStream should log caught

[jira] [Updated] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

[ https://issues.apache.org/jira/browse/HDFS-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10792: --- Attachment: HDFS-10792.01.patch v01. two places that need to log exceptions. >

[jira] [Created] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

Wei-Chiu Chuang created HDFS-10792: -- Summary: RedundantEditLogInputStream should log caught exceptions Key: HDFS-10792 URL: https://issues.apache.org/jira/browse/HDFS-10792 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435861#comment-15435861 ] Yongjun Zhang edited comment on HDFS-4660 at 8/24/16 10:42 PM: --- Hi

[jira] [Commented] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435861#comment-15435861 ] Yongjun Zhang commented on HDFS-4660: - Hi [~nroberts], Thanks for your earlier work here. Would you

[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435855#comment-15435855 ] Jeff Field commented on HDFS-10788: --- Perfect, thanks, I'll discuss a backport with my vendor/plan an

[jira] [Commented] (HDFS-10791) Delete block meta file when the block file is missing

[ https://issues.apache.org/jira/browse/HDFS-10791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435843#comment-15435843 ] Tsz Wo Nicholas Sze commented on HDFS-10791: A related comment: Currently,

[jira] [Created] (HDFS-10791) Delete block meta file when the block file is missing

Tsz Wo Nicholas Sze created HDFS-10791: -- Summary: Delete block meta file when the block file is missing Key: HDFS-10791 URL: https://issues.apache.org/jira/browse/HDFS-10791 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435817#comment-15435817 ] Bob Hansen commented on HDFS-10754: --- Looks like there was a compilation failure in tools: could not find

[jira] [Comment Edited] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435809#comment-15435809 ] Bob Hansen edited comment on HDFS-10754 at 8/24/16 10:10 PM: - Thanks for your

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435809#comment-15435809 ] Bob Hansen commented on HDFS-10754: --- Thanks for your hard work, [~anatoli.shein]. I'm sorry to have to

[jira] [Commented] (HDFS-10768) Optimize mkdir ops

[ https://issues.apache.org/jira/browse/HDFS-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435812#comment-15435812 ] Hadoop QA commented on HDFS-10768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435803#comment-15435803 ] Lei (Eddy) Xu commented on HDFS-9668: - Hi, [~jingcheng...@intel.com] Thanks a lot for the patch. It

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: HDFS-10652.006.patch Hi [~vinayrpet], Sorry for the delay. I finally got to look at

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435765#comment-15435765 ] Hadoop QA commented on HDFS-10754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10790) libhdfs++: split recursive versions of SetPermission and SetOwner to SetAllPermissions and SetAllOwner

Bob Hansen created HDFS-10790: - Summary: libhdfs++: split recursive versions of SetPermission and SetOwner to SetAllPermissions and SetAllOwner Key: HDFS-10790 URL: https://issues.apache.org/jira/browse/HDFS-10790

[jira] [Comment Edited] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435692#comment-15435692 ] Anatoli Shein edited comment on HDFS-10679 at 8/24/16 9:23 PM: --- Thanks for

[jira] [Comment Edited] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435697#comment-15435697 ] Anatoli Shein edited comment on HDFS-10754 at 8/24/16 9:22 PM: --- Thanks for

[jira] [Comment Edited] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435658#comment-15435658 ] Wei-Chiu Chuang edited comment on HDFS-10788 at 8/24/16 9:23 PM: - Thanks

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Attachment: HDFS-10754.HDFS-8707.009.patch Please review the new patch. > libhdfs++: Create

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435697#comment-15435697 ] Anatoli Shein commented on HDFS-10754: -- Thanks for the review, [~bobhansen]. I have addressed your

[jira] [Commented] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435696#comment-15435696 ] Anatoli Shein commented on HDFS-10754: -- I am moving the find tool into this jira from HDFS-10679 now

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Resolution: Resolved Status: Resolved (was: Patch Available) It is being reviewed as

[jira] [Updated] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find.

[ https://issues.apache.org/jira/browse/HDFS-10754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10754: - Summary: libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown,

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435692#comment-15435692 ] Anatoli Shein commented on HDFS-10679: -- Thanks for the review, [~bobhansen]. I will close this jira

[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435658#comment-15435658 ] Wei-Chiu Chuang commented on HDFS-10788: Thanks [~kshukla] for confirming my guess. I also traced

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435642#comment-15435642 ] Zhe Zhang commented on HDFS-8901: - Sorry about the delay. I just finished reviewing the patch. It needs a

[jira] [Commented] (HDFS-10772) Reduce byte/string conversions for get listing

[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435640#comment-15435640 ] Hudson commented on HDFS-10772: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10339 (See

[jira] [Commented] (HDFS-10768) Optimize mkdir ops

[ https://issues.apache.org/jira/browse/HDFS-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435633#comment-15435633 ] Kihwal Lee commented on HDFS-10768: --- The patch can apply now. Kicked a precommit build. > Optimize

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435626#comment-15435626 ] Hadoop QA commented on HDFS-10742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10772) Reduce byte/string conversions for get listing

[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10772: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435620#comment-15435620 ] Kuhu Shukla commented on HDFS-10788: [~jfield]. This is fixed in 2.7.3 through HDFS-9958. I am

[jira] [Commented] (HDFS-10772) Reduce byte/string conversions for get listing

[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435606#comment-15435606 ] Kihwal Lee commented on HDFS-10772: --- +1 it looks straight-forward. > Reduce byte/string conversions for

[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435578#comment-15435578 ] Wei-Chiu Chuang commented on HDFS-10788: I suspect it's HDFS-9958. > fsck NullPointerException

[jira] [Commented] (HDFS-10788) fsck NullPointerException when it encounters corrupt replicas

[ https://issues.apache.org/jira/browse/HDFS-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435537#comment-15435537 ] Kihwal Lee commented on HDFS-10788: --- [~kshukla], I think one of your jiras fixed it. Please verify. >

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435511#comment-15435511 ] Andrew Wang commented on HDFS-10784: Thanks for taking a look Xiao. FWIW, the limitation of starting

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435496#comment-15435496 ] Xiao Chen commented on HDFS-10784: -- Thanks Andrew for working on this, and Brahma for bringing up

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435492#comment-15435492 ] Surendra Singh Lilhore commented on HDFS-10608: --- Thanks [~churromorales] for patch..

[jira] [Updated] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8986: -- Fix Version/s: (was: 2.9.0) > Add option to -du to calculate directory space usage excluding

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.006.patch The findbugs still complains the issue, slightly modified the code to

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435442#comment-15435442 ] Hadoop QA commented on HDFS-10742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10777) DataNode should report volume failures if DU cannot access files

[ https://issues.apache.org/jira/browse/HDFS-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10777: --- Attachment: HDFS-10777.01.patch v01: a proof of concept. Whenever DU gets an IOException with

[jira] [Updated] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10636: -- Attachment: HDFS-10636.006.patch Posting an updated patch based on [~eddyxu]'s comments

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435324#comment-15435324 ] Chen Liang commented on HDFS-10742: --- Thanks [~arpitagarwal]! Updated a patch to fix style. findbugs

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.005.patch > Measurement of lock held time in FsDatasetImpl >

[jira] [Updated] (HDFS-8093) blk does not exist or is not under Constructionnull

[ https://issues.apache.org/jira/browse/HDFS-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8093: -- Summary: blk does not exist or is not under Constructionnull (was: BP does not exist or

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435262#comment-15435262 ] Xiao Chen commented on HDFS-8986: - Thanks [~jojochuang] for the reviews, and everyone for creating and

[jira] [Commented] (HDFS-8093) BP does not exist or is not under Constructionnull

[ https://issues.apache.org/jira/browse/HDFS-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435275#comment-15435275 ] Tsz Wo Nicholas Sze commented on HDFS-8093: --- Then your cluster probably doesn't have HDFS-9365

[jira] [Updated] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8986: Fix Version/s: 3.0.0-alpha2 2.9.0 2.8.0 > Add option to -du to

[jira] [Updated] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8986: -- Release Note: Add a -x option for "hdfs -du" and "hdfs -count" commands to exclude snapshots

[jira] [Updated] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8986: -- Release Note: Add a -x option to "hdfs -du" and "hdfs -count" command to excludes snapshots from

[jira] [Updated] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8986: -- Release Note: Add a -x option to "hdfs -du" command to excludes snapshots from being calculated.

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435207#comment-15435207 ] Wei-Chiu Chuang commented on HDFS-8986: --- +1 on branch-2 patch. Test failures are not reproducible in

[jira] [Updated] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8986: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435188#comment-15435188 ] Xinwei Qin commented on HDFS-7859: --- Sorry for attaching the wrong patch, not the latest one, I will

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435140#comment-15435140 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435124#comment-15435124 ] Kihwal Lee commented on HDFS-10763: --- The one thing I had to do in the latest patch for branch-2.7 was to

[jira] [Commented] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435117#comment-15435117 ] Hadoop QA commented on HDFS-10782: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9696: - Attachment: HDFS-9696.branch-2.6.patch I think it is worth having in branch-2.6. We would if we were still

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435092#comment-15435092 ] Xinwei Qin commented on HDFS-7859: --- Attach the new patch to fix the only TestOfflineEditsViewer failure.

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-7859: -- Attachment: HDFS-7859.008.patch > Erasure Coding: Persist erasure coding policies in NameNode >

[jira] [Commented] (HDFS-8093) BP does not exist or is not under Constructionnull

[ https://issues.apache.org/jira/browse/HDFS-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435064#comment-15435064 ] Max Schmidt commented on HDFS-8093: --- I am still facing this issue on my namenode (just happened once

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435007#comment-15435007 ] Hudson commented on HDFS-8905: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10335 (See

[jira] [Commented] (HDFS-10762) Pass IIP for file status related methods

[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434984#comment-15434984 ] Hudson commented on HDFS-10762: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10334 (See

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8905: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1 Target

[jira] [Updated] (HDFS-10762) Pass IIP for file status related methods

[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10762: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Status: Patch Available (was: Open) re-submit patch. > Decrease memory frequent exchange of

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Status: Open (was: Patch Available) > Decrease memory frequent exchange of Centralized Cache

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: (was: HDFS-10782-branch-2.001.patch) > Decrease memory frequent exchange of

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: HDFS-10782-branch-2.001.patch > Decrease memory frequent exchange of Centralized Cache

[jira] [Commented] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434756#comment-15434756 ] Hadoop QA commented on HDFS-10782: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Labels: patch (was: ) Status: Patch Available (was: Open) NN returns uncached blocks for

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434723#comment-15434723 ] Hadoop QA commented on HDFS-8905: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9337) Should check required params in WebHDFS to avoid NPE

[ https://issues.apache.org/jira/browse/HDFS-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434703#comment-15434703 ] Hadoop QA commented on HDFS-9337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: HDFS-10782-branch-2.001.patch submit patch for branch-2.7 > Decrease memory frequent

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Attachment: HDFS-8905-v15.patch Rebased against the latest trunk code > Refactor

[jira] [Commented] (HDFS-9337) Should check required params in WebHDFS to avoid NPE

[ https://issues.apache.org/jira/browse/HDFS-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434558#comment-15434558 ] Jagadesh Kiran N commented on HDFS-9337: [~walter.k.su] & [~vinayrpet] Sorry for the delay was

  1   2   >