[jira] [Updated] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-10838: -- Attachment: NN_UI.png DFSAdmin-Report.png > Last full block

[jira] [Updated] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-10838: -- Attachment: HDFS-10838-001.patch Added last block report time in NN UI and

[jira] [Commented] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464671#comment-15464671 ] Masatake Iwasaki commented on HDFS-10426: - Sorry for delayed reply, [~linyiqun]. bq. I think it

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464786#comment-15464786 ] Hadoop QA commented on HDFS-8901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901-v20.patch 1. remove "//buffer.position(buffer.position() + bytesToRead)" 2. use

[jira] [Updated] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-10838: -- Status: Patch Available (was: Open) > Last full block report received time for

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464454#comment-15464454 ] SammiChen commented on HDFS-8901: - Thanks Zhe! Thanks Kai! bq. Why do we need to flip? In the previous

[jira] [Updated] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10636: -- Status: Open (was: Patch Available) > Modify ReplicaInfo to remove the assumption that

[jira] [Updated] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10636: -- Status: Patch Available (was: Open) > Modify ReplicaInfo to remove the assumption that

[jira] [Commented] (HDFS-6220) Webhdfs should differentiate remote exceptions

[ https://issues.apache.org/jira/browse/HDFS-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465393#comment-15465393 ] Steve Loughran commented on HDFS-6220: -- Looks like (from spark-user) post, it needs to * handle 404s

[jira] [Resolved] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao resolved HDFS-9334. --- Resolution: Duplicate HDFS-6830 has fixed this. > NameNode crash caused by

[jira] [Updated] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9038: --- Attachment: HDFS-9038-011.patch Attaching the updated patch with new test. bq.

[jira] [Commented] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465042#comment-15465042 ] Kai Zheng commented on HDFS-10794: -- Thanks [~Rakesh] for the work. It's a good start. 1. Ref. the codes

[jira] [Comment Edited] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465140#comment-15465140 ] Brahma Reddy Battula edited comment on HDFS-9038 at 9/5/16 2:29 PM:

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466024#comment-15466024 ] SammiChen commented on HDFS-8901: - 1. Run {{hadoop.net.TestDNS}} locally, it passed without any failure.

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466027#comment-15466027 ] Romain Rigaux commented on HDFS-10784: -- Thanks! And for HttpFs, should we create a follow-up jira? >

[jira] [Created] (HDFS-10840) Mover should be in the path of "org.apache.hadoop.hdfs.tools"

Yuanbo Liu created HDFS-10840: - Summary: Mover should be in the path of "org.apache.hadoop.hdfs.tools" Key: HDFS-10840 URL: https://issues.apache.org/jira/browse/HDFS-10840 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10840) Mover should be in the path of "org.apache.hadoop.hdfs.tools"

[ https://issues.apache.org/jira/browse/HDFS-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10840: -- Status: Open (was: Patch Available) > Mover should be in the path of "org.apache.hadoop.hdfs.tools" >

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466291#comment-15466291 ] Arpit Agarwal commented on HDFS-9038: - +1 lgtm. The findbugs warning is due to a deprecated function

[jira] [Updated] (HDFS-10840) Mover should be in the path of "org.apache.hadoop.hdfs.tools"

[ https://issues.apache.org/jira/browse/HDFS-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10840: -- Status: Patch Available (was: Open) > Mover should be in the path of "org.apache.hadoop.hdfs.tools" >

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466285#comment-15466285 ] Arpit Agarwal commented on HDFS-9781: - bq. As Xiao Chen mentioned, the updated test case

[jira] [Updated] (HDFS-10840) Mover should be in the path of "org.apache.hadoop.hdfs.tools"

[ https://issues.apache.org/jira/browse/HDFS-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10840: -- Attachment: HDFS-10840.001.patch > Mover should be in the path of "org.apache.hadoop.hdfs.tools" >

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466360#comment-15466360 ] Vinayakumar B commented on HDFS-9038: - +1 for the latest changes. Thanks [~brahmareddy],

[jira] [Updated] (HDFS-10840) Mover should be in the path of "org.apache.hadoop.hdfs.tools"

[ https://issues.apache.org/jira/browse/HDFS-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10840: -- Attachment: HDFS-10840.001.patch > Mover should be in the path of "org.apache.hadoop.hdfs.tools" >

[jira] [Updated] (HDFS-10840) Mover should be in the path of "org.apache.hadoop.hdfs.tools"

[ https://issues.apache.org/jira/browse/HDFS-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10840: -- Status: Patch Available (was: Open) > Mover should be in the path of "org.apache.hadoop.hdfs.tools" >

[jira] [Updated] (HDFS-10840) Mover should be in the path of "org.apache.hadoop.hdfs.tools"

[ https://issues.apache.org/jira/browse/HDFS-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10840: -- Attachment: (was: HDFS-10840.001.patch) > Mover should be in the path of

[jira] [Comment Edited] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466291#comment-15466291 ] Arpit Agarwal edited comment on HDFS-9038 at 9/6/16 3:38 AM: - +1 lgtm. The

[jira] [Updated] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10426: - Attachment: HDFS-10426.005.patch Thanks [~iwasakims] for the comments. The comments looks good to me. I

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466388#comment-15466388 ] Xiao Chen commented on HDFS-10784: -- Yep, that's being tracked by the linked HDFS-10823. > Implement

[jira] [Commented] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466139#comment-15466139 ] Akira Ajisaka commented on HDFS-10778: -- Thanks [~linyiqun] for updating the patch. I tried your patch

[jira] [Updated] (HDFS-9849) DiskBalancer : reduce lock path in shutdown code

[ https://issues.apache.org/jira/browse/HDFS-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9849: --- Assignee: Yuanbo Liu (was: Anu Engineer) > DiskBalancer : reduce lock path in shutdown code >

[jira] [Commented] (HDFS-9849) DiskBalancer : reduce lock path in shutdown code

[ https://issues.apache.org/jira/browse/HDFS-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466247#comment-15466247 ] Anu Engineer commented on HDFS-9849: sure, please go ahead. > DiskBalancer : reduce lock path in

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466299#comment-15466299 ] Arpit Agarwal commented on HDFS-10830: -- The test timeout appears to have been introduced by

[jira] [Updated] (HDFS-9849) DiskBalancer : reduce lock path in shutdown code

[ https://issues.apache.org/jira/browse/HDFS-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-9849: - Status: Patch Available (was: Open) > DiskBalancer : reduce lock path in shutdown code >

[jira] [Updated] (HDFS-9849) DiskBalancer : reduce lock path in shutdown code

[ https://issues.apache.org/jira/browse/HDFS-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-9849: - Attachment: HDFS-9849.001.patch [~anu] Thanks very much! uploaded v1 patch for this jira. > DiskBalancer

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465359#comment-15465359 ] Hadoop QA commented on HDFS-9038: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Affects Version/s: 3.0.0-alpha2 > Use ByteBuffer in striping positional read >

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8957: Assignee: SammiChen (was: Youwei Wang) > Consolidate client striping input stream codes for stateful read

[jira] [Updated] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8957: Affects Version/s: 3.0.0-alpha2 > Consolidate client striping input stream codes for stateful read and >

[jira] [Commented] (HDFS-9849) DiskBalancer : reduce lock path in shutdown code

[ https://issues.apache.org/jira/browse/HDFS-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466464#comment-15466464 ] Hadoop QA commented on HDFS-9849: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10840) Mover should be in the path of "org.apache.hadoop.hdfs.tools"

[ https://issues.apache.org/jira/browse/HDFS-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466473#comment-15466473 ] Hadoop QA commented on HDFS-10840: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466521#comment-15466521 ] Rakesh R commented on HDFS-10794: - Thanks a lot [~drankye] for the reviews. I'll take care 1,2,3 comments.

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464251#comment-15464251 ] Zhe Zhang commented on HDFS-8901: - Thanks for the comment Kai. I agree we can leave the {{readAll}}

[jira] [Comment Edited] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464280#comment-15464280 ] Yuanbo Liu edited comment on HDFS-10802 at 9/5/16 7:04 AM: --- [~umamaheswararao]

[jira] [Commented] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464280#comment-15464280 ] Yuanbo Liu commented on HDFS-10802: --- [~umamaheswararao] I'd like to contribute to SPS. If you don't

[jira] [Commented] (HDFS-10778) Optimize the output result of FileDistribution processor in hdfs oiv command

[ https://issues.apache.org/jira/browse/HDFS-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464324#comment-15464324 ] Hadoop QA commented on HDFS-10778: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem