[jira] [Commented] (HDFS-8197) [umbrella] System tests for EC feature

2015-04-21 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506536#comment-14506536 ] Kai Sasaki commented on HDFS-8197: -- [~zhz] How can I move these sub-tasks under HDFS-7285?

[jira] [Commented] (HDFS-8136) Client gets and uses EC schema when reads and writes a stripping file

2015-04-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506504#comment-14506504 ] Vinayakumar B commented on HDFS-8136: - Hi [~kaisasak], Thanks for working on this, Her

[jira] [Updated] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8218: - Attachment: HDFS-8218.000.patch > Move classes that used by ClientProtocol into hdfs-client > -

[jira] [Updated] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8218: - Status: Patch Available (was: Open) > Move classes that used by ClientProtocol into hdfs-client >

[jira] [Created] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-21 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8218: Summary: Move classes that used by ClientProtocol into hdfs-client Key: HDFS-8218 URL: https://issues.apache.org/jira/browse/HDFS-8218 Project: Hadoop HDFS Issue Typ

[jira] [Updated] (HDFS-8217) During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.

2015-04-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8217: Attachment: HDFS-8217-01.patch Attached the patch. Please review. > During block recovery for trunc

[jira] [Updated] (HDFS-8217) During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.

2015-04-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8217: Status: Patch Available (was: Open) > During block recovery for truncate Log new Block Id in case of

[jira] [Updated] (HDFS-8136) Client gets and uses EC schema when reads and writes a stripping file

2015-04-21 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8136: Attachment: HDFS-8136-005.patch > Client gets and uses EC schema when reads and writes a stripping file > ---

[jira] [Commented] (HDFS-8136) Client gets and uses EC schema when reads and writes a stripping file

2015-04-21 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506461#comment-14506461 ] Li Bo commented on HDFS-8136: - HDFS-8190 has given and committed changes to {{TestDFSStripedOut

[jira] [Commented] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506447#comment-14506447 ] Haohui Mai commented on HDFS-8052: -- [~tfukudom], sorry that I missed your earlier comments

[jira] [Updated] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8052: - Status: Patch Available (was: Open) > Move WebHdfsFileSystem into hadoop-hdfs-client > ---

[jira] [Commented] (HDFS-4505) Balancer failure with nameservice configuration.

2015-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506445#comment-14506445 ] Hadoop QA commented on HDFS-4505: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8052: - Attachment: HDFS-8052.000.patch > Move WebHdfsFileSystem into hadoop-hdfs-client >

[jira] [Created] (HDFS-8217) During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.

2015-04-21 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-8217: --- Summary: During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. Key: HDFS-8217 URL: https://issues.apache.org/jira/browse/HDFS-8217 Pr

[jira] [Commented] (HDFS-8185) Separate client related routines in HAUtil into a new class

2015-04-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506437#comment-14506437 ] Hudson commented on HDFS-8185: -- FAILURE: Integrated in Hadoop-trunk-Commit #7634 (See [https:

[jira] [Updated] (HDFS-8185) Separate client related routines in HAUtil into a new class

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8185: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) I've comm

[jira] [Assigned] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-8213: -- Assignee: Brahma Reddy Battula > DFSClient should not instantiate SpanReceiverHo

[jira] [Commented] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

2015-04-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506409#comment-14506409 ] Rakesh R commented on HDFS-7949: Thanks [~zhz] for the review. Attached another patch where

[jira] [Commented] (HDFS-8197) [umbrella] System tests for EC feature

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506404#comment-14506404 ] Zhe Zhang commented on HDFS-8197: - Thanks for initiating the work Kai! I think the timing i

[jira] [Updated] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

2015-04-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7949: --- Attachment: HDFS-7949-006.patch > WebImageViewer need support file size calculation with striped blocks > -

[jira] [Commented] (HDFS-8209) ArrayIndexOutOfBoundsException in MiniDFSCluster.

2015-04-21 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506393#comment-14506393 ] surendra singh lilhore commented on HDFS-8209: -- [~szetszwo] Thanks , Yes it wi

[jira] [Resolved] (HDFS-8212) DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8212. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed > DistributedFileSystem.creat

[jira] [Commented] (HDFS-8212) DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506375#comment-14506375 ] Zhe Zhang commented on HDFS-8212: - Thanks Nicholas for the work, and reviews from Yi and Br

[jira] [Updated] (HDFS-8216) TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8216: Fix Version/s: HDFS-7285 > TestDFSStripedOutputStream should use BlockReaderTestUtil to create > BlockReader

[jira] [Commented] (HDFS-8216) TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506371#comment-14506371 ] Zhe Zhang commented on HDFS-8216: - Thanks Nicholas for the work and Yi for reviewing! I jus

[jira] [Resolved] (HDFS-8216) TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8216. - Resolution: Fixed Hadoop Flags: Reviewed > TestDFSStripedOutputStream should use BlockReaderTestUtil

[jira] [Commented] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-04-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506368#comment-14506368 ] Walter Su commented on HDFS-7621: - 001 patch is initial patch. No tests included. I want to

[jira] [Updated] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-04-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7621: Attachment: HDFS-7621.001.patch > Erasure Coding: update the Balancer/Mover data migration logic > --

[jira] [Updated] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-04-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7621: Attachment: (was: HDFS-7621.001.patch) > Erasure Coding: update the Balancer/Mover data migration logic >

[jira] [Updated] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-04-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7621: Attachment: HDFS-7621.001.patch > Erasure Coding: update the Balancer/Mover data migration logic > --

[jira] [Updated] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8156: Attachment: HDFS-8156-v9.patch Updated the patch, addressing above comment. Thanks! > Add/implement necessar

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506296#comment-14506296 ] Hadoop QA commented on HDFS-8211: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-4505) Balancer failure with nameservice configuration.

2015-04-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506227#comment-14506227 ] Ravi Prakash commented on HDFS-4505: Thanks for the rebase Stephen! I added the followi

[jira] [Commented] (HDFS-8185) Separate client related routines in HAUtil into a new class

2015-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506222#comment-14506222 ] Hadoop QA commented on HDFS-8185: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-21 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506221#comment-14506221 ] Xinwei Qin commented on HDFS-8156: --- A minor comment: The {{toString()}} method will outp

[jira] [Commented] (HDFS-8147) Mover should not select the DN storage as target where already same replica exists.

2015-04-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506183#comment-14506183 ] Walter Su commented on HDFS-8147: - >... It better to override equals() in StorageGroup. ..

[jira] [Updated] (HDFS-8147) Mover should not select the DN storage as target where already same replica exists.

2015-04-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8147: Attachment: HDFS-8147_2.patch > Mover should not select the DN storage as target where already same replica

[jira] [Updated] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8156: Attachment: HDFS-8156-v8.patch Thanks for the review and comments. bq.Should the DEFAULT_CODEC_NAME be "RS"?

[jira] [Resolved] (HDFS-8204) Balancer: 2 replicas ends in same node after running balance.

2015-04-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-8204. - Resolution: Duplicate > Balancer: 2 replicas ends in same node after running balance. > ---

[jira] [Commented] (HDFS-8209) ArrayIndexOutOfBoundsException in MiniDFSCluster.

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506154#comment-14506154 ] Tsz Wo Nicholas Sze commented on HDFS-8209: --- > .storageTypes(new StorageType[][]

[jira] [Commented] (HDFS-8216) TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader

2015-04-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506152#comment-14506152 ] Yi Liu commented on HDFS-8216: -- +1 > TestDFSStripedOutputStream should use BlockReaderTestUti

[jira] [Commented] (HDFS-8212) DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver

2015-04-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506146#comment-14506146 ] Brahma Reddy Battula commented on HDFS-8212: Patch LGTM ,+1 ( non binding) > D

[jira] [Commented] (HDFS-8212) DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver

2015-04-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506143#comment-14506143 ] Yi Liu commented on HDFS-8212: -- +1 > DistributedFileSystem.createErasureCodingZone should pas

[jira] [Updated] (HDFS-8212) DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8212: -- Attachment: h8212_20150421.patch h8212_20150421.patch > DistributedFileSystem.createEras

[jira] [Comment Edited] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506131#comment-14506131 ] Yi Liu edited comment on HDFS-8033 at 4/22/15 12:42 AM: Thanks Zhe

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506131#comment-14506131 ] Yi Liu commented on HDFS-8033: -- Thanks Zhe for the response, and also thanks Jing for the revi

[jira] [Updated] (HDFS-8216) TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8216: -- Attachment: h8216_20150421.patch h8216_20150421.patch: use BlockReaderTestUtil.getBlockRe

[jira] [Created] (HDFS-8216) TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8216: - Summary: TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader Key: HDFS-8216 URL: https://issues.apache.org/jira/browse/HDFS-8216

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506104#comment-14506104 ] Tsz Wo Nicholas Sze commented on HDFS-8156: --- This one is much better. Thanks. S

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-21 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506098#comment-14506098 ] Takanobu Asanuma commented on HDFS-7687: I created a JIRA to refactor {{NamenodeFsc

[jira] [Created] (HDFS-8215) Refactor NamenodeFsck#check method

2015-04-21 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created HDFS-8215: -- Summary: Refactor NamenodeFsck#check method Key: HDFS-8215 URL: https://issues.apache.org/jira/browse/HDFS-8215 Project: Hadoop HDFS Issue Type: Improvem

[jira] [Created] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-21 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-8214: -- Summary: Secondary NN Web UI shows wrong date for Last Checkpoint Key: HDFS-8214 URL: https://issues.apache.org/jira/browse/HDFS-8214 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8185) Separate client related routines in HAUtil into a new class

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8185: -- Component/s: hdfs-client Hadoop Flags: Reviewed +1 the new patch looks good. Thanks

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506017#comment-14506017 ] Brahma Reddy Battula commented on HDFS-8211: Nice catch, Patch,LGTM +1 ( non bi

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506006#comment-14506006 ] Zhe Zhang commented on HDFS-8033: - Continuing with Jing's comments: bq. In DFSInputStream,

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505991#comment-14505991 ] Zhe Zhang commented on HDFS-8033: - Thanks for the helpful comments Yi and Jing. bq. In DFS

[jira] [Commented] (HDFS-8185) Separate client related routines in HAUtil into a new class

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505988#comment-14505988 ] Haohui Mai commented on HDFS-8185: -- Thanks Nicholas for the review. The v2 patch address N

[jira] [Updated] (HDFS-8185) Separate client related routines in HAUtil into a new class

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8185: - Attachment: HDFS-8185.002.patch > Separate client related routines in HAUtil into a new class > ---

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505982#comment-14505982 ] Anu Engineer commented on HDFS-8211: Also verified that FSDatasetState-UUID appears cor

[jira] [Updated] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8211: --- Status: Patch Available (was: Open) > DataNode UUID is always null in the JMX counter > --

[jira] [Updated] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8211: --- Attachment: hdfs-8211.001.patch > DataNode UUID is always null in the JMX counter > ---

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505968#comment-14505968 ] Anu Engineer commented on HDFS-8211: [~aw] would you like to take a look at this to see

[jira] [Issue Comment Deleted] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8211: Comment: was deleted (was: [~aw] would you like to take a look at this to see if this is related to

[jira] [Commented] (HDFS-8129) Maintain consistent naming for Erasure Coding related classes - EC/ErasureCode

2015-04-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505952#comment-14505952 ] Kai Zheng commented on HDFS-8129: - Maybe we could list all the relevant classes and give th

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-21 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505925#comment-14505925 ] Takanobu Asanuma commented on HDFS-7687: I understand. Thank you. > Change fsck to

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505897#comment-14505897 ] Tsz Wo Nicholas Sze commented on HDFS-7687: --- Yes, refactoring in trunk first. >

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505896#comment-14505896 ] Tsz Wo Nicholas Sze commented on HDFS-7687: --- Yes, refactoring in trunk first. >

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505884#comment-14505884 ] Hadoop QA commented on HDFS-8078: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-21 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505877#comment-14505877 ] Takanobu Asanuma commented on HDFS-7687: Thanks for your review, Nicholas! bq. A C

[jira] [Updated] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8156: Attachment: HDFS-8156-v7.patch How about this one, all your comments addressed. > Add/implement necessary AP

[jira] [Commented] (HDFS-8185) Separate client related routines in HAUtil into a new class

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505867#comment-14505867 ] Tsz Wo Nicholas Sze commented on HDFS-8185: --- - Both DFSUtilClient.locatedBlocks2L

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-21 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505860#comment-14505860 ] Nick Dimiduk commented on HDFS-8213: I think [~billie.rinaldi] is correct here; the cli

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-21 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505854#comment-14505854 ] Billie Rinaldi commented on HDFS-8213: -- If span receiver initialization in DFSClient i

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-21 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505847#comment-14505847 ] Billie Rinaldi commented on HDFS-8213: -- As documented, each process must configure its

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-21 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Patch Available (was: Open) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-21 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Open (was: Patch Available) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505797#comment-14505797 ] Colin Patrick McCabe commented on HDFS-8213: Hi Billie, {{DFSClient}} needs to

[jira] [Commented] (HDFS-8118) Delay in checkpointing Trash can leave trash for 2 intervals before deleting

2015-04-21 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505791#comment-14505791 ] Harsh J commented on HDFS-8118: --- Thanks for explaining that Casey. It makes sense to constant

[jira] [Created] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-21 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created HDFS-8213: Summary: DFSClient should not instantiate SpanReceiverHost Key: HDFS-8213 URL: https://issues.apache.org/jira/browse/HDFS-8213 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-8194) Add administrative tool to be able to examine the NN's view of DN storages

2015-04-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505748#comment-14505748 ] Chris Nauroth commented on HDFS-8194: - There could be some potential overlap here with

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2015-04-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505739#comment-14505739 ] Karthik Kambatla commented on HDFS-7005: Thanks for the ping, [~cnauroth]. [~ndim

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505735#comment-14505735 ] Jing Zhao commented on HDFS-8033: - Thanks for working on this, Zhe! And thanks for the revi

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2015-04-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505722#comment-14505722 ] Chris Nauroth commented on HDFS-7005: - Hi [~ndimiduk]. I'm not aware of any plans for

[jira] [Created] (HDFS-8212) DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8212: - Summary: DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver Key: HDFS-8212 URL: https://issues.apache.org/jira/browse/HDFS-8212

[jira] [Created] (HDFS-8210) Ozone: Implement storage container manager

2015-04-21 Thread Jitendra Nath Pandey (JIRA)
Jitendra Nath Pandey created HDFS-8210: -- Summary: Ozone: Implement storage container manager Key: HDFS-8210 URL: https://issues.apache.org/jira/browse/HDFS-8210 Project: Hadoop HDFS Iss

[jira] [Created] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8211: -- Summary: DataNode UUID is always null in the JMX counter Key: HDFS-8211 URL: https://issues.apache.org/jira/browse/HDFS-8211 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505663#comment-14505663 ] Tsz Wo Nicholas Sze commented on HDFS-8156: --- - Please do not add extractChunkSize

[jira] [Commented] (HDFS-8207) Improper log mesage when blockreport interval comapred with initial delay

2015-04-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505653#comment-14505653 ] Hadoop QA commented on HDFS-8207: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2015-04-21 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505636#comment-14505636 ] Nick Dimiduk commented on HDFS-7005: Any chance of bringing this to a 2.5.x patch relea

[jira] [Updated] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8200: - Attachment: HDFS-8200.001.patch > Refactor FSDirStatAndListingOp > -- > >

[jira] [Moved] (HDFS-8209) ArrayIndexOutOfBoundsException in MiniDFSCluster.

2015-04-21 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore moved HADOOP-11856 to HDFS-8209: --- Component/s: (was: test)

[jira] [Updated] (HDFS-8133) Improve readability of deleted block check

2015-04-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8133: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-8133) Improve readability of deleted block check

2015-04-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505512#comment-14505512 ] Hudson commented on HDFS-8133: -- FAILURE: Integrated in Hadoop-trunk-Commit #7626 (See [https:

[jira] [Commented] (HDFS-8133) Improve readability of deleted block check

2015-04-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505479#comment-14505479 ] Colin Patrick McCabe commented on HDFS-8133: +1. Thanks, Daryn. Test failures

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505467#comment-14505467 ] Tsz Wo Nicholas Sze commented on HDFS-7687: --- For #1, see if you want to create a

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505463#comment-14505463 ] Tsz Wo Nicholas Sze commented on HDFS-7687: --- The items looks good. Just a minor

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505449#comment-14505449 ] Zhe Zhang commented on HDFS-8193: - Thanks for the pointers Chris! A mock-up is a very good

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-21 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: HDFS-8078.4.patch > HDFS client gets errors trying to to connect to IPv6 DataNode > -

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-21 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: (was: HDFS-8078.4.patch) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Commented] (HDFS-8163) Using monotonicNow for block report scheduling causes test failures on recently restarted systems

2015-04-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505432#comment-14505432 ] Hudson commented on HDFS-8163: -- FAILURE: Integrated in Hadoop-trunk-Commit #7624 (See [https:

  1   2   >