[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250520#comment-15250520 ] Xiaobing Zhou commented on HDFS-10207: -- Thanks [~xyao] for reviews. v005 addressed all your comments

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250521#comment-15250521 ] Yongjun Zhang commented on HDFS-10313: -- BTW, there is a method {{getSourceSnapshotPath(Path

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-04-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250640#comment-15250640 ] Ravi Prakash commented on HDFS-6489: >From Bogdan's code (thanks for that :-) ) I see its not #1 in my

[jira] [Updated] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10207: - Attachment: HDFS-10207-HDFS-9000.006.patch > Support enable Hadoop IPC backoff without namenode

[jira] [Updated] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10309: --- Priority: Minor (was: Major) Hadoop Flags: Reviewed +1 the new patch looks

[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10319: --- Status: Patch Available (was: Open) > Balancer should not try to pair storages with

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root

2016-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250617#comment-15250617 ] Yongjun Zhang commented on HDFS-9670: - Thanks for the new rev [~jzhuge], LGTM, +1 and I will commit

[jira] [Updated] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10264: --- Target Version/s: 2.6.5 +1 from me too. Could we please commit this to 2.6 branch as

[jira] [Comment Edited] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250521#comment-15250521 ] Yongjun Zhang edited comment on HDFS-10313 at 4/20/16 7:03 PM: --- In addition,

[jira] [Commented] (HDFS-10308) TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing

2016-04-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250584#comment-15250584 ] Hudson commented on HDFS-10308: --- FAILURE: Integrated in Hadoop-trunk-Commit #9636 (See

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250582#comment-15250582 ] Jing Zhao commented on HDFS-10313: -- bq. the old behavior is that we fallback to regular distcp if sync

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-04-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250626#comment-15250626 ] Ravi Prakash commented on HDFS-6489: Unfortunately I don't think your approach will work Weiwei! The du

[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10319: --- Attachment: h10319_20160420.patch h10319_20160420.patch: matches storage types. >

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250714#comment-15250714 ] Xiaobing Zhou commented on HDFS-10207: -- patch v006 removed some unused imports, e.g. {code} - import

[jira] [Updated] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10207: - Attachment: HDFS-10207-HDFS-9000.005.patch > Support enable Hadoop IPC backoff without namenode

[jira] [Commented] (HDFS-10308) TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing

2016-04-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250510#comment-15250510 ] Rakesh R commented on HDFS-10308: - Thanks [~cmccabe], for reviewing and committing the patch. >

[jira] [Created] (HDFS-10319) Balancer should not try to pair storages with different types

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-10319: -- Summary: Balancer should not try to pair storages with different types Key: HDFS-10319 URL: https://issues.apache.org/jira/browse/HDFS-10319 Project:

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Status: Patch Available (was: Open) > libhdfs++: DatanodeConnection::Cancel should not

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Attachment: HDFS-10311.HDFS-8707.000.patch Fix for this bug: -add lock guards to

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-04-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250592#comment-15250592 ] Ravi Prakash commented on HDFS-6489: Thanks for the patch [~cheersyang]! Could you please let me know

[jira] [Updated] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

2016-04-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10312: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Updated] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Anand updated HDFS-10309: -- Attachment: HDFS-10309.02.patch > HDFS Balancer doesn't honor dfs.blocksize value defined with suffix

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249363#comment-15249363 ] Zhe Zhang commented on HDFS-9869: - bq. How about keeping only the recent property name |

[jira] [Updated] (HDFS-5280) Corrupted meta files on data nodes prevents DFClient from connecting to data nodes and updating corruption status to name node.

2016-04-20 Thread Andres Perez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated HDFS-5280: --- Attachment: HDFS-5280.patch > Corrupted meta files on data nodes prevents DFClient from connecting to

[jira] [Updated] (HDFS-5280) Corrupted meta files on data nodes prevents DFClient from connecting to data nodes and updating corruption status to name node.

2016-04-20 Thread Andres Perez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated HDFS-5280: --- Affects Version/s: 3.0.0 Status: Patch Available (was: Open) The

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249351#comment-15249351 ] Hadoop QA commented on HDFS-10313: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249372#comment-15249372 ] Andrew Wang commented on HDFS-9869: --- I like Zhe's proposal. I'd prefer to keep the old keys around if

[jira] [Commented] (HDFS-10256) Use GenericTestUtils.getTestDir method in tests for temporary directories

2016-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249340#comment-15249340 ] Vinayakumar B commented on HDFS-10256: -- bq. MiniDFSCluster#shutdown() registers base_dir to be

[jira] [Comment Edited] (HDFS-10256) Use GenericTestUtils.getTestDir method in tests for temporary directories

2016-04-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249340#comment-15249340 ] Vinayakumar B edited comment on HDFS-10256 at 4/20/16 6:09 AM: --- bq.

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249371#comment-15249371 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-20 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249525#comment-15249525 ] Takanobu Asanuma commented on HDFS-8057: Some comments for test results: * I think checkstyle warns

[jira] [Created] (HDFS-10317) dfs.domain.socket.path is not set in TestShortCircuitLocalRead.testReadWithRemoteBlockReader

2016-04-20 Thread Li Bo (JIRA)
Li Bo created HDFS-10317: Summary: dfs.domain.socket.path is not set in TestShortCircuitLocalRead.testReadWithRemoteBlockReader Key: HDFS-10317 URL: https://issues.apache.org/jira/browse/HDFS-10317 Project:

[jira] [Commented] (HDFS-10276) Different results for exist call for file.ext/name

2016-04-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249555#comment-15249555 ] Yuanbo Liu commented on HDFS-10276: --- [~cmccabe] Thanks for your comment. Yes I agree with you that we

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249390#comment-15249390 ] Hadoop QA commented on HDFS-8057: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

2016-04-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249482#comment-15249482 ] Brahma Reddy Battula commented on HDFS-10312: - You are right. It would be non-trivial for

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249607#comment-15249607 ] Hadoop QA commented on HDFS-8449: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-04-20 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8449: Attachment: HDFS-8449-005.patch Thanks Kai's review. There're several other ec related metrics to add, so I think

[jira] [Updated] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-20 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10318: Description: When a metric has incorrect value the DFSTestUtil.waitForMetric waits 60 sec then

[jira] [Assigned] (HDFS-10318) TestJMXGet:testNameNode() fails

2016-04-20 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor reassigned HDFS-10318: --- Assignee: Andras Bokor (was: Gergely Novák) > TestJMXGet:testNameNode() fails >

[jira] [Created] (HDFS-10318) TestJMXGet:testNameNode() fails

2016-04-20 Thread Andras Bokor (JIRA)
Andras Bokor created HDFS-10318: --- Summary: TestJMXGet:testNameNode() fails Key: HDFS-10318 URL: https://issues.apache.org/jira/browse/HDFS-10318 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-5280) Corrupted meta files on data nodes prevents DFClient from connecting to data nodes and updating corruption status to name node.

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249701#comment-15249701 ] Hadoop QA commented on HDFS-5280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-20 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10318: Summary: TestJMXGet hides the real error in case of test failure (was: TestJMXGet:testNameNode()

[jira] [Work started] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10309 started by Amit Anand. - > HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), >

[jira] [Updated] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-20 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10318: Attachment: TestJMXGetFails.log > TestJMXGet hides the real error in case of test failure >

[jira] [Updated] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Anand updated HDFS-10309: -- Fix Version/s: 2.8.0 Status: Patch Available (was: In Progress) > HDFS Balancer doesn't

[jira] [Updated] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Anand updated HDFS-10309: -- Attachment: HDFS-10309.01.patch > HDFS Balancer doesn't honor dfs.blocksize value defined with suffix

[jira] [Assigned] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-04-20 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu reassigned HDFS-9890: - Assignee: Xiaowei Zhu (was: Stephen) > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-20 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10318: Attachment: HDFS-10318.01.patch [~kihwal] Could you please review my patch? Since we worked with

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-04-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.002.patch Uploaded a patch with some of the read pipeline error

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-04-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250095#comment-15250095 ] Rakesh R commented on HDFS-9833: Thank you [~drankye], I will soon come up with a proposal. > Erasure

[jira] [Commented] (HDFS-5280) Corrupted meta files on data nodes prevents DFClient from connecting to data nodes and updating corruption status to name node.

2016-04-20 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249649#comment-15249649 ] Walter Su commented on HDFS-5280: - +1 for catching the exception. The same exception will cause

[jira] [Commented] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249743#comment-15249743 ] Amit Anand commented on HDFS-10309: --- After building the patched jar I was able to test it successfully:

[jira] [Updated] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-20 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10318: Status: Patch Available (was: Open) > TestJMXGet hides the real error in case of test failure >

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9869: --- Attachment: HDFS-9869-005.patch > Erasure Coding: Rename replication-based names in BlockManager to more >

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249897#comment-15249897 ] Rakesh R commented on HDFS-9869: Thanks [~zhz], [~andrew.wang] for the advice. Attached new patch with the

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

2016-04-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249906#comment-15249906 ] Chris Nauroth commented on HDFS-10312: -- bq. With your patch, to come out the current case,

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-04-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249965#comment-15249965 ] Kai Zheng commented on HDFS-9833: - Per off-line discussion with [~rakeshr], he'd like to help with this and

[jira] [Updated] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-04-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9833: Assignee: Rakesh R (was: Kai Zheng) > Erasure coding: recomputing block checksum on the fly by

[jira] [Updated] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-20 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10318: Hadoop Flags: (was: Reviewed) > TestJMXGet hides the real error in case of test failure >

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250193#comment-15250193 ] Hadoop QA commented on HDFS-9890: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250219#comment-15250219 ] Hadoop QA commented on HDFS-9869: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250176#comment-15250176 ] Hadoop QA commented on HDFS-10309: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250323#comment-15250323 ] Hadoop QA commented on HDFS-10318: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250439#comment-15250439 ] Tsz Wo Nicholas Sze commented on HDFS-10309: Hi Amit, thanks for working on this. Could you

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250438#comment-15250438 ] Yongjun Zhang commented on HDFS-10313: -- Hi [~linyiqun], Thanks a lot for working on this issue! I

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250443#comment-15250443 ] Tsz Wo Nicholas Sze commented on HDFS-8057: --- Thanks for checking the results. Will wait for your

[jira] [Commented] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

2016-04-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250821#comment-15250821 ] Jing Zhao commented on HDFS-9894: - +1 pending Jenkins. > Add unsetStoragePolicy API to

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250820#comment-15250820 ] Xiaobing Zhou commented on HDFS-10207: -- Patch v007 removed the unused imports. Thanks [~xyao] for

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250903#comment-15250903 ] Xiaoyu Yao commented on HDFS-10207: --- There are 4 more checkstyle issues (in addition to the 3 imports)

[jira] [Updated] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10175: Attachment: HDFS-10175.006.patch I posted patch 006 as an example of what I was

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251177#comment-15251177 ] Hadoop QA commented on HDFS-10207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-04-20 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251150#comment-15251150 ] Walter Su commented on HDFS-10220: -- 1. isMaxFilesCheckedToReleaseLease is not requirted to be a function.

[jira] [Commented] (HDFS-10224) Implement an asynchronous DistributedFileSystem

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251159#comment-15251159 ] Hadoop QA commented on HDFS-10224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-04-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251140#comment-15251140 ] Weiwei Yang commented on HDFS-6489: --- [~raviprak] Thanks for looking at this. #1 Yes, this issue can be

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250807#comment-15250807 ] Colin Patrick McCabe commented on HDFS-10175: - I thought about this a little bit more, and I

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-04-20 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250841#comment-15250841 ] Nicolas Fraison commented on HDFS-10220: [~vinayrpet], there is one checkstyle issue remaining but

[jira] [Commented] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250896#comment-15250896 ] Hadoop QA commented on HDFS-10309: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

2016-04-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250993#comment-15250993 ] Zhe Zhang commented on HDFS-9806: - Thanks [~chris.douglas] for proposing the work and [~virajith] for the

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Attachment: HDFS-10311.HDFS-8707.001.patch New patch, cleaned some stuff up. > libhdfs++:

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

2016-04-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250792#comment-15250792 ] Hudson commented on HDFS-10312: --- FAILURE: Integrated in Hadoop-trunk-Commit #9637 (See

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250880#comment-15250880 ] Hadoop QA commented on HDFS-10207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10207: - Attachment: HDFS-10207-HDFS-9000.007.patch > Support enable Hadoop IPC backoff without namenode

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251006#comment-15251006 ] John Zhuge commented on HDFS-10297: --- Could someone kindly review this simple patch? > Increase default

[jira] [Commented] (HDFS-10317) dfs.domain.socket.path is not set in TestShortCircuitLocalRead.testReadWithRemoteBlockReader

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250868#comment-15250868 ] Xiaobing Zhou commented on HDFS-10317: -- [~libo-intel] can you comment how to reproduce it? Thank you.

[jira] [Created] (HDFS-10320) Rack failures may result in NN terminate

2016-04-20 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-10320: Summary: Rack failures may result in NN terminate Key: HDFS-10320 URL: https://issues.apache.org/jira/browse/HDFS-10320 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10320) Rack failures may result in NN terminate

2016-04-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250924#comment-15250924 ] Xiao Chen commented on HDFS-10320: -- The failure is due to a race, since in {{BPPD#chooseRandom}} we

[jira] [Updated] (HDFS-10320) Rack failures may result in NN terminate

2016-04-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10320: - Attachment: HDFS-10320.01.patch Patch 1 logs an error when {{NetworkTopology#chooseRandom}} cannot choose

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251041#comment-15251041 ] Hadoop QA commented on HDFS-10175: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-20 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8057: --- Attachment: HDFS-8057.2.patch Thanks for the comment, Nicholas. I uploaded a new patch. I

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-20 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251220#comment-15251220 ] Takanobu Asanuma commented on HDFS-8057: I created the jira(HDFS-10321) for cleaning up checkstyle

[jira] [Updated] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10207: - Attachment: HDFS-10207-HDFS-9000.008.patch Patch v008 fixed two check style issues. > Support

[jira] [Created] (HDFS-10321) Clean up checkstyle warnings in BlockReader

2016-04-20 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created HDFS-10321: --- Summary: Clean up checkstyle warnings in BlockReader Key: HDFS-10321 URL: https://issues.apache.org/jira/browse/HDFS-10321 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

2016-04-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: HDFS-10313.002.patch Thanks [~yzhangal] for review. Update the latest for addressing the

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

2016-04-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251217#comment-15251217 ] Xiaobing Zhou commented on HDFS-10207: -- Thanks [~xyao], this is output of patch v005, forget about

[jira] [Comment Edited] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

2016-04-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251275#comment-15251275 ] Colin Patrick McCabe edited comment on HDFS-10301 at 4/21/16 4:58 AM: --

[jira] [Commented] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

2016-04-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251275#comment-15251275 ] Colin Patrick McCabe commented on HDFS-10301: - Thanks for the bug report. This is a tricky

[jira] [Updated] (HDFS-10320) Rack failures may result in NN terminate

2016-04-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10320: - Status: Patch Available (was: Open) > Rack failures may result in NN terminate >

[jira] [Commented] (HDFS-10276) Different results for exist call for file.ext/name

2016-04-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250459#comment-15250459 ] Colin Patrick McCabe commented on HDFS-10276: - bq. I think it's more reasonable to throw

[jira] [Commented] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

2016-04-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250468#comment-15250468 ] Colin Patrick McCabe commented on HDFS-10265: - Thanks, [~rakesh_r] and [~brahmareddy]. I will

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9869: --- Attachment: HDFS-9869-006.patch Attached another patch fixing {{TestHdfsConfigFields}} test case failure. >

  1   2   >