[jira] [Commented] (HDFS-2580) NameNode#main(...) can make use of GenericOptionsParser.

2016-03-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210980#comment-15210980 ] Konstantin Shvachko commented on HDFS-2580: --- This is an old patch, but never made

[jira] [Created] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-05 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-10264: -- Summary: Logging improvements in FSImageFormatProtobuf.Saver Key: HDFS-10264 URL: https://issues.apache.org/jira/browse/HDFS-10264 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227509#comment-15227509 ] Konstantin Shvachko commented on HDFS-10264: Add the following to {{FSImageFor

[jira] [Created] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

2016-04-17 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-10301: -- Summary: Blocks removed by thousands due to falsely detected zombie storages Key: HDFS-10301 URL: https://issues.apache.org/jira/browse/HDFS-10301 Project

[jira] [Commented] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

2016-04-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244876#comment-15244876 ] Konstantin Shvachko commented on HDFS-10301: More details. # My DataNode has 6

[jira] [Commented] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

2016-04-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244890#comment-15244890 ] Konstantin Shvachko commented on HDFS-10301: My DN has the following six stora

[jira] [Updated] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

2016-04-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10301: --- Attachment: zombieStorageLogs.rtf > Blocks removed by thousands due to falsely detecte

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15246500#comment-15246500 ] Konstantin Shvachko commented on HDFS-10264: Makes sense. Good suggestions, An

[jira] [Commented] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

2016-04-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15246571#comment-15246571 ] Konstantin Shvachko commented on HDFS-10301: Hey Daryn, not sure how HDFS-9198

[jira] [Updated] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10264: --- Target Version/s: 2.6.5 +1 from me too. Could we please commit this to 2.6 branch as w

[jira] [Commented] (HDFS-10301) Blocks removed by thousands due to falsely detected zombie storages

2016-04-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252377#comment-15252377 ] Konstantin Shvachko commented on HDFS-10301: Hey Walter, your patch looks good

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252696#comment-15252696 ] Konstantin Shvachko commented on HDFS-10264: Hey [~arpitagarwal], it looks lik

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252709#comment-15252709 ] Konstantin Shvachko commented on HDFS-10264: Sorry, please ignore the above: i

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252710#comment-15252710 ] Konstantin Shvachko commented on HDFS-10264: My bad. > Logging improvements i

[jira] [Updated] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10264: --- Fix Version/s: (was: 2.7.3) 2.6.5 Committed to branch 2.6. > L

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2016-04-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15254353#comment-15254353 ] Konstantin Shvachko commented on HDFS-10264: No problem, Arpit. I thought that

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15254668#comment-15254668 ] Konstantin Shvachko commented on HDFS-10301: Hey [~walter.k.su], sorry let me

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15254673#comment-15254673 ] Konstantin Shvachko commented on HDFS-10301: [~cmccabe] I don't think that HDF

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15254994#comment-15254994 ] Konstantin Shvachko commented on HDFS-10301: Colin I ran your unit test and ve

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257164#comment-15257164 ] Konstantin Shvachko commented on HDFS-10301: Yes, on trunk {{generateUniqueBlo

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259278#comment-15259278 ] Konstantin Shvachko commented on HDFS-10301: Hey Colin, I reviewed your patch

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259284#comment-15259284 ] Konstantin Shvachko commented on HDFS-10301: May be we should go with a differ

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259688#comment-15259688 ] Konstantin Shvachko commented on HDFS-10301: ??Maybe I'm misunderstanding the

[jira] [Updated] (HDFS-2580) NameNode#main(...) can make use of GenericOptionsParser.

2016-05-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-2580: -- Fix Version/s: (was: 3.0.0) 2.6.5 2.7.3 Committ

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271737#comment-15271737 ] Konstantin Shvachko commented on HDFS-10301: ??In the short term, however, I w

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271743#comment-15271743 ] Konstantin Shvachko commented on HDFS-10301: Daryn, I also proposed throwing a

[jira] [Commented] (HDFS-7330) Unclosed RandomAccessFile warnings in FSDatasetIml.

2016-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271785#comment-15271785 ] Konstantin Shvachko commented on HDFS-7330: --- Hey [~boky01], I do not see it on tr

[jira] [Resolved] (HDFS-7330) Unclosed RandomAccessFile warnings in FSDatasetIml.

2016-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-7330. --- Resolution: Duplicate Fix Version/s: 2.7.0 > Unclosed RandomAccessFile warnings

[jira] [Closed] (HDFS-7330) Unclosed RandomAccessFile warnings in FSDatasetIml.

2016-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko closed HDFS-7330. - > Unclosed RandomAccessFile warnings in FSDatasetIml. > ---

[jira] [Updated] (HDFS-7258) CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level

2016-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7258: -- Fix Version/s: 2.6.5 Committed to branch-2.6. > CacheReplicationMonitor rescan schedule

[jira] [Created] (HDFS-10377) CacheReplicationMonitor shutdown log message should use INFO level.

2016-05-06 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-10377: -- Summary: CacheReplicationMonitor shutdown log message should use INFO level. Key: HDFS-10377 URL: https://issues.apache.org/jira/browse/HDFS-10377 Project

[jira] [Commented] (HDFS-10377) CacheReplicationMonitor shutdown log message should use INFO level.

2016-05-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275355#comment-15275355 ] Konstantin Shvachko commented on HDFS-10377: +1. The patch looks good. > Cach

[jira] [Commented] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2015-11-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009360#comment-15009360 ] Konstantin Shvachko commented on HDFS-9379: --- It would make sense to change the de

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009395#comment-15009395 ] Konstantin Shvachko commented on HDFS-9407: --- Yes, just removing the line {{-

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-11-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009534#comment-15009534 ] Konstantin Shvachko commented on HDFS-7847: --- Shouldn't we be specifying the namen

[jira] [Comment Edited] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-11-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009534#comment-15009534 ] Konstantin Shvachko edited comment on HDFS-7847 at 11/17/15 9:21 PM:

[jira] [Commented] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2015-11-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009604#comment-15009604 ] Konstantin Shvachko commented on HDFS-9379: --- Yes, the test for NNThroughputBenchm

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-11-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009837#comment-15009837 ] Konstantin Shvachko commented on HDFS-7847: --- ??The motivation was to have a simpl

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-19 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15014178#comment-15014178 ] Konstantin Shvachko commented on HDFS-9407: --- Walter, yes keeping a specific port

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-11-19 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15014253#comment-15014253 ] Konstantin Shvachko commented on HDFS-7847: --- Yes, {{NNThroughputBenchmark}} is a

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-19 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15014274#comment-15014274 ] Konstantin Shvachko commented on HDFS-9407: --- Just to clarify, I do not advocate f

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025506#comment-15025506 ] Konstantin Shvachko commented on HDFS-9436: --- Hey Mingliang, I thought you will in

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026024#comment-15026024 ] Konstantin Shvachko commented on HDFS-9407: --- Actually, could you please also reve

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026045#comment-15026045 ] Konstantin Shvachko commented on HDFS-9407: --- I meant not revert HDFS-9224, but ra

[jira] [Updated] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9407: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-11-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027910#comment-15027910 ] Konstantin Shvachko commented on HDFS-7435: --- I agree this broke {NNThroughputBenc

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027931#comment-15027931 ] Konstantin Shvachko commented on HDFS-9436: --- In {{BlockReportStats}} - {{numOpsR

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9436: -- Target Version/s: 2.8.0 Fix Version/s: (was: 2.8.0) > Make NNThroughputBenchma

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-12-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036932#comment-15036932 ] Konstantin Shvachko commented on HDFS-9436: --- {{numOpsRequired = 10}} and the {{nu

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-12-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037067#comment-15037067 ] Konstantin Shvachko commented on HDFS-9484: --- Yes indeed {{nrBlocks == blocks.size

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-12-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037072#comment-15037072 ] Konstantin Shvachko commented on HDFS-9436: --- Three is better. +1 > Make NNThroug

[jira] [Created] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2015-12-03 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-9503: - Summary: Replace -namenode option with -fs for NNThroughputBenchmark Key: HDFS-9503 URL: https://issues.apache.org/jira/browse/HDFS-9503 Project: Hadoop HDF

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-12-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038342#comment-15038342 ] Konstantin Shvachko commented on HDFS-7847: --- I created HDFS-9503 to replace the {

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-12-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038347#comment-15038347 ] Konstantin Shvachko commented on HDFS-9484: --- +1 Will commit both shortly. > NNTh

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-12-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9436: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-12-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9484: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049644#comment-15049644 ] Konstantin Shvachko commented on HDFS-9516: --- Indeed, looks like an attempt to ren

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049658#comment-15049658 ] Konstantin Shvachko commented on HDFS-9516: --- Btw which branch are you running it

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053440#comment-15053440 ] Konstantin Shvachko commented on HDFS-9516: --- Plamen, the fix looks good. * I thin

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057550#comment-15057550 ] Konstantin Shvachko commented on HDFS-9516: --- +1 on the latest patch. The Jenkins

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9516: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Statu

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9516: -- Fix Version/s: (was: 2.9.0) 2.7.3 Committed to branch-2.8 and bran

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-12-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064771#comment-15064771 ] Konstantin Shvachko commented on HDFS-8999: --- Kihwal, I did not understand exactly

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-12-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15065165#comment-15065165 ] Konstantin Shvachko commented on HDFS-8999: --- > the goal of this jira is to allow

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-12-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068676#comment-15068676 ] Konstantin Shvachko commented on HDFS-8999: --- Before commenting on suggested solut

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073339#comment-15073339 ] Konstantin Shvachko commented on HDFS-8999: --- What is "the block receipt RPC"? Whi

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-12-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074148#comment-15074148 ] Konstantin Shvachko commented on HDFS-8999: --- Thought so. But # The IBR problem is

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086562#comment-15086562 ] Konstantin Shvachko commented on HDFS-8999: --- COMPLETE state used to mean that the

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086570#comment-15086570 ] Konstantin Shvachko commented on HDFS-8999: --- > Let's test with the last block to

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS

2016-01-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088000#comment-15088000 ] Konstantin Shvachko commented on HDFS-9607: --- Dinesh, "random writes" should be in

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS

2016-01-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088023#comment-15088023 ] Konstantin Shvachko commented on HDFS-9607: --- Just want to add that random writes

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS Update (write-in-place)

2016-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120280#comment-15120280 ] Konstantin Shvachko commented on HDFS-9607: --- > Even though HDFS files stores byt

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15122549#comment-15122549 ] Konstantin Shvachko commented on HDFS-9503: --- Mingliang, I could not apply your la

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124229#comment-15124229 ] Konstantin Shvachko commented on HDFS-9503: --- > If anybody out there feels these c

[jira] [Resolved] (HDFS-1613) NPE running NNThroughputBenchmark

2016-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-1613. --- Resolution: Not A Problem This is probably obsolete at this point. Resolving as No Prob

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124403#comment-15124403 ] Konstantin Shvachko commented on HDFS-9503: --- # Mingliang, there is still some pro

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127376#comment-15127376 ] Konstantin Shvachko commented on HDFS-9503: --- Sorry, it was my fault, I used some

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127725#comment-15127725 ] Konstantin Shvachko commented on HDFS-9503: --- Hey Vinayakumar. The patch will inde

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129357#comment-15129357 ] Konstantin Shvachko commented on HDFS-9503: --- Hey [~liuml07] I was trying to commi

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-02-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9601: -- Target Version/s: 2.8.0 This should be pushed to branch-2.8.0 as it breaks TestNNThroughp

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-02-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9601: -- Fix Version/s: 2.8.0 Committed to branch-2.8, updated Fix Version. > NNThroughputBenchma

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9503: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Statu

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

2015-08-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724432#comment-14724432 ] Konstantin Shvachko commented on HDFS-8763: --- Hey guys, it looks to me that this w

[jira] [Commented] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

2015-08-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724466#comment-14724466 ] Konstantin Shvachko commented on HDFS-8984: --- Not sure it is a good idea to introd

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

2015-09-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726308#comment-14726308 ] Konstantin Shvachko commented on HDFS-8763: --- A different jira for a different top

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-09-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726445#comment-14726445 ] Konstantin Shvachko commented on HDFS-8999: --- The current logic as I remember it w

[jira] [Commented] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

2015-09-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728220#comment-14728220 ] Konstantin Shvachko commented on HDFS-8984: --- Some comments on the latest patch re

[jira] [Commented] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

2015-09-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728270#comment-14728270 ] Konstantin Shvachko commented on HDFS-8984: --- Well, that was based on 002 patch.

[jira] [Commented] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

2015-09-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14730148#comment-14730148 ] Konstantin Shvachko commented on HDFS-8984: --- +1 modular Jings nit and my comment

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-09-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733172#comment-14733172 ] Konstantin Shvachko commented on HDFS-8999: --- Spent some time browsing jira. This

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

2015-09-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733173#comment-14733173 ] Konstantin Shvachko commented on HDFS-8763: --- I think we can close this as a dupli

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-09-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14791779#comment-14791779 ] Konstantin Shvachko commented on HDFS-3107: --- I would say absolutely go for it. As

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-10-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941846#comment-14941846 ] Konstantin Shvachko commented on HDFS-3107: --- Sorry, got distracted. It would be g

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14528895#comment-14528895 ] Konstantin Shvachko commented on HDFS-2484: --- Hey Rakesh, your change looks good t

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529302#comment-14529302 ] Konstantin Shvachko commented on HDFS-2484: --- +1 pending Jenkins. > checkLease sh

[jira] [Commented] (HDFS-8286) Scaling out the namespace using KV store

2015-05-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529524#comment-14529524 ] Konstantin Shvachko commented on HDFS-8286: --- Hey guys, I read the design doc, and

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531623#comment-14531623 ] Konstantin Shvachko commented on HDFS-2484: --- What is "BB2015-05-TBR" any way - so

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-2484: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Statu

[jira] [Commented] (HDFS-8394) Move getAdditionalBlock() and related functionalities into a separate class

2015-05-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14548397#comment-14548397 ] Konstantin Shvachko commented on HDFS-8394: --- I was wondering what is the reason f

[jira] [Commented] (HDFS-8421) Move startFile() and related operations into FSDirWriteFileOp

2015-05-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14548422#comment-14548422 ] Konstantin Shvachko commented on HDFS-8421: --- Are you rewriting HDFS in C-style al

  1   2   3   4   5   6   7   8   9   10   >