[jira] [Updated] (HDFS-9599) TestDecommissioningStatus.testDecommissionStatus occasionally fails

2016-04-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9599: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Target

[jira] [Commented] (HDFS-9599) TestDecommissioningStatus.testDecommissionStatus occasionally fails

2016-04-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224729#comment-15224729 ] Masatake Iwasaki commented on HDFS-9599: +1 > TestDecommissioningStatus.testDecommissionStatus

[jira] [Updated] (HDFS-3743) QJM: improve formatting behavior for JNs

2016-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-3743: --- Assignee: (was: Masatake Iwasaki) > QJM: improve formatting behavior for JNs >

[jira] [Assigned] (HDFS-3743) QJM: improve formatting behavior for JNs

2016-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-3743: -- Assignee: Masatake Iwasaki > QJM: improve formatting behavior for JNs >

[jira] [Commented] (HDFS-10178) Permanent write failures can happen if pipeline recoveries occur for the first packet

2016-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222588#comment-15222588 ] Masatake Iwasaki commented on HDFS-10178: - {code} 577 // For testing. Delay sending

[jira] [Resolved] (HDFS-10230) HDFS Native Client build failed

2016-03-30 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-10230. - Resolution: Duplicate I'm going to close this as duplicate of HADOOP-12692. Please reopen

[jira] [Commented] (HDFS-10230) HDFS Native Client build failed

2016-03-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216173#comment-15216173 ] Masatake Iwasaki commented on HDFS-10230: - The cause seems to be slowing down of the build

[jira] [Updated] (HDFS-9954) Test RPC timeout fix of HADOOP-12672 against HDFS

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9954: --- Resolution: Invalid Status: Resolved (was: Patch Available) It turned out that

[jira] [Updated] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9928: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Target

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195148#comment-15195148 ] Masatake Iwasaki commented on HDFS-9928: +1 > Make HDFS commands guide up to date >

[jira] [Updated] (HDFS-9954) Test RPC timeout fix of HADOOP-12672 against HDFS

2016-03-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9954: --- Status: Patch Available (was: Open) > Test RPC timeout fix of HADOOP-12672 against HDFS >

[jira] [Updated] (HDFS-9954) Test RPC timeout fix of HADOOP-12672 against HDFS

2016-03-14 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9954: --- Attachment: HDFS-9954.006.patch attaching 006 patch of HADOOP-12672 to test it against HDFS.

[jira] [Created] (HDFS-9954) Test RPC timeout fix of HADOOP-12672 against HDFS

2016-03-14 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9954: -- Summary: Test RPC timeout fix of HADOOP-12672 against HDFS Key: HDFS-9954 URL: https://issues.apache.org/jira/browse/HDFS-9954 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192392#comment-15192392 ] Masatake Iwasaki commented on HDFS-9928: Thanks for the update, [~jojochuang]. The patch looks

[jira] [Commented] (HDFS-9942) Add an HTrace span when refreshing the groups for a username

2016-03-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15190489#comment-15190489 ] Masatake Iwasaki commented on HDFS-9942: +1 BTW, this looks like the use case of NullTracer being

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189599#comment-15189599 ] Masatake Iwasaki commented on HDFS-9928: How about targeting 2.9.0 here by just reverting the part

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189595#comment-15189595 ] Masatake Iwasaki commented on HDFS-9928: {noformat} + hdfs storagepolicies +

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189573#comment-15189573 ] Masatake Iwasaki commented on HDFS-9928: {noformat} hdfs dfsadmin [GENERIC_OPTIONS]

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189527#comment-15189527 ] Masatake Iwasaki commented on HDFS-9928: {noformat} -Usage: `hdfs cacheadmin -addDirective -path

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189512#comment-15189512 ] Masatake Iwasaki commented on HDFS-9928: {noformat} 264 | `-h`\|`--help` | Display the tool

[jira] [Commented] (HDFS-9895) Remove all cached configuration from DataNode

2016-03-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189449#comment-15189449 ] Masatake Iwasaki commented on HDFS-9895: Current implementation does not need this because

[jira] [Updated] (HDFS-9884) Use doxia macro to generate in-page TOC of HDFS site documentation

2016-03-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9884: --- Status: Patch Available (was: Open) > Use doxia macro to generate in-page TOC of HDFS site

[jira] [Updated] (HDFS-9884) Use doxia macro to generate in-page TOC of HDFS site documentation

2016-03-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9884: --- Attachment: HDFS-9884.001.patch Since HADOOP-12470 came in, we can use toc macro in HDFS docs.

[jira] [Updated] (HDFS-9865) TestBlockReplacement fails intermittently in trunk

2016-03-07 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9865: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3

[jira] [Commented] (HDFS-9476) TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail

2016-03-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182645#comment-15182645 ] Masatake Iwasaki commented on HDFS-9476: Sorry, this was wrong.. "Cannot obtain block length for

[jira] [Commented] (HDFS-9476) TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail

2016-03-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182641#comment-15182641 ] Masatake Iwasaki commented on HDFS-9476: The message "Cannot obtain block length for

[jira] [Commented] (HDFS-9865) TestBlockReplacement fails intermittently in trunk

2016-03-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182627#comment-15182627 ] Masatake Iwasaki commented on HDFS-9865: Thanks for working on this, [~linyiqun]. {code} 415

[jira] [Updated] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9048: --- Resolution: Fixed Fix Version/s: 2.7.3 2.8.0 Target

[jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15177490#comment-15177490 ] Masatake Iwasaki commented on HDFS-9048: {{namenode_address}} or {{namenode_host}} should be fine.

[jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-02 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175631#comment-15175631 ] Masatake Iwasaki commented on HDFS-9048: Thanks for the update [~daisuke.kobayashi]. If you prefer

[jira] [Updated] (HDFS-9884) Use doxia macro to generate in-page TOC of HDFS site documentation

2016-03-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9884: --- Description: Since maven-site-plugin 3.5 was released, we can use toc macro in Markdown.

[jira] [Created] (HDFS-9884) Use doxia macro to generate in-page TOC of HDFS site documentation

2016-03-01 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9884: -- Summary: Use doxia macro to generate in-page TOC of HDFS site documentation Key: HDFS-9884 URL: https://issues.apache.org/jira/browse/HDFS-9884 Project: Hadoop

[jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated

2016-02-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171484#comment-15171484 ] Masatake Iwasaki commented on HDFS-9048: {noformat} 419 Remote cluster is specified as

[jira] [Updated] (HDFS-9048) DistCp documentation is out-of-dated

2016-02-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9048: --- Status: Patch Available (was: Open) > DistCp documentation is out-of-dated >

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-02-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156532#comment-15156532 ] Masatake Iwasaki commented on HDFS-9427: HBASE-10123 could be useful as reference. > HDFS should

[jira] [Commented] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

2016-02-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15147139#comment-15147139 ] Masatake Iwasaki commented on HDFS-9765: +1. {{TestBlockScanner#testVolumeIteratorWithCaching}}

[jira] [Updated] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9700: --- Issue Type: Improvement (was: Bug) > DFSClient and DFSOutputStream should set TCP_NODELAY on

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144743#comment-15144743 ] Masatake Iwasaki commented on HDFS-9700: I would like to update title and type of the issue because

[jira] [Updated] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9700: --- Summary: DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144739#comment-15144739 ] Masatake Iwasaki commented on HDFS-9700: +1. I will commit this to branch-2.8 and above if there is

[jira] [Updated] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9700: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-02-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133583#comment-15133583 ] Masatake Iwasaki commented on HDFS-9700: I'm +1 too on 003. I do not think setting the default

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-02-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133598#comment-15133598 ] Masatake Iwasaki commented on HDFS-9700: Just 1 nit.. {code}

[jira] [Commented] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-02-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131457#comment-15131457 ] Masatake Iwasaki commented on HDFS-9601: Thanks, [~shv]. I'm +1 on cherry-picking. >

[jira] [Commented] (HDFS-9726) Refactor IBR code to a new class

2016-02-02 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129110#comment-15129110 ] Masatake Iwasaki commented on HDFS-9726: Thanks for working on this, [~szetszwo]. I think this is

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-02-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126245#comment-15126245 ] Masatake Iwasaki commented on HDFS-9700: Both of {{DFSClient#connectToDN}} and

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-01-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123206#comment-15123206 ] Masatake Iwasaki commented on HDFS-9700:

[jira] [Commented] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

2016-01-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114671#comment-15114671 ] Masatake Iwasaki commented on HDFS-9689: Thanks for working on this, [~liuml07]. Are other test

[jira] [Updated] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9618: --- Attachment: HDFS-9618.002.patch > Fix mismatch between log level and guard in >

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-01-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9601: --- Affects Version/s: (was: 3.0.0) 2.9.0 >

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-01-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9601: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk and

[jira] [Updated] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9618: --- Resolution: Fixed Fix Version/s: 2.9.0 Target Version/s: 2.9.0

[jira] [Commented] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085335#comment-15085335 ] Masatake Iwasaki commented on HDFS-9618: The log level had been info but it seemed to be changed to

[jira] [Commented] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085324#comment-15085324 ] Masatake Iwasaki commented on HDFS-9618: {code} if (blockLog.isInfoEnabled()) { // log

[jira] [Created] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-06 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9618: -- Summary: Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks Key: HDFS-9618 URL: https://issues.apache.org/jira/browse/HDFS-9618

[jira] [Commented] (HDFS-9576) HTrace: collect path/offset/length information on read and write operations

2016-01-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085932#comment-15085932 ] Masatake Iwasaki commented on HDFS-9576: I agree to fix tracing of write in follow-up. The 02

[jira] [Updated] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9618: --- Attachment: HDFS-9618.001.patch Thanks for the comment, [~drankye]. I attached 001. bq. Then

[jira] [Updated] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9618: --- Affects Version/s: (was: 3.0.0) 2.8.0 Status: Patch

[jira] [Commented] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085978#comment-15085978 ] Masatake Iwasaki commented on HDFS-9618: This was wrong. The log level was changed by HDFS-6860. >

[jira] [Created] (HDFS-9623) Update example configuration of block state change log in log4j.properties

2016-01-06 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9623: -- Summary: Update example configuration of block state change log in log4j.properties Key: HDFS-9623 URL: https://issues.apache.org/jira/browse/HDFS-9623 Project:

[jira] [Updated] (HDFS-9623) Update example configuration of block state change log in log4j.properties

2016-01-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9623: --- Attachment: HDFS-9623.001.patch > Update example configuration of block state change log in

[jira] [Commented] (HDFS-9576) HTrace: collect path/offset/length information on read and write operations

2016-01-05 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082697#comment-15082697 ] Masatake Iwasaki commented on HDFS-9576: Thanks for working on this, [~zhz]. I tried the 01 patch

[jira] [Commented] (HDFS-9376) TestSeveralNameNodes fails occasionally

2016-01-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080780#comment-15080780 ] Masatake Iwasaki commented on HDFS-9376: Thanks, [~cnauroth]. > TestSeveralNameNodes fails

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-01-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9601: --- Attachment: HDFS-9601.002.patch I attached 002. * simplified retrying * added comment * got

[jira] [Commented] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-01-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080778#comment-15080778 ] Masatake Iwasaki commented on HDFS-9601: Thanks for the comment, [~liuml07]. As you say, we can

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2015-12-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9601: --- Description: TestNNThroughputBenchmark intermittently fails due to NotReplicatedYetException.

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2015-12-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9601: --- Summary: NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2015-12-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9601: --- Status: Patch Available (was: Open) > NNThroughputBenchmark.BlockReportStats should handle >

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2015-12-29 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9601: --- Attachment: HDFS-9601.001.patch I attached 001. For the case of

[jira] [Updated] (HDFS-9376) TestSeveralNameNodes fails occasionally

2015-12-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9376: --- Attachment: HDFS-9376.002.patch I updated the patch. Though the possibility is low, clients

[jira] [Commented] (HDFS-9376) TestSeveralNameNodes fails occasionally

2015-12-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073364#comment-15073364 ] Masatake Iwasaki commented on HDFS-9376: The failure of {{TestReplicationPolicyConsiderLoad}} was

[jira] [Updated] (HDFS-9602) TestReplicationPolicyConsiderLoad.testChooseTargetWithDecomNodes failed on trunk

2015-12-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9602: --- Resolution: Duplicate Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-9602) TestReplicationPolicyConsiderLoad.testChooseTargetWithDecomNodes failed on trunk

2015-12-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071595#comment-15071595 ] Masatake Iwasaki commented on HDFS-9602: Thanks for reporting this, [~yangzhe1991]. This is

[jira] [Updated] (HDFS-9376) TestSeveralNameNodes fails occasionally

2015-12-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9376: --- Attachment: HDFS-9376.001.patch If we set time between failover to greater value, we might not

[jira] [Updated] (HDFS-9376) TestSeveralNameNodes fails occasionally

2015-12-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9376: --- Status: Patch Available (was: Open) > TestSeveralNameNodes fails occasionally >

[jira] [Commented] (HDFS-9376) TestSeveralNameNodes fails occasionally

2015-12-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071388#comment-15071388 ] Masatake Iwasaki commented on HDFS-9376: The failover thread in {{HAStressTestHarness}} will invoke

[jira] [Created] (HDFS-9601) Fix intermittent failure of TestNNThroughputBenchmark

2015-12-24 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-9601: -- Summary: Fix intermittent failure of TestNNThroughputBenchmark Key: HDFS-9601 URL: https://issues.apache.org/jira/browse/HDFS-9601 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9601) Fix intermittent failure of TestNNThroughputBenchmark

2015-12-24 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071407#comment-15071407 ] Masatake Iwasaki commented on HDFS-9601: {noformat}

[jira] [Assigned] (HDFS-9376) TestSeveralNameNodes fails occasionally

2015-12-23 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-9376: -- Assignee: Masatake Iwasaki > TestSeveralNameNodes fails occasionally >

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-21 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066800#comment-15066800 ] Masatake Iwasaki commented on HDFS-9505: Thanks, [~ajisakaa]! > HDFS Architecture documentation

[jira] [Updated] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-20 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9505: --- Attachment: HDFS-9505.002.patch I attached updated patch as 002. * made it clearer that

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065648#comment-15065648 ] Masatake Iwasaki commented on HDFS-9505: Thanks for the review comments, [~ajisakaa]. bq. hadoop

[jira] [Updated] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9505: --- Attachment: (was: HDFS-9505.001.patch) > HDFS Architecture documentation needs to be

[jira] [Updated] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9505: --- Attachment: HDFS-9505.001.patch I attached 001. * fixed description about quota and

[jira] [Updated] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9505: --- Attachment: HDFS-9505.001.patch I reattached the patch to fix formatting issue. > HDFS

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055447#comment-15055447 ] Masatake Iwasaki commented on HDFS-9505: Long lines in markdown documentation is side effect of

[jira] [Commented] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053798#comment-15053798 ] Masatake Iwasaki commented on HDFS-9535: bq. When one IBR is later received, the last block is

[jira] [Commented] (HDFS-8326) Documentation about when checkpoints are run is out of date

2015-12-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053828#comment-15053828 ] Masatake Iwasaki commented on HDFS-8326: Thanks, [~xyao]. > Documentation about when checkpoints

[jira] [Commented] (HDFS-9535) Newly completed blocks in IBR should not be considered under-replicated too quickly

2015-12-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053897#comment-15053897 ] Masatake Iwasaki commented on HDFS-9535: bq. The guarantee Jing Zhao proposed in addStoredBlock

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052497#comment-15052497 ] Masatake Iwasaki commented on HDFS-9505: The statement that "all blocks in a file except the last

[jira] [Commented] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051963#comment-15051963 ] Masatake Iwasaki commented on HDFS-9535: Thanks for reporting this. {code} final boolean b =

[jira] [Commented] (HDFS-9535) Fix TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate

2015-12-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051981#comment-15051981 ] Masatake Iwasaki commented on HDFS-9535: bq. For the first block, it is possible that NN receives 0

[jira] [Commented] (HDFS-8326) Documentation about when checkpoints are run is out of date

2015-12-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052255#comment-15052255 ] Masatake Iwasaki commented on HDFS-8326: [~xyao], though the "Fix version/s" is set to 2.8.0, the

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052261#comment-15052261 ] Masatake Iwasaki commented on HDFS-9505: bq. "Currently, automatic restart and failover of the

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048320#comment-15048320 ] Masatake Iwasaki commented on HDFS-9505: I would like to start working on this. If someone is

[jira] [Assigned] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2015-12-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-9505: -- Assignee: Masatake Iwasaki > HDFS Architecture documentation needs to be refreshed. >

[jira] [Updated] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-12-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Description: (was: https://builds.apache.org/job/Hadoop-Hdfs-trunk/2556/testReport/

[jira] [Updated] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2015-12-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Attachment: HDFS-9444.004.patch I added fix to TestNameNodeMXBean and updated summary. Thanks

[jira] [Updated] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

2015-12-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Description: Unit tests using MiniDFSCluster with namanode-ha enabled need set of port

[jira] [Updated] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2015-12-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9444: --- Summary: Add utility to find set of available ephemeral ports to ServerSocketUtil (was:

<    1   2   3   4   5   6   7   8   >