[jira] [Commented] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742366#comment-14742366 ] He Xiaoqiao commented on HDFS-9068: --- it is necessary to add thread to periodic check if the sd in

[jira] [Created] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9068: - Summary: SBN checkpoint could not work after the only name directory recovery from failure Key: HDFS-9068 URL: https://issues.apache.org/jira/browse/HDFS-9068 Project:

[jira] [Updated] (HDFS-6564) Use slf4j instead of common-logging in hdfs-client

2015-09-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-6564: - Component/s: build > Use slf4j instead of common-logging in hdfs-client >

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.003.patch Holy cow, that was an adventure. It's just 1 line of code,

[jira] [Updated] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2015-09-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-8947: - Affects Version/s: 2.8.0 Target Version/s: 2.8.0 Priority: Minor (was: Major)

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742603#comment-14742603 ] Steve Loughran commented on HDFS-8953: -- -1. uses a hard coded port for tests. Use {{ServerSocketUtil}}

[jira] [Commented] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742553#comment-14742553 ] Hadoop QA commented on HDFS-9065: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742620#comment-14742620 ] Vinayakumar B commented on HDFS-8953: - {code}. + private final static InetSocketAddress NN_ADDR = new

[jira] [Updated] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2015-09-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-8947: - Status: Patch Available (was: Open) > NameNode, DataNode and NFS gateway to support

[jira] [Updated] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2015-09-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-8947: - Attachment: HADOOP-12321-003.patch > NameNode, DataNode and NFS gateway to support JvmPauseMonitor

[jira] [Created] (HDFS-9069) TestNameNodeMetricsLogger failing -port in use

2015-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-9069: Summary: TestNameNodeMetricsLogger failing -port in use Key: HDFS-9069 URL: https://issues.apache.org/jira/browse/HDFS-9069 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9069) TestNameNodeMetricsLogger failing -port in use

2015-09-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742622#comment-14742622 ] Vinayakumar B commented on HDFS-9069: - +1 > TestNameNodeMetricsLogger failing -port in use >

[jira] [Updated] (HDFS-9069) TestNameNodeMetricsLogger failing -port in use

2015-09-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9069: - Attachment: HDFS-9069-001.patch fix to use ServerSocketUtil > TestNameNodeMetricsLogger failing

[jira] [Updated] (HDFS-9069) TestNameNodeMetricsLogger failing -port in use

2015-09-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9069: - Status: Patch Available (was: Open) > TestNameNodeMetricsLogger failing -port in use >

[jira] [Commented] (HDFS-9040) Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers

2015-09-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742796#comment-14742796 ] Walter Su commented on HDFS-9040: - bq. preallocate GS when NN creates a new striped block group

[jira] [Created] (HDFS-9070) Erasure coding: allow fsck display the pending replica information(including datanode information) of being-written EC block group

2015-09-13 Thread GAO Rui (JIRA)
GAO Rui created HDFS-9070: - Summary: Erasure coding: allow fsck display the pending replica information(including datanode information) of being-written EC block group Key: HDFS-9070 URL:

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742694#comment-14742694 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- > I checked patch and passed our previous test case

[jira] [Commented] (HDFS-9069) TestNameNodeMetricsLogger failing -port in use

2015-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742676#comment-14742676 ] Hadoop QA commented on HDFS-9069: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9054) Race condition on yieldCount in FSDirectory.java

2015-09-13 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742821#comment-14742821 ] zhaoyunjiong commented on HDFS-9054: Agree, thanks for your time. > Race condition on yieldCount in

[jira] [Updated] (HDFS-9054) Race condition on yieldCount in FSDirectory.java

2015-09-13 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-9054: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) > Race condition on yieldCount

[jira] [Created] (HDFS-9072) Fix random failures in TestJMXGet

2015-09-13 Thread J.Andreina (JIRA)
J.Andreina created HDFS-9072: Summary: Fix random failures in TestJMXGet Key: HDFS-9072 URL: https://issues.apache.org/jira/browse/HDFS-9072 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9067) o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk

2015-09-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742954#comment-14742954 ] Brahma Reddy Battula commented on HDFS-9067: [~surendrasingh] thanks for taking this

[jira] [Commented] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

2015-09-13 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742956#comment-14742956 ] J.Andreina commented on HDFS-8545: -- Thanks [~wheat9] for the review comments. bq.My question is whether

[jira] [Commented] (HDFS-8956) Not able to start Datanode

2015-09-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742859#comment-14742859 ] Brahma Reddy Battula commented on HDFS-8956: {quote}I have sent a request to hadoop user

[jira] [Reopened] (HDFS-9073) Fix failures in TestLazyPersistLockedMemory#testReleaseOnEviction

2015-09-13 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina reopened HDFS-9073: -- Reopening as the fix for HDFS-9067 does not apply. > Fix failures in

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-09-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742837#comment-14742837 ] Rui Li commented on HDFS-8968: -- Findbugs seems to have 4 new warnings but Findbugs Report is just empty. Any

[jira] [Created] (HDFS-9071) chooseTargets in ReplicationWork may pass incomplete srcPath

2015-09-13 Thread He Tianyi (JIRA)
He Tianyi created HDFS-9071: --- Summary: chooseTargets in ReplicationWork may pass incomplete srcPath Key: HDFS-9071 URL: https://issues.apache.org/jira/browse/HDFS-9071 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-9073) Fix failures in TestLazyPersistLockedMemory#testReleaseOnEviction

2015-09-13 Thread J.Andreina (JIRA)
J.Andreina created HDFS-9073: Summary: Fix failures in TestLazyPersistLockedMemory#testReleaseOnEviction Key: HDFS-9073 URL: https://issues.apache.org/jira/browse/HDFS-9073 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9037) Trash messages should be handled by Logger instead of being delivered on System.out

2015-09-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742942#comment-14742942 ] Akira AJISAKA commented on HDFS-9037: - I'll commit this to trunk and branch-2 in Sep. 16 if there are

[jira] [Commented] (HDFS-9040) Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers

2015-09-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742842#comment-14742842 ] Walter Su commented on HDFS-9040: - Jing's proposal looks great. Thanks for the effort. bq. The direction

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-09-13 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742846#comment-14742846 ] He Tianyi commented on HDFS-8829: - * "I've" -> "I'll" > DataNode sets SO_RCVBUF explicitly is disabling

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-09-13 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742844#comment-14742844 ] He Tianyi commented on HDFS-8829: - Hi, thanks for the comments. I've update the patch against current

[jira] [Updated] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-9068: -- Attachment: HDFS-9068.patch Attach patch: check failure directory if OK before saving fsimage. > SBN

[jira] [Commented] (HDFS-8780) Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node.

2015-09-13 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742881#comment-14742881 ] J.Andreina commented on HDFS-8780: -- TestCase failures are unrelated. Please review. > Fetching live/dead

[jira] [Resolved] (HDFS-9073) Fix failures in TestLazyPersistLockedMemory#testReleaseOnEviction

2015-09-13 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina resolved HDFS-9073. -- Resolution: Duplicate Resolving this as duplicate to HDFS-9067 . As the fix will be on same utility

[jira] [Updated] (HDFS-9067) o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk

2015-09-13 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9067: - Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-9067) o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk

2015-09-13 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9067: - Attachment: HDFS-9067.patch Attached patch.. Please review... >

[jira] [Moved] (HDFS-9074) Fix failures in TestLazyPersistReplicaPlacement

2015-09-13 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina moved HADOOP-12410 to HDFS-9074: --- Key: HDFS-9074 (was: HADOOP-12410) Project: Hadoop HDFS (was: Hadoop