[jira] [Comment Edited] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-10-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973802#comment-14973802 ] Yi Liu edited comment on HDFS-7984 at 10/26/15 6:27 AM: {quote} there is no way for

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-26 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973816#comment-14973816 ] Walter Su commented on HDFS-9079: - bq. It seems that some failure cases were not considered. For example,

[jira] [Commented] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

2015-10-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973827#comment-14973827 ] Rakesh R commented on HDFS-9261: Attached simple patch to check the health of parity streamers before

[jira] [Commented] (HDFS-9255) Consolidate block recovery related implementation into a single class

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973952#comment-14973952 ] Hadoop QA commented on HDFS-9255: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9284) fsck command should not print exception trace when file not found

2015-10-26 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974074#comment-14974074 ] Jagadesh Kiran N commented on HDFS-9284: [~andrew.wang] Please review it., > fsck command should

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-10-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973802#comment-14973802 ] Yi Liu commented on HDFS-7984: -- {quote} there is no way for an end user to create a token file with multiple

[jira] [Updated] (HDFS-9229) Expose size of NameNode directory as a metric

2015-10-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9229: - Attachment: HDFS-9229.005.patch Thanks [~rakeshr] for review and suggestions.

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973825#comment-14973825 ] Allen Wittenauer commented on HDFS-7984: bq. No, I think we have. When using existing

[jira] [Updated] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

2015-10-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9261: --- Attachment: HDFS-9261-00.patch > Erasure Coding: Skip encoding the data cells if all the parity data streamers

[jira] [Updated] (HDFS-8631) WebHDFS : Support list/setQuota

2015-10-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8631: - Status: Patch Available (was: Open) Resubmitting patch to trigger QA build.. >

[jira] [Updated] (HDFS-8631) WebHDFS : Support list/setQuota

2015-10-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8631: - Status: Open (was: Patch Available) > WebHDFS : Support list/setQuota >

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-10-26 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973851#comment-14973851 ] Liangliang Gu commented on HDFS-9276: - *FileSystem#addDelegationTokens* will return *Token for NameNode

[jira] [Updated] (HDFS-9255) Consolidate block recovery related implementation into a single class

2015-10-26 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9255: Attachment: HDFS-9255.06.patch bq. One question is: since DataNode#blockRecoveryWorker is not declared as

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-10-26 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973857#comment-14973857 ] Liangliang Gu commented on HDFS-9276: - ps: *Token for NameNode 1* and *Token for NameNode2* is

[jira] [Updated] (HDFS-9304) Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses

2015-10-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9304: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9308) Add truncateMeta() to MiniDFSCluster

2015-10-26 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9308: -- Attachment: HDFS-9308.001.patch In this patch: * Add {{truncateMeta()}} method to truncate meta data files on

[jira] [Updated] (HDFS-9308) Add truncateMeta() to MiniDFSCluster

2015-10-26 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9308: -- Status: Patch Available (was: Open) > Add truncateMeta() to MiniDFSCluster >

[jira] [Commented] (HDFS-3745) fsck prints that it's using KSSL even when it's in fact using SPNEGO for authentication

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975189#comment-14975189 ] Hadoop QA commented on HDFS-3745: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9284) fsck command should not print exception trace when file not found

2015-10-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9284: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Description: A non-striped DataStreamer goes through the following steps in error handling: {code} 1) Finds

[jira] [Updated] (HDFS-9310) TestDataNodeHotSwapVolumes fails occasionally

2015-10-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9310: Description: TestDataNodeHotSwapVolumes fails occasionally in Jenkins and locally. e.g.

[jira] [Commented] (HDFS-9304) Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974896#comment-14974896 ] Hudson commented on HDFS-9304: -- FAILURE: Integrated in Hadoop-trunk-Commit #8709 (See

[jira] [Updated] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

2015-10-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7284: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) I

[jira] [Commented] (HDFS-9309) Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig()

2015-10-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975055#comment-14975055 ] Wei-Chiu Chuang commented on HDFS-9309: --- The HDFS-9277 exhibited the same error message, so could be

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.009.patch Patch 009 fixes the check style warning of comments ending in '.'. Test

[jira] [Commented] (HDFS-5032) Write pipeline failures caused by slow or busy disk may not be handled properly.

2015-10-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975142#comment-14975142 ] Kihwal Lee commented on HDFS-5032: -- bq. The faulty (slow) node was not detected correctly. Instead, the

[jira] [Commented] (HDFS-9304) Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975181#comment-14975181 ] Hudson commented on HDFS-9304: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #587 (See

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974876#comment-14974876 ] Zhe Zhang commented on HDFS-9260: - Quick note: the patches are all named after HDFS-7435 > Improve

[jira] [Commented] (HDFS-9292) Make TestFileConcorruption independent to underlying FsDataset Implementation.

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974972#comment-14974972 ] Colin Patrick McCabe commented on HDFS-9292: {code} 81

[jira] [Commented] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975147#comment-14975147 ] Hadoop QA commented on HDFS-9245: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

2015-10-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974893#comment-14974893 ] Yongjun Zhang commented on HDFS-7284: - +1 on 005, I will commit momentarily. > Add more debug info

[jira] [Commented] (HDFS-9304) Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses

2015-10-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974840#comment-14974840 ] Haohui Mai commented on HDFS-9304: -- +1. The failed unit tests are unrelated. Committing it shortly. > Add

[jira] [Commented] (HDFS-9083) Replication violates block placement policy.

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974953#comment-14974953 ] Hadoop QA commented on HDFS-9083: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Assigned] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9307: --- Assignee: Mingliang Liu > fuseConnect should be private to fuse_connect.c >

[jira] [Resolved] (HDFS-5032) Write pipeline failures caused by slow or busy disk may not be handled properly.

2015-10-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-5032. -- Resolution: Fixed > Write pipeline failures caused by slow or busy disk may not be handled > properly.

[jira] [Updated] (HDFS-9083) Replication violates block placement policy.

2015-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-9083: - Attachment: HDFS-9083-branch-2.7.patch > Replication violates block placement policy. >

[jira] [Updated] (HDFS-9083) Replication violates block placement policy.

2015-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-9083: - Status: Patch Available (was: Open) > Replication violates block placement policy. >

[jira] [Updated] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-10-26 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-7984: - Attachment: HDFS-7984.002.patch > webhdfs:// needs to support provided delegation tokens >

[jira] [Commented] (HDFS-9299) Give ReplicationMonitor a readable thread name

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974974#comment-14974974 ] Colin Patrick McCabe commented on HDFS-9299: +1 pending jenkins. > Give ReplicationMonitor a

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975016#comment-14975016 ] Anu Engineer commented on HDFS-9129: [~liuml07] Thanks for adding me to this review. It looks like the

[jira] [Updated] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9307: Attachment: HDFS-9307.000.patch Thanks for reporting this. I also think it should be private. The

[jira] [Created] (HDFS-9309) Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig()

2015-10-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9309: - Summary: Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig() Key: HDFS-9309 URL: https://issues.apache.org/jira/browse/HDFS-9309 Project: Hadoop

[jira] [Updated] (HDFS-9309) Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig()

2015-10-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9309: -- Description: When KeyStoreUtil.setupSSLConfig() is called, several files are created

[jira] [Updated] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-10-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9007: -- Attachment: HDFS-9007.patch Here is the initial patch. The basic idea is to add a new method called

[jira] [Commented] (HDFS-9304) Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses

2015-10-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974847#comment-14974847 ] Mingliang Liu commented on HDFS-9304: - Thanks to [~wheat9] for your review and commit. > Add

[jira] [Updated] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9268: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Assigned] (HDFS-5032) Write pipeline failures caused by slow or busy disk may not be handled properly.

2015-10-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-5032: - Assignee: Daryn Sharp > Write pipeline failures caused by slow or busy disk may not be handled >

[jira] [Commented] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975088#comment-14975088 ] Hadoop QA commented on HDFS-9279: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975087#comment-14975087 ] Colin Patrick McCabe commented on HDFS-9307: Thanks, [~liuml07]. can you remove it from the

[jira] [Commented] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

2015-10-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975085#comment-14975085 ] Andrew Wang commented on HDFS-9305: --- LGTM, though the test has some whitespace errors. +1 pending, feel

[jira] [Updated] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-10-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9007: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Fix HDFS Balancer to honor upgrade domain policy

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975154#comment-14975154 ] Yongjun Zhang commented on HDFS-9231: - Thanks Xiao for the new revs. +1 on 009 pending jenkins. >

[jira] [Resolved] (HDFS-8128) hadoop-hdfs-client dependency convergence error

2015-10-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-8128. -- Resolution: Cannot Reproduce Resolving this issue. It looks like it is no longer reproducible in trunk.

[jira] [Updated] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

2015-10-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9305: Attachment: HDFS-9305.02.patch > Delayed heartbeat processing causes storm of subsequent heartbeats

[jira] [Commented] (HDFS-9291) Fix TestInterDatanodeProtocol to be FsDataset-agnostic.

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974965#comment-14974965 ] Colin Patrick McCabe commented on HDFS-9291: +1. Thanks, [~eddyxu]. > Fix

[jira] [Commented] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974983#comment-14974983 ] Colin Patrick McCabe commented on HDFS-9268: Thanks, [~zhz]. I'll open a follow-on JIRA for

[jira] [Commented] (HDFS-9301) HDFS clients can't construct HdfsConfiguration instances

2015-10-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974981#comment-14974981 ] Steve Loughran commented on HDFS-9301: -- OK, I can verify that with this patch, my code compiles again.

[jira] [Created] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-26 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-9307: -- Summary: fuseConnect should be private to fuse_connect.c Key: HDFS-9307 URL: https://issues.apache.org/jira/browse/HDFS-9307 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9307: Status: Patch Available (was: Open) > fuseConnect should be private to fuse_connect.c >

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975040#comment-14975040 ] Zhe Zhang commented on HDFS-9260: - Thanks for the great work Staffan. The only change related to erasure

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975042#comment-14975042 ] Hadoop QA commented on HDFS-9260: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9307: Attachment: HDFS-9307.001.patch Thanks for your review, [~cmccabe]. The v1 patch addresses this and

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975177#comment-14975177 ] Ming Ma commented on HDFS-9259: --- Thanks [~liuml07]! The patch looks good. Just some format nits in

[jira] [Commented] (HDFS-9304) Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975235#comment-14975235 ] Hudson commented on HDFS-9304: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1323 (See

[jira] [Commented] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975237#comment-14975237 ] Hudson commented on HDFS-7284: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1323 (See

[jira] [Updated] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-10-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9168: - Attachment: HDFS-9168.003.patch > Move client side unit test to hadoop-hdfs-client >

[jira] [Commented] (HDFS-9289) check genStamp when complete file

2015-10-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975348#comment-14975348 ] Zhe Zhang commented on HDFS-9289: - [~lichangleo] I think the below log shows that the client does have new

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-26 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-9260.008.patch Using the right name of the bug on the patch... Fixed white

[jira] [Commented] (HDFS-9299) Give ReplicationMonitor a readable thread name

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975409#comment-14975409 ] Hadoop QA commented on HDFS-9299: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-10-26 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9314: - Summary: Improve BlockPlacementPolicyDefault's picking of excess replicas Key: HDFS-9314 URL: https://issues.apache.org/jira/browse/HDFS-9314 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9018) Update the pom to add junit dependency and move TestXAttr to client project

2015-10-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9018: - Resolution: Duplicate Status: Resolved (was: Patch Available) HDFS-9168 moves all unit tests that

[jira] [Created] (HDFS-9308) Add truncateMeta() to MiniDFSCluster

2015-10-26 Thread Tony Wu (JIRA)
Tony Wu created HDFS-9308: - Summary: Add truncateMeta() to MiniDFSCluster Key: HDFS-9308 URL: https://issues.apache.org/jira/browse/HDFS-9308 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975194#comment-14975194 ] Hadoop QA commented on HDFS-9305: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975240#comment-14975240 ] Hadoop QA commented on HDFS-4937: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975236#comment-14975236 ] Hudson commented on HDFS-9268: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1323 (See

[jira] [Commented] (HDFS-9277) IOException "Unable to load OAuth2 connection factory." in TestWebHDFSOAuth2.listStatusReturnsAsExpected

2015-10-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975248#comment-14975248 ] Wei-Chiu Chuang commented on HDFS-9277: --- This failure occurred, because ssl-client.xml is present in

[jira] [Commented] (HDFS-7284) Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975269#comment-14975269 ] Hudson commented on HDFS-7284: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #599 (See

[jira] [Commented] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975268#comment-14975268 ] Hudson commented on HDFS-9268: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #599 (See

[jira] [Commented] (HDFS-9277) IOException "Unable to load OAuth2 connection factory." in TestWebHDFSOAuth2.listStatusReturnsAsExpected

2015-10-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975261#comment-14975261 ] Wei-Chiu Chuang commented on HDFS-9277: --- Which is to say, test OAuth2 connection w/o SSL, and then

[jira] [Updated] (HDFS-9309) Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig()

2015-10-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9309: -- Attachment: HDFS-9309.001.patch > Tests that use KeyStoreUtil must call

[jira] [Updated] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-10-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8945: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation

2015-10-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975270#comment-14975270 ] Andrew Wang commented on HDFS-8945: --- My bad for leaving this for so long, +1 LGTM will commit shortly. >

[jira] [Commented] (HDFS-9304) Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975267#comment-14975267 ] Hudson commented on HDFS-9304: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #599 (See

[jira] [Created] (HDFS-9310) TestDataNodeHotSwapVolumes fails occasionally

2015-10-26 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-9310: --- Summary: TestDataNodeHotSwapVolumes fails occasionally Key: HDFS-9310 URL: https://issues.apache.org/jira/browse/HDFS-9310 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

2015-10-26 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9311: --- Summary: Support optional offload of NameNode HA service health checks to a separate RPC server. Key: HDFS-9311 URL: https://issues.apache.org/jira/browse/HDFS-9311

[jira] [Commented] (HDFS-8871) Decommissioning of a node with a failed volume may not start

2015-10-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975386#comment-14975386 ] Vinod Kumar Vavilapalli commented on HDFS-8871: --- [~daryn] / [~kihwal], any update on this?

[jira] [Created] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-10-26 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9313: - Summary: Possible NullPointerException in BlockManager if no excess replica can be chosen Key: HDFS-9313 URL: https://issues.apache.org/jira/browse/HDFS-9313 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-10-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9313: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Possible NullPointerException in BlockManager if

[jira] [Updated] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-10-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9313: -- Attachment: HDFS-9313.patch Here is the patch that illustrates the scenario. It is better to guard against

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-10-26 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975193#comment-14975193 ] Tony Wu commented on HDFS-9282: --- Manually verified hadoop.hdfs.server.datanode.TestDirectoryScanner runs

[jira] [Commented] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975213#comment-14975213 ] Hudson commented on HDFS-9268: -- FAILURE: Integrated in Hadoop-trunk-Commit #8710 (See

[jira] [Commented] (HDFS-9290) DFSClient#callAppend() is not backward compatible for slightly older NameNodes

2015-10-26 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975231#comment-14975231 ] Tony Wu commented on HDFS-9290: --- HI [~kihwal], Thanks for taking the time to manually run these tests. I

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975257#comment-14975257 ] Hadoop QA commented on HDFS-7984: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-10-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9312: Attachment: HDFS-9312.00.patch This patch: * Adds {{TestFsDatasetTestUtils#injectReplica}}. * Fix

[jira] [Updated] (HDFS-9277) IOException "Unable to load OAuth2 connection factory." in TestWebHDFSOAuth2.listStatusReturnsAsExpected

2015-10-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9277: -- Status: Patch Available (was: Open) > IOException "Unable to load OAuth2 connection factory."

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-10-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975453#comment-14975453 ] Mingliang Liu commented on HDFS-9313: - Thanks for filing and working on this, [~mingma]. I think the

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975188#comment-14975188 ] James Clampffer commented on HDFS-8766: --- Thanks for the input Haohui! I have the bulk of the next

[jira] [Updated] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9259: Attachment: HDFS-9259.001.patch Thanks for your review [~mingma]! The v1 patch addresses the format

[jira] [Commented] (HDFS-9284) fsck command should not print exception trace when file not found

2015-10-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975199#comment-14975199 ] Andrew Wang commented on HDFS-9284: --- Thanks for the reminder [~jagadesh.kiran], +1 LGTM will commit

[jira] [Updated] (HDFS-9308) Add truncateMeta() to MiniDFSCluster

2015-10-26 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9308: -- Description: HDFS-9188 introduced {{corruptMeta()}} method to make corrupting the metadata file filesystem

  1   2   3   >