[jira] [Updated] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-07-21 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-10659: Assignee: Hanisha Koneru > Namenode crashes after Journalnode re-installation in an

[jira] [Updated] (HDFS-4660) Block corruption can happen during pipeline recovery

2016-07-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4660: --- Assignee: Kihwal Lee (was: Rakesh R) > Block corruption can happen during pipeline recovery >

[jira] [Assigned] (HDFS-4660) Block corruption can happen during pipeline recovery

2016-07-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-4660: -- Assignee: Rakesh R (was: Kihwal Lee) > Block corruption can happen during pipeline recovery >

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-07-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388899#comment-15388899 ] Rakesh R commented on HDFS-10584: - Thanks [~zhz] for the help. > Allow long-running Mover tool to login

[jira] [Updated] (HDFS-10677) Über-jira: Enhancements to NNThroughputBenchmark tool

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10677: - Summary: Über-jira: Enhancements to NNThroughputBenchmark tool (was: Über-jira: Enhancements to

[jira] [Updated] (HDFS-10677) Über-jira: Enhancements to NNThroughputBenchmark

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10677: - Summary: Über-jira: Enhancements to NNThroughputBenchmark (was: Enhancements to

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-07-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388857#comment-15388857 ] Wei-Chiu Chuang commented on HDFS-8986: --- Hi [~xiaochen] thanks for working on the patch! I'd like to

[jira] [Comment Edited] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388803#comment-15388803 ] John Zhuge edited comment on HDFS-9276 at 7/22/16 3:57 AM: --- I was able to

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-21 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388836#comment-15388836 ] Yuanbo Liu commented on HDFS-10645: --- [~ajisakaa] Thanks for your comments and your patience. {quote}

[jira] [Comment Edited] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388803#comment-15388803 ] John Zhuge edited comment on HDFS-9276 at 7/22/16 3:14 AM: --- I was able to

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-07-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9276: - Attachment: HDFSReadLoop.scala I was able to reproduce with a simple long running Spark application

[jira] [Work started] (HDFS-10677) Enhancements to NNThroughputBenchmark

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10677 started by Mingliang Liu. > Enhancements to NNThroughputBenchmark > -

[jira] [Updated] (HDFS-9601) NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9601: Issue Type: Sub-task (was: Bug) Parent: HDFS-10677 > NNThroughputBenchmark.BlockReportStats

[jira] [Created] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-07-21 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10678: Summary: Documenting NNThroughputBenchmark tool Key: HDFS-10678 URL: https://issues.apache.org/jira/browse/HDFS-10678 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10677) Enhancements to NNThroughputBenchmark

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10677: - Component/s: test > Enhancements to NNThroughputBenchmark > -

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Issue Type: Sub-task (was: Bug) Parent: HDFS-10677 > Replace -namenode option with -fs for

[jira] [Updated] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9484: Issue Type: Sub-task (was: Bug) Parent: HDFS-10677 > NNThroughputBenchmark$BlockReportStats

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Issue Type: Sub-task (was: Improvement) Parent: HDFS-10677 > Make

[jira] [Updated] (HDFS-10677) Enhancements to NNThroughputBenchmark

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10677: - Issue Type: Improvement (was: Bug) > Enhancements to NNThroughputBenchmark >

[jira] [Updated] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9421: Issue Type: Sub-task (was: Bug) Parent: HDFS-10677 > NNThroughputBenchmark replication test

[jira] [Updated] (HDFS-9387) Fix namenodeUri parameter parsing in NNThroughputBenchmark

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9387: Issue Type: Sub-task (was: Bug) Parent: HDFS-10677 > Fix namenodeUri parameter parsing in

[jira] [Updated] (HDFS-10677) Enhancements to NNThroughputBenchmark

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10677: - Affects Version/s: 3.0.0-alpha2 > Enhancements to NNThroughputBenchmark >

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Issue Type: Sub-task (was: Improvement) Parent: HDFS-10677 > Make

[jira] [Created] (HDFS-10677) Enhancements to NNThroughputBenchmark

2016-07-21 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10677: Summary: Enhancements to NNThroughputBenchmark Key: HDFS-10677 URL: https://issues.apache.org/jira/browse/HDFS-10677 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388713#comment-15388713 ] Hadoop QA commented on HDFS-10650: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9672: Issue Type: Sub-task (was: Bug) Parent: HDFS-10666 > o.a.h.hdfs.TestLeaseRecovery2 fails

[jira] [Updated] (HDFS-9691) TestBlockManagerSafeMode#testCheckSafeMode fails intermittently

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9691: Issue Type: Sub-task (was: Bug) Parent: HDFS-10666 >

[jira] [Assigned] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-10642: Assignee: Mingliang Liu > Fix intermittently failing UT >

[jira] [Updated] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10281: - Issue Type: Sub-task (was: Bug) Parent: HDFS-10666 >

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Issue Type: Sub-task (was: Bug) Parent: HDFS-10666 >

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should disallow storage type changes.

2016-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388658#comment-15388658 ] Hudson commented on HDFS-10225: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10134 (See

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388648#comment-15388648 ] Hadoop QA commented on HDFS-10653: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388647#comment-15388647 ] Hadoop QA commented on HDFS-10653: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10225) DataNode hot swap drives should disallow storage type changes.

2016-07-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388642#comment-15388642 ] Xiao Chen edited comment on HDFS-10225 at 7/21/16 11:59 PM: Committed to

[jira] [Updated] (HDFS-10225) DataNode hot swap drives should disallow storage type changes.

2016-07-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10225: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Target

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2016-07-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Attachment: HDFS-10675-HDFS-9806.001.patch The current patch: # Implements a

[jira] [Commented] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388627#comment-15388627 ] Chris Nauroth commented on HDFS-10650: -- I'm not aware of any history behind an intentional choice to

[jira] [Updated] (HDFS-10225) DataNode hot swap drives should disallow storage type changes.

2016-07-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10225: - Summary: DataNode hot swap drives should disallow storage type changes. (was: DataNode hot swap drives

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388624#comment-15388624 ] Xiao Chen commented on HDFS-10225: -- +1 on patch 3, will commit shortly. > DataNode hot swap drives

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388621#comment-15388621 ] Allen Wittenauer commented on HDFS-10653: - bq. Do you have a clue why test results page is not

[jira] [Updated] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-21 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Zhou updated HDFS-10519: -- Attachment: HDFS-10519.010.patch Fix some style problems. Remove committedTxId check from

[jira] [Created] (HDFS-10676) Add namenode metric to measure time spent in generating EDEKs

2016-07-21 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-10676: - Summary: Add namenode metric to measure time spent in generating EDEKs Key: HDFS-10676 URL: https://issues.apache.org/jira/browse/HDFS-10676 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388614#comment-15388614 ] Hadoop QA commented on HDFS-10653: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10636: - Assignee: Virajith Jalaparti > Modify ReplicaInfo to remove the assumption that replica metadata and data

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10637: - Assignee: Virajith Jalaparti > Modifications to remove the assumption that FsVolumes are backed by >

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2016-07-21 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-8409: -- Status: Open (was: Patch Available) > HDFS client RPC call throws "java.lang.IllegalStateException" >

[jira] [Updated] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2016-07-21 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-8409: -- Status: Patch Available (was: Open) > HDFS client RPC call throws "java.lang.IllegalStateException" >

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10653: - Attachment: HDFS-10653-branch-2.6.02.patch Updating patch to address Findbugs issue. [~aw] Do you have a

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-07-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.004.patch New patch to account for changes in the patch of

[jira] [Updated] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-07-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10636: -- Attachment: HDFS-10636.003.patch Fixed accounting for ramdisk replicas in

[jira] [Commented] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-07-21 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388603#comment-15388603 ] Inigo Goiri commented on HDFS-9836: --- [~xyao], yes, HDFS-8409 should take care of my issue. [~Guocui], do

[jira] [Created] (HDFS-10675) Datanode support to read from external stores.

2016-07-21 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-10675: - Summary: Datanode support to read from external stores. Key: HDFS-10675 URL: https://issues.apache.org/jira/browse/HDFS-10675 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388571#comment-15388571 ] Hadoop QA commented on HDFS-10653: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-07-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388570#comment-15388570 ] Xiaoyu Yao commented on HDFS-9836: -- [~elgoiri], I think HDFS-8409 should solve the connectionId issue

[jira] [Updated] (HDFS-10674) Optimize creating a full path from an inode

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10674: --- Attachment: HDFS-10674.patch > Optimize creating a full path from an inode >

[jira] [Created] (HDFS-10674) Optimize creating a full path from an inode

2016-07-21 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10674: -- Summary: Optimize creating a full path from an inode Key: HDFS-10674 URL: https://issues.apache.org/jira/browse/HDFS-10674 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10653: - Attachment: HDFS-10653-branch-2.6.01.patch Thanks for the suggestion [~daryn]. Attaching new 2.6 patch to

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388525#comment-15388525 ] Hadoop QA commented on HDFS-10653: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388517#comment-15388517 ] Hadoop QA commented on HDFS-10673: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10629) Federation Router

2016-07-21 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388504#comment-15388504 ] Inigo Goiri commented on HDFS-10629: [~jakace], thanks for the patch, I think 001 is a pretty good

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10655: --- Status: Patch Available (was: Open) > Fix path related byte array conversion bugs >

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10653: - Status: Patch Available (was: Reopened) > Optimize conversion from path string to components >

[jira] [Reopened] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-10653: -- Sorry, have to reopen the issue otherwise Jenkins won't run. > Optimize conversion from path string to

[jira] [Updated] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10662: --- Status: Open (was: Patch Available) > Optimize UTF8 string/byte conversions >

[jira] [Updated] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10662: --- Status: Patch Available (was: Open) > Optimize UTF8 string/byte conversions >

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10655: --- Status: Open (was: Patch Available) > Fix path related byte array conversion bugs >

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10655: --- Attachment: HDFS-10655.patch Needed a 1-line change to TestFsLimits. > Fix path related byte array

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-21 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388283#comment-15388283 ] Akira Ajisaka commented on HDFS-10645: -- In addition, would you update Metrics.md to document the new

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388265#comment-15388265 ] Daryn Sharp commented on HDFS-10653: Thanks Jing and Zhe! Zhe, +1 looks fine but you may want to try

[jira] [Updated] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10673: --- Attachment: HDFS-10673.patch > Optimize FSPermissionChecker's internal path usage >

[jira] [Updated] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10673: --- Status: Patch Available (was: Open) > Optimize FSPermissionChecker's internal path usage >

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10655: --- Status: Patch Available (was: Open) > Fix path related byte array conversion bugs >

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-21 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388246#comment-15388246 ] Akira Ajisaka commented on HDFS-10645: -- Thanks [~yuanbo] for the update! I'm thinking we're getting

[jira] [Created] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-07-21 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10673: -- Summary: Optimize FSPermissionChecker's internal path usage Key: HDFS-10673 URL: https://issues.apache.org/jira/browse/HDFS-10673 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10653: - Fix Version/s: 2.7.4 2.8.0 > Optimize conversion from path string to components >

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10653: - Attachment: HDFS-10653-branch-2.6.00.patch Attaching branch-2.6 patch to trigger Jenkins and also ping

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388233#comment-15388233 ] Hudson commented on HDFS-10653: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10130 (See

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388235#comment-15388235 ] Hudson commented on HDFS-10287: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10130 (See

[jira] [Updated] (HDFS-10666) Über-jira: Unit tests should not use fixed sleep interval to wait for conditions

2016-07-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10666: - Description: There have been dozens of intermittent failing unit tests because they depend on

[jira] [Updated] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-21 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10287: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-21 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388160#comment-15388160 ] Akira Ajisaka commented on HDFS-10287: -- +1, checking this in. > MiniDFSCluster should implement

[jira] [Commented] (HDFS-10565) Erasure Coding: Document about the current allowed storage policies for EC Striped mode files

2016-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388158#comment-15388158 ] Jing Zhao commented on HDFS-10565: -- +1 pending Jenkins. > Erasure Coding: Document about the current

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388156#comment-15388156 ] Zhe Zhang commented on HDFS-10653: -- Thanks Daryn for the patch and Jing for the review. I quickly tried

[jira] [Updated] (HDFS-10565) Erasure Coding: Document about the current allowed storage policies for EC Striped mode files

2016-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10565: - Hadoop Flags: Reviewed > Erasure Coding: Document about the current allowed storage policies for EC >

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10653: - Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) I've

[jira] [Updated] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10653: - Hadoop Flags: Reviewed > Optimize conversion from path string to components >

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388140#comment-15388140 ] Jing Zhao commented on HDFS-10653: -- The patch looks good to me. +1. > Optimize conversion from path

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388104#comment-15388104 ] Jing Zhao commented on HDFS-10659: -- Yeah I checked the code again and I think you're right. The format

[jira] [Updated] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recommendations.

2016-07-21 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10663: -- Summary: Comparison of two System.nanoTime methods return values are against standard java

[jira] [Updated] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recomendations.

2016-07-21 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10663: -- Summary: Comparison of two System.nanoTime methods return values are against standard java

[jira] [Commented] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-21 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388065#comment-15388065 ] Rushabh S Shah commented on HDFS-10663: --- bq. It will be better if we can also update these two

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387990#comment-15387990 ] John Zhuge commented on HDFS-6962: -- Unit test failures seem unrelated. There is nothing I can do about the

[jira] [Commented] (HDFS-10666) Über-jira: Unit tests should not use fixed sleep interval to wait for conditions

2016-07-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387987#comment-15387987 ] Chris Nauroth commented on HDFS-10666: -- Excellent! Thank you for filing this, Mingliang. Another

[jira] [Commented] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387723#comment-15387723 ] Kai Zheng commented on HDFS-10651: -- The latest patch LGTM and +1. Will commit it tomorrow if nobody

[jira] [Commented] (HDFS-10653) Optimize conversion from path string to components

2016-07-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387722#comment-15387722 ] Daryn Sharp commented on HDFS-10653: May I have a review please? It's going to become harder for me

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-21 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387658#comment-15387658 ] Andras Bokor commented on HDFS-10287: - Test failures are unrelated. > MiniDFSCluster should implement

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-07-21 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387632#comment-15387632 ] Amit Anand commented on HDFS-10659: --- [~jingzhao] I believe manual creation of {{current}} directory is

[jira] [Created] (HDFS-10672) libhdfs++: reorder directories in src/main/libhdfspp/examples, and add C++ version of cat tool

2016-07-21 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10672: Summary: libhdfs++: reorder directories in src/main/libhdfspp/examples, and add C++ version of cat tool Key: HDFS-10672 URL: https://issues.apache.org/jira/browse/HDFS-10672

[jira] [Updated] (HDFS-10658) Reduce JsonFactory instance allocation in StartupProgressServlet

2016-07-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10658: - Issue Type: Improvement (was: Bug) > Reduce JsonFactory instance allocation in StartupProgressServlet >

[jira] [Updated] (HDFS-10670) memory leak in libhdfs when using LocalFileSystem

2016-07-21 Thread hzheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hzheng updated HDFS-10670: -- Component/s: libhdfs hdfs > memory leak in libhdfs when using LocalFileSystem >

  1   2   >