[jira] [Commented] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049669#comment-14049669 ] zhaoyunjiong commented on HDFS-6616: What happened on our cluster is very rare case. Se

[jira] [Created] (HDFS-6620) Snapshot docs should specify about preserve options with cp command

2014-07-01 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-6620: - Summary: Snapshot docs should specify about preserve options with cp command Key: HDFS-6620 URL: https://issues.apache.org/jira/browse/HDFS-6620 Project: Ha

[jira] [Commented] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049606#comment-14049606 ] Stephen Chu commented on HDFS-6603: --- Thank you, Chris! > Add XAttr with ACL test > -

[jira] [Updated] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6618: - Status: Patch Available (was: Open) > Edit log corruption may still happen even after HDFS-6527 > ---

[jira] [Updated] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6618: - Attachment: HDFS-6618.inodeRemover.patch Here is a new patch that implements {{INodeRemover}}. It replaces

[jira] [Commented] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049585#comment-14049585 ] Hudson commented on HDFS-6603: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5807 (See [https:

[jira] [Updated] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6603: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Status: Resolved (

[jira] [Updated] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6603: Target Version/s: 3.0.0, 2.5.0 Hadoop Flags: Reviewed +1 for the patch. I'll commit this.

[jira] [Updated] (HDFS-6605) Client server negotiation of cipher suite

2014-07-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6605: -- Attachment: hdfs-6605.001.patch Patch attached. Overall idea: - Client provides an ordered list of Ciph

[jira] [Commented] (HDFS-6619) Clean up encryption-related tests

2014-07-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049530#comment-14049530 ] Andrew Wang commented on HDFS-6619: --- Let's also try to isolate the tests to use the FS an

[jira] [Commented] (HDFS-6619) Clean up encryption-related tests

2014-07-01 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049457#comment-14049457 ] Charles Lamb commented on HDFS-6619: As part of HDFS-6516 have changes to TestEncrypti

[jira] [Created] (HDFS-6619) Clean up encryption-related tests

2014-07-01 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6619: - Summary: Clean up encryption-related tests Key: HDFS-6619 URL: https://issues.apache.org/jira/browse/HDFS-6619 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049420#comment-14049420 ] Tsz Wo Nicholas Sze commented on HDFS-6616: --- I think it is not a good idea to do

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049421#comment-14049421 ] Hadoop QA commented on HDFS-6482: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6616: -- Component/s: webhdfs > bestNode shouldn't always return the first DataNode > ---

[jira] [Commented] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049418#comment-14049418 ] Hadoop QA commented on HDFS-6609: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6618: - Attachment: (was: HDFS-6681.AbstractList.patch) > Edit log corruption may still happen even after HDFS

[jira] [Updated] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6618: - Attachment: HDFS-6618.AbstractList.patch > Edit log corruption may still happen even after HDFS-6527 > ---

[jira] [Updated] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6618: - Attachment: HDFS-6681.AbstractList.patch The new patch implements an idea for minimal change. This is jus

[jira] [Updated] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6618: - Status: Open (was: Patch Available) > Edit log corruption may still happen even after HDFS-6527 > ---

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-07-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049344#comment-14049344 ] Alejandro Abdelnur commented on HDFS-6134: -- lets assume you have an HSM that keeps

[jira] [Commented] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049329#comment-14049329 ] Hadoop QA commented on HDFS-6609: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049319#comment-14049319 ] Stephen Chu commented on HDFS-6603: --- The intermittent test failure above (TestCacheDirect

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-07-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049310#comment-14049310 ] Tsz Wo Nicholas Sze commented on HDFS-6134: --- [~andrew.purt...@gmail.com], thanks

[jira] [Commented] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049309#comment-14049309 ] Kihwal Lee commented on HDFS-6618: -- I guess we can move it inside the first lock, since it

[jira] [Commented] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049301#comment-14049301 ] Hadoop QA commented on HDFS-6603: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-01 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.6.patch Added ASF license comment. > Use block ID-based block layout on datanod

[jira] [Commented] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049259#comment-14049259 ] Hadoop QA commented on HDFS-6618: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049258#comment-14049258 ] Hadoop QA commented on HDFS-6609: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6469) Coordinated replication of the namespace using ConsensusNode

2014-07-01 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049227#comment-14049227 ] Sanjay Radia commented on HDFS-6469: Wrt to double journaling bq. If I follow your logi

[jira] [Commented] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049195#comment-14049195 ] Kihwal Lee commented on HDFS-6618: -- bq. can we move the following code into the writelock

[jira] [Comment Edited] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049195#comment-14049195 ] Kihwal Lee edited comment on HDFS-6618 at 7/1/14 7:06 PM: -- bq. can

[jira] [Comment Edited] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049195#comment-14049195 ] Kihwal Lee edited comment on HDFS-6618 at 7/1/14 7:06 PM: -- bq. can

[jira] [Updated] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6609: Attachment: HDFS-6609.002.patch Update the patch to address Haohui's comments. > Use DirectorySnapshottable

[jira] [Commented] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049122#comment-14049122 ] Jing Zhao commented on HDFS-6618: - If the corruption is caused by the same issue, can we mo

[jira] [Updated] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6603: -- Attachment: HDFS-6603.002.patch Attached a new patch based on Chris's comments. I ran the following tes

[jira] [Commented] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

2014-07-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049100#comment-14049100 ] Andrew Wang commented on HDFS-6391: --- Great, thanks [~hitliuyi], appreciate the double che

[jira] [Updated] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6609: Attachment: HDFS-6609.001.patch Update the patch to fix javadoc and findbug warnings. > Use DirectorySnapsh

[jira] [Commented] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049098#comment-14049098 ] Jing Zhao commented on HDFS-6609: - Thanks for the review, [~wheat9]. Will update the patch

[jira] [Commented] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049090#comment-14049090 ] Haohui Mai commented on HDFS-6609: -- The patch looks good to me. Some comments: 1. in {{IN

[jira] [Commented] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049086#comment-14049086 ] Stephen Chu commented on HDFS-6603: --- Thanks, [~cnauroth]! That sounds like a better route

[jira] [Updated] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6618: - Status: Patch Available (was: Open) > Edit log corruption may still happen even after HDFS-6527 > ---

[jira] [Commented] (HDFS-6603) Add XAttr with ACL test

2014-07-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049083#comment-14049083 ] Chris Nauroth commented on HDFS-6603: - Hi, [~schu]. Thank you for adding these tests.

[jira] [Updated] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6618: - Attachment: HDFS-6618.patch The patch makes {{FileWithSnapshotFeature.isCurrentFileDeleted}} and {{INode.

[jira] [Created] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6618: Summary: Edit log corruption may still happen even after HDFS-6527 Key: HDFS-6618 URL: https://issues.apache.org/jira/browse/HDFS-6618 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-6607) Improve DFSInputStream forward seek performance

2014-07-01 Thread Abdullah Alamoudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049069#comment-14049069 ] Abdullah Alamoudi commented on HDFS-6607: - This problem doesn't exist in the local

[jira] [Commented] (HDFS-6606) Optimize encryption support in DataTransfer Protocol with High performance

2014-07-01 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049031#comment-14049031 ] Andrew Purtell commented on HDFS-6606: -- {quote} Thanks for the information, you are ri

[jira] [Commented] (HDFS-4120) Add a new "-skipSharedEditsCheck" option for BootstrapStandby

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049006#comment-14049006 ] Hadoop QA commented on HDFS-4120: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6558) Missing '\n' in the description of dfsadmin -rollingUpgrade

2014-07-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048964#comment-14048964 ] Suresh Srinivas commented on HDFS-6558: --- [~airbots], it would be better to use platfo

[jira] [Commented] (HDFS-6558) Missing '\n' in the description of dfsadmin -rollingUpgrade

2014-07-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048954#comment-14048954 ] Hudson commented on HDFS-6558: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1818 (See [htt

[jira] [Commented] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-07-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048953#comment-14048953 ] Hudson commented on HDFS-6591: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1818 (See [htt

[jira] [Commented] (HDFS-4286) Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM

2014-07-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048905#comment-14048905 ] Rakesh R commented on HDFS-4286: Thanks [~umamaheswararao] for the review. oops its my mi

[jira] [Commented] (HDFS-4286) Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM

2014-07-01 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048900#comment-14048900 ] Uma Maheswara Rao G commented on HDFS-4286: --- {noformat} + the dependency book

[jira] [Commented] (HDFS-6615) Replace java.security.SecureRandom with org.apache.hadoop.crypto.random.SecureRandom in HDFS

2014-07-01 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048896#comment-14048896 ] Uma Maheswara Rao G commented on HDFS-6615: --- +1 for doing this. We need to wait u

[jira] [Commented] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048877#comment-14048877 ] Hadoop QA commented on HDFS-6617: - {color:green}+1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-4286) Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM

2014-07-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-4286: -- Assignee: Rakesh R > Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server > jar

[jira] [Commented] (HDFS-3862) QJM: don't require a fencer to be configured if shared storage has built-in single-writer semantics

2014-07-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048862#comment-14048862 ] Rakesh R commented on HDFS-3862: Hi [~tlipcon], [~umamaheswararao], I'm also thinking, co

[jira] [Commented] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-07-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048859#comment-14048859 ] Hudson commented on HDFS-6591: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1791 (See [https://

[jira] [Commented] (HDFS-6558) Missing '\n' in the description of dfsadmin -rollingUpgrade

2014-07-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048860#comment-14048860 ] Hudson commented on HDFS-6558: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1791 (See [https://

[jira] [Assigned] (HDFS-3752) BOOTSTRAPSTANDBY for new Standby node will not work just after saveNameSpace at ANN in case of BKJM

2014-07-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-3752: -- Assignee: Rakesh R > BOOTSTRAPSTANDBY for new Standby node will not work just after saveNameSpace > at

[jira] [Commented] (HDFS-4120) Add a new "-skipSharedEditsCheck" option for BootstrapStandby

2014-07-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048853#comment-14048853 ] Rakesh R commented on HDFS-4120: Hi [~vinayrpet], Thanks for the reviews. I've moved the te

[jira] [Updated] (HDFS-4120) Add a new "-skipSharedEditsCheck" option for BootstrapStandby

2014-07-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4120: --- Attachment: HDFS-4120.patch > Add a new "-skipSharedEditsCheck" option for BootstrapStandby >

[jira] [Commented] (HDFS-6558) Missing '\n' in the description of dfsadmin -rollingUpgrade

2014-07-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048768#comment-14048768 ] Hudson commented on HDFS-6558: -- FAILURE: Integrated in Hadoop-Yarn-trunk #600 (See [https://b

[jira] [Commented] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-07-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048767#comment-14048767 ] Hudson commented on HDFS-6591: -- FAILURE: Integrated in Hadoop-Yarn-trunk #600 (See [https://b

[jira] [Updated] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6617: Description: Just Hit a false alarm testing while working at HDFS-6614, see https://builds.apache.org/job/

[jira] [Updated] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6617: Status: Patch Available (was: Open) > Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin du

[jira] [Updated] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6617: Attachment: HDFS-6617.txt > Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a > l

[jira] [Commented] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048741#comment-14048741 ] Hadoop QA commented on HDFS-6609: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6617: --- Summary: Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op Key: HDFS-6617 URL: https://issues.apache.org/jira/browse/HDFS-6617

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048742#comment-14048742 ] Liang Xie commented on HDFS-6614: - The failed case is not related with current change, file

[jira] [Commented] (HDFS-6613) Improve logging in caching classes

2014-07-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048685#comment-14048685 ] Steve Loughran commented on HDFS-6613: -- you not tempted to move SLf4J in the process?

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048652#comment-14048652 ] Hadoop QA commented on HDFS-6614: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6613) Improve logging in caching classes

2014-07-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048639#comment-14048639 ] Hadoop QA commented on HDFS-6613: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

2014-07-01 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048631#comment-14048631 ] Yi Liu commented on HDFS-6391: -- [~andrew.wang], sorry, I just saw the message you asked for my

[jira] [Commented] (HDFS-6606) Optimize encryption support in DataTransfer Protocol with High performance

2014-07-01 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048624#comment-14048624 ] Yi Liu commented on HDFS-6606: -- Thanks [~tucu00], [~yoderme] and [~andrew.purt...@gmail.com] f

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: HDFS-6616.patch > bestNode shouldn't always return the first DataNode > --

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: (was: HDFS-6616.patch) > bestNode shouldn't always return the first DataNode > ---

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: HDFS-6616.patch One possible solution is choose DataNode randomly with the cost of ignore

[jira] [Updated] (HDFS-6592) Use Fluentd to write data into Hadoop HDFS over WebHDFS. Throw the AlreadyBeingCreatedException exception

2014-07-01 Thread shengjinmiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengjinmiao updated HDFS-6592: --- Summary: Use Fluentd to write data into Hadoop HDFS over WebHDFS. Throw the AlreadyBeingCreatedExcepti

[jira] [Updated] (HDFS-6592) Use Fluentd to collect data to append to HDFS. Throw the AlreadyBeingCreatedException exception

2014-07-01 Thread shengjinmiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengjinmiao updated HDFS-6592: --- Summary: Use Fluentd to collect data to append to HDFS. Throw the AlreadyBeingCreatedException excepti

[jira] [Created] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-6616: -- Summary: bestNode shouldn't always return the first DataNode Key: HDFS-6616 URL: https://issues.apache.org/jira/browse/HDFS-6616 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-6615) Replace java.security.SecureRandom with org.apache.hadoop.crypto.random.SecureRandom in HDFS

2014-07-01 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6615: Summary: Replace java.security.SecureRandom with org.apache.hadoop.crypto.random.SecureRandom in HDFS Key: HDFS-6615 URL: https://issues.apache.org/jira/browse/HDFS-6615 Project: Had