[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700272#comment-15700272 ] Hadoop QA commented on HDFS-11164: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (HDFS-11171) add metric to report client shortcircuit reads

2016-11-27 Thread 5feixiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 5feixiang updated HDFS-11171: - Comment: was deleted (was: How can I calculate local read bytes and time of short-circuit?) > add metric

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700698#comment-15700698 ] Brahma Reddy Battula commented on HDFS-11178: - [~linyiqun] thanks for pinging me. Following

[jira] [Updated] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11164: Attachment: HDFS-11164-02.patch > Mover should avoid unnecessary retries if the block is pinned >

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-11-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700120#comment-15700120 ] Rakesh R commented on HDFS-11164: - Attached another patch. Here, I've tried an attempt by maintaining

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180.00.patch Attaching a sample patch. I'm thinking removing synchronized from

[jira] [Created] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-27 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created HDFS-11179: --- Summary: LightWeightHashSet can't remove blocks correctly which have a large number blockId Key: HDFS-11179 URL: https://issues.apache.org/jira/browse/HDFS-11179

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701022#comment-15701022 ] Takanobu Asanuma commented on HDFS-11178: - Hi [~linyiqun] thanks for working on this and

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701148#comment-15701148 ] Hudson commented on HDFS-10994: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10898 (See

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701180#comment-15701180 ] Abhishek Modi commented on HDFS-11180: -- Can we have a separate readWrite lock for txid? We will

[jira] [Comment Edited] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700698#comment-15700698 ] Brahma Reddy Battula edited comment on HDFS-11178 at 11/28/16 2:17 AM:

[jira] [Created] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Abhishek Modi (JIRA)
Abhishek Modi created HDFS-11180: Summary: Intermittent deadlock in NameNode when failover happens. Key: HDFS-11180 URL: https://issues.apache.org/jira/browse/HDFS-11180 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701042#comment-15701042 ] Abhishek Modi commented on HDFS-11180: -- We are using Hadoop-2.6.0 > Intermittent deadlock in

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701038#comment-15701038 ] Akira Ajisaka commented on HDFS-11180: -- Hi [~abmodi], thank you for reporting this. Would you tell us

[jira] [Updated] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11178: - Attachment: HDFS-11178.002.patch Thanks [~brahmareddy] and [~tasanuma0829] for the review. The comments

[jira] [Updated] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10994: - Release Note: This introduced a new erasure coding policy named XOR-2-1-64k using the simple XOR codec,

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701066#comment-15701066 ] Kai Zheng commented on HDFS-10994: -- Thanks Sammi for the hard work and making it pretty easy to support

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701113#comment-15701113 ] Akira Ajisaka commented on HDFS-11180: -- Thank you for your information. It looks like: * NameNode

[jira] [Commented] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-27 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700826#comment-15700826 ] Takanobu Asanuma commented on HDFS-11179: - When a blockId is a large number, this method doesn't

[jira] [Commented] (HDFS-8792) BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory

2016-11-27 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700869#comment-15700869 ] Takanobu Asanuma commented on HDFS-8792: This seems to have a bug. Please see HDFS-11179. >

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated HDFS-11180: - Attachment: jstack.log > Intermittent deadlock in NameNode when failover happens. >

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Affects Version/s: 2.6.0 > Intermittent deadlock in NameNode when failover happens. >

[jira] [Updated] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10994: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Updated] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11178: - Attachment: HDFS-11178.001.patch Attach a patch to have a fix. Could you have a look [~brahmareddy], :).

[jira] [Updated] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-27 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11150: -- Status: Patch Available (was: Open) > [SPS]: Provide persistence when satisfying storage policy. >

[jira] [Updated] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-27 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11150: -- Attachment: HDFS-11150-HDFS-10285.001.patch Here is a draft patch for this JIRA. I'd prefer hearing

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15699407#comment-15699407 ] Hadoop QA commented on HDFS-11150: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11178: - Description: The test {{TestAddStripedBlockInFBR#testAddBlockInFullBlockReport}} fails easily in trunk.

[jira] [Updated] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11178: - Status: Patch Available (was: Open) > TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails

[jira] [Updated] (HDFS-8154) Extract WebHDFS protocol out as a specification to allow easier clients and servers

2016-11-27 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8154: -- Assignee: (was: Jakob Homan) > Extract WebHDFS protocol out as a specification to allow easier

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15699438#comment-15699438 ] Hadoop QA commented on HDFS-11178: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-27 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11178: Summary: TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk Key: HDFS-11178 URL: https://issues.apache.org/jira/browse/HDFS-11178 Project: