[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205838#comment-15205838 ] Hadoop QA commented on HDFS-9483: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10185: - Resolution: Not A Problem Status: Resolved (was: Patch Available) Closed the jira, because this

[jira] [Commented] (HDFS-9959) add log when block removed from last live datanode

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205802#comment-15205802 ] Hadoop QA commented on HDFS-9959: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7648) Verify that HDFS blocks are in the correct datanode directories

2016-03-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205769#comment-15205769 ] Rakesh R commented on HDFS-7648: Thanks [~szetszwo] for the reply. bq. Why it needs a separated sub-task

[jira] [Created] (HDFS-10190) Expose FSDatasetImpl lock metrics

2016-03-21 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10190: - Summary: Expose FSDatasetImpl lock metrics Key: HDFS-10190 URL: https://issues.apache.org/jira/browse/HDFS-10190 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205713#comment-15205713 ] John Zhuge commented on HDFS-10185: --- Close it then. Thanks for attempting to fix this unit test though,

[jira] [Commented] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205707#comment-15205707 ] Lin Yiqun commented on HDFS-10185: -- {quote} However, do you think this comment is no longer true? {quote}

[jira] [Commented] (HDFS-9559) Add haadmin command to get HA state of all the namenodes

2016-03-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205701#comment-15205701 ] Surendra Singh Lilhore commented on HDFS-9559: -- Please can someone review this jira? This

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2016-03-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205678#comment-15205678 ] Surendra Singh Lilhore commented on HDFS-9483: -- [~cnauroth], Please can you review... >

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205674#comment-15205674 ] Vinayakumar B commented on HDFS-9847: - bq. Can we use nothrow exception way, but still print out the

[jira] [Updated] (HDFS-2043) TestHFlush failing intermittently

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-2043: Attachment: HDFS-2043.003.patch Update the patch and adding the sleep time in each retry chance. Testing

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205658#comment-15205658 ] Brahma Reddy Battula commented on HDFS-9917: Uploaded patch..Kindly review.. can we limit the

[jira] [Updated] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9917: --- Status: Patch Available (was: Open) > IBR accumulate more objects when SNN was down

[jira] [Updated] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9917: --- Attachment: HDFS-9917.patch > IBR accumulate more objects when SNN was down for

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205644#comment-15205644 ] Lin Yiqun commented on HDFS-9847: - {quote} Yes. Similar to the discussion on casting the result to int, the

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205621#comment-15205621 ] Lin Yiqun commented on HDFS-9951: - Thanks [~cmccabe] for commit! > Use string constants for XML tags in

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-21 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205591#comment-15205591 ] Rushabh S Shah commented on HDFS-9874: -- Sure. Will update the patch shortly. > Long living

[jira] [Commented] (HDFS-9959) add log when block removed from last live datanode

2016-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205585#comment-15205585 ] Tsz Wo Nicholas Sze commented on HDFS-9959: --- For the new patch, please call init() in

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205581#comment-15205581 ] Hadoop QA commented on HDFS-9118: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10189) PacketResponder toString is built incorrectly

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205469#comment-15205469 ] Hadoop QA commented on HDFS-10189: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205403#comment-15205403 ] Devaraj Das commented on HDFS-3702: --- Just FYI - the balancer work is being tracked in HBASE-8549. > Add

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205395#comment-15205395 ] Arpit Agarwal commented on HDFS-3702: - If the region server has write permissions on /hbase/.logs,

[jira] [Updated] (HDFS-9959) add log when block removed from last live datanode

2016-03-21 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunjiong zhao updated HDFS-9959: Attachment: HDFS-9959.2.patch How about this one? In case of extreme case, for example, all

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Nicolas Liochon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205380#comment-15205380 ] Nicolas Liochon commented on HDFS-3702: --- bq. The issue was opened in July 2012 so we not holding our

[jira] [Updated] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10175: - Status: Patch Available (was: In Progress) > add per-operation stats to FileSystem.Statistics >

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205369#comment-15205369 ] Chris Douglas commented on HDFS-9847: - bq. Sorry I didn't understand your proposal to handle

[jira] [Updated] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10175: - Attachment: HDFS-10175.001.patch > add per-operation stats to FileSystem.Statistics >

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205361#comment-15205361 ] stack commented on HDFS-3702: - bq. ...could you comment on the usability of providing node lists to this API?

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205343#comment-15205343 ] stack commented on HDFS-3702: - bq. Hi stack, the attribute could be set by an installer script or an API call

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205337#comment-15205337 ] stack commented on HDFS-3702: - bq. How would DFSClient know which nodes are disfavored nodes? How could it

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205306#comment-15205306 ] Arpit Agarwal commented on HDFS-9847: - Sorry I didn't understand your proposal to handle compatibility

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205275#comment-15205275 ] Arpit Agarwal commented on HDFS-3702: - bq. No need for an admin operator to remember to set attributes

[jira] [Commented] (HDFS-10189) PacketResponder toString is built incorrectly

2016-03-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205233#comment-15205233 ] Colin Patrick McCabe commented on HDFS-10189: - +1 pending jenkins. Thanks. [~jpallas] >

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.003.patch New patch, incorporates a lot of [~bobhansen]'s

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205215#comment-15205215 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- > For uniform distribution of files over a cluster,

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205191#comment-15205191 ] Chris Douglas commented on HDFS-9847: - Sorry, I overloaded "precision". By providing another parameter,

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205142#comment-15205142 ] stack commented on HDFS-3702: - For uniform distribution of files over a cluster, I think users would prefer

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205137#comment-15205137 ] Wei-Chiu Chuang commented on HDFS-9874: --- Thanks for looking into it. Maybe the NPE is unrelated. I'm

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205136#comment-15205136 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- > ... we can also add another flag for fully random

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205111#comment-15205111 ] Andrew Wang commented on HDFS-3702: --- [~stack] from a downstream perspective, could you comment on the

[jira] [Comment Edited] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204945#comment-15204945 ] Chris Douglas edited comment on HDFS-9847 at 3/21/16 8:53 PM: -- The current

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-21 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205092#comment-15205092 ] Rushabh S Shah commented on HDFS-9874: -- The NPE is expected. {quote} at

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-03-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205086#comment-15205086 ] Mingliang Liu commented on HDFS-10175: -- Thanks for your comment, [~andrew.wang]. I was aware of the

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205079#comment-15205079 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- > So, the suggestion is changing public signatures

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205020#comment-15205020 ] Arpit Agarwal commented on HDFS-9847: - The precision check was my idea so I'll try to answer. bq. The

[jira] [Updated] (HDFS-10189) PacketResponder toString is built incorrectly

2016-03-21 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-10189: -- Attachment: HDFS-10189.patch > PacketResponder toString is built incorrectly >

[jira] [Updated] (HDFS-10189) PacketResponder toString is built incorrectly

2016-03-21 Thread Joe Pallas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-10189: -- Assignee: Joe Pallas Status: Patch Available (was: Open) > PacketResponder toString is built

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204989#comment-15204989 ] stack commented on HDFS-3702: - [~szetszwo] So, the suggestion is changing public signatures to add a new

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-21 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204987#comment-15204987 ] Rushabh S Shah commented on HDFS-9874: -- [~jojochuang]: Thanks for reporting. Taking a look now. >

[jira] [Commented] (HDFS-10187) Add a "list" refresh handler to list all registered refresh identifiers/handlers

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204985#comment-15204985 ] Wei-Chiu Chuang commented on HDFS-10187: Test failures are all known bugs and unrelated. The

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204980#comment-15204980 ] Wei-Chiu Chuang commented on HDFS-9874: --- It seems this patch is buggy. In a precommit job, this test

[jira] [Commented] (HDFS-9405) Warmup NameNode EDEK caches in background thread

2016-03-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204977#comment-15204977 ] Xiao Chen commented on HDFS-9405: - Thanks Andrew and all for the review! (Sorry for that missed final)

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204981#comment-15204981 ] stack commented on HDFS-3702: - [~arpiagariu] You'd like to purge all of the CreateFlag parameters Arpit?

[jira] [Created] (HDFS-10189) PacketResponder toString is built incorrectly

2016-03-21 Thread Joe Pallas (JIRA)
Joe Pallas created HDFS-10189: - Summary: PacketResponder toString is built incorrectly Key: HDFS-10189 URL: https://issues.apache.org/jira/browse/HDFS-10189 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204956#comment-15204956 ] Hudson commented on HDFS-9951: -- FAILURE: Integrated in Hadoop-trunk-Commit #9483 (See

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204945#comment-15204945 ] Chris Douglas commented on HDFS-9847: - The current patch changes {{Configuration::getTimeDuration}} to

[jira] [Commented] (HDFS-10187) Add a "list" refresh handler to list all registered refresh identifiers/handlers

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204949#comment-15204949 ] Hadoop QA commented on HDFS-10187: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9809) Abstract implementation-specific details from the datanode

2016-03-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9809: - Component/s: fs datanode > Abstract implementation-specific details from

[jira] [Commented] (HDFS-9809) Abstract implementation-specific details from the datanode

2016-03-21 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204943#comment-15204943 ] Virajith Jalaparti commented on HDFS-9809: -- Hi [~zhz], Thanks for the comment. One concrete

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204925#comment-15204925 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- Please do commit the patch yet. Some idea below.

[jira] [Updated] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9951: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204862#comment-15204862 ] Colin Patrick McCabe commented on HDFS-9951: Thanks for fixing the patch. +1 > Use string

[jira] [Commented] (HDFS-9405) Warmup NameNode EDEK caches in background thread

2016-03-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204863#comment-15204863 ] Hudson commented on HDFS-9405: -- FAILURE: Integrated in Hadoop-trunk-Commit #9482 (See

[jira] [Updated] (HDFS-9405) Warmup NameNode EDEK caches in background thread

2016-03-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9405: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Pushed

[jira] [Commented] (HDFS-9405) Warmup NameNode EDEK caches in background thread

2016-03-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204847#comment-15204847 ] Andrew Wang commented on HDFS-9405: --- One teensy nit is that I think we could make initialDelay and

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204843#comment-15204843 ] Tsz Wo Nicholas Sze commented on HDFS-9917: --- [~brahmareddy], your proposal on reRegister() sounds

[jira] [Commented] (HDFS-7648) Verify that HDFS blocks are in the correct datanode directories

2016-03-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204822#comment-15204822 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- > ... I've raised separate sub-task HDFS-10186 to

[jira] [Commented] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204776#comment-15204776 ] Hadoop QA commented on HDFS-9616: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-9579: -- Fix Version/s: 2.9.0 Committed the branch-2 patch onto branch-2. I am not committing it to branch-2.8

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204734#comment-15204734 ] Lei (Eddy) Xu commented on HDFS-3702: - Hey, Guys Based on [~stack] and [~andrew.wang]'s +1s, I will

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204679#comment-15204679 ] Ming Ma commented on HDFS-9579: --- The branch-2 version also applies to branch-2.8. Unless others ask for it,

[jira] [Commented] (HDFS-10184) Introduce unit tests framework for HDFS UI

2016-03-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204670#comment-15204670 ] Haohui Mai commented on HDFS-10184: --- Unless we move to Java 8 this is a non starter. The UI is heavily

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204661#comment-15204661 ] Lei (Eddy) Xu commented on HDFS-3702: - [~arpitagarwal] and [~szetszwo]. Thanks for these useful

[jira] [Commented] (HDFS-2043) TestHFlush failing intermittently

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204615#comment-15204615 ] Hadoop QA commented on HDFS-2043: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204613#comment-15204613 ] Arpit Agarwal commented on HDFS-9847: - Thanks [~linyiqun]. I am +1 for the latest patch with a minor

[jira] [Commented] (HDFS-9959) add log when block removed from last live datanode

2016-03-21 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204604#comment-15204604 ] yunjiong zhao commented on HDFS-9959: - +1 for this. > add log when block removed from last live

[jira] [Updated] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9579: -- Attachment: HDFS-9579-branch-2.patch Thank you [~sjlee0], [~liuml07] and [~cmccabe]! Here is the patch for

[jira] [Updated] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-21 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9616: - Assignee: Bob Hansen (was: James Clampffer) > libhdfs++ Add runtime hooks to allow a client application

[jira] [Updated] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-21 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9616: - Attachment: HDFS-9616.HDFS-8707.002.patch Added callbacks that provide context (cluster, file, and event)

[jira] [Updated] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-21 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9616: - Status: Patch Available (was: Open) > libhdfs++ Add runtime hooks to allow a client application to add

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

2016-03-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204495#comment-15204495 ] Sangjin Lee commented on HDFS-10183: I agree that JLS makes it clear that a memory barrier is required

[jira] [Updated] (HDFS-10187) Add a "list" refresh handler to list all registered refresh identifiers/handlers

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10187: --- Status: Patch Available (was: Open) > Add a "list" refresh handler to list all registered

[jira] [Commented] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204427#comment-15204427 ] John Zhuge commented on HDFS-10185: --- bq. Yes, my new code is used to check if

[jira] [Created] (HDFS-10188) libhdfs++: Implement debug allocators

2016-03-21 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10188: -- Summary: libhdfs++: Implement debug allocators Key: HDFS-10188 URL: https://issues.apache.org/jira/browse/HDFS-10188 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10187) Add a "list" refresh handler to list all registered refresh identifiers/handlers

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10187: --- Labels: commandline supportability (was: supportability) > Add a "list" refresh handler to

[jira] [Updated] (HDFS-10187) Add a "list" refresh handler to list all registered refresh identifiers/handlers

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10187: --- Attachment: HDFS-10187.001.patch Rev01: added the list refresh handler, a test case to verify

[jira] [Created] (HDFS-10187) Add a "list" refresh handler to list all registered refresh identifiers/handlers

2016-03-21 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10187: -- Summary: Add a "list" refresh handler to list all registered refresh identifiers/handlers Key: HDFS-10187 URL: https://issues.apache.org/jira/browse/HDFS-10187

[jira] [Commented] (HDFS-10183) Prevent race condition during class initialization

2016-03-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204345#comment-15204345 ] Daryn Sharp commented on HDFS-10183: My reading of the JLS and the footnotes seems to pretty clearly

[jira] [Updated] (HDFS-2043) TestHFlush failing intermittently

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-2043: Attachment: HDFS-2043.002.patch > TestHFlush failing intermittently > - > >

[jira] [Commented] (HDFS-2043) TestHFlush failing intermittently

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204126#comment-15204126 ] Lin Yiqun commented on HDFS-2043: - As [~kihwal] pointed out, it seems to be an actual race. The two

[jira] [Updated] (HDFS-2043) TestHFlush failing intermittently

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-2043: Status: Patch Available (was: Open) > TestHFlush failing intermittently > -

[jira] [Assigned] (HDFS-2043) TestHFlush failing intermittently

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun reassigned HDFS-2043: --- Assignee: Lin Yiqun > TestHFlush failing intermittently > - > >

[jira] [Commented] (HDFS-10184) Introduce unit tests framework for HDFS UI

2016-03-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204086#comment-15204086 ] Steve Loughran commented on HDFS-10184: --- can you see if you can get away with HtmlUnit first? That

[jira] [Commented] (HDFS-10186) DirectoryScanner: Improve logs by adding full path of both actual and expected block directories

2016-03-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203998#comment-15203998 ] Kai Zheng commented on HDFS-10186: -- The patch LGTM. Thanks [~rakeshr] for the nice work. >

[jira] [Commented] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-21 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203975#comment-15203975 ] Lin Yiqun commented on HDFS-10185: -- The failed reason of unit test {{hadoop.hdfs.TestHFlush }} is not

[jira] [Commented] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203881#comment-15203881 ] Hadoop QA commented on HDFS-9555: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-03-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203879#comment-15203879 ] Weiwei Yang commented on HDFS-6489: --- This issue happened to us as well. We have some clients continually

[jira] [Commented] (HDFS-10186) DirectoryScanner: Improve logs by adding full path of both actual and expected block directories

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203867#comment-15203867 ] Hadoop QA commented on HDFS-10186: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10185) TestHFlushInterrupted verifies interrupt state incorrectly

2016-03-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203857#comment-15203857 ] Hadoop QA commented on HDFS-10185: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||