[jira] [Updated] (HDFS-11517) Expose slow disks via DataNode JMX

[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11517: -- Attachment: HDFS-11517.001.patch In patch v02, I have resolved the checkstyle errors and

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927487#comment-15927487 ] stack commented on HDFS-11170: -- I took a look at 03 * CreateBuilder.java needs license. * I was going to

[jira] [Updated] (HDFS-11511) Support Timeout when checking single disk

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11511: - Summary: Support Timeout when checking single disk (was: DataNode disk checks should timeout

[jira] [Commented] (HDFS-11511) DataNode disk checks should timeout when stalled

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927398#comment-15927398 ] Hanisha Koneru commented on HDFS-11511: --- Thank you [~arpitagarwal] for taking care of the fixes and

[jira] [Commented] (HDFS-11537) Block Storage : add cache layer

[ https://issues.apache.org/jira/browse/HDFS-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927391#comment-15927391 ] Xiaoyu Yao commented on HDFS-11537: --- Thanks [~vagarychen] for working on this and posting the patch. It

[jira] [Updated] (HDFS-11531) Expose hedged read metrics via libHDFS API

[ https://issues.apache.org/jira/browse/HDFS-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11531: - Attachment: HDFS-11531.000.patch > Expose hedged read metrics via libHDFS API >

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927364#comment-15927364 ] Hadoop QA commented on HDFS-10530: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927361#comment-15927361 ] Arpit Agarwal commented on HDFS-11535: -- This is a comprehensive performance analysis [~vagarychen].

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927311#comment-15927311 ] Andrew Wang commented on HDFS-10530: Hi Manoj, thanks for working on this, hoping you can help me

[jira] [Commented] (HDFS-11511) DataNode disk checks should timeout when stalled

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927287#comment-15927287 ] Hudson commented on HDFS-11511: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11411 (See

[jira] [Commented] (HDFS-10706) Add tool generating FSImage from external store

[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927272#comment-15927272 ] Hadoop QA commented on HDFS-10706: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11511) DataNode disk checks should timeout when stalled

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11511: - Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-11511) DataNode disk checks should timeout when stalled

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11511: - Summary: DataNode disk checks should timeout when stalled (was: Support Timeout when checking

[jira] [Commented] (HDFS-11511) Support Timeout when checking single disk

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927268#comment-15927268 ] Arpit Agarwal commented on HDFS-11511: -- - The javac and javadoc warnings are in the imported code. -

[jira] [Commented] (HDFS-11481) hdfs snapshotDiff /.reserved/raw/... fails on snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927255#comment-15927255 ] Andrew Wang commented on HDFS-11481: Thanks for working on this Mavin, I refreshed myself a bit on

[jira] [Commented] (HDFS-11511) Support Timeout when checking single disk

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927247#comment-15927247 ] Hadoop QA commented on HDFS-11511: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11190) Namenode support for data stored in external stores.

[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927238#comment-15927238 ] Virajith Jalaparti edited comment on HDFS-11190 at 3/16/17 12:16 AM: -

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Attachment: HDFS-11190-HDFS-9806.001.patch Posting a patch that enables this

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927233#comment-15927233 ] Andrew Wang commented on HDFS-11170: bq. Can we change the name (i.e. CreateBuilder) to be more

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927221#comment-15927221 ] Xiaobing Zhou commented on HDFS-11170: -- Thanks [~zhouwei] for the work. Some comments: # Can we

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Status: Patch Available (was: Open) > Namenode support for data stored in external

[jira] [Updated] (HDFS-11190) Namenode support for data stored in external stores.

[ https://issues.apache.org/jira/browse/HDFS-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11190: -- Status: Open (was: Patch Available) > Namenode support for data stored in external

[jira] [Updated] (HDFS-10706) Add tool generating FSImage from external store

[ https://issues.apache.org/jira/browse/HDFS-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10706: -- Attachment: HDFS-10706-HDFS-9806.003.patch Posting a modified version of patch v002

[jira] [Comment Edited] (HDFS-10675) Datanode support to read from external stores.

[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927202#comment-15927202 ] Virajith Jalaparti edited comment on HDFS-10675 at 3/15/17 11:47 PM: -

[jira] [Comment Edited] (HDFS-10675) Datanode support to read from external stores.

[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927202#comment-15927202 ] Virajith Jalaparti edited comment on HDFS-10675 at 3/15/17 11:46 PM: -

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Attachment: HDFS-10675-HDFS-9806.004.patch Posting a new patch that rebases the earlier

[jira] [Commented] (HDFS-11465) Rename BlockType#CONTIGUOUS to BlockType#REPLICATED

[ https://issues.apache.org/jira/browse/HDFS-11465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927194#comment-15927194 ] Andrew Wang commented on HDFS-11465: Hi [~yuanbo], thanks for picking this up. Upon further thought, I

[jira] [Updated] (HDFS-11465) Rename BlockType#CONTIGUOUS to BlockType#REPLICATED

[ https://issues.apache.org/jira/browse/HDFS-11465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11465: --- Resolution: Later Status: Resolved (was: Patch Available) I'm going to close this as "Later"

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927142#comment-15927142 ] Andrew Wang commented on HDFS-11170: Hi Sammi, thanks for taking this over, a few review comments:

[jira] [Updated] (HDFS-11537) Block Storage : add cache layer

[ https://issues.apache.org/jira/browse/HDFS-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11537: -- Description: This JIRA adds the cache layer. Specifically, this JIRA implements the cache interface in

[jira] [Updated] (HDFS-11537) Block Storage : add cache layer

[ https://issues.apache.org/jira/browse/HDFS-11537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11537: -- Attachment: HDFS-11537-HDSF-7240.001.patch > Block Storage : add cache layer >

[jira] [Created] (HDFS-11537) Block Storage : add cache layer

Chen Liang created HDFS-11537: - Summary: Block Storage : add cache layer Key: HDFS-11537 URL: https://issues.apache.org/jira/browse/HDFS-11537 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927069#comment-15927069 ] Chris Nauroth commented on HDFS-11163: -- [~surendrasingh], I was about to commit this when I noticed

[jira] [Updated] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11519: --- Attachment: HDFS-11519-HDFS-7240.20170315.patch HDFS-11519-HDFS-7240.20170315.patch:

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927029#comment-15927029 ] Steve Loughran commented on HDFS-11431: --- [~aw] bq. I think that sort of defeats the purpose. no,

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927021#comment-15927021 ] Andrew Wang commented on HDFS-6984: --- Hi Chris, thanks for revving, a few review comments: I was

[jira] [Updated] (HDFS-11511) Support Timeout when checking single disk

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11511: - Attachment: HDFS-11511.004.patch The Jenkins issues are all in the TimeoutFuture code imported

[jira] [Commented] (HDFS-11528) NameNode load EditRecords throws NPE

[ https://issues.apache.org/jira/browse/HDFS-11528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926982#comment-15926982 ] Ravi Prakash commented on HDFS-11528: - Thanks for the report tangshangwen! I see the code has changed

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926983#comment-15926983 ] Allen Wittenauer commented on HDFS-11431: - bq. Could we get away with declaring hadoop-hdfs as a

[jira] [Commented] (HDFS-11534) Add counters for number of blocks in pending IBR

[ https://issues.apache.org/jira/browse/HDFS-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926973#comment-15926973 ] Hadoop QA commented on HDFS-11534: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11536: - Labels: 2.9.0 (was: ) > Throttle DataNode slow BlockReceiver warnings >

[jira] [Commented] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926969#comment-15926969 ] Mingliang Liu commented on HDFS-11536: -- +1 for the proposal. > Throttle DataNode slow BlockReceiver

[jira] [Updated] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11536: - Component/s: (was: hdfs) datanode > Throttle DataNode slow BlockReceiver

[jira] [Updated] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11536: - Description: There are a couple of warnings for every packet when peer is slow. See also

[jira] [Updated] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11536: - Description: There are too many warnings when peer is slow. See also

[jira] [Updated] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11536: - Component/s: hdfs > Throttle DataNode slow BlockReceiver warnings >

[jira] [Updated] (HDFS-11536) Throttle DataNode slow BlockReceiver warnings

[ https://issues.apache.org/jira/browse/HDFS-11536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11536: - Summary: Throttle DataNode slow BlockReceiver warnings (was: Suppress logs in BlockReceiver when

[jira] [Created] (HDFS-11536) Suppress logs in BlockReceiver when peer is slow

Xiaobing Zhou created HDFS-11536: Summary: Suppress logs in BlockReceiver when peer is slow Key: HDFS-11536 URL: https://issues.apache.org/jira/browse/HDFS-11536 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926895#comment-15926895 ] Hadoop QA commented on HDFS-11431: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11534) Add counters for number of blocks in pending IBR

[ https://issues.apache.org/jira/browse/HDFS-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926891#comment-15926891 ] Arpit Agarwal commented on HDFS-11534: -- Also please see if you can add a unit test. The

[jira] [Commented] (HDFS-11534) Add counters for number of blocks in pending IBR

[ https://issues.apache.org/jira/browse/HDFS-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926887#comment-15926887 ] Arpit Agarwal commented on HDFS-11534: -- The patch looks good. A few code style suggestions: # Replace

[jira] [Commented] (HDFS-11511) Support Timeout when checking single disk

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926868#comment-15926868 ] Hadoop QA commented on HDFS-11511: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11535: -- Description: This JIRA is created to post the results of some performance experiments we did. For

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926854#comment-15926854 ] Chen Liang commented on HDFS-11530: --- hi [~linyiqun], I've created JIRA HDFS-11535 as a placeholder for

[jira] [Updated] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11535: -- Attachment: HDFS-11535.001.patch > Performance analysis of new DFSNetworkTopology#chooseRandom >

[jira] [Updated] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11535: -- Attachment: PerfTest.pdf > Performance analysis of new DFSNetworkTopology#chooseRandom >

[jira] [Created] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

Chen Liang created HDFS-11535: - Summary: Performance analysis of new DFSNetworkTopology#chooseRandom Key: HDFS-11535 URL: https://issues.apache.org/jira/browse/HDFS-11535 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated HDFS-11431: --- Attachment: HDFS-11431-branch-2.8.0.002.patch Attaching a new patch which excludes all the transitive

[jira] [Commented] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926819#comment-15926819 ] Hudson commented on HDFS-11419: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11410 (See

[jira] [Updated] (HDFS-11514) DFSTopologyNodeImpl#chooseRandom optimizations

[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11514: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HDFS-11514) DFSTopologyNodeImpl#chooseRandom optimizations

[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11514: - Summary: DFSTopologyNodeImpl#chooseRandom optimizations (was: ChooseRandom can potentially be

[jira] [Commented] (HDFS-11514) ChooseRandom can potentially be optimized

[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926800#comment-15926800 ] Hadoop QA commented on HDFS-11514: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11534) Add counters for number of blocks in pending IBR

[ https://issues.apache.org/jira/browse/HDFS-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11534: - Status: Patch Available (was: Open) > Add counters for number of blocks in pending IBR >

[jira] [Updated] (HDFS-11534) Add counters for number of blocks in pending IBR

[ https://issues.apache.org/jira/browse/HDFS-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11534: - Attachment: HDFS-11534.000.patch > Add counters for number of blocks in pending IBR >

[jira] [Commented] (HDFS-11533) reuseAddress option should be used for child channels in Portmap and SimpleTcpServer

[ https://issues.apache.org/jira/browse/HDFS-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926782#comment-15926782 ] Hadoop QA commented on HDFS-11533: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11533) reuseAddress option should be used for child channels in Portmap and SimpleTcpServer

[ https://issues.apache.org/jira/browse/HDFS-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11533: - Status: Patch Available (was: Open) > reuseAddress option should be used for child

[jira] [Updated] (HDFS-11533) reuseAddress option should be used for child channels in Portmap and SimpleTcpServer

[ https://issues.apache.org/jira/browse/HDFS-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11533: - Attachment: HDFS-11533.001.patch Tested this patch manually by killing the nfs gateway

[jira] [Created] (HDFS-11534) Add counters for number of blocks in pending IBR

Xiaobing Zhou created HDFS-11534: Summary: Add counters for number of blocks in pending IBR Key: HDFS-11534 URL: https://issues.apache.org/jira/browse/HDFS-11534 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11534) Add counters for number of blocks in pending IBR

[ https://issues.apache.org/jira/browse/HDFS-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11534: - Component/s: hdfs > Add counters for number of blocks in pending IBR >

[jira] [Commented] (HDFS-11514) ChooseRandom can potentially be optimized

[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926669#comment-15926669 ] Arpit Agarwal commented on HDFS-11514: -- +1 for the v003 patch pending Jenkins. > ChooseRandom can

[jira] [Commented] (HDFS-11511) Support Timeout when checking single disk

[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1592#comment-1592 ] Arpit Agarwal commented on HDFS-11511: -- Restarted precommit build.

[jira] [Updated] (HDFS-11533) reuseAddress option should be used for child channels in Portmap and SimpleTcpServer

[ https://issues.apache.org/jira/browse/HDFS-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11533: - Description: Bind can fail in SimpleTcpServer because reuseAddress option is not used for

[jira] [Updated] (HDFS-11533) reuseAddress option should be used for child channels in Portmap and SimpleTcpServer

[ https://issues.apache.org/jira/browse/HDFS-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11533: - Description: Bind can fail in SimpleTcpServer because reuseAddress option is not used for

[jira] [Created] (HDFS-11533) reuseAddress option should be used for child channels in Portmap and SimpleTcpServer

Mukul Kumar Singh created HDFS-11533: Summary: reuseAddress option should be used for child channels in Portmap and SimpleTcpServer Key: HDFS-11533 URL: https://issues.apache.org/jira/browse/HDFS-11533

[jira] [Updated] (HDFS-11514) ChooseRandom can potentially be optimized

[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11514: -- Attachment: HDFS-11514.003.patch Thanks [~arpitagarwal] and [~linyiqun] for the comments! Post v003

[jira] [Updated] (HDFS-11420) Edit file should not be processed by the same type processor in OfflineEditsViewer

[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11420: - Resolution: Fixed Status: Resolved (was: Patch Available) > Edit file should not be processed by

[jira] [Updated] (HDFS-11420) Edit file should not be processed by the same type processor in OfflineEditsViewer

[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11420: - Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 2.9.0 Test failures are not

[jira] [Commented] (HDFS-11420) Edit file should not be processed by the same type processor in OfflineEditsViewer

[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926075#comment-15926075 ] Hadoop QA commented on HDFS-11420: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7343) HDFS smart storage management

/issues.apache.org/jira/browse/HDFS-7343 > Project: Hadoop HDFS > Issue Type: Improvement > Reporter: Kai Zheng >Assignee: Wei Zhou > Attachments: HDFSSmartStorageManagement-General-20170315.pdf, > HDFS-Smart-Storage-Management.

[jira] [Commented] (HDFS-11514) ChooseRandom can potentially be optimized

[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925899#comment-15925899 ] Yiqun Lin commented on HDFS-11514: -- Thanks [~arpitagarwal] for providing the review. Agreed on your

[jira] [Commented] (HDFS-11420) Edit file should not be processed by the same type processor in OfflineEditsViewer

[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925869#comment-15925869 ] Hudson commented on HDFS-11420: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11407 (See

[jira] [Updated] (HDFS-11420) Edit file should not be processed by the same type processor in OfflineEditsViewer

[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11420: - Attachment: HDFS-11420-branch-2.patch Thanks [~ajisakaa] for the review. Committed this to trunk and

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925842#comment-15925842 ] Steve Loughran commented on HDFS-11431: --- One thing to consider here is that a key goal of the split

[jira] [Updated] (HDFS-11420) Edit file should not be processed by the same type processor in OfflineEditsViewer

[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11420: - Summary: Edit file should not be processed by the same type processor in OfflineEditsViewer (was: Edit

[jira] [Updated] (HDFS-7343) HDFS smart storage management

[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-7343: --- Attachment: HDFSSmartStorageManagement-Phase1-20170315.pdf HDFSSmartStorageManagement-General

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925714#comment-15925714 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925677#comment-15925677 ] Uma Maheswara Rao G commented on HDFS-11334: Thank you [~rakeshr] for bringing this case. Here

[jira] [Commented] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925622#comment-15925622 ] Sailesh Mukil commented on HDFS-11529: -- [~James C] Thank you very much for the pointer! And yes, as

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925588#comment-15925588 ] Takanobu Asanuma commented on HDFS-10530: - Thanks for the patch, [~manojg]! Mostly it looks good