[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-03-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.005.patch > In Hadoop 3, make FileStatus serialize itself via protobuf >

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-03-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925574#comment-15925574 ] Chris Douglas commented on HDFS-6984: - Fixed some checkstyle warnings. Test failures are due to

[jira] [Comment Edited] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-03-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925574#comment-15925574 ] Chris Douglas edited comment on HDFS-6984 at 3/15/17 5:52 AM: -- Fixed some

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925548#comment-15925548 ] Hadoop QA commented on HDFS-11170: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11420) Edit file should not be processed by same type processor in OfflineEditsViewer

2017-03-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925546#comment-15925546 ] Akira Ajisaka commented on HDFS-11420: -- LGTM, +1. > Edit file should not be processed by same type

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2017-03-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925514#comment-15925514 ] Virajith Jalaparti commented on HDFS-6708: -- Thanks for all the work [~ehiggs] and [~PieterReuse].

[jira] [Created] (HDFS-11532) Ozone: SCM: Support listContainers API

2017-03-14 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-11532: - Summary: Ozone: SCM: Support listContainers API Key: HDFS-11532 URL: https://issues.apache.org/jira/browse/HDFS-11532 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925504#comment-15925504 ] Hadoop QA commented on HDFS-6648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11491) Ozone: SCM: Add close container RPC

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11491: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-11491) Ozone: SCM: Add close container RPC

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11491: -- Summary: Ozone: SCM: Add close container RPC (was: Ozone: Add close container RPC ) > Ozone: SCM:

[jira] [Commented] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925493#comment-15925493 ] Xiaoyu Yao commented on HDFS-11487: --- [~yuanbo], thanks for the new patch. I just pushed it to HDFS-7240.

[jira] [Commented] (HDFS-11511) Support Timeout when checking single disk

2017-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925467#comment-15925467 ] Arpit Agarwal commented on HDFS-11511: -- +1 pending Jenkins. One nit I can fix while committing -

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925466#comment-15925466 ] SammiChen commented on HDFS-11170: -- A new patch uploaded. Javadoc issue and two failed unit test

[jira] [Commented] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925465#comment-15925465 ] James Clampffer commented on HDFS-11529: [~sailesh] You're correct, it hasn't been pushed to

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-03.patch > Add create API in filesystem public class to support assign parameter

[jira] [Comment Edited] (HDFS-11514) ChooseRandom can potentially be optimized

2017-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925461#comment-15925461 ] Arpit Agarwal edited comment on HDFS-11514 at 3/15/17 3:06 AM: --- The change

[jira] [Commented] (HDFS-11514) ChooseRandom can potentially be optimized

2017-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925461#comment-15925461 ] Arpit Agarwal commented on HDFS-11514: -- The change looks good. Just one comment - the

[jira] [Commented] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925451#comment-15925451 ] Yuanbo Liu commented on HDFS-11487: --- [~xyao] Thanks for your response. the package name of

[jira] [Updated] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11487: -- Attachment: HDFS-11487-HDFS-7240-amend.001.patch > Ozone: Exclude container protobuf files from

[jira] [Comment Edited] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2017-03-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925405#comment-15925405 ] SammiChen edited comment on HDFS-9705 at 3/15/17 2:43 AM: -- Thanks Andrew for

[jira] [Updated] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

2017-03-14 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-6648: -- Attachment: HDFS-6648-001.patch Reuploading for jenkins. > Order of namenodes in

[jira] [Updated] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

2017-03-14 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-6648: -- Attachment: (was: HDFS-6648-001.patch) > Order of namenodes in ConfiguredFailoverProxyProvider is

[jira] [Commented] (HDFS-11491) Ozone: Add close container RPC

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925437#comment-15925437 ] Xiaoyu Yao commented on HDFS-11491: --- Thanks [~anu] for the update. +1 for patch v2. The findbugs issue

[jira] [Commented] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925436#comment-15925436 ] Xiaoyu Yao commented on HDFS-11487: --- This does not fix the ozone protobuf find-bugs issue as the package

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925435#comment-15925435 ] Yiqun Lin commented on HDFS-11530: -- I get it. Thanks [~arpitagarwal] and [~vagarychen] for the comments.

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2017-03-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925433#comment-15925433 ] Kai Zheng commented on HDFS-9705: - Hi [~Sammi], it's a good idea to get this ported to 2.x to ensure the

[jira] [Commented] (HDFS-11514) ChooseRandom can potentially be optimized

2017-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925432#comment-15925432 ] Yiqun Lin commented on HDFS-11514: -- Thanks [~vagarychen] for updating the patch. The patch looks good to

[jira] [Commented] (HDFS-11334) [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks

2017-03-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925407#comment-15925407 ] Rakesh R commented on HDFS-11334: - [~umamaheswararao], Apart from the NN switch and DN heartbeat expiry,

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2017-03-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925405#comment-15925405 ] SammiChen commented on HDFS-9705: - Thanks Andrew for review and commit the patch! As for back port to 2.x,

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925399#comment-15925399 ] Hadoop QA commented on HDFS-11431: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11511) Support Timeout when checking single disk

2017-03-14 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11511: -- Attachment: HDFS-11511.003.patch Thank you [~arpitagarwal]. I have updated the patch (v03). >

[jira] [Updated] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-14 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated HDFS-11431: --- Status: Patch Available (was: Open) > hadoop-hdfs-client JAR does not include

[jira] [Updated] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-14 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated HDFS-11431: --- Attachment: HDFS-11431-branch-2.8.0.001.patch I've attached a patch which simply makes hadoop-client

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925334#comment-15925334 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11491) Ozone: Add close container RPC

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925335#comment-15925335 ] Hadoop QA commented on HDFS-11491: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11511) Support Timeout when checking single disk

2017-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925319#comment-15925319 ] Arpit Agarwal edited comment on HDFS-11511 at 3/15/17 12:19 AM: Thanks

[jira] [Commented] (HDFS-11511) Support Timeout when checking single disk

2017-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925319#comment-15925319 ] Arpit Agarwal commented on HDFS-11511: -- Thanks [~hanishakoneru]! The changes look good. A few more

[jira] [Comment Edited] (HDFS-11511) Support Timeout when checking single disk

2017-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925319#comment-15925319 ] Arpit Agarwal edited comment on HDFS-11511 at 3/15/17 12:19 AM: Thanks

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2017-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925311#comment-15925311 ] Hudson commented on HDFS-9705: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11405 (See

[jira] [Commented] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-14 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925305#comment-15925305 ] Sailesh Mukil commented on HDFS-11529: -- [~James C] It looks like libhdfs++ hasn't been pushed to

[jira] [Updated] (HDFS-11491) Ozone: Add close container RPC

2017-03-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11491: Attachment: HDFS-11491-HDFS-7240.002.patch [~xyao] Thanks for the code review. This new patch

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2017-03-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9705: -- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10530: -- Attachment: HDFS-10530.4.patch Attached v4 patch with latest trunk rebase, and test

[jira] [Commented] (HDFS-11361) Block Storage : add cache interface

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925243#comment-15925243 ] Hadoop QA commented on HDFS-11361: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925188#comment-15925188 ] Andrew Wang commented on HDFS-11170: Great, thanks [~Sammi] and [~zhouwei]! I feel like we've already

[jira] [Commented] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925183#comment-15925183 ] James Clampffer commented on HDFS-11529: We added a "hdfsGetLastError" call using thread local

[jira] [Commented] (HDFS-11511) Support Timeout when checking single disk

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925156#comment-15925156 ] Hadoop QA commented on HDFS-11511: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-03-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Status: Patch Available (was: Open) > In Hadoop 3, make FileStatus serialize itself via protobuf >

[jira] [Assigned] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-10530: - Assignee: Manoj Govindassamy (was: Rui Gao) Sure, taking up this bug based on

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925103#comment-15925103 ] Steve Loughran commented on HDFS-11431: --- that said: if the proxy is meant to be used in the client,

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925099#comment-15925099 ] Steve Loughran commented on HDFS-11431: --- +1 for hadoop-client dependencies in the POM; I think my

[jira] [Updated] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11431: --- Target Version/s: 2.8.0, 3.0.0-alpha3 Adding target versions since this looks to be possibly a real

[jira] [Commented] (HDFS-11514) ChooseRandom can potentially be optimized

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925071#comment-15925071 ] Hadoop QA commented on HDFS-11514: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-14 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924995#comment-15924995 ] Steven Rand commented on HDFS-11431: I tried the naive approach of simply moving

[jira] [Resolved] (HDFS-11495) Ozone: Fix TestDatanodeStateMachine#testDatanodeStateContext

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-11495. --- Resolution: Fixed This has been fixed by HDFS-11469. > Ozone: Fix

[jira] [Commented] (HDFS-6648) Order of namenodes in ConfiguredFailoverProxyProvider is not defined by order in hdfs-site.xml

2017-03-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924984#comment-15924984 ] Chris Douglas commented on HDFS-6648: - +1 on the latest patch, assuming Jenkins comes back clean. Or at

[jira] [Updated] (HDFS-11361) Block Storage : add cache interface

2017-03-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11361: -- Attachment: HDFS-11361-HDFS-7240.003.patch post v003 to address the compilation issue. > Block Storage

[jira] [Assigned] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-10971: -- Assignee: Manoj Govindassamy (was: Yongjun Zhang) > Distcp should not copy replication factor

[jira] [Assigned] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-10971: -- Assignee: Yongjun Zhang (was: Wei-Chiu Chuang) > Distcp should not copy replication factor if

[jira] [Commented] (HDFS-11469) Ozone: SCM: Container allocation based on node report

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924923#comment-15924923 ] Xiaoyu Yao commented on HDFS-11469: --- Thanks [~anu] for the review and commit. > Ozone: SCM: Container

[jira] [Updated] (HDFS-11514) ChooseRandom can potentially be optimized

2017-03-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11514: -- Status: Patch Available (was: In Progress) > ChooseRandom can potentially be optimized >

[jira] [Updated] (HDFS-11514) ChooseRandom can potentially be optimized

2017-03-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11514: -- Attachment: HDFS-11514.002.patch Thanks [~linyiqun] for the comments! Uploaded v002 patch to include

[jira] [Commented] (HDFS-11361) Block Storage : add cache interface

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924876#comment-15924876 ] Hadoop QA commented on HDFS-11361: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report

2017-03-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11469: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924826#comment-15924826 ] Hudson commented on HDFS-11505: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11401 (See

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924823#comment-15924823 ] Manoj Govindassamy commented on HDFS-11505: --- Thanks for the review and commit help

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Release Note: By default, none of the built-in erasure coding policies are enabled.

[jira] [Commented] (HDFS-11355) Block Storage : merge configuration into ozone configuration classes

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924816#comment-15924816 ] Hadoop QA commented on HDFS-11355: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11361) Block Storage : add cache interface

2017-03-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11361: -- Attachment: HDFS-11361-HDFS-7240.002.patch Repost v001 patch as v002 patch to trigger Jenkins. > Block

[jira] [Updated] (HDFS-11355) Block Storage : merge configuration into ozone configuration classes

2017-03-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11355: -- Attachment: HDFS-11355-HDFS-7240.004.patch Re-post v003 patch as v004 patch to trigger Jenkins. >

[jira] [Updated] (HDFS-11511) Support Timeout when checking single disk

2017-03-14 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11511: -- Attachment: HDFS-11511.002.patch Thank you [~arpitagarwal] for reviewing the patch. I have

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11505: --- Resolution: Fixed Hadoop Flags: Incompatible change Fix Version/s: 3.0.0-alpha3

[jira] [Created] (HDFS-11531) Expose hedged read metrics via libHDFS API

2017-03-14 Thread Sailesh Mukil (JIRA)
Sailesh Mukil created HDFS-11531: Summary: Expose hedged read metrics via libHDFS API Key: HDFS-11531 URL: https://issues.apache.org/jira/browse/HDFS-11531 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11162) Block Storage : add command line tool

2017-03-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11162: -- Attachment: HDFS-11162-HDFS-7240.007.patch post v007 patch to fix the compile and checkstyle issue in

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924708#comment-15924708 ] Chen Liang commented on HDFS-11530: --- Hi [~linyiqun], Thanks for bringing up this work item! But could

[jira] [Updated] (HDFS-11524) Ozone: Fix TestContainerPersistence failures

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11524: -- Resolution: Duplicate Status: Resolved (was: Patch Available) This one should have been fixed

[jira] [Commented] (HDFS-11469) Ozone: SCM: Container allocation based on node report

2017-03-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924706#comment-15924706 ] Anu Engineer commented on HDFS-11469: - +1, v6 patch. [~xyao] Thanks for the patch. It is nice to see

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924703#comment-15924703 ] Arpit Agarwal commented on HDFS-11530: -- [~linyiqun], let's hold off on doing this for now. We want to

[jira] [Commented] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2017-03-14 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924650#comment-15924650 ] Kuhu Shukla commented on HDFS-10601: TestHASafeMode passes locally and has an address bind exception.

[jira] [Updated] (HDFS-11469) Ozone: SCM: Container allocation based on node report

2017-03-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11469: -- Attachment: HDFS-11469-HDFS-7240.006.patch check style clean up. > Ozone: SCM: Container allocation

[jira] [Commented] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924584#comment-15924584 ] Hadoop QA commented on HDFS-10601: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9411) HDFS NodeLabel support

2017-03-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924558#comment-15924558 ] Vinayakumar B commented on HDFS-9411: - bq. Guys .. Whether this is still active? We talked recently

[jira] [Updated] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2017-03-14 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10601: --- Attachment: HDFS-10601.004.patch Rebasing with some modifications to address the test failures and

[jira] [Commented] (HDFS-11420) Edit file should not be processed by same type processor in OfflineEditsViewer

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924114#comment-15924114 ] Hadoop QA commented on HDFS-11420: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924091#comment-15924091 ] Hadoop QA commented on HDFS-11530: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11420) Edit file should not be processed by same type processor in OfflineEditsViewer

2017-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11420: - Attachment: HDFS-11420.004.patch Attach the same patch to trigger the Jenkins. > Edit file should not be

[jira] [Commented] (HDFS-11526) Fix confusing block recovery message

2017-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923946#comment-15923946 ] Hudson commented on HDFS-11526: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11400 (See

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Status: Patch Available (was: Open) > Use HDFS specific network topology to choose datanode in >

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Attachment: HDFS-11530.001.patch Initial patch attached. Kindly review. > Use HDFS specific network

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Description: The work for {{chooseRandomWithStorageType}} has been merged in HDFS-11482. But this method

[jira] [Created] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-14 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11530: Summary: Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault Key: HDFS-11530 URL: https://issues.apache.org/jira/browse/HDFS-11530 Project:

[jira] [Updated] (HDFS-11526) Fix confusing block recovery message

2017-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11526: - Resolution: Fixed Status: Resolved (was: Patch Available) > Fix confusing block recovery message

[jira] [Updated] (HDFS-11526) Fix confusing block recovery message

2017-03-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11526: - Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 2.9.0 Test failure are not

[jira] [Updated] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-14 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11529: - Description: libHDFS uses a table to compare exceptions against and returns a corresponding

[jira] [Created] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-14 Thread Sailesh Mukil (JIRA)
Sailesh Mukil created HDFS-11529: Summary: libHDFS still does not return appropriate error information in many cases Key: HDFS-11529 URL: https://issues.apache.org/jira/browse/HDFS-11529 Project:

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-14 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923824#comment-15923824 ] Wei Zhou commented on HDFS-11170: - Thanks [~andrew.wang] for the reminder and sorry for the delay due to

[jira] [Commented] (HDFS-11244) [SPS]: Limit the number of satisfyStoragePolicy items at Namenode

2017-03-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923821#comment-15923821 ] Yuanbo Liu commented on HDFS-11244: --- [~umamaheswararao] Not sure whether you're working on this JIRA. If

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923805#comment-15923805 ] Hadoop QA commented on HDFS-11170: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11336: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11336) [SPS]: Remove xAttrs when movements done or SPS disabled

2017-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923733#comment-15923733 ] Uma Maheswara Rao G commented on HDFS-11336: +1 on latest patch > [SPS]: Remove xAttrs when

  1   2   >