[jira] [Commented] (HDFS-11183) Document XOR policy XOR-2-1-64k support in HDFS

2017-03-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898856#comment-15898856 ] SammiChen commented on HDFS-11183: -- Hi, [~andrew.wang], I see you have mentioned XOR-2-1-64K policy in

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2017-03-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9705: Attachment: HDFS-9705-v7.patch The previous comment is kind of misleading. When the crcType is "NULL" which

[jira] [Comment Edited] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2017-03-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898838#comment-15898838 ] SammiChen edited comment on HDFS-9705 at 3/7/17 6:45 AM: - The previous comment is

[jira] [Commented] (HDFS-11158) Ozone: TestDatanodeStateMachine is failing intermittently

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898797#comment-15898797 ] Anu Engineer commented on HDFS-11158: - +1, I will add another test case to make sure we can launch the

[jira] [Commented] (HDFS-11451) Ozone: Add protobuf definitions for container reports

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898788#comment-15898788 ] Anu Engineer commented on HDFS-11451: - [~xyao] verbally approved checking the patch v4 since jenkins

[jira] [Assigned] (HDFS-11158) Ozone: TestDatanodeStateMachine is failing intermittently

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11158: --- Assignee: Weiwei Yang (was: Anu Engineer) > Ozone: TestDatanodeStateMachine is failing

[jira] [Updated] (HDFS-11508) Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state

2017-03-06 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11508: - Status: Patch Available (was: Open) > Fix bind failure in SimpleTCPServer & Portmap

[jira] [Updated] (HDFS-11508) Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state

2017-03-06 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11508: - Attachment: HDFS-11508.001.patch Tested this patch manually by starting NFS gateway and

[jira] [Updated] (HDFS-11465) Rename BlockType#CONTIGUOUS to BlockType#REPLICATED

2017-03-06 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11465: -- Status: Patch Available (was: Open) > Rename BlockType#CONTIGUOUS to BlockType#REPLICATED >

[jira] [Updated] (HDFS-11465) Rename BlockType#CONTIGUOUS to BlockType#REPLICATED

2017-03-06 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11465: -- Attachment: HDFS-11465.001.patch upload v1 patch for this JIRA, basically there are two changes here: *

[jira] [Updated] (HDFS-11497) Ozone: Fix Container test regression.

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11497: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898769#comment-15898769 ] Masatake Iwasaki commented on HDFS-11499: - Thanks for working on this, [~lukmajercak] and

[jira] [Commented] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

2017-03-06 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898770#comment-15898770 ] Surendra Singh Lilhore commented on HDFS-10838: --- Thanks [~arpitagarwal] for review and

[jira] [Commented] (HDFS-11497) Ozone: Fix Container test regression.

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898763#comment-15898763 ] Anu Engineer commented on HDFS-11497: - None of these failures are reproducible on local machine, and

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11499: -- Hadoop Flags: Reviewed Status: Patch Available (was: Open) > Decommissioning stuck

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11499: -- Status: Open (was: Patch Available) > Decommissioning stuck because of failing recovery >

[jira] [Created] (HDFS-11508) Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state

2017-03-06 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-11508: Summary: Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state Key: HDFS-11508 URL:

[jira] [Commented] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx "qry=Hadoop:service=DataNode,name=RpcDetailedActivityForPort8010" to get tag.hostname

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898730#comment-15898730 ] Hadoop QA commented on HDFS-11502: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx "qry=Hadoop:service=DataNode,name=RpcDetailedActivityForPort8010" to get tag.hostname

2017-03-06 Thread Jeffrey E Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey E Rodriguez updated HDFS-11502: Fix Version/s: 2.7.3 3.0.0-alpha1 3.0.0-alpha2

[jira] [Updated] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx "qry=Hadoop:service=DataNode,name=RpcDetailedActivityForPort8010" to get tag.hostname

2017-03-06 Thread Jeffrey E Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeffrey E Rodriguez updated HDFS-11502: Attachment: HDFS-11502.001.patch Patch fixes Datanode html UI so we use

[jira] [Work started] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx "qry=Hadoop:service=DataNode,name=RpcDetailedActivityForPort8010" to get tag.hostname

2017-03-06 Thread Jeffrey E Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11502 started by Jeffrey E Rodriguez. --- > dn.js set datanode UI to window.location.hostname, it should use

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898700#comment-15898700 ] Yiqun Lin commented on HDFS-11499: -- You are right, I misreading for this. +1 for the patch. Pending

[jira] [Updated] (HDFS-10983) OIV tool should make an EC file explicit

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10983: -- Attachment: HDFS-10983.03.patch [~andrew.wang], Removed the explicit replication field

[jira] [Assigned] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx "qry=Hadoop:service=DataNode,name=RpcDetailedActivityForPort8010" to get tag.hostname

2017-03-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-11502: --- Assignee: Jeffrey E Rodriguez > dn.js set datanode UI to

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898651#comment-15898651 ] Manoj Govindassamy commented on HDFS-11499: --- [~linyiqun], Thanks for the review. I was using

[jira] [Commented] (HDFS-11071) Ozone: SCM: Move SCM config keys to ScmConfig

2017-03-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898634#comment-15898634 ] Weiwei Yang commented on HDFS-11071: There seems to be some issue on Jenkins {quote} FATAL: command

[jira] [Updated] (HDFS-11446) TestMaintenanceState#testWithNNAndDNRestart fails intermittently

2017-03-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11446: - Attachment: HDFS-11446-branch-2.patch HDFS-11446.003.patch Reupload the patch to trigger

[jira] [Updated] (HDFS-11446) TestMaintenanceState#testWithNNAndDNRestart fails intermittently

2017-03-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11446: - Attachment: (was: HDFS-11446-branch-2.patch) > TestMaintenanceState#testWithNNAndDNRestart fails

[jira] [Updated] (HDFS-11446) TestMaintenanceState#testWithNNAndDNRestart fails intermittently

2017-03-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11446: - Attachment: (was: HDFS-11446.003.patch) > TestMaintenanceState#testWithNNAndDNRestart fails

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898628#comment-15898628 ] Yiqun Lin commented on HDFS-11499: -- Great work, everyone! Only one nit for the v03 patch: {code} + +

[jira] [Commented] (HDFS-10983) OIV tool should make an EC file explicit

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898592#comment-15898592 ] Manoj Govindassamy commented on HDFS-10983: --- Thanks for the review [~andrew.wang]. If we don't

[jira] [Commented] (HDFS-11314) Enforce set of enabled EC policies on the NameNode

2017-03-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898588#comment-15898588 ] Kai Zheng commented on HDFS-11314: -- Thanks for your clarifying and consideration, Andrew. Yes renaming

[jira] [Commented] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx "qry=Hadoop:service=DataNode,name=RpcDetailedActivityForPort8010" to get tag.hostname

2017-03-06 Thread Jeffrey E Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898587#comment-15898587 ] Jeffrey E Rodriguez commented on HDFS-11502: - Thanks I would do so > dn.js set datanode UI

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898584#comment-15898584 ] Hadoop QA commented on HDFS-9705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898583#comment-15898583 ] Kai Zheng commented on HDFS-11505: -- Thanks Andrew for your thought and it makes sense. The client-side

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11499: -- Attachment: HDFS-11499.03.patch [~lukmajercak], Attached v03 patch to have the same

[jira] [Commented] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx "qry=Hadoop:service=DataNode,name=RpcDetailedActivityForPort8010" to get tag.hostname

2017-03-06 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898579#comment-15898579 ] Yuanbo Liu commented on HDFS-11502: --- [~jeffreyr97] If you want to work on it, please send a email to

[jira] [Updated] (HDFS-11314) Enforce set of enabled EC policies on the NameNode

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11314: --- Attachment: HDFS-11314.006.patch Thanks for reviewing Kai! Regarding the naming, I was trying to

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898571#comment-15898571 ] Lukas Majercak commented on HDFS-11499: --- [~manojg], yes

[jira] [Updated] (HDFS-11314) Enforce set of enabled EC policies on the NameNode

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11314: --- Attachment: HDFS-11314.005.patch New patch to address checkstyle errors. > Enforce set of enabled EC

[jira] [Commented] (HDFS-11314) Enforce set of enabled EC policies on the NameNode

2017-03-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898546#comment-15898546 ] Kai Zheng commented on HDFS-11314: -- I agree it's much safer to have admin configure and ensure the valid

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898544#comment-15898544 ] Andrew Wang commented on HDFS-11505: Hi Kai, Your understanding is correct. However, I think the vast

[jira] [Commented] (HDFS-11314) Enforce set of enabled EC policies on the NameNode

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898541#comment-15898541 ] Hadoop QA commented on HDFS-11314: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898537#comment-15898537 ] Manoj Govindassamy commented on HDFS-11499: --- [~lukmajercak], Are you referring to the timeout in

[jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11482: -- Attachment: HDFS-11482.003.patch v001 and v002 patch were missing the change to one more file. Fixed in

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898529#comment-15898529 ] Kai Zheng commented on HDFS-11505: -- So assume some policies are enabled by the configuration, will users

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898524#comment-15898524 ] Lukas Majercak commented on HDFS-11499: --- Looks like the test timed out, [~manojg], do you mind

[jira] [Created] (HDFS-11507) NetworkTopology#chooseRandom may run into a dead loop due to race condition

2017-03-06 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11507: - Summary: NetworkTopology#chooseRandom may run into a dead loop due to race condition Key: HDFS-11507 URL: https://issues.apache.org/jira/browse/HDFS-11507 Project: Hadoop

[jira] [Commented] (HDFS-11071) Ozone: SCM: Move SCM config keys to ScmConfig

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898519#comment-15898519 ] Hadoop QA commented on HDFS-11071: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

2017-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898518#comment-15898518 ] Hudson commented on HDFS-10838: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11358 (See

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-03-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.004.patch > In Hadoop 3, make FileStatus serialize itself via protobuf >

[jira] [Commented] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898493#comment-15898493 ] Hadoop QA commented on HDFS-11482: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898491#comment-15898491 ] Hadoop QA commented on HDFS-11499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11477) Simplify file IO profiling configuration

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898478#comment-15898478 ] Hadoop QA commented on HDFS-11477: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898476#comment-15898476 ] Hadoop QA commented on HDFS-11482: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

2017-03-06 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10838: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Comment Edited] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

2017-03-06 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898471#comment-15898471 ] Arpit Agarwal edited comment on HDFS-10838 at 3/7/17 12:44 AM: --- Committed

[jira] [Commented] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898443#comment-15898443 ] Hadoop QA commented on HDFS-10838: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10983) OIV tool should make an EC file explicit

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898441#comment-15898441 ] Andrew Wang commented on HDFS-10983: Looks good overall, thanks for revving Manoj! One question

[jira] [Commented] (HDFS-11498) Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0

2017-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898416#comment-15898416 ] Hudson commented on HDFS-11498: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11357 (See

[jira] [Issue Comment Deleted] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11482: -- Comment: was deleted (was: I was looking into what would happen when chooseRandom and add/remove are

[jira] [Commented] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898412#comment-15898412 ] Chen Liang commented on HDFS-11482: --- I was looking into what would happen when chooseRandom and

[jira] [Commented] (HDFS-11497) Ozone: Fix Container test regression.

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898404#comment-15898404 ] Hadoop QA commented on HDFS-11497: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11482: -- Attachment: HDFS-11482.002.patch > Add storage type demand to into DFSNetworkTopology#chooseRandom >

[jira] [Updated] (HDFS-11314) Enforce set of enabled EC policies on the NameNode

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11314: --- Attachment: HDFS-11314.004.patch Here's a patch to fix the TestOIV failure, had to enable an EC

[jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11482: -- Status: Patch Available (was: Open) > Add storage type demand to into DFSNetworkTopology#chooseRandom

[jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11482: -- Attachment: HDFS-11482.001.patch > Add storage type demand to into DFSNetworkTopology#chooseRandom >

[jira] [Updated] (HDFS-11498) Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11498: --- Release Note: This JIRA sets the Netty 4 dependency to 4.0.23. This is an incompatible change for the

[jira] [Updated] (HDFS-11498) Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11498: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.8.0 Status:

[jira] [Updated] (HDFS-11376) Revert HDFS-8377 Support HTTP/2 in datanode

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11376: --- Affects Version/s: (was: 2.9.0) 2.8.0 Target Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11376) Revert HDFS-8377 Support HTTP/2 in datanode

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898346#comment-15898346 ] Andrew Wang commented on HDFS-11376: Per discussion on HDFS-11498, I've backported this to branch-2.8

[jira] [Commented] (HDFS-11498) Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898323#comment-15898323 ] Andrew Wang commented on HDFS-11498: Yea, sorry for only testing on branch-2, I assumed it'd be a

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898290#comment-15898290 ] Lukas Majercak commented on HDFS-11499: --- LGTM > Decommissioning stuck because of failing recovery >

[jira] [Assigned] (HDFS-4934) add symlink support to WebHDFS server side

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-4934: - Assignee: (was: Andrew Wang) > add symlink support to WebHDFS server side >

[jira] [Assigned] (HDFS-4933) add symlink support to WebHDFS to HTTP REST API & client filesystem

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-4933: - Assignee: (was: Andrew Wang) > add symlink support to WebHDFS to HTTP REST API & client

[jira] [Assigned] (HDFS-4935) add symlink support to HttpFS server side

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-4935: - Assignee: (was: Andrew Wang) > add symlink support to HttpFS server side >

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11499: -- Attachment: HDFS-11499.02.patch [~lukmajercak], [~jojochuang], [~linyiqun], Attached

[jira] [Updated] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11487: Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: HDFS-7240

[jira] [Commented] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898259#comment-15898259 ] Anu Engineer commented on HDFS-11487: - +1, i will commit this shortly. > Ozone: Exclude container

[jira] [Assigned] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-11505: - Assignee: Manoj Govindassamy (was: Andrew Wang) > Do not enable any erasure

[jira] [Assigned] (HDFS-11506) Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-11506: - Assignee: Manoj Govindassamy (was: Andrew Wang) > Move

[jira] [Commented] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

2017-03-06 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898251#comment-15898251 ] Arpit Agarwal commented on HDFS-10838: -- Thanks [~surendrasingh]. +1 pending Jenkins. HDFS Pre-commit

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898250#comment-15898250 ] Lukas Majercak commented on HDFS-11499: --- [~manojg], I don't really mind, let's go for the second

[jira] [Created] (HDFS-11506) Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code

2017-03-06 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11506: -- Summary: Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code Key: HDFS-11506 URL: https://issues.apache.org/jira/browse/HDFS-11506 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11314) Enforce set of enabled EC policies on the NameNode

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898246#comment-15898246 ] Andrew Wang commented on HDFS-11314: Hi Rakesh, thanks for reviewing! bq. I'd also prefer keep the

[jira] [Commented] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898239#comment-15898239 ] Hadoop QA commented on HDFS-11487: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11445) FSCK shows overall health stauts as corrupt even one replica is corrupt

2017-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898236#comment-15898236 ] Jing Zhao commented on HDFS-11445: -- Thanks for working on this, [~brahmareddy]! I think you just find a

[jira] [Created] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-06 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11505: -- Summary: Do not enable any erasure coding policies by default Key: HDFS-11505 URL: https://issues.apache.org/jira/browse/HDFS-11505 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898231#comment-15898231 ] Hadoop QA commented on HDFS-11196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11196) Ozone: Improve logging and error handling in the container layer

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898232#comment-15898232 ] Hadoop QA commented on HDFS-11196: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898222#comment-15898222 ] Manoj Govindassamy commented on HDFS-11499: --- yes [~lukmajercak], we need to additionally count

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898211#comment-15898211 ] Lukas Majercak commented on HDFS-11499: --- Hi [~jojochuang], [~manojg] So shall we count in the

[jira] [Comment Edited] (HDFS-11500) Java Unlimited Cryptography Extension doesn't work

2017-03-06 Thread Jeff W (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898191#comment-15898191 ] Jeff W edited comment on HDFS-11500 at 3/6/17 9:42 PM: --- Run command: curl -k -v -u

[jira] [Comment Edited] (HDFS-11500) Java Unlimited Cryptography Extension doesn't work

2017-03-06 Thread Jeff W (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898191#comment-15898191 ] Jeff W edited comment on HDFS-11500 at 3/6/17 9:41 PM: --- Run command: curl -k -v

[jira] [Commented] (HDFS-11500) Java Unlimited Cryptography Extension doesn't work

2017-03-06 Thread Jeff W (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898191#comment-15898191 ] Jeff W commented on HDFS-11500: --- Run command: curl -k -v --negotiate

[jira] [Commented] (HDFS-11496) Ozone: Merge with trunk needed a ignore duplicate entry in pom file due to shading

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898138#comment-15898138 ] Anu Engineer commented on HDFS-11496: - [~busbey] That makes sense, I think we did add netty

[jira] [Commented] (HDFS-11496) Ozone: Merge with trunk needed a ignore duplicate entry in pom file due to shading

2017-03-06 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898103#comment-15898103 ] Sean Busbey commented on HDFS-11496: I would guess that the Ozone branch added netty as a dependency

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898100#comment-15898100 ] Manoj Govindassamy commented on HDFS-11499: --- Sure [~jojochuang]. I can give you a patch for the

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-03-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898092#comment-15898092 ] Chris Nauroth commented on HDFS-11163: -- The {{FsServerDefaults}} class is annotated {{Public}}, so

[jira] [Commented] (HDFS-11496) Ozone: Merge with trunk needed a ignore duplicate entry in pom file due to shading

2017-03-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898035#comment-15898035 ] Anu Engineer commented on HDFS-11496: - [~busbey] Thanks for your comment. I agree that changing

  1   2   >