[jira] [Updated] (HDFS-7933) fsck should also report decommissioning replicas.

2015-04-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7933: --- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) Marking this as an incompatible

[jira] [Updated] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7866: Attachment: HDFS-7866-v2.patch Updated the patch, adding a test. Looks like there're not too much work left

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493702#comment-14493702 ] Xinwei Qin commented on HDFS-7859: --- OK, I will track it. Erasure Coding: Persist EC

[jira] [Commented] (HDFS-8092) dfs -count -q should not consider snapshots under REM_QUOTA

2015-04-14 Thread Archana T (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493693#comment-14493693 ] Archana T commented on HDFS-8092: - Hi [~aw] The first two columns of hdfs count cmd refers

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493695#comment-14493695 ] Kai Zheng commented on HDFS-7859: - Note I have updated the patch in HDFS-7866 aligning with

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493699#comment-14493699 ] Xinwei Qin commented on HDFS-7859: --- [~drankye], thanks for your comments. {quote} 1.

[jira] [Updated] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8120: Attachment: HDFS-8120.003.patch Thanks Jing for the comment on {{BlockManager}}. The 003 patch makes the

[jira] [Resolved] (HDFS-7842) Blocks missed while performing downgrade immediately after rolling back the cluster.

2015-04-14 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina resolved HDFS-7842. -- Resolution: Duplicate Closing this issue as it is already been fixed as part of HDFS-7645 Blocks

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493703#comment-14493703 ] Xinwei Qin commented on HDFS-7859: --- OK, I will track it. Erasure Coding: Persist EC

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493704#comment-14493704 ] Xinwei Qin commented on HDFS-7859: --- OK, I will track it. Erasure Coding: Persist EC

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493725#comment-14493725 ] Kai Zheng commented on HDFS-7866: - I thought it's good to have this in the patch and

[jira] [Commented] (HDFS-8123) Erasure Coding: Better to move EC related proto messages to a separate 'erasurecode.proto' file

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493742#comment-14493742 ] Rakesh R commented on HDFS-8123: Thanks [~drankye] for the comments. bq. For somehow

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493755#comment-14493755 ] Vinayakumar B commented on HDFS-7866: - Hi [~xinwei], Thanks for working on this. Patch

[jira] [Commented] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493818#comment-14493818 ] Hadoop QA commented on HDFS-8127: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-8140) ECSchema supports for offline EditsVistor over an OEV XML file

2015-04-14 Thread Xinwei Qin (JIRA)
Xinwei Qin created HDFS-8140: - Summary: ECSchema supports for offline EditsVistor over an OEV XML file Key: HDFS-8140 URL: https://issues.apache.org/jira/browse/HDFS-8140 Project: Hadoop HDFS

[jira] [Created] (HDFS-8141) Use Certificate as a zone key

2015-04-14 Thread Abhijit C Patil (JIRA)
Abhijit C Patil created HDFS-8141: - Summary: Use Certificate as a zone key Key: HDFS-8141 URL: https://issues.apache.org/jira/browse/HDFS-8141 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7349) Support DFS command for the EC encoding

2015-04-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7349: Attachment: HDFS-7349-005.patch Attached the updated patch. Changes 1. Moved {{ECCli}} to

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493729#comment-14493729 ] Vinayakumar B commented on HDFS-7993: - patch needs rebase after HDFS-7933. bq. Change

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-14 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493727#comment-14493727 ] Xinwei Qin commented on HDFS-7866: --- OK, that sounds good. Erasure coding: NameNode

[jira] [Updated] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-04-14 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-7937: - Attachment: HDFS-7937.8.patch Erasure Coding: INodeFile quota computation unit tests

[jira] [Commented] (HDFS-8123) Erasure Coding: Better to move EC related proto messages to a separate 'erasurecode.proto' file

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493715#comment-14493715 ] Kai Zheng commented on HDFS-8123: - 1. For somehow feeling maybe we could use

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-14 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493720#comment-14493720 ] Xinwei Qin commented on HDFS-7866: --- Hi, [~drankye] {code} +/** + * TODO:

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493774#comment-14493774 ] Li Bo commented on HDFS-8120: - hi, Zhe, I update branch code and find it failed to build. The

[jira] [Updated] (HDFS-7934) During Rolling upgrade rollback ,standby namenode startup fails.

2015-04-14 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-7934: - Attachment: HDFS-7934.2.patch Uploaded the patch for modifying the steps for rolling upgrade rollback .

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493942#comment-14493942 ] Hudson commented on HDFS-7701: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493933#comment-14493933 ] Hudson commented on HDFS-8117: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (HDFS-8083) Separate the client write conf from DFSConfigKeys

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493936#comment-14493936 ] Hudson commented on HDFS-8083: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (HDFS-8111) NPE thrown when invalid FSImage filename given for hdfs oiv_legacy cmd

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493943#comment-14493943 ] Hudson commented on HDFS-8111: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (HDFS-8092) dfs -count -q should not consider snapshots under REM_QUOTA

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493997#comment-14493997 ] Rakesh R commented on HDFS-8092: Thanks [~archanat] for reporting this. Thanks [~aw] for

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493863#comment-14493863 ] Kai Zheng commented on HDFS-7866: - Hi [~vinayrpet], thanks for your good comments. Patch

[jira] [Commented] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

2015-04-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493870#comment-14493870 ] Vinayakumar B commented on HDFS-8127: - Same/little different problem could occur with

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-14 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493886#comment-14493886 ] GAO Rui commented on HDFS-8033: --- Zhe, thank you very much for your help. I understand read()

[jira] [Commented] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493980#comment-14493980 ] Hudson commented on HDFS-8117: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493989#comment-14493989 ] Hudson commented on HDFS-7701: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493966#comment-14493966 ] Hudson commented on HDFS-8117: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Commented] (HDFS-8111) NPE thrown when invalid FSImage filename given for hdfs oiv_legacy cmd

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493976#comment-14493976 ] Hudson commented on HDFS-8111: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Updated] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7866: Attachment: HDFS-7866-v3.patch Updated the patch according to the review comments. Erasure coding:

[jira] [Commented] (HDFS-7349) Support DFS command for the EC encoding

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493867#comment-14493867 ] Kai Zheng commented on HDFS-7349: - I'm OK with these renamings. Maybe we can revisit them

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-04-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493922#comment-14493922 ] Vinayakumar B commented on HDFS-7866: - Some more nits, 1. Following changes not

[jira] [Commented] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493950#comment-14493950 ] Hudson commented on HDFS-8117: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (HDFS-8083) Separate the client write conf from DFSConfigKeys

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493953#comment-14493953 ] Hudson commented on HDFS-8083: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (HDFS-8111) NPE thrown when invalid FSImage filename given for hdfs oiv_legacy cmd

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493960#comment-14493960 ] Hudson commented on HDFS-8111: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493959#comment-14493959 ] Hudson commented on HDFS-7701: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493975#comment-14493975 ] Hudson commented on HDFS-7701: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Commented] (HDFS-8083) Separate the client write conf from DFSConfigKeys

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493983#comment-14493983 ] Hudson commented on HDFS-8083: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (HDFS-8111) NPE thrown when invalid FSImage filename given for hdfs oiv_legacy cmd

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493990#comment-14493990 ] Hudson commented on HDFS-8111: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (HDFS-8083) Separate the client write conf from DFSConfigKeys

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493969#comment-14493969 ] Hudson commented on HDFS-8083: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-: Affects Version/s: (was: 2.5.0) (was: 3.0.0)

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-: Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 (was: 3.0.0, 2.6.0)

[jira] [Updated] (HDFS-8055) NullPointerException when topology script is missing.

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8055: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-: Release Note: NameNode and DataNode now abort during startup if attempting to run in secure mode,

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494495#comment-14494495 ] Zhe Zhang commented on HDFS-7889: - As we go deeper in testing, I've found the following

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494354#comment-14494354 ] Zhe Zhang commented on HDFS-8120: - The branch builds OK on my local machine. Our nightly

[jira] [Commented] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

2015-04-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494390#comment-14494390 ] Zhe Zhang commented on HDFS-7949: - Thanks Rakesh for the update! The latest patch looks

[jira] [Commented] (HDFS-8055) NullPointerException when topology script is missing.

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494464#comment-14494464 ] Hudson commented on HDFS-8055: -- FAILURE: Integrated in Hadoop-trunk-Commit #7583 (See

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494415#comment-14494415 ] Hudson commented on HDFS-: -- FAILURE: Integrated in Hadoop-trunk-Commit #7582 (See

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494363#comment-14494363 ] Hadoop QA commented on HDFS-7993: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494372#comment-14494372 ] Ming Ma commented on HDFS-7993: --- Thanks, Vinay. bq. In the current output, blk_x len=y

[jira] [Commented] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

2015-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494489#comment-14494489 ] Jing Zhao commented on HDFS-8127: - RollingUpgrade does not have this issue because instead

[jira] [Created] (HDFS-8142) DistributedFileSystem#EncryptionZones should resolve given path relative to workingDir

2015-04-14 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8142: -- Summary: DistributedFileSystem#EncryptionZones should resolve given path relative to workingDir Key: HDFS-8142 URL: https://issues.apache.org/jira/browse/HDFS-8142 Project:

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-14 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Patch Available (was: In Progress) HDFS client gets errors trying to to connect to IPv6 DataNode

[jira] [Updated] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

2015-04-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8127: -- Hadoop Flags: Reviewed +1 the new patch looks good. NameNode Failover during HA

[jira] [Commented] (HDFS-8142) DistributedFileSystem#EncryptionZones should resolve given path relative to workingDir

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494551#comment-14494551 ] Rakesh R commented on HDFS-8142: Attached patch (contains unit test to simulate the case)

[jira] [Commented] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494201#comment-14494201 ] Hudson commented on HDFS-8117: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #164 (See

[jira] [Commented] (HDFS-8083) Separate the client write conf from DFSConfigKeys

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494273#comment-14494273 ] Hudson commented on HDFS-8083: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2113 (See

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494280#comment-14494280 ] Hudson commented on HDFS-7701: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2113 (See

[jira] [Commented] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494270#comment-14494270 ] Hudson commented on HDFS-8117: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2113 (See

[jira] [Commented] (HDFS-8132) Namenode Startup Failing When we add Jcarder.jar in class Path

2015-04-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494330#comment-14494330 ] Brahma Reddy Battula commented on HDFS-8132: [~tlipcon] any pointers to this

[jira] [Commented] (HDFS-7934) During Rolling upgrade rollback ,standby namenode startup fails.

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494294#comment-14494294 ] Hadoop QA commented on HDFS-7934: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494212#comment-14494212 ] Hudson commented on HDFS-7701: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #164 (See

[jira] [Commented] (HDFS-8083) Separate the client write conf from DFSConfigKeys

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494205#comment-14494205 ] Hudson commented on HDFS-8083: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #164 (See

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495498#comment-14495498 ] Tsz Wo Nicholas Sze commented on HDFS-7859: --- The patch under this JIRA handles

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495546#comment-14495546 ] Tsz Wo Nicholas Sze commented on HDFS-7859: --- ... schema name for the ID purpose.

[jira] [Issue Comment Deleted] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8120: Comment: was deleted (was: bq. which make DFSOutputStream#completeFile fail Yes, the completeFile call

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495614#comment-14495614 ] Li Bo commented on HDFS-7889: - hi, Zhe, please see my following explanation of the related

[jira] [Updated] (HDFS-8123) Erasure Coding: Better to move EC related proto messages to a separate 'erasurecode.proto' file

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8123: --- Attachment: HDFS-8123-004 Erasure Coding: Better to move EC related proto messages to a separate

[jira] [Updated] (HDFS-8123) Erasure Coding: Better to move EC related proto messages to a separate 'erasurecode.proto' file

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8123: --- Attachment: (was: HDFS-8123-004) Erasure Coding: Better to move EC related proto messages to a separate

[jira] [Commented] (HDFS-8144) Split TestLazyPersistFiles into multiple tests

2015-04-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495174#comment-14495174 ] Xiaoyu Yao commented on HDFS-8144: -- [~arpitagarwal], the patch looks pretty good to me. I

[jira] [Created] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

2015-04-14 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8145: --- Summary: Fix the editlog corruption exposed by failed TestAddStripedBlocks Key: HDFS-8145 URL: https://issues.apache.org/jira/browse/HDFS-8145 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495553#comment-14495553 ] Tsz Wo Nicholas Sze commented on HDFS-7859: --- ... We would persist the whole

[jira] [Commented] (HDFS-8144) Split TestLazyPersistFiles into multiple tests

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495562#comment-14495562 ] Hadoop QA commented on HDFS-8144: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495584#comment-14495584 ] Li Bo commented on HDFS-8120: - bq. the DFSStripedOutputStream should not allocate a new block

[jira] [Updated] (HDFS-8123) Erasure Coding: Better to move EC related proto messages to a separate 'erasurecode.proto' file

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8123: --- Attachment: HDFS-8123-004.patch Erasure Coding: Better to move EC related proto messages to a separate

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-04-14 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495178#comment-14495178 ] Takanobu Asanuma commented on HDFS-7687: Thanks for your comments, Nicholas. I will

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495442#comment-14495442 ] Zhe Zhang commented on HDFS-7859: - [~szetszwo] / [~drankye]: The [phasing plan |

[jira] [Updated] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7949: --- Attachment: HDFS-7949-004.patch WebImageViewer need support file size calculation with striped blocks

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495556#comment-14495556 ] Kai Zheng commented on HDFS-7859: - bq.Using schema name as ID As we would not make it heavy

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495568#comment-14495568 ] Li Bo commented on HDFS-8120: - When completing a block group, NN will check if the replications

[jira] [Commented] (HDFS-8123) Erasure Coding: Better to move EC related proto messages to a separate 'erasurecode.proto' file

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495172#comment-14495172 ] Rakesh R commented on HDFS-8123: Attached patch addressing [~drankye]'s comments. Hi

[jira] [Commented] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

2015-04-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495454#comment-14495454 ] Rakesh R commented on HDFS-7949: Thanks [~zhz]. I've attached new patch using null for the

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495493#comment-14495493 ] Kai Zheng commented on HDFS-7859: - Hi [~zhz], Thanks for taking care of this and your good

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495520#comment-14495520 ] Jing Zhao commented on HDFS-8120: - Thanks Zhe. The latest patch looks pretty good to me.

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495517#comment-14495517 ] Kai Zheng commented on HDFS-7859: - bq.we don't know what to persist. For example, should we

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-04-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495560#comment-14495560 ] Kai Zheng commented on HDFS-7859: - bq.How can we be sure that the schema object format

[jira] [Commented] (HDFS-8132) Namenode Startup Failing When we add Jcarder.jar in class Path

2015-04-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495504#comment-14495504 ] Todd Lipcon commented on HDFS-8132: --- Yea, I'm guessing the same issue -- probably getting

[jira] [Commented] (HDFS-8132) Namenode Startup Failing When we add Jcarder.jar in class Path

2015-04-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495528#comment-14495528 ] Brahma Reddy Battula commented on HDFS-8132: [~cnauroth] and [~tlipcon] thanks

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495571#comment-14495571 ] Jing Zhao commented on HDFS-8120: - bq. which make DFSOutputStream#completeFile fail Yes,

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

2015-04-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495576#comment-14495576 ] Jing Zhao commented on HDFS-8120: - bq. which make DFSOutputStream#completeFile fail. More

[jira] [Updated] (HDFS-8144) Split TestLazyPersistFiles into multiple tests

2015-04-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8144: Attachment: HDFS-8144.02.patch Thanks for the review [~xyao]. v2 patch addresses your feedback.

[jira] [Commented] (HDFS-8132) Namenode Startup Failing When we add Jcarder.jar in class Path

2015-04-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495698#comment-14495698 ] Todd Lipcon commented on HDFS-8132: --- Nope. Feel free to send me a pull request for

  1   2   >