[jira] [Updated] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

2015-09-10 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8853: - Attachment: HDFS-8853-HDFS-7285-06.patch Sorry for the delay [~zhz] . Testcase failures are unrelated to

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738468#comment-14738468 ] Hudson commented on HDFS-8974: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1104 (See

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738547#comment-14738547 ] Hudson commented on HDFS-8974: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #372 (See

[jira] [Updated] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-10 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8974: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-09-10 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738375#comment-14738375 ] Kai Zheng commented on HDFS-8968: - Thanks Rui for coming up the tool. Since HDFS-8833 was in, would you

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738420#comment-14738420 ] Hudson commented on HDFS-8974: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #366 (See

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738552#comment-14738552 ] Hudson commented on HDFS-8974: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2291 (See

[jira] [Updated] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9024: Attachment: HDFS-9024.002.patch Thanks [~templedf] for the review. Updated the patch to fix the

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738370#comment-14738370 ] Hudson commented on HDFS-8974: -- FAILURE: Integrated in Hadoop-trunk-Commit #8427 (See

[jira] [Commented] (HDFS-8837) Remove the unnecessary Quota.Counts class

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738366#comment-14738366 ] Hadoop QA commented on HDFS-8837: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738573#comment-14738573 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- Yes, it is reasonable. The deadlock here seems that

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738574#comment-14738574 ] Hadoop QA commented on HDFS-9024: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738657#comment-14738657 ] Vinayakumar B commented on HDFS-6955: - thanks [~kanaka] for the update. +1, Changes looks good to me

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738694#comment-14738694 ] Vinayakumar B commented on HDFS-8953: - bq. 1. After HDFS-9009, NN metrics are also configured to

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738605#comment-14738605 ] Hudson commented on HDFS-8974: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2314 (See

[jira] [Commented] (HDFS-9043) Doc updation for commands in HDFS Federation

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738721#comment-14738721 ] Allen Wittenauer commented on HDFS-9043: Also: It's worth noting that your replacement balancer

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738729#comment-14738729 ] Vinayakumar B commented on HDFS-9024: - Also how about updating the UI related files with 'FilesTotal',

[jira] [Created] (HDFS-9043) Doc updation for commands in HDFS Federation

2015-09-10 Thread J.Andreina (JIRA)
J.Andreina created HDFS-9043: Summary: Doc updation for commands in HDFS Federation Key: HDFS-9043 URL: https://issues.apache.org/jira/browse/HDFS-9043 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-9042) Update document for the Storage policy name

2015-09-10 Thread J.Andreina (JIRA)
J.Andreina created HDFS-9042: Summary: Update document for the Storage policy name Key: HDFS-9042 URL: https://issues.apache.org/jira/browse/HDFS-9042 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738575#comment-14738575 ] Hadoop QA commented on HDFS-8853: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8975) Erasure coding : Fix random failure in TestSafeModeWithStripedFile

2015-09-10 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8975: - Attachment: HDFS-8975-HDFS-7285-02.patch Thanks [~walter.k.su] for the review comments. Udpated the patch

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738627#comment-14738627 ] Hudson commented on HDFS-8974: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #352 (See

[jira] [Commented] (HDFS-9043) Doc updation for commands in HDFS Federation

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738718#comment-14738718 ] Allen Wittenauer commented on HDFS-9043: Be aware that this document is different in trunk due to

[jira] [Updated] (HDFS-9036) In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true.

2015-09-10 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9036: - Status: Patch Available (was: Open) > In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random

[jira] [Updated] (HDFS-9036) In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true.

2015-09-10 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9036: - Attachment: HDFS-9036.1.patch Attached an initial patch . Please review. > In

[jira] [Created] (HDFS-9044) If favored nodes are not available, then should fall back to regular BlockPlacementPolicyWithNodeGroup

2015-09-10 Thread J.Andreina (JIRA)
J.Andreina created HDFS-9044: Summary: If favored nodes are not available, then should fall back to regular BlockPlacementPolicyWithNodeGroup Key: HDFS-9044 URL: https://issues.apache.org/jira/browse/HDFS-9044

[jira] [Commented] (HDFS-9040) Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers

2015-09-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738730#comment-14738730 ] Walter Su commented on HDFS-9040: - bq. The role of BlockGroupDataStreamer looks similar (or closely

[jira] [Updated] (HDFS-9046) Any Error during BPOfferService run can leads to Missing DN.

2015-09-10 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated HDFS-9046: Attachment: HDFS-9046_1.patch Attached the patch Similar issue noticed in init section also. It is hard to

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738767#comment-14738767 ] Daryn Sharp commented on HDFS-6763: --- +1 This is a long overdue change. > Initialize file system-wide

[jira] [Commented] (HDFS-9030) libwebhdfs lacks headers, documentation; not part of mvn package

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738903#comment-14738903 ] Allen Wittenauer commented on HDFS-9030: So even better: libwebhdfs *STILL* has JNI in it. Which

[jira] [Created] (HDFS-9045) DatanodeHttpServer is not setting Endpoint based on configured policy and not loading ssl configuration.

2015-09-10 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created HDFS-9045: -- Summary: DatanodeHttpServer is not setting Endpoint based on configured policy and not loading ssl configuration. Key: HDFS-9045 URL:

[jira] [Updated] (HDFS-9043) Doc updation for commands in HDFS Federation

2015-09-10 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9043: - Description: 1. command is wrong {noformat} $HADOOP_PREFIX/bin/hdfs dfsadmin -refreshNameNode :

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738820#comment-14738820 ] Hudson commented on HDFS-6763: -- FAILURE: Integrated in Hadoop-trunk-Commit #8428 (See

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738863#comment-14738863 ] Hudson commented on HDFS-6763: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #373 (See

[jira] [Commented] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738868#comment-14738868 ] Hadoop QA commented on HDFS-8853: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-9046) Any Error during BPOfferService run can leads to Missing DN.

2015-09-10 Thread nijel (JIRA)
nijel created HDFS-9046: --- Summary: Any Error during BPOfferService run can leads to Missing DN. Key: HDFS-9046 URL: https://issues.apache.org/jira/browse/HDFS-9046 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9036) In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true.

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738834#comment-14738834 ] Hadoop QA commented on HDFS-9036: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738805#comment-14738805 ] Kihwal Lee commented on HDFS-6763: -- Thanks for the review, Daryn. I've committed this to trunk and

[jira] [Commented] (HDFS-9043) Doc updation for commands in HDFS Federation

2015-09-10 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738797#comment-14738797 ] J.Andreina commented on HDFS-9043: -- Thanks [~aw] for the comments. I agree with your point . Shall we

[jira] [Updated] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6763: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 3.0.0

[jira] [Commented] (HDFS-9043) Doc updation for commands in HDFS Federation

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738851#comment-14738851 ] Allen Wittenauer commented on HDFS-9043: bq. Shall we update the command to start-balancer.sh

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738886#comment-14738886 ] Hudson commented on HDFS-6763: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2315 (See

[jira] [Updated] (HDFS-9045) DatanodeHttpServer is not setting Endpoint based on configured policy and not loading ssl configuration.

2015-09-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated HDFS-9045: --- Description: Always DN is starting in http mode. {code} HttpServer2.Builder builder = new

[jira] [Commented] (HDFS-8975) Erasure coding : Fix random failure in TestSafeModeWithStripedFile

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14738845#comment-14738845 ] Hadoop QA commented on HDFS-8975: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9047: --- Target Version/s: 3.0.0 > deprecate libwebhdfs in branch-2; remove from trunk >

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739195#comment-14739195 ] Hudson commented on HDFS-6763: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #367 (See

[jira] [Commented] (HDFS-9045) DatanodeHttpServer is not setting Endpoint based on configured policy and not loading ssl configuration.

2015-09-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739023#comment-14739023 ] Brahma Reddy Battula commented on HDFS-9045: Thanks for reporting this..HDFS-8572 induced this

[jira] [Updated] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9047: --- Description: This library is basically a mess: * It's not part of the mvn package * It's

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8287: -- Attachment: h8287_20150911.patch > DFSStripedOutputStream.writeChunk should not wait for

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-09-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739002#comment-14739002 ] Brahma Reddy Battula commented on HDFS-8647: Thanks a lot [~mingma] for your review comments..

[jira] [Updated] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9047: --- Description: This library is basically a mess: * It's not part of the mvn package * It's

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739087#comment-14739087 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- Played around the code. The patch below can pass

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739104#comment-14739104 ] Chris Nauroth commented on HDFS-9047: - Notifying some of the original authors, [~jingzhao] and

[jira] [Commented] (HDFS-9030) libwebhdfs lacks headers, documentation; not part of mvn package

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739014#comment-14739014 ] Allen Wittenauer commented on HDFS-9030: At this point, I'm leaning heavily towards just

[jira] [Moved] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved HADOOP-12402 to HDFS-9047: - Key: HDFS-9047 (was: HADOOP-12402) Project: Hadoop HDFS

[jira] [Commented] (HDFS-9030) libwebhdfs lacks headers, documentation; not part of mvn package

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739058#comment-14739058 ] Allen Wittenauer commented on HDFS-9030: I've opened HDFS-9047 to kill it. I'll leave this open

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739062#comment-14739062 ] Hudson commented on HDFS-6763: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1105 (See

[jira] [Created] (HDFS-9048) DistCp documentation is out-of-dated

2015-09-10 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9048: Summary: DistCp documentation is out-of-dated Key: HDFS-9048 URL: https://issues.apache.org/jira/browse/HDFS-9048 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-09-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739108#comment-14739108 ] Ming Ma commented on HDFS-7877: --- For the open issues around timeout and persistence, [~ctrezzo] [~eddyxu] and

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739221#comment-14739221 ] Hudson commented on HDFS-6763: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #353 (See

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739227#comment-14739227 ] Hadoop QA commented on HDFS-8287: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739247#comment-14739247 ] Hudson commented on HDFS-6763: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2292 (See

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739300#comment-14739300 ] Arpit Agarwal commented on HDFS-6955: - Hi [~vinayrpet], good point. Perhaps we can just document that

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739306#comment-14739306 ] Vinayakumar B commented on HDFS-6955: - bq. Hi Vinayakumar B, good point. Perhaps we can just document

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739345#comment-14739345 ] Daniel Templeton commented on HDFS-9024: I don't see any UI files that use TotalFiles. Did you

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739312#comment-14739312 ] Arpit Agarwal commented on HDFS-6955: - We can rename the internal counter to reservedForReplicas or

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9027: Status: Open (was: Patch Available) > Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method >

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9027: Status: Patch Available (was: Open) > Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method >

[jira] [Commented] (HDFS-9004) Add upgrade domain to DatanodeInfo

2015-09-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739226#comment-14739226 ] Rushabh S Shah commented on HDFS-9004: -- Hi [~mingma], The patch looks neat. Just one minor comment.

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739318#comment-14739318 ] Vinayakumar B commented on HDFS-6955: - Yes, that would work. Thank you. [~kanaka], can you please

[jira] [Resolved] (HDFS-9045) DatanodeHttpServer is not setting Endpoint based on configured policy and not loading ssl configuration.

2015-09-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-9045. -- Resolution: Invalid This is invalid as the Netty serves as a reverse proxy for the Jetty server. The

[jira] [Created] (HDFS-9049) Make Datanode Netty reverse proxy port to be configurable

2015-09-10 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-9049: --- Summary: Make Datanode Netty reverse proxy port to be configurable Key: HDFS-9049 URL: https://issues.apache.org/jira/browse/HDFS-9049 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9049) Make Datanode Netty reverse proxy port to be configurable

2015-09-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739352#comment-14739352 ] Haohui Mai commented on HDFS-9049: -- Why does it need to be configurable? How does it benefit deployment?

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739670#comment-14739670 ] Zhe Zhang commented on HDFS-9050: - This is related to error handing when writing striped files.

[jira] [Updated] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9041: Attachment: HDFS-9041.001.patch Thank you [~wheat9] for your insight. The v1 patch addresses this.

[jira] [Commented] (HDFS-9005) Provide support for upgrade domain script

2015-09-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739969#comment-14739969 ] Ming Ma commented on HDFS-9005: --- Yes, that is a good idea. We discussed it briefly in the context of

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739978#comment-14739978 ] Hadoop QA commented on HDFS-9050: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739998#comment-14739998 ] Hudson commented on HDFS-7314: -- FAILURE: Integrated in Hadoop-trunk-Commit #8432 (See

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739721#comment-14739721 ] Zhe Zhang commented on HDFS-9050: - Thanks Jing for the feedback. Wire incompatibility is a good point that

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739747#comment-14739747 ] Daniel Templeton commented on HDFS-9024: Not sure why the build failed for the tests in Jenkins.

[jira] [Updated] (HDFS-8853) Erasure Coding: Provide ECSchema validation when setting EC policy

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8853: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Target Version/s:

[jira] [Commented] (HDFS-9025) Fix compilation issues on arch linux

2015-09-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739964#comment-14739964 ] James Clampffer commented on HDFS-9025: --- +1 > Fix compilation issues on arch linux >

[jira] [Commented] (HDFS-8952) InputStream.PositionRead() should be aware of available DNs

2015-09-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739963#comment-14739963 ] James Clampffer commented on HDFS-8952: --- +1 > InputStream.PositionRead() should be aware of

[jira] [Commented] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739717#comment-14739717 ] Hadoop QA commented on HDFS-9041: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8996: Attachment: HDFS-8996.00.patch {{validateLog}} and {{scanLog}} have very similar logics in

[jira] [Commented] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739776#comment-14739776 ] Haohui Mai commented on HDFS-9041: -- {code} + + +${basedir}/src/main/resources +

[jira] [Updated] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

2015-09-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8874: --- Attachment: HDFS-8874-trunk-v3.patch [~mingma] V3 attached. I realized I do not need accessor methods

[jira] [Updated] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8996: Summary: Consolidate validateLog and scanLog in FJM#EditLogFile (was: Remove redundant scanEditLog code) >

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739695#comment-14739695 ] Jing Zhao commented on HDFS-9047: - I also agree the current implementation is not good. So I'm fine with

[jira] [Commented] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Alex Ivanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739709#comment-14739709 ] Alex Ivanov commented on HDFS-9052: --- I saw [https://issues.apache.org/jira/browse/HDFS-6908] but since

[jira] [Comment Edited] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739734#comment-14739734 ] Jing Zhao edited comment on HDFS-9052 at 9/10/15 10:27 PM: --- A possible scenario

[jira] [Commented] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739734#comment-14739734 ] Jing Zhao commented on HDFS-9052: - A possible scenario is like this: 1. We deleted a file "foo" but it

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-09-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: HDFS-8830.06.patch Rebase the patch and remove unused methods from EncryptonZoneManager. >

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739970#comment-14739970 ] Arpit Agarwal commented on HDFS-8953: - Thanks for the heads up [~vinayrpet]. [~kanaka], the patch

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739643#comment-14739643 ] Arpit Agarwal commented on HDFS-9027: - Hi [~liuml07], thanks for this improvement. # Let's remove the

[jira] [Commented] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

2015-09-10 Thread Himanshu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739661#comment-14739661 ] Himanshu commented on HDFS-8750: [~ste...@apache.org] HDFS-8750.004.patch should work, I couldn't figure

[jira] [Commented] (HDFS-9008) Balancer#Parameters class could use a builder pattern

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739692#comment-14739692 ] Hadoop QA commented on HDFS-9008: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8996: Status: Patch Available (was: Open) > Consolidate validateLog and scanLog in FJM#EditLogFile >

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9027: Attachment: HDFS-9027.001.patch Thank you [~arpitagarwal] (online) and [~wheat9] (offline) for

[jira] [Updated] (HDFS-8853) Erasure Coding: Provide ECSchema validation when setting EC policy

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8853: Summary: Erasure Coding: Provide ECSchema validation when setting EC policy (was: Erasure Coding: Provide

  1   2   >