[jira] [Updated] (HDFS-9768) Reuse objectMapper instance in HDFS to improve the performance

2016-02-12 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9768: Attachment: HDFS-9768.003.patch Thanks [~ajisakaa] for review. Update the latest patch. > Reuse

[jira] [Updated] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9794: -- Hadoop Flags: Reviewed Component/s: hdfs-client +1 patch looks good. > Streamer

[jira] [Updated] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2016-02-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9754: -- Hadoop Flags: Reviewed +1 the new patch looks good! > Avoid unnecessary

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144349#comment-15144349 ] Hadoop QA commented on HDFS-9787: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9768) Reuse objectMapper instance in HDFS to improve the performance

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144413#comment-15144413 ] Hadoop QA commented on HDFS-9768: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-12 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144513#comment-15144513 ] Larry McCay commented on HDFS-9711: --- I am much more inclined to try and make v004 work than go back to

[jira] [Commented] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2016-02-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144837#comment-15144837 ] Kihwal Lee commented on HDFS-9533: -- I haven't seen it actually creating problems other than our internal

[jira] [Resolved] (HDFS-6953) HDFS file append failing in single node configuration

2016-02-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-6953. -- Resolution: Invalid Corrected resolution field to 'invalid' since there was no fix. > HDFS file append

[jira] [Reopened] (HDFS-6953) HDFS file append failing in single node configuration

2016-02-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-6953: -- > HDFS file append failing in single node configuration >

[jira] [Closed] (HDFS-6953) HDFS file append failing in single node configuration

2016-02-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley closed HDFS-6953. > HDFS file append failing in single node configuration > -

[jira] [Commented] (HDFS-9768) Reuse objectMapper instance in HDFS to improve the performance

2016-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144878#comment-15144878 ] Hudson commented on HDFS-9768: -- FAILURE: Integrated in Hadoop-trunk-Commit #9293 (See

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144891#comment-15144891 ] Zhe Zhang commented on HDFS-8831: - [~xyao] [~arpitagarwal] [~leftnoteasy] [~andrew.wang] : Since the new

[jira] [Updated] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-12 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9797: -- Status: Patch Available (was: In Progress) > RequestHedgingProxyProvider is too verbose with Standby

[jira] [Commented] (HDFS-9798) TestHdfsNativeCodeLoader fails

2016-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144826#comment-15144826 ] Akira AJISAKA commented on HDFS-9798: - Thanks [~cnauroth]! > TestHdfsNativeCodeLoader fails >

[jira] [Commented] (HDFS-9793) upgrade or remove guava dependency

2016-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144843#comment-15144843 ] Colin Patrick McCabe commented on HDFS-9793: We should upgrade to Guava 15 in branch-3 (trunk).

[jira] [Updated] (HDFS-9768) Reuse objectMapper instance in HDFS to improve the performance

2016-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9768: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9425) Expose number of blocks per volume as a metric

2016-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9425: --- Attachment: HDFS-9425-004.patch > Expose number of blocks per volume as a metric >

[jira] [Commented] (HDFS-9768) Reuse objectMapper instance in HDFS to improve the performance

2016-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144805#comment-15144805 ] Akira AJISAKA commented on HDFS-9768: - +1, the test failure looks unrelated to the patch. > Reuse

[jira] [Resolved] (HDFS-9798) TestHdfsNativeCodeLoader fails

2016-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9798. - Resolution: Duplicate Hi [~ajisakaa]. A recent Yetus change is preventing pre-commit from

[jira] [Updated] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9700: --- Issue Type: Improvement (was: Bug) > DFSClient and DFSOutputStream should set TCP_NODELAY on

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144743#comment-15144743 ] Masatake Iwasaki commented on HDFS-9700: I would like to update title and type of the issue because

[jira] [Updated] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9700: --- Summary: DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for

[jira] [Updated] (HDFS-7452) Can we skip getCorruptFiles() call for standby NameNode..?

2016-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7452: --- Attachment: HDFS-7452.patch > Can we skip getCorruptFiles() call for standby

[jira] [Commented] (HDFS-7452) Can we skip getCorruptFiles() call for standby NameNode..?

2016-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144728#comment-15144728 ] Brahma Reddy Battula commented on HDFS-7452: uploaded the patch to eliminate spam in

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream do not respect TCP_NODELAY config in two spots

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144739#comment-15144739 ] Masatake Iwasaki commented on HDFS-9700: +1. I will commit this to branch-2.8 and above if there is

[jira] [Commented] (HDFS-9425) Expose number of blocks per volume as a metric

2016-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144763#comment-15144763 ] Brahma Reddy Battula commented on HDFS-9425: [~vinayrpet] thanks for reviewing . Uploaded the

[jira] [Created] (HDFS-9798) TestHdfsNativeCodeLoader fails

2016-02-12 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-9798: --- Summary: TestHdfsNativeCodeLoader fails Key: HDFS-9798 URL: https://issues.apache.org/jira/browse/HDFS-9798 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7452) Can we skip getCorruptFiles() call for standby NameNode..?

2016-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7452: --- Status: Patch Available (was: Open) > Can we skip getCorruptFiles() call for standby

[jira] [Updated] (HDFS-9773) Remove dead code related to SimulatedFSDataset in tests

2016-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9773: --- Attachment: HDFS-9773-003.patch > Remove dead code related to SimulatedFSDataset in

[jira] [Commented] (HDFS-9773) Remove dead code related to SimulatedFSDataset in tests

2016-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144798#comment-15144798 ] Brahma Reddy Battula commented on HDFS-9773: [~ajisakaa] thanks for review.uploaded the

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144977#comment-15144977 ] Chris Nauroth commented on HDFS-9711: - [~lmccay], thanks again. I think we're basically on the same

[jira] [Updated] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9799: Attachment: HDFS-9799.00.patch The source of the {{IOException}} is from {{getEZForPath}}. So when

[jira] [Commented] (HDFS-7452) Can we skip getCorruptFiles() call for standby NameNode..?

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144956#comment-15144956 ] Hadoop QA commented on HDFS-7452: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-12 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145008#comment-15145008 ] Larry McCay commented on HDFS-9711: --- No, I don't think that is necessary to go that far. +1 for removing

[jira] [Commented] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144910#comment-15144910 ] Zhe Zhang commented on HDFS-9533: - Thanks for clarifying this Kihwal. > seen_txid in the shared edits

[jira] [Updated] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9799: Status: Patch Available (was: Open) > Reimplement getCurrentTrashDir to remove incompatibility >

[jira] [Created] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-9799: --- Summary: Reimplement getCurrentTrashDir to remove incompatibility Key: HDFS-9799 URL: https://issues.apache.org/jira/browse/HDFS-9799 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9644) Update encryption documentation to reflect nested EZs

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9644: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) > Update

[jira] [Updated] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9794: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) I've

[jira] [Commented] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2016-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145105#comment-15145105 ] Hudson commented on HDFS-9754: -- FAILURE: Integrated in Hadoop-trunk-Commit #9296 (See

[jira] [Commented] (HDFS-9794) Streamer threads may leak if failure happens when closing the striped outputstream

2016-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145106#comment-15145106 ] Hudson commented on HDFS-9794: -- FAILURE: Integrated in Hadoop-trunk-Commit #9296 (See

[jira] [Updated] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9799: Attachment: HDFS-9799.01.patch Thanks Andrew for the review. The IOException logic in {{getTrashRoots}} is

[jira] [Updated] (HDFS-9797) Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level

2016-02-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-9797: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-9797) Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level

2016-02-12 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145132#comment-15145132 ] Inigo Goiri commented on HDFS-9797: --- Thank you [~asuresh] very much for the review and the commit! > Log

[jira] [Commented] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145031#comment-15145031 ] Arun Suresh commented on HDFS-9797: --- It looks like the test case failures are unrelated and this being a

[jira] [Resolved] (HDFS-9124) NullPointerException when underreplicated blocks are there

2016-02-12 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu resolved HDFS-9124. - Resolution: Duplicate Fix Version/s: 2.7.4 It was fixed in HDFS-9574. >

[jira] [Updated] (HDFS-9644) Update encryption documentation to reflect nested EZs

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9644: Issue Type: Improvement (was: New Feature) > Update encryption documentation to reflect nested EZs >

[jira] [Commented] (HDFS-9797) RequestHedgingProxyProvider is too verbose with Standby exceptions

2016-02-12 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145038#comment-15145038 ] Inigo Goiri commented on HDFS-9797: --- Yes, I tested with a few thousand containers and they don't show the

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145043#comment-15145043 ] Hudson commented on HDFS-9700: -- FAILURE: Integrated in Hadoop-trunk-Commit #9294 (See

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145055#comment-15145055 ] Andrew Wang commented on HDFS-9799: --- Throwing a new checked exception is definitely incompatible, good

[jira] [Updated] (HDFS-9644) Update encryption documentation to reflect nested EZs

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9644: Hadoop Flags: Reviewed Thanks Andrew! Committed to trunk, branch-2, and branch-2.8. > Update encryption

[jira] [Commented] (HDFS-9644) Update encryption documentation to reflect nested EZs

2016-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145071#comment-15145071 ] Hudson commented on HDFS-9644: -- FAILURE: Integrated in Hadoop-trunk-Commit #9295 (See

[jira] [Updated] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9700: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9797) Log Standby exceptions thrown by RequestHedgingProxyProvider as DEBUG

2016-02-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-9797: -- Summary: Log Standby exceptions thrown by RequestHedgingProxyProvider as DEBUG (was:

[jira] [Updated] (HDFS-9797) Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level

2016-02-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-9797: -- Summary: Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (was: Log Standby

[jira] [Commented] (HDFS-9796) Add throttler for datanode bandwidth

2016-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145117#comment-15145117 ] Arpit Agarwal commented on HDFS-9796: - Hi [~Guocui], can you add some more details in the description?

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145121#comment-15145121 ] Zhe Zhang commented on HDFS-9799: - The v01 patch added some formatting and Javadoc changes. > Reimplement

[jira] [Commented] (HDFS-9425) Expose number of blocks per volume as a metric

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145130#comment-15145130 ] Hadoop QA commented on HDFS-9425: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145147#comment-15145147 ] Zhe Zhang commented on HDFS-9688: - So you mean complete deletion of nested EZs (instead of deleting into

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145155#comment-15145155 ] Zhe Zhang commented on HDFS-9688: - Thanks Andrew for the suggestion re:pre-commit. I think it's worthwhile

[jira] [Created] (HDFS-9800) Add option to send BlockStateChange logs to alternate async appender

2016-02-12 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-9800: --- Summary: Add option to send BlockStateChange logs to alternate async appender Key: HDFS-9800 URL: https://issues.apache.org/jira/browse/HDFS-9800 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9797) Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level

2016-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145158#comment-15145158 ] Hudson commented on HDFS-9797: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9297 (See

[jira] [Updated] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9711: Attachment: HDFS-9711.005.patch Here is patch v005. The only changes since v004 are in

[jira] [Updated] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2016-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9754: Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) I've

[jira] [Commented] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-02-12 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145180#comment-15145180 ] Lei (Eddy) Xu commented on HDFS-9671: - Hi, [~anu] Thanks a lot for the updates. It LGTM overall. Will

[jira] [Commented] (HDFS-9773) Remove dead code related to SimulatedFSDataset in tests

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145184#comment-15145184 ] Hadoop QA commented on HDFS-9773: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9797) Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145193#comment-15145193 ] Hadoop QA commented on HDFS-9797: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9772) TestBlockReplacement#testThrottler use falut variable to calculate bandwidth

2016-02-12 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145864#comment-15145864 ] Lin Yiqun commented on HDFS-9772: - hi, [~kihwal], could you please review the patch, it seemed that you

[jira] [Updated] (HDFS-9810) Allow support for more than one block replica per datanode

2016-02-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9810: -- Component/s: datanode I am not sure your use case. This does not sound like a good idea

[jira] [Updated] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

2016-02-12 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7766: --- Attachment: HDFS-7766.05.patch Here's a rebased patch > Add a flag to WebHDFS op=CREATE to not

[jira] [Updated] (HDFS-9801) ReconfigurableBase should update the cached configuration

2016-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9801: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8831: Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) > Trash Support for deletion in HDFS encryption

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145310#comment-15145310 ] Zhe Zhang commented on HDFS-8831: - Thanks Arpit. I think we should also decide whether to revert this

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145346#comment-15145346 ] Zhe Zhang commented on HDFS-8831: - Sounds good to me. I don't expect HDFS-9799 to take too long. > Trash

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145432#comment-15145432 ] Jing Zhao commented on HDFS-9698: - Agree. In the end we may want to run balancer as a daemon service like

[jira] [Commented] (HDFS-9801) ReconfigurableBase should update the cached configuration

2016-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145284#comment-15145284 ] Hudson commented on HDFS-9801: -- FAILURE: Integrated in Hadoop-trunk-Commit #9298 (See

[jira] [Updated] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9799: Attachment: HDFS-9799.02.patch Updating the patch to fix checkstyle issue. The reported test failure is

[jira] [Commented] (HDFS-9657) Schedule EC tasks at proper time to reduce the impact of recovery traffic

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145342#comment-15145342 ] Zhe Zhang commented on HDFS-9657: - This is an interesting idea. However, when some internal blocks of a

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2016-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145304#comment-15145304 ] Arpit Agarwal commented on HDFS-8831: - Hi [~zhz], we should definitely fix it since we don't want an

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145403#comment-15145403 ] Xiao Chen commented on HDFS-9698: - FWIW, I think I'd briefly update here for future reference. Thanks all

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2016-02-12 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145469#comment-15145469 ] Dave Latham commented on HDFS-7964: --- Would love to see this get committed. > Add support for async edit

[jira] [Updated] (HDFS-8020) Erasure Coding: constructing and mapping BlockGroup info to utilize and call ErasureCoder API

2016-02-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8020: - Status: Patch Available (was: Open) > Erasure Coding: constructing and mapping BlockGroup info to utilize

[jira] [Updated] (HDFS-8020) Erasure Coding: constructing and mapping BlockGroup info to utilize and call ErasureCoder API

2016-02-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8020: - Status: Open (was: Patch Available) > Erasure Coding: constructing and mapping BlockGroup info to utilize

[jira] [Commented] (HDFS-9804) Allow long-running Balancer in Kerberized Environments

2016-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145530#comment-15145530 ] Chris Nauroth commented on HDFS-9804: - [~xiaochen], yes, that makes sense. It would be an optional

[jira] [Moved] (HDFS-9801) ReconfigurableBase should update the cached configuration

2016-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal moved HADOOP-12746 to HDFS-9801: -- Affects Version/s: (was: 2.8.0) 2.8.0

[jira] [Commented] (HDFS-9801) ReconfigurableBase should update the cached configuration

2016-02-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145269#comment-15145269 ] ASF GitHub Bot commented on HDFS-9801: -- Github user arp7 closed the pull request at:

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145478#comment-15145478 ] Chris Nauroth commented on HDFS-9698: - Thank you, [~xiaochen]. Sounds like a good plan. > Long

[jira] [Commented] (HDFS-9804) Allow long-running Balancer in Kerberized Environments

2016-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145475#comment-15145475 ] Chris Nauroth commented on HDFS-9804: - The "run as a daemon" piece is supported by the shell script

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145510#comment-15145510 ] Hadoop QA commented on HDFS-9799: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145511#comment-15145511 ] Hadoop QA commented on HDFS-7964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9804) Allow long-running Balancer in Kerberized Environments

2016-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145518#comment-15145518 ] Xiao Chen commented on HDFS-9804: - Thanks for the comment [~cnauroth]. I didn't know we have {{hdfs

[jira] [Assigned] (HDFS-9804) Allow long-running Balancer in Kerberized Environments

2016-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-9804: --- Assignee: Xiao Chen > Allow long-running Balancer in Kerberized Environments >

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145215#comment-15145215 ] Hadoop QA commented on HDFS-9799: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9801) ReconfigurableBase should update the cached configuration

2016-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145259#comment-15145259 ] Arpit Agarwal commented on HDFS-9801: - Thanks for the code review [~jingzhao]. I moved this to HDFS.

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145439#comment-15145439 ] Xiao Chen commented on HDFS-9781: - Chatted with [~jojochuang] offline, the test timeouts because of the NPE

[jira] [Updated] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9799: Attachment: HDFS-9799.03.patch Thanks Andrew. I took another look at {{getTrashRoots}}. Agreed that

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145451#comment-15145451 ] Xiao Chen commented on HDFS-9698: - Thanks Chris and Jing for the quick response! FYI - I created HDFS-9804.

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2016-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7964: Attachment: HDFS-7964.patch rebase the patch for Daryn. > Add support for async edit logging >

[jira] [Comment Edited] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2016-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145304#comment-15145304 ] Arpit Agarwal edited comment on HDFS-8831 at 2/12/16 9:12 PM: -- Hi [~zhz], we

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145418#comment-15145418 ] Chris Nauroth commented on HDFS-9698: - Running balancer as an interactive process, the assumption is

  1   2   >