Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-25 Thread Karthik Kambatla
Thanks everyone for chiming in. I created https://issues.apache.org/jira/browse/HADOOP-10896 as a 2.5 blocker. On Thu, Jul 24, 2014 at 9:34 PM, Chris Nauroth cnaur...@hortonworks.com wrote: +1 for the proposal. I believe stating that classes without annotations are implicitly private is

[jira] [Resolved] (HDFS-6747) Display the most recent GC info on NN webUI

2014-07-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma resolved HDFS-6747. --- Resolution: Won't Fix Display the most recent GC info on NN webUI

[jira] [Created] (HDFS-6752) Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit

2014-07-25 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-6752: --- Summary: Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit Key: HDFS-6752 URL: https://issues.apache.org/jira/browse/HDFS-6752 Project: Hadoop HDFS

[jira] [Created] (HDFS-6753) When one the Disk is full and all the volumes configured are unhealthy , then Datanode is not considering it as failure and datanode process is not shutting down .

2014-07-25 Thread J.Andreina (JIRA)
J.Andreina created HDFS-6753: Summary: When one the Disk is full and all the volumes configured are unhealthy , then Datanode is not considering it as failure and datanode process is not shutting down . Key: HDFS-6753

Hadoop-Hdfs-trunk - Build # 1815 - Still Failing

2014-07-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1815/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 17657 lines...] main: [mkdir] Created dir:

Build failed in Jenkins: Hadoop-Hdfs-trunk #1815

2014-07-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1815/changes Changes: [vinayakumarb] HDFS-5919. FileJournalManager doesn't purge empty and corrupt inprogress edits files (vinayakumarb) [wang] HADOOP-10891. Add EncryptedKeyVersion factory method to KeyProviderCryptoExtension. (wang)

[jira] [Created] (HDFS-6755) Make DFSOutputStream more efficient

2014-07-25 Thread Mit Desai (JIRA)
Mit Desai created HDFS-6755: --- Summary: Make DFSOutputStream more efficient Key: HDFS-6755 URL: https://issues.apache.org/jira/browse/HDFS-6755 Project: Hadoop HDFS Issue Type: Bug Affects

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-25 Thread Colin McCabe
+1. Colin On Tue, Jul 22, 2014 at 2:54 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi devs As you might have noticed, we have several classes and methods in them that are not annotated at all. This is seldom intentional. Avoiding incompatible changes to all these classes can be

Re: Finding file size during block placement

2014-07-25 Thread Colin McCabe
On Wed, Jul 23, 2014 at 8:15 AM, Arjun baksh...@mail.uc.edu wrote: Hi, I want to write a block placement policy that takes the size of the file being placed into account. Something like what is done in CoHadoop or BEEMR paper. I have the following questions: Hadoop uses a stream metaphor.

[jira] [Resolved] (HDFS-6724) Decrypt EDEK before creating CryptoInputStream/CryptoOutputStream

2014-07-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6724. --- Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Decrypt EDEK

[jira] [Created] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6756: - Summary: Default ipc.maximum.data.length should be increased to 128MB from 64MB Key: HDFS-6756 URL: https://issues.apache.org/jira/browse/HDFS-6756 Project: Hadoop HDFS

Re: Branching 2.5

2014-07-25 Thread Andrew Wang
I just went through and fixed up the HDFS and Common CHANGES.txt for 2.5.0. As a friendly reminder, please try to put things under the correct section :) We have subsections for the xattr changes in HDFS-2006 and HADOOP-10514, and there were some unrelated JIRAs appended to the end. I'd also

Re: Branching 2.5

2014-07-25 Thread Andrew Wang
One thing I forgot, the release note activities are happening at HADOOP-10821. If you have other things you'd like to see mentioned, feel free to leave a comment on the JIRA and I'll try to include it. Thanks, Andrew On Fri, Jul 25, 2014 at 12:28 PM, Andrew Wang andrew.w...@cloudera.com wrote:

Re: Branching 2.5

2014-07-25 Thread Karthik Kambatla
A quick update: All remaining blockers are on the verge of getting committed. Once that is done, I plan to cut a branch for 2.5.0 and get an RC out hopefully this coming Monday. On Fri, Jul 25, 2014 at 12:32 PM, Andrew Wang andrew.w...@cloudera.com wrote: One thing I forgot, the release note

[jira] [Resolved] (HDFS-3607) log a message when fuse_dfs is not built

2014-07-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-3607. Resolution: Fixed Target Version/s: (was: ) log a message when

[jira] [Resolved] (HDFS-6756) Default ipc.maximum.data.length should be increased to 128MB from 64MB

2014-07-25 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu resolved HDFS-6756. --- Resolution: Invalid Default ipc.maximum.data.length should be increased to 128MB from 64MB

[jira] [Created] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-07-25 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6758: --- Summary: block writer should pass the expected block size to DataXceiverServer Key: HDFS-6758 URL: https://issues.apache.org/jira/browse/HDFS-6758 Project: Hadoop HDFS