[jira] [Resolved] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-08-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-10757. -- Resolution: Duplicate Agree with Arun. Closing this as a dup of HADOOP-13381. Feel free to

[jira] [Created] (HDFS-10757) KMSClientProvider combined with KeyProviderCache results in wrong UGI being used

2016-08-11 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HDFS-10757: --- Summary: KMSClientProvider combined with KeyProviderCache results in wrong UGI being used Key: HDFS-10757 URL: https://issues.apache.org/jira/browse/HDFS-10757

[jira] [Created] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-08-11 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-10756: Summary: Expose getTrashRoot to HTTPFS and WebHDFS Key: HDFS-10756 URL: https://issues.apache.org/jira/browse/HDFS-10756 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-10755) TestDecommissioningStatus BindException Failure

2016-08-11 Thread Eric Badger (JIRA)
Eric Badger created HDFS-10755: -- Summary: TestDecommissioningStatus BindException Failure Key: HDFS-10755 URL: https://issues.apache.org/jira/browse/HDFS-10755 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat

2016-08-11 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10754: Summary: libhdfs++: Create tools directory and implement hdfs_cat Key: HDFS-10754 URL: https://issues.apache.org/jira/browse/HDFS-10754 Project: Hadoop HDFS

Re: NFS Gateway Performance

2016-08-11 Thread Zhe Zhang
Did you try multiple NFS gateways? On Thu, Aug 11, 2016 at 8:44 AM Senthil Kumar wrote: > Hi Team , I'm trying out the NFS Gateway feature in Hadoop. > > Would like to understand the performance of NFS.. > > Hadoop Version : *Hadoop 2.7.1.2.4.2.0-258* > > Cluster Size :

Re: [Release thread] 2.6.5 release activities

2016-08-11 Thread Karthik Kambatla
Since there is sufficient interest in 2.6.5, we should probably do it. All the reasons Allen outlines make sense. That said, Junping brings up a very important point that we should think of for future releases. For a new user or a user that does not directly contribute to the project, more stable

Re: [Release thread] 2.6.5 release activities

2016-08-11 Thread Allen Wittenauer
> On Aug 11, 2016, at 8:10 AM, Junping Du wrote: > > Allen, to be clear, I am not against any branch release effort here. However, "I'm not an X but " > as RM for previous releases 2.6.3 and 2.6.4, I feel to have responsibility to > take care

[jira] [Created] (HDFS-10753) Method invocation in log can be replaced by variable because the variable's toString method contains more info

2016-08-11 Thread Nemo Chen (JIRA)
Nemo Chen created HDFS-10753: Summary: Method invocation in log can be replaced by variable because the variable's toString method contains more info Key: HDFS-10753 URL:

[jira] [Created] (HDFS-10752) Variable in byte printed directly in hdfs

2016-08-11 Thread Nemo Chen (JIRA)
Nemo Chen created HDFS-10752: Summary: Variable in byte printed directly in hdfs Key: HDFS-10752 URL: https://issues.apache.org/jira/browse/HDFS-10752 Project: Hadoop HDFS Issue Type: Bug

Re: HDFS Balancer - Balancing Effectively ?

2016-08-11 Thread Xiaobing Zhou
They are working if you removed the last digit of the links. On Thu, Aug 11, 2016 at 10:49 AM, Zhe Zhang wrote: > Thanks Nicholas for the pointers; the first 2 links are not working. > > On Thu, Aug 11, 2016 at 10:09 AM Tsz Wo Sze > wrote: > > > Hi

Re: HDFS Balancer - Balancing Effectively ?

2016-08-11 Thread Zhe Zhang
Thanks Nicholas for the pointers; the first 2 links are not working. On Thu, Aug 11, 2016 at 10:09 AM Tsz Wo Sze wrote: > Hi Senthi > The Balancer performance was improved dramatically recently [1]. I am not > sure if you know about the new conf and parameters; see

[jira] [Created] (HDFS-10751) Log refactoring: method invocation should be replaced by a shorter method

2016-08-11 Thread Nemo Chen (JIRA)
Nemo Chen created HDFS-10751: Summary: Log refactoring: method invocation should be replaced by a shorter method Key: HDFS-10751 URL: https://issues.apache.org/jira/browse/HDFS-10751 Project: Hadoop HDFS

[jira] [Created] (HDFS-10750) Log refactoring: method invocation should be replaced by a shorter method

2016-08-11 Thread Nemo Chen (JIRA)
Nemo Chen created HDFS-10750: Summary: Log refactoring: method invocation should be replaced by a shorter method Key: HDFS-10750 URL: https://issues.apache.org/jira/browse/HDFS-10750 Project: Hadoop HDFS

Re: HDFS Balancer - Balancing Effectively ?

2016-08-11 Thread Tsz Wo Sze
Hi Senthi The Balancer performance was improved dramatically recently [1].  I am not sure if you know about the new conf and parameters; see [2].  If you are interested in more details on how the Balancer works, please see [3].  Thanks. 1. 

NFS Gateway Performance

2016-08-11 Thread Senthil Kumar
Hi Team , I'm trying out the NFS Gateway feature in Hadoop. Would like to understand the performance of NFS.. Hadoop Version : *Hadoop 2.7.1.2.4.2.0-258* Cluster Size : 10 DNS , 1 NN, 1 SN , 1 RM. One of the Data Node is NFS Gateway Server..Now i could see Performance issues when i start ( 5

Re: [Release thread] 2.6.5 release activities

2016-08-11 Thread Junping Du
Allen, to be clear, I am not against any branch release effort here. However, as RM for previous releases 2.6.3 and 2.6.4, I feel to have responsibility to take care branch-2.6 together with other RMs (Vinod and Sangjin) on this branch and understand current gap - especially, to get consensus

[jira] [Created] (HDFS-10749) Log refactoring: method invocation should be replaced by variable

2016-08-11 Thread Nemo Chen (JIRA)
Nemo Chen created HDFS-10749: Summary: Log refactoring: method invocation should be replaced by variable Key: HDFS-10749 URL: https://issues.apache.org/jira/browse/HDFS-10749 Project: Hadoop HDFS

Re: [Release thread] 2.6.5 release activities

2016-08-11 Thread Allen Wittenauer
> On Aug 11, 2016, at 5:59 AM, Junping Du wrote: > > These comments are more like wishes but not giving more clarifications > on the needs. I would like to hear more specific reasons to not move to 2.7.x > releases but prefer to upgrade to 2.6.5. If the only reason

Re: HDFS Balancer - Balancing Effectively ?

2016-08-11 Thread Senthil Kumar
Hi Team , Pls add your suggestion(s) here , So that i can tune parameters to balance cluster which is in bad shape now :( .. --Senthil On Thu, Aug 11, 2016 at 3:51 PM, Senthil Kumar wrote: > Thanks Lars for your quick response! > > Here is my Cluster Utilization.. >

Re: [Release thread] 2.6.5 release activities

2016-08-11 Thread Junping Du
Hi Chris, Thanks for your response! I think I could miss the thread discussion of "[DISCUSS] 2.6.x line releases" for something reason. I checked the discussion - Sean claimed that HBase community needs 2.6.5, Zhe said they are using 2.6.x releases and Akira said that are over new

Re: HDFS Balancer - Recommended Threshold Value

2016-08-11 Thread Senthil Kumar
Thanks Lars for your quick response! Here is my Cluster Utilization.. DFS Used% : 74.39% DFS Remaining% : 25.60% Block Pool Used% : 74.39% DataNodes usages : Min % Median % Max % stdev % 1.25% 99.72% 99.99% 22.53% Hadoop Version : *2.4.1* Let's take an example : Cluster Live Nodes

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-08-11 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/130/ [Aug 10, 2016 4:54:31 PM] (cnauroth) HADOOP-13476. CredentialProviderFactory fails at class loading from [Aug 10, 2016 6:04:18 PM] (jlowe) YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers.