Re: Something kill hadoopuser applications

2016-02-17 Thread Roberto Gonzalez
We could only see the SIGTERM, We monitor the memory, and it was not a memory problem, could be ulimit, since lsof | wc -l was higher than 200K some times. after 2 weeks trying to solve it, trying with JAVA 7, JAVA8, hadoop 2.4.1, 2.6.4 and 2.7.2 we have decided to reinstall everything from the

Re: Hadoop fs mv pushes folder under subfolder of same name

2016-02-17 Thread Chandeep Singh
This is what I get on CDH 5.4.8: [csingh]$ hadoop fs -ls -R abc drwxr-xr-x - hdfs supergroup 0 2016-02-17 18:25 abc/a drwxr-xr-x - hdfs supergroup 0 2016-02-17 18:26 abc/b drwxr-xr-x - hdfs supergroup 0 2016-02-17 18:26 abc/b/a [csingh]$ hadoop fs -mv abc/a abc/b

Hadoop fs mv pushes folder under subfolder of same name

2016-02-17 Thread Christopher Maier
Hi, I've run into an odd condition in the Hadoop move command. When moving a directory 'a' under a directory 'b' which already has a directory 'a' under it, it moves under that subdirectory rather than failing. > hdfs -ls -R abc drwxr-x--x - dedwmktmedia supergroup 0 2016-02-17

Re: FW: Trash data after upgrade from 2.7.1 to 2.7.2

2016-02-17 Thread Chef Win2er
Hi Vinay, If you can share your namenode and datanode logs that would be helpful. >Sadly for some reason I cannot upload the logs. I found this(https://issues.apache.org/jira/browse/HDFS-7645) ticket.(Yes, you commented it. :) ) May this concerns? I tried the steps you mentioned but it didn't

Re: fs.s3a.endpoint not working

2016-02-17 Thread Billy Watson
Thanks for following up! William Watson Lead Software Engineer On Tue, Feb 16, 2016 at 5:08 PM, Phillips, Caleb wrote: > Hi All, > > Just wanted to follow on that we got this working with the help of the > object storage vendor. After running in circles for a bit, the