Re: Question on configuring Hadoop 2.6.0 with a different filesystem

2015-04-16 Thread sandeep vura
Hi Silvan, Please put the below configuration in core-site.xml and start the cluster. property namefs.default.name/name valuequobyte:// prod.corp.quobyte.com:7861/users/kaisers/hadoop-test//value/property propertynamefs.quobyte.impl/name

Question on configuring Hadoop 2.6.0 with a different filesystem

2015-04-16 Thread Silvan Kaiser
Hello! I'm rather new to hadoop and currently testing the integration of a new file system as replacement for HDFS, similiar to integrations like GlusterFS, GPFS, Ceph, etc. . I do have an implementation of the FileSystem class but a basic issue trying to test it, This seems to be rooted in a

Found weird issue with HttpFS and WebHdfsFileSystem

2015-04-16 Thread Bram Biesbrouck
Hi all, I'm experiencing something strange while developing against the HttpFS front-end webapp on Hadoop 2.6.0. I'm currently digging into WebHdfsFileSystem and HttpFS to understand it better and understand how the rest api works. I've setup a local single node Hadoop instance, which I can

Re: Mapreduce job got stuck

2015-04-16 Thread Vandana kumari
Thank you everyone for your reply. My problem is solved now. On Wed, Apr 15, 2015 at 4:39 PM, Rohith Sharma K S rohithsharm...@huawei.com wrote: Hi, On master machine, NodeManager is not running because of “Caused by: java.net.BindException: Problem binding to [*kirti:8040*], got from

Yarn AppMaster request for containers not working

2015-04-16 Thread Antonescu Andrei Bogdan
Hello, I'm writing a Yarn Client for my distributed processing framework and I`m not able to request containers for workers from AppMaster addContainerRequest method. Please find here a more detailed explanation:

Re: Add keys to column family in HBase using Python

2015-04-16 Thread Chris Nauroth
Hello Manoj, I recommend restarting this thread over at u...@hbase.apache.org. The user@hadoop.apache.org list specifically covers issues in Hadoop Common, HDFS, YARN and MapReduce. Chris Nauroth Hortonworks http://hortonworks.com/ From: Manoj Venkatesh

Re: Deprecation Error

2015-04-16 Thread Chris Nauroth
Hello Anand, MapReduce provides 2 similar but slightly different public APIs for writing jobs. The original API is in the org.apache.hadoop.mapred package, and a revised version is in the org.apache.hadoop.mapreduce package. The JavaDocs provide examples of both:

Re: is this a best practice to do....

2015-04-16 Thread Chris Nauroth
Hello Kumar, I recommend restarting this thread over at u...@sqoop.apache.org. The user@hadoop.apache.org list specifically covers issues in Hadoop Common, HDFS, YARN and MapReduce. Chris Nauroth Hortonworks http://hortonworks.com/ From: Kumar Jayapal

Re: Pin Map/Reduce tasks to specific cores

2015-04-16 Thread George Ioannidis
Dear Rohith and Naga, Thank you very much for your quick responses, your information has proven very useful. Cheers, George On 7 April 2015 at 07:08, Naganarasimha G R (Naga) garlanaganarasi...@huawei.com wrote: Hi George, The current implementation present in YARN using Cgroups supports

Container exited with a non-zero exit code 134

2015-04-16 Thread Nitin Mathur
Hi All, Production job failing with Container exited with a non-zero exit code 134. Any ideas what could be causing this as I am not able to see anything straight forward here. - Nitin

Re: Container exited with a non-zero exit code 134

2015-04-16 Thread Chris Nauroth
Hello Nitin, When I see an exit code greater than 128, then that makes me think the process didn't exit normally and instead it was terminated unexpectedly by a signal. On most of the systems I've used, if a process gets killed, then the reported exit status is 128 + the signal number. 134 -

Re: Container exited with a non-zero exit code 134

2015-04-16 Thread Ted Yu
Can you provide a bit more information please (such as hadoop release) ? Using the following command you would get more clue on the cause (plug in your app Id and container Id): yarn logs -applicationId application_1386639398517_0007 -containerId container_1386639398517_0007_01_19 Cheers

Re: Found weird issue with HttpFS and WebHdfsFileSystem

2015-04-16 Thread Chris Nauroth
Hello Bram, There are a few Apache jiras with background discussion of the introduction of these fields in WebHDFS. https://issues.apache.org/jira/browse/HDFS-4502 https://issues.apache.org/jira/browse/HDFS-4772 https://issues.apache.org/jira/browse/HDFS-4969 The new fields could not be