RE: Does MapReduceApplicationMaster prevents data node from spawning YarnChild?

Thank You very much if it is the case then ApplicationMaster alone takes alomst everything that my datanode can offer - that would explain why task itself can't start. Thank You very much again. Dnia 17 listopada 2015 20:40 Bikas Saha bi...@apache.org napisał(a): You can check for

Re: failed to start namenode

At least share some excerpts from log of name node log file. On Wed, Nov 18, 2015 at 5:46 PM, siva kumar wrote: > Hi Folks, > I'm trying to install a fresh hadoop cluster. But > then,namenode is not is not starting up because of which hdfs service is >

failed to start namenode

Hi Folks, I'm trying to install a fresh hadoop cluster. But then,namenode is not is not starting up because of which hdfs service is not started during my first run. Can anyone help me out? I'm trying this using parcels(CDH-5). Any help?

Data spilling on disk from MR jobs

Hi, I'm running my pig script over YARN(MR2). I was going through some tuning parameter and find out that the value of parameter "mapreduce.task.io.sort.mb" should be tuned properly. By default it is configured to 256 MB in my cloudera setup. I would wish to know that how can I find whether my

Re: yarn uses nodes non symetrically

Nicolae It depends on how big your AM container is compared to the task containers. By default, the AM container size is 1.5GB and the map/reduce containers are 1GB. You can adjust these by setting yarn.app.mapreduce.am.resource.mb, mapreduce.map.memory.mb, and mapreduce.map.memory.mb. If you

Re: failed to start namenode

Its surprising that no logs are created. How are you trying to start Name node? If you are starting using cloudera manager then logs can be seen found out on screen as well. On Thu, Nov 19, 2015 at 11:36 AM, siva kumar wrote: > Hi Sandeep, > The

Yarn application reading from Data node using short-circuit.

Hi, I was going through some benchmarking and realized that there are lots of TCP connections are initiated while running my PIG jobs over YARN(MR2). These TCP connections are related to data node. Although short-circuit is enabled in my data nodes but still a lot TCP connections are being

Re: failed to start namenode

Hi Sandeep, The log is not getting generated for the name node. On Wed, Nov 18, 2015 at 5:53 PM, sandeep das wrote: > At least share some excerpts from log of name node log file. > > On Wed, Nov 18, 2015 at 5:46 PM, siva kumar

map task frozen from master(s) perspective, but no process is there, and task log reports completion

Hi, I have a map task "slot" occupied with a task that does not make progress for hours, and in fact is seen by yarn as NEW and STARTING. (Since we use yarn / hadoop2, it is not a slot per-se, but the resource mechanism works as dynamically computing slots - for instance I have top 5

Fwd: Unable to submit jobs to a Hadoop cluster after a while

Re-sending the post. Any help is highly appreciated. -- Forwarded message -- From: Ashwanth Kumar Date: Sun, Nov 15, 2015 at 9:24 AM Subject: Unable to submit jobs to a Hadoop cluster after a while To: user@hadoop.apache.org We're running Hadoop