Re: Master /slave file configuration for multiple datanodes on same machine

The SSH-helped slave file approach will not work for the goal of running multiple slave daemons per host, where different configuration directories are instead expected to be used. You can instead use "hadoop --config custom-dir datanode" to launch them directly. On Wed, Jul 30, 2014 at 1:24 PM,

Re: PCA in HAdoop MapReduce

This may not be the right place to ask this question. I asked a more generic question about how to do predictive modeling on hadoop and nobody answered. It perplexes me as well how to take these machine learning concepts and implement them in a Map Reduce paradigm. Adaryl "Bob" Wakefield, MBA P

Re: Allocating Containers on a particular Node in Yarn

Just to add, when I am using Capacity Scheduler, the same request works fine. On Wed, Jul 30, 2014 at 11:45 AM, Gaurav Gupta wrote: > Hi, > > I am using CHD5 (Hadoop 2.3.0-cdh5.0.0) as my Hadoop Distro. I am using > Fair Scheduler. I am requesting for two containers on a particular host, > but

Allocating Containers on a particular Node in Yarn

Hi, I am using CHD5 (Hadoop 2.3.0-cdh5.0.0) as my Hadoop Distro. I am using Fair Scheduler. I am requesting for two containers on a particular host, but I don't get any container back. Here are the container requests Requested container: Capability[]Priority[0] Requested container: Capability[]Pr

Re: Performance on singlenode and multinode hadoop

Thank you Harsh , I have a look on this and get back . On 29 Jul 2014, at 18:56, Harsh J wrote: > It isn't the DataNode that does the compute spawn/work, but the TaskTracker. > > If you wanted to increase MR parallelism on a single machine, you do > not need two DNs, nor two TTs, just higher

Master /slave file configuration for multiple datanodes on same machine

Hello friends , I have set up multiple datanodes on same machine following the link http://mail-archives.apache.org/mod_mbox/hadoop-common-user/201009.mbox/ So now i have conf and conf2 both in my hadoop directory. How should master and slave files of conf and conf2 look like if i want conf to

Re: How to specify the job to run on the specific nodes(machines) in the hadoop yarn cluster?

https://issues.apache.org/jira/browse/YARN-796 Not yet released, so this is not yet supported. On Wed, Jul 30, 2014 at 2:34 AM, adu wrote: > Hi all, > RT. I want to run a job on specific two nodes in the cluster? How to > configure the yarn? Dose yarn queue help? > > Thanks > > > -- CONFIDEN

How to specify the job to run on the specific nodes(machines) in the hadoop yarn cluster?

Hi all, RT. I want to run a job on specific two nodes in the cluster? How to configure the yarn? Dose yarn queue help? Thanks