Re: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread daemeon reiydelle
:* Alexander Alten-Lorenz [mailto:wget.n...@gmail.com] *Sent:* Monday, February 02, 2015 3:07 PM *To:* user@hadoop.apache.org *Cc:* Harun Rešit Zafer *Subject:* Re: Multiple separate Hadoop clusters on same physical machines http://blog.sequenceiq.com/blog/2014/06/19/multinode-hadoop-cluster

RE: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread Ashish Kumar9
ViSolve Inc.|www.visolve.com From: Alexander Pivovarov [mailto:apivova...@gmail.com] Sent: Monday, February 02, 2015 12:56 PM To: user@hadoop.apache.org Subject: Re: Multiple separate Hadoop clusters on same physical machines start several vms and install hadoop on each vm keywords: kvm, QEMU

Re: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread Alexander Alten-Lorenz
.|www.visolve.com http://www.visolve.com/ From: Alexander Pivovarov [mailto:apivova...@gmail.com mailto:apivova...@gmail.com] Sent: Monday, February 02, 2015 12:56 PM To: user@hadoop.apache.org Subject: Re: Multiple separate Hadoop clusters on same physical machines start several vms

RE: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread Hadoop Support
To: user@hadoop.apache.org Cc: Harun Rešit Zafer Subject: Re: Multiple separate Hadoop clusters on same physical machines http://blog.sequenceiq.com/blog/2014/06/19/multinode-hadoop-cluster-on-docker/ Ambari based, but works quite well On 02 Feb 2015, at 10:33, Ashish Kumar9 ashis

RE: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread hadoop.support
.| http://www.visolve.com www.visolve.com From: Alexander Pivovarov [mailto:apivova...@gmail.com] Sent: Monday, February 02, 2015 12:56 PM To: user@hadoop.apache.org Subject: Re: Multiple separate Hadoop clusters on same physical machines start several vms and install hadoop on each

Re: Multiple separate Hadoop clusters on same physical machines

2015-02-01 Thread daemeon reiydelle
Make virtualization an option. Federation will NOT solve your problems. *...* *“Life should not be a journey to the grave with the intention of arriving safely in apretty and well preserved body, but rather to skid in broadside in a cloud of smoke,thoroughly used up, totally worn out,

Re: Multiple separate Hadoop clusters on same physical machines

2015-02-01 Thread Alexander Alten-Lorenz
I see no possibility how federation may help to have different Clusters on _same_ machines. On top, federation isn’t production ready, since the NN can have massively issues with GC on high loaded systems, which will be the case here. To have multiple, maybe single node, clusters the best way

Re: Multiple separate Hadoop clusters on same physical machines

2015-02-01 Thread Alexander Pivovarov
start several vms and install hadoop on each vm keywords: kvm, QEMU On Mon, Jan 26, 2015 at 1:18 AM, Harun Reşit Zafer harun.za...@tubitak.gov.tr wrote: Hi everyone, We have set up and been playing with Hadoop 1.2.x and its friends (Hbase, pig, hive etc.) on 7 physical servers. We want to

Multiple separate Hadoop clusters on same physical machines

2015-01-26 Thread Harun Reşit Zafer
Hi everyone, We have set up and been playing with Hadoop 1.2.x and its friends (Hbase, pig, hive etc.) on 7 physical servers. We want to test Hadoop (maybe different versions) and ecosystem on physical machines (virtualization is not an option) from different perspectives. As a bunch of

Re: Multiple separate Hadoop clusters on same physical machines

2015-01-26 Thread Azuryy Yu
Hi, I think the best way is deploy HDFS federation with Hadoop 2.x. On Mon, Jan 26, 2015 at 5:18 PM, Harun Reşit Zafer harun.za...@tubitak.gov.tr wrote: Hi everyone, We have set up and been playing with Hadoop 1.2.x and its friends (Hbase, pig, hive etc.) on 7 physical servers. We want to