You need to create two sets of Hadoop configurations and deploy them to the
correct nodes.
Yarn was supposed to be the way to heterogenous clusters.
But this begs the question. Why on earth did you have a 32 bit cluster to begin
with?
On Sep 16, 2014, at 1:13 AM, Esteban Gutierrez
Why 32 bit? Because it was a cheaper and more suitable option when we set
up the cluster.
Btw. we've added the 64-bit machines to the 32-bit cluster and everything
survived - HBase 0.94.
Here's a graph showing just disk utilization and the 2 new nodes joining
the cluster and gradually taking
Well, many HBase internal limits are based on the architecture so that
should impact you right away in resource utilization in the RSs, so a heap
or a setting that worked fine for your 32-bit RSs might need to be tuned
for a 64-bit environment. Probably might be easier to run a 32-bit JVM in
the
Hi Esteban,
Sorry, I meant to point that out in my original email - yeah, heap sizes,
Xmx, and such will be different for 32-bit and 64-bit servers, but I was
wondering if there is anything in HBase that could complain if, say, a
region written on a 32-bit server moves to a 64-bit server or
Only where we touch the native Hadoop libraries I think. If you have
specified compression implemented with a Hadoop native library, like
snappy or lzo, and have forgotten to deploy 64 bit native libraries,
and move to this 64 bit environment, you won't be able to open the
affected table(s) until
Do we have kind of native compression in PB? Or not at all? Because if so,
it might be an issue.
I run a 0.94 cluster with a mix of 32 and 64 with Snappy enabled. But never
tried 0.96 or more on it...
2014-09-15 18:36 GMT-04:00 Andrew Purtell apurt...@apache.org:
Only where we touch the native
bq. Do we have kind of native compression in PB?
I don't think so.
On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari
jean-m...@spaggiari.org wrote:
Do we have kind of native compression in PB? Or not at all? Because if so,
it might be an issue.
I run a 0.94 cluster with a mix of 32 and
On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari
jean-m...@spaggiari.org wrote:
Do we have kind of native compression in PB?
Protobufs has its own encodings, the Java language bindings implement
them in Java.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by
