Hi All,
I am using hadoop cluster with active directory setup , where I
have usernames with spaces ex . AB CD can I run MR jobs will there be any
issues ?
--
Warm Regards,
*Bharath Kumar *
Hi Smita,
Can you please inform abt the following :
1. Which version of Hadoop ?
2. Linux Container Executor with DRC and "CgroupsLCEResourcesHandler" is being
configured ?
3. if its against the trunk code, have you configured for
"yarn.nodemanager.linux-container-executor.cgroups.strict-resource
From: Smita Deshpande
Sent: Wednesday, November 05, 2014 10:52 AM
To: user@hadoop.apache.org
Subject: CPU usage of a container.
Hi All,
I am facing sort of a weird issue in YARN. I am running a
single container on a cluster whose cpu configuration is as follows:
Try docker!
http://ferry.opencore.io/en/latest/examples/hadoop.html
On Tue, Nov 4, 2014 at 6:36 PM, jay vyas
wrote:
> Hi daemon: Actually, for most folks who would want to actually use a
> hadoop cluster, i would think setting up bigtop is super easy ! If you
> have issues with it ping me a
Hi daemon: Actually, for most folks who would want to actually use a
hadoop cluster, i would think setting up bigtop is super easy ! If you
have issues with it ping me and I can help you get started.
Also, we have docker containers - so you dont even *need* a VM to run a 4
or 5 node hadoop cluste
Hi Fabio,
To answer your questions:
1)
CS (capacity-scheduler) will do allocation from root to leaf, level by
level, and for queues with same parent, will do allocation in following way:
First will allocate queue with least used resource
If queues with same used resource, say root.qA used 1G, root.
What you want as a sandbox depends on what you are trying to learn.
If you are trying to learn to code in e.g PigLatin, Sqooz, or similar, all
of the suggestions (perhaps excluding BigTop due to its setup complexities)
are great. Laptop? perhaps but laptop's are really kind of infuriatingly
slow (
you can try the pivotal vm as well.
http://pivotalhd.docs.pivotal.io/tutorial/getting-started/pivotalhd-vm.html
On Tue, Nov 4, 2014 at 3:13 PM, Leonid Fedotov
wrote:
> Tim,
> download Sandbox from http://hortonworks/com
> You will have everything needed in a small VM instance which will run on
Or on your local laptop or desktop you can setup the env using VM and VM
image of Hadoop and related components. Wrote instructions sometime back
here
https://www.linkedin.com/today/post/article/20140924133831-2560863-new-to-hadoop-and-want-to-setup-dev-environment
On Nov 5, 2014 2:25 AM, "Jim Cole
Hello Tim,
Horton and Cloudera both offer VM’s (Including Virtual box, which is free) you
can pull down to play with, if you’re looking just for something small to get
you started. i’m partial to the horton works one myself.
Hope that help.
JC
> On Nov 4, 2014, at 2:28 PM, Tim Dunphy w
Tim,
download Sandbox from http://hortonworks/com
You will have everything needed in a small VM instance which will run on
your home desktop.
*Thank you!*
*Sincerely,*
*Leonid Fedotov*
Systems Architect - Professional Services
lfedo...@hortonworks.com
office: +1 855 846 7866 ext 292
mobile
Hi tim. Id suggest using apache bigtop for this.
BigTop integrates the hadoop ecosystem into a single upstream distribution,
packages everything, curates smoke tests, vagrant, docker recipes for
deployment.
Also, we curate a blueprint hadoop application (bigpetstore) which you
build yourself, eas
Hi All,
When I query on larger datasets job is failing due to below issue
2014-11-03 13:40:15,279 INFO datanode.DataNode - Exception for
BP-1442477155-10.28.12.10-1391025835784:blk_1096748808_1099611172702
java.io.IOException: Premature EOF from inputStream
at org.apache.hadoop.io.IOUtils.readFu
Hey all,
I want to setup an environment where I can teach myself hadoop. Usually
the way I'll handle this is to grab a machine off the Amazon free tier and
setup whatever software I want.
However I realize that Hadoop is a memory intensive, big data solution. So
what I'm wondering is, would a t2
14 matches
Mail list logo