hadoop admin user name with space

2014-11-04 Thread Bharath Kumar
Hi All, I am using hadoop cluster with active directory setup , where I have usernames with spaces ex . AB CD can I run MR jobs will there be any issues ? -- Warm Regards, *Bharath Kumar *

RE: CPU usage of a container.

2014-11-04 Thread Naganarasimha G R (Naga)
Hi Smita, Can you please inform abt the following : 1. Which version of Hadoop ? 2. Linux Container Executor with DRC and "CgroupsLCEResourcesHandler" is being configured ? 3. if its against the trunk code, have you configured for "yarn.nodemanager.linux-container-executor.cgroups.strict-resource

CPU usage of a container.

2014-11-04 Thread Smita Deshpande
From: Smita Deshpande Sent: Wednesday, November 05, 2014 10:52 AM To: user@hadoop.apache.org Subject: CPU usage of a container. Hi All, I am facing sort of a weird issue in YARN. I am running a single container on a cluster whose cpu configuration is as follows:

Re: Hadoop Learning Environment

2014-11-04 Thread Gavin Yue
Try docker! http://ferry.opencore.io/en/latest/examples/hadoop.html On Tue, Nov 4, 2014 at 6:36 PM, jay vyas wrote: > Hi daemon: Actually, for most folks who would want to actually use a > hadoop cluster, i would think setting up bigtop is super easy ! If you > have issues with it ping me a

Re: Hadoop Learning Environment

2014-11-04 Thread jay vyas
Hi daemon: Actually, for most folks who would want to actually use a hadoop cluster, i would think setting up bigtop is super easy ! If you have issues with it ping me and I can help you get started. Also, we have docker containers - so you dont even *need* a VM to run a 4 or 5 node hadoop cluste

Re: Questions about Capacity scheduler behavior

2014-11-04 Thread Wangda Tan
Hi Fabio, To answer your questions: 1) CS (capacity-scheduler) will do allocation from root to leaf, level by level, and for queues with same parent, will do allocation in following way: First will allocate queue with least used resource If queues with same used resource, say root.qA used 1G, root.

Re: Hadoop Learning Environment

2014-11-04 Thread daemeon reiydelle
What you want as a sandbox depends on what you are trying to learn. If you are trying to learn to code in e.g PigLatin, Sqooz, or similar, all of the suggestions (perhaps excluding BigTop due to its setup complexities) are great. Laptop? perhaps but laptop's are really kind of infuriatingly slow (

Re: Hadoop Learning Environment

2014-11-04 Thread oscar sumano
you can try the pivotal vm as well. http://pivotalhd.docs.pivotal.io/tutorial/getting-started/pivotalhd-vm.html On Tue, Nov 4, 2014 at 3:13 PM, Leonid Fedotov wrote: > Tim, > download Sandbox from http://hortonworks/com > You will have everything needed in a small VM instance which will run on

Re: Hadoop Learning Environment

2014-11-04 Thread Sandeep Khurana
Or on your local laptop or desktop you can setup the env using VM and VM image of Hadoop and related components. Wrote instructions sometime back here https://www.linkedin.com/today/post/article/20140924133831-2560863-new-to-hadoop-and-want-to-setup-dev-environment On Nov 5, 2014 2:25 AM, "Jim Cole

Re: Hadoop Learning Environment

2014-11-04 Thread Jim Colestock
Hello Tim, Horton and Cloudera both offer VM’s (Including Virtual box, which is free) you can pull down to play with, if you’re looking just for something small to get you started. i’m partial to the horton works one myself. Hope that help. JC > On Nov 4, 2014, at 2:28 PM, Tim Dunphy w

Re: Hadoop Learning Environment

2014-11-04 Thread Leonid Fedotov
Tim, download Sandbox from http://hortonworks/com You will have everything needed in a small VM instance which will run on your home desktop. *Thank you!* *Sincerely,* *Leonid Fedotov* Systems Architect - Professional Services lfedo...@hortonworks.com office: +1 855 846 7866 ext 292 mobile

Re: Hadoop Learning Environment

2014-11-04 Thread jay vyas
Hi tim. Id suggest using apache bigtop for this. BigTop integrates the hadoop ecosystem into a single upstream distribution, packages everything, curates smoke tests, vagrant, docker recipes for deployment. Also, we curate a blueprint hadoop application (bigpetstore) which you build yourself, eas

Job failing due to premature EOF

2014-11-04 Thread Giri P
Hi All, When I query on larger datasets job is failing due to below issue 2014-11-03 13:40:15,279 INFO datanode.DataNode - Exception for BP-1442477155-10.28.12.10-1391025835784:blk_1096748808_1099611172702 java.io.IOException: Premature EOF from inputStream at org.apache.hadoop.io.IOUtils.readFu

Hadoop Learning Environment

2014-11-04 Thread Tim Dunphy
Hey all, I want to setup an environment where I can teach myself hadoop. Usually the way I'll handle this is to grab a machine off the Amazon free tier and setup whatever software I want. However I realize that Hadoop is a memory intensive, big data solution. So what I'm wondering is, would a t2