Re: Hadoop is for whom? Data architect or Java Architect or All

On 27/01/11 07:28, Manuel Meßner wrote: Hi, you may want to take a look into the streaming api, which allows users to write there map-reduce jobs with any language, which is capable of writing to stdout and reading from stdin. http://hadoop.apache.org/mapreduce/docs/current/streaming.html

Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

Hi Koji, thanks for sharing the information, Is the 0.20-security branch planned to be a official release at some point ? Cheers -- Renaud Delbru On 27/01/11 01:50, Koji Noguchi wrote: Hi Renaud, Hopefully it’ll be in 0.20-security branch that Arun is trying to push. Related (very abstract)

Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

On 27/01/11 10:51, Renaud Delbru wrote: Hi Koji, thanks for sharing the information, Is the 0.20-security branch planned to be a official release at some point ? Cheers If you can play with the beta you can see that it works for you and if not, get bugs fixed during the beta cycle

Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2

Thanks, we will try to test it next week. -- Renaud Delbru On 27/01/11 11:31, Steve Loughran wrote: On 27/01/11 10:51, Renaud Delbru wrote: Hi Koji, thanks for sharing the information, Is the 0.20-security branch planned to be a official release at some point ? Cheers If you can play with

Re: Hadoop is for whom? Data architect or Java Architect or All

On Thu, Jan 27, 2011 at 5:42 AM, Steve Loughran ste...@apache.org wrote: On 27/01/11 07:28, Manuel Meßner wrote: Hi, you may want to take a look into the streaming api, which allows users to write there map-reduce jobs with any language, which is capable of writing to stdout and reading

Re: Cannot copy files to HDFS

Hi, Your data Node is not up.. please run jps command to check all required daemons are running. you can refer http://www.hadoop-tutorial.blogspot.com/ -- *Regards*, Rahul Patodi Software Engineer, Impetus Infotech (India) Pvt Ltd, www.impetus.com Mob:09907074413

Re: Hadoop is for whom? Data architect or Java Architect or All

Hi Manoranjan, While knowing Java will help you better use more of the features of Hadoop and process the data more efficiently, I have worked in a situation where we used Hadoop without touching any Java code at all. We needed to utilise our legacy Perl code in our Map-Reduce jobs and simply

Re: Hadoop is for whom? Data architect or Java Architect or All

unsubscribe On Wed, Jan 26, 2011 at 8:43 AM, manoranjand manoranj...@rediffmail.comwrote: Hi- I have a basic question. Appologies for my ignorance, but is hadoop a mis-fit for a data architect with zero java knowledge? -- View this message in context:

Thread safety issues with JNI/native code from map tasks?

I am seeing very perplexing segfaults and standard allocation exceptions in my native code (.so files passed to the distributed cace) which is called via JNI from the map task. This code runs perfectly fine (on the same data) outside Hadoop. Even when run in a Hadoop standalone mode (no

Too small initial heap problem.

Hi, I have 9 cluster (1 master, 8 slaves) to run a hadoop. when I executed my job in a master, I got the following errors. 11/01/28 10:58:01 INFO mapred.JobClient: Running job: job_201101271451_0011 11/01/28 10:58:02 INFO mapred.JobClient: map 0% reduce 0% 11/01/28 10:58:08 INFO

Re: Too small initial heap problem.

-Xmx1024 This would be 1024 bytes heap. Maybe you want -Xmx1024m ? Koji On 1/27/11 6:04 PM, Jun Young Kim juneng...@gmail.com wrote: Hi, I have 9 cluster (1 master, 8 slaves) to run a hadoop. when I executed my job in a master, I got the following errors. 11/01/28 10:58:01 INFO