Re: Which release to use?

2011-07-19 Thread Rita
Arun, I second Joeś comment. Thanks for giving us a heads up. I will wait patiently until 0.23 is considered stable. On Mon, Jul 18, 2011 at 11:19 PM, Joe Stein charmal...@allthingshadoop.comwrote: Arun, Thanks for the update. Again, I hate to have to play the part of captain obvious.

Re: Which release to use?

2011-07-19 Thread Steve Loughran
On 19/07/11 12:44, Rita wrote: Arun, I second Joeś comment. Thanks for giving us a heads up. I will wait patiently until 0.23 is considered stable. API-wise, 0.21 is better. I know that as I'm working with 0.20.203 right now, and it is a step backwards. Regarding future releases, the best

RE: Hadoop upgrade Java version

2011-07-19 Thread Michael Segel
Yeah... you can do that... I haven't tried to mix/match different releases within a cluster, although I suspect I could without any problems, but I don't want to risk it. Until we have a problem, or until we expand our clouds with a batch of new nodes, I like to follow the mantra... if it

Re: Which release to use?

2011-07-19 Thread Vitalii Tymchyshyn
19.07.11 14:50, Steve Loughran написав(ла): On 19/07/11 12:44, Rita wrote: Arun, I second Joeś comment. Thanks for giving us a heads up. I will wait patiently until 0.23 is considered stable. API-wise, 0.21 is better. I know that as I'm working with 0.20.203 right now, and it is a step

RE: Hadoop Discrete Event Simulator

2011-07-19 Thread Jeff.Schmitz
Maneesh, You may want to check this out https://issues.apache.org/jira/browse/HADOOP-5005 -Original Message- From: maneesh varshney [mailto:mvarsh...@gmail.com] Sent: Monday, July 18, 2011 8:09 PM To: common-user@hadoop.apache.org Subject: Hadoop Discrete Event Simulator Hello,

RE: Hadoop upgrade Java version

2011-07-19 Thread Jeff.Schmitz
I am using this java version 1.6.0_15 Java(TM) SE Runtime Environment (build 1.6.0_15-b03) Java HotSpot(TM) 64-Bit Server VM (build 14.1-b02, mixed mode) With latest release and it works fine - Cheers - JGS -Original Message- From: highpointe [mailto:highpoint...@gmail.com] Sent:

RE: Hadoop upgrade Java version

2011-07-19 Thread Isaac Dooley
_24 seems to work fine on my cluster.

How would you translate this into MapReduce?

2011-07-19 Thread Em
Hello list, sorry, sent this email to the wrong list, I think (MapReduce-list had *no* activity the last whole day?). As a newbie I got a tricky use-case in mind which I want to implement with Hadoop to train my skillz. There is no real scenario behind that, so I can extend or shrink the problem

localhost permission denied

2011-07-19 Thread Kobina Kwarko
Hello, Please any assistance?? I am using Hadoop for a school project and managed to install it on two computers testing with the wordcount example. However, after stopping Hadoop and restarting the computers (Ubuntu Server 10.10) I am getting the following error: root@localhost's password:

Re: localhost permission denied

2011-07-19 Thread John Armstrong
On Tue, 19 Jul 2011 20:47:31 +0100, Kobina Kwarko kobina.kwa...@gmail.com wrote: Hello, Please any assistance?? I am using Hadoop for a school project and managed to install it on two computers testing with the wordcount example. However, after stopping Hadoop and restarting the computers

RE: localhost permission denied

2011-07-19 Thread Jeff.Schmitz
Your SSH isn't setup properly Setup passphraseless ssh Now check that you can ssh to the localhost without a passphrase: $ ssh localhost If you cannot ssh to localhost without a passphrase, execute the following commands: $ ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa $ cat ~/.ssh/id_dsa.pub

Re: localhost permission denied

2011-07-19 Thread Kobina Kwarko
That is the strangest part, I never set it up as as root, this root just came with the error. I have a dedicated hadoop user that I'm using, it worked fine the first time and I tested it with the word count example which produced the expected result but when I restarted the computers this error

Re: localhost permission denied

2011-07-19 Thread Kobina Kwarko
I can ssh into locahost, even the hadoop user can ssh into localhost without any error when I try starting hadoop it then that error comes. On 19 July 2011 20:54, jeff.schm...@shell.com wrote: Your SSH isn't setup properly Setup passphraseless ssh Now check that you can ssh to the localhost

IO pipeline optimizations

2011-07-19 Thread Shrinivas Joshi
This blog post on YDN website http://developer.yahoo.com/blogs/hadoop/posts/2009/08/the_anatomy_of_hadoop_io_pipel/has detailed discussion on different steps involved in Hadoop IO operations and opportunities for optimizations. Could someone please comment on current state of these potential

Re: IO pipeline optimizations

2011-07-19 Thread Todd Lipcon
Hi Shrinivas, There has been some work going on recently around optimizing checksums. See HDFS-2080 for example. This will help both the write and read code, though we've focused more on read. There have also been a lot of improvements around random read access - for example HDFS-941 which

Job progress not showing in Hadoop Tasktracker web interface

2011-07-19 Thread foo_foo_foo
I am a Hadoop novice so kindly pardon my ingorance. I am running the following Hadoop program in Fully Distributed Mode to count the number of lines in a file. I am running this job from eclipse and I see it running (based on the output to the eclipse console) but I do not see the tasks in the

RE: Job progress not showing in Hadoop Tasktracker web interface

2011-07-19 Thread Teng, James
You can't run a hadoop job in eclipse, you have to set up an environment on linux system. Maybe you can try to install it on WMware linux system and run the job in pseudo-distributed system. James, Teng (Teng Linxiao) eRL, CDC,eBay,Shanghai Extension:86-21-28913530 MSN:

Re: Job progress not showing in Hadoop Tasktracker web interface

2011-07-19 Thread Harsh J
Looks like it may be running in the local mode. Have you setup your Eclipse configuration properly? What version of Hadoop are you using? On Wed, Jul 20, 2011 at 7:35 AM, foo_foo_foo finallya...@gmail.com wrote: I am a Hadoop novice so kindly pardon my ingorance. I am running the following