Re: What is the NEW api?

2012-03-11 Thread Mike Spreitzer
As far as I know, the new API is the stuff in the Java package named org.apache.hadoop.mapreduce, while the old API is in org.apache.hadoop.mapred. And, just to keep you on your toes, I am told the new API is deprecated, it is the old API that is currently favored. Regards, Mike

Re: Hadoop pain points?

2012-03-02 Thread Mike Spreitzer
Interesting question. Do you want to be asking those who use Hadoop --- or those who find it too painful to use? Regards, Mike From: Kunaal To: common-user@hadoop.apache.org Date: 03/02/2012 11:23 AM Subject:Hadoop pain points? Sent by:kunaalbha...@gmail.com I am d

Re: Running a job continuously

2011-12-05 Thread Mike Spreitzer
Burak, Before we can really answer your question, you need to give us some more information on the processing you want to do. Do you want output that is continuous or batched (if so, how)? How should the output at a given time be related to the input up to then and the previous outputs? Regar

Re: Matrix multiplication in Hadoop

2011-11-22 Thread Mike Spreitzer
I am looking at large dense matrix multiplication as an example problem for a class of middleware. I am also interested in sparse matrices, but am taking things one step at a time. There is a paper in IEEE CloudCom '10 about Hama, including a matrix multiplication technique. It is essentially

RE: Matrix multiplication in Hadoop

2011-11-18 Thread Mike Spreitzer
Well, this mismatch may tell me something interesting about Hadoop. Matrix multiplication has a lot of inherent parallelism, so from very crude considerations it is not obvious that there should be a mismatch. Why is matrix multiplication ill-suited for Hadoop? BTW, I looked into the Mahout do

Re: Matrix multiplication in Hadoop

2011-11-18 Thread Mike Spreitzer
That's also an interesting question, but right now I am studying Hadoop and want to know how well dense MM can be done in Hadoop. Thanks, Mike From: Michel Segel To: "common-user@hadoop.apache.org" Date: 11/18/2011 12:34 PM Subject:Re: Matrix multiplication in Hadoop Is Ha

Matrix multiplication in Hadoop

2011-11-18 Thread Mike Spreitzer
Who is doing multiplication of large dense matrices using Hadoop? What is a good way to do that computation using Hadoop? Thanks, Mike

Re: Hadoop not working after replacing hadoop-core.jar with hadoop-core-append.jar

2011-06-06 Thread Mike Spreitzer
My latest information (not from me, from actual experts) says it is NOT the right approach. Look further into that discussion thread. I do not understand why (http://hbase.apache.org/notsoquick.html#hadoop) still points at that misleading message. Regards, Mike Spreitzer From