Re: Amazon Elastic MapReduce

2009-04-06 Thread Peter Skomoroch
op offering: > > http://aws.amazon.com/elasticmapreduce/ > > > > And Cascading 1.0 supports it: > > http://www.cascading.org/2009/04/amazon-elastic-mapreduce.html > > > > cheers, > > ckw > > > > -- > > Chris K Wensel > > ch...@wense

Re: Amazon Elastic MapReduce

2009-04-06 Thread Patrick A.
.org/2009/04/amazon-elastic-mapreduce.html > > cheers, > ckw > > -- > Chris K Wensel > ch...@wensel.net > http://www.cascading.org/ > http://www.scaleunlimited.com/ > > > -- View this message in context: http://www.nabble.com/Amazon-Elastic-MapReduce-tp22842658p22911

RE: Amazon Elastic MapReduce

2009-04-03 Thread Ricky Ho
iring them to learn all the admin aspects of Hadoop, which becomes a hurdle for them to move fast. Rgds, Ricky -Original Message- From: Steve Loughran [mailto:ste...@apache.org] Sent: Friday, April 03, 2009 2:19 AM To: core-user@hadoop.apache.org Subject: Re: Amazon Elastic MapReduce

Re: Amazon Elastic MapReduce

2009-04-03 Thread Lukáš Vlček
I may be wrong but I would welcome this. As far as I understand the hot topic in cloud computing these days is standardization ... and I would be happy if Hadoop could be considered as a standard for cloud computing architecture. So the more Amazon pushes Hadoop the more it could be accepted by oth

Re: Amazon Elastic MapReduce

2009-04-03 Thread Stuart Sierra
On Thu, Apr 2, 2009 at 4:13 AM, zhang jianfeng wrote: > seems like I should pay for additional money, so why not configure a hadoop > cluster in EC2 by myself. This already have been automatic using script. Personally, I'm excited about this. They're charging a tiny fraction above the standard E

Re: Amazon Elastic MapReduce

2009-04-03 Thread Tim Wintle
On Fri, 2009-04-03 at 11:19 +0100, Steve Loughran wrote: > True, but this way nobody gets the opportunity to learn how to do it > themselves, which can be a tactical error one comes to regret further > down the line. By learning the pain of cluster management today, you get > to keep it under co

Re: Amazon Elastic MapReduce

2009-04-03 Thread Steve Loughran
Brian Bockelman wrote: On Apr 2, 2009, at 3:13 AM, zhang jianfeng wrote: seems like I should pay for additional money, so why not configure a hadoop cluster in EC2 by myself. This already have been automatic using script. Not everyone has a support team or an operations team or enough tim

Re: Amazon Elastic MapReduce

2009-04-02 Thread Peter Skomoroch
Kevin, The API accepts any arguments you can pass in the standard jobconf for Hadoop 18.3, it is pretty easy to convert over an existing jobflow to a JSON job description that will run on the service. -Pete On Thu, Apr 2, 2009 at 2:44 PM, Kevin Peterson wrote: > So if I understand correctly, t

Re: Amazon Elastic MapReduce

2009-04-02 Thread Kevin Peterson
So if I understand correctly, this is an automated system to bring up a hadoop cluster on EC2, import some data from S3, run a job flow, write the data back to S3, and bring down the cluster? This seems like a pretty good deal. At the pricing they are offering, unless I'm able to keep a cluster at

Re: Amazon Elastic MapReduce

2009-04-02 Thread Chris K Wensel
You should check out the new pricing. On Apr 2, 2009, at 1:13 AM, zhang jianfeng wrote: seems like I should pay for additional money, so why not configure a hadoop cluster in EC2 by myself. This already have been automatic using script. On Thu, Apr 2, 2009 at 4:09 PM, Miles Osborne

Re: Amazon Elastic MapReduce

2009-04-02 Thread Brian Bockelman
On Apr 2, 2009, at 3:13 AM, zhang jianfeng wrote: seems like I should pay for additional money, so why not configure a hadoop cluster in EC2 by myself. This already have been automatic using script. Not everyone has a support team or an operations team or enough time to learn how to d

Announcing Amazon Elastic MapReduce

2009-04-02 Thread Sirota, Peter
Dear Hadoop community, We are excited today to introduce the public beta of Amazon Elastic MapReduce, a web service that enables developers to easily and cost-effectively process vast amounts of data. It utilizes a hosted Hadoop (0.18.3) running on the web-scale infrastructure of Amazon

Re: Amazon Elastic MapReduce

2009-04-02 Thread zhang jianfeng
seems like I should pay for additional money, so why not configure a hadoop cluster in EC2 by myself. This already have been automatic using script. On Thu, Apr 2, 2009 at 4:09 PM, Miles Osborne wrote: > ... and only in the US > > Miles > > 2009/4/2 zhang jianfeng : > > Does it support pig ?

Re: Amazon Elastic MapReduce

2009-04-02 Thread Miles Osborne
... and only in the US Miles 2009/4/2 zhang jianfeng : > Does it support pig ? > > > On Thu, Apr 2, 2009 at 3:47 PM, Chris K Wensel wrote: > >> >> FYI >> >> Amazons new Hadoop offering: >> http://aws.amazon.com/elasticmapreduce/ >> >> And Cascading 1.0 supports it: >> http://www.cascading.org/20

Re: Amazon Elastic MapReduce

2009-04-02 Thread zhang jianfeng
Does it support pig ? On Thu, Apr 2, 2009 at 3:47 PM, Chris K Wensel wrote: > > FYI > > Amazons new Hadoop offering: > http://aws.amazon.com/elasticmapreduce/ > > And Cascading 1.0 supports it: > http://www.cascading.org/2009/04/amazon-elastic-mapreduce.html > > cheers, > ckw > > -- > Chris K W

Amazon Elastic MapReduce

2009-04-02 Thread Chris K Wensel
FYI Amazons new Hadoop offering: http://aws.amazon.com/elasticmapreduce/ And Cascading 1.0 supports it: http://www.cascading.org/2009/04/amazon-elastic-mapreduce.html cheers, ckw -- Chris K Wensel ch...@wensel.net http://www.cascading.org/ http://www.scaleunlimited.com/