Intermediate results can be stored in hdfs on the EC2 machines, or in S3
using s3n... performance is better if you store on hdfs:
"-input",
"s3n://elasticmapreduce/samples/similarity/lastfm/input/",
"-output", "hdfs:///home/hadoop/output2/",
On Mon, Apr 6, 2009 at 11:27 AM, Patrick A. <patrickange...@gmail.com>wrote:
>
> Are intermediate results stored in S3 as well?
>
> Also, any plans to support HTable?
>
>
>
> Chris K Wensel-2 wrote:
> >
> >
> > FYI
> >
> > Amazons new Hadoop offering:
> > http://aws.amazon.com/elasticmapreduce/
> >
> > And Cascading 1.0 supports it:
> > http://www.cascading.org/2009/04/amazon-elastic-mapreduce.html
> >
> > cheers,
> > ckw
> >
> > --
> > Chris K Wensel
> > ch...@wensel.net
> > http://www.cascading.org/
> > http://www.scaleunlimited.com/
> >
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/Amazon-Elastic-MapReduce-tp22842658p22911128.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
>
--
Peter N. Skomoroch
617.285.8348
http://www.datawrangling.com
http://delicious.com/pskomoroch
http://twitter.com/peteskomoroch
