Thank you, Tom. Forgive me for being dense, but I don't understand your reply:
> If you make the default filesystem S3 then you can't run HDFS daemons. > If you want to run HDFS and use an S3 filesystem, you need to make the > default filesystem a hdfs URI, and use s3 URIs to reference S3 > filesystems. Do you mean that it is possible to use the Hadoop daemons with S3 but the default filesystem must be HDFS? If that is the case, can I specify the output filesystem on a per-job basis and can that be an S3 FS? Also, is there a particular reason to not allow S3 as the default FS? Thanks so much for your time! -lincoln -- lincolnritter.com On Thu, Jul 10, 2008 at 1:55 PM, Tom White <[EMAIL PROTECTED]> wrote: >> I get (where the all-caps portions are the actual values...): >> >> 2008-07-01 19:05:17,540 ERROR org.apache.hadoop.dfs.NameNode: >> java.lang.NumberFormatException: For input string: >> "[EMAIL PROTECTED]" >> at >> java.lang.NumberFormatException.forInputString(NumberFormatException.java:48) >> at java.lang.Integer.parseInt(Integer.java:447) >> at java.lang.Integer.parseInt(Integer.java:497) >> at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:128) >> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:121) >> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178) >> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164) >> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:848) >> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:857) >> >> These exceptions are taken from the namenode log. The datanode logs >> show the same exceptions. > > If you make the default filesystem S3 then you can't run HDFS daemons. > If you want to run HDFS and use an S3 filesystem, you need to make the > default filesystem a hdfs URI, and use s3 URIs to reference S3 > filesystems. > > Hope this helps. > > Tom >
