On Apr 15, 2009, at 3:16 PM, Grant Ingersoll wrote:
On Apr 15, 2009, at 2:54 PM, Stephen Green wrote:
On Apr 15, 2009, at 2:19 PM, Jeff Eastman wrote:
None of the clustering implementations hard code the filesystem.
The file names are constructed from the input and output filepath
arguments.
This is what I saw as well.
Grant Ingersoll wrote:
I seem to recall this being something you have to set in your
Hadoop configuration. Or, let me double check that we aren't
hard-coding the FS in our Job.
I'm pretty sure that the configuration on EMR allows this, as the
job has no problem reading from the s3n input data.
Can you share your Hadoop configuration? i.e. the contents of the
conf directory? You might actually have some luck asking this
question on core-users over at Hadoop.
Well, Amazon controls the configuration, but I could probably log into
the master while it's running and pull it out.
Steve
--
Stephen Green // [email protected]
Principal Investigator \\ http://blogs.sun.com/searchguy
Aura Project // Voice: +1 781-442-0926
Sun Microsystems Labs \\ Fax: +1 781-442-1692
