On Wed, Feb 17, 2010 at 1:46 PM, Markus Weimer <mar...@weimo.de> wrote: > > Is the structure of the files you create on hdfs the same as that of the > files created using the routines shipped with Avro? E.g. could I create > files on the grid, download them and open them locally?
Yes, the Avro api is used to read or write files regardless of whether they are written locally or on hdfs, so I don't see a problem doing what you suggest. You just need to make sure you're telling avro to use the right class/schema on each end. Take a look at o.a.m.avro.AvroWriterReaderTest int src/test/java for an example how to read and write files from a local filesystem outside of the context of a mapreduce job. Drew
