Re: Avro

2012-08-05 Thread Nitin Kesarwani
Mohit,

You can use this patch to suit your need:
https://issues.apache.org/jira/browse/PIG-2579

New fields in Avro schema descriptor file need to have a non-null default
value. Hence, using the new schema file, you should be able to read older
data as well. Try it out. It is very straight forward.

Hope this helps!

On Sun, Aug 5, 2012 at 12:01 AM, Mohit Anchlia mohitanch...@gmail.com wrote:

I've heard that Avro provides a good way of dealing with changing schemas.
 I am not sure how it could be done without keeping some kind of structure
 along with the data. Are there any good examples and documentation that I
 can look at?


-N


Re: Avro

2012-08-05 Thread Mohit Anchlia
On Sat, Aug 4, 2012 at 11:43 PM, Nitin Kesarwani bumble@gmail.comwrote:

 Mohit,

 You can use this patch to suit your need:
 https://issues.apache.org/jira/browse/PIG-2579

 New fields in Avro schema descriptor file need to have a non-null default
 value. Hence, using the new schema file, you should be able to read older
 data as well. Try it out. It is very straight forward.

 Hope this helps!


Thanks! I am new to Avro what's the best place to see some examples of how
Avro deals with schema changes? I am trying to find some examples.


 On Sun, Aug 5, 2012 at 12:01 AM, Mohit Anchlia mohitanch...@gmail.com
 wrote:

 I've heard that Avro provides a good way of dealing with changing schemas.
  I am not sure how it could be done without keeping some kind of structure
  along with the data. Are there any good examples and documentation that I
  can look at?
 

 -N