Chukwa needs a cross language serialization/RPC framework. During demux, being able to create dynamically the schema based on the recordType will be a big plus instead of using an hardcoded one, The projection feature will also be useful.
+1 /Jerome. On 4/2/09 3:05 PM, "Doug Cutting" <[email protected]> wrote: I propose we add a new Hadoop subproject for Avro, a serialization system. My ambition is for Avro to replace both Hadoop's RPC and to be used for most Hadoop data files, e.g., by Pig, Hive, etc. Initial committers would be Sharad Agarwal and me, both existing Hadoop committers. We are the sole authors of this software to date. The code is currently at: http://people.apache.org/~cutting/avro.git/ To learn more: git clone http://people.apache.org/~cutting/avro.git/ avro cat avro/README.txt Comments? Questions? Doug
