Hello happy Hopper, Now that we're closing in on a 1.0 it's time to start thinking about the road ahead. The work done on the Avro data type made me consider different ways of handling encapsulated data. With encapsulated data I mean records or even complete data sets which are stored in a single format like an Avro Record, Protobuf message, JSON or XML (there are others).
Personally I think that we have an opportunity to simplify things a bit with respect to the encoding and decoding of encapsulated data. - Standard data types for all popular encapsulation methods - Standard encoding and decoding methods from/to Hop primitives On top of this it makes sense to start thinking about the standardisation of file reading and writing for the various formats and also the way that these files and even records are compressed (or encoded). As a first step in this process I thought I'd ask for your opinions and thoughts. Cheers, Matt
