Yi Pan (Data Infrastructure) created SAMZA-484:
--------------------------------------------------

             Summary: Define the serialization/deserialization format for 
stream tuple
                 Key: SAMZA-484
                 URL: https://issues.apache.org/jira/browse/SAMZA-484
             Project: Samza
          Issue Type: Sub-task
            Reporter: Yi Pan (Data Infrastructure)
            Priority: Minor


It came out in the discussion for streaming SQL that we will need to define the 
serialization/deserialization format for stream tuple.

The ideal serialization/deserialization format should allow both forward and 
backward compatibility on additional/missing fields in the data.

Several choices to be considered:
1) Avro
2) Protobuf
3) Flatbuffer

It might also be interesting to consider a pluggable serialization interface 
that allows different serialization methods for different Samza jobs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to