Nico Kruber created FLINK-9797:
----------------------------------

             Summary: Separate state serializers from network serializers
                 Key: FLINK-9797
                 URL: https://issues.apache.org/jira/browse/FLINK-9797
             Project: Flink
          Issue Type: Improvement
          Components: Type Serialization System
            Reporter: Nico Kruber


State serializers need to maintain backwards compatibility and therefore the 
format cannot be changed that easily and this is honoured by the classes around 
{{TypeInformation}}. However, currently the same {{TypeInformation}} is being 
used in the network stack where data is serialized between two operators during 
shuffles and so. There, however, we do not need backwards compatibility and 
could easily change the format and have more performant code, e.g. use custom 
serializers for Java collections (not going through Kryo), etc.

I propose to separate these two (this is probably a bigger task since it is 
quite invasive).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to