StephanEwen commented on issue #10358: [FLINK-14346] [serialization] faster implementation of StringValue writeString and readString URL: https://github.com/apache/flink/pull/10358#issuecomment-561582129 Some thoughts for follow-up: - Do you know where exactly the performance difference comes from? Is it mainly the many individual `read()` single byte operations, that get more efficient if you bulk get into a byte array? - We can actually break the serialization format, as long as we change the StringSerializer config snapshot and restore methods. We can return "needs conversion" as the compatibility and return a serializer with the old encoding as the restore serializer. - Thinking twice, the above would only work if all parts support serializer evoluation, and I think keys in RocksDB cannot be evolved right now (not yet implemented).
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
