Hi,
@Dawid yes each state is compressed separately as with keyed state. I'll
add this precision to the FLIP.
Best
Etienne
Le 18/01/2023 à 13:55, Dawid Wysakowicz a écrit :
It makes sense from my side.
Could you, just for completeness, extend it with the info what will be
the compression unit? If understand it correctly you envision each
state to be compressed separately.
Best,
Dawid
On 17/01/2023 15:47, Etienne Chauchot wrote:
Hi everyone,
I just published a new FLIP to introduce operator state compression
(1). This feature is pretty straightforward to implement, so a PR is
already under review (2) but it appeared during the review that to be
able to insure backward compatibility of the operator state
snapshots, we needed to modify the snapshot format hence the FLIP.
Please tell me if you have any thoughts about it.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-290+Operator+state+compression
[2] https://github.com/apache/flink/pull/21636
Best,
Etienne
