[jira] [Created] (FLINK-3084) File State Backend should not write very small state into files

[Stephan Ewen (JIRA)]

Stephan Ewen created FLINK-3084:
-----------------------------------

             Summary: File State Backend should not write very small state into 
files
                 Key: FLINK-3084
                 URL: https://issues.apache.org/jira/browse/FLINK-3084
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
    Affects Versions: 0.10.0
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.0.0


Currently, the {{FsStateBackend}} writes all state into files. Some state (like 
Kafka Offsets) is so small that it adds unnecessary overhead, and sometimes the 
checkpointed file handles are larger than the actual state.

Small state (below a certain threshold, say 1 KB) should not be stored in 
files, but directly in the state handles.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)