[jira] [Commented] (FLINK-5462) Flink job fails due to java.util.concurrent.CancellationException while snapshotting

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998367#comment-15998367 ] Stefan Richter commented on FLINK-5462: --- I think this is just a followup exception of a canceled

[jira] [Commented] (FLINK-5439) Adjust max parallelism when migrating

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998363#comment-15998363 ] Stefan Richter commented on FLINK-5439: --- [~uce] I think we can close this issue? Correct me if I am

[jira] [Commented] (FLINK-5440) Misleading error message when migrating and scaling down from savepoint

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998362#comment-15998362 ] Stefan Richter commented on FLINK-5440: --- [~uce] I think we can close this issue? Correct me if I am

[jira] [Commented] (FLINK-5924) Support asynchronous checkpointing of operator state

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998356#comment-15998356 ] Stefan Richter commented on FLINK-5924: --- Was this issue about the raw (stream-written) or managed

[jira] [Commented] (FLINK-5925) Clean up extracted RocksDB JNI library

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998354#comment-15998354 ] Stefan Richter commented on FLINK-5925: --- [~till.rohrmann] is this issue still valid? > Clean up

[jira] [Assigned] (FLINK-6412) Stream has already been closed during job cancel

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6412: - Assignee: Stefan Richter > Stream has already been closed during job cancel >

[jira] [Closed] (FLINK-5051) Backwards compatibility for serializers in backend state

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5051. - Resolution: Implemented > Backwards compatibility for serializers in backend state >

[jira] [Closed] (FLINK-5041) Implement savepoint backwards compatibility 1.1 -> 1.2

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5041. - Resolution: Implemented Fix Version/s: 1.2.0 > Implement savepoint backwards compatibility

[jira] [Closed] (FLINK-6048) Asynchronous snapshots for heap-based operator state backends

2017-05-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6048. - Resolution: Implemented > Asynchronous snapshots for heap-based operator state backends >

[jira] [Commented] (FLINK-6333) Utilize Bloomfilters in RocksDb

2017-05-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992627#comment-15992627 ] Stefan Richter commented on FLINK-6333: --- It is mentioned in this issue:

[jira] [Commented] (FLINK-6412) Stream has already been closed during job cancel

2017-04-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989189#comment-15989189 ] Stefan Richter commented on FLINK-6412: --- I can probably fix this easily, suggest I wait until I

[jira] [Commented] (FLINK-6412) Stream has already been closed during job cancel

2017-04-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989125#comment-15989125 ] Stefan Richter commented on FLINK-6412: --- I think the root cause of this is a) the stream is

[jira] [Commented] (FLINK-6402) Consider removing REAPER_THREAD_LOCK in SafetyNetCloseableRegistry#doRegister()

2017-04-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986940#comment-15986940 ] Stefan Richter commented on FLINK-6402: --- I think that removing wouldn't be helpful, because the lock

[jira] [Commented] (FLINK-6402) Consider locking REAPER_THREAD_LOCK in SafetyNetCloseableRegistry#doRegister()

2017-04-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986909#comment-15986909 ] Stefan Richter commented on FLINK-6402: --- I think this lock is not required, because we enforce the

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:32 AM: - Yes,

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:30 AM: - Yes,

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:30 AM: - Yes,

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:29 AM: - Yes,

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980978#comment-15980978 ] Stefan Richter edited comment on FLINK-6353 at 4/24/17 10:29 AM: - Yes,

[jira] [Commented] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980978#comment-15980978 ] Stefan Richter commented on FLINK-6353: --- Yes, that is the idea. After implementing

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979042#comment-15979042 ] Stefan Richter edited comment on FLINK-6353 at 4/21/17 4:42 PM: Just a

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979042#comment-15979042 ] Stefan Richter edited comment on FLINK-6353 at 4/21/17 4:40 PM: Just a

[jira] [Commented] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979042#comment-15979042 ] Stefan Richter commented on FLINK-6353: --- Just a small idea: do you think that from a users

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976404#comment-15976404 ] Stefan Richter commented on FLINK-6321: --- Ok, then this problem can be related. The easiest

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976383#comment-15976383 ] Stefan Richter commented on FLINK-6321: --- I understood that part about the backends. What I do not

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976363#comment-15976363 ] Stefan Richter commented on FLINK-6321: --- This is an indicator of some problem in the CEP operator.

[jira] [Commented] (FLINK-6333) Utilize Bloomfilters in RocksDb

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976306#comment-15976306 ] Stefan Richter commented on FLINK-6333: --- Right now, the biggest problem in updating RockDB above

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973369#comment-15973369 ] Stefan Richter commented on FLINK-6321: --- The reported exception is probably not showing the root

[jira] [Created] (FLINK-6220) Fine-grained copy-on-write for Heap(Map/List)States in CopyOnWriteStateTable

2017-03-30 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6220: - Summary: Fine-grained copy-on-write for Heap(Map/List)States in CopyOnWriteStateTable Key: FLINK-6220 URL: https://issues.apache.org/jira/browse/FLINK-6220

[jira] [Closed] (FLINK-6034) Add KeyedStateHandle for the snapshots in keyed streams

2017-03-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6034. - Resolution: Fixed Fix Version/s: 1.3.0 Implemented in

[jira] [Closed] (FLINK-6207) Duplicate type serializers for async snapshots of CopyOnWriteStateTable

2017-03-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6207. - Resolution: Fixed Fix Version/s: 1.2.1 fixed in 89866a5 backported to 1.2 in bb3e26f >

[jira] [Created] (FLINK-6207) Duplicate type serializers for async snapshots of CopyOnWriteStateTable

2017-03-28 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6207: - Summary: Duplicate type serializers for async snapshots of CopyOnWriteStateTable Key: FLINK-6207 URL: https://issues.apache.org/jira/browse/FLINK-6207 Project:

[jira] [Created] (FLINK-6207) Duplicate type serializers for async snapshots of CopyOnWriteStateTable

2017-03-28 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6207: - Summary: Duplicate type serializers for async snapshots of CopyOnWriteStateTable Key: FLINK-6207 URL: https://issues.apache.org/jira/browse/FLINK-6207 Project:

[jira] [Commented] (FLINK-5217) Deprecated interface Checkpointed make clear suggestion

2017-03-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942790#comment-15942790 ] Stefan Richter commented on FLINK-5217: --- [~shijinkui] the JavaDocs for {{Checkpointed}} and

[jira] [Closed] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

2017-03-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4760. - Resolution: Not A Problem > Kafka 09 Consumer failed to initialize state because of corrupted

[jira] [Assigned] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5985: - Assignee: Stefan Richter > Flink treats every task as stateful (making topology changes

[jira] [Closed] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5985. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 fixed in 20fff32. > Flink

[jira] [Closed] (FLINK-5715) Asynchronous snapshotting for HeapKeyedStateBackend

2017-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5715. - Resolution: Fixed Fix Version/s: 1.3.0 fixed in ab014ef > Asynchronous snapshotting for

[jira] [Closed] (FLINK-5979) Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3)

2017-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5979. - Resolution: Fixed fixed in ab014ef > Backwards compatibility for HeapKeyedStateBackend

[jira] [Closed] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6044. - Resolution: Fixed Fix Version/s: 1.3.0 Fixed in cbaf4e5 (master) >

[jira] [Closed] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6061. - Resolution: Fixed Fix Version/s: 1.3.0 Fixed in 0bdc8bf (master) > NPE on

[jira] [Commented] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926192#comment-15926192 ] Stefan Richter commented on FLINK-6061: --- [~vpernin] afaik, there is not yet a native support for TTL

[jira] [Assigned] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6061: - Assignee: Stefan Richter > NPE on TypeSerializer.serialize with a RocksDBStateBackend

[jira] [Comment Edited] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925929#comment-15925929 ] Stefan Richter edited comment on FLINK-6061 at 3/15/17 11:19 AM: - Thanks

[jira] [Commented] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925929#comment-15925929 ] Stefan Richter commented on FLINK-6061: --- Thanks for reporting this. I agree that the information

[jira] [Created] (FLINK-6049) Parallelize execution of (async) snapshots in AsyncCheckpointRunnable

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6049: - Summary: Parallelize execution of (async) snapshots in AsyncCheckpointRunnable Key: FLINK-6049 URL: https://issues.apache.org/jira/browse/FLINK-6049 Project: Flink

[jira] [Created] (FLINK-6049) Parallelize execution of (async) snapshots in AsyncCheckpointRunnable

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6049: - Summary: Parallelize execution of (async) snapshots in AsyncCheckpointRunnable Key: FLINK-6049 URL: https://issues.apache.org/jira/browse/FLINK-6049 Project: Flink

[jira] [Created] (FLINK-6048) Asynchronous snapshots for heap-based operator state backends

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6048: - Summary: Asynchronous snapshots for heap-based operator state backends Key: FLINK-6048 URL: https://issues.apache.org/jira/browse/FLINK-6048 Project: Flink

[jira] [Created] (FLINK-6048) Asynchronous snapshots for heap-based operator state backends

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6048: - Summary: Asynchronous snapshots for heap-based operator state backends Key: FLINK-6048 URL: https://issues.apache.org/jira/browse/FLINK-6048 Project: Flink

[jira] [Commented] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924201#comment-15924201 ] Stefan Richter commented on FLINK-6044: --- Thanks for reporting this. The {{read(...)}} is intended to

[jira] [Assigned] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6044: - Assignee: Stefan Richter > TypeSerializerSerializationProxy.read() doesn't verify the

[jira] [Commented] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904895#comment-15904895 ] Stefan Richter commented on FLINK-5985: --- I think the proper solution is based on preventing those

[jira] [Commented] (FLINK-5991) Expose Broadcast Operator State through public APIs

2017-03-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903085#comment-15903085 ] Stefan Richter commented on FLINK-5991: --- I agree with [~aljoscha] 's suggestion. > Expose Broadcast

[jira] [Commented] (FLINK-5995) Get a Exception when creating the ListStateDescriptor with a TypeInformation

2017-03-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902750#comment-15902750 ] Stefan Richter commented on FLINK-5995: --- Hi, I think your idea should work, you just have to ensure

[jira] [Created] (FLINK-5979) Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3)

2017-03-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5979: - Summary: Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3) Key: FLINK-5979 URL: https://issues.apache.org/jira/browse/FLINK-5979

[jira] [Created] (FLINK-5979) Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3)

2017-03-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5979: - Summary: Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3) Key: FLINK-5979 URL: https://issues.apache.org/jira/browse/FLINK-5979

[jira] [Created] (FLINK-5961) Queryable State is broken for HeapKeyedStateBackend

2017-03-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5961: - Summary: Queryable State is broken for HeapKeyedStateBackend Key: FLINK-5961 URL: https://issues.apache.org/jira/browse/FLINK-5961 Project: Flink Issue

[jira] [Created] (FLINK-5961) Queryable State is broken for HeapKeyedStateBackend

2017-03-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5961: - Summary: Queryable State is broken for HeapKeyedStateBackend Key: FLINK-5961 URL: https://issues.apache.org/jira/browse/FLINK-5961 Project: Flink Issue

[jira] [Commented] (FLINK-3387) Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894614#comment-15894614 ] Stefan Richter commented on FLINK-3387: --- [~sbcd90] are you still working on this? [~StephanEwen] I

[jira] [Commented] (FLINK-3089) OperatorState timeout

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894606#comment-15894606 ] Stefan Richter commented on FLINK-3089: --- Does this solve the problem and we can close this issue? >

[jira] [Commented] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894605#comment-15894605 ] Stefan Richter commented on FLINK-4760: --- [~zhenzhongxu] is this still a problem or can we close this

[jira] [Commented] (FLINK-4275) Generic Folding, Reducing and List states behave differently from other state backends

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894595#comment-15894595 ] Stefan Richter commented on FLINK-4275: --- One more ping on this. Can I close this issue? > Generic

[jira] [Closed] (FLINK-5917) Remove MapState.size()

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5917. - Resolution: Fixed Fixed in f37507d (master) > Remove MapState.size() > -- >

[jira] [Updated] (FLINK-5958) Asynchronous snapshots for heap-based keyed state backends

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5958: -- Summary: Asynchronous snapshots for heap-based keyed state backends (was: Asyncronous

[jira] [Created] (FLINK-5958) Asyncronous snapshots for heap-based keyed state backends

2017-03-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5958: - Summary: Asyncronous snapshots for heap-based keyed state backends Key: FLINK-5958 URL: https://issues.apache.org/jira/browse/FLINK-5958 Project: Flink

[jira] [Created] (FLINK-5958) Asyncronous snapshots for heap-based keyed state backends

2017-03-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5958: - Summary: Asyncronous snapshots for heap-based keyed state backends Key: FLINK-5958 URL: https://issues.apache.org/jira/browse/FLINK-5958 Project: Flink

[jira] [Commented] (FLINK-5107) Job Manager goes out of memory from long history of prior execution attempts

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893955#comment-15893955 ] Stefan Richter commented on FLINK-5107: --- This is not intentional. > Job Manager goes out of memory

[jira] [Commented] (FLINK-5917) Remove MapState.size()

2017-03-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891945#comment-15891945 ] Stefan Richter commented on FLINK-5917: --- I agree with [~aljoscha]. Unlike Java's HashMap, RocksDB

[jira] [Commented] (FLINK-5932) Order of legacy vs new state initialization in the AbstractStreamOperator.

2017-03-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891930#comment-15891930 ] Stefan Richter commented on FLINK-5932: --- I think it makes a lot of sense if it is easily possible.

[jira] [Commented] (FLINK-1725) New Partitioner for better load balancing for skewed data

2017-02-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871572#comment-15871572 ] Stefan Richter commented on FLINK-1725: --- I agree with you [~aljoscha]. While this would be nice to

[jira] [Commented] (FLINK-2491) Operators are not participating in state checkpointing in some cases

2017-02-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871538#comment-15871538 ] Stefan Richter commented on FLINK-2491: --- This seems still valid, but I assume it is not in progress

[jira] [Closed] (FLINK-3841) RocksDB statebackend creates empty dbs for stateless operators

2017-02-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-3841. - Resolution: Not A Problem Fix Version/s: 1.2.0 Not a problem any more. Will close this

[jira] [Commented] (FLINK-5740) Make WrappingFunction an interface and move to flink-core

2017-02-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15859254#comment-15859254 ] Stefan Richter commented on FLINK-5740: --- +1 very good idea. > Make WrappingFunction an interface

[jira] [Created] (FLINK-5730) User can concurrently modify state metadata of RocksDB asynchronous snapshots

2017-02-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5730: - Summary: User can concurrently modify state metadata of RocksDB asynchronous snapshots Key: FLINK-5730 URL: https://issues.apache.org/jira/browse/FLINK-5730

[jira] [Created] (FLINK-5730) User can concurrently modify state metadata of RocksDB asynchronous snapshots

2017-02-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5730: - Summary: User can concurrently modify state metadata of RocksDB asynchronous snapshots Key: FLINK-5730 URL: https://issues.apache.org/jira/browse/FLINK-5730

[jira] [Updated] (FLINK-5730) Users can concurrently modify state metadata of RocksDB asynchronous snapshots

2017-02-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5730: -- Summary: Users can concurrently modify state metadata of RocksDB asynchronous snapshots (was:

[jira] [Created] (FLINK-5715) Asynchronous snapshotting for HeapKeyedStateBackend

2017-02-06 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5715: - Summary: Asynchronous snapshotting for HeapKeyedStateBackend Key: FLINK-5715 URL: https://issues.apache.org/jira/browse/FLINK-5715 Project: Flink Issue

[jira] [Created] (FLINK-5715) Asynchronous snapshotting for HeapKeyedStateBackend

2017-02-06 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5715: - Summary: Asynchronous snapshotting for HeapKeyedStateBackend Key: FLINK-5715 URL: https://issues.apache.org/jira/browse/FLINK-5715 Project: Flink Issue

[jira] [Created] (FLINK-5707) Find better keys for backend configuration parameters

2017-02-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5707: - Summary: Find better keys for backend configuration parameters Key: FLINK-5707 URL: https://issues.apache.org/jira/browse/FLINK-5707 Project: Flink Issue

[jira] [Created] (FLINK-5707) Find better keys for backend configuration parameters

2017-02-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5707: - Summary: Find better keys for backend configuration parameters Key: FLINK-5707 URL: https://issues.apache.org/jira/browse/FLINK-5707 Project: Flink Issue

[jira] (FLINK-5480) User-provided hashes for operators

2017-01-30 Thread Stefan Richter (JIRA)
Title: Message Title Stefan Richter commented on FLINK-5480

[jira] (FLINK-5044) Converting operator and function state from Flink 1.1 for all changed operators in 1.2

2017-01-30 Thread Stefan Richter (JIRA)
Title: Message Title Stefan Richter commented on FLINK-5044

[jira] [Created] (FLINK-5681) Make ReaperThread for SafetyNetCloseableRegistry a singleton

2017-01-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5681: - Summary: Make ReaperThread for SafetyNetCloseableRegistry a singleton Key: FLINK-5681 URL: https://issues.apache.org/jira/browse/FLINK-5681 Project: Flink

[jira] [Created] (FLINK-5681) Make ReaperThread for SafetyNetCloseableRegistry a singleton

2017-01-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5681: - Summary: Make ReaperThread for SafetyNetCloseableRegistry a singleton Key: FLINK-5681 URL: https://issues.apache.org/jira/browse/FLINK-5681 Project: Flink

[jira] [Assigned] (FLINK-5663) Checkpoint fails because of closed registry

2017-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5663: - Assignee: Stefan Richter > Checkpoint fails because of closed registry >

[jira] [Commented] (FLINK-5663) Checkpoint fails because of closed registry

2017-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840101#comment-15840101 ] Stefan Richter commented on FLINK-5663: --- The only place this registry ever gets closed is through

[jira] [Commented] (FLINK-5663) Checkpoint fails because of closed registry

2017-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840070#comment-15840070 ] Stefan Richter commented on FLINK-5663: --- Then again, question is if this task already ended and for

[jira] [Commented] (FLINK-5663) Checkpoint fails because of closed registry

2017-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840068#comment-15840068 ] Stefan Richter commented on FLINK-5663: --- I don't think this is a race condition. This exception only

[jira] [Commented] (FLINK-5436) UDF state without CheckpointedRestoring can result in restarting loop

2017-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15834292#comment-15834292 ] Stefan Richter commented on FLINK-5436: --- I think that would be good to have in. > UDF state without

[jira] [Assigned] (FLINK-5468) Restoring from a semi async rocksdb statebackend (1.1) to 1.2 fails with ClassNotFoundException

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5468: - Assignee: Stefan Richter > Restoring from a semi async rocksdb statebackend (1.1) to 1.2

[jira] [Commented] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821808#comment-15821808 ] Stefan Richter commented on FLINK-5465: --- After talking to [~StephanEwen], we came to the conclusion

[jira] [Commented] (FLINK-5468) Restoring from a semi async rocksdb statebackend (1.1) to 1.2 fails with ClassNotFoundException

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821807#comment-15821807 ] Stefan Richter commented on FLINK-5468: --- Migrating from semi async snapshotting will not be

[jira] [Closed] (FLINK-5283) InputStream should be closed in RocksDBKeyedStateBackend#restoreOldSavepointKeyedState

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5283. - Resolution: Fixed > InputStream should be closed in >

[jira] [Closed] (FLINK-4956) Introduce convenient methods for testing checkpoint/restore in StreamTaskTestHarness

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4956. - Resolution: Implemented > Introduce convenient methods for testing checkpoint/restore in >

[jira] [Created] (FLINK-5480) User-provided hashes for operators

2017-01-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5480: - Summary: User-provided hashes for operators Key: FLINK-5480 URL: https://issues.apache.org/jira/browse/FLINK-5480 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5480) User-provided hashes for operators

2017-01-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5480: - Summary: User-provided hashes for operators Key: FLINK-5480 URL: https://issues.apache.org/jira/browse/FLINK-5480 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-5473) setMaxParallelism() higher than 1 is possible on non-parallel operators

2017-01-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821254#comment-15821254 ] Stefan Richter commented on FLINK-5473: --- We could try to automatically set the old parallelism as

[jira] [Assigned] (FLINK-5467) Stateless chained tasks set legacy operator state

2017-01-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5467: - Assignee: Stefan Richter > Stateless chained tasks set legacy operator state >

[jira] [Commented] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

2017-01-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819458#comment-15819458 ] Stefan Richter commented on FLINK-5465: --- Looks like cleanup function which calls to clear() is run

[jira] [Created] (FLINK-5442) Add test to fix ordinals of serialized enum StateDescriptor.Type

2017-01-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5442: - Summary: Add test to fix ordinals of serialized enum StateDescriptor.Type Key: FLINK-5442 URL: https://issues.apache.org/jira/browse/FLINK-5442 Project: Flink

<    5   6   7   8   9   10   11   12   >