[jira] [Created] (FLINK-5101) Test CassandraConnectorITCase instable

2016-11-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5101: - Summary: Test CassandraConnectorITCase instable Key: FLINK-5101 URL: https://issues.apache.org/jira/browse/FLINK-5101 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-5107) Job Manager goes out of memory from long history of prior execution attempts

2016-11-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683096#comment-15683096 ] Stefan Richter commented on FLINK-5107: --- agreed, it could be a next step to provide this alternative

[jira] [Created] (FLINK-5107) Job Manager goes out of memory from long history of prior execution attempts

2016-11-21 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5107: - Summary: Job Manager goes out of memory from long history of prior execution attempts Key: FLINK-5107 URL: https://issues.apache.org/jira/browse/FLINK-5107

[jira] [Commented] (FLINK-5111) Change the assignToKeyGroup() method to not use Object.hashCode()

2016-11-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683737#comment-15683737 ] Stefan Richter commented on FLINK-5111: --- I think this is not an issue, because the documentation is

[jira] [Updated] (FLINK-5051) Backwards compatibility for serializers in backend state

2016-11-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5051: -- Description: When a new state is register, e.g. in a keyed backend via `getPartitionedState`,

[jira] [Updated] (FLINK-5051) Backwards compatibility for serializers in backend state

2016-11-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5051: -- Description: When a new state is register, e.g. in a keyed backend via `getPartitionedState`,

[jira] [Assigned] (FLINK-4945) KafkaConsumer logs wrong warning about confirmation for unknown checkpoint

2016-10-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-4945: - Assignee: Stefan Richter > KafkaConsumer logs wrong warning about confirmation for

[jira] [Created] (FLINK-4945) KafkaConsumer logs wrong warning about confirmation for unknown checkpoint

2016-10-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4945: - Summary: KafkaConsumer logs wrong warning about confirmation for unknown checkpoint Key: FLINK-4945 URL: https://issues.apache.org/jira/browse/FLINK-4945 Project:

[jira] [Closed] (FLINK-4974) RescalingITCase.testSavepointRescalingInPartitionedOperatorState unstable

2016-10-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4974. - Resolution: Fixed Fixed trough 094b747 >

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-10-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622902#comment-15622902 ] Stefan Richter commented on FLINK-4193: --- I fixed some concurrency issues in the

[jira] [Created] (FLINK-5019) Proper isRestored result for tasks that did not write state

2016-11-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5019: - Summary: Proper isRestored result for tasks that did not write state Key: FLINK-5019 URL: https://issues.apache.org/jira/browse/FLINK-5019 Project: Flink

[jira] [Created] (FLINK-4956) Introduce convenient methods for testing checkpoint/restore in StreamTaskTestHarness

2016-10-28 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4956: - Summary: Introduce convenient methods for testing checkpoint/restore in StreamTaskTestHarness Key: FLINK-4956 URL: https://issues.apache.org/jira/browse/FLINK-4956

[jira] [Created] (FLINK-4844) Partitionable Raw Keyed/Operator State

2016-10-17 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4844: - Summary: Partitionable Raw Keyed/Operator State Key: FLINK-4844 URL: https://issues.apache.org/jira/browse/FLINK-4844 Project: Flink Issue Type: New

[jira] [Assigned] (FLINK-5283) InputStream should be closed in RocksDBKeyedStateBackend#restoreOldSavepointKeyedState

2016-12-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5283: - Assignee: Stefan Richter > InputStream should be closed in >

[jira] [Created] (FLINK-5291) Ensure backwards compatibility of the hashes used to generate JobVertexIds

2016-12-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5291: - Summary: Ensure backwards compatibility of the hashes used to generate JobVertexIds Key: FLINK-5291 URL: https://issues.apache.org/jira/browse/FLINK-5291 Project:

[jira] [Closed] (FLINK-5291) Ensure backwards compatibility of the hashes used to generate JobVertexIds

2016-12-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5291. - Resolution: Duplicate > Ensure backwards compatibility of the hashes used to generate

[jira] [Created] (FLINK-5290) Ensure backwards compatibility of the hashes used to generate JobVertexIds

2016-12-08 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5290: - Summary: Ensure backwards compatibility of the hashes used to generate JobVertexIds Key: FLINK-5290 URL: https://issues.apache.org/jira/browse/FLINK-5290 Project:

[jira] [Updated] (FLINK-5041) Implement savepoint backwards compatibility 1.1 -> 1.2

2016-12-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5041: -- Description: This issue tracks the implementation of backwards compatibility between Flink 1.1

[jira] [Assigned] (FLINK-5289) NPE when using value state on non-keyed stream

2016-12-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5289: - Assignee: Stefan Richter > NPE when using value state on non-keyed stream >

[jira] [Commented] (FLINK-5286) Build instability: WordCountSubclassPOJOITCase fails with IOException: Stream Closed

2016-12-08 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731933#comment-15731933 ] Stefan Richter commented on FLINK-5286: --- I think that FLINK-4910 uncovers subtle problems in those

[jira] [Created] (FLINK-5325) Introduce interface for CloseableRegistry to separate user from system-facing functionality

2016-12-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5325: - Summary: Introduce interface for CloseableRegistry to separate user from system-facing functionality Key: FLINK-5325 URL: https://issues.apache.org/jira/browse/FLINK-5325

[jira] [Created] (FLINK-5327) Remove IOException from StateObject::getStateSize

2016-12-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5327: - Summary: Remove IOException from StateObject::getStateSize Key: FLINK-5327 URL: https://issues.apache.org/jira/browse/FLINK-5327 Project: Flink Issue

[jira] [Created] (FLINK-5335) Allow ListCheckpointed user functions to return null

2016-12-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5335: - Summary: Allow ListCheckpointed user functions to return null Key: FLINK-5335 URL: https://issues.apache.org/jira/browse/FLINK-5335 Project: Flink Issue

[jira] [Closed] (FLINK-5290) Ensure backwards compatibility of the hashes used to generate JobVertexIds

2016-12-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5290. - Resolution: Fixed Fix Version/s: 1.2.0 > Ensure backwards compatibility of the hashes used

[jira] [Created] (FLINK-5337) Introduce backwards compatible state to task assignment

2016-12-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5337: - Summary: Introduce backwards compatible state to task assignment Key: FLINK-5337 URL: https://issues.apache.org/jira/browse/FLINK-5337 Project: Flink

[jira] [Commented] (FLINK-5347) Unclosed stream in OperatorBackendSerializationProxy#write()

2016-12-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752765#comment-15752765 ] Stefan Richter commented on FLINK-5347: --- {{dos}} is just a wrapper around {{out}}. {{out}} does not

[jira] [Commented] (FLINK-5347) Unclosed stream in OperatorBackendSerializationProxy#write()

2016-12-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752754#comment-15752754 ] Stefan Richter commented on FLINK-5347: --- The stream is not opened in the method and therefore should

[jira] [Issue Comment Deleted] (FLINK-5347) Unclosed stream in OperatorBackendSerializationProxy#write()

2016-12-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5347: -- Comment: was deleted (was: The stream is not opened in the method and therefore should also not

[jira] [Updated] (FLINK-5327) Remove IOException from StateObject::getStateSize

2016-12-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5327: -- Description: The signature of {{StateObject::getStateSize}} declares throwing of an

[jira] [Commented] (FLINK-5034) Don't Write StateDescriptor to RocksDB Snapshot

2016-12-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744733#comment-15744733 ] Stefan Richter commented on FLINK-5034: --- Yes > Don't Write StateDescriptor to RocksDB Snapshot >

[jira] [Assigned] (FLINK-5052) Changing the maximum parallelism (number of key groups) of a job

2016-12-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5052: - Assignee: Stefan Richter > Changing the maximum parallelism (number of key groups) of a

[jira] [Updated] (FLINK-5052) Changing the maximum parallelism (number of key groups) of a job

2016-12-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5052: -- Assignee: (was: Stefan Richter) > Changing the maximum parallelism (number of key groups)

[jira] [Assigned] (FLINK-5051) Backwards compatibility for serializers in backend state

2016-12-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5051: - Assignee: Stefan Richter > Backwards compatibility for serializers in backend state >

[jira] [Commented] (FLINK-5035) Don't Write TypeSerializer to Heap State Snapshot

2016-12-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15728267#comment-15728267 ] Stefan Richter commented on FLINK-5035: --- That is correct. I think we actually need the opposite of

[jira] [Closed] (FLINK-5335) Allow ListCheckpointed user functions to return null

2016-12-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5335. - Resolution: Implemented Fix Version/s: 1.2.0 > Allow ListCheckpointed user functions to

[jira] [Commented] (FLINK-4858) Remove Legacy Checkpointing Interfaces

2016-12-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742624#comment-15742624 ] Stefan Richter commented on FLINK-4858: --- Agreed. We can not remove it in 1.2, because that means

[jira] [Assigned] (FLINK-5468) Restoring from a semi async rocksdb statebackend (1.1) to 1.2 fails with ClassNotFoundException

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5468: - Assignee: Stefan Richter > Restoring from a semi async rocksdb statebackend (1.1) to 1.2

[jira] [Assigned] (FLINK-5467) Stateless chained tasks set legacy operator state

2017-01-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5467: - Assignee: Stefan Richter > Stateless chained tasks set legacy operator state >

[jira] [Commented] (FLINK-5473) setMaxParallelism() higher than 1 is possible on non-parallel operators

2017-01-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821254#comment-15821254 ] Stefan Richter commented on FLINK-5473: --- We could try to automatically set the old parallelism as

[jira] [Created] (FLINK-5480) User-provided hashes for operators

2017-01-13 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5480: - Summary: User-provided hashes for operators Key: FLINK-5480 URL: https://issues.apache.org/jira/browse/FLINK-5480 Project: Flink Issue Type: Improvement

[jira] [Closed] (FLINK-5283) InputStream should be closed in RocksDBKeyedStateBackend#restoreOldSavepointKeyedState

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5283. - Resolution: Fixed > InputStream should be closed in >

[jira] [Closed] (FLINK-4956) Introduce convenient methods for testing checkpoint/restore in StreamTaskTestHarness

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4956. - Resolution: Implemented > Introduce convenient methods for testing checkpoint/restore in >

[jira] [Commented] (FLINK-5468) Restoring from a semi async rocksdb statebackend (1.1) to 1.2 fails with ClassNotFoundException

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821807#comment-15821807 ] Stefan Richter commented on FLINK-5468: --- Migrating from semi async snapshotting will not be

[jira] [Commented] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

2017-01-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821808#comment-15821808 ] Stefan Richter commented on FLINK-5465: --- After talking to [~StephanEwen], we came to the conclusion

[jira] [Created] (FLINK-5442) Add test to fix ordinals of serialized enum StateDescriptor.Type

2017-01-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5442: - Summary: Add test to fix ordinals of serialized enum StateDescriptor.Type Key: FLINK-5442 URL: https://issues.apache.org/jira/browse/FLINK-5442 Project: Flink

[jira] [Commented] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

2017-01-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819458#comment-15819458 ] Stefan Richter commented on FLINK-5465: --- Looks like cleanup function which calls to clear() is run

[jira] [Commented] (FLINK-4492) Cleanup files from canceled snapshots

2016-12-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715225#comment-15715225 ] Stefan Richter commented on FLINK-4492: --- Should be ok to close this. > Cleanup files from canceled

[jira] [Created] (FLINK-5265) Introduce state handle replication mode for CheckpointCoordinator

2016-12-05 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5265: - Summary: Introduce state handle replication mode for CheckpointCoordinator Key: FLINK-5265 URL: https://issues.apache.org/jira/browse/FLINK-5265 Project: Flink

[jira] [Assigned] (FLINK-5265) Introduce state handle replication mode for CheckpointCoordinator

2016-12-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5265: - Assignee: Stefan Richter > Introduce state handle replication mode for

[jira] [Assigned] (FLINK-5407) Savepoint for iterative Task fails.

2017-01-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5407: - Assignee: Stefan Richter > Savepoint for iterative Task fails. >

[jira] [Updated] (FLINK-5250) Make AbstractUdfStreamOperator aware of WrappingFunction

2017-01-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5250: -- Assignee: Stefan Richter > Make AbstractUdfStreamOperator aware of WrappingFunction >

[jira] [Created] (FLINK-5421) Explicit restore method in Snapshotable

2017-01-06 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5421: - Summary: Explicit restore method in Snapshotable Key: FLINK-5421 URL: https://issues.apache.org/jira/browse/FLINK-5421 Project: Flink Issue Type:

[jira] [Commented] (FLINK-5397) Fail to deserialize savepoints in v1.1 when there exist missing fields in class serialization descriptors

2016-12-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782747#comment-15782747 ] Stefan Richter commented on FLINK-5397: --- Thanks for pointing out this problem. I opened a PR #3050

[jira] [Assigned] (FLINK-5397) Fail to deserialize savepoints in v1.1 when there exist missing fields in class serialization descriptors

2016-12-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5397: - Assignee: Stefan Richter > Fail to deserialize savepoints in v1.1 when there exist

[jira] [Closed] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

2017-03-24 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4760. - Resolution: Not A Problem > Kafka 09 Consumer failed to initialize state because of corrupted

[jira] [Created] (FLINK-6207) Duplicate type serializers for async snapshots of CopyOnWriteStateTable

2017-03-28 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6207: - Summary: Duplicate type serializers for async snapshots of CopyOnWriteStateTable Key: FLINK-6207 URL: https://issues.apache.org/jira/browse/FLINK-6207 Project:

[jira] [Commented] (FLINK-5217) Deprecated interface Checkpointed make clear suggestion

2017-03-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942790#comment-15942790 ] Stefan Richter commented on FLINK-5217: --- [~shijinkui] the JavaDocs for {{Checkpointed}} and

[jira] [Created] (FLINK-6220) Fine-grained copy-on-write for Heap(Map/List)States in CopyOnWriteStateTable

2017-03-30 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6220: - Summary: Fine-grained copy-on-write for Heap(Map/List)States in CopyOnWriteStateTable Key: FLINK-6220 URL: https://issues.apache.org/jira/browse/FLINK-6220

[jira] [Closed] (FLINK-6207) Duplicate type serializers for async snapshots of CopyOnWriteStateTable

2017-03-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6207. - Resolution: Fixed Fix Version/s: 1.2.1 fixed in 89866a5 backported to 1.2 in bb3e26f >

[jira] [Closed] (FLINK-6034) Add KeyedStateHandle for the snapshots in keyed streams

2017-03-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6034. - Resolution: Fixed Fix Version/s: 1.3.0 Implemented in

[jira] [Closed] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5985. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 fixed in 20fff32. > Flink

[jira] [Assigned] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-17 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5985: - Assignee: Stefan Richter > Flink treats every task as stateful (making topology changes

[jira] [Commented] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925929#comment-15925929 ] Stefan Richter commented on FLINK-6061: --- Thanks for reporting this. I agree that the information

[jira] [Assigned] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6061: - Assignee: Stefan Richter > NPE on TypeSerializer.serialize with a RocksDBStateBackend

[jira] [Comment Edited] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925929#comment-15925929 ] Stefan Richter edited comment on FLINK-6061 at 3/15/17 11:19 AM: - Thanks

[jira] [Closed] (FLINK-5979) Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3)

2017-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5979. - Resolution: Fixed fixed in ab014ef > Backwards compatibility for HeapKeyedStateBackend

[jira] [Closed] (FLINK-5715) Asynchronous snapshotting for HeapKeyedStateBackend

2017-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5715. - Resolution: Fixed Fix Version/s: 1.3.0 fixed in ab014ef > Asynchronous snapshotting for

[jira] [Commented] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926192#comment-15926192 ] Stefan Richter commented on FLINK-6061: --- [~vpernin] afaik, there is not yet a native support for TTL

[jira] [Closed] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6044. - Resolution: Fixed Fix Version/s: 1.3.0 Fixed in cbaf4e5 (master) >

[jira] [Closed] (FLINK-6061) NPE on TypeSerializer.serialize with a RocksDBStateBackend calling entries() on a keyed state in the open() function

2017-03-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6061. - Resolution: Fixed Fix Version/s: 1.3.0 Fixed in 0bdc8bf (master) > NPE on

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979042#comment-15979042 ] Stefan Richter edited comment on FLINK-6353 at 4/21/17 4:40 PM: Just a

[jira] [Commented] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979042#comment-15979042 ] Stefan Richter commented on FLINK-6353: --- Just a small idea: do you think that from a users

[jira] [Comment Edited] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979042#comment-15979042 ] Stefan Richter edited comment on FLINK-6353 at 4/21/17 4:42 PM: Just a

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976383#comment-15976383 ] Stefan Richter commented on FLINK-6321: --- I understood that part about the backends. What I do not

[jira] [Commented] (FLINK-6333) Utilize Bloomfilters in RocksDb

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976306#comment-15976306 ] Stefan Richter commented on FLINK-6333: --- Right now, the biggest problem in updating RockDB above

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976404#comment-15976404 ] Stefan Richter commented on FLINK-6321: --- Ok, then this problem can be related. The easiest

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976363#comment-15976363 ] Stefan Richter commented on FLINK-6321: --- This is an indicator of some problem in the CEP operator.

[jira] [Commented] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904895#comment-15904895 ] Stefan Richter commented on FLINK-5985: --- I think the proper solution is based on preventing those

[jira] [Commented] (FLINK-3387) Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894614#comment-15894614 ] Stefan Richter commented on FLINK-3387: --- [~sbcd90] are you still working on this? [~StephanEwen] I

[jira] [Commented] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894605#comment-15894605 ] Stefan Richter commented on FLINK-4760: --- [~zhenzhongxu] is this still a problem or can we close this

[jira] [Commented] (FLINK-3089) OperatorState timeout

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894606#comment-15894606 ] Stefan Richter commented on FLINK-3089: --- Does this solve the problem and we can close this issue? >

[jira] [Commented] (FLINK-4275) Generic Folding, Reducing and List states behave differently from other state backends

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894595#comment-15894595 ] Stefan Richter commented on FLINK-4275: --- One more ping on this. Can I close this issue? > Generic

[jira] [Created] (FLINK-5961) Queryable State is broken for HeapKeyedStateBackend

2017-03-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5961: - Summary: Queryable State is broken for HeapKeyedStateBackend Key: FLINK-5961 URL: https://issues.apache.org/jira/browse/FLINK-5961 Project: Flink Issue

[jira] [Commented] (FLINK-5995) Get a Exception when creating the ListStateDescriptor with a TypeInformation

2017-03-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902750#comment-15902750 ] Stefan Richter commented on FLINK-5995: --- Hi, I think your idea should work, you just have to ensure

[jira] [Commented] (FLINK-5991) Expose Broadcast Operator State through public APIs

2017-03-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903085#comment-15903085 ] Stefan Richter commented on FLINK-5991: --- I agree with [~aljoscha] 's suggestion. > Expose Broadcast

[jira] [Assigned] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6044: - Assignee: Stefan Richter > TypeSerializerSerializationProxy.read() doesn't verify the

[jira] [Commented] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-14 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924201#comment-15924201 ] Stefan Richter commented on FLINK-6044: --- Thanks for reporting this. The {{read(...)}} is intended to

[jira] [Created] (FLINK-6049) Parallelize execution of (async) snapshots in AsyncCheckpointRunnable

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6049: - Summary: Parallelize execution of (async) snapshots in AsyncCheckpointRunnable Key: FLINK-6049 URL: https://issues.apache.org/jira/browse/FLINK-6049 Project: Flink

[jira] [Created] (FLINK-6048) Asynchronous snapshots for heap-based operator state backends

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6048: - Summary: Asynchronous snapshots for heap-based operator state backends Key: FLINK-6048 URL: https://issues.apache.org/jira/browse/FLINK-6048 Project: Flink

[jira] [Created] (FLINK-5979) Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3)

2017-03-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5979: - Summary: Backwards compatibility for HeapKeyedStateBackend serialization format (1.2 -> 1.3) Key: FLINK-5979 URL: https://issues.apache.org/jira/browse/FLINK-5979

[jira] [Updated] (FLINK-5958) Asynchronous snapshots for heap-based keyed state backends

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-5958: -- Summary: Asynchronous snapshots for heap-based keyed state backends (was: Asyncronous

[jira] [Created] (FLINK-5958) Asyncronous snapshots for heap-based keyed state backends

2017-03-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5958: - Summary: Asyncronous snapshots for heap-based keyed state backends Key: FLINK-5958 URL: https://issues.apache.org/jira/browse/FLINK-5958 Project: Flink

[jira] [Commented] (FLINK-5107) Job Manager goes out of memory from long history of prior execution attempts

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893955#comment-15893955 ] Stefan Richter commented on FLINK-5107: --- This is not intentional. > Job Manager goes out of memory

[jira] [Closed] (FLINK-5917) Remove MapState.size()

2017-03-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5917. - Resolution: Fixed Fixed in f37507d (master) > Remove MapState.size() > -- >

[jira] [Commented] (FLINK-6321) RocksDB state backend Checkpointing is not working with KeydCEP.

2017-04-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973369#comment-15973369 ] Stefan Richter commented on FLINK-6321: --- The reported exception is probably not showing the root

[jira] [Commented] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-07-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107037#comment-16107037 ] Stefan Richter commented on FLINK-7289: --- Thanks for the input. I have one question about the last

[jira] [Closed] (FLINK-7220) Update RocksDB dependency to 5.5.5

2017-07-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7220. - Resolution: Fixed Merged in 219ae33d36 > Update RocksDB dependency to 5.5.5 >

[jira] [Commented] (FLINK-7220) Update RocksDB dependency to 5.5.5

2017-07-28 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104894#comment-16104894 ] Stefan Richter commented on FLINK-7220: --- Yes, I know. Accidentally pushed the wrong branch that was

[jira] [Comment Edited] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-07-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107244#comment-16107244 ] Stefan Richter edited comment on FLINK-7289 at 7/31/17 12:33 PM: - Cache

[jira] [Commented] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

2017-07-31 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107244#comment-16107244 ] Stefan Richter commented on FLINK-7289: --- Cache memory is usually not reclaimed by applications, it

<    1   2   3   4   5   6   7   8   9   10   >