[jira] [Closed] (FLINK-6690) Rescaling broken

[ https://issues.apache.org/jira/browse/FLINK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6690. - Resolution: Fixed fixed in 36830adace > Rescaling broken > > >

[jira] [Closed] (FLINK-5756) When there are many values under the same key in ListState, RocksDBStateBackend performances poor

[ https://issues.apache.org/jira/browse/FLINK-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5756. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 fixed in e651df99f4 >

[jira] [Commented] (FLINK-6690) Rescaling broken

[ https://issues.apache.org/jira/browse/FLINK-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021694#comment-16021694 ] Stefan Richter commented on FLINK-6690: --- I have found the cause in a bug that was introduced as part

[jira] [Created] (FLINK-6640) Ensure registration of shared state happens before externalizing a checkpoint

Stefan Richter created FLINK-6640: - Summary: Ensure registration of shared state happens before externalizing a checkpoint Key: FLINK-6640 URL: https://issues.apache.org/jira/browse/FLINK-6640

[jira] [Commented] (FLINK-6620) Add KeyGroupCheckpointedOperator interface that works for checkpointing key-groups

[ https://issues.apache.org/jira/browse/FLINK-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019298#comment-16019298 ] Stefan Richter commented on FLINK-6620: --- Yes, and I think there problem with designing the API still

[jira] [Assigned] (FLINK-6651) Clearing registeredStates map should be protected in SharedStateRegistry#clear

[ https://issues.apache.org/jira/browse/FLINK-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6651: - Assignee: Stefan Richter > Clearing registeredStates map should be protected in

[jira] [Closed] (FLINK-6651) Clearing registeredStates map should be protected in SharedStateRegistry#clear

[ https://issues.apache.org/jira/browse/FLINK-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6651. - Resolution: Fixed Fix Version/s: 1.3.0 fixed in 392bc71301 > Clearing registeredStates

[jira] [Closed] (FLINK-6640) Ensure registration of shared state happens before externalizing a checkpoint

[ https://issues.apache.org/jira/browse/FLINK-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6640. - Resolution: Fixed fixed in 040356391f > Ensure registration of shared state happens before

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019373#comment-16019373 ] Stefan Richter commented on FLINK-6633: --- This is fixed through the issue you mentioned. > Register

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019717#comment-16019717 ] Stefan Richter commented on FLINK-6537: --- Which exception is that exactly? And how does it happen all

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019717#comment-16019717 ] Stefan Richter edited comment on FLINK-6537 at 5/22/17 3:42 PM: Which

[jira] [Created] (FLINK-6761) Limitation for maximum state size per key in RocksDB backend

Stefan Richter created FLINK-6761: - Summary: Limitation for maximum state size per key in RocksDB backend Key: FLINK-6761 URL: https://issues.apache.org/jira/browse/FLINK-6761 Project: Flink

[jira] [Updated] (FLINK-6761) Limitation for maximum state size per key in RocksDB backend

[ https://issues.apache.org/jira/browse/FLINK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6761: -- Description: RocksDB`s JNI bridge allows for putting and getting {{byte[]}} as keys and

[jira] [Commented] (FLINK-6761) Limitation for maximum state size per key in RocksDB backend

[ https://issues.apache.org/jira/browse/FLINK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028363#comment-16028363 ] Stefan Richter commented on FLINK-6761: --- Opened a corresponding issue in the RocksDB tracker:

[jira] [Comment Edited] (FLINK-6762) Cannot rescale externalized incremental checkpoints

[ https://issues.apache.org/jira/browse/FLINK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028487#comment-16028487 ] Stefan Richter edited comment on FLINK-6762 at 5/29/17 4:02 PM: FYI, I

[jira] [Commented] (FLINK-6762) Cannot rescale externalized incremental checkpoints

[ https://issues.apache.org/jira/browse/FLINK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028487#comment-16028487 ] Stefan Richter commented on FLINK-6762: --- FYI, I think we can can ALMOST support this by changing

[jira] [Commented] (FLINK-6762) Cannot rescale externalized incremental checkpoints

[ https://issues.apache.org/jira/browse/FLINK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028449#comment-16028449 ] Stefan Richter commented on FLINK-6762: --- Officially, we currently do not want to support rescaling

[jira] [Comment Edited] (FLINK-6762) Cannot rescale externalized incremental checkpoints

[ https://issues.apache.org/jira/browse/FLINK-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028449#comment-16028449 ] Stefan Richter edited comment on FLINK-6762 at 5/29/17 3:19 PM:

[jira] [Created] (FLINK-6766) Update documentation with async backends and incremental checkpoints

Stefan Richter created FLINK-6766: - Summary: Update documentation with async backends and incremental checkpoints Key: FLINK-6766 URL: https://issues.apache.org/jira/browse/FLINK-6766 Project: Flink

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020941#comment-16020941 ] Stefan Richter commented on FLINK-6537: --- Ok, I think I have an idea about a possible problem, but it

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019717#comment-16019717 ] Stefan Richter edited comment on FLINK-6537 at 5/22/17 4:19 PM: Which

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020789#comment-16020789 ] Stefan Richter edited comment on FLINK-6537 at 5/23/17 8:20 AM: I had a

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020789#comment-16020789 ] Stefan Richter edited comment on FLINK-6537 at 5/23/17 8:23 AM: I had a

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020789#comment-16020789 ] Stefan Richter edited comment on FLINK-6537 at 5/23/17 8:23 AM: I had a

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020789#comment-16020789 ] Stefan Richter commented on FLINK-6537: --- I had a look at those logs, but they seem strange to me.

[jira] [Comment Edited] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020789#comment-16020789 ] Stefan Richter edited comment on FLINK-6537 at 5/23/17 8:33 AM: I had a

[jira] [Created] (FLINK-6599) Communicate last committed checkpoint through trigger checkpoint message

Stefan Richter created FLINK-6599: - Summary: Communicate last committed checkpoint through trigger checkpoint message Key: FLINK-6599 URL: https://issues.apache.org/jira/browse/FLINK-6599 Project:

[jira] [Commented] (FLINK-6333) Utilize Bloomfilters in RocksDb

[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028212#comment-16028212 ] Stefan Richter commented on FLINK-6333: --- This issue still exists after some testing and stops us

[jira] [Updated] (FLINK-6773) Use compression (e.g. snappy) for full check/savepoints

[ https://issues.apache.org/jira/browse/FLINK-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6773: -- Description: We could use compression (e.g. snappy stream compression) to decrease the size of

[jira] [Created] (FLINK-6773) Use compression (e.g. snappy) for full check/savepoints

Stefan Richter created FLINK-6773: - Summary: Use compression (e.g. snappy) for full check/savepoints Key: FLINK-6773 URL: https://issues.apache.org/jira/browse/FLINK-6773 Project: Flink

[jira] [Updated] (FLINK-6776) Use skip instead of seek for small forward repositioning in DFS streams

[ https://issues.apache.org/jira/browse/FLINK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6776: -- Priority: Minor (was: Major) > Use skip instead of seek for small forward repositioning in DFS

[jira] [Created] (FLINK-6776) Use skip instead of seek for small forward repositioning in DFS streams

Stefan Richter created FLINK-6776: - Summary: Use skip instead of seek for small forward repositioning in DFS streams Key: FLINK-6776 URL: https://issues.apache.org/jira/browse/FLINK-6776 Project:

[jira] [Commented] (FLINK-6849) Refactor operator state backend and internal operator state hierarchy

[ https://issues.apache.org/jira/browse/FLINK-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040460#comment-16040460 ] Stefan Richter commented on FLINK-6849: --- I agree in general, because this was clear from the

[jira] [Comment Edited] (FLINK-6849) Refactor operator state backend and internal operator state hierarchy

[ https://issues.apache.org/jira/browse/FLINK-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040460#comment-16040460 ] Stefan Richter edited comment on FLINK-6849 at 6/7/17 8:09 AM: --- I agree in

[jira] [Closed] (FLINK-5053) Incremental / lightweight snapshots for checkpoints

[ https://issues.apache.org/jira/browse/FLINK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5053. - Resolution: Implemented > Incremental / lightweight snapshots for checkpoints >

[jira] [Closed] (FLINK-6364) Implement incremental checkpointing in RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-6364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6364. - Resolution: Fixed > Implement incremental checkpointing in RocksDBStateBackend >

[jira] [Closed] (FLINK-6776) Use skip instead of seek for small forward repositioning in DFS streams

[ https://issues.apache.org/jira/browse/FLINK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6776. - Resolution: Implemented Fix Version/s: 1.4.0 Implemented in 9141379f6d > Use skip instead

[jira] [Created] (FLINK-6931) Support custom compression formats for checkpoints (+Upgrade/Compatibility)

Stefan Richter created FLINK-6931: - Summary: Support custom compression formats for checkpoints (+Upgrade/Compatibility) Key: FLINK-6931 URL: https://issues.apache.org/jira/browse/FLINK-6931 Project:

[jira] [Assigned] (FLINK-6773) Use compression (e.g. snappy) for full check/savepoints

[ https://issues.apache.org/jira/browse/FLINK-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6773: - Assignee: Stefan Richter > Use compression (e.g. snappy) for full check/savepoints >

[jira] [Commented] (FLINK-6679) Document HeapStatebackend

[ https://issues.apache.org/jira/browse/FLINK-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053694#comment-16053694 ] Stefan Richter commented on FLINK-6679: --- The issue is not very specific, so I think this is not an

[jira] [Commented] (FLINK-6679) Document HeapStatebackend

[ https://issues.apache.org/jira/browse/FLINK-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053904#comment-16053904 ] Stefan Richter commented on FLINK-6679: --- MemoryStateBackend and FsStateBackend are those backends

[jira] [Commented] (FLINK-6679) Document HeapStatebackend

[ https://issues.apache.org/jira/browse/FLINK-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053919#comment-16053919 ] Stefan Richter commented on FLINK-6679: --- I can understand that :) The naming is confusing because

[jira] [Commented] (FLINK-6471) RocksDBStateBackendTest#testCancelRunningSnapshot sometimes fails

[ https://issues.apache.org/jira/browse/FLINK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999837#comment-15999837 ] Stefan Richter commented on FLINK-6471: --- Thanks for reporting this problem. This is cause by a

[jira] [Created] (FLINK-6480) Add executor service parameter Snapshotable::snapshot(...)

Stefan Richter created FLINK-6480: - Summary: Add executor service parameter Snapshotable::snapshot(...) Key: FLINK-6480 URL: https://issues.apache.org/jira/browse/FLINK-6480 Project: Flink

[jira] [Created] (FLINK-6481) Encapsulate different snapshot algorithms (full, incremental) slightly clearer into strategy pattern

Stefan Richter created FLINK-6481: - Summary: Encapsulate different snapshot algorithms (full, incremental) slightly clearer into strategy pattern Key: FLINK-6481 URL:

[jira] [Created] (FLINK-6484) Send only the registry keys for already registered files in incremental checkpointing

Stefan Richter created FLINK-6484: - Summary: Send only the registry keys for already registered files in incremental checkpointing Key: FLINK-6484 URL: https://issues.apache.org/jira/browse/FLINK-6484

[jira] [Closed] (FLINK-6471) RocksDBStateBackendTest#testCancelRunningSnapshot sometimes fails

[ https://issues.apache.org/jira/browse/FLINK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6471. - Resolution: Fixed Assignee: Stefan Richter Fix Version/s: 1.3.0 Fixed in

[jira] [Created] (FLINK-6475) Incremental snapshots in RocksDB hold lock during async file upload

Stefan Richter created FLINK-6475: - Summary: Incremental snapshots in RocksDB hold lock during async file upload Key: FLINK-6475 URL: https://issues.apache.org/jira/browse/FLINK-6475 Project: Flink

[jira] [Created] (FLINK-6485) Use buffering to avoid frequent memtable flushes for short intervals in RockdDB incremental checkpoints

Stefan Richter created FLINK-6485: - Summary: Use buffering to avoid frequent memtable flushes for short intervals in RockdDB incremental checkpoints Key: FLINK-6485 URL:

[jira] [Commented] (FLINK-6333) Utilize Bloomfilters in RocksDb

[ https://issues.apache.org/jira/browse/FLINK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992627#comment-15992627 ] Stefan Richter commented on FLINK-6333: --- It is mentioned in this issue:

[jira] [Closed] (FLINK-6048) Asynchronous snapshots for heap-based operator state backends

[ https://issues.apache.org/jira/browse/FLINK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6048. - Resolution: Implemented > Asynchronous snapshots for heap-based operator state backends >

[jira] [Commented] (FLINK-5439) Adjust max parallelism when migrating

[ https://issues.apache.org/jira/browse/FLINK-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998363#comment-15998363 ] Stefan Richter commented on FLINK-5439: --- [~uce] I think we can close this issue? Correct me if I am

[jira] [Commented] (FLINK-5440) Misleading error message when migrating and scaling down from savepoint

[ https://issues.apache.org/jira/browse/FLINK-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998362#comment-15998362 ] Stefan Richter commented on FLINK-5440: --- [~uce] I think we can close this issue? Correct me if I am

[jira] [Commented] (FLINK-5599) State interface docs often refer to keyed state only

[ https://issues.apache.org/jira/browse/FLINK-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998370#comment-15998370 ] Stefan Richter commented on FLINK-5599: --- This looks like we can close it by now. The state docs have

[jira] [Closed] (FLINK-5599) State interface docs often refer to keyed state only

[ https://issues.apache.org/jira/browse/FLINK-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5599. - Resolution: Fixed > State interface docs often refer to keyed state only >

[jira] [Commented] (FLINK-5463) RocksDB.disposeInternal does not react to interrupts, blocks task cancellation

[ https://issues.apache.org/jira/browse/FLINK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998368#comment-15998368 ] Stefan Richter commented on FLINK-5463: --- [~rmetzger] How should we proceed with this issue? >

[jira] [Assigned] (FLINK-6412) Stream has already been closed during job cancel

[ https://issues.apache.org/jira/browse/FLINK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-6412: - Assignee: Stefan Richter > Stream has already been closed during job cancel >

[jira] [Commented] (FLINK-5924) Support asynchronous checkpointing of operator state

[ https://issues.apache.org/jira/browse/FLINK-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998356#comment-15998356 ] Stefan Richter commented on FLINK-5924: --- Was this issue about the raw (stream-written) or managed

[jira] [Closed] (FLINK-5051) Backwards compatibility for serializers in backend state

[ https://issues.apache.org/jira/browse/FLINK-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5051. - Resolution: Implemented > Backwards compatibility for serializers in backend state >

[jira] [Closed] (FLINK-5041) Implement savepoint backwards compatibility 1.1 -> 1.2

[ https://issues.apache.org/jira/browse/FLINK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5041. - Resolution: Implemented Fix Version/s: 1.2.0 > Implement savepoint backwards compatibility

[jira] [Commented] (FLINK-5925) Clean up extracted RocksDB JNI library

[ https://issues.apache.org/jira/browse/FLINK-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998354#comment-15998354 ] Stefan Richter commented on FLINK-5925: --- [~till.rohrmann] is this issue still valid? > Clean up

[jira] [Commented] (FLINK-5462) Flink job fails due to java.util.concurrent.CancellationException while snapshotting

[ https://issues.apache.org/jira/browse/FLINK-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998367#comment-15998367 ] Stefan Richter commented on FLINK-5462: --- I think this is just a followup exception of a canceled

[jira] [Updated] (FLINK-6484) Send only the registry keys for already registered files in incremental checkpointing

[ https://issues.apache.org/jira/browse/FLINK-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6484: -- Description: State handles for files that are (potentially) shared across multiple incremental

[jira] [Created] (FLINK-7619) Improve abstraction in AbstractAsyncIOCallable to better fit

Stefan Richter created FLINK-7619: - Summary: Improve abstraction in AbstractAsyncIOCallable to better fit Key: FLINK-7619 URL: https://issues.apache.org/jira/browse/FLINK-7619 Project: Flink

[jira] [Commented] (FLINK-6684) Remove AsyncCheckpointRunnable from StreamTask

[ https://issues.apache.org/jira/browse/FLINK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203174#comment-16203174 ] Stefan Richter commented on FLINK-6684: --- Not sure if this issue is actually valid, because most

[jira] [Closed] (FLINK-7619) Improve abstraction in AbstractAsyncIOCallable to better fit

[ https://issues.apache.org/jira/browse/FLINK-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7619. - Resolution: Fixed Fix Version/s: 1.4.0 Merged in 5af463a9c0. > Improve abstraction in

[jira] [Closed] (FLINK-7524) Task "xxx" did not react to cancelling signal, but is stuck in method

[ https://issues.apache.org/jira/browse/FLINK-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7524. - Assignee: Stefan Richter I still found some small potential for improvement that is merged in

[jira] [Created] (FLINK-7719) Send checkpoint id to task as part of deployment descriptor when resuming

Stefan Richter created FLINK-7719: - Summary: Send checkpoint id to task as part of deployment descriptor when resuming Key: FLINK-7719 URL: https://issues.apache.org/jira/browse/FLINK-7719 Project:

[jira] [Created] (FLINK-7720) Centralize creation of backends and state related resources

Stefan Richter created FLINK-7720: - Summary: Centralize creation of backends and state related resources Key: FLINK-7720 URL: https://issues.apache.org/jira/browse/FLINK-7720 Project: Flink

[jira] [Created] (FLINK-7757) RocksDB lock is too strict and can block snapshots in synchronous phase

Stefan Richter created FLINK-7757: - Summary: RocksDB lock is too strict and can block snapshots in synchronous phase Key: FLINK-7757 URL: https://issues.apache.org/jira/browse/FLINK-7757 Project:

[jira] [Created] (FLINK-7505) Use lambdas in suppressed exception idiom

Stefan Richter created FLINK-7505: - Summary: Use lambdas in suppressed exception idiom Key: FLINK-7505 URL: https://issues.apache.org/jira/browse/FLINK-7505 Project: Flink Issue Type:

[jira] [Closed] (FLINK-7461) Remove Backwards compatibility for Flink 1.1 from Flink 1.4

[ https://issues.apache.org/jira/browse/FLINK-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7461. - Resolution: Fixed merged in 6642768ad8. > Remove Backwards compatibility for Flink 1.1 from

[jira] [Closed] (FLINK-7460) Close all ColumnFamilyHandles when restoring rescaled incremental checkpoints

[ https://issues.apache.org/jira/browse/FLINK-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7460. - Resolution: Fixed merged in ca87bec4f7. > Close all ColumnFamilyHandles when restoring rescaled

[jira] [Closed] (FLINK-7505) Use lambdas in suppressed exception idiom

[ https://issues.apache.org/jira/browse/FLINK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7505. - Resolution: Fixed merged in 5456cf9f8f. > Use lambdas in suppressed exception idiom >

[jira] [Closed] (FLINK-7757) RocksDB lock is too strict and can block snapshots in synchronous phase

[ https://issues.apache.org/jira/browse/FLINK-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7757. - Resolution: Fixed Fixed in 7d026aa728. > RocksDB lock is too strict and can block snapshots in

[jira] [Assigned] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-5372: - Assignee: Stefan Richter > Fix

[jira] [Closed] (FLINK-7796) RocksDBKeyedStateBackend#RocksDBFullSnapshotOperation should close snapshotCloseableRegistry

[ https://issues.apache.org/jira/browse/FLINK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7796. - Resolution: Invalid > RocksDBKeyedStateBackend#RocksDBFullSnapshotOperation should close >

[jira] [Commented] (FLINK-7796) RocksDBKeyedStateBackend#RocksDBFullSnapshotOperation should close snapshotCloseableRegistry

[ https://issues.apache.org/jira/browse/FLINK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208979#comment-16208979 ] Stefan Richter commented on FLINK-7796: --- It is closed by the creator/owner in

[jira] [Comment Edited] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210596#comment-16210596 ] Stefan Richter edited comment on FLINK-5372 at 10/19/17 5:41 AM: - Those

[jira] [Comment Edited] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210596#comment-16210596 ] Stefan Richter edited comment on FLINK-5372 at 10/19/17 5:23 AM: - Those

[jira] [Commented] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210596#comment-16210596 ] Stefan Richter commented on FLINK-5372: --- Those are two separate problems and I don't the problem

[jira] [Closed] (FLINK-7316) always use off-heap network buffers

[ https://issues.apache.org/jira/browse/FLINK-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7316. - Resolution: Fixed Fix Version/s: 1.5.0 Merged in 1854a3de19. > always use off-heap

[jira] [Commented] (FLINK-8098) LeaseExpiredException when using FsStateBackend for checkpointing due to multiple mappers tries to access the same file.

[ https://issues.apache.org/jira/browse/FLINK-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262324#comment-16262324 ] Stefan Richter commented on FLINK-8098: --- What do you mean by "parallelism of checkpointing"? Each

[jira] [Comment Edited] (FLINK-8125) Support limiting the number of open FileSystem connections

[ https://issues.apache.org/jira/browse/FLINK-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262343#comment-16262343 ] Stefan Richter edited comment on FLINK-8125 at 11/22/17 11:27 AM: -- Maybe

[jira] [Commented] (FLINK-8125) Support limiting the number of open FileSystem connections

[ https://issues.apache.org/jira/browse/FLINK-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262343#comment-16262343 ] Stefan Richter commented on FLINK-8125: --- Maybe we can add this monitoring to the already existing

[jira] [Commented] (FLINK-8098) LeaseExpiredException when using FsStateBackend for checkpointing due to multiple mappers tries to access the same file.

[ https://issues.apache.org/jira/browse/FLINK-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264175#comment-16264175 ] Stefan Richter commented on FLINK-8098: --- Parallel scripts was just another option that I have seen

[jira] [Commented] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264061#comment-16264061 ] Stefan Richter commented on FLINK-5465: --- Hi [~dernasherbrezon], it is true that this problem still

[jira] [Closed] (FLINK-6505) Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

[ https://issues.apache.org/jira/browse/FLINK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-6505. - Resolution: Fixed Fix Version/s: 1.5.0 1.4.0 merged in ccf917de23. >

[jira] [Reopened] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reopened FLINK-5465: --- Assignee: Stefan Richter Reconsidered for a better solution because JVM crashed can also

[jira] [Closed] (FLINK-5465) RocksDB fails with segfault while calling AbstractRocksDBState.clear()

[ https://issues.apache.org/jira/browse/FLINK-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-5465. - Resolution: Fixed Fix Version/s: 1.5.0 1.4.0 merged in d86c6b6bb3. >

[jira] [Commented] (FLINK-8281) org.apache.flink.runtime.fs.hdfs.HadoopDataOutputStream cannot be cast to org.apache.flink.core.fs.WrappingProxyCloseable

[ https://issues.apache.org/jira/browse/FLINK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295806#comment-16295806 ] Stefan Richter commented on FLINK-8281: --- Hi, I had a look at your stacktraces and something seems

[jira] [Comment Edited] (FLINK-8281) org.apache.flink.runtime.fs.hdfs.HadoopDataOutputStream cannot be cast to org.apache.flink.core.fs.WrappingProxyCloseable

[ https://issues.apache.org/jira/browse/FLINK-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295806#comment-16295806 ] Stefan Richter edited comment on FLINK-8281 at 12/18/17 10:58 PM: -- Hi, I

[jira] [Closed] (FLINK-8040) Test instability ResourceGuard#testCloseBlockIfAcquired

[ https://issues.apache.org/jira/browse/FLINK-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8040. - Resolution: Fixed Merged in ad8ef6d01b. > Test instability

[jira] [Closed] (FLINK-8053) Default to asynchronous snapshots for FsStateBackend

[ https://issues.apache.org/jira/browse/FLINK-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8053. - Resolution: Fixed Merged in 2906698b4a. > Default to asynchronous snapshots for FsStateBackend >

[jira] [Assigned] (FLINK-8053) Default to asynchronous snapshots for FsStateBackend

[ https://issues.apache.org/jira/browse/FLINK-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-8053: - Assignee: Stefan Richter (was: Aljoscha Krettek) > Default to asynchronous snapshots

[jira] [Commented] (FLINK-7873) Introduce CheckpointCacheManager for reading checkpoint data locally when performing failover

[ https://issues.apache.org/jira/browse/FLINK-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249823#comment-16249823 ] Stefan Richter commented on FLINK-7873: --- [~sihuazhou] We are already planning to introduce this

[jira] [Commented] (FLINK-8098) LeaseExpiredException when using FsStateBackend for checkpointing due to multiple mappers tries to access the same file.

[ https://issues.apache.org/jira/browse/FLINK-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259045#comment-16259045 ] Stefan Richter commented on FLINK-8098: --- >From a first glance, this does not look like a Flink

[jira] [Comment Edited] (FLINK-8098) LeaseExpiredException when using FsStateBackend for checkpointing due to multiple mappers tries to access the same file.

[ https://issues.apache.org/jira/browse/FLINK-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259045#comment-16259045 ] Stefan Richter edited comment on FLINK-8098 at 11/20/17 10:05 AM: -- >From

[jira] [Commented] (FLINK-7873) Introduce CheckpointCacheManager for reading checkpoint data locally when performing failover

[ https://issues.apache.org/jira/browse/FLINK-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255069#comment-16255069 ] Stefan Richter commented on FLINK-7873: --- [~sihuazhou] If you want, you can also open a PR with your

[jira] [Commented] (FLINK-7873) Introduce CheckpointCacheManager for reading checkpoint data locally when performing failover

[ https://issues.apache.org/jira/browse/FLINK-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255087#comment-16255087 ] Stefan Richter commented on FLINK-7873: --- Very good, that fits well because we are still pretty busy

<    1   2   3   4   5   6   7   8   9   10   >