[jira] [Closed] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8411. - Resolution: Fixed Merged in e157cfa77f83608a0cd6d7d41a96edb0ca1f97f6 . > HeapListState#add(null)

[jira] [Closed] (FLINK-8365) Relax List type in HeapListState and HeapKeyedStateBackend

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8365. - Resolution: Fixed Merged in e075da5d5eb0f5ae8c394ea0c549f9dbce28fcf3 . > Relax List type in

[jira] [Closed] (FLINK-8441) serialize values and value separator directly to stream in RocksDBListState

2018-01-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8441. - Resolution: Fixed Merged in ce25688bac1c1ecfa53a03ab1857bb82963b0696 . > serialize values and

[jira] [Comment Edited] (FLINK-3089) State API Should Support Data Expiration (State TTL)

2018-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341298#comment-16341298 ] Stefan Richter edited comment on FLINK-3089 at 1/26/18 5:12 PM:

[jira] [Commented] (FLINK-3089) State API Should Support Data Expiration (State TTL)

2018-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341298#comment-16341298 ] Stefan Richter commented on FLINK-3089: --- [~phoenixjiangnan] I agree that we could start with a

[jira] [Comment Edited] (FLINK-3089) State API Should Support Data Expiration (State TTL)

2018-01-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341298#comment-16341298 ] Stefan Richter edited comment on FLINK-3089 at 1/26/18 5:13 PM:

[jira] [Closed] (FLINK-7720) Centralize creation of backends and state related resources

2018-01-25 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7720. - Resolution: Fixed Fix Version/s: 1.5.0 Merged in 517b3f87214168a445b5751cda210ecf3a292fd6.

[jira] [Closed] (FLINK-7719) Send checkpoint id to task as part of deployment descriptor when resuming

2018-01-25 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-7719. - Resolution: Fixed Fix Version/s: 1.5.0 Merged in 402a2e30c750e1bcb753643ed66c6df0dd861112.

[jira] [Commented] (FLINK-8522) DefaultOperatorStateBackend writes data in checkpoint that is never read.

2018-01-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343580#comment-16343580 ] Stefan Richter commented on FLINK-8522: --- Option 1 looks good for me. > DefaultOperatorStateBackend

[jira] [Closed] (FLINK-4809) Operators should tolerate checkpoint failures

2018-02-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4809. - Resolution: Fixed Fix Version/s: 1.4.0 Merged in 

[jira] [Reopened] (FLINK-4809) Operators should tolerate checkpoint failures

2018-02-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reopened FLINK-4809: --- > Operators should tolerate checkpoint failures > - >

[jira] [Closed] (FLINK-4809) Operators should tolerate checkpoint failures

2018-02-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-4809. - Resolution: Fixed Fix Version/s: (was: 1.4.0) 1.5.0 Merged in 

[jira] [Commented] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-30 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344793#comment-16344793 ] Stefan Richter commented on FLINK-8411: --- That is a tough one. I feel like the previous behaviour for

[jira] [Commented] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-30 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344870#comment-16344870 ] Stefan Richter commented on FLINK-8411: --- Ola, I always assumed that to be a copy-paste error when

[jira] [Commented] (FLINK-8522) DefaultOperatorStateBackend writes data in checkpoint that is never read.

2018-01-29 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343622#comment-16343622 ] Stefan Richter commented on FLINK-8522: --- I don't think that we ever need to read the int, it was

[jira] [Commented] (FLINK-8411) HeapListState#add(null) will wipe out entire list state

2018-01-30 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344895#comment-16344895 ] Stefan Richter commented on FLINK-8411: --- Fine with me, we can revert the commit on the 1.4 branch as

[jira] [Closed] (FLINK-8571) Provide an enhanced KeyedStream implementation to use ForwardPartitioner

2018-02-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8571. - Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Merged in 91eea376ee.

[jira] [Assigned] (FLINK-8571) Provide an enhanced KeyedStream implementation to use ForwardPartitioner

2018-02-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-8571: - Assignee: Stefan Richter > Provide an enhanced KeyedStream implementation to use

[jira] [Assigned] (FLINK-8569) Provide a hook to override the default KeyGroupRangeAssignment

2018-02-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-8569: - Assignee: Stefan Richter > Provide a hook to override the default

[jira] [Assigned] (FLINK-8569) Provide a hook to override the default KeyGroupRangeAssignment

2018-02-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-8569: - Assignee: (was: Stefan Richter) > Provide a hook to override the default

[jira] [Closed] (FLINK-8385) Fix exceptions in AbstractEventTimeWindowCheckpointingITCase

2018-02-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8385. - Resolution: Fixed Merged in  b32b835. > Fix exceptions in

[jira] [Commented] (FLINK-8709) Flaky test: SlotPoolRpcTest.testCancelSlotAllocationWithoutResourceManager

2018-02-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371146#comment-16371146 ] Stefan Richter commented on FLINK-8709: --- Also still seeing this.

[jira] [Closed] (FLINK-8547) Implement CheckpointBarrierHandler not to spill data for exactly-once based on credit-based flow control

2018-02-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8547. - Resolution: Fixed Fix Version/s: 1.5.0 Merged in 3126bf5229. > Implement

[jira] [Closed] (FLINK-8657) Fix incorrect description for external checkpoint vs savepoint

2018-02-19 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8657. - Resolution: Fixed Merged in 5909b5bb7f. > Fix incorrect description for external checkpoint vs

[jira] [Closed] (FLINK-8679) RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with namespace

2018-02-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8679. - Resolution: Fixed Merged in eeac022f05. > RocksDBKeyedBackend.getKeys(stateName, namespace)

[jira] [Closed] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8639. - Resolution: Fixed Merged in 1e315f0. > Fix always need to seek multiple times when iterator

[jira] [Closed] (FLINK-8674) Efficiently handle alwaysFlush case (0ms flushTimeout)

2018-02-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8674. - Resolution: Fixed Fix Version/s: 1.5.0 Merged in a144d0f77f. > Efficiently handle

[jira] [Commented] (FLINK-8309) JVM sigsegv crash when enabling async checkpoints

2017-12-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301756#comment-16301756 ] Stefan Richter commented on FLINK-8309: --- Looks like this is very likely related to this Java

[jira] [Created] (FLINK-8360) Implement task-local state recovery

2018-01-04 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8360: - Summary: Implement task-local state recovery Key: FLINK-8360 URL: https://issues.apache.org/jira/browse/FLINK-8360 Project: Flink Issue Type: New Feature

[jira] [Issue Comment Deleted] (FLINK-8360) Implement task-local state recovery

2018-01-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-8360: -- Comment: was deleted (was: More general implementation that also works for non-filebased

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-01-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311322#comment-16311322 ] Stefan Richter commented on FLINK-8360: --- More general implementation that also works for

[jira] [Commented] (FLINK-9626) Possible resource leak in FileSystem

2018-06-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518096#comment-16518096 ] Stefan Richter commented on FLINK-9626: --- I think in general it can be dangerous to call a {{close}}

[jira] [Closed] (FLINK-9887) Ensure serializer upgrades work with timer service remake

2018-08-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9887. - Resolution: Implemented Merged in: master: 9d273a3 release-1.6: eca1efa > Ensure serializer

[jira] [Created] (FLINK-10040) Decompose RocksDBKeyedStateBackend

2018-08-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10040: -- Summary: Decompose RocksDBKeyedStateBackend Key: FLINK-10040 URL: https://issues.apache.org/jira/browse/FLINK-10040 Project: Flink Issue Type:

[jira] [Created] (FLINK-10043) Refactor object construction/inititlization/restore code

2018-08-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10043: -- Summary: Refactor object construction/inititlization/restore code Key: FLINK-10043 URL: https://issues.apache.org/jira/browse/FLINK-10043 Project: Flink

[jira] [Created] (FLINK-10044) Check proper RIA style and introduce it where missing

2018-08-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10044: -- Summary: Check proper RIA style and introduce it where missing Key: FLINK-10044 URL: https://issues.apache.org/jira/browse/FLINK-10044 Project: Flink

[jira] [Created] (FLINK-10041) Extract all different iterators (inner or static inner classes) into full classes

2018-08-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10041: -- Summary: Extract all different iterators (inner or static inner classes) into full classes Key: FLINK-10041 URL: https://issues.apache.org/jira/browse/FLINK-10041

[jira] [Created] (FLINK-10042) Extract snapshot algorithms from inner classes into full classes

2018-08-03 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10042: -- Summary: Extract snapshot algorithms from inner classes into full classes Key: FLINK-10042 URL: https://issues.apache.org/jira/browse/FLINK-10042 Project: Flink

[jira] [Closed] (FLINK-9918) Outsource fastutil dependency to flink-shading.

2018-07-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9918. - Resolution: Workaround Fix Version/s: 1.6.0 We currently no longer need the dependency

[jira] [Created] (FLINK-9981) Tune performance of RocksDB implementation

2018-07-27 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9981: - Summary: Tune performance of RocksDB implementation Key: FLINK-9981 URL: https://issues.apache.org/jira/browse/FLINK-9981 Project: Flink Issue Type:

[jira] [Commented] (FLINK-9945) RocksDB state backend Checkpointing Failed

2018-07-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16557994#comment-16557994 ] Stefan Richter commented on FLINK-9945: --- The exception does not show the root cause why the

[jira] [Commented] (FLINK-9945) RocksDB state backend Checkpointing Failed

2018-07-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558160#comment-16558160 ] Stefan Richter commented on FLINK-9945: --- Ok, there is no exception but it clearly says that the

[jira] [Comment Edited] (FLINK-9945) RocksDB state backend Checkpointing Failed

2018-07-26 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558160#comment-16558160 ] Stefan Richter edited comment on FLINK-9945 at 7/26/18 10:47 AM: - Ok,

[jira] [Created] (FLINK-10026) Integrate heap based timers in RocksDB backend with incremental checkpoints

2018-08-02 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10026: -- Summary: Integrate heap based timers in RocksDB backend with incremental checkpoints Key: FLINK-10026 URL: https://issues.apache.org/jira/browse/FLINK-10026

[jira] [Created] (FLINK-10028) Introduce ByteArrayData[Input|Output]View

2018-08-02 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10028: -- Summary: Introduce ByteArrayData[Input|Output]View Key: FLINK-10028 URL: https://issues.apache.org/jira/browse/FLINK-10028 Project: Flink Issue Type:

[jira] [Closed] (FLINK-10028) Introduce ByteArrayData[Input|Output]View

2018-08-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10028. -- Resolution: Implemented Merged in: master: fffd2e8c5c release-1.6: 7aaa0c4 > Introduce

[jira] [Closed] (FLINK-9981) Tune performance of RocksDB implementation

2018-08-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9981. - Resolution: Implemented Fix Version/s: 1.6.0 Merged in: master: a20fd1d51b release-1.6:

[jira] [Created] (FLINK-10066) Keep only archived version of previous executions

2018-08-06 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10066: -- Summary: Keep only archived version of previous executions Key: FLINK-10066 URL: https://issues.apache.org/jira/browse/FLINK-10066 Project: Flink Issue

[jira] [Closed] (FLINK-10041) Extract all different iterators (inner or static inner classes) into full classes

2018-08-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10041. -- Resolution: Implemented Fix Version/s: 1.7.0 Merged in: master: 9d67afbb84 > Extract

[jira] [Closed] (FLINK-10124) Use ByteArrayDataInput/OutputView instead of stream + wrapper

2018-08-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10124. -- Resolution: Implemented Fix Version/s: 1.7.0 Merged in: master: 18ff4ab > Use

[jira] [Created] (FLINK-10124) Use ByteArrayDataInput/OutputView instead of stream + wrapper

2018-08-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10124: -- Summary: Use ByteArrayDataInput/OutputView instead of stream + wrapper Key: FLINK-10124 URL: https://issues.apache.org/jira/browse/FLINK-10124 Project: Flink

[jira] [Closed] (FLINK-9938) State TTL cleanup during full state scan upon checkpointing

2018-08-03 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9938. - Resolution: Implemented Merged in: master: ce96c40914 release-1.6: 93bb127be3 > State TTL

[jira] [Closed] (FLINK-10066) Keep only archived version of previous executions

2018-08-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10066. -- Resolution: Fixed Merged in: master: 160dc56fdf release-1.6: 74323d50b0 release-1.5:

[jira] [Closed] (FLINK-10160) Index out of bound when serializing operator state

2018-08-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10160. -- Resolution: Duplicate > Index out of bound when serializing operator state >

[jira] [Commented] (FLINK-10160) Index out of bound when serializing operator state

2018-08-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582693#comment-16582693 ] Stefan Richter commented on FLINK-10160: This problem was fixed in 1.4.3. > Index out of bound

[jira] [Closed] (FLINK-10154) Make sure we always read at least one record in KinesisConnector

2018-08-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10154. -- Resolution: Fixed Fix Version/s: 1.7.0 1.6.1 Merged in: master:

[jira] [Updated] (FLINK-10068) Add documentation for async/RocksDB-based timers

2018-08-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-10068: --- Issue Type: Sub-task (was: Improvement) Parent: FLINK-9485 > Add documentation for

[jira] [Closed] (FLINK-9504) Change checkpoint duration log level to debug to avoid too much log

2018-08-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9504. - Resolution: Fixed > Change checkpoint duration log level to debug to avoid too much log >

[jira] [Reopened] (FLINK-9504) Change checkpoint duration log level to debug to avoid too much log

2018-08-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reopened FLINK-9504: --- > Change checkpoint duration log level to debug to avoid too much log >

[jira] [Updated] (FLINK-9504) Change checkpoint duration log level to debug to avoid too much log

2018-08-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-9504: -- Fix Version/s: 1.7.0 > Change checkpoint duration log level to debug to avoid too much log >

[jira] [Closed] (FLINK-9504) Change checkpoint duration log level to debug to avoid too much log

2018-08-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9504. - Resolution: Implemented Mergend in: master: b2a91310e1 > Change checkpoint duration log level

[jira] [Closed] (FLINK-10095) Change the serialisation order in TTL value wrapper

2018-08-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10095. -- Resolution: Implemented Fix Version/s: 1.6.0 Merged in: master: b535fab release-1.6:

[jira] [Commented] (FLINK-10129) Flink job IDs are not getting deleted automatically from zookeeper metadata after canceling flink job in flink HA cluster

2018-08-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577929#comment-16577929 ] Stefan Richter commented on FLINK-10129: Could you please specify for which Flink version you

[jira] [Created] (FLINK-10121) Introduce methods to remove registered operator states

2018-08-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10121: -- Summary: Introduce methods to remove registered operator states Key: FLINK-10121 URL: https://issues.apache.org/jira/browse/FLINK-10121 Project: Flink

[jira] [Created] (FLINK-10122) KafkaConsumer should use partitionable state over union state if partition discovery is not active

2018-08-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10122: -- Summary: KafkaConsumer should use partitionable state over union state if partition discovery is not active Key: FLINK-10122 URL:

[jira] [Created] (FLINK-10068) Add documentation for async/RocksDB-based timers

2018-08-06 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10068: -- Summary: Add documentation for async/RocksDB-based timers Key: FLINK-10068 URL: https://issues.apache.org/jira/browse/FLINK-10068 Project: Flink Issue

[jira] [Closed] (FLINK-10042) Extract snapshot algorithms from inner classes into full classes

2018-08-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10042. -- Resolution: Implemented Fix Version/s: 1.7.0 Merged in: master: f803280bb9 > Extract

[jira] [Closed] (FLINK-10151) [State TTL] Fix false recursion call in TransformingStateTableKeyGroupPartitioner.tryAddToSource

2018-08-21 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10151. -- Resolution: Fixed Merged in: master: c73747b release-1.6: 00a2e81 > [State TTL] Fix false

[jira] [Created] (FLINK-10176) Replace ByteArrayData[Input|Output]View with Data[Output|InputDe]Serializer

2018-08-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10176: -- Summary: Replace ByteArrayData[Input|Output]View with Data[Output|InputDe]Serializer Key: FLINK-10176 URL: https://issues.apache.org/jira/browse/FLINK-10176

[jira] [Commented] (FLINK-10176) Replace ByteArrayData[Input|Output]View with Data[Output|InputDe]Serializer

2018-08-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16585700#comment-16585700 ] Stefan Richter commented on FLINK-10176: Yes, they almost did what I was looking for. In my PR

[jira] [Created] (FLINK-10175) Fix concurrent access to shared buffer in map state / querable state

2018-08-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10175: -- Summary: Fix concurrent access to shared buffer in map state / querable state Key: FLINK-10175 URL: https://issues.apache.org/jira/browse/FLINK-10175 Project:

[jira] [Closed] (FLINK-10068) Add documentation for async/RocksDB-based timers

2018-08-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10068. -- Resolution: Implemented Fix Version/s: 1.7.0 1.6.1 Merged in:

[jira] [Created] (FLINK-10198) Set Env object in DBOptions for RocksDB

2018-08-22 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10198: -- Summary: Set Env object in DBOptions for RocksDB Key: FLINK-10198 URL: https://issues.apache.org/jira/browse/FLINK-10198 Project: Flink Issue Type:

[jira] [Closed] (FLINK-10175) Fix concurrent access to shared buffer in map state / querable state

2018-08-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10175. -- Resolution: Fixed Merged in: master: 2b6beed > Fix concurrent access to shared buffer in map

[jira] [Closed] (FLINK-10176) Replace ByteArrayData[Input|Output]View with Data[Output|InputDe]Serializer

2018-08-22 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10176. -- Resolution: Implemented Merged in: master: 3fd6587 > Replace ByteArrayData[Input|Output]View

[jira] [Created] (FLINK-10200) Consolidate FileBasedStateOutputStream and FsCheckpointStateOutputStream

2018-08-22 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10200: -- Summary: Consolidate FileBasedStateOutputStream and FsCheckpointStateOutputStream Key: FLINK-10200 URL: https://issues.apache.org/jira/browse/FLINK-10200

[jira] [Created] (FLINK-9902) Improve and refactor window checkpointing IT cases

2018-07-20 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9902: - Summary: Improve and refactor window checkpointing IT cases Key: FLINK-9902 URL: https://issues.apache.org/jira/browse/FLINK-9902 Project: Flink Issue

[jira] [Closed] (FLINK-9858) State TTL End-to-End Test

2018-07-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9858. - Resolution: Implemented Merged in: master: 01cf808ee8 release-1.6: 6a36afd > State TTL

[jira] [Closed] (FLINK-9902) Improve and refactor window checkpointing IT cases

2018-07-20 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9902. - Resolution: Implemented Merged in: master: d309e61 release-1.6: f19337a > Improve and refactor

[jira] [Created] (FLINK-9918) Outsource fastutil dependency to flink-shading.

2018-07-23 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9918: - Summary: Outsource fastutil dependency to flink-shading. Key: FLINK-9918 URL: https://issues.apache.org/jira/browse/FLINK-9918 Project: Flink Issue Type:

[jira] [Commented] (FLINK-9918) Outsource fastutil dependency to flink-shading.

2018-07-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552777#comment-16552777 ] Stefan Richter commented on FLINK-9918: --- I am currently checking if I can replace my need for the

[jira] [Commented] (FLINK-9918) Outsource fastutil dependency to flink-shading.

2018-07-23 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552776#comment-16552776 ] Stefan Richter commented on FLINK-9918: --- What would it help to guard against clashes with

[jira] [Created] (FLINK-9887) Ensure serializer upgrades work with timer service remake

2018-07-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9887: - Summary: Ensure serializer upgrades work with timer service remake Key: FLINK-9887 URL: https://issues.apache.org/jira/browse/FLINK-9887 Project: Flink

[jira] [Commented] (FLINK-8098) LeaseExpiredException when using FsStateBackend for checkpointing due to multiple mappers tries to access the same file.

2018-09-06 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605446#comment-16605446 ] Stefan Richter commented on FLINK-8098: --- Maybe you could first give us some more details, for

[jira] [Created] (FLINK-10297) PostVersionedIOReadableWritable ignores result of InputStream.read(...)

2018-09-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-10297: -- Summary: PostVersionedIOReadableWritable ignores result of InputStream.read(...) Key: FLINK-10297 URL: https://issues.apache.org/jira/browse/FLINK-10297 Project:

[jira] [Commented] (FLINK-10297) PostVersionedIOReadableWritable ignores result of InputStream.read(...)

2018-09-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606844#comment-16606844 ] Stefan Richter commented on FLINK-10297: Yes, that is a very common trap that can have very bad

[jira] [Comment Edited] (FLINK-10297) PostVersionedIOReadableWritable ignores result of InputStream.read(...)

2018-09-07 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606844#comment-16606844 ] Stefan Richter edited comment on FLINK-10297 at 9/7/18 8:35 AM: Yes,

[jira] [Closed] (FLINK-9735) Potential resource leak in RocksDBStateBackend#getDbOptions

2018-09-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9735. - Resolution: Fixed Merged in: master: 1a94c2094b > Potential resource leak in

[jira] [Commented] (FLINK-9486) Introduce TimerState in keyed state backend

2018-09-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610497#comment-16610497 ] Stefan Richter commented on FLINK-9486: --- Hi, you can migrate an old savepoint from earlier Flink

[jira] [Commented] (FLINK-9486) Introduce TimerState in keyed state backend

2018-09-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610602#comment-16610602 ] Stefan Richter commented on FLINK-9486: --- Exactly, that's how it is right now. In the future, we are

[jira] [Closed] (FLINK-10267) [State] Fix arbitrary iterator access on RocksDBMapIterator

2018-09-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10267. -- Resolution: Fixed Merged in: master: 16dc5978c7 release-1.6: a19e1ee3ba release-1.5:

[jira] [Commented] (FLINK-9736) Potential null reference in KeyGroupPartitionedPriorityQueue#poll()

2018-07-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16533515#comment-16533515 ] Stefan Richter commented on FLINK-9736: --- [~sihuazhou] Is correct, this heap is always initialized

[jira] [Closed] (FLINK-9736) Potential null reference in KeyGroupPartitionedPriorityQueue#poll()

2018-07-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9736. - Resolution: Not A Bug > Potential null reference in KeyGroupPartitionedPriorityQueue#poll() >

[jira] [Closed] (FLINK-9513) Wrap state binder with TTL logic

2018-07-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9513. - Resolution: Implemented Merged in: master: afdbf54713 > Wrap state binder with TTL logic >

[jira] [Commented] (FLINK-7775) Remove unreferenced method PermanentBlobCache#getNumberOfCachedJobs

2018-07-04 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16532638#comment-16532638 ] Stefan Richter commented on FLINK-7775: --- hi @yanghua it was already merged, please check the commit

[jira] [Created] (FLINK-9799) Generalize/unify state meta info

2018-07-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9799: - Summary: Generalize/unify state meta info Key: FLINK-9799 URL: https://issues.apache.org/jira/browse/FLINK-9799 Project: Flink Issue Type: Sub-task

[jira] [Closed] (FLINK-9511) Implement TTL config

2018-07-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9511. - Resolution: Implemented Merged in: master: dc7d81c9c0 > Implement TTL config >

[jira] [Closed] (FLINK-9701) Activate TTL in state descriptors

2018-07-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9701. - Resolution: Implemented Merged in: master: f45b7f7ff2 > Activate TTL in state descriptors >

[jira] [Commented] (FLINK-9831) Too many open files for RocksDB

2018-07-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541415#comment-16541415 ] Stefan Richter commented on FLINK-9831: --- In your list of open files, I can only see one from

[jira] [Comment Edited] (FLINK-9831) Too many open files for RocksDB

2018-07-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541621#comment-16541621 ] Stefan Richter edited comment on FLINK-9831 at 7/12/18 1:20 PM: Defaults

<    1   2   3   4   5   6   7   8   9   10   >