[jira] [Updated] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

2024-04-30 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-35217: --- Fix Version/s: 1.18.2 1.19.1 > Missing fsync in

[jira] [Closed] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

2024-04-30 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-35217. -- Resolution: Fixed Merged to master in

[jira] [Updated] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

2024-04-30 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-35217: --- Fix Version/s: 1.20.0 > Missing fsync in FileSystemCheckpointStorage >

[jira] [Assigned] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

2024-04-25 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-35217: -- Assignee: Stefan Richter > Missing fsync in FileSystemCheckpointStorage >

[jira] [Commented] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

2024-04-25 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840787#comment-17840787 ] Stefan Richter commented on FLINK-35217: I think you are right, close will only guarantee a

[jira] [Commented] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

2024-04-23 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840115#comment-17840115 ] Stefan Richter commented on FLINK-35217: Hi, the code is calling close on the output stream

[jira] [Updated] (FLINK-34693) Memory leak in KafkaWriter

2024-03-15 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-34693: --- Attachment: (was: image-2024-03-15-10-30-50-902.png) > Memory leak in KafkaWriter >

[jira] [Updated] (FLINK-34693) Memory leak in KafkaWriter

2024-03-15 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-34693: --- Description: KafkaWriter is keeping objects in Dequeue of closeables

[jira] [Updated] (FLINK-34693) Memory leak in KafkaWriter

2024-03-15 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-34693: --- Description: KafkaWriter is keeping instances of {{TwoPhaseCommitProducer}} in Dequeue of

[jira] [Created] (FLINK-34693) Memory leak in KafkaWriter

2024-03-15 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34693: -- Summary: Memory leak in KafkaWriter Key: FLINK-34693 URL: https://issues.apache.org/jira/browse/FLINK-34693 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-34693) Memory leak in KafkaWriter

2024-03-15 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34693: -- Summary: Memory leak in KafkaWriter Key: FLINK-34693 URL: https://issues.apache.org/jira/browse/FLINK-34693 Project: Flink Issue Type: Bug

[jira] [Closed] (FLINK-34579) Introduce metric for time since last completed checkpoint

2024-03-05 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-34579. -- Resolution: Won't Do > Introduce metric for time since last completed checkpoint >

[jira] [Created] (FLINK-34579) Introduce metric for time since last completed checkpoint

2024-03-05 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34579: -- Summary: Introduce metric for time since last completed checkpoint Key: FLINK-34579 URL: https://issues.apache.org/jira/browse/FLINK-34579 Project: Flink

[jira] [Created] (FLINK-34579) Introduce metric for time since last completed checkpoint

2024-03-05 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34579: -- Summary: Introduce metric for time since last completed checkpoint Key: FLINK-34579 URL: https://issues.apache.org/jira/browse/FLINK-34579 Project: Flink

[jira] [Closed] (FLINK-34546) Emit span with failure labels on failure

2024-03-01 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-34546. -- Resolution: Fixed > Emit span with failure labels on failure >

[jira] [Created] (FLINK-34546) Emit span with failure labels on failure

2024-02-29 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34546: -- Summary: Emit span with failure labels on failure Key: FLINK-34546 URL: https://issues.apache.org/jira/browse/FLINK-34546 Project: Flink Issue Type:

[jira] [Created] (FLINK-34546) Emit span with failure labels on failure

2024-02-29 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34546: -- Summary: Emit span with failure labels on failure Key: FLINK-34546 URL: https://issues.apache.org/jira/browse/FLINK-34546 Project: Flink Issue Type:

[jira] [Commented] (FLINK-33555) LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory:

2024-02-16 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817916#comment-17817916 ] Stefan Richter commented on FLINK-33555: [~mapohl] I did some work related to local recovery

[jira] [Commented] (FLINK-33962) Chaining-agnostic OperatorID generation for improved state compatibility on parallelism change

2024-02-07 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815274#comment-17815274 ] Stefan Richter commented on FLINK-33962: Hi [~Zhanghao Chen] ! The proposed change in this Jira

[jira] [Comment Edited] (FLINK-34050) Rocksdb state has space amplification after rescaling with DeleteRange

2024-02-05 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814312#comment-17814312 ] Stefan Richter edited comment on FLINK-34050 at 2/5/24 10:41 AM: - Just

[jira] [Commented] (FLINK-34050) Rocksdb state has space amplification after rescaling with DeleteRange

2024-02-05 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814312#comment-17814312 ] Stefan Richter commented on FLINK-34050: Just one idea: since the current proposal is making the

[jira] [Commented] (FLINK-34200) AutoRescalingITCase#testCheckpointRescalingInKeyedState fails

2024-01-26 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811194#comment-17811194 ] Stefan Richter commented on FLINK-34200: [~fanrui] I think you misunderstood my comment. I

[jira] [Resolved] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

2024-01-24 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-32410. Fix Version/s: 1.18.0 (was: 1.19.0) Resolution: Done >

[jira] [Commented] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

2024-01-24 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810420#comment-17810420 ] Stefan Richter commented on FLINK-32410: Yes, it's already done. > Allocate hash-based

[jira] [Resolved] (FLINK-33696) FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

2024-01-24 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-33696. Resolution: Done merged in 7db2ecad > FLIP-385: Add OpenTelemetryTraceReporter and

[jira] [Commented] (FLINK-34218) AutoRescalingITCase#testCheckpointRescalingInKeyedState fails

2024-01-24 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810313#comment-17810313 ] Stefan Richter commented on FLINK-34218: Hi, I also cannot reproduce the problem locally, but

[jira] [Updated] (FLINK-34199) Add tracing for durations of rescaling/restoring RocksDB incremental checkpoints from downloaded and local state

2024-01-23 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-34199: --- Summary: Add tracing for durations of rescaling/restoring RocksDB incremental checkpoints

[jira] [Created] (FLINK-34199) Add tracing for durations of rescaling/restoring from local state

2024-01-22 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34199: -- Summary: Add tracing for durations of rescaling/restoring from local state Key: FLINK-34199 URL: https://issues.apache.org/jira/browse/FLINK-34199 Project: Flink

[jira] [Created] (FLINK-34199) Add tracing for durations of rescaling/restoring from local state

2024-01-22 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34199: -- Summary: Add tracing for durations of rescaling/restoring from local state Key: FLINK-34199 URL: https://issues.apache.org/jira/browse/FLINK-34199 Project: Flink

[jira] [Created] (FLINK-34134) Add tracing for restored state size and locations

2024-01-17 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34134: -- Summary: Add tracing for restored state size and locations Key: FLINK-34134 URL: https://issues.apache.org/jira/browse/FLINK-34134 Project: Flink Issue

[jira] [Created] (FLINK-34134) Add tracing for restored state size and locations

2024-01-17 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-34134: -- Summary: Add tracing for restored state size and locations Key: FLINK-34134 URL: https://issues.apache.org/jira/browse/FLINK-34134 Project: Flink Issue

[jira] [Commented] (FLINK-32444) Enable object reuse for Flink SQL jobs by default

2023-11-30 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791536#comment-17791536 ] Stefan Richter commented on FLINK-32444: [~pnowojski] if there really is an issue with heap

[jira] [Closed] (FLINK-33341) Use available local keyed state for rescaling

2023-10-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-33341. -- Resolution: Fixed merged in a4ad86f  > Use available local keyed state for rescaling >

[jira] [Updated] (FLINK-33341) Use available local keyed state for rescaling

2023-10-26 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-33341: --- Summary: Use available local keyed state for rescaling (was: Use available local state for

[jira] [Commented] (FLINK-33341) Use available local state for rescaling

2023-10-24 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779129#comment-17779129 ] Stefan Richter commented on FLINK-33341: FYI, here is a link to the development branch:

[jira] [Commented] (FLINK-33341) Use available local state for rescaling

2023-10-24 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779124#comment-17779124 ] Stefan Richter commented on FLINK-33341: [~Yanfei Lei], yes only the previous local state is

[jira] [Commented] (FLINK-33341) Use available local state for rescaling

2023-10-23 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778677#comment-17778677 ] Stefan Richter commented on FLINK-33341: Exactly, we support local state for recovery - but not

[jira] [Created] (FLINK-33341) Use available local state for rescaling

2023-10-23 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33341: -- Summary: Use available local state for rescaling Key: FLINK-33341 URL: https://issues.apache.org/jira/browse/FLINK-33341 Project: Flink Issue Type:

[jira] [Created] (FLINK-33341) Use available local state for rescaling

2023-10-23 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33341: -- Summary: Use available local state for rescaling Key: FLINK-33341 URL: https://issues.apache.org/jira/browse/FLINK-33341 Project: Flink Issue Type:

[jira] [Created] (FLINK-33246) Add RescalingIT case that uses checkpoints and resource requests

2023-10-11 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33246: -- Summary: Add RescalingIT case that uses checkpoints and resource requests Key: FLINK-33246 URL: https://issues.apache.org/jira/browse/FLINK-33246 Project: Flink

[jira] [Created] (FLINK-33246) Add RescalingIT case that uses checkpoints and resource requests

2023-10-11 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33246: -- Summary: Add RescalingIT case that uses checkpoints and resource requests Key: FLINK-33246 URL: https://issues.apache.org/jira/browse/FLINK-33246 Project: Flink

[jira] [Created] (FLINK-33077) Minimize the risk of hard back-pressure with buffer debloating enabled

2023-09-12 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33077: -- Summary: Minimize the risk of hard back-pressure with buffer debloating enabled Key: FLINK-33077 URL: https://issues.apache.org/jira/browse/FLINK-33077 Project:

[jira] [Created] (FLINK-33077) Minimize the risk of hard back-pressure with buffer debloating enabled

2023-09-12 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33077: -- Summary: Minimize the risk of hard back-pressure with buffer debloating enabled Key: FLINK-33077 URL: https://issues.apache.org/jira/browse/FLINK-33077 Project:

[jira] [Updated] (FLINK-32782) Release Testing: Disable WAL in RocksDBWriteBatchWrapper by default

2023-08-29 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32782: --- Description: Covered by nightly tests, for example - run_test "Resuming Externalized

[jira] [Updated] (FLINK-32783) Release Testing: Improve parallel download of RocksDB incremental state

2023-08-29 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32783: --- Description: This feature is automatically used whenever we download state during a restart

[jira] [Updated] (FLINK-32783) Release Testing: Improve parallel download of RocksDB incremental state

2023-08-23 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32783: --- Description: This feature is automatically used whenever we download state during a restart

[jira] [Closed] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32681. -- Resolution: Fixed merged into master d11cc32 >

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749599#comment-17749599 ] Stefan Richter commented on FLINK-32681: [~Feifan Wang]Thanks for the offer but I've already

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-07-31 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749247#comment-17749247 ] Stefan Richter commented on FLINK-32681: I'm running on Mac, but with a sleep I already managed

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-07-31 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749203#comment-17749203 ] Stefan Richter commented on FLINK-32681: [~mapohl] I was trying to reproduce this locally

[jira] [Updated] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32410: --- Fix Version/s: 1.18.0 (was: 1.19.0) > Allocate hash-based

[jira] [Updated] (FLINK-32345) Improve parallel download of RocksDB incremental state

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32345: --- Fix Version/s: 1.18.0 (was: 1.19.0) > Improve parallel download of

[jira] [Closed] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32326. -- Resolution: Fixed > Disable WAL in RocksDBWriteBatchWrapper by default >

[jira] [Closed] (FLINK-32345) Improve parallel download of RocksDB incremental state

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32345. -- Resolution: Fixed > Improve parallel download of RocksDB incremental state >

[jira] [Updated] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32326: --- Fix Version/s: 1.18.0 (was: 1.19.0) > Disable WAL in

[jira] [Updated] (FLINK-32347) Exceptions from the CompletedCheckpointStore are not registered by the CheckpointFailureManager

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32347: --- Fix Version/s: 1.18.0 > Exceptions from the CompletedCheckpointStore are not registered by

[jira] [Closed] (FLINK-32347) Exceptions from the CompletedCheckpointStore are not registered by the CheckpointFailureManager

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32347. -- Resolution: Fixed > Exceptions from the CompletedCheckpointStore are not registered by the >

[jira] [Closed] (FLINK-32441) DefaultSchedulerTest#testTriggerCheckpointAndCompletedAfterStore fails with timeout on AZP

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32441. -- Resolution: Fixed > DefaultSchedulerTest#testTriggerCheckpointAndCompletedAfterStore fails

[jira] [Commented] (FLINK-32441) DefaultSchedulerTest#testTriggerCheckpointAndCompletedAfterStore fails with timeout on AZP

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737642#comment-17737642 ] Stefan Richter commented on FLINK-32441: Fixed in master 0c787f5. >

[jira] (FLINK-30859) Remove flink-connector-kafka from master branch

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30859 ] Stefan Richter deleted comment on FLINK-30859: was (Author: srichter): [~tzulitai] I think you forgot to remove some code here:

[jira] [Commented] (FLINK-30859) Remove flink-connector-kafka from master branch

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737569#comment-17737569 ] Stefan Richter commented on FLINK-30859: [~tzulitai] I think you forgot to remove some code

[jira] [Assigned] (FLINK-32441) DefaultSchedulerTest#testTriggerCheckpointAndCompletedAfterStore fails with timeout on AZP

2023-06-27 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-32441: -- Assignee: Stefan Richter >

[jira] [Updated] (FLINK-32437) Determine and set correct maxParallelism for operator chains

2023-06-26 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32437: --- Fix Version/s: 2.0.0 (was: 1.19.0) > Determine and set correct

[jira] [Created] (FLINK-32437) Determine and set correct maxParallelism for operator chains

2023-06-26 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32437: -- Summary: Determine and set correct maxParallelism for operator chains Key: FLINK-32437 URL: https://issues.apache.org/jira/browse/FLINK-32437 Project: Flink

[jira] [Created] (FLINK-32437) Determine and set correct maxParallelism for operator chains

2023-06-26 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32437: -- Summary: Determine and set correct maxParallelism for operator chains Key: FLINK-32437 URL: https://issues.apache.org/jira/browse/FLINK-32437 Project: Flink

[jira] [Created] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

2023-06-21 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32410: -- Summary: Allocate hash-based collections with sufficient capacity for expected size Key: FLINK-32410 URL: https://issues.apache.org/jira/browse/FLINK-32410

[jira] [Created] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

2023-06-21 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32410: -- Summary: Allocate hash-based collections with sufficient capacity for expected size Key: FLINK-32410 URL: https://issues.apache.org/jira/browse/FLINK-32410

[jira] [Commented] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-06-19 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17734183#comment-17734183 ] Stefan Richter commented on FLINK-31238: [~mayuehappy] Thanks for working on this topic! I saw

[jira] [Commented] (FLINK-32347) Exceptions from the CompletedCheckpointStore are not registered by the CheckpointFailureManager

2023-06-15 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733059#comment-17733059 ] Stefan Richter commented on FLINK-32347: Hey, I've already opened a PR. The issue was still

[jira] [Assigned] (FLINK-32347) Exceptions from the CompletedCheckpointStore are not registered by the CheckpointFailureManager

2023-06-15 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-32347: -- Assignee: Stefan Richter > Exceptions from the CompletedCheckpointStore are not

[jira] [Created] (FLINK-32345) Improve parallel download of RocksDB incremental state

2023-06-15 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32345: -- Summary: Improve parallel download of RocksDB incremental state Key: FLINK-32345 URL: https://issues.apache.org/jira/browse/FLINK-32345 Project: Flink

[jira] [Created] (FLINK-32345) Improve parallel download of RocksDB incremental state

2023-06-15 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32345: -- Summary: Improve parallel download of RocksDB incremental state Key: FLINK-32345 URL: https://issues.apache.org/jira/browse/FLINK-32345 Project: Flink

[jira] [Created] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

2023-06-13 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32326: -- Summary: Disable WAL in RocksDBWriteBatchWrapper by default Key: FLINK-32326 URL: https://issues.apache.org/jira/browse/FLINK-32326 Project: Flink Issue

[jira] [Created] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

2023-06-13 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-32326: -- Summary: Disable WAL in RocksDBWriteBatchWrapper by default Key: FLINK-32326 URL: https://issues.apache.org/jira/browse/FLINK-32326 Project: Flink Issue

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-16 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723051#comment-17723051 ] Stefan Richter commented on FLINK-31963: Yes, PR is currently in review here:

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-12 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722120#comment-17722120 ] Stefan Richter commented on FLINK-31963: Seems that this is similar to the problem described in

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-11 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721788#comment-17721788 ] Stefan Richter commented on FLINK-31963: I have a local reproducer as well as a fix, will open a

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-10 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721387#comment-17721387 ] Stefan Richter commented on FLINK-31963: [~masteryhx] Did your job also make use of

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-08 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720596#comment-17720596 ] Stefan Richter commented on FLINK-31963: Hi, just to clarify: when you say a checkpoint that

[jira] [Created] (FLINK-13325) Add test case for FLINK-13249

2019-07-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-13325: -- Summary: Add test case for FLINK-13249 Key: FLINK-13325 URL: https://issues.apache.org/jira/browse/FLINK-13325 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-13325) Add test case for FLINK-13249

2019-07-18 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-13325: -- Summary: Add test case for FLINK-13249 Key: FLINK-13325 URL: https://issues.apache.org/jira/browse/FLINK-13325 Project: Flink Issue Type: Sub-task

[jira] [Closed] (FLINK-13249) Distributed Jepsen test fails with blocked TaskExecutor

2019-07-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-13249. -- Resolution: Fixed Merged in: master: 23bd23b325 release-1.9: 3eff6387b5 > Distributed Jepsen

[jira] [Closed] (FLINK-13256) Periodical checkpointing is stopped after failovers

2019-07-18 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-13256. -- Resolution: Fixed Merged in: master: 1ec34249a0 release-1.9: b7bfafca14 > Periodical

[jira] [Commented] (FLINK-13249) Distributed Jepsen test fails with blocked TaskExecutor

2019-07-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885981#comment-16885981 ] Stefan Richter commented on FLINK-13249: My tendency is also more towards having a

[jira] [Commented] (FLINK-13249) Distributed Jepsen test fails with blocked TaskExecutor

2019-07-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885059#comment-16885059 ] Stefan Richter commented on FLINK-13249: [~till.rohrmann] alright, I think then we have a

[jira] [Commented] (FLINK-13249) Distributed Jepsen test fails with blocked TaskExecutor

2019-07-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885002#comment-16885002 ] Stefan Richter commented on FLINK-13249: [~gaoyunhaii] That is also how I understood your

[jira] [Commented] (FLINK-13249) Distributed Jepsen test fails with blocked TaskExecutor

2019-07-15 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884960#comment-16884960 ] Stefan Richter commented on FLINK-13249: [~gaoyunhaii] thanks for the input, I think what you

[jira] [Updated] (FLINK-12958) Integrate AsyncWaitOperator with mailbox

2019-07-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-12958: --- Labels: (was: pull-request-available) > Integrate AsyncWaitOperator with mailbox >

[jira] [Created] (FLINK-13248) Enhance mailbox executor with yield-to-downstream functionality

2019-07-12 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-13248: -- Summary: Enhance mailbox executor with yield-to-downstream functionality Key: FLINK-13248 URL: https://issues.apache.org/jira/browse/FLINK-13248 Project: Flink

[jira] [Created] (FLINK-13248) Enhance mailbox executor with yield-to-downstream functionality

2019-07-12 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-13248: -- Summary: Enhance mailbox executor with yield-to-downstream functionality Key: FLINK-13248 URL: https://issues.apache.org/jira/browse/FLINK-13248 Project: Flink

[jira] [Assigned] (FLINK-12958) Integrate AsyncWaitOperator with mailbox

2019-07-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-12958: -- Assignee: (was: Stefan Richter) > Integrate AsyncWaitOperator with mailbox >

[jira] [Closed] (FLINK-12804) Introduce mailbox-based ExecutorService

2019-07-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-12804. -- Resolution: Implemented Merged in: master: 6cf98b671d > Introduce mailbox-based

[jira] [Updated] (FLINK-12804) Introduce mailbox-based ExecutorService

2019-07-12 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-12804: --- Fix Version/s: (was: 1.9.0) 1.10.0 > Introduce mailbox-based

[jira] [Commented] (FLINK-13072) RocksDBStateBachend is not thread safe and data loss silently

2019-07-10 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881825#comment-16881825 ] Stefan Richter commented on FLINK-13072: I think it is surely not a bad idea to improve or

[jira] [Closed] (FLINK-13063) AsyncWaitOperator shouldn't be releasing checkpointingLock

2019-07-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-13063. -- Resolution: Fixed Release Note: This changes the default chaining behavior of the

[jira] [Commented] (FLINK-13072) RocksDBStateBachend is not thread safe and data loss silently

2019-07-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881149#comment-16881149 ] Stefan Richter commented on FLINK-13072: [~zicat] After reading my previous comment, do you

[jira] [Closed] (FLINK-12730) Combine BitSet implementations in flink-runtime

2019-07-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-12730. -- Resolution: Implemented Merged in: master: 14c4b23 > Combine BitSet implementations in

[jira] [Closed] (FLINK-12693) Store state per key-group in CopyOnWriteStateTable

2019-07-09 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-12693. -- Resolution: Implemented Merged in: master: 8f47b38 > Store state per key-group in

[jira] [Assigned] (FLINK-13063) AsyncWaitOperator shouldn't be releasing checkpointingLock

2019-07-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-13063: -- Assignee: Stefan Richter (was: Piotr Nowojski) > AsyncWaitOperator shouldn't be

[jira] [Comment Edited] (FLINK-13072) RocksDBStateBachend is not thread safe and data loss silently

2019-07-05 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879099#comment-16879099 ] Stefan Richter edited comment on FLINK-13072 at 7/5/19 9:21 AM: [~zicat]

  1   2   3   4   5   6   7   8   9   10   >