Re: [VOTE] FLIP-452: Allow Skipping Invocation of Function Calls While Constant-folding

Hi Alan, Thanks for this proposal, the ability to exclude functions from constant folding makes sense to me. +1 (binding) Best, Stefan > On 8. May 2024, at 02:01, Alan Sheinberg > wrote: > > Hi everyone, > > I'd like to start a vote on FLIP-452 [1]. It covers adding a new method >

Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

+1 (binding) Thanks for updating to a new version! Best, Stefan > On 6. May 2024, at 08:36, Hangxiang Yu wrote: > > +1（binding） > > On Mon, May 6, 2024 at 12:25 PM Yuan Mei > wrote: > >> +1（binding） >> >> Best >> Yuan >> >> On Mon, May 6, 2024 at 11:28 AM

[jira] [Updated] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-35217: --- Fix Version/s: 1.18.2 1.19.1 > Missing fs

Re: [DISCUSS] FLIP-444: Native file copy support

Hi, Thanks for the proposal, I think improving download speed in this way is a great idea. Hope we can have similar improvements for other clouds as well. Best, Stefan > On 30. Apr 2024, at 15:15, Piotr Nowojski wrote: > > Hi all! > > I would like to put under discussion: > > FLIP-444:

Re: [DISCUSS] FLIP-443: Interruptible watermark processing

Thanks for the improvement proposal, I’m +1 for the change! Best, Stefan > On 30. Apr 2024, at 15:23, Roman Khachatryan wrote: > > Thanks for the proposal, I definitely see the need for this improvement, +1. > > Regards, > Roman > > > On Tue, Apr 30, 2024 at 3:11 PM Piotr Nowojski

[jira] [Closed] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-35217. -- Resolution: Fixed Merged to master in [{{80af4d5}}|https://github.com/apache/flink/commit

[jira] [Updated] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-35217: --- Fix Version/s: 1.20.0 > Missing fsync in FileSystemCheckpointStor

[jira] [Assigned] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-35217: -- Assignee: Stefan Richter > Missing fsync in FileSystemCheckpointStor

[jira] [Commented] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840787#comment-17840787 ] Stefan Richter commented on FLINK-35217: I think you are right, close will only guarantee

[jira] [Commented] (FLINK-35217) Missing fsync in FileSystemCheckpointStorage

[ https://issues.apache.org/jira/browse/FLINK-35217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840115#comment-17840115 ] Stefan Richter commented on FLINK-35217: Hi, the code is calling close on the output stream

[jira] [Updated] (FLINK-34693) Memory leak in KafkaWriter

[ https://issues.apache.org/jira/browse/FLINK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-34693: --- Attachment: (was: image-2024-03-15-10-30-50-902.png) > Memory leak in KafkaWri

[jira] [Updated] (FLINK-34693) Memory leak in KafkaWriter

[ https://issues.apache.org/jira/browse/FLINK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-34693: --- Description: KafkaWriter is keeping objects in Dequeue of closeables

[jira] [Updated] (FLINK-34693) Memory leak in KafkaWriter

[ https://issues.apache.org/jira/browse/FLINK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-34693: --- Description: KafkaWriter is keeping instances of {{TwoPhaseCommitProducer}} in Dequeue

[jira] [Created] (FLINK-34693) Memory leak in KafkaWriter

Stefan Richter created FLINK-34693: -- Summary: Memory leak in KafkaWriter Key: FLINK-34693 URL: https://issues.apache.org/jira/browse/FLINK-34693 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-34693) Memory leak in KafkaWriter

Stefan Richter created FLINK-34693: -- Summary: Memory leak in KafkaWriter Key: FLINK-34693 URL: https://issues.apache.org/jira/browse/FLINK-34693 Project: Flink Issue Type: Bug

[jira] [Closed] (FLINK-34579) Introduce metric for time since last completed checkpoint

[ https://issues.apache.org/jira/browse/FLINK-34579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-34579. -- Resolution: Won't Do > Introduce metric for time since last completed checkpo

[jira] [Created] (FLINK-34579) Introduce metric for time since last completed checkpoint

Stefan Richter created FLINK-34579: -- Summary: Introduce metric for time since last completed checkpoint Key: FLINK-34579 URL: https://issues.apache.org/jira/browse/FLINK-34579 Project: Flink

[jira] [Created] (FLINK-34579) Introduce metric for time since last completed checkpoint

Stefan Richter created FLINK-34579: -- Summary: Introduce metric for time since last completed checkpoint Key: FLINK-34579 URL: https://issues.apache.org/jira/browse/FLINK-34579 Project: Flink

[jira] [Closed] (FLINK-34546) Emit span with failure labels on failure

[ https://issues.apache.org/jira/browse/FLINK-34546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-34546. -- Resolution: Fixed > Emit span with failure labels on fail

[jira] [Created] (FLINK-34546) Emit span with failure labels on failure

Stefan Richter created FLINK-34546: -- Summary: Emit span with failure labels on failure Key: FLINK-34546 URL: https://issues.apache.org/jira/browse/FLINK-34546 Project: Flink Issue Type

[jira] [Created] (FLINK-34546) Emit span with failure labels on failure

Stefan Richter created FLINK-34546: -- Summary: Emit span with failure labels on failure Key: FLINK-34546 URL: https://issues.apache.org/jira/browse/FLINK-34546 Project: Flink Issue Type

[jira] [Commented] (FLINK-33555) LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory:

[ https://issues.apache.org/jira/browse/FLINK-33555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817916#comment-17817916 ] Stefan Richter commented on FLINK-33555: [~mapohl] I did some work related to local recovery

[jira] [Commented] (FLINK-33962) Chaining-agnostic OperatorID generation for improved state compatibility on parallelism change

[ https://issues.apache.org/jira/browse/FLINK-33962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815274#comment-17815274 ] Stefan Richter commented on FLINK-33962: Hi [~Zhanghao Chen] ! The proposed change in this Jira

[jira] [Comment Edited] (FLINK-34050) Rocksdb state has space amplification after rescaling with DeleteRange

[ https://issues.apache.org/jira/browse/FLINK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814312#comment-17814312 ] Stefan Richter edited comment on FLINK-34050 at 2/5/24 10:41 AM: - Just

[jira] [Commented] (FLINK-34050) Rocksdb state has space amplification after rescaling with DeleteRange

[ https://issues.apache.org/jira/browse/FLINK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814312#comment-17814312 ] Stefan Richter commented on FLINK-34050: Just one idea: since the current proposal is making

[jira] [Commented] (FLINK-34200) AutoRescalingITCase#testCheckpointRescalingInKeyedState fails

[ https://issues.apache.org/jira/browse/FLINK-34200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811194#comment-17811194 ] Stefan Richter commented on FLINK-34200: [~fanrui] I think you misunderstood my comment. I

[jira] [Resolved] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

[ https://issues.apache.org/jira/browse/FLINK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-32410. Fix Version/s: 1.18.0 (was: 1.19.0) Resolution: Done

[jira] [Commented] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

[ https://issues.apache.org/jira/browse/FLINK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810420#comment-17810420 ] Stefan Richter commented on FLINK-32410: Yes, it's already done. > Allocate hash-ba

[jira] [Resolved] (FLINK-33696) FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

[ https://issues.apache.org/jira/browse/FLINK-33696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-33696. Resolution: Done merged in 7db2ecad > FLIP-385: Add OpenTelemetryTraceRepor

[jira] [Commented] (FLINK-34218) AutoRescalingITCase#testCheckpointRescalingInKeyedState fails

[ https://issues.apache.org/jira/browse/FLINK-34218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810313#comment-17810313 ] Stefan Richter commented on FLINK-34218: Hi, I also cannot reproduce the problem locally

[jira] [Updated] (FLINK-34199) Add tracing for durations of rescaling/restoring RocksDB incremental checkpoints from downloaded and local state

[ https://issues.apache.org/jira/browse/FLINK-34199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-34199: --- Summary: Add tracing for durations of rescaling/restoring RocksDB incremental checkpoints

[jira] [Created] (FLINK-34199) Add tracing for durations of rescaling/restoring from local state

Stefan Richter created FLINK-34199: -- Summary: Add tracing for durations of rescaling/restoring from local state Key: FLINK-34199 URL: https://issues.apache.org/jira/browse/FLINK-34199 Project: Flink

[jira] [Created] (FLINK-34199) Add tracing for durations of rescaling/restoring from local state

Stefan Richter created FLINK-34199: -- Summary: Add tracing for durations of rescaling/restoring from local state Key: FLINK-34199 URL: https://issues.apache.org/jira/browse/FLINK-34199 Project: Flink

[jira] [Created] (FLINK-34134) Add tracing for restored state size and locations

Stefan Richter created FLINK-34134: -- Summary: Add tracing for restored state size and locations Key: FLINK-34134 URL: https://issues.apache.org/jira/browse/FLINK-34134 Project: Flink Issue

[jira] [Created] (FLINK-34134) Add tracing for restored state size and locations

Stefan Richter created FLINK-34134: -- Summary: Add tracing for restored state size and locations Key: FLINK-34134 URL: https://issues.apache.org/jira/browse/FLINK-34134 Project: Flink Issue

[jira] [Commented] (FLINK-32444) Enable object reuse for Flink SQL jobs by default

[ https://issues.apache.org/jira/browse/FLINK-32444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791536#comment-17791536 ] Stefan Richter commented on FLINK-32444: [~pnowojski] if there really is an issue with heap

Re: [VOTE] FLIP-386: Support adding custom metrics in Recovery Spans

+1 (binding) Best, Stefan > On 23. Nov 2023, at 09:49, Roman Khachatryan wrote: > > +1 (binding) > > Regards, > Roman > > > On Wed, Nov 22, 2023 at 12:55 PM Rui Fan <1996fan...@gmail.com > > wrote: > >> +1(binding) >> >> Thanks for driving this proposal! >>

Re: [VOTE] FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

+1 (binding) Best, Stefan > On 22. Nov 2023, at 12:34, Jing Ge wrote: > > +1(binding) > Thanks! > > Best Regards, > Jing > > On Wed, Nov 22, 2023 at 11:21 AM Roman Khachatryan > wrote: > >> +1 (binding) >> >> Regards, >> Roman >> >> On Wed, Nov 22, 2023, 7:30 AM

Re: [VOTE] FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

+1 (binding) Best, Stefan > On 22. Nov 2023, at 11:20, Roman Khachatryan wrote: > > +1 (binding) > > Regards, > Roman > > On Wed, Nov 22, 2023, 7:08 AM Zakelly Lan > wrote: > >> +1(non-binding) >> >> Best, >> Zakelly >> >> On Wed, Nov 22, 2023 at 3:04 PM

[jira] [Closed] (FLINK-33341) Use available local keyed state for rescaling

[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-33341. -- Resolution: Fixed merged in a4ad86f  > Use available local keyed state for rescal

[jira] [Updated] (FLINK-33341) Use available local keyed state for rescaling

[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-33341: --- Summary: Use available local keyed state for rescaling (was: Use available local state

[jira] [Commented] (FLINK-33341) Use available local state for rescaling

[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779129#comment-17779129 ] Stefan Richter commented on FLINK-33341: FYI, here is a link to the development branch: https

[jira] [Commented] (FLINK-33341) Use available local state for rescaling

[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779124#comment-17779124 ] Stefan Richter commented on FLINK-33341: [~Yanfei Lei], yes only the previous local state

[jira] [Commented] (FLINK-33341) Use available local state for rescaling

[ https://issues.apache.org/jira/browse/FLINK-33341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778677#comment-17778677 ] Stefan Richter commented on FLINK-33341: Exactly, we support local state for recovery

[jira] [Created] (FLINK-33341) Use available local state for rescaling

Stefan Richter created FLINK-33341: -- Summary: Use available local state for rescaling Key: FLINK-33341 URL: https://issues.apache.org/jira/browse/FLINK-33341 Project: Flink Issue Type

[jira] [Created] (FLINK-33341) Use available local state for rescaling

Stefan Richter created FLINK-33341: -- Summary: Use available local state for rescaling Key: FLINK-33341 URL: https://issues.apache.org/jira/browse/FLINK-33341 Project: Flink Issue Type

[jira] [Created] (FLINK-33246) Add RescalingIT case that uses checkpoints and resource requests

Stefan Richter created FLINK-33246: -- Summary: Add RescalingIT case that uses checkpoints and resource requests Key: FLINK-33246 URL: https://issues.apache.org/jira/browse/FLINK-33246 Project: Flink

[jira] [Created] (FLINK-33246) Add RescalingIT case that uses checkpoints and resource requests

Stefan Richter created FLINK-33246: -- Summary: Add RescalingIT case that uses checkpoints and resource requests Key: FLINK-33246 URL: https://issues.apache.org/jira/browse/FLINK-33246 Project: Flink

[jira] [Created] (FLINK-33077) Minimize the risk of hard back-pressure with buffer debloating enabled

Stefan Richter created FLINK-33077: -- Summary: Minimize the risk of hard back-pressure with buffer debloating enabled Key: FLINK-33077 URL: https://issues.apache.org/jira/browse/FLINK-33077 Project

[jira] [Created] (FLINK-33077) Minimize the risk of hard back-pressure with buffer debloating enabled

Stefan Richter created FLINK-33077: -- Summary: Minimize the risk of hard back-pressure with buffer debloating enabled Key: FLINK-33077 URL: https://issues.apache.org/jira/browse/FLINK-33077 Project

Re: [DISCUSS] FLIP-357: Deprecate Iteration API of DataStream

+1 Thanks, Stefan > On 5. Sep 2023, at 10:45, David Morávek wrote: > > +1 since there is an alternative, more complete implementation available > > Best, > D. > > On Sat, Sep 2, 2023 at 12:07 AM David Anderson > wrote: > >> +1 >> >> Keeping the legacy

[jira] [Updated] (FLINK-32782) Release Testing: Disable WAL in RocksDBWriteBatchWrapper by default

[ https://issues.apache.org/jira/browse/FLINK-32782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32782: --- Description: Covered by nightly tests, for example - run_test "Resuming Externa

[jira] [Updated] (FLINK-32783) Release Testing: Improve parallel download of RocksDB incremental state

[ https://issues.apache.org/jira/browse/FLINK-32783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32783: --- Description: This feature is automatically used whenever we download state during a restart

[jira] [Updated] (FLINK-32783) Release Testing: Improve parallel download of RocksDB incremental state

[ https://issues.apache.org/jira/browse/FLINK-32783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32783: --- Description: This feature is automatically used whenever we download state during a restart

[jira] [Closed] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32681. -- Resolution: Fixed merged into master d11cc32

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749599#comment-17749599 ] Stefan Richter commented on FLINK-32681: [~Feifan Wang]Thanks for the offer but I've already

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749247#comment-17749247 ] Stefan Richter commented on FLINK-32681: I'm running on Mac, but with a sleep I already managed

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749203#comment-17749203 ] Stefan Richter commented on FLINK-32681: [~mapohl] I was trying to reproduce this locally

Re: [DISCUSS][2.0] FLIP-349: Move RocksDB statebackend classes to o.a.f.state.rocksdb package

+1 > On 24. Jul 2023, at 12:25, Chesnay Schepler wrote: > > To properly reflect the state of the rocksdb statebackend I propose to move > all classes in the state-backend-rocksdb module under the classes to > o.a.f.state.rocksdb package. > > >

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

+1 (binding) Thanks, Stefan > On 20. Jul 2023, at 05:24, Zhu Zhu wrote: > > +1 (binding) > > Thanks, > Zhu > > yuxia mailto:luoyu...@alumni.sjtu.edu.cn>> > 于2023年7月20日周四 09:23写道： >> >> +1（binding) >> >> Best regards, >> Yuxia >> >> - 原始邮件 - >> 发件人: "Guowei Ma" >> 收件人: "dev" >>

Re: [DISCUSS] FLIP-325: Support configuring end-to-end allowed latency

Hi, After reading through the discussion, I think the FLIP should provide additional details and explanations about the exact semantics of the end-to-end latency configuration and how it interacts with all other configurations around latency, such as checkpointing. In this context, I have a

Re: [VOTE] FLIP-321: introduce an API deprecation process

+1 (binding) > On 3. Jul 2023, at 10:08, Martijn Visser wrote: > > +1 (binding) > > > > On Mon, Jul 3, 2023 at 10:03 AM Xintong Song > wrote: > >> +1 (binding) >> >> Best, >> >> Xintong >> >> >> >> On Sat, Jul 1, 2023 at 11:26 PM Dong Lin wrote: >> >>>

[jira] [Updated] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

[ https://issues.apache.org/jira/browse/FLINK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32410: --- Fix Version/s: 1.18.0 (was: 1.19.0) > Allocate hash-ba

[jira] [Updated] (FLINK-32345) Improve parallel download of RocksDB incremental state

[ https://issues.apache.org/jira/browse/FLINK-32345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32345: --- Fix Version/s: 1.18.0 (was: 1.19.0) > Improve parallel downl

[jira] [Closed] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

[ https://issues.apache.org/jira/browse/FLINK-32326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32326. -- Resolution: Fixed > Disable WAL in RocksDBWriteBatchWrapper by defa

[jira] [Closed] (FLINK-32345) Improve parallel download of RocksDB incremental state

[ https://issues.apache.org/jira/browse/FLINK-32345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32345. -- Resolution: Fixed > Improve parallel download of RocksDB incremental st

[jira] [Updated] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

[ https://issues.apache.org/jira/browse/FLINK-32326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32326: --- Fix Version/s: 1.18.0 (was: 1.19.0) > Disable

[jira] [Updated] (FLINK-32347) Exceptions from the CompletedCheckpointStore are not registered by the CheckpointFailureManager

[ https://issues.apache.org/jira/browse/FLINK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32347: --- Fix Version/s: 1.18.0 > Exceptions from the CompletedCheckpointStore are not registe

[jira] [Closed] (FLINK-32347) Exceptions from the CompletedCheckpointStore are not registered by the CheckpointFailureManager

[ https://issues.apache.org/jira/browse/FLINK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32347. -- Resolution: Fixed > Exceptions from the CompletedCheckpointStore are not registe

[jira] [Closed] (FLINK-32441) DefaultSchedulerTest#testTriggerCheckpointAndCompletedAfterStore fails with timeout on AZP

[ https://issues.apache.org/jira/browse/FLINK-32441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32441. -- Resolution: Fixed > DefaultSchedulerTest#testTriggerCheckpointAndCompletedAfterStore fa

[jira] [Commented] (FLINK-32441) DefaultSchedulerTest#testTriggerCheckpointAndCompletedAfterStore fails with timeout on AZP

[ https://issues.apache.org/jira/browse/FLINK-32441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737642#comment-17737642 ] Stefan Richter commented on FLINK-32441: Fixed in master 0c787f5. > DefaultSchedulerT

[jira] (FLINK-30859) Remove flink-connector-kafka from master branch

[ https://issues.apache.org/jira/browse/FLINK-30859 ] Stefan Richter deleted comment on FLINK-30859: was (Author: srichter): [~tzulitai] I think you forgot to remove some code here: https://github.com/apache/flink/blob

[jira] [Commented] (FLINK-30859) Remove flink-connector-kafka from master branch

[ https://issues.apache.org/jira/browse/FLINK-30859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737569#comment-17737569 ] Stefan Richter commented on FLINK-30859: [~tzulitai] I think you forgot to remove some code here

[jira] [Assigned] (FLINK-32441) DefaultSchedulerTest#testTriggerCheckpointAndCompletedAfterStore fails with timeout on AZP

[ https://issues.apache.org/jira/browse/FLINK-32441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-32441: -- Assignee: Stefan Richter > DefaultSchedulerT

[jira] [Updated] (FLINK-32437) Determine and set correct maxParallelism for operator chains

[ https://issues.apache.org/jira/browse/FLINK-32437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-32437: --- Fix Version/s: 2.0.0 (was: 1.19.0) > Determine and set corr

[jira] [Created] (FLINK-32437) Determine and set correct maxParallelism for operator chains

Stefan Richter created FLINK-32437: -- Summary: Determine and set correct maxParallelism for operator chains Key: FLINK-32437 URL: https://issues.apache.org/jira/browse/FLINK-32437 Project: Flink

[jira] [Created] (FLINK-32437) Determine and set correct maxParallelism for operator chains

Stefan Richter created FLINK-32437: -- Summary: Determine and set correct maxParallelism for operator chains Key: FLINK-32437 URL: https://issues.apache.org/jira/browse/FLINK-32437 Project: Flink

[jira] [Created] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

Stefan Richter created FLINK-32410: -- Summary: Allocate hash-based collections with sufficient capacity for expected size Key: FLINK-32410 URL: https://issues.apache.org/jira/browse/FLINK-32410

[jira] [Created] (FLINK-32410) Allocate hash-based collections with sufficient capacity for expected size

Stefan Richter created FLINK-32410: -- Summary: Allocate hash-based collections with sufficient capacity for expected size Key: FLINK-32410 URL: https://issues.apache.org/jira/browse/FLINK-32410

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

Hi Xintong, Thanks for the summary, most of the points that you agreed upon also make sense to me. > 2. Dropping deprecated Public APIs in minor releases, or demoting APIs > from Public to PublicEvolving / Experimental / Retired in any version bump, > are not good practices. I hope we

[jira] [Commented] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17734183#comment-17734183 ] Stefan Richter commented on FLINK-31238: [~mayuehappy] Thanks for working on this topic! I saw

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

his means there will be a cycle > in the data flow, it will be hard for current Flink to schedule this kind > of graph. I admit we can find a way to do this, but that's probably a > bit outside the scope of this FLIP. So let's do these complex > optimizations later, WDYT？ > >

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

s#More+underlying+implementations). > > Best, > Lijie > > Stefan Richter <mailto:srich...@confluent.io.invalid>> 于2023年6月19日周一 15:58写道： > >> >> Hi Lijie, >> >> thanks for your response, I agree with what you said about points 2 and 3. >> L

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

filter > implementation introduces some complexity (we need to implement it, test > it, etc), and is not the focus of this FLIP. > > [1] > https://www.google.com/url?q=https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/tuning/%23local-global-aggregation=gm

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

load partitions once we collected enough keys for one round of loading. Best, Stefan <https://www.confluent.io/> Stefan Richter Principal Engineer II Follow us: <https://www.confluent.io/blog?utm_source=footer_medium=email_campaign=ch.email-signature_type.community_content.blog

[jira] [Commented] (FLINK-32347) Exceptions from the CompletedCheckpointStore are not registered by the CheckpointFailureManager

[ https://issues.apache.org/jira/browse/FLINK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733059#comment-17733059 ] Stefan Richter commented on FLINK-32347: Hey, I've already opened a PR. The issue was still

[jira] [Assigned] (FLINK-32347) Exceptions from the CompletedCheckpointStore are not registered by the CheckpointFailureManager

[ https://issues.apache.org/jira/browse/FLINK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter reassigned FLINK-32347: -- Assignee: Stefan Richter > Exceptions from the CompletedCheckpointSt

[jira] [Created] (FLINK-32345) Improve parallel download of RocksDB incremental state

Stefan Richter created FLINK-32345: -- Summary: Improve parallel download of RocksDB incremental state Key: FLINK-32345 URL: https://issues.apache.org/jira/browse/FLINK-32345 Project: Flink

[jira] [Created] (FLINK-32345) Improve parallel download of RocksDB incremental state

Stefan Richter created FLINK-32345: -- Summary: Improve parallel download of RocksDB incremental state Key: FLINK-32345 URL: https://issues.apache.org/jira/browse/FLINK-32345 Project: Flink

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

evel of stability for Flink. > > So, it looks like our story for API stability and compatibility would be > complete with this FLIP. > > Thanks, > > Jiangjie (Becket) Qin > > > On Tue, Jun 13, 2023 at 12:30 AM Stefan Richter > mailto:srich...@confluent.io.inval

[jira] [Created] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

Stefan Richter created FLINK-32326: -- Summary: Disable WAL in RocksDBWriteBatchWrapper by default Key: FLINK-32326 URL: https://issues.apache.org/jira/browse/FLINK-32326 Project: Flink Issue

[jira] [Created] (FLINK-32326) Disable WAL in RocksDBWriteBatchWrapper by default

Stefan Richter created FLINK-32326: -- Summary: Disable WAL in RocksDBWriteBatchWrapper by default Key: FLINK-32326 URL: https://issues.apache.org/jira/browse/FLINK-32326 Project: Flink Issue

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

it easier to write adapter code than changing method signatures in-place on the existing interface. Those concerns should be considered in our process for evolving interfaces. Best, Stefan <https://www.confluent.io/> Stefan Richter Principal Engineer II Follow us: <https://www.con

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723051#comment-17723051 ] Stefan Richter commented on FLINK-31963: Yes, PR is currently in review here: https://github.com

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722120#comment-17722120 ] Stefan Richter commented on FLINK-31963: Seems that this is similar to the problem described

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721788#comment-17721788 ] Stefan Richter commented on FLINK-31963: I have a local reproducer as well as a fix, will open

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721387#comment-17721387 ] Stefan Richter commented on FLINK-31963: [~masteryhx] Did your job also make use of side-outputs

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720596#comment-17720596 ] Stefan Richter commented on FLINK-31963: Hi, just to clarify: when you say a checkpoint

Re: [bitcoin-dev] Surprisingly, Tail Emission Is Not Inflationary

I very much agree with AJ here. This is something I remember discussing on Bitcointalk back in 2011: I find it highly intuitive that the amount of lost coins is not a constant fraction of the supply, because people get better at keeping their coins with increasing value, distribution and

Re: [Lightning-dev] Code for sub second runtime of piecewise linarization to quickly approximate the minimum convex cost flow problem (makes fast multi part payments with large amounts possible)

Good morning everyone, with regards to zerobasefee, I think that the argument that HTLCs are costly doesn't quite hold up because they are always free to an attacker as it stands. However, I fully agree with Zmn's opinion that it's not necessary to bang our head against any opposition to this

  1   2   3   4   5   6   7   8   9   10   >