[jira] [Updated] (FLINK-35420) WordCountMapredITCase fails to compile in IntelliJ

[ https://issues.apache.org/jira/browse/FLINK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35420: --- Fix Version/s: 1.20.0 > WordCountMapredITCase fails to compile in IntelliJ >

[jira] [Assigned] (FLINK-35420) WordCountMapredITCase fails to compile in IntelliJ

[ https://issues.apache.org/jira/browse/FLINK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35420: -- Assignee: Piotr Nowojski > WordCountMapredITCase fails to compile in IntelliJ >

[jira] [Closed] (FLINK-35420) WordCountMapredITCase fails to compile in IntelliJ

[ https://issues.apache.org/jira/browse/FLINK-35420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35420. -- Resolution: Fixed 9ccfb65 into apache:master now > WordCountMapredITCase fails to compile

[jira] [Created] (FLINK-35420) WordCountMapredITCase fails to compile in IntelliJ

Piotr Nowojski created FLINK-35420: -- Summary: WordCountMapredITCase fails to compile in IntelliJ Key: FLINK-35420 URL: https://issues.apache.org/jira/browse/FLINK-35420 Project: Flink Issue

[jira] [Closed] (FLINK-32828) Partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-32828. -- Fix Version/s: 2.0.0 1.18.2 1.20.0

[jira] [Commented] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846869#comment-17846869 ] Piotr Nowojski commented on FLINK-35351: Thanks, after reading the PR indeed I understand this

[jira] [Updated] (FLINK-32828) Partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32828: --- Summary: Partition aware watermark not handled correctly shortly after job start up from

[jira] [Comment Edited] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846694#comment-17846694 ] Piotr Nowojski edited comment on FLINK-32828 at 5/15/24 4:27 PM: - We

[jira] [Commented] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846694#comment-17846694 ] Piotr Nowojski commented on FLINK-32828: We have just stumbled upon the same issue and I can

[jira] [Updated] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32828: --- Priority: Critical (was: Major) > Kafka partition aware watermark not handled correctly

[jira] [Updated] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32828: --- Affects Version/s: 1.18.1 1.19.0 > Kafka partition aware watermark

[jira] [Assigned] (FLINK-32828) Kafka partition aware watermark not handled correctly shortly after job start up from checkpoint or savepoint

[ https://issues.apache.org/jira/browse/FLINK-32828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-32828: -- Assignee: Piotr Nowojski > Kafka partition aware watermark not handled correctly

[jira] [Commented] (FLINK-33109) Watermark alignment not applied after recovery from checkpoint

[ https://issues.apache.org/jira/browse/FLINK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846597#comment-17846597 ] Piotr Nowojski commented on FLINK-33109: Hi! {quote} I guess this bug has been fixed in 1.17.2

[jira] [Comment Edited] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846231#comment-17846231 ] Piotr Nowojski edited comment on FLINK-35351 at 5/14/24 9:11 AM: - Hi

[jira] [Commented] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846231#comment-17846231 ] Piotr Nowojski commented on FLINK-35351: Hi [~lda-dima], thanks for reporting this issue and

[jira] [Assigned] (FLINK-35351) Restore from unaligned checkpoints with a custom partitioner fails.

[ https://issues.apache.org/jira/browse/FLINK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-35351: -- Assignee: Dmitriy Linevich > Restore from unaligned checkpoints with a custom

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840327#comment-17840327 ] Piotr Nowojski commented on FLINK-33856: Hey [~hejufang001]! Sorry for the usual open source

[jira] [Updated] (FLINK-33856) Add sub-task spans to TraceReporter for checkpointing

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33856: --- Summary: Add sub-task spans to TraceReporter for checkpointing (was: Add metrics to

[jira] [Closed] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-34913. -- Fix Version/s: 1.20.0 (was: 2.0.0) Resolution: Fixed >

[jira] [Assigned] (FLINK-20217) More fine-grained timer processing

[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-20217: -- Assignee: Piotr Nowojski > More fine-grained timer processing >

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836113#comment-17836113 ] Piotr Nowojski commented on FLINK-34704: Sounds good to me (y) Indeed we could later provide

[jira] [Comment Edited] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836083#comment-17836083 ] Piotr Nowojski edited comment on FLINK-34704 at 4/11/24 9:57 AM: - Yes,

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836083#comment-17836083 ] Piotr Nowojski commented on FLINK-34704: {quote} the checkpoint still happen when some user code

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836037#comment-17836037 ] Piotr Nowojski commented on FLINK-34704: {code:java} So it is designed to be safe to checkpoint

[jira] [Comment Edited] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835796#comment-17835796 ] Piotr Nowojski edited comment on FLINK-34704 at 4/10/24 3:46 PM: - Adding

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835796#comment-17835796 ] Piotr Nowojski commented on FLINK-34704: Adding new {{yield}} method wouldn't help, as we can

[jira] [Closed] (FLINK-35065) Add numFiredTimers and numFiredTimersPerSecond metrics

[ https://issues.apache.org/jira/browse/FLINK-35065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-35065. -- Resolution: Fixed Merged to master as 98bd2659f5b > Add numFiredTimers and

[jira] [Created] (FLINK-35065) Add numFiredTimers and numFiredTimersPerSecond metrics

Piotr Nowojski created FLINK-35065: -- Summary: Add numFiredTimers and numFiredTimersPerSecond metrics Key: FLINK-35065 URL: https://issues.apache.org/jira/browse/FLINK-35065 Project: Flink

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Affects Version/s: 1.16.3 > Weird priorities when processing unaligned checkpoints >

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Description: While looking through the code I noticed that `StreamTask` is processing

[jira] [Updated] (FLINK-35051) Weird priorities when processing unaligned checkpoints

[ https://issues.apache.org/jira/browse/FLINK-35051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35051: --- Description: While looking through the code I noticed that `StreamTask` is processing

[jira] [Created] (FLINK-35051) Weird priorities when processing unaligned checkpoints

Piotr Nowojski created FLINK-35051: -- Summary: Weird priorities when processing unaligned checkpoints Key: FLINK-35051 URL: https://issues.apache.org/jira/browse/FLINK-35051 Project: Flink

[jira] [Commented] (FLINK-32957) Add current timer trigger lag to metrics

[ https://issues.apache.org/jira/browse/FLINK-32957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833184#comment-17833184 ] Piotr Nowojski commented on FLINK-32957: {{mailboxLatencyMs}} shows basically the same thing

[jira] [Comment Edited] (FLINK-26515) RetryingExecutorTest. testDiscardOnTimeout failed on azure

[ https://issues.apache.org/jira/browse/FLINK-26515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830957#comment-17830957 ] Piotr Nowojski edited comment on FLINK-26515 at 3/26/24 2:31 PM: -

[jira] [Updated] (FLINK-26515) RetryingExecutorTest. testDiscardOnTimeout failed on azure

[ https://issues.apache.org/jira/browse/FLINK-26515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26515: --- Priority: Blocker (was: Critical) > RetryingExecutorTest. testDiscardOnTimeout failed on

[jira] [Commented] (FLINK-26515) RetryingExecutorTest. testDiscardOnTimeout failed on azure

[ https://issues.apache.org/jira/browse/FLINK-26515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830957#comment-17830957 ] Piotr Nowojski commented on FLINK-26515: occurance of the same issue in a private build >

[jira] [Updated] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34913: --- Fix Version/s: 2.0.0 (was: 1.19.1) > ConcurrentModificationException

[jira] [Commented] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830419#comment-17830419 ] Piotr Nowojski commented on FLINK-34913: merged commit 1a5ca7f into apache:master >

[jira] [Comment Edited] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830419#comment-17830419 ] Piotr Nowojski edited comment on FLINK-34913 at 3/25/24 10:01 AM: --

[jira] [Updated] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34913: --- Description: The following failures can occur during job's recovery when using clip &

[jira] [Assigned] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-34913: -- Assignee: Piotr Nowojski > ConcurrentModificationException >

[jira] [Updated] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

[ https://issues.apache.org/jira/browse/FLINK-34913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34913: --- Description: The following failures can occur during job's recovery when using clip &

[jira] [Created] (FLINK-34913) ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric

Piotr Nowojski created FLINK-34913: -- Summary: ConcurrentModificationException SubTaskInitializationMetricsBuilder.addDurationMetric Key: FLINK-34913 URL: https://issues.apache.org/jira/browse/FLINK-34913

[jira] [Updated] (FLINK-34696) GSRecoverableWriterCommitter is generating excessive data blobs

[ https://issues.apache.org/jira/browse/FLINK-34696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34696: --- Issue Type: Improvement (was: Bug) > GSRecoverableWriterCommitter is generating excessive

[jira] [Closed] (FLINK-33816) SourceStreamTaskTest.testTriggeringStopWithSavepointWithDrain failed due async checkpoint triggering not being completed

[ https://issues.apache.org/jira/browse/FLINK-33816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-33816. -- Fix Version/s: 2.0.0 Assignee: jiabao.sun Resolution: Fixed merged commit

[jira] [Comment Edited] (FLINK-33816) SourceStreamTaskTest.testTriggeringStopWithSavepointWithDrain failed due async checkpoint triggering not being completed

[ https://issues.apache.org/jira/browse/FLINK-33816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827503#comment-17827503 ] Piotr Nowojski edited comment on FLINK-33816 at 3/15/24 1:33 PM: - Thanks

[jira] [Commented] (FLINK-26990) BatchArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredByTime failed

[ https://issues.apache.org/jira/browse/FLINK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826779#comment-17826779 ] Piotr Nowojski commented on FLINK-26990: I've just encountered the same issue in some internal

[jira] [Updated] (FLINK-26990) BatchArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredByTime failed

[ https://issues.apache.org/jira/browse/FLINK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26990: --- Priority: Major (was: Minor) >

[jira] [Updated] (FLINK-26990) BatchArrowPythonGroupWindowAggregateFunctionOperatorTest.testFinishBundleTriggeredByTime failed

[ https://issues.apache.org/jira/browse/FLINK-26990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26990: --- Affects Version/s: 1.18.1 >

[jira] [Updated] (FLINK-29114) TableSourceITCase#testTableHintWithLogicalTableScanReuse sometimes fails with result mismatch

[ https://issues.apache.org/jira/browse/FLINK-29114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-29114: --- Priority: Blocker (was: Major) > TableSourceITCase#testTableHintWithLogicalTableScanReuse

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820619#comment-17820619 ] Piotr Nowojski commented on FLINK-33856: Hey [~hejufang001]! The new processes hasn't been yet

[jira] [Commented] (FLINK-34430) Akka frame size exceeded with many ByteStreamStateHandle being used

[ https://issues.apache.org/jira/browse/FLINK-34430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818838#comment-17818838 ] Piotr Nowojski commented on FLINK-34430: [~roman] is already working on that under FLINK-26050

[jira] [Comment Edited] (FLINK-34386) Add RocksDB bloom filter metrics

[ https://issues.apache.org/jira/browse/FLINK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818837#comment-17818837 ] Piotr Nowojski edited comment on FLINK-34386 at 2/20/24 2:42 PM: - merged

[jira] [Closed] (FLINK-34386) Add RocksDB bloom filter metrics

[ https://issues.apache.org/jira/browse/FLINK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-34386. -- Fix Version/s: 1.20.0 Resolution: Fixed merged commit 890a995 into apache:master now

[jira] [Assigned] (FLINK-34386) Add RocksDB bloom filter metrics

[ https://issues.apache.org/jira/browse/FLINK-34386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-34386: -- Assignee: Jufang He > Add RocksDB bloom filter metrics >

[jira] [Comment Edited] (FLINK-34424) BoundedBlockingSubpartitionWriteReadTest#testRead10ConsumersConcurrent times out

[ https://issues.apache.org/jira/browse/FLINK-34424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817251#comment-17817251 ] Piotr Nowojski edited comment on FLINK-34424 at 2/14/24 8:39 AM: - :D

[jira] [Commented] (FLINK-34424) BoundedBlockingSubpartitionWriteReadTest#testRead10ConsumersConcurrent times out

[ https://issues.apache.org/jira/browse/FLINK-34424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817251#comment-17817251 ] Piotr Nowojski commented on FLINK-34424: :D [~mapohl] I haven't made any modifications to this

[jira] [Updated] (FLINK-34430) Akka frame size exceeded with many ByteStreamStateHandle being used

[ https://issues.apache.org/jira/browse/FLINK-34430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34430: --- Description: The following error can happen {noformat} Discarding oversized payload sent to

[jira] [Updated] (FLINK-34430) Akka frame size exceeded with many ByteStreamStateHandle being used

[ https://issues.apache.org/jira/browse/FLINK-34430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34430: --- Description: The following error can happen {noformat} Discarding oversized payload sent to

[jira] [Updated] (FLINK-34430) Akka frame size exceeded with many ByteStreamStateHandle being used

[ https://issues.apache.org/jira/browse/FLINK-34430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34430: --- Description: The following error can happen {noformat} Discarding oversized payload sent to

[jira] [Commented] (FLINK-34430) Akka frame size exceeded with many ByteStreamStateHandle being used

[ https://issues.apache.org/jira/browse/FLINK-34430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17816597#comment-17816597 ] Piotr Nowojski commented on FLINK-34430: Akka frame size can be exceeded as a result of RocksDB

[jira] [Created] (FLINK-34430) Akka frame size exceeded with many ByteStreamStateHandle being used

Piotr Nowojski created FLINK-34430: -- Summary: Akka frame size exceeded with many ByteStreamStateHandle being used Key: FLINK-34430 URL: https://issues.apache.org/jira/browse/FLINK-34430 Project:

[jira] [Commented] (FLINK-26050) Too many small sst files in rocksdb state backend when using time window created in ascending order

[ https://issues.apache.org/jira/browse/FLINK-26050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17816595#comment-17816595 ] Piotr Nowojski commented on FLINK-26050: I have encountered the same situation but with event

[jira] [Updated] (FLINK-26050) Too many small sst files in rocksdb state backend when using time window created in ascending order

[ https://issues.apache.org/jira/browse/FLINK-26050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26050: --- Description: When using processing or event time windows, in some workloads, there will be

[jira] [Updated] (FLINK-26050) Too many small sst files in rocksdb state backend when using time window created in ascending order

[ https://issues.apache.org/jira/browse/FLINK-26050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26050: --- Summary: Too many small sst files in rocksdb state backend when using time window created

[jira] [Commented] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815766#comment-17815766 ] Piotr Nowojski commented on FLINK-34289: That definitely would prevent my confusion :) >

[jira] [Commented] (FLINK-34403) VeryBigPbProtoToRowTest#testSimple cannot pass due to OOM

[ https://issues.apache.org/jira/browse/FLINK-34403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815685#comment-17815685 ] Piotr Nowojski commented on FLINK-34403:

[jira] [Updated] (FLINK-34403) VeryBigPbProtoToRowTest#testSimple cannot pass due to OOM

[ https://issues.apache.org/jira/browse/FLINK-34403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34403: --- Priority: Critical (was: Major) > VeryBigPbProtoToRowTest#testSimple cannot pass due to

[jira] [Comment Edited] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815532#comment-17815532 ] Piotr Nowojski edited comment on FLINK-34289 at 2/8/24 6:33 AM:

[jira] [Commented] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815532#comment-17815532 ] Piotr Nowojski commented on FLINK-34289: !Screenshot 2024-02-08 at 07.22.19.png! This part

[jira] [Updated] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34289: --- Attachment: Screenshot 2024-02-08 at 07.22.19.png > Release Testing Instructions: Verify

[jira] [Commented] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814807#comment-17814807 ] Piotr Nowojski commented on FLINK-34289: I wasn't complaining, just explaining myself :) Sorry

[jira] [Commented] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814787#comment-17814787 ] Piotr Nowojski commented on FLINK-34289: Thanks for cleaning this up. Indeed I was confused what

[jira] [Closed] (FLINK-34387) Release Testing: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-34387. -- Resolution: Won't Do After giving it a second thought I'm closing this ticket, as there is no

[jira] [Assigned] (FLINK-34289) Release Testing: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-34289: -- Assignee: (was: Piotr Nowojski) > Release Testing: Verify FLINK-33695 Introduce

[jira] [Closed] (FLINK-34290) Release Testing Instructions: Verify FLINK-33696 Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

[ https://issues.apache.org/jira/browse/FLINK-34290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-34290. -- Resolution: Won't Do Covered by https://issues.apache.org/jira/browse/FLINK-34289 > Release

[jira] [Updated] (FLINK-34289) Release Testing: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34289: --- Summary: Release Testing: Verify FLINK-33695 Introduce TraceReporter and use it to create

[jira] [Updated] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34289: --- Description: This ticket covers testing three related features: FLINK-33695, FLINK-33735

[jira] [Commented] (FLINK-34289) Release Testing Instructions: Verify FLINK-33695 Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-34289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814439#comment-17814439 ] Piotr Nowojski commented on FLINK-34289: Thanks! I will create a single ticket for release

[jira] [Commented] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813740#comment-17813740 ] Piotr Nowojski commented on FLINK-33819: Thanks [~mayuehappy]. {quote} merged 4f7725aa into

[jira] [Comment Edited] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813740#comment-17813740 ] Piotr Nowojski edited comment on FLINK-33819 at 2/2/24 3:52 PM: Thanks

[jira] [Reopened] (FLINK-33696) FLIP-385: Add OpenTelemetryTraceReporter and OpenTelemetryMetricReporter

[ https://issues.apache.org/jira/browse/FLINK-33696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reopened FLINK-33696: No it's not yet done. I still have to open a PR adding OpenTelemetry reporters. 7db2ecad was

[jira] [Updated] (FLINK-34134) Add tracing for restored state size and locations

[ https://issues.apache.org/jira/browse/FLINK-34134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-34134: --- Fix Version/s: 1.19.0 > Add tracing for restored state size and locations >

[jira] [Closed] (FLINK-27756) Fix intermittently failing test in AsyncSinkWriterTest.checkLoggedSendTimesAreWithinBounds

[ https://issues.apache.org/jira/browse/FLINK-27756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-27756. -- Resolution: Fixed Thanks [~chalixar] for fixing this! merged commit d92ab39 into

[jira] [Updated] (FLINK-27756) Fix intermittently failing test in AsyncSinkWriterTest.checkLoggedSendTimesAreWithinBounds

[ https://issues.apache.org/jira/browse/FLINK-27756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27756: --- Fix Version/s: 1.17.3 1.18.2 > Fix intermittently failing test in >

[jira] [Updated] (FLINK-27756) Fix intermittently failing test in AsyncSinkWriterTest.checkLoggedSendTimesAreWithinBounds

[ https://issues.apache.org/jira/browse/FLINK-27756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27756: --- Affects Version/s: 1.18.1 > Fix intermittently failing test in >

[jira] [Updated] (FLINK-27756) Fix intermittently failing test in AsyncSinkWriterTest.checkLoggedSendTimesAreWithinBounds

[ https://issues.apache.org/jira/browse/FLINK-27756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27756: --- Priority: Blocker (was: Critical) > Fix intermittently failing test in >

[jira] [Commented] (FLINK-33338) Bump FRocksDB version

[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806860#comment-17806860 ] Piotr Nowojski commented on FLINK-8: [~roman], let's make sure that this latest bug fix is

[jira] [Commented] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806861#comment-17806861 ] Piotr Nowojski commented on FLINK-7: Thanks [~mayuehappy] for the update! > Expose IngestDB

[jira] [Comment Edited] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806804#comment-17806804 ] Piotr Nowojski edited comment on FLINK-33819 at 1/15/24 1:09 PM: - Thanks

[jira] [Commented] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806804#comment-17806804 ] Piotr Nowojski commented on FLINK-33819: +1 for making this option configurable. > Support

[jira] [Comment Edited] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806804#comment-17806804 ] Piotr Nowojski edited comment on FLINK-33819 at 1/15/24 1:00 PM: - Thanks

[jira] [Comment Edited] (FLINK-34063) When snapshot compression is enabled, rescaling of a source operator leads to some splits getting lost

[ https://issues.apache.org/jira/browse/FLINK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805934#comment-17805934 ] Piotr Nowojski edited comment on FLINK-34063 at 1/12/24 8:32 AM: -

[jira] [Commented] (FLINK-34063) When snapshot compression is enabled, rescaling of a source operator leads to some splits getting lost

[ https://issues.apache.org/jira/browse/FLINK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805934#comment-17805934 ] Piotr Nowojski commented on FLINK-34063: Could this issue be discovered by our ITCases if

[jira] [Closed] (FLINK-33697) FLIP-386: Support adding custom metrics in Recovery Spans

[ https://issues.apache.org/jira/browse/FLINK-33697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-33697. -- Release Note: A braking change has been introduced to the `StateBackend` interface. This is

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805739#comment-17805739 ] Piotr Nowojski commented on FLINK-33856: In that case [~hejufang001] it would be great if you

[jira] [Closed] (FLINK-33775) Report JobInitialization traces

[ https://issues.apache.org/jira/browse/FLINK-33775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-33775. -- Fix Version/s: 1.19.0 Resolution: Fixed merged commit 793a66b into apache:master >

[jira] [Closed] (FLINK-33695) FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

[ https://issues.apache.org/jira/browse/FLINK-33695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-33695. -- Resolution: Fixed > FLIP-384: Introduce TraceReporter and use it to create checkpointing and

[jira] [Commented] (FLINK-33897) Allow triggering unaligned checkpoint via CLI

[ https://issues.apache.org/jira/browse/FLINK-33897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803535#comment-17803535 ] Piotr Nowojski commented on FLINK-33897: By real world motivation, I meant if that really is an

[jira] [Comment Edited] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803478#comment-17803478 ] Piotr Nowojski edited comment on FLINK-33856 at 1/5/24 9:58 AM: {quote}

  1   2   3   4   5   6   7   8   9   10   >