[jira] [Closed] (FLINK-7894) Improve metrics around fine-grained recovery and associated checkpointing behaviors

2023-11-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-7894. - Resolution: Duplicate > Improve metrics around fine-grained recovery and associated checkpointing

[jira] [Updated] (FLINK-33695) FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

2023-11-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33695: --- Description: https://cwiki.apache.org/confluence/x/TguZE *Motivation* Currently Flink has a

[jira] [Updated] (FLINK-33695) FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

2023-11-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33695: --- Description: https://cwiki.apache.org/confluence/x/TguZE *Motivation* Currently Flink has a

[jira] [Closed] (FLINK-22390) Support for OpenTelemetry

2023-11-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-22390. -- Resolution: Won't Do This ticket is most likely mostly superseded via FLINK-33695. > Support

[jira] [Closed] (FLINK-23411) Expose Flink checkpoint details metrics

2023-11-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-23411. -- Resolution: Duplicate Closing as duplicate in favour of FLINK-33695 > Expose Flink checkpoint

[jira] [Created] (FLINK-33695) FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces

2023-11-29 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-33695: -- Summary: FLIP-384: Introduce TraceReporter and use it to create checkpointing and recovery traces Key: FLINK-33695 URL: https://issues.apache.org/jira/browse/FLINK-33695

[jira] [Closed] (FLINK-6755) Allow triggering Checkpoints through command line client

2023-11-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-6755. - Fix Version/s: 1.19.0 Resolution: Fixed merged commit 7265438 into apache:master > Allow

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789447#comment-17789447 ] Piotr Nowojski commented on FLINK-27681: Ahh got it. In that case I would argue

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789418#comment-17789418 ] Piotr Nowojski commented on FLINK-27681: Thanks [~fanrui] for pinging me, and do

[jira] [Commented] (FLINK-32444) Enable object reuse for Flink SQL jobs by default

2023-11-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789031#comment-17789031 ] Piotr Nowojski commented on FLINK-32444: Instead of checking for the configured

[jira] [Closed] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-7. -- Resolution: Fixed > Expose IngestDB and ClipDB in the official RocksDB API > -

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-7: --- Description: Remaining open PRs: None :) Already merged PRs: https://github.com/facebook

[jira] [Commented] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783523#comment-17783523 ] Piotr Nowojski commented on FLINK-7: Thanks for the update [~mayuehappy]! Do

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-06 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-7: --- Description: Remaining open PRs: https://github.com/facebook/rocksdb/pull/11646 Already me

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-06 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-7: --- Description: Remaining open PRs: https://github.com/facebook/rocksdb/pull/11646 -https://gi

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-06 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-7: --- Description: Remaining open PRs: https://github.com/facebook/rocksdb/pull/11646 ~https://gi

[jira] [Commented] (FLINK-32444) Enable object reuse for Flink SQL jobs by default

2023-11-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17782658#comment-17782658 ] Piotr Nowojski commented on FLINK-32444: {quote} Does it give us a performance b

[jira] [Closed] (FLINK-33090) CheckpointsCleaner clean individual checkpoint states in parallel

2023-10-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-33090. -- Fix Version/s: 1.19.0 Release Note: Now when disposing of no longer needed checkpoints, ev

[jira] [Commented] (FLINK-33338) Bump FRocksDB version

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778646#comment-17778646 ] Piotr Nowojski commented on FLINK-8: The problem is that some of the require

[jira] [Updated] (FLINK-33338) Bump FRocksDB version

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-8: --- Summary: Bump FRocksDB version (was: Bump FRocksDB version to 7.x) > Bump FRocksDB version

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-7: --- Description: Remaining open PRs: https://github.com/facebook/rocksdb/pull/11646 https://git

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-7: --- Description: Remaining open PRs: https://github.com/facebook/rocksdb/pull/11646 https://git

[jira] [Updated] (FLINK-33338) Bump FRocksDB version to 7.x

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-8: --- Summary: Bump FRocksDB version to 7.x (was: Bump RocksDB version to 7.x) > Bump FRocksDB ve

[jira] [Updated] (FLINK-33338) Bump RocksDB version to 7.x

2023-10-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-8: --- Summary: Bump RocksDB version to 7.x (was: Bump up RocksDB version to 7.x) > Bump RocksDB v

[jira] [Created] (FLINK-33338) Bump up RocksDB version to 7.x

2023-10-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-8: -- Summary: Bump up RocksDB version to 7.x Key: FLINK-8 URL: https://issues.apache.org/jira/browse/FLINK-8 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-10-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-7: -- Summary: Expose IngestDB and ClipDB in the official RocksDB API Key: FLINK-7 URL: https://issues.apache.org/jira/browse/FLINK-7 Project: Flink Is

[jira] [Commented] (FLINK-33324) Add flink managed timeout mechanism for backend restore operation

2023-10-20 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1641#comment-1641 ] Piotr Nowojski commented on FLINK-33324: Could you share a code for the change,

[jira] [Commented] (FLINK-23411) Expose Flink checkpoint details metrics

2023-10-19 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1364#comment-1364 ] Piotr Nowojski commented on FLINK-23411: Just FYI. I'm creating at the moment a

[jira] [Commented] (FLINK-33178) Highly parallel apps suffer from bottleneck in NativePRNG

2023-10-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774858#comment-17774858 ] Piotr Nowojski commented on FLINK-33178: I have a feeling this ticket is a dupli

[jira] [Commented] (FLINK-33052) codespeed and benchmark server is down

2023-09-20 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17767153#comment-17767153 ] Piotr Nowojski commented on FLINK-33052: I think there is no big difference one

[jira] [Comment Edited] (FLINK-33071) Log checkpoint statistics

2023-09-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765533#comment-17765533 ] Piotr Nowojski edited comment on FLINK-33071 at 9/15/23 11:37 AM:

[jira] [Updated] (FLINK-33071) Log checkpoint statistics

2023-09-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33071: --- Fix Version/s: 1.18.1 > Log checkpoint statistics > -- > >

[jira] [Closed] (FLINK-33071) Log checkpoint statistics

2023-09-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-33071. -- Fix Version/s: 1.19.0 Resolution: Fixed merged commit ece5fad into apache:master > Log

[jira] [Closed] (FLINK-28758) FlinkKafkaConsumer fails to stop with savepoint

2023-09-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-28758. -- Resolution: Fixed merged commit 27a5465 into main merged commit 20c854c into v3.0 > FlinkKafk

[jira] [Assigned] (FLINK-28758) FlinkKafkaConsumer fails to stop with savepoint

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-28758: -- Assignee: Piotr Nowojski (was: Mark Cho) > FlinkKafkaConsumer fails to stop with sav

[jira] [Commented] (FLINK-28758) FlinkKafkaConsumer fails to stop with savepoint

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764673#comment-17764673 ] Piotr Nowojski commented on FLINK-28758: I will try to take care of that > Flin

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764581#comment-17764581 ] Piotr Nowojski edited comment on FLINK-33052 at 9/13/23 10:28 AM:

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33052: --- Priority: Blocker (was: Critical) > codespeed server is down > > >

[jira] [Commented] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764581#comment-17764581 ] Piotr Nowojski commented on FLINK-33052: We have been always treating benchmarki

[jira] [Commented] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764564#comment-17764564 ] Piotr Nowojski commented on FLINK-33052: Thanks for investigating this issue [~j

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33052: --- Component/s: Benchmarks > codespeed server is down > > >

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33052: --- Affects Version/s: 1.18.0 > codespeed server is down > > >

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-33052: --- Priority: Blocker (was: Major) > codespeed server is down > > >

[jira] [Closed] (FLINK-31387) StreamTaskCancellationTest.testCancelTaskShouldPreventAdditionalProcessingTimeTimersFromBeingFired failed with an assertion

2023-09-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-31387. -- > StreamTaskCancellationTest.testCancelTaskShouldPreventAdditionalProcessingTimeTimersFromBeingFir

[jira] [Commented] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764113#comment-17764113 ] Piotr Nowojski commented on FLINK-23411: {quote} maybe we could still register s

[jira] [Comment Edited] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17763789#comment-17763789 ] Piotr Nowojski edited comment on FLINK-23411 at 9/11/23 3:51 PM: -

[jira] [Commented] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17763789#comment-17763789 ] Piotr Nowojski commented on FLINK-23411: Hey, I've just upon this ticket as we a

[jira] [Created] (FLINK-33071) Log checkpoint statistics

2023-09-11 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-33071: -- Summary: Log checkpoint statistics Key: FLINK-33071 URL: https://issues.apache.org/jira/browse/FLINK-33071 Project: Flink Issue Type: New Feature

[jira] [Updated] (FLINK-13698) Rework threading model of CheckpointCoordinator

2023-08-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-13698: --- Priority: Not a Priority (was: Minor) > Rework threading model of CheckpointCoordinator > -

[jira] [Comment Edited] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752327#comment-17752327 ] Piotr Nowojski edited comment on FLINK-18405 at 8/9/23 8:47 AM: --

[jira] [Commented] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752327#comment-17752327 ] Piotr Nowojski commented on FLINK-18405: Actually I don't see a problem with SQL

[jira] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405 ] Piotr Nowojski deleted comment on FLINK-18405: was (Author: pnowojski): To rephrase the problem using the concrete SQL OVER example. SQL Over ({{RowTimeRowsBoundedPrecedingFunction}}) ha

[jira] [Comment Edited] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752324#comment-17752324 ] Piotr Nowojski edited comment on FLINK-18405 at 8/9/23 8:37 AM: --

[jira] [Commented] (FLINK-18405) Add watermark support for unaligned checkpoints

2023-08-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752324#comment-17752324 ] Piotr Nowojski commented on FLINK-18405: To rephrase the problem using the concr

[jira] [Commented] (FLINK-32548) Make watermark alignment ready for production use

2023-07-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748194#comment-17748194 ] Piotr Nowojski commented on FLINK-32548: Good catch, I would bump this to {{Publ

[jira] [Comment Edited] (FLINK-32548) Make watermark alignment ready for production use

2023-07-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17747847#comment-17747847 ] Piotr Nowojski edited comment on FLINK-32548 at 7/27/23 8:38 AM: -

[jira] [Commented] (FLINK-32548) Make watermark alignment ready for production use

2023-07-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17747847#comment-17747847 ] Piotr Nowojski commented on FLINK-32548: I agree with [~fanrui], given recent ef

[jira] [Commented] (FLINK-25322) Support no-claim mode in changelog state backend

2023-07-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17747840#comment-17747840 ] Piotr Nowojski commented on FLINK-25322: Thanks for pointing this out [~masteryh

[jira] [Commented] (FLINK-19249) Detect broken connections in case TCP Timeout takes too long.

2023-07-19 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17744645#comment-17744645 ] Piotr Nowojski commented on FLINK-19249: Hi [~Jiangang], no sorry there was no p

[jira] [Closed] (FLINK-24402) Add a metric for back-pressure from the ChangelogStateBackend

2023-07-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-24402. -- Fix Version/s: 1.18.0 Resolution: Fixed merged commit bcdbc51 into apache:master > Add

[jira] [Assigned] (FLINK-24402) Add a metric for back-pressure from the ChangelogStateBackend

2023-07-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-24402: -- Assignee: Yanfei Lei > Add a metric for back-pressure from the ChangelogStateBackend

[jira] [Updated] (FLINK-32420) Watermark aggregation performance is poor when watermark alignment is enabled and parallelism is high

2023-07-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32420: --- Release Note: This performance improvement would be good to mention in the release blog post

[jira] [Commented] (FLINK-32420) Watermark aggregation performance is poor when watermark alignment is enabled and parallelism is high

2023-07-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742846#comment-17742846 ] Piotr Nowojski commented on FLINK-32420: Yeah... no need for further comments :)

[jira] [Updated] (FLINK-32420) Watermark aggregation performance is poor when watermark alignment is enabled and parallelism is high

2023-07-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-32420: --- Attachment: Screenshot 2023-07-13 at 17.19.11.png Screenshot 2023-07-13 at 17

[jira] [Commented] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-07-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740998#comment-17740998 ] Piotr Nowojski commented on FLINK-31238: [~mayuehappy] thanks for your work on t

[jira] [Commented] (FLINK-25322) Support no-claim mode in changelog state backend

2023-07-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740173#comment-17740173 ] Piotr Nowojski commented on FLINK-25322: Fair enough. In that case I would sugge

[jira] [Commented] (FLINK-32437) Determine and set correct maxParallelism for operator chains

2023-07-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739693#comment-17739693 ] Piotr Nowojski commented on FLINK-32437: Shouldn't we also set different number

[jira] [Commented] (FLINK-25322) Support no-claim mode in changelog state backend

2023-06-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738073#comment-17738073 ] Piotr Nowojski commented on FLINK-25322: Hi [~Feifan Wang] thanks for picking up

[jira] [Assigned] (FLINK-25322) Support no-claim mode in changelog state backend

2023-06-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-25322: -- Assignee: Feifan Wang (was: Yuan Mei) > Support no-claim mode in changelog state bac

[jira] [Comment Edited] (FLINK-31655) Adaptive Channel selection for partitioner

2023-06-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738053#comment-17738053 ] Piotr Nowojski edited comment on FLINK-31655 at 6/28/23 11:24 AM:

[jira] [Commented] (FLINK-31655) Adaptive Channel selection for partitioner

2023-06-28 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738053#comment-17738053 ] Piotr Nowojski commented on FLINK-31655: I also like the idea with {{maxTraverse

[jira] [Closed] (FLINK-32316) Duplicated announceCombinedWatermark task maybe scheduled if jobmanager failover

2023-06-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-32316. -- Fix Version/s: 1.18.0 1.16.3 1.17.2 Resolution: Fi

[jira] [Closed] (FLINK-24881) When the Source is back pressured, the checkpoint interval may not take effect

2023-06-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-24881. -- Resolution: Not A Bug Hi, sorry for a late response, I have just stumbled across this ticket.

[jira] [Commented] (FLINK-21796) SQLClientKafkaITCase.testKafka fails to download Kafka

2023-06-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731505#comment-17731505 ] Piotr Nowojski commented on FLINK-21796: [~chesnay] [~dwysakowicz], as this has

[jira] [Comment Edited] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731021#comment-17731021 ] Piotr Nowojski edited comment on FLINK-32303 at 6/9/23 4:48 PM: --

[jira] [Commented] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731021#comment-17731021 ] Piotr Nowojski commented on FLINK-32303: I think this bug has been introduced by

[jira] [Comment Edited] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731021#comment-17731021 ] Piotr Nowojski edited comment on FLINK-32303 at 6/9/23 4:47 PM: --

[jira] [Comment Edited] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731021#comment-17731021 ] Piotr Nowojski edited comment on FLINK-32303 at 6/9/23 4:47 PM: --

[jira] [Created] (FLINK-32303) Incorrect error message in KafkaSource

2023-06-09 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-32303: -- Summary: Incorrect error message in KafkaSource Key: FLINK-32303 URL: https://issues.apache.org/jira/browse/FLINK-32303 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-28853) FLIP-217 Support watermark alignment of source splits

2023-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17727532#comment-17727532 ] Piotr Nowojski commented on FLINK-28853: Thanks for pointing this out [~asardaes

[jira] [Closed] (FLINK-31519) The watermark alignment docs is outdated after FLIP-217 finished

2023-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-31519. -- Assignee: Mason Chen Resolution: Fixed Fixed via FLINK-28853 merged commit 678370b into

[jira] [Commented] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-05-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17724809#comment-17724809 ] Piotr Nowojski commented on FLINK-28386: Hi [~Jiang Xin], thanks! I guess it dep

[jira] [Assigned] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-05-22 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-28386: -- Assignee: Jiang Xin > Trigger an immediate checkpoint after all sources finished > --

[jira] [Commented] (FLINK-31970) "Key group 0 is not in KeyGroupRange" when using CheckpointedFunction

2023-05-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723386#comment-17723386 ] Piotr Nowojski commented on FLINK-31970: Yes, {{CheckpointedFunction}} can be us

[jira] [Updated] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-31963: --- Fix Version/s: 1.16.2 1.18.0 1.17.1 > java.lang.ArrayI

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723126#comment-17723126 ] Piotr Nowojski commented on FLINK-31963: To clarify impact of this bug. This is

[jira] [Assigned] (FLINK-24696) Translate how to configure unaligned checkpoints into Chinese

2023-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-24696: -- Assignee: lijie > Translate how to configure unaligned checkpoints into Chinese > ---

[jira] [Commented] (FLINK-24696) Translate how to configure unaligned checkpoints into Chinese

2023-05-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17722802#comment-17722802 ] Piotr Nowojski commented on FLINK-24696: Sure! Thanks :) > Translate how to con

[jira] [Updated] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-31963: --- Affects Version/s: 1.15.4 1.16.1 1.18.0 > java

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721777#comment-17721777 ] Piotr Nowojski commented on FLINK-31963: We have managed to reproduce and find t

[jira] [Assigned] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-31963: -- Assignee: Stefan Richter > java.lang.ArrayIndexOutOfBoundsException when scaling down

[jira] [Closed] (FLINK-18808) Task-level numRecordsOut metric may be underestimated

2023-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-18808. -- Fix Version/s: 1.18.0 Resolution: Fixed Merged to master as 24685395ccf^^..24685395ccf

[jira] [Commented] (FLINK-31959) Correct the unaligned checkpoint type at checkpoint level

2023-05-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721233#comment-17721233 ] Piotr Nowojski commented on FLINK-31959: merged as 35254cbdc9a^,35254cbdc9a to m

[jira] [Updated] (FLINK-31959) Correct the unaligned checkpoint type at checkpoint level

2023-05-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-31959: --- Fix Version/s: 1.16.2 1.18.0 1.17.1 > Correct the unal

[jira] [Comment Edited] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17720610#comment-17720610 ] Piotr Nowojski edited comment on FLINK-31963 at 5/9/23 3:23 PM: --

[jira] [Comment Edited] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17720610#comment-17720610 ] Piotr Nowojski edited comment on FLINK-31963 at 5/8/23 5:03 PM: --

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17720610#comment-17720610 ] Piotr Nowojski commented on FLINK-31963: Additionally to what [~srichter] asked.

[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints

2023-05-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-18753: --- Fix Version/s: (was: 1.18.0) > Support local recovery for Unaligned checkpoints > --

[jira] [Commented] (FLINK-24657) Add metric of the total real size of input/output buffers queue

2023-05-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17719732#comment-17719732 ] Piotr Nowojski commented on FLINK-24657: We had some discussion around that in t

[jira] [Comment Edited] (FLINK-31970) "Key group 0 is not in KeyGroupRange" when using CheckpointedFunction

2023-05-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17719336#comment-17719336 ] Piotr Nowojski edited comment on FLINK-31970 at 5/4/23 1:53 PM: --

<    1   2   3   4   5   6   7   8   9   10   >