[jira] [Updated] (FLINK-18405) Add watermark support for unaligned checkpoints

2022-08-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-18405: --- Fix Version/s: (was: 1.17.0) > Add watermark support for unaligned checkpoints >

[jira] [Assigned] (FLINK-28853) FLIP-217 Support watermark alignment of source splits

2022-08-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-28853: -- Assignee: Sebastian Mattheis > FLIP-217 Support watermark alignment of source splits

[jira] [Commented] (FLINK-28504) Local-Global aggregation causes watermark alignment (table.exec.source.idle-timeout) of idle partition invalid

2022-08-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17583571#comment-17583571 ] Piotr Nowojski commented on FLINK-28504: {quote} After giving this a second look I think the

[jira] [Closed] (FLINK-28835) Savepoint and checkpoint capabilities and limitations table is incorrect

2022-08-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-28835. -- Resolution: Fixed fixed on release-1.15 as 39a737f31be merged commit b1c40bd into

[jira] [Assigned] (FLINK-28835) Savepoint and checkpoint capabilities and limitations table is incorrect

2022-08-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-28835: -- Assignee: Piotr Nowojski > Savepoint and checkpoint capabilities and limitations

[jira] [Updated] (FLINK-28835) Savepoint and checkpoint capabilities and limitations table is incorrect

2022-08-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-28835: --- Priority: Critical (was: Major) > Savepoint and checkpoint capabilities and limitations

[jira] [Created] (FLINK-28835) Savepoint and checkpoint capabilities and limitations table is incorrect

2022-08-05 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-28835: -- Summary: Savepoint and checkpoint capabilities and limitations table is incorrect Key: FLINK-28835 URL: https://issues.apache.org/jira/browse/FLINK-28835

[jira] [Closed] (FLINK-25256) Savepoints do not work with ExternallyInducedSources

2022-07-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-25256. -- Fix Version/s: 1.15.0 (was: 1.14.6) Resolution: Fixed >

[jira] [Updated] (FLINK-28474) ChannelStateWriteResult may not fail after checkpoint abort

2022-07-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-28474: --- Description: After Checkpoint abort, ChannelStateWriteResult should fail. But if

[jira] [Updated] (FLINK-27165) Benchmark test SerializationFrameworkMiniBenchmarks#serializerHeavyString became unstable

2022-07-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27165: --- Priority: Not a Priority (was: Minor) > Benchmark test

[jira] [Comment Edited] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

2022-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17565043#comment-17565043 ] Piotr Nowojski edited comment on FLINK-22643 at 7/11/22 2:55 PM: - After

[jira] [Updated] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

2022-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-22643: --- Attachment: Screenshot 2022-07-11 at 16.55.02.png > Too many TCP connections among

[jira] [Comment Edited] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

2022-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17565043#comment-17565043 ] Piotr Nowojski edited comment on FLINK-22643 at 7/11/22 2:52 PM: - After

[jira] [Comment Edited] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

2022-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17565043#comment-17565043 ] Piotr Nowojski edited comment on FLINK-22643 at 7/11/22 2:52 PM: - After

[jira] [Commented] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

2022-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17565043#comment-17565043 ] Piotr Nowojski commented on FLINK-22643: After closing a ticket I forgot to mention that this

[jira] [Updated] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

2022-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-22643: --- Attachment: Screenshot 2022-07-11 at 16.49.42.png > Too many TCP connections among

[jira] [Assigned] (FLINK-28487) Introduce configurable RateLimitingStrategy for Async Sink

2022-07-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-28487: -- Assignee: Hong Liang Teoh > Introduce configurable RateLimitingStrategy for Async

[jira] [Commented] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-09 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564588#comment-17564588 ] Piotr Nowojski commented on FLINK-28357: Hi [~Sandys-Lumsdaine] {quote} Maybe my example above

[jira] [Comment Edited] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17563760#comment-17563760 ] Piotr Nowojski edited comment on FLINK-28357 at 7/8/22 7:18 AM: I've

[jira] [Comment Edited] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17563760#comment-17563760 ] Piotr Nowojski edited comment on FLINK-28357 at 7/7/22 7:18 PM: I've

[jira] [Updated] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-28357: --- Fix Version/s: 1.16.0 > Watermark issue when recovering Finished sources >

[jira] [Closed] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-07 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-28357. -- Fix Version/s: 1.15.2 1.14.6 Resolution: Fixed I've fixed the

[jira] [Commented] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562485#comment-17562485 ] Piotr Nowojski commented on FLINK-28357: {quote} Also - you say "non-chained map" but I believe

[jira] [Comment Edited] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562234#comment-17562234 ] Piotr Nowojski edited comment on FLINK-28357 at 7/4/22 7:38 PM: Thanks

[jira] [Commented] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562234#comment-17562234 ] Piotr Nowojski commented on FLINK-28357: Thanks for the bug report. Indeed there was a bug where

[jira] [Assigned] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-28357: -- Assignee: Piotr Nowojski > Watermark issue when recovering Finished sources >

[jira] [Closed] (FLINK-27530) FLIP-227: Support overdraft buffer

2022-06-29 Thread Piotr Nowojski (Jira)
Title: Message Title Piotr Nowojski

[jira] [Closed] (FLINK-27789) LegacySource compatible with overdraft buffer

2022-06-29 Thread Piotr Nowojski (Jira)
Title: Message Title Piotr Nowojski

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-06-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17559261#comment-17559261 ] Piotr Nowojski commented on FLINK-26803: Hi [~fanrui] +1, from my side to the design doc. >

[jira] [Assigned] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-06-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-26803: -- Assignee: fanrui > Merge small ChannelState file for Unaligned Checkpoint >

[jira] [Closed] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

2022-06-27 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-26762. -- Resolution: Fixed Chinese documentation translation merged as commit e57f2cf into

[jira] [Commented] (FLINK-27921) Introduce the checkResourceRequirementsWithDelay in DeclarativeSlotManager

2022-06-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558053#comment-17558053 ] Piotr Nowojski commented on FLINK-27921: Benchmarks maybe could be rewritten in such way that

[jira] [Commented] (FLINK-25454) Negative time in throughput calculator

2022-06-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557971#comment-17557971 ] Piotr Nowojski commented on FLINK-25454: merged commit 10e6341 into apache:release-1.14 This

[jira] [Comment Edited] (FLINK-25454) Negative time in throughput calculator

2022-06-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557971#comment-17557971 ] Piotr Nowojski edited comment on FLINK-25454 at 6/23/22 9:33 AM: - merged

[jira] [Updated] (FLINK-25454) Negative time in throughput calculator

2022-06-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25454: --- Fix Version/s: 1.14.6 > Negative time in throughput calculator >

[jira] [Comment Edited] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

2022-06-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556873#comment-17556873 ] Piotr Nowojski edited comment on FLINK-26762 at 6/21/22 3:48 PM: -

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

2022-06-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556873#comment-17556873 ] Piotr Nowojski commented on FLINK-26762: Feature merged commit 0b60ee8 into apache:master > Add

[jira] [Updated] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

2022-06-21 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26762: --- Release Note: New concept of overdraft network buffers was introduced to mitigate effects

[jira] [Commented] (FLINK-27792) InterruptedException thrown by ChannelStateWriterImpl

2022-06-20 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556311#comment-17556311 ] Piotr Nowojski commented on FLINK-27792: Thanks for the analysis [~fanrui]. It makes sense to

[jira] [Commented] (FLINK-27792) InterruptedException thrown by ChannelStateWriterImpl

2022-06-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1725#comment-1725 ] Piotr Nowojski commented on FLINK-27792: Thanks for pointing this out. So what's happening in

[jira] [Commented] (FLINK-27792) InterruptedException thrown by ChannelStateWriterImpl

2022-06-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555461#comment-17555461 ] Piotr Nowojski commented on FLINK-27792: What is causing this `InterruptedException`? Where does

[jira] [Commented] (FLINK-26993) CheckpointCoordinatorTest#testMinCheckpointPause

2022-06-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555078#comment-17555078 ] Piotr Nowojski commented on FLINK-26993: merged commit 3e86cf2 into apache:release-1.15 now >

[jira] [Updated] (FLINK-26993) CheckpointCoordinatorTest#testMinCheckpointPause

2022-06-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-26993: --- Fix Version/s: 1.15.2 > CheckpointCoordinatorTest#testMinCheckpointPause >

[jira] [Commented] (FLINK-25454) Negative time in throughput calculator

2022-06-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555077#comment-17555077 ] Piotr Nowojski commented on FLINK-25454: I've looked into backporting this fix, but it's not

[jira] [Updated] (FLINK-27114) On JM restart, the information about the initial checkpoints can be lost

2022-06-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27114: --- Fix Version/s: (was: 1.16.0) (was: 1.15.1)

[jira] [Updated] (FLINK-24483) Document what is Public API and what compatibility guarantees Flink is providing

2022-06-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-24483: --- Fix Version/s: (was: 1.16.0) (was: 1.13.7)

[jira] [Closed] (FLINK-27522) Ignore max buffers per channel when allocate buffer

2022-05-31 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-27522. -- Resolution: Fixed merged commit 9146220 into apache:master > Ignore max buffers per channel

[jira] [Commented] (FLINK-27667) YARNHighAvailabilityITCase fails with "Failed to delete temp directory /tmp/junit1681"

2022-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17543996#comment-17543996 ] Piotr Nowojski commented on FLINK-27667:

[jira] [Updated] (FLINK-27667) YARNHighAvailabilityITCase fails with "Failed to delete temp directory /tmp/junit1681"

2022-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27667: --- Priority: Critical (was: Major) > YARNHighAvailabilityITCase fails with "Failed to delete

[jira] [Closed] (FLINK-27825) Update the doc of aligned checkpoint timeout

2022-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-27825. -- Resolution: Fixed Thanks for the update [~fanrui]. merged commit 317b230 into apache:master

[jira] [Assigned] (FLINK-27825) Update the doc of aligned checkpoint timeout

2022-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-27825: -- Assignee: fanrui (was: Piotr Nowojski) > Update the doc of aligned checkpoint

[jira] [Assigned] (FLINK-27825) Update the doc of aligned checkpoint timeout

2022-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-27825: -- Assignee: Piotr Nowojski > Update the doc of aligned checkpoint timeout >

[jira] [Assigned] (FLINK-27789) LegacySource compatible with overdraft buffer

2022-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-27789: -- Assignee: fanrui > LegacySource compatible with overdraft buffer >

[jira] [Assigned] (FLINK-27530) FLIP-227: Support overdraft buffer

2022-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-27530: -- Assignee: fanrui > FLIP-227: Support overdraft buffer >

[jira] [Assigned] (FLINK-27522) Ignore max buffers per channel when allocate buffer

2022-05-30 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-27522: -- Assignee: fanrui > Ignore max buffers per channel when allocate buffer >

[jira] [Closed] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-27251. -- Resolution: Fixed Merged to master as e68d679e8ac^^..e68d679e8ac. Thank you [~fanrui] for a

[jira] [Closed] (FLINK-27724) The SubtaskCheckpointCoordinatorImpl#close() isn't called in anywhere

2022-05-24 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-27724. -- Resolution: Not A Problem As [~fanrui] pointed out in an offline discussion,

[jira] [Assigned] (FLINK-27724) The SubtaskCheckpointCoordinatorImpl#close() isn't called in anywhere

2022-05-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-27724: -- Assignee: fanrui > The SubtaskCheckpointCoordinatorImpl#close() isn't called in

[jira] [Commented] (FLINK-27724) The SubtaskCheckpointCoordinatorImpl#close() isn't called in anywhere

2022-05-23 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540947#comment-17540947 ] Piotr Nowojski commented on FLINK-27724: {quote} In StreamTask#cancel(),

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-05-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17538819#comment-17538819 ] Piotr Nowojski commented on FLINK-26803: Sorry for late response [~fanrui]. Thanks for the

[jira] [Comment Edited] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17538730#comment-17538730 ] Piotr Nowojski edited comment on FLINK-27251 at 5/18/22 11:01 AM: --

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-18 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17538730#comment-17538730 ] Piotr Nowojski commented on FLINK-27251: Thanks [~fanrui] for the update. I will take a look :)

[jira] [Updated] (FLINK-27640) Flink not compiling, flink-connector-hive_2.12 is missing jhyde pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

2022-05-16 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27640: --- Summary: Flink not compiling, flink-connector-hive_2.12 is missing jhyde

[jira] [Created] (FLINK-27640) Flink not compiling, flink-connector-hive_2.12 is missing pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

2022-05-16 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-27640: -- Summary: Flink not compiling, flink-connector-hive_2.12 is missing pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde Key: FLINK-27640 URL:

[jira] [Comment Edited] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536089#comment-17536089 ] Piotr Nowojski edited comment on FLINK-27251 at 5/12/22 12:34 PM: --

[jira] [Assigned] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-27251: -- Assignee: fanrui > Timeout aligned to unaligned checkpoint barrier in the output

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536089#comment-17536089 ] Piotr Nowojski commented on FLINK-27251: Thanks for the answers. Re 3., thanks for the pointers,

[jira] [Commented] (FLINK-25872) Restoring from non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534881#comment-17534881 ] Piotr Nowojski commented on FLINK-25872: I would still wait and see how many people would be

[jira] [Comment Edited] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534876#comment-17534876 ] Piotr Nowojski edited comment on FLINK-27251 at 5/11/22 12:53 PM: -- I've

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-11 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534876#comment-17534876 ] Piotr Nowojski commented on FLINK-27251: I've looked at the code and I have a couple of high

[jira] [Commented] (FLINK-27251) Solve the problem that upstream Task cannot be switched to Unaligned Checkpoint

2022-05-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534325#comment-17534325 ] Piotr Nowojski commented on FLINK-27251: Thanks for rising the issue [~fanrui]. Yes, this is a

[jira] [Updated] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

2022-05-10 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27251: --- Summary: Timeout aligned to unaligned checkpoint barrier in the output buffers of an

[jira] [Updated] (FLINK-27530) FLIP-227: Support overdraft buffer

2022-05-06 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27530: --- Summary: FLIP-227: Support overdraft buffer (was: Support overdraft buffer) > FLIP-227:

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-05-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531595#comment-17531595 ] Piotr Nowojski commented on FLINK-26803: Would removing 15K out of 50K files solve the issue for

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-05-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531097#comment-17531097 ] Piotr Nowojski commented on FLINK-26803: If it's just a single file per {{OperatorChain}}, why

[jira] [Comment Edited] (FLINK-25872) Restoring from non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-05-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530927#comment-17530927 ] Piotr Nowojski edited comment on FLINK-25872 at 5/2/22 7:47 PM:

[jira] [Commented] (FLINK-25872) Restoring from non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-05-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530927#comment-17530927 ] Piotr Nowojski commented on FLINK-25872: I would second [~dwysakowicz] concerns if we really

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

2022-05-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530907#comment-17530907 ] Piotr Nowojski commented on FLINK-26803: {quote} one file for each operator in the chain {quote}

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458438#comment-17458438 ] Piotr Nowojski edited comment on FLINK-6755 at 4/15/22 12:52 PM: - The

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458438#comment-17458438 ] Piotr Nowojski edited comment on FLINK-6755 at 4/15/22 12:51 PM: - The

[jira] [Comment Edited] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522815#comment-17522815 ] Piotr Nowojski edited comment on FLINK-27101 at 4/15/22 12:48 PM: --

[jira] [Comment Edited] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458438#comment-17458438 ] Piotr Nowojski edited comment on FLINK-6755 at 4/15/22 12:48 PM: - The

[jira] [Comment Edited] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522815#comment-17522815 ] Piotr Nowojski edited comment on FLINK-27101 at 4/15/22 12:47 PM: --

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-15 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522815#comment-17522815 ] Piotr Nowojski commented on FLINK-27101: Checkpoint would be still owned by the Flink itself.

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522243#comment-17522243 ] Piotr Nowojski commented on FLINK-27101: I've chatted offline with [~yunta] a bit about this. I

[jira] [Updated] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-6755: -- Priority: Not a Priority (was: Minor) > Allow triggering Checkpoints through command line

[jira] [Reopened] (FLINK-6755) Allow triggering Checkpoints through command line client

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reopened FLINK-6755: --- > Allow triggering Checkpoints through command line client >

[jira] [Updated] (FLINK-24191) Adjusting number of buffers besides buffer size

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-24191: --- Fix Version/s: (was: 1.16.0) > Adjusting number of buffers besides buffer size >

[jira] [Updated] (FLINK-15922) Show "Warn - received late message for checkpoint" only when checkpoint actually expired

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-15922: --- Priority: Not a Priority (was: Minor) > Show "Warn - received late message for checkpoint"

[jira] [Updated] (FLINK-13856) Reduce the delete file api when the checkpoint is completed

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-13856: --- Fix Version/s: (was: 1.16.0) > Reduce the delete file api when the checkpoint is

[jira] [Updated] (FLINK-15922) Show "Warn - received late message for checkpoint" only when checkpoint actually expired

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-15922: --- Fix Version/s: (was: 1.16.0) > Show "Warn - received late message for checkpoint" only

[jira] [Updated] (FLINK-14918) Add performance e2e test module and scripts

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-14918: --- Fix Version/s: (was: 1.16.0) > Add performance e2e test module and scripts >

[jira] [Updated] (FLINK-21317) Downstream keyed state not work after FlinkKafkaShuffle

2022-04-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-21317: --- Fix Version/s: (was: 1.16.0) > Downstream keyed state not work after FlinkKafkaShuffle

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521662#comment-17521662 ] Piotr Nowojski commented on FLINK-27101: But do you have in mind introducing something like

[jira] [Updated] (FLINK-27214) Build Failed on state backend benchmark

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27214: --- Fix Version/s: 1.16.0 > Build Failed on state backend benchmark >

[jira] [Updated] (FLINK-27214) Build Failed on state backend benchmark

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-27214: --- Priority: Blocker (was: Major) > Build Failed on state backend benchmark >

[jira] [Updated] (FLINK-20217) More fine-grained timer processing

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-20217: --- Description: Timers are currently processed in one big block under the checkpoint lock

[jira] [Updated] (FLINK-20217) More fine-grained timer processing

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-20217: --- Component/s: Runtime / Task > More fine-grained timer processing >

[jira] [Updated] (FLINK-25688) Resolve performance degradation with high parallelism when using buffer debloating

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-25688: --- Description: As documented in FLINK-25646, currently buffer debloating in Flink, at least

[jira] [Commented] (FLINK-24578) Unexpected erratic load shape for channel skew load profile and ~10% performance loss with enabled debloating

2022-04-13 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521540#comment-17521540 ] Piotr Nowojski commented on FLINK-24578: As a next step in this ticket it might be a good idea

<    1   2   3   4   5   6   7   8   9   10   >