[jira] [Created] (FLINK-29730) Simplify the ChannelStateWriteRequestDispatcherImpl due to not supported concurrent unaligned checkpoint

fanrui created FLINK-29730: -- Summary: Simplify the ChannelStateWriteRequestDispatcherImpl due to not supported concurrent unaligned checkpoint Key: FLINK-29730 URL: https://issues.apache.org/jira/browse/FLINK-29730

[jira] [Commented] (FLINK-28474) ChannelStateWriteResult may not fail after checkpoint abort

[ https://issues.apache.org/jira/browse/FLINK-28474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17613959#comment-17613959 ] fanrui commented on FLINK-28474: [~pnowojski]  thanks for your help and review~ >

[jira] [Commented] (FLINK-27530) FLIP-227: Support overdraft buffer

[ https://issues.apache.org/jira/browse/FLINK-27530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17606530#comment-17606530 ] fanrui commented on FLINK-27530: Hi [~godfreyhe] , as I understand, [~pnowojski]  has written the

[jira] [Commented] (FLINK-28474) ChannelStateWriteResult may not fail after checkpoint abort

[ https://issues.apache.org/jira/browse/FLINK-28474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564809#comment-17564809 ] fanrui commented on FLINK-28474: Hi [~pnowojski] , I have submitted this PR, could you help take a look

[jira] [Updated] (FLINK-28474) ChannelStateWriteResult may not fail after checkpoint abort

[ https://issues.apache.org/jira/browse/FLINK-28474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-28474: --- Description: After Checkpoint abort, ChannelStateWriteResult should fail. But if

[jira] [Updated] (FLINK-28474) ChannelStateWriteResult may not fail after checkpoint abort

[ https://issues.apache.org/jira/browse/FLINK-28474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-28474: --- Description: After Checkpoint abort, ChannelStateWriteResult should fail. But if

[jira] [Created] (FLINK-28474) ChannelStateWriteResult may not fail after checkpoint abort

fanrui created FLINK-28474: -- Summary: ChannelStateWriteResult may not fail after checkpoint abort Key: FLINK-28474 URL: https://issues.apache.org/jira/browse/FLINK-28474 Project: Flink Issue Type:

[jira] [Updated] (FLINK-28454) Fix the wrong timestamp example of KafkaSource

[ https://issues.apache.org/jira/browse/FLINK-28454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-28454: --- Description: [https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/connectors/datastream/kafka/]

[jira] [Updated] (FLINK-28454) Fix the wrong timestamp example of KafkaSource

[ https://issues.apache.org/jira/browse/FLINK-28454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-28454: --- Attachment: image-2022-07-08-13-46-05-540.png > Fix the wrong timestamp example of KafkaSource >

[jira] [Updated] (FLINK-28454) Fix the wrong timestamp example of KafkaSource

[ https://issues.apache.org/jira/browse/FLINK-28454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-28454: --- Attachment: image-2022-07-08-13-43-14-278.png > Fix the wrong timestamp example of KafkaSource >

[jira] [Updated] (FLINK-28454) Fix the wrong timestamp example of KafkaSource

[ https://issues.apache.org/jira/browse/FLINK-28454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-28454: --- Attachment: image-2022-07-08-13-42-49-902.png > Fix the wrong timestamp example of KafkaSource >

[jira] [Created] (FLINK-28454) Fix the wrong timestamp example of KafkaSource

fanrui created FLINK-28454: -- Summary: Fix the wrong timestamp example of KafkaSource Key: FLINK-28454 URL: https://issues.apache.org/jira/browse/FLINK-28454 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-27530) FLIP-227: Support overdraft buffer

Title: Message Title fanrui commented on

[jira] [Commented] (FLINK-27792) InterruptedException thrown by ChannelStateWriterImpl

[ https://issues.apache.org/jira/browse/FLINK-27792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555864#comment-17555864 ] fanrui commented on FLINK-27792: Hi [~chesnay]  [~pnowojski] . Sorry for introducing this issue, I'm

[jira] [Updated] (FLINK-27792) InterruptedException thrown by ChannelStateWriterImpl

[ https://issues.apache.org/jira/browse/FLINK-27792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-27792: --- Attachment: image-2022-06-18-16-42-13-669.png > InterruptedException thrown by ChannelStateWriterImpl >

[jira] [Updated] (FLINK-27792) InterruptedException thrown by ChannelStateWriterImpl

[ https://issues.apache.org/jira/browse/FLINK-27792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-27792: --- Attachment: image-2022-06-18-16-42-46-283.png > InterruptedException thrown by ChannelStateWriterImpl >

[jira] [Updated] (FLINK-27792) InterruptedException thrown by ChannelStateWriterImpl

[ https://issues.apache.org/jira/browse/FLINK-27792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-27792: --- Attachment: image-2022-06-18-16-39-54-402.png > InterruptedException thrown by ChannelStateWriterImpl >

[jira] [Commented] (FLINK-28077) KeyedStateCheckpointingITCase.testWithMemoryBackendSync runs into timeout

[ https://issues.apache.org/jira/browse/FLINK-28077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554862#comment-17554862 ] fanrui commented on FLINK-28077: Hi [~mapohl] [~chesnay] , thanks for this information, I will take a

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552631#comment-17552631 ] fanrui commented on FLINK-26803: Hi everyone, I've done a POC for merging the channel state files and

[jira] [Commented] (FLINK-27522) Ignore max buffers per channel when allocate buffer

[ https://issues.apache.org/jira/browse/FLINK-27522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544198#comment-17544198 ] fanrui commented on FLINK-27522: [~pnowojski] Thanks a lot for your review. > Ignore max buffers per

[jira] [Commented] (FLINK-27825) Update the doc of aligned checkpoint timeout

[ https://issues.apache.org/jira/browse/FLINK-27825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17543867#comment-17543867 ] fanrui commented on FLINK-27825: Hi [~pnowojski] , thanks for your review.(y) > Update the doc of

[jira] [Created] (FLINK-27825) Update the doc of aligned checkpoint timeout

fanrui created FLINK-27825: -- Summary: Update the doc of aligned checkpoint timeout Key: FLINK-27825 URL: https://issues.apache.org/jira/browse/FLINK-27825 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27822) Translate the doc of checkpoint/savepoint guarantees

fanrui created FLINK-27822: -- Summary: Translate the doc of checkpoint/savepoint guarantees Key: FLINK-27822 URL: https://issues.apache.org/jira/browse/FLINK-27822 Project: Flink Issue Type:

[jira] [Created] (FLINK-27789) LegacySource compatible with overdraft buffer

fanrui created FLINK-27789: -- Summary: LegacySource compatible with overdraft buffer Key: FLINK-27789 URL: https://issues.apache.org/jira/browse/FLINK-27789 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541863#comment-17541863 ] fanrui commented on FLINK-27251: [~pnowojski] Thanks a lot for your guidance and help. In the process of

[jira] [Commented] (FLINK-27724) The SubtaskCheckpointCoordinatorImpl#close() isn't called in anywhere

[ https://issues.apache.org/jira/browse/FLINK-27724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540973#comment-17540973 ] fanrui commented on FLINK-27724: Hi [~pnowojski]  [~Wencong Liu] , it's never closed on the

[jira] [Commented] (FLINK-27724) The SubtaskCheckpointCoordinatorImpl#close() isn't called in anywhere

[ https://issues.apache.org/jira/browse/FLINK-27724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540590#comment-17540590 ] fanrui commented on FLINK-27724: Hi [~Wencong Liu] , thanks for your feedback. I may have missed

[jira] [Comment Edited] (FLINK-27724) The SubtaskCheckpointCoordinatorImpl#close() isn't called in anywhere

[ https://issues.apache.org/jira/browse/FLINK-27724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540590#comment-17540590 ] fanrui edited comment on FLINK-27724 at 5/22/22 1:07 PM: - Hi [~Wencong Liu] ,

[jira] [Created] (FLINK-27724) The SubtaskCheckpointCoordinatorImpl#close() isn't called in anywhere

fanrui created FLINK-27724: -- Summary: The SubtaskCheckpointCoordinatorImpl#close() isn't called in anywhere Key: FLINK-27724 URL: https://issues.apache.org/jira/browse/FLINK-27724 Project: Flink

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17538832#comment-17538832 ] fanrui commented on FLINK-26803: Hi [~pnowojski] thanks for your feedback. Yes, I mean that for mostly

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17537192#comment-17537192 ] fanrui commented on FLINK-27251: Hi [~pnowojski] I have addressed your all suggestions, including: *

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536102#comment-17536102 ] fanrui commented on FLINK-27251: Thanks for your suggestions. Re 4, your are right. There is one 

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534911#comment-17534911 ] fanrui commented on FLINK-27251: Thanks for your comments.  For comment 1 and 2, you're right. It's

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534774#comment-17534774 ] fanrui commented on FLINK-27251: Hi [~pnowojski] This is my POC code :

[jira] [Commented] (FLINK-27251) Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask

[ https://issues.apache.org/jira/browse/FLINK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534356#comment-17534356 ] fanrui commented on FLINK-27251: Hi [~pnowojski] , thanks for your reply and some useful information.

[jira] [Updated] (FLINK-27522) Ignore max buffers per channel when allocate buffer

[ https://issues.apache.org/jira/browse/FLINK-27522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-27522: --- Parent: FLINK-27530 Issue Type: Sub-task (was: Improvement) > Ignore max buffers per channel when

[jira] [Updated] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26762: --- Parent: FLINK-27530 Issue Type: Sub-task (was: Improvement) > Add the overdraft buffer in

[jira] [Created] (FLINK-27530) Support overdraft buffer

fanrui created FLINK-27530: -- Summary: Support overdraft buffer Key: FLINK-27530 URL: https://issues.apache.org/jira/browse/FLINK-27530 Project: Flink Issue Type: Improvement Components:

[jira] [Created] (FLINK-27522) Ignore max buffers per channel when allocate buffer

fanrui created FLINK-27522: -- Summary: Ignore max buffers per channel when allocate buffer Key: FLINK-27522 URL: https://issues.apache.org/jira/browse/FLINK-27522 Project: Flink Issue Type:

[jira] [Updated] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26803: --- Attachment: image-2022-05-05-12-36-09-969.png > Merge small ChannelState file for Unaligned Checkpoint >

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532058#comment-17532058 ] fanrui commented on FLINK-26803: Hi [~pnowojski]  [~akalashnikov] , I want to add some information about

[jira] [Comment Edited] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531603#comment-17531603 ] fanrui edited comment on FLINK-26803 at 5/5/22 2:07 AM: Hi [~pnowojski]  Thanks

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531603#comment-17531603 ] fanrui commented on FLINK-26803: Hi [~pnowojski]  Thanks for your feedback. I'm sorry. I didn't express

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531182#comment-17531182 ] fanrui commented on FLINK-26803: Hi [~pnowojski] you're right. After my research, 15K of the 50K files

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17531034#comment-17531034 ] fanrui commented on FLINK-26803: Hi [~pnowojski] , thanks for your reply. In fact, there is one file

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528212#comment-17528212 ] fanrui commented on FLINK-26762: [~akalashnikov]  Thanks for your review. I will read your comments and

[jira] [Created] (FLINK-27396) Reduce the Heartbeat timeout after zookeeper suspended

fanrui created FLINK-27396: -- Summary: Reduce the Heartbeat timeout after zookeeper suspended Key: FLINK-27396 URL: https://issues.apache.org/jira/browse/FLINK-27396 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524320#comment-17524320 ] fanrui edited comment on FLINK-26762 at 4/19/22 2:29 PM: - Thanks for your quick

[jira] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762 ] fanrui deleted comment on FLINK-26762: was (Author: fanrui): I have a question, I hope you have time to help. Thanks a lot. When overdraft-memory-size=128KB, that is 4 memory segments. If 4

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524336#comment-17524336 ] fanrui commented on FLINK-26762: I have a question, I hope you have time to help. Thanks a lot. When

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524320#comment-17524320 ] fanrui commented on FLINK-26762: Thanks for your quick feedback. I just submitted a PR for benchmark.

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524253#comment-17524253 ] fanrui commented on FLINK-26762: [~akalashnikov]  thanks for your feedback. I think I should understand

[jira] [Comment Edited] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523505#comment-17523505 ] fanrui edited comment on FLINK-26762 at 4/18/22 4:01 AM: - Hi [~akalashnikov] , I

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523505#comment-17523505 ] fanrui commented on FLINK-26762: Hi [~akalashnikov] , I have submitted the PR of the overdraft buffer,

[jira] [Updated] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26762: --- Attachment: image-2022-04-18-11-46-03-895.png > Add the overdraft buffer in BufferPool to reduce unaligned

[jira] [Updated] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26762: --- Attachment: image-2022-04-18-11-45-14-700.png > Add the overdraft buffer in BufferPool to reduce unaligned

[jira] [Updated] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26762: --- Attachment: (was: image-2022-04-18-11-43-08-541.png) > Add the overdraft buffer in BufferPool to reduce

[jira] [Updated] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26762: --- Attachment: image-2022-04-18-11-43-08-541.png > Add the overdraft buffer in BufferPool to reduce unaligned

[jira] [Updated] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26762: --- Attachment: (was: image-2022-04-18-11-40-48-931.png) > Add the overdraft buffer in BufferPool to reduce

[jira] [Updated] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26762: --- Attachment: image-2022-04-18-11-40-48-931.png > Add the overdraft buffer in BufferPool to reduce unaligned

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522363#comment-17522363 ] fanrui commented on FLINK-26803: Hi [~akalashnikov] , thanks for your quick feedback. For some flink

[jira] [Created] (FLINK-27251) Solve the problem that upstream Task cannot be switched to Unaligned Checkpoint

fanrui created FLINK-27251: -- Summary: Solve the problem that upstream Task cannot be switched to Unaligned Checkpoint Key: FLINK-27251 URL: https://issues.apache.org/jira/browse/FLINK-27251 Project: Flink

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522304#comment-17522304 ] fanrui commented on FLINK-26803: Hi [~akalashnikov] , thanks for your reply. In fact, there is only one

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521221#comment-17521221 ] fanrui commented on FLINK-26762: Thanks for your quick feedback.  By default, the memory-segment size

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521011#comment-17521011 ] fanrui commented on FLINK-26762: Hi [~akalashnikov] , thanks a lot for your sincere reply and your

[jira] [Commented] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513251#comment-17513251 ] fanrui commented on FLINK-26803: Hi [~pnowojski]  [~arvid]  , could you help take a look in your free

[jira] [Commented] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

[ https://issues.apache.org/jira/browse/FLINK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513250#comment-17513250 ] fanrui commented on FLINK-26762: Hi [~pnowojski]  [~arvid] , could you help take a look in your free

[jira] [Created] (FLINK-26803) Merge small ChannelState file for Unaligned Checkpoint

fanrui created FLINK-26803: -- Summary: Merge small ChannelState file for Unaligned Checkpoint Key: FLINK-26803 URL: https://issues.apache.org/jira/browse/FLINK-26803 Project: Flink Issue Type:

[jira] [Commented] (FLINK-26759) Legacy source support waiting for recordWriter to be available

[ https://issues.apache.org/jira/browse/FLINK-26759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510352#comment-17510352 ] fanrui commented on FLINK-26759: Hi [~martijnvisser]  [~knaufk] , thanks for your clarification.

[jira] [Commented] (FLINK-26759) Legacy source support waiting for recordWriter to be available

[ https://issues.apache.org/jira/browse/FLINK-26759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510187#comment-17510187 ] fanrui commented on FLINK-26759: Hi [~martijnvisser] , thanks for your comment. I understand your

[jira] [Created] (FLINK-26762) Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked

fanrui created FLINK-26762: -- Summary: Add the overdraft buffer in BufferPool to reduce unaligned checkpoint being blocked Key: FLINK-26762 URL: https://issues.apache.org/jira/browse/FLINK-26762 Project:

[jira] [Updated] (FLINK-26759) Legacy source support waiting for recordWriter to be available

[ https://issues.apache.org/jira/browse/FLINK-26759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26759: --- Issue Type: Improvement (was: Bug) > Legacy source support waiting for recordWriter to be available >

[jira] [Created] (FLINK-26759) Legacy source support waiting for recordWriter to be available

fanrui created FLINK-26759: -- Summary: Legacy source support waiting for recordWriter to be available Key: FLINK-26759 URL: https://issues.apache.org/jira/browse/FLINK-26759 Project: Flink Issue

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501262#comment-17501262 ] fanrui commented on FLINK-26049: [~pnowojski]  [~akalashnikov]  Thank you for your advice and review. :)

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496559#comment-17496559 ] fanrui commented on FLINK-26049: Hi [~pnowojski] [~akalashnikov] , I have updated the

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495826#comment-17495826 ] fanrui commented on FLINK-26049: Hi [~pnowojski], this is exception stack. We meet the hdfs permission

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26049: --- Attachment: image-2022-02-22-10-31-05-012.png > The tolerable-failed-checkpoints logic is invalid when

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26049: --- Attachment: image-2022-02-22-10-27-43-731.png > The tolerable-failed-checkpoints logic is invalid when

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495464#comment-17495464 ] fanrui commented on FLINK-26049: Hi, [~pnowojski] , thanks for your reply. I think check IOExceptions

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494897#comment-17494897 ] fanrui commented on FLINK-26049: Hi [~akalashnikov] . Actually, I'm working on this JIRA, I'm pleasant

[jira] [Comment Edited] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494555#comment-17494555 ] fanrui edited comment on FLINK-26049 at 2/18/22, 11:32 AM: --- Hi [~akalashnikov]

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494555#comment-17494555 ] fanrui commented on FLINK-26049: Hi [~akalashnikov] , could we increase numberOfFailedCheckpoints

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26049: --- Attachment: (was: image-2022-02-18-11-28-12-354.png) > The tolerable-failed-checkpoints logic is

[jira] [Commented] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494353#comment-17494353 ] fanrui commented on FLINK-26049: I'm sorry, our prod env use Flink 1.13. I see some jiras have resolved

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26049: --- Attachment: image-2022-02-18-11-44-52-745.png > The tolerable-failed-checkpoints logic is invalid when

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26049: --- Attachment: image-2022-02-18-11-33-28-232.png > The tolerable-failed-checkpoints logic is invalid when

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26049: --- Attachment: image-2022-02-18-11-28-53-337.png > The tolerable-failed-checkpoints logic is invalid when

[jira] [Updated] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

[ https://issues.apache.org/jira/browse/FLINK-26049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated FLINK-26049: --- Attachment: image-2022-02-18-11-28-12-354.png > The tolerable-failed-checkpoints logic is invalid when

[jira] [Created] (FLINK-26049) The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed

fanrui created FLINK-26049: -- Summary: The tolerable-failed-checkpoints logic is invalid when checkpoint trigger failed Key: FLINK-26049 URL: https://issues.apache.org/jira/browse/FLINK-26049 Project: Flink

[jira] [Commented] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476106#comment-17476106 ] fanrui commented on FLINK-22643: I have submitted a PR by referencing the POC. If you are available,

[jira] [Commented] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474448#comment-17474448 ] fanrui commented on FLINK-22643: I have finished the performance test. From the test, I think we can set

[jira] [Commented] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467241#comment-17467241 ] fanrui commented on FLINK-22643: [~pnowojski]  Thanks for your suggestion. I will ensure that each task

[jira] [Comment Edited] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467174#comment-17467174 ] fanrui edited comment on FLINK-22643 at 12/31/21, 10:22 AM: [~kevin.cyj]

[jira] [Commented] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467174#comment-17467174 ] fanrui commented on FLINK-22643: [~kevin.cyj] [~pnowojski] Of course, I can do it. So, do I need to run

[jira] [Commented] (FLINK-22643) Too many TCP connections among TaskManagers for large scale jobs

[ https://issues.apache.org/jira/browse/FLINK-22643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464238#comment-17464238 ] fanrui commented on FLINK-22643: [~Thesharing] [~pnowojski] Thanks for your discussion. In our

[jira] [Commented] (FLINK-25417) Too many connections for TM

[ https://issues.apache.org/jira/browse/FLINK-25417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464225#comment-17464225 ] fanrui commented on FLINK-25417: Yeah, [~Thesharing] thanks for your reminder. I will watch FLINK-22643.

[jira] [Created] (FLINK-25417) Too many connections for TM

fanrui created FLINK-25417: -- Summary: Too many connections for TM Key: FLINK-25417 URL: https://issues.apache.org/jira/browse/FLINK-25417 Project: Flink Issue Type: Improvement

[jira] [Closed] (FLINK-21436) Speed ​​up the restore of UnionListState

[ https://issues.apache.org/jira/browse/FLINK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui closed FLINK-21436. -- Resolution: Invalid > Speed ​​up the restore of UnionListState > > >

[jira] [Commented] (FLINK-13856) Reduce the delete file api when the checkpoint is completed

[ https://issues.apache.org/jira/browse/FLINK-13856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324751#comment-17324751 ] fanrui commented on FLINK-13856: [~sewen]  [~andrew_lin] Good Feature. In HeapKeyedStateBackend or

[jira] [Commented] (FLINK-8531) Support separation of "Exclusive", "Shared" and "Task owned" state

[ https://issues.apache.org/jira/browse/FLINK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324728#comment-17324728 ] fanrui commented on FLINK-8531: --- [~yunta], I will look FLINK-13856. thanks. > Support separation of

  1   2   >