[jira] [Closed] (FLINK-33076) broadcastEmit of ChannelSelectorRecordWriter should reuse the serialized record

2023-09-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-33076. -- Fix Version/s: 1.19.0 Resolution: Fixed master(1.19) via

[jira] [Updated] (FLINK-32620) Migrate DiscardingSink to sinkv2

2023-09-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-32620: --- Affects Version/s: 1.19.0 (was: 1.18.0) > Migrate DiscardingSink to

[jira] [Created] (FLINK-33076) broadcastEmit of ChannelSelectorRecordWriter should reuse the serialized record

2023-09-12 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-33076: -- Summary: broadcastEmit of ChannelSelectorRecordWriter should reuse the serialized record Key: FLINK-33076 URL: https://issues.apache.org/jira/browse/FLINK-33076 Project:

[jira] [Closed] (FLINK-30906) TwoInputStreamTask passes wrong configuration object when creating input processor

2023-09-13 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-30906. -- Resolution: Fixed master(1.19) via 70f4c40f15f38ed404d8e031a08d534326535ced. > TwoInputStreamTask

[jira] [Updated] (FLINK-30906) TwoInputStreamTask passes wrong configuration object when creating input processor

2023-09-13 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-30906: --- Fix Version/s: 1.19.0 > TwoInputStreamTask passes wrong configuration object when creating input >

[jira] [Updated] (FLINK-32620) Migrate DiscardingSink to sinkv2

2023-09-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-32620: --- Fix Version/s: 1.19.0 > Migrate DiscardingSink to sinkv2 > > >

[jira] [Closed] (FLINK-32620) Migrate DiscardingSink to sinkv2

2023-09-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-32620. -- Resolution: Fixed master(1.19) via c4a76e2f006d834771092a8fac96bfc63361e20b. > Migrate

[jira] [Assigned] (FLINK-33323) HybridShuffleITCase fails with produced an uncaught exception in FatalExitExceptionHandler

2023-11-02 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-33323: -- Assignee: Wencong Liu > HybridShuffleITCase fails with produced an uncaught exception in >

[jira] [Closed] (FLINK-33323) HybridShuffleITCase fails with produced an uncaught exception in FatalExitExceptionHandler

2023-11-02 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-33323. -- Resolution: Fixed master(1.19) via cb3a69c967a978bf8e8bbe287e15113740a2766a. > HybridShuffleITCase

[jira] [Commented] (FLINK-33044) Reduce the frequency of triggering flush for the disk tier of the tiered storage

2023-09-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767089#comment-17767089 ] Weijie Guo commented on FLINK-33044: master(1.19) via b076c52d8da914e81c3e004c0b0c7883463bb151. >

[jira] [Updated] (FLINK-33044) Reduce the frequency of triggering flush for the disk tier of the tiered storage

2023-09-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-33044: --- Fix Version/s: 1.19.0 > Reduce the frequency of triggering flush for the disk tier of the tiered >

[jira] [Closed] (FLINK-33103) Hybrid shuffle ITCase supports the new mode

2023-09-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-33103. -- Fix Version/s: 1.19.0 Resolution: Fixed > Hybrid shuffle ITCase supports the new mode >

[jira] [Comment Edited] (FLINK-33044) Reduce the frequency of triggering flush for the disk tier of the tiered storage

2023-09-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767089#comment-17767089 ] Weijie Guo edited comment on FLINK-33044 at 9/21/23 2:04 AM: - master(1.19)

[jira] [Closed] (FLINK-33044) Reduce the frequency of triggering flush for the disk tier of the tiered storage

2023-09-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-33044. -- Resolution: Fixed > Reduce the frequency of triggering flush for the disk tier of the tiered >

[jira] [Updated] (FLINK-33044) Reduce the frequency of triggering flush for the disk tier of the tiered storage

2023-09-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-33044: --- Fix Version/s: 1.18.0 > Reduce the frequency of triggering flush for the disk tier of the tiered >

[jira] [Commented] (FLINK-33103) Hybrid shuffle ITCase supports the new mode

2023-09-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1770#comment-1770 ] Weijie Guo commented on FLINK-33103: master(1.19) via cc33ce175c1b3953577cd26e2416cb2eef94e176. >

[jira] [Comment Edited] (FLINK-33185) HybridShuffleITCase fails with TimeoutException: Pending slot request timed out in slot pool on AZP

2023-10-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776626#comment-17776626 ] Weijie Guo edited comment on FLINK-33185 at 10/18/23 12:05 PM: --- master via

[jira] [Commented] (FLINK-33185) HybridShuffleITCase fails with TimeoutException: Pending slot request timed out in slot pool on AZP

2023-10-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776626#comment-17776626 ] Weijie Guo commented on FLINK-33185: master via 166aab3ac4d83b0078496b41483d469158332b91. Feel free

[jira] [Closed] (FLINK-33185) HybridShuffleITCase fails with TimeoutException: Pending slot request timed out in slot pool on AZP

2023-10-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-33185. -- Fix Version/s: 1.19.0 Resolution: Fixed > HybridShuffleITCase fails with TimeoutException:

[jira] [Assigned] (FLINK-31262) Move kafka sql connector fat jar test to SmokeKafkaITCase

2023-10-16 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-31262: -- Assignee: (was: Weijie Guo) > Move kafka sql connector fat jar test to SmokeKafkaITCase

[jira] [Closed] (FLINK-32770) Fix the inaccurate backlog number of Hybrid Shuffle

2023-08-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-32770. -- Resolution: Fixed master(1.18) via ed4937cbc0ee73e08856cc59bfbf788682c70a09. > Fix the inaccurate

[jira] [Assigned] (FLINK-32770) Fix the inaccurate backlog number of Hybrid Shuffle

2023-08-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-32770: -- Assignee: Wencong Liu > Fix the inaccurate backlog number of Hybrid Shuffle >

[jira] [Resolved] (FLINK-32779) Release Testing: Verify FLIP-301: Hybrid Shuffle supports Remote Storage

2023-08-29 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-32779. Resolution: Resolved > Release Testing: Verify FLIP-301: Hybrid Shuffle supports Remote Storage >

[jira] [Commented] (FLINK-32779) Release Testing: Verify FLIP-301: Hybrid Shuffle supports Remote Storage

2023-08-29 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759905#comment-17759905 ] Weijie Guo commented on FLINK-32779: Thank you for the detailed testing instructions. I took the

[jira] [Assigned] (FLINK-33493) Elasticsearch connector ElasticsearchWriterITCase test failed

2023-11-09 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-33493: -- Assignee: Yuxin Tan > Elasticsearch connector ElasticsearchWriterITCase test failed >

[jira] [Updated] (FLINK-33493) Elasticsearch connector ElasticsearchWriterITCase test failed

2023-11-09 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-33493: --- Fix Version/s: elasticsearch-3.1.0 > Elasticsearch connector ElasticsearchWriterITCase test failed

[jira] [Resolved] (FLINK-33493) Elasticsearch connector ElasticsearchWriterITCase test failed

2023-11-09 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-33493. Resolution: Fixed > Elasticsearch connector ElasticsearchWriterITCase test failed >

[jira] [Closed] (FLINK-33493) Elasticsearch connector ElasticsearchWriterITCase test failed

2023-11-09 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-33493. -- > Elasticsearch connector ElasticsearchWriterITCase test failed >

[jira] [Commented] (FLINK-33493) Elasticsearch connector ElasticsearchWriterITCase test failed

2023-11-09 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17784683#comment-17784683 ] Weijie Guo commented on FLINK-33493: main via 161b615. > Elasticsearch connector

[jira] [Commented] (FLINK-25806) Remove legacy high availability services

2022-06-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544782#comment-17544782 ] Weijie Guo commented on FLINK-25806: Hi [~chesnay], I noticed that in this PR, only

[jira] [Created] (FLINK-28448) BoundedDataTestBase has potential problem when compression is enable

2022-07-07 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-28448: -- Summary: BoundedDataTestBase has potential problem when compression is enable Key: FLINK-28448 URL: https://issues.apache.org/jira/browse/FLINK-28448 Project: Flink

[jira] [Commented] (FLINK-28448) BoundedDataTestBase has potential problem when compression is enable

2022-07-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17563839#comment-17563839 ] Weijie Guo commented on FLINK-28448: cc [~kevin.cyj]  > BoundedDataTestBase has potential problem

[jira] [Commented] (FLINK-28382) Introduce new compression algorithms of higher compression ratio

2022-07-05 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562696#comment-17562696 ] Weijie Guo commented on FLINK-28382: [~kevin.cyj] Maybe i can help introduce some compression

[jira] [Commented] (FLINK-28363) Support drop savepoint statement in SQL client

2022-07-02 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561774#comment-17561774 ] Weijie Guo commented on FLINK-28363: Hi [~Paul Lin] , I'm very interested in this ticket. If you

[jira] [Updated] (FLINK-27905) Introduce HsSpillStrategy and Implement SelectiveSpillStrategy

2022-06-29 Thread Weijie Guo (Jira)
Title: Message Title Weijie Guo updated

[jira] [Updated] (FLINK-27905) Introduce HsSpillStrategy and Implement SelectiveSpillStrategy

2022-06-29 Thread Weijie Guo (Jira)
Title: Message Title Weijie Guo updated

[jira] [Updated] (FLINK-27905) Introduce HsSpillingStrategy and Implement SelectiveSpillingStrategy

2022-06-29 Thread Weijie Guo (Jira)
Title: Message Title Weijie Guo updated

[jira] [Commented] (FLINK-28326) ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

2022-07-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561338#comment-17561338 ] Weijie Guo commented on FLINK-28326: Thanks for reporting the issue, it's an unstable test, I'll fix

[jira] [Updated] (FLINK-27907) Implement disk read and write logic for hybrid shuffle

2022-06-28 Thread Weijie Guo (Jira)
Title: Message Title Weijie Guo updated

[jira] [Updated] (FLINK-27907) Implement disk read and write logic for hybrid shuffle

2022-06-28 Thread Weijie Guo (Jira)
Title: Message Title Weijie Guo updated

[jira] [Updated] (FLINK-27907) Implement disk read and write logic for hybrid shuffle

2022-06-28 Thread Weijie Guo (Jira)
Title: Message Title Weijie Guo updated

[jira] [Comment Edited] (FLINK-28326) ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

2022-07-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561338#comment-17561338 ] Weijie Guo edited comment on FLINK-28326 at 7/1/22 6:08 PM: Thanks for

[jira] [Commented] (FLINK-28399) Refactor CheckedThread to accept runnable via constructor

2022-07-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564448#comment-17564448 ] Weijie Guo commented on FLINK-28399: Hi [~chesnay] Thanks for open this ticket, I think this idea

[jira] [Comment Edited] (FLINK-28399) Refactor CheckedThread to accept runnable via constructor

2022-07-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564448#comment-17564448 ] Weijie Guo edited comment on FLINK-28399 at 7/8/22 8:07 PM: Hi [~chesnay]

[jira] [Commented] (FLINK-25784) SerializedThrowable(De)Serializer out of sync

2022-07-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564456#comment-17564456 ] Weijie Guo commented on FLINK-25784: In `SerializedThrowableSerializer`, the other two fields have

[jira] [Commented] (FLINK-27904) Introduce HsDataBuffer

2022-07-11 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564827#comment-17564827 ] Weijie Guo commented on FLINK-27904: Through offline communication with [~aitozi] , because he has

[jira] [Commented] (FLINK-28325) DataOutputSerializer#writeBytes increase position twice

2022-07-08 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564338#comment-17564338 ] Weijie Guo commented on FLINK-28325: duplicate as FLINK-23598 > DataOutputSerializer#writeBytes

[jira] [Updated] (FLINK-27904) Introduce HsMemoryDataManager

2022-07-12 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-27904: --- Summary: Introduce HsMemoryDataManager (was: Introduce HsDataBuffer) > Introduce

[jira] [Updated] (FLINK-27905) Introduce HsSpillingStrategy and Implement SelectiveSpillingStrategy、FullSpillingStrategy

2022-07-12 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-27905: --- Summary: Introduce HsSpillingStrategy and Implement SelectiveSpillingStrategy、FullSpillingStrategy

[jira] [Created] (FLINK-27920) Documented enums constant support ExcludeFromDocumentation annotation

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27920: -- Summary: Documented enums constant support ExcludeFromDocumentation annotation Key: FLINK-27920 URL: https://issues.apache.org/jira/browse/FLINK-27920 Project: Flink

[jira] [Comment Edited] (FLINK-27862) FLIP-235: Hybrid Shuffle Mode

2022-06-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550819#comment-17550819 ] Weijie Guo edited comment on FLINK-27862 at 6/7/22 6:17 AM: Hi [~aitozi],

[jira] [Commented] (FLINK-27862) FLIP-235: Hybrid Shuffle Mode

2022-06-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550819#comment-17550819 ] Weijie Guo commented on FLINK-27862: Hi [~aitozi], Thank you very much for your attention, welcome

[jira] [Updated] (FLINK-27920) Documented enums constant support ExcludeFromDocumentation annotation

2022-06-06 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-27920: --- Issue Type: Improvement (was: Bug) > Documented enums constant support ExcludeFromDocumentation

[jira] [Created] (FLINK-27902) Refactor ResultPartitionType to decouple scheduling and partition release logic

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27902: -- Summary: Refactor ResultPartitionType to decouple scheduling and partition release logic Key: FLINK-27902 URL: https://issues.apache.org/jira/browse/FLINK-27902 Project:

[jira] [Created] (FLINK-27906) Introduce HsDataIndex

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27906: -- Summary: Introduce HsDataIndex Key: FLINK-27906 URL: https://issues.apache.org/jira/browse/FLINK-27906 Project: Flink Issue Type: Sub-task Reporter:

[jira] [Created] (FLINK-27907) Abstract and implement disk read and write logic for hybrid shuffle

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27907: -- Summary: Abstract and implement disk read and write logic for hybrid shuffle Key: FLINK-27907 URL: https://issues.apache.org/jira/browse/FLINK-27907 Project: Flink

[jira] [Created] (FLINK-27909) Add document and tests for hybrid shuffle mode

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27909: -- Summary: Add document and tests for hybrid shuffle mode Key: FLINK-27909 URL: https://issues.apache.org/jira/browse/FLINK-27909 Project: Flink Issue Type:

[jira] [Created] (FLINK-27908) Introduce HsResultPartition and HsSubpartitionView

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27908: -- Summary: Introduce HsResultPartition and HsSubpartitionView Key: FLINK-27908 URL: https://issues.apache.org/jira/browse/FLINK-27908 Project: Flink Issue Type:

[jira] [Created] (FLINK-27903) Introduce and support HYBRID resultPartitionType

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27903: -- Summary: Introduce and support HYBRID resultPartitionType Key: FLINK-27903 URL: https://issues.apache.org/jira/browse/FLINK-27903 Project: Flink Issue Type:

[jira] [Created] (FLINK-27904) Introduce HsDataBuffer

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27904: -- Summary: Introduce HsDataBuffer Key: FLINK-27904 URL: https://issues.apache.org/jira/browse/FLINK-27904 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-27905) Introduce HsSpillStrategy and Implement SelectiveSpillStrategy

2022-06-06 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27905: -- Summary: Introduce HsSpillStrategy and Implement SelectiveSpillStrategy Key: FLINK-27905 URL: https://issues.apache.org/jira/browse/FLINK-27905 Project: Flink

[jira] [Commented] (FLINK-28102) Flink AkkaRpcSystemLoader fails when temporary directory is a symlink

2022-06-17 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555485#comment-17555485 ] Weijie Guo commented on FLINK-28102:  We can handle symlinks correctly before FLINK-23500, but now

[jira] [Comment Edited] (FLINK-28102) Flink AkkaRpcSystemLoader fails when temporary directory is a symlink

2022-06-17 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555485#comment-17555485 ] Weijie Guo edited comment on FLINK-28102 at 6/17/22 8:58 AM: -  We can handle

[jira] [Comment Edited] (FLINK-28102) Flink AkkaRpcSystemLoader fails when temporary directory is a symlink

2022-06-17 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555485#comment-17555485 ] Weijie Guo edited comment on FLINK-28102 at 6/17/22 8:59 AM: -  We can handle

[jira] [Commented] (FLINK-28102) Flink AkkaRpcSystemLoader fails when temporary directory is a symlink

2022-06-17 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555442#comment-17555442 ] Weijie Guo commented on FLINK-28102: You can set an io.tmp.dirs yourself using -D createDirectories

[jira] [Comment Edited] (FLINK-28102) Flink AkkaRpcSystemLoader fails when temporary directory is a symlink

2022-06-17 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555442#comment-17555442 ] Weijie Guo edited comment on FLINK-28102 at 6/17/22 7:19 AM: - You can set

[jira] [Commented] (FLINK-28033) find and output new min watermark mybe wrong when in multichannel

2022-06-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556114#comment-17556114 ] Weijie Guo commented on FLINK-28033: `newMinWatermark` is a local variable, it will be reset to the

[jira] [Comment Edited] (FLINK-28033) find and output new min watermark mybe wrong when in multichannel

2022-06-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556114#comment-17556114 ] Weijie Guo edited comment on FLINK-28033 at 6/19/22 6:43 PM: - [~ye-able] ,

[jira] [Comment Edited] (FLINK-28033) find and output new min watermark mybe wrong when in multichannel

2022-06-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556114#comment-17556114 ] Weijie Guo edited comment on FLINK-28033 at 6/19/22 6:43 PM: - hi [~ye-able]

[jira] [Commented] (FLINK-28125) Promote leadership changing logs to INFO level

2022-06-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556220#comment-17556220 ] Weijie Guo commented on FLINK-28125: Hi [~xtsong] , I am interested in this ticket, would you like

[jira] [Commented] (FLINK-25540) [JUnit5 Migration] Module: flink-runtime

2022-06-21 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556661#comment-17556661 ] Weijie Guo commented on FLINK-25540: Hi, [~RocMarshal] Are you still working on it? If not, I'd like

[jira] (FLINK-25540) [JUnit5 Migration] Module: flink-runtime

2022-06-21 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25540 ] Weijie Guo deleted comment on FLINK-25540: was (Author: weijie guo): Hi, [~RocMarshal] Are you still working on it? If not, I'd like to take it over. > [JUnit5 Migration] Module:

[jira] [Commented] (FLINK-27874) KeyedStateCheckpointingITCase Timeout

2022-06-09 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17552091#comment-17552091 ] Weijie Guo commented on FLINK-27874:

[jira] [Created] (FLINK-27948) Unifying how result partition should be released

2022-06-07 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-27948: -- Summary: Unifying how result partition should be released Key: FLINK-27948 URL: https://issues.apache.org/jira/browse/FLINK-27948 Project: Flink Issue Type:

[jira] [Commented] (FLINK-27667) YARNHighAvailabilityITCase fails with "Failed to delete temp directory /tmp/junit1681"

2022-06-10 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553031#comment-17553031 ] Weijie Guo commented on FLINK-27667:

[jira] [Created] (FLINK-28623) Optimize the use of off heap memory by blocking and hybrid shuffle reader

2022-07-21 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-28623: -- Summary: Optimize the use of off heap memory by blocking and hybrid shuffle reader Key: FLINK-28623 URL: https://issues.apache.org/jira/browse/FLINK-28623 Project: Flink

[jira] [Updated] (FLINK-28623) Optimize the use of off heap memory by blocking and hybrid shuffle reader

2022-07-21 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-28623: --- Description: Currently, each FileReader(PartitionFileReader or HsSubpartitionFileReaderImpl) will

[jira] [Commented] (FLINK-26721) PulsarSourceITCase.testSavepoint failed on azure pipeline

2022-07-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566917#comment-17566917 ] Weijie Guo commented on FLINK-26721:

[jira] [Created] (FLINK-28701) Minimize the explosion range during failover for hybrid shuffle

2022-07-27 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-28701: -- Summary: Minimize the explosion range during failover for hybrid shuffle Key: FLINK-28701 URL: https://issues.apache.org/jira/browse/FLINK-28701 Project: Flink

[jira] [Updated] (FLINK-27908) Introduce HsResultPartition and HsSubpartitionView

2022-07-27 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-27908: --- Description: Introduce HsResultPartition and HsSubpartitionView to supports record write and read.

[jira] [Commented] (FLINK-28214) ArrayDataSerializer can not be reused to copy customized type of array data

2022-06-23 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557840#comment-17557840 ] Weijie Guo commented on FLINK-28214: Hi [~yittg], I'm not particularly sure why the extra copy is

[jira] [Comment Edited] (FLINK-28214) ArrayDataSerializer can not be reused to copy customized type of array data

2022-06-23 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557840#comment-17557840 ] Weijie Guo edited comment on FLINK-28214 at 6/23/22 6:13 AM: - Hi [~yittg],

[jira] [Commented] (FLINK-26721) PulsarSourceITCase.testSavepoint failed on azure pipeline

2022-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17573838#comment-17573838 ] Weijie Guo commented on FLINK-26721:

[jira] [Created] (FLINK-29101) PipelinedRegionSchedulingStrategy benchmark shows performance degradation

2022-08-24 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-29101: -- Summary: PipelinedRegionSchedulingStrategy benchmark shows performance degradation Key: FLINK-29101 URL: https://issues.apache.org/jira/browse/FLINK-29101 Project: Flink

[jira] [Created] (FLINK-29034) HYBRID_FULL result partition type is not yet reConsumable

2022-08-18 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-29034: -- Summary: HYBRID_FULL result partition type is not yet reConsumable Key: FLINK-29034 URL: https://issues.apache.org/jira/browse/FLINK-29034 Project: Flink Issue

[jira] [Created] (FLINK-29053) Hybrid shuffle has concurrent modification of buffer when compression is enabled

2022-08-22 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-29053: -- Summary: Hybrid shuffle has concurrent modification of buffer when compression is enabled Key: FLINK-29053 URL: https://issues.apache.org/jira/browse/FLINK-29053

[jira] [Created] (FLINK-29056) Throw PartitionNotFoundException if the partition file is not readable for hybird shuffle.

2022-08-22 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-29056: -- Summary: Throw PartitionNotFoundException if the partition file is not readable for hybird shuffle. Key: FLINK-29056 URL: https://issues.apache.org/jira/browse/FLINK-29056

[jira] [Commented] (FLINK-29183) flink job ended before window time up while using bounded stream source

2022-09-07 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601316#comment-17601316 ] Weijie Guo commented on FLINK-29183: [~landlord] First of all, the phenomenon you observed is in

[jira] [Commented] (FLINK-28923) Release Testing: Verify flip-241 completed jobs information enhancement

2022-08-23 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17583399#comment-17583399 ] Weijie Guo commented on FLINK-28923: [~xtsong] Thank you for such a good job, I have manually tested

[jira] [Updated] (FLINK-29056) Throw PartitionNotFoundException if the partition file is not readable for hybrid shuffle.

2022-08-23 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-29056: --- Summary: Throw PartitionNotFoundException if the partition file is not readable for hybrid shuffle.

[jira] [Created] (FLINK-29425) Hybrid full spilling strategy triggering spilling frequently

2022-09-26 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-29425: -- Summary: Hybrid full spilling strategy triggering spilling frequently Key: FLINK-29425 URL: https://issues.apache.org/jira/browse/FLINK-29425 Project: Flink

[jira] [Commented] (FLINK-29431) Exceptions during job graph serialization lock up client

2022-09-27 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610030#comment-17610030 ] Weijie Guo commented on FLINK-29431: [~chesnay] Thank you for reporting this bug, I'll take a look.

[jira] [Commented] (FLINK-29460) HsResultPartitionTest.testRelease failed with AssertionFailedError

2022-09-28 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610777#comment-17610777 ] Weijie Guo commented on FLINK-29460: [~hxbks2ks] Thanks for reporting this unstable test, I think

[jira] [Commented] (FLINK-29641) SortMergeResultPartitionReadSchedulerTest.testCreateSubpartitionReader

2022-10-18 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619420#comment-17619420 ] Weijie Guo commented on FLINK-29641: This JIRA can be closed as the pull request has been merged. >

[jira] [Commented] (FLINK-29419) HybridShuffle.testHybridFullExchangesRestart hangs

2022-10-17 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618713#comment-17618713 ] Weijie Guo commented on FLINK-29419: The specific reason needs to be further investigated. In order

[jira] [Updated] (FLINK-28889) Hybrid shuffle should supports multiple consumer

2022-10-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-28889: --- Summary: Hybrid shuffle should supports multiple consumer (was: Hybrid shuffle writes multiple

[jira] [Updated] (FLINK-28889) Hybrid shuffle writes multiple copies of broadcast data

2022-10-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-28889: --- Description: Hybrid shuffle does not support multiple consumer for single subpartition data. This

[jira] [Updated] (FLINK-28889) Hybrid shuffle should supports multiple consumer

2022-10-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-28889: --- Description: Hybrid shuffle does not support multiple consumer for single subpartition data. This

[jira] [Commented] (FLINK-29698) Job Manager fails with FileAlreadyExistsException if java.io.tmpdir points to a symbolic link

2022-10-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620782#comment-17620782 ] Weijie Guo commented on FLINK-29698: Maybe this is duplicated with FLINK-28102 > Job Manager fails

[jira] [Commented] (FLINK-29698) Job Manager fails with FileAlreadyExistsException if java.io.tmpdir points to a symbolic link

2022-10-20 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620794#comment-17620794 ] Weijie Guo commented on FLINK-29698: Yes, I agree with you that this is a serious problem. However,

  1   2   3   4   5   6   7   8   9   10   >