[jira] [Created] (FLINK-35166) Improve the performance of Hybrid Shuffle when enable memory decoupling

2024-04-18 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-35166: - Summary: Improve the performance of Hybrid Shuffle when enable memory decoupling Key: FLINK-35166 URL: https://issues.apache.org/jira/browse/FLINK-35166 Project: Flink

[jira] [Updated] (FLINK-33668) Decoupling Shuffle network memory and job topology

2024-01-15 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33668: -- Description: With FLINK-30469  and FLINK-31643, we have decoupled the shuffle network memory and the

[jira] [Comment Edited] (FLINK-34070) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails for the AdaptiveScheduler

2024-01-12 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806125#comment-17806125 ] Jiang Xin edited comment on FLINK-34070 at 1/12/24 5:08 PM: [~mapohl] Thanks

[jira] [Commented] (FLINK-34070) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails for the AdaptiveScheduler

2024-01-12 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806125#comment-17806125 ] Jiang Xin commented on FLINK-34070: --- [~mapohl] Thanks for the clarification of FLINK-33414 and

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may stop working for a while during redistribution

2024-01-11 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Summary: Hybrid Shuffle may stop working for a while during redistribution (was: Hybrid Shuffle may

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang for a while during redistribution

2024-01-11 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Summary: Hybrid Shuffle may hang for a while during redistribution (was: Hybrid Shuffle may hang

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2024-01-11 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Description: Currently, the Hybrid Shuffle can work with the memory tier and disk tier together,

[jira] [Commented] (FLINK-33414) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails due to unexpected TimeoutException

2024-01-10 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805022#comment-17805022 ] Jiang Xin commented on FLINK-33414: --- [~mapohl] Do you have time to take a look? I went through the

[jira] [Comment Edited] (FLINK-33414) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails due to unexpected TimeoutException

2024-01-08 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17804610#comment-17804610 ] Jiang Xin edited comment on FLINK-33414 at 1/9/24 7:44 AM: --- [~Sergey Nuyanzin]

[jira] [Commented] (FLINK-33414) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails due to unexpected TimeoutException

2024-01-08 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17804610#comment-17804610 ] Jiang Xin commented on FLINK-33414: --- [~Sergey Nuyanzin] Is it can be consistently reproduced on AZP? I

[jira] [Commented] (FLINK-33961) Hybrid Shuffle may hang when exclusive buffers per channel is set to 0

2024-01-01 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801676#comment-17801676 ] Jiang Xin commented on FLINK-33961: --- [~Weijie Guo] Thanks for the explanation, I have no more

[jira] [Updated] (FLINK-33954) Large record may cause the hybrid shuffle hang

2024-01-01 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33954: -- Description: In some cases, the job may hang when there are not enough buffers in the local buffer

[jira] [Updated] (FLINK-33954) Large record may cause the hybrid shuffle hang

2024-01-01 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33954: -- Description: In some cases, the job may hang when there are not enough buffers in the local buffer

[jira] [Commented] (FLINK-33961) Hybrid Shuffle may hang when exclusive buffers per channel is set to 0

2024-01-01 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801642#comment-17801642 ] Jiang Xin commented on FLINK-33961: --- [~Weijie Guo] Do you have any idea about it? > Hybrid Shuffle

[jira] [Updated] (FLINK-33961) Hybrid Shuffle may hang when exclusive buffers per channel is set to 0

2024-01-01 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33961: -- Description: I found that the Hybrid Shuffle without enabling new mode may hang when

[jira] [Updated] (FLINK-33961) Hybrid Shuffle may hang when exclusive buffers per channel is set to 0

2024-01-01 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33961: -- Description: I found that the Hybrid Shuffle without enabling new mode may hang when

[jira] [Created] (FLINK-33961) Hybrid Shuffle may hang when exclusive buffers per channel is set to 0

2024-01-01 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-33961: - Summary: Hybrid Shuffle may hang when exclusive buffers per channel is set to 0 Key: FLINK-33961 URL: https://issues.apache.org/jira/browse/FLINK-33961 Project: Flink

[jira] [Created] (FLINK-33954) Large record may cause the hybrid shuffle hang

2023-12-27 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-33954: - Summary: Large record may cause the hybrid shuffle hang Key: FLINK-33954 URL: https://issues.apache.org/jira/browse/FLINK-33954 Project: Flink Issue Type: Bug

[jira] [Comment Edited] (FLINK-33414) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails due to unexpected TimeoutException

2023-12-23 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800056#comment-17800056 ] Jiang Xin edited comment on FLINK-33414 at 12/23/23 1:57 PM: - [~mapohl] I

[jira] [Commented] (FLINK-33414) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails due to unexpected TimeoutException

2023-12-23 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800056#comment-17800056 ] Jiang Xin commented on FLINK-33414: --- [~mapohl] I think it is caused by this

[jira] [Comment Edited] (FLINK-33414) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails due to unexpected TimeoutException

2023-12-21 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799308#comment-17799308 ] Jiang Xin edited comment on FLINK-33414 at 12/21/23 9:26 AM: - [~mapohl]

[jira] [Comment Edited] (FLINK-33414) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails due to unexpected TimeoutException

2023-12-21 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799308#comment-17799308 ] Jiang Xin edited comment on FLINK-33414 at 12/21/23 8:59 AM: - [~mapohl]

[jira] [Commented] (FLINK-33414) MiniClusterITCase.testHandleStreamingJobsWhenNotEnoughSlot fails due to unexpected TimeoutException

2023-12-21 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799308#comment-17799308 ] Jiang Xin commented on FLINK-33414: --- I also met the exception and after delving into the code, I found

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

2023-12-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17799254#comment-17799254 ] Jiang Xin commented on FLINK-33856: --- [~hejufang001] I'm sorry, I have no permission to assign but I

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2023-12-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Description: Currently, the Hybrid Shuffle can work with the memory tier and disk tier together,

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2023-12-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Description: Currently, the Hybrid Shuffle can work with the memory tier and disk tier together,

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2023-12-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Description: Currently, the Hybrid Shuffle can work with the memory tier and disk tier together,

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2023-12-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Description: Currently, the Hybrid Shuffle can work with Memory Tier and Disk Tier together,

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2023-12-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Description: Currently, the Hybrid Shuffle can work with Memory Tier and Disk Tier together, if the

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2023-12-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Description: Currently, the Hybrid Shuffle can work with Memory Tier and Disk Tier together, however,

[jira] [Updated] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2023-12-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33879: -- Description: Currently, the Hybrid Shuffle can work with Memory Tier and Disk Tier together. Image

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

2023-12-19 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798787#comment-17798787 ] Jiang Xin commented on FLINK-33856: --- Sounds reasonable. Have you already started working on this? >

[jira] [Created] (FLINK-33879) Hybrid Shuffle may hang during redistribution

2023-12-19 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-33879: - Summary: Hybrid Shuffle may hang during redistribution Key: FLINK-33879 URL: https://issues.apache.org/jira/browse/FLINK-33879 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-33668) Decoupling Shuffle network memory and job topology

2023-11-28 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33668: -- Description: With FLINK-30469  and FLINK-31643, we have decoupled the shuffle network memory and the

[jira] [Updated] (FLINK-33668) Decoupling Shuffle network memory and job topology

2023-11-28 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33668: -- Description: With FLINK-30469  and FLINK-31643, we have decoupled the shuffle network memory and the

[jira] [Updated] (FLINK-33668) Decoupling Shuffle network memory and job topology

2023-11-28 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33668: -- Description: With FLINK-30469  and FLINK-31643, we have decoupled the shuffle network memory and the

[jira] [Updated] (FLINK-33668) Decoupling Shuffle network memory and job topology

2023-11-27 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-33668: -- Description: With FLINK-30469  and FLINK-31643, we have decoupled the shuffle network memory and the

[jira] [Created] (FLINK-33668) Decoupling Shuffle network memory and job topology

2023-11-27 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-33668: - Summary: Decoupling Shuffle network memory and job topology Key: FLINK-33668 URL: https://issues.apache.org/jira/browse/FLINK-33668 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-33186) CheckpointAfterAllTasksFinishedITCase.testRestoreAfterSomeTasksFinished fails on AZP

2023-10-10 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773565#comment-17773565 ] Jiang Xin edited comment on FLINK-33186 at 10/10/23 6:53 AM: - [~Sergey

[jira] [Commented] (FLINK-33186) CheckpointAfterAllTasksFinishedITCase.testRestoreAfterSomeTasksFinished fails on AZP

2023-10-10 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773565#comment-17773565 ] Jiang Xin commented on FLINK-33186: --- [~Sergey Nuyanzin] I don't think the failure is related to

[jira] [Commented] (FLINK-33186) CheckpointAfterAllTasksFinishedITCase.testRestoreAfterSomeTasksFinished fails on AZP

2023-10-05 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17772246#comment-17772246 ] Jiang Xin commented on FLINK-33186: --- I'll take a look at it. >

[jira] [Created] (FLINK-33118) Remove the PythonBridgeUtils

2023-09-19 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-33118: - Summary: Remove the PythonBridgeUtils Key: FLINK-33118 URL: https://issues.apache.org/jira/browse/FLINK-33118 Project: Flink Issue Type: Improvement

[jira] [Comment Edited] (FLINK-32996) CheckpointAfterAllTasksFinishedITCase.testFailoverAfterSomeTasksFinished fails on AZP

2023-08-30 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760357#comment-17760357 ] Jiang Xin edited comment on FLINK-32996 at 8/30/23 12:20 PM: - I tried to

[jira] [Commented] (FLINK-32996) CheckpointAfterAllTasksFinishedITCase.testFailoverAfterSomeTasksFinished fails on AZP

2023-08-30 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760357#comment-17760357 ] Jiang Xin commented on FLINK-32996: --- I tried to reproduce it locally, but the failure didn't appear

[jira] [Resolved] (FLINK-32911) Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished

2023-08-30 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin resolved FLINK-32911. --- Resolution: Fixed > Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after >

[jira] [Commented] (FLINK-32911) Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished

2023-08-30 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760351#comment-17760351 ] Jiang Xin commented on FLINK-32911: --- [~mapohl], thanks for your efforts. The test result looks good

[jira] [Commented] (FLINK-32911) Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished

2023-08-23 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757905#comment-17757905 ] Jiang Xin commented on FLINK-32911: --- [~mapohl] Yes, it is a bug. Please help create a bug issue and

[jira] [Commented] (FLINK-32911) Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished

2023-08-23 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757879#comment-17757879 ] Jiang Xin commented on FLINK-32911: --- [~mapohl] Thanks for reporting this. I didn't find the attached

[jira] [Updated] (FLINK-32911) Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished

2023-08-22 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-32911: -- Description: The feature is described in the

[jira] [Updated] (FLINK-32911) Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished

2023-08-22 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-32911: -- Description: The feature is described in the

[jira] [Updated] (FLINK-32911) Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished

2023-08-22 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-32911: -- Description: The feature is described in the

[jira] [Created] (FLINK-32911) Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished

2023-08-22 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-32911: - Summary: Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished Key: FLINK-32911 URL: https://issues.apache.org/jira/browse/FLINK-32911

[jira] [Created] (FLINK-32704) Supports spilling to disk when feedback channel memory buffer is full

2023-07-27 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-32704: - Summary: Supports spilling to disk when feedback channel memory buffer is full Key: FLINK-32704 URL: https://issues.apache.org/jira/browse/FLINK-32704 Project: Flink

[jira] [Commented] (FLINK-32603) Avoid consuming twice when two pipelines have the same table source

2023-07-19 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744466#comment-17744466 ] Jiang Xin commented on FLINK-32603: --- Thanks, [~martijnvisser]. Yes, the problem only cause when we

[jira] (FLINK-32603) Avoid consuming twice when two pipelines have the same table source

2023-07-19 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32603 ] Jiang Xin deleted comment on FLINK-32603: --- was (Author: jiang xin): A solution is to share a `Map` using `org.apache.flink.table.factories.PlannerFactoryUtil$Context` between planners. The

[jira] [Commented] (FLINK-32603) Avoid consuming twice when two pipelines have the same table source

2023-07-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744042#comment-17744042 ] Jiang Xin commented on FLINK-32603: --- A solution is to share a `Map` using

[jira] [Created] (FLINK-32603) Avoid consuming twice when two pipelines have the same table source

2023-07-17 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-32603: - Summary: Avoid consuming twice when two pipelines have the same table source Key: FLINK-32603 URL: https://issues.apache.org/jira/browse/FLINK-32603 Project: Flink

[jira] [Created] (FLINK-32588) Flink ML unittest BoundedPerRoundStreamIterationITCase failed

2023-07-13 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-32588: - Summary: Flink ML unittest BoundedPerRoundStreamIterationITCase failed Key: FLINK-32588 URL: https://issues.apache.org/jira/browse/FLINK-32588 Project: Flink

[jira] [Updated] (FLINK-32545) Improves the performance by optimizing row operations

2023-07-05 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-32545: -- Summary: Improves the performance by optimizing row operations (was: Removes the expensive Row

[jira] [Created] (FLINK-32545) Removes the expensive Row operations like join

2023-07-05 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-32545: - Summary: Removes the expensive Row operations like join Key: FLINK-32545 URL: https://issues.apache.org/jira/browse/FLINK-32545 Project: Flink Issue Type:

[jira] [Created] (FLINK-32424) Flink ML CI fails due to NPE

2023-06-25 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-32424: - Summary: Flink ML CI fails due to NPE Key: FLINK-32424 URL: https://issues.apache.org/jira/browse/FLINK-32424 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-32335) Fix the Flink ML unittest failure

2023-06-14 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-32335: - Summary: Fix the Flink ML unittest failure Key: FLINK-32335 URL: https://issues.apache.org/jira/browse/FLINK-32335 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-32285) Support multiple Flink versions in each Flink ML Java library release

2023-06-07 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-32285: - Summary: Support multiple Flink versions in each Flink ML Java library release Key: FLINK-32285 URL: https://issues.apache.org/jira/browse/FLINK-32285 Project: Flink

[jira] [Comment Edited] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-05-18 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724093#comment-17724093 ] Jiang Xin edited comment on FLINK-28386 at 5/19/23 3:38 AM: Hi [~pnowojski],

[jira] [Commented] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-05-18 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724093#comment-17724093 ] Jiang Xin commented on FLINK-28386: --- Hi [~pnowojski], I'm working on this. I agree with you that only

[jira] [Commented] (FLINK-31910) Using BroadcastUtils#withBroadcast in iteration perround mode got stuck

2023-05-18 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723841#comment-17723841 ] Jiang Xin commented on FLINK-31910: --- >From the demo, I'm not sure if the

[jira] [Created] (FLINK-31948) Supports triggering CI manually

2023-04-26 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31948: - Summary: Supports triggering CI manually Key: FLINK-31948 URL: https://issues.apache.org/jira/browse/FLINK-31948 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31899) Upgrade Flink version of Flink ML to 1.17.0

2023-04-23 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31899: - Summary: Upgrade Flink version of Flink ML to 1.17.0 Key: FLINK-31899 URL: https://issues.apache.org/jira/browse/FLINK-31899 Project: Flink Issue Type:

[jira] [Updated] (FLINK-31887) Upgrade Flink version of Flink ML to 1.16.1

2023-04-23 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31887: -- Fix Version/s: ml-2.3.0 > Upgrade Flink version of Flink ML to 1.16.1 >

[jira] [Updated] (FLINK-31887) Upgrade Flink version of Flink ML to 1.16.1

2023-04-23 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31887: -- Description: Upgrade Flink version of Flink ML to 1.16.1. (was: Upgrade Flink version of Flink ML to

[jira] [Updated] (FLINK-31887) Upgrade Flink version of Flink ML to 1.16.1

2023-04-23 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31887: -- Summary: Upgrade Flink version of Flink ML to 1.16.1 (was: Upgrade Flink version of Flink ML to

[jira] [Created] (FLINK-31887) Upgrade Flink version of Flink ML to 1.17.0

2023-04-23 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31887: - Summary: Upgrade Flink version of Flink ML to 1.17.0 Key: FLINK-31887 URL: https://issues.apache.org/jira/browse/FLINK-31887 Project: Flink Issue Type:

[jira] [Commented] (FLINK-31373) PerRoundWrapperOperator should carry epoch information in watermark

2023-04-20 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714492#comment-17714492 ] Jiang Xin commented on FLINK-31373: --- [~zhangzp] I met the same issue with the following code.

[jira] [Updated] (FLINK-31486) Using KeySelector in IterationBody causes ClassCastException

2023-03-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31486: -- Summary: Using KeySelector in IterationBody causes ClassCastException (was: Using KeySelector in

[jira] [Updated] (FLINK-31486) Using KeySelector in IterationBody causes ClassNotFoundException

2023-03-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31486: -- Description: We have the following code which uses CoGroup along with KeySelector in an

[jira] [Updated] (FLINK-31486) Using KeySelector in IterationBody causes ClassNotFoundException

2023-03-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31486: -- Description: We have the following code which uses CoGroup along with KeySelector in an

[jira] [Updated] (FLINK-31486) Using KeySelector in IterationBody causes ClassNotFoundException

2023-03-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31486: -- Description: We have the following code which uses CoGroup along with KeySelector in an

[jira] [Commented] (FLINK-31486) Using KeySelector in IterationBody causes ClassNotFoundException

2023-03-16 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701508#comment-17701508 ] Jiang Xin commented on FLINK-31486: --- [~zhangzp] I'm afraid not. This issue is most likely causing by

[jira] [Updated] (FLINK-31486) Using KeySelector in IterationBody causes ClassNotFoundException

2023-03-16 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31486: -- Description: When we use CoGroup along with KeySelector in an IterationBody, the following exception

[jira] [Created] (FLINK-31486) Using KeySelector in IterationBody causes ClassNotFoundException

2023-03-16 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31486: - Summary: Using KeySelector in IterationBody causes ClassNotFoundException Key: FLINK-31486 URL: https://issues.apache.org/jira/browse/FLINK-31486 Project: Flink

[jira] [Created] (FLINK-31453) Improve the test utils to call methods explicitly

2023-03-14 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31453: - Summary: Improve the test utils to call methods explicitly Key: FLINK-31453 URL: https://issues.apache.org/jira/browse/FLINK-31453 Project: Flink Issue Type:

[jira] [Updated] (FLINK-31422) Add Servable for Logistic Regression Model

2023-03-14 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31422: -- Issue Type: New Feature (was: Bug) > Add Servable for Logistic Regression Model >

[jira] [Created] (FLINK-31422) Add Servable for Logistic Regression Model

2023-03-13 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31422: - Summary: Add Servable for Logistic Regression Model Key: FLINK-31422 URL: https://issues.apache.org/jira/browse/FLINK-31422 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-31312) EnableObjectReuse cause different behaviors

2023-03-09 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698278#comment-17698278 ] Jiang Xin commented on FLINK-31312: --- [~kevin.cyj] Thanks for the reply. Sure, I believe it can be

[jira] [Commented] (FLINK-31312) EnableObjectReuse cause different behaviors

2023-03-03 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696099#comment-17696099 ] Jiang Xin commented on FLINK-31312: --- [~xzw0223] Thanks for the reply. >From the perspective of users,

[jira] [Updated] (FLINK-31312) EnableObjectReuse cause different behaviors

2023-03-03 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31312: -- Description: I have the following test code which fails with the exception `Accessing a field by

[jira] [Updated] (FLINK-31312) EnableObjectReuse cause different behaviors

2023-03-02 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-31312: -- Description: I have the following test code which fails with the exception `Accessing a field by

[jira] [Created] (FLINK-31312) EnableObjectReuse cause different behaviors

2023-03-02 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31312: - Summary: EnableObjectReuse cause different behaviors Key: FLINK-31312 URL: https://issues.apache.org/jira/browse/FLINK-31312 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31306) Add Servable for PipelineModel

2023-03-02 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31306: - Summary: Add Servable for PipelineModel Key: FLINK-31306 URL: https://issues.apache.org/jira/browse/FLINK-31306 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31240) Reduce the overhead of conversion between DataStream and Table

2023-02-27 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-31240: - Summary: Reduce the overhead of conversion between DataStream and Table Key: FLINK-31240 URL: https://issues.apache.org/jira/browse/FLINK-31240 Project: Flink

[jira] [Updated] (FLINK-30715) FLIP-289: Support Online Inference

2023-01-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-30715: -- Description: The FLIP design doc can be found at

[jira] [Updated] (FLINK-30715) FLIP-289: Support Online Inference

2023-01-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-30715: -- Description: The FLIP design doc can be found [here|

[jira] [Updated] (FLINK-30715) FLIP-289: Support Online Inference

2023-01-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-30715: -- Description: The FLIP design doc can be found here. (was: The FLIP design doc can be found at

[jira] [Updated] (FLINK-30715) FLIP-289: Support Online Inference

2023-01-17 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-30715: -- Description: The FLIP design doc can be found at

[jira] [Created] (FLINK-30715) FLIP-289: Support Online Inference

2023-01-17 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-30715: - Summary: FLIP-289: Support Online Inference Key: FLINK-30715 URL: https://issues.apache.org/jira/browse/FLINK-30715 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-30515) Add benchmark for CountVectorizer, Imputer, RobustScaler, UnivariateFeatureSelector and VarianceThresholdSelector

2022-12-28 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-30515: -- Component/s: Library / Machine Learning Fix Version/s: ml-2.2.0 Issue Type: Improvement

[jira] [Created] (FLINK-30515) Add benchmark for CountVectorizer, Imputer, RobustScaler, UnivariateFeatureSelector and VarianceThresholdSelector

2022-12-27 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-30515: - Summary: Add benchmark for CountVectorizer, Imputer, RobustScaler, UnivariateFeatureSelector and VarianceThresholdSelector Key: FLINK-30515 URL:

[jira] [Updated] (FLINK-30420) NPE thrown when using window time in Table API

2022-12-14 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-30420: -- Description: Run the following unit test. {code:java} import

[jira] [Updated] (FLINK-30420) NPE thrown when using window time in Table API

2022-12-14 Thread Jiang Xin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xin updated FLINK-30420: -- Description: Run the following unit test. {code:java} import

[jira] [Created] (FLINK-30420) NPE thrown when using window time in Table API

2022-12-14 Thread Jiang Xin (Jira)
Jiang Xin created FLINK-30420: - Summary: NPE thrown when using window time in Table API Key: FLINK-30420 URL: https://issues.apache.org/jira/browse/FLINK-30420 Project: Flink Issue Type: Bug

  1   2   >