[jira] [Updated] (FLINK-32027) Batch jobs could hang at shuffle phase when max parallelism is really large

2023-05-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-32027: Affects Version/s: 1.16.1 1.17.0 > Batch jobs could hang at shuffle phase

[jira] [Updated] (FLINK-32027) Batch jobs could hang at shuffle phase when max parallelism is really large

2023-05-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-32027: Fix Version/s: 1.16.2 1.17.1 > Batch jobs could hang at shuffle phase when max

[jira] [Commented] (FLINK-31386) Fix the potential deadlock issue of blocking shuffle

2023-04-23 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715425#comment-17715425 ] Yingjie Cao commented on FLINK-31386: - Cherry picked to 1.16 via

[jira] [Updated] (FLINK-31386) Fix the potential deadlock issue of blocking shuffle

2023-04-23 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-31386: Affects Version/s: 1.16.1 1.16.0 > Fix the potential deadlock issue of

[jira] [Updated] (FLINK-31386) Fix the potential deadlock issue of blocking shuffle

2023-04-23 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-31386: Fix Version/s: 1.16.2 > Fix the potential deadlock issue of blocking shuffle >

[jira] [Commented] (FLINK-31610) Refactoring of LocalBufferPool

2023-04-13 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711825#comment-17711825 ] Yingjie Cao commented on FLINK-31610: - Sorry for the delayed reply. Totally agree that we should

[jira] (FLINK-31610) Refactoring of LocalBufferPool

2023-04-06 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31610 ] Yingjie Cao deleted comment on FLINK-31610: - was (Author: kevin.cyj): Sorry for being so late. > Refactoring of LocalBufferPool > -- > > Key:

[jira] [Commented] (FLINK-31610) Refactoring of LocalBufferPool

2023-04-06 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17709284#comment-17709284 ] Yingjie Cao commented on FLINK-31610: - Sorry for being so late. > Refactoring of LocalBufferPool >

[jira] [Closed] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-14 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-31418. --- Resolution: Fixed > SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on >

[jira] [Updated] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-14 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-31418: Fix Version/s: 1.17.0 > SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed

[jira] [Assigned] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-13 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-31418: --- Assignee: Yuxin Tan > SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout

[jira] [Commented] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-13 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699913#comment-17699913 ] Yingjie Cao commented on FLINK-31418: - It is a test issue, we will fix it soon. >

[jira] [Comment Edited] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-13 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699561#comment-17699561 ] Yingjie Cao edited comment on FLINK-31418 at 3/13/23 10:51 AM: --- I will

[jira] [Commented] (FLINK-31418) SortMergeResultPartitionReadSchedulerTest.testRequestBufferTimeout failed on CI

2023-03-13 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699561#comment-17699561 ] Yingjie Cao commented on FLINK-31418: - I will also try to reproduce it. If it can reproduce, let's

[jira] [Commented] (FLINK-31312) EnableObjectReuse cause different behaviors

2023-03-13 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699482#comment-17699482 ] Yingjie Cao commented on FLINK-31312: - Sorry, I did not notice the fact that the constructor is not

[jira] [Closed] (FLINK-31386) Fix the potential deadlock issue of blocking shuffle

2023-03-10 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-31386. --- Resolution: Fixed > Fix the potential deadlock issue of blocking shuffle >

[jira] [Commented] (FLINK-31386) Fix the potential deadlock issue of blocking shuffle

2023-03-10 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698953#comment-17698953 ] Yingjie Cao commented on FLINK-31386: - Merged into 1.17 to unblock release. Will pick to master

[jira] [Assigned] (FLINK-31386) Fix the potential deadlock issue of blocking shuffle

2023-03-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-31386: --- Assignee: Yingjie Cao > Fix the potential deadlock issue of blocking shuffle >

[jira] [Created] (FLINK-31386) Fix the potential deadlock issue of blocking shuffle

2023-03-09 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-31386: --- Summary: Fix the potential deadlock issue of blocking shuffle Key: FLINK-31386 URL: https://issues.apache.org/jira/browse/FLINK-31386 Project: Flink Issue

[jira] [Commented] (FLINK-31266) dashboard info error (received and send alway show 0 when having data)

2023-03-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698264#comment-17698264 ] Yingjie Cao commented on FLINK-31266: - Something like NaN may be better than 0? BTW, do newer flink

[jira] [Commented] (FLINK-31312) EnableObjectReuse cause different behaviors

2023-03-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698249#comment-17698249 ] Yingjie Cao commented on FLINK-31312: - There is another constructor in Row: Row( RowKind kind,

[jira] [Closed] (FLINK-28189) The taskmanager dynamically created by flink native k8s creates pods directly, why not create a deployment?

2023-02-23 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-28189. --- Resolution: Not A Problem > The taskmanager dynamically created by flink native k8s creates pods >

[jira] [Closed] (FLINK-28378) Use larger data reading buffer size for sort-shuffle

2023-02-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-28378. --- Resolution: Won't Fix > Use larger data reading buffer size for sort-shuffle >

[jira] [Updated] (FLINK-28378) Use larger data reading buffer size for sort-shuffle

2023-02-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28378: Fix Version/s: (was: 1.17.0) > Use larger data reading buffer size for sort-shuffle >

[jira] [Updated] (FLINK-28326) ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

2023-02-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28326: Fix Version/s: 1.16.2 > ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

[jira] [Resolved] (FLINK-28326) ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

2023-02-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28326. - Resolution: Fixed > ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError >

[jira] [Commented] (FLINK-28326) ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

2023-02-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685678#comment-17685678 ] Yingjie Cao commented on FLINK-28326: - 1.16: 096c4a5e29cdffc8b4ed72f7bc6fc7b42dab2e9b >

[jira] [Updated] (FLINK-28326) ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

2023-02-02 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28326: Priority: Major (was: Minor) > ResultPartitionTest.testIdleAndBackPressuredTime failed with

[jira] [Updated] (FLINK-28326) ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

2023-02-02 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28326: Priority: Minor (was: Critical) > ResultPartitionTest.testIdleAndBackPressuredTime failed with

[jira] [Commented] (FLINK-28326) ResultPartitionTest.testIdleAndBackPressuredTime failed with AssertError

2023-02-02 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683651#comment-17683651 ] Yingjie Cao commented on FLINK-28326: - master: 7980d4b7956bbb5952933d6f4c49e27f59c96834 >

[jira] [Commented] (FLINK-29884) Flaky test failure in finegrained_resource_management/SortMergeResultPartitionTest.testRelease

2023-01-18 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678444#comment-17678444 ] Yingjie Cao commented on FLINK-29884: - Merged into master via

[jira] [Closed] (FLINK-29884) Flaky test failure in finegrained_resource_management/SortMergeResultPartitionTest.testRelease

2023-01-18 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-29884. --- Resolution: Fixed > Flaky test failure in >

[jira] [Assigned] (FLINK-29884) Flaky test failure in finegrained_resource_management/SortMergeResultPartitionTest.testRelease

2023-01-17 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-29884: --- Assignee: Weijie Guo (was: Yingjie Cao) > Flaky test failure in >

[jira] [Assigned] (FLINK-29845) ThroughputCalculator throws java.lang.IllegalArgumentException: Time should be non negative under very low throughput cluster

2023-01-17 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-29845: --- Assignee: Weijie Guo > ThroughputCalculator throws java.lang.IllegalArgumentException:

[jira] [Commented] (FLINK-29884) Flaky test failure in finegrained_resource_management/SortMergeResultPartitionTest.testRelease

2023-01-14 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676983#comment-17676983 ] Yingjie Cao commented on FLINK-29884: - Sorry for the delay, I already found the root cause. It is

[jira] [Closed] (FLINK-30511) Ignore the Exception in user-timer Triggerble when recover form state.

2023-01-05 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-30511. --- Resolution: Duplicate > Ignore the Exception in user-timer Triggerble when recover form state. >

[jira] [Commented] (FLINK-30511) Ignore the Exception in user-timer Triggerble when recover form state.

2023-01-05 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654896#comment-17654896 ] Yingjie Cao commented on FLINK-30511: - I am closing this ticket for now. We can discuss in

[jira] [Commented] (FLINK-30511) Ignore the Exception in user-timer Triggerble when recover form state.

2023-01-05 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654876#comment-17654876 ] Yingjie Cao commented on FLINK-30511: - [~RocMarshal] Thanks for reporting. I guess an easy way to

[jira] [Commented] (FLINK-26088) Add Elasticsearch 8.0 support

2023-01-03 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653975#comment-17653975 ] Yingjie Cao commented on FLINK-26088: - [~iture123] Any progress on this issue? In which version do

[jira] [Commented] (FLINK-29845) ThroughputCalculator throws java.lang.IllegalArgumentException: Time should be non negative under very low throughput cluster

2022-12-22 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651157#comment-17651157 ] Yingjie Cao commented on FLINK-29845: - [~dawnwords] Would you like to fix it? If not, we will assign

[jira] [Commented] (FLINK-30208) avoid unconditional state update in CountTrigger#onElement

2022-12-22 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651155#comment-17651155 ] Yingjie Cao commented on FLINK-30208: - [~xljtswf] Thanks for your explanation. I think there is no

[jira] [Commented] (FLINK-30208) avoid unconditional state update in CountTrigger#onElement

2022-12-08 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644663#comment-17644663 ] Yingjie Cao commented on FLINK-30208: - After the change, for most cases, the state will be still

[jira] [Updated] (FLINK-30217) Use ListState#update() to replace clear + add mode.

2022-12-08 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-30217: Component/s: Runtime / State Backends (was: API / DataStream) > Use

[jira] [Commented] (FLINK-29884) Flaky test failure in finegrained_resource_management/SortMergeResultPartitionTest.testRelease

2022-11-17 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635272#comment-17635272 ] Yingjie Cao commented on FLINK-29884: - I will try to reproduce it and will update if any progress.

[jira] [Commented] (FLINK-29845) ThroughputCalculator throws java.lang.IllegalArgumentException: Time should be non negative under very low throughput cluster

2022-11-17 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635261#comment-17635261 ] Yingjie Cao commented on FLINK-29845: - I think it is not guaranteed that System.currentTimeMillis is

[jira] [Commented] (FLINK-29816) Userfunction exception in ProcessWindowFunction was called before invoke during restore state(subtask was in INITIALIZING state), but SteamTask skip handle Exception

2022-11-17 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635247#comment-17635247 ] Yingjie Cao commented on FLINK-29816: - Any update on this issue? > Userfunction exception in

[jira] [Commented] (FLINK-29809) REST API for running a Flink job

2022-11-17 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635244#comment-17635244 ] Yingjie Cao commented on FLINK-29809: - Do you mean to pass an URL to Flink through the REST API and

[jira] [Updated] (FLINK-28561) Merge subpartition shuffle data read request for better sequential IO

2022-11-03 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28561: Priority: Minor (was: Major) > Merge subpartition shuffle data read request for better

[jira] [Updated] (FLINK-28561) Merge subpartition shuffle data read request for better sequential IO

2022-11-03 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28561: Fix Version/s: (was: 1.17.0) > Merge subpartition shuffle data read request for better

[jira] [Commented] (FLINK-29573) Flink does not work for windows if installing on other drive except for C drive

2022-11-03 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628157#comment-17628157 ] Yingjie Cao commented on FLINK-29573: - [~kriswang] Thanks for reporting this issue, do you know if

[jira] [Closed] (FLINK-29008) SortMergeResultPartitionTest.testRelease failed with TestTimedOutException

2022-10-27 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-29008. --- Resolution: Cannot Reproduce > SortMergeResultPartitionTest.testRelease failed with

[jira] [Commented] (FLINK-29008) SortMergeResultPartitionTest.testRelease failed with TestTimedOutException

2022-10-27 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17624937#comment-17624937 ] Yingjie Cao commented on FLINK-29008: - I ran this test for more than 1000 times locally, the issue

[jira] [Closed] (FLINK-29296) OperatorCoordinatorHolder.create throws NPE

2022-10-20 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-29296. --- Resolution: Fixed > OperatorCoordinatorHolder.create throws NPE >

[jira] [Commented] (FLINK-29296) OperatorCoordinatorHolder.create throws NPE

2022-10-20 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620874#comment-17620874 ] Yingjie Cao commented on FLINK-29296: - I think it is already fixed by

[jira] [Commented] (FLINK-29298) LocalBufferPool request buffer from NetworkBufferPool hanging

2022-10-20 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620848#comment-17620848 ] Yingjie Cao commented on FLINK-29298: - [~Weijie Guo] Thanks for reporting this. > LocalBufferPool

[jira] [Assigned] (FLINK-29306) fail to check multiple flink-dist*.jar for config.sh

2022-10-20 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-29306: --- Assignee: LiuZeshan > fail to check multiple flink-dist*.jar for config.sh >

[jira] [Commented] (FLINK-29565) In Flink per job mode, the logs printed by taskManager on the web UI will not be highlighted, because the log contents are annotated due to special symbols, which will

2022-10-20 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620835#comment-17620835 ] Yingjie Cao commented on FLINK-29565: - [~1336399775] Thanks for reporting this. Do you have a

[jira] [Updated] (FLINK-29641) SortMergeResultPartitionReadSchedulerTest.testCreateSubpartitionReader

2022-10-17 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-29641: Fix Version/s: 1.17.0 1.16.1 >

[jira] [Updated] (FLINK-29641) SortMergeResultPartitionReadSchedulerTest.testCreateSubpartitionReader

2022-10-17 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-29641: Component/s: Runtime / Network Tests (was: Runtime /

[jira] [Assigned] (FLINK-29298) LocalBufferPool request buffer from NetworkBufferPool hanging

2022-10-14 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-29298: --- Assignee: Weijie Guo > LocalBufferPool request buffer from NetworkBufferPool hanging >

[jira] [Updated] (FLINK-29546) UDF:Failed to compile split code, falling back to original code

2022-10-14 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-29546: Component/s: Table SQL / Runtime (was: API / DataStream) > UDF:Failed to

[jira] [Updated] (FLINK-29565) In Flink per job mode, the logs printed by taskManager on the web UI will not be highlighted, because the log contents are annotated due to special symbols, which will a

2022-10-14 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-29565: Component/s: Runtime / Web Frontend (was: API / Core) > In Flink per job

[jira] [Created] (FLINK-29351) Enable input buffer floating for blocking shuffle

2022-09-20 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-29351: --- Summary: Enable input buffer floating for blocking shuffle Key: FLINK-29351 URL: https://issues.apache.org/jira/browse/FLINK-29351 Project: Flink Issue Type:

[jira] [Resolved] (FLINK-29299) Fix the network memory size calculation issue in fine-grained resource mode

2022-09-20 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-29299. - Resolution: Fixed Fix via  d3513d98953b0922e3dc753ef90806ed4e264926 on master

[jira] [Updated] (FLINK-29299) Fix the network memory size calculation issue in fine-grained resource mode

2022-09-14 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-29299: Issue Type: Bug (was: Improvement) > Fix the network memory size calculation issue in

[jira] [Assigned] (FLINK-29299) Fix the network memory size calculation issue in fine-grained resource mode

2022-09-14 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-29299: --- Assignee: Yingjie Cao > Fix the network memory size calculation issue in fine-grained

[jira] [Created] (FLINK-29299) Fix the network memory size calculation issue in fine-grained resource mode

2022-09-13 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-29299: --- Summary: Fix the network memory size calculation issue in fine-grained resource mode Key: FLINK-29299 URL: https://issues.apache.org/jira/browse/FLINK-29299 Project:

[jira] [Resolved] (FLINK-28942) Deadlock may occurs when releasing readers for SortMergeResultPartition

2022-08-12 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28942. - Resolution: Fixed Merged into master via f2fb6b20ec493a3af3f19a6f69f25e26ed226dda > Deadlock

[jira] [Assigned] (FLINK-28942) Deadlock may occurs when releasing readers for SortMergeResultPartition

2022-08-12 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28942: --- Assignee: Yuxin Tan > Deadlock may occurs when releasing readers for

[jira] [Updated] (FLINK-28942) Deadlock may occurs when releasing readers for SortMergeResultPartition

2022-08-12 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28942: Fix Version/s: 1.16.0 > Deadlock may occurs when releasing readers for SortMergeResultPartition >

[jira] [Assigned] (FLINK-28623) Optimize the use of off heap memory by blocking and hybrid shuffle reader

2022-08-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28623: --- Assignee: Weijie Guo > Optimize the use of off heap memory by blocking and hybrid shuffle

[jira] [Resolved] (FLINK-28623) Optimize the use of off heap memory by blocking and hybrid shuffle reader

2022-08-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28623. - Fix Version/s: 1.16.0 Resolution: Fixed Merged into master via 

[jira] [Closed] (FLINK-28374) Some further improvements of blocking shuffle

2022-08-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-28374. --- Resolution: Fixed > Some further improvements of blocking shuffle >

[jira] [Resolved] (FLINK-28373) Read a full buffer of data per file IO read request for sort-shuffle

2022-08-09 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28373. - Resolution: Fixed Merged into master via d6a47d897a9a4753c800b39adb17c06e154422cc > Read a

[jira] [Closed] (FLINK-28380) Produce one intermediate dataset for multiple consumers consuming the same data

2022-08-08 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-28380. --- Resolution: Fixed Merged into master via 60bc87c0b83149c4f19d7e54af2d967087a277fb > Produce one

[jira] [Resolved] (FLINK-28663) Allow multiple downstream consumer job vertices sharing the same intermediate dataset at scheduler side

2022-08-08 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28663. - Fix Version/s: 1.16.0 Resolution: Fixed Merged into master via 

[jira] [Resolved] (FLINK-28823) Enlarge the max requested buffers for SortMergeResultPartitionReadScheduler

2022-08-08 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28823. - Resolution: Fixed Merged into master via ca45a28205b424c2c77a21366fb29a67457672ff > Enlarge

[jira] [Assigned] (FLINK-28828) Sorting all unfinished readers in batches at one time in SortMergeResultPartitionReadScheduler

2022-08-08 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28828: --- Assignee: Yuxin Tan > Sorting all unfinished readers in batches at one time in >

[jira] [Closed] (FLINK-28789) TPC-DS tests failed due to release input gate for task failure

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-28789. --- Resolution: Fixed > TPC-DS tests failed due to release input gate for task failure >

[jira] [Commented] (FLINK-28789) TPC-DS tests failed due to release input gate for task failure

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576513#comment-17576513 ] Yingjie Cao commented on FLINK-28789: - Closing this issue, feel free to reopen it if the problem

[jira] [Resolved] (FLINK-28828) Sorting all unfinished readers in batches at one time in SortMergeResultPartitionReadScheduler

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28828. - Resolution: Fixed Merged into master via 07a309ad93444097049aa65944e2ca4fbff37e42 > Sorting

[jira] [Resolved] (FLINK-28826) Avoid notifying too frequently when recycling buffers for BatchShuffleReadBufferPool

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28826. - Resolution: Fixed > Avoid notifying too frequently when recycling buffers for >

[jira] [Commented] (FLINK-28826) Avoid notifying too frequently when recycling buffers for BatchShuffleReadBufferPool

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576375#comment-17576375 ] Yingjie Cao commented on FLINK-28826: - Merged into master via 

[jira] [Assigned] (FLINK-28826) Avoid notifying too frequently when recycling buffers for BatchShuffleReadBufferPool

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28826: --- Assignee: Yuxin Tan > Avoid notifying too frequently when recycling buffers for >

[jira] [Updated] (FLINK-28826) Avoid notifying too frequently when recycling buffers for BatchShuffleReadBufferPool

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28826: Fix Version/s: 1.16.0 > Avoid notifying too frequently when recycling buffers for >

[jira] [Updated] (FLINK-28823) Enlarge the max requested buffers for SortMergeResultPartitionReadScheduler

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28823: Fix Version/s: 1.16.0 > Enlarge the max requested buffers for

[jira] [Assigned] (FLINK-28823) Enlarge the max requested buffers for SortMergeResultPartitionReadScheduler

2022-08-07 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28823: --- Assignee: Yuxin Tan > Enlarge the max requested buffers for

[jira] [Commented] (FLINK-28789) TPC-DS tests failed due to release input gate for task failure

2022-08-04 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575360#comment-17575360 ] Yingjie Cao commented on FLINK-28789: - Though still not know the root cause, by reverting

[jira] [Commented] (FLINK-28382) Introduce new compression algorithms of higher compression ratio

2022-08-02 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17574075#comment-17574075 ] Yingjie Cao commented on FLINK-28382: - Merged into master via 

[jira] [Resolved] (FLINK-28382) Introduce new compression algorithms of higher compression ratio

2022-08-02 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28382. - Resolution: Fixed > Introduce new compression algorithms of higher compression ratio >

[jira] [Resolved] (FLINK-28519) Fix the bug that SortMergeResultPartitionReadScheduler may not read data sequentially

2022-07-29 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao resolved FLINK-28519. - Resolution: Fixed Merged into master via f88489a6af42638679429df3fdb4818c278cacbf > Fix the

[jira] [Closed] (FLINK-28448) BoundedDataTestBase has potential problem when compression is enable

2022-07-27 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao closed FLINK-28448. --- Resolution: Fixed Merged into master via 1b012cb2c402a91be58e8b201ffd1b6d38b58ef9 and 

[jira] [Assigned] (FLINK-28448) BoundedDataTestBase has potential problem when compression is enable

2022-07-27 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28448: --- Assignee: Weijie Guo > BoundedDataTestBase has potential problem when compression is

[jira] [Updated] (FLINK-28378) Use larger data reading buffer size for sort-shuffle

2022-07-25 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28378: Parent: (was: FLINK-28374) Issue Type: Improvement (was: Sub-task) > Use larger data

[jira] [Updated] (FLINK-28378) Use larger data reading buffer size for sort-shuffle

2022-07-25 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28378: Fix Version/s: 1.17.0 > Use larger data reading buffer size for sort-shuffle >

[jira] [Updated] (FLINK-28378) Use larger data reading buffer size for sort-shuffle

2022-07-25 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28378: Fix Version/s: (was: 1.16.0) > Use larger data reading buffer size for sort-shuffle >

[jira] [Assigned] (FLINK-28663) Allow multiple downstream consumer job vertices sharing the same intermediate dataset at scheduler side

2022-07-25 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28663: --- Assignee: Yingjie Cao > Allow multiple downstream consumer job vertices sharing the same

[jira] [Updated] (FLINK-28663) Allow multiple downstream consumer job vertices sharing the same intermediate dataset at scheduler side

2022-07-25 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao updated FLINK-28663: Parent: FLINK-28374 Issue Type: Sub-task (was: Improvement) > Allow multiple downstream

[jira] [Assigned] (FLINK-28373) Read a full buffer of data per file IO read request for sort-shuffle

2022-07-25 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28373: --- Assignee: Yuxin Tan > Read a full buffer of data per file IO read request for sort-shuffle

[jira] [Assigned] (FLINK-28380) Produce one intermediate dataset for multiple consumers consuming the same data

2022-07-25 Thread Yingjie Cao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingjie Cao reassigned FLINK-28380: --- Assignee: Yingjie Cao > Produce one intermediate dataset for multiple consumers consuming

  1   2   3   4   5   6   7   8   >