[jira] [Comment Edited] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476945#comment-17476945 ] Zhu Zhu edited comment on FLINK-25649 at 1/17/22, 8:19 AM: --- Hi [~gdegrove],

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476945#comment-17476945 ] Zhu Zhu commented on FLINK-25649: - Hi Gil, just to confirm the scenario, 1. are all the jobs unbounded

[jira] [Comment Edited] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476945#comment-17476945 ] Zhu Zhu edited comment on FLINK-25649 at 1/17/22, 3:59 AM: --- Hi [~gdegrove],

[jira] [Closed] (FLINK-25034) Support flexible number of subpartitions in IntermediateResultPartition

2022-01-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25034. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: 856652435b2b65933c0b09e780a6229c62a854e4

[jira] [Updated] (FLINK-24892) FLIP-187: Adaptive Batch Scheduler

2022-01-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24892: Fix Version/s: 1.15.0 > FLIP-187: Adaptive Batch Scheduler > -- > >

[jira] [Closed] (FLINK-25032) Allow to create execution vertices and execution edges lazily

2022-01-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25032. --- Fix Version/s: 1.15.0 Resolution: Done master/1.15: d2bfe404e199f98115df419232399bcc11b59e5a

[jira] [Closed] (FLINK-18295) Remove the hack logics of result consumers

2021-12-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-18295. --- Fix Version/s: 1.15.0 Resolution: Fixed master/1.15: 15255565ad1ec6261db4e1c9211fe9b85ca77ac3

[jira] [Assigned] (FLINK-18295) Remove the hack logics of result consumers

2021-12-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-18295: --- Assignee: Zhu Zhu > Remove the hack logics of result consumers >

[jira] [Updated] (FLINK-18295) Remove the hack logics of result consumers

2021-12-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Description: Currently an {{IntermediateDataSet}} can have multiple consumer {{JobEdge}}. That's why the

[jira] [Updated] (FLINK-18295) Remove the hack logics of result consumers

2021-12-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Description: Currently an {{IntermediateDataSet}} can have multiple consumer {{JobEdge}}. That's why the

[jira] [Closed] (FLINK-25011) Introduce VertexParallelismDecider

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25011. --- Fix Version/s: 1.15.0 Resolution: Fixed master: afb29d92c4e76ec6a453459c3d8a08304efec549 >

[jira] [Updated] (FLINK-25225) Add e2e TPCDS tests to run against the AdaptiveBatchScheduler

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25225: Description: To automatically and continuously verify the AdatpiveBatchScheduler, we should add a new e2e

[jira] [Updated] (FLINK-25225) Add e2e TPCDS tests to run against the AdaptiveBatchScheduler

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25225: Summary: Add e2e TPCDS tests to run against the AdaptiveBatchScheduler (was: Add e2e TPCDS tests to run

[jira] [Updated] (FLINK-25225) Add e2e TPCDS tests to run against the AdaptiveBatchScheduler

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25225: Description: To automatically and continuously verify the AdaptiveBatchScheduler, we should add a new e2e

[jira] [Created] (FLINK-25226) Add documentation about the AdaptiveBatchScheduler

2021-12-08 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-25226: --- Summary: Add documentation about the AdaptiveBatchScheduler Key: FLINK-25226 URL: https://issues.apache.org/jira/browse/FLINK-25226 Project: Flink Issue Type:

[jira] [Created] (FLINK-25225) Add e2e TPCDS tests to run against the AdatpiveBatchScheduler

2021-12-08 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-25225: --- Summary: Add e2e TPCDS tests to run against the AdatpiveBatchScheduler Key: FLINK-25225 URL: https://issues.apache.org/jira/browse/FLINK-25225 Project: Flink Issue

[jira] [Closed] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19142. --- Resolution: Fixed > Local recovery can be broken if slot hijacking happened during a full restart >

[jira] [Commented] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456104#comment-17456104 ] Zhu Zhu commented on FLINK-19142: - 1.14: 63cf221ca2d963aa1394fb0244a8702b9e8c3835

[jira] [Commented] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17455181#comment-17455181 ] Zhu Zhu commented on FLINK-19142: - I think it's time to do the backport. I'm now doing it. I have also

[jira] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142 ] Zhu Zhu deleted comment on FLINK-19142: - was (Author: flink-jira-bot): This issue was marked "stale-assigned" and has not received an update in 7 days. It is now automatically unassigned. If

[jira] [Updated] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Labels: pull-request-available (was: pull-request-available stale-assigned) > Local recovery can be

[jira] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-12-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142 ] Zhu Zhu deleted comment on FLINK-19142: - was (Author: flink-jira-bot): I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see

[jira] [Closed] (FLINK-25031) Job finishes iff all job vertices finish

2021-12-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25031. --- Fix Version/s: 1.15.0 Resolution: Fixed Done via caf72abd10628187af1440e0e8113384e1343eb9 > Job

[jira] [Closed] (FLINK-24980) Collect sizes of finished BLOCKING result partitions

2021-11-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-24980. --- Fix Version/s: 1.15.0 Resolution: Fixed Done via 3761bbf68c183cf4728353948acea0a2ac40f2a7 > Collect

[jira] [Assigned] (FLINK-25045) Introduce AdaptiveBatchScheduler

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25045: --- Assignee: Lijie Wang > Introduce AdaptiveBatchScheduler > > >

[jira] [Assigned] (FLINK-25033) Let some scheduler components updatable

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25033: --- Assignee: Lijie Wang > Let some scheduler components updatable >

[jira] [Assigned] (FLINK-25032) Allow to create execution vertices and execution edges lazily

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25032: --- Assignee: Lijie Wang > Allow to create execution vertices and execution edges lazily >

[jira] [Assigned] (FLINK-25035) Shuffle Service Supports Consuming Subpartition Range

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25035: --- Assignee: Lijie Wang > Shuffle Service Supports Consuming Subpartition Range >

[jira] [Assigned] (FLINK-25034) Support flexible number of subpartitions in IntermediateResultPartition

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25034: --- Assignee: Lijie Wang > Support flexible number of subpartitions in IntermediateResultPartition >

[jira] [Assigned] (FLINK-25036) Introduce stage-wised scheduling strategy

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25036: --- Assignee: Lijie Wang > Introduce stage-wised scheduling strategy >

[jira] [Assigned] (FLINK-25011) Introduce VertexParallelismDecider

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25011: --- Assignee: Lijie Wang > Introduce VertexParallelismDecider > -- > >

[jira] [Assigned] (FLINK-25031) Job finishes iff all job vertices finish

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25031: --- Assignee: Lijie Wang > Job finishes iff all job vertices finish >

[jira] [Assigned] (FLINK-24892) FLIP-187: Adaptive Batch Scheduler

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-24892: --- Assignee: Lijie Wang > FLIP-187: Adaptive Batch Scheduler > -- > >

[jira] [Assigned] (FLINK-24980) Collect sizes of finished BLOCKING result partitions

2021-11-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-24980: --- Assignee: Lijie Wang > Collect sizes of finished BLOCKING result partitions >

[jira] [Updated] (FLINK-24793) DefaultSchedulerLocalRecoveryITCase fails on AZP

2021-11-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24793: Fix Version/s: (was: 1.14.1) > DefaultSchedulerLocalRecoveryITCase fails on AZP >

[jira] [Closed] (FLINK-24793) DefaultSchedulerLocalRecoveryITCase fails on AZP

2021-11-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-24793. --- Resolution: Fixed Fixed via 130db3830a9dc9173b2afd8f22e577c9711812bc > DefaultSchedulerLocalRecoveryITCase

[jira] [Updated] (FLINK-24793) DefaultSchedulerLocalRecoveryITCase fails on AZP

2021-11-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24793: Affects Version/s: (was: 1.14.1) > DefaultSchedulerLocalRecoveryITCase fails on AZP >

[jira] [Commented] (FLINK-24793) DefaultSchedulerLocalRecoveryITCase fails on AZP

2021-11-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440224#comment-17440224 ] Zhu Zhu commented on FLINK-24793: - This IT case fails when it is testing using AdaptiveScheduler. The

[jira] [Assigned] (FLINK-24793) DefaultSchedulerLocalRecoveryITCase fails on AZP

2021-11-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-24793: --- Assignee: Zhu Zhu > DefaultSchedulerLocalRecoveryITCase fails on AZP >

[jira] [Commented] (FLINK-24793) DefaultSchedulerLocalRecoveryITCase fails on AZP

2021-11-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439669#comment-17439669 ] Zhu Zhu commented on FLINK-24793: - Thanks for the notification! [~trohrmann] I will look into it. >

[jira] [Updated] (FLINK-18295) Remove the hack logics of result consumers

2021-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Description: Currently an {{IntermediateDataSet}} can have multiple consumer {{JobEdge}}s. That's why

[jira] [Closed] (FLINK-24316) Refactor IntermediateDataSet to have only one consumer

2021-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-24316. --- Resolution: Duplicate > Refactor IntermediateDataSet to have only one consumer >

[jira] [Updated] (FLINK-24316) Refactor IntermediateDataSet to have only one consumer

2021-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24316: Fix Version/s: (was: 1.15.0) > Refactor IntermediateDataSet to have only one consumer >

[jira] [Comment Edited] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438675#comment-17438675 ] Zhu Zhu edited comment on FLINK-19142 at 11/5/21, 9:25 AM: --- Fixed in

[jira] [Reopened] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reopened FLINK-19142: - > Local recovery can be broken if slot hijacking happened during a full restart >

[jira] [Updated] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Fix Version/s: 1.14.1 > Local recovery can be broken if slot hijacking happened during a full restart >

[jira] [Commented] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439118#comment-17439118 ] Zhu Zhu commented on FLINK-19142: - I would keep this ticket open for now and keep watching it. If there

[jira] [Closed] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-11-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19142. --- Resolution: Fixed Done via 4618b6a6e0584fc9054505035bb6a3b4e951c937

[jira] [Updated] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-11-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Fix Version/s: (was: 1.14.1) > Local recovery can be broken if slot hijacking happened during a full

[jira] [Updated] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-11-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Fix Version/s: 1.14.1 > Local recovery can be broken if slot hijacking happened during a full restart >

[jira] [Updated] (FLINK-19142) Local recovery can be broken if slot hijacking happened during a full restart

2021-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Summary: Local recovery can be broken if slot hijacking happened during a full restart (was: Local

[jira] [Updated] (FLINK-19142) Local recovery can be broken if slot hijacking happened during restarting

2021-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Issue Type: Bug (was: Improvement) > Local recovery can be broken if slot hijacking happened during

[jira] [Updated] (FLINK-19142) Local recovery can be broken if slot hijacking happened during restarting

2021-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Description: The ticket originates from [this PR

[jira] [Updated] (FLINK-19142) Local recovery can be broken if slot hijacking happened during restarting

2021-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Summary: Local recovery can be broken if slot hijacking happened during restarting (was: Investigate

[jira] [Issue Comment Deleted] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-09-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Comment: was deleted (was: I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I

[jira] [Issue Comment Deleted] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-09-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Comment: was deleted (was: I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I

[jira] [Issue Comment Deleted] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-09-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Comment: was deleted (was: I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I

[jira] [Issue Comment Deleted] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-09-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Comment: was deleted (was: This issue was marked "stale-assigned" 7 days ago and has not received an

[jira] [Closed] (FLINK-24375) The name of flush thread in RecordWriter should contain subtask index

2021-09-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-24375. --- Resolution: Done Done via 5947647a3390bf7804ca927976dda909fb6db295 > The name of flush thread in

[jira] [Commented] (FLINK-24293) Tasks from the same job on a machine share user jar

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420270#comment-17420270 ] Zhu Zhu commented on FLINK-24293: - I think "yarn.provided.lib.dirs" can be used for user jars. If a user

[jira] [Updated] (FLINK-24375) The name of flush thread in RecordWriter should contain subtask index

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24375: Fix Version/s: 1.15.0 > The name of flush thread in RecordWriter should contain subtask index >

[jira] [Commented] (FLINK-24375) The name of flush thread in RecordWriter should contain subtask index

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420235#comment-17420235 ] Zhu Zhu commented on FLINK-24375: - Thanks for reporting this! [~wanglijie95] I think it's good to have

[jira] [Updated] (FLINK-24375) The name of flush thread in RecordWriter should contain subtask index

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24375: Priority: Major (was: Minor) > The name of flush thread in RecordWriter should contain subtask index >

[jira] [Assigned] (FLINK-24375) The name of flush thread in RecordWriter should contain subtask index

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-24375: --- Assignee: Lijie Wang > The name of flush thread in RecordWriter should contain subtask index >

[jira] [Commented] (FLINK-24293) Tasks from the same job on a machine share user jar

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420222#comment-17420222 ] Zhu Zhu commented on FLINK-24293: - Hi [~huntercc], I agree that it's not ideal to download a jar to one

[jira] [Comment Edited] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420218#comment-17420218 ] Zhu Zhu edited comment on FLINK-23826 at 9/26/21, 6:56 AM: --- Here is the

[jira] [Comment Edited] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420218#comment-17420218 ] Zhu Zhu edited comment on FLINK-23826 at 9/26/21, 6:48 AM: --- Here is the

[jira] [Closed] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-23826. --- Resolution: Done > Verify optimized scheduler performance for large-scale jobs >

[jira] [Commented] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420218#comment-17420218 ] Zhu Zhu commented on FLINK-23826: - Here is the benchmark results of release-1.14 v.s. release-1.12.

[jira] [Updated] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-23826: Description: This ticket is used to verify the result of FLINK-21110. It should check if large scale

[jira] [Updated] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-23826: Priority: Major (was: Critical) > Verify optimized scheduler performance for large-scale jobs >

[jira] [Commented] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414833#comment-17414833 ] Zhu Zhu commented on FLINK-23826: - Here's the testing result: ||JM/Scheduler Initializing||Task

[jira] [Updated] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-23826: Description: This ticket is used to verify the result of FLINK-21110. It should check if large scale

[jira] [Updated] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-23826: Description: This ticket is used to verify the result of FLINK-21110. It should check if large scale

[jira] [Assigned] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-23826: --- Assignee: Zhu Zhu (was: Zhilong Hong) > Verify optimized scheduler performance for large-scale

[jira] [Updated] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-09-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-23826: Priority: Critical (was: Blocker) > Verify optimized scheduler performance for large-scale jobs >

[jira] [Updated] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-09-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Labels: pull-request-available (was: auto-unassigned pull-request-available) > Investigate slot

[jira] [Updated] (FLINK-19142) Investigate slot hijacking from preceding pipelined regions after failover

2021-09-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19142: Fix Version/s: (was: 1.14.0) 1.15.0 > Investigate slot hijacking from preceding

[jira] [Updated] (FLINK-21110) Optimize scheduler performance for large-scale jobs

2021-09-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-21110: Release Note: The performance of scheduler has been improved to reduce the time on execution graph

[jira] [Closed] (FLINK-23833) Cache of ShuffleDescriptors should be individually cleaned up

2021-08-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-23833. --- Resolution: Fixed Fixed via: master: 8d3ec4a2fb1c9e07ee386dced15e1f64f359c6a2

[jira] [Updated] (FLINK-23833) Cache of ShuffleDescriptors should be individually cleaned up

2021-08-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-23833: Fix Version/s: 1.15.0 > Cache of ShuffleDescriptors should be individually cleaned up >

[jira] [Comment Edited] (FLINK-24005) Resource requirements declaration may be incorrect if JobMaster disconnects with a TaskManager with available slots in the SlotPool

2021-08-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406577#comment-17406577 ] Zhu Zhu edited comment on FLINK-24005 at 8/30/21, 6:20 AM: --- Thanks for the

[jira] [Commented] (FLINK-24005) Resource requirements declaration may be incorrect if JobMaster disconnects with a TaskManager with available slots in the SlotPool

2021-08-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406577#comment-17406577 ] Zhu Zhu commented on FLINK-24005: - Thanks for the explanation! [~trohrmann] [~chesnay] I now understand

[jira] [Commented] (FLINK-24005) Resource requirements declaration may be incorrect if JobMaster disconnects with a TaskManager with available slots in the SlotPool

2021-08-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405565#comment-17405565 ] Zhu Zhu commented on FLINK-24005: - That's also my question that why we need to decrease requirements

[jira] [Commented] (FLINK-24005) Resource requirements declaration may be incorrect if JobMaster disconnects with a TaskManager with available slots in the SlotPool

2021-08-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405203#comment-17405203 ] Zhu Zhu commented on FLINK-24005: - Would it work if we do not decrease resource requirements if a TM

[jira] [Updated] (FLINK-24005) Resource requirements declaration may be incorrect if JobMaster disconnects with a TaskManager with available slots in the SlotPool

2021-08-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24005: Attachment: decrease_resource_requirements.log > Resource requirements declaration may be incorrect if

[jira] [Created] (FLINK-24005) Resource requirements declaration may be incorrect if JobMaster disconnects with a TaskManager with available slots in the SlotPool

2021-08-26 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-24005: --- Summary: Resource requirements declaration may be incorrect if JobMaster disconnects with a TaskManager with available slots in the SlotPool Key: FLINK-24005 URL:

[jira] [Closed] (FLINK-23172) Links to Task Failure Recovery page on Configuration page are broken

2021-08-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-23172. --- Resolution: Fixed release-1.13: 1fb2c19fbd24c0037b436b3f261db63fc4056df5 > Links to Task Failure Recovery

[jira] [Comment Edited] (FLINK-23889) Unnecessary logging from FineGrainedSlotManager

2021-08-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402974#comment-17402974 ] Zhu Zhu edited comment on FLINK-23889 at 8/23/21, 6:40 AM: --- Regarding why the

[jira] [Commented] (FLINK-23889) Unnecessary logging from FineGrainedSlotManager

2021-08-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402974#comment-17402974 ] Zhu Zhu commented on FLINK-23889: - Regarding why the empty resource declaration is sent twice, I think

[jira] [Commented] (FLINK-23889) Unnecessary logging from FineGrainedSlotManager

2021-08-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402962#comment-17402962 ] Zhu Zhu commented on FLINK-23889: - Looks to me that "Clearing resource requirements ..." is printed each

[jira] [Issue Comment Deleted] (FLINK-18295) Remove the hack logics of result consumers

2021-08-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Comment: was deleted (was: This issue was marked "stale-assigned" and has not received an update in 7

[jira] [Issue Comment Deleted] (FLINK-18295) Remove the hack logics of result consumers

2021-08-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Comment: was deleted (was: This issue was labeled "stale-major" 7 ago and has not received any updates

[jira] [Issue Comment Deleted] (FLINK-18295) Remove the hack logics of result consumers

2021-08-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Comment: was deleted (was: This issue is assigned but has not received an update in 7 days so it has

[jira] [Issue Comment Deleted] (FLINK-18295) Remove the hack logics of result consumers

2021-08-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Comment: was deleted (was: I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I

[jira] [Updated] (FLINK-18295) Remove the hack logics of result consumers

2021-08-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Priority: Major (was: Minor) > Remove the hack logics of result consumers >

[jira] [Updated] (FLINK-18295) Remove the hack logics of result consumers

2021-08-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Labels: (was: auto-deprioritized-major auto-unassigned) > Remove the hack logics of result consumers >

[jira] [Commented] (FLINK-23879) Benchmark are not compiling

2021-08-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401986#comment-17401986 ] Zhu Zhu commented on FLINK-23879: - cc [~arvid] [~dwysakowicz] > Benchmark are not compiling >

[jira] [Closed] (FLINK-23806) StackOverflowException can happen if a large scale job failed to acquire enough slots in time

2021-08-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-23806. --- Resolution: Fixed Fixed via master/release-1.14: f543e9a97e2d2dda340d4d1d54467ffe060666cb release-1.13:

[jira] [Assigned] (FLINK-23833) Cache of ShuffleDescriptors should be individually cleaned up

2021-08-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-23833: --- Assignee: Zhilong Hong > Cache of ShuffleDescriptors should be individually cleaned up >

<    3   4   5   6   7   8   9   10   11   12   >