[jira] [Commented] (FLINK-27791) SlotCountExceedingParallelismTest tests failed with NoResourceAvailableException

[ https://issues.apache.org/jira/browse/FLINK-27791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544246#comment-17544246 ] Zhu Zhu commented on FLINK-27791: - I will take a look. > SlotCountExceedingParallelismTest tests failed

[jira] [Closed] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

[ https://issues.apache.org/jira/browse/FLINK-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-17295. --- Resolution: Done Merged into master: 061df0ba8f2cd4b4e6436ebde1bc249bc629e940

[jira] [Updated] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

[ https://issues.apache.org/jira/browse/FLINK-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-17295: Fix Version/s: 1.16.0 > Refactor the ExecutionAttemptID to consist of ExecutionVertexID and >

[jira] [Comment Edited] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

[ https://issues.apache.org/jira/browse/FLINK-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539914#comment-17539914 ] Zhu Zhu edited comment on FLINK-17295 at 5/20/22 4:31 AM: -- I was not concerning

[jira] [Assigned] (FLINK-27710) Improve logs to better display Execution

[ https://issues.apache.org/jira/browse/FLINK-27710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-27710: --- Assignee: Zhu Zhu > Improve logs to better display Execution >

[jira] [Created] (FLINK-27710) Improve logs to better display Execution

Zhu Zhu created FLINK-27710: --- Summary: Improve logs to better display Execution Key: FLINK-27710 URL: https://issues.apache.org/jira/browse/FLINK-27710 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

[ https://issues.apache.org/jira/browse/FLINK-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539914#comment-17539914 ] Zhu Zhu commented on FLINK-17295: - I was not concerning about it because PartitionRequests are sent and

[jira] [Commented] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

[ https://issues.apache.org/jira/browse/FLINK-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17538581#comment-17538581 ] Zhu Zhu commented on FLINK-17295: - The benchmark value is the size of a serialized TDD. The difference

[jira] [Closed] (FLINK-26909) Allow to set parallelism to be -1 from Cli

[ https://issues.apache.org/jira/browse/FLINK-26909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26909. --- Fix Version/s: 1.15.1 Resolution: Done Done via: master: 46c6d78ddd6b271cd434eff03ae65c0e74c0d53e

[jira] [Updated] (FLINK-26909) Allow to set parallelism to be -1 from Cli

[ https://issues.apache.org/jira/browse/FLINK-26909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26909: Summary: Allow to set parallelism to be -1 from Cli (was: Support AdaptiveBatch when parallelism is -1

[jira] [Commented] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

[ https://issues.apache.org/jira/browse/FLINK-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536476#comment-17536476 ] Zhu Zhu commented on FLINK-17295: - I had another thought and did some experiment, now I prefer to

[jira] [Commented] (FLINK-26909) Support AdaptiveBatch when parallelism is -1 from Cli

[ https://issues.apache.org/jira/browse/FLINK-26909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17535847#comment-17535847 ] Zhu Zhu commented on FLINK-26909: - Sure. > Support AdaptiveBatch when parallelism is -1 from Cli >

[jira] [Comment Edited] (FLINK-27555) Performance regression in schedulingDownstreamTasks on 02.05.2022

[ https://issues.apache.org/jira/browse/FLINK-27555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534423#comment-17534423 ] Zhu Zhu edited comment on FLINK-27555 at 5/10/22 3:48 PM: -- I think #2 is the

[jira] [Commented] (FLINK-27555) Performance regression in schedulingDownstreamTasks on 02.05.2022

[ https://issues.apache.org/jira/browse/FLINK-27555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534423#comment-17534423 ] Zhu Zhu commented on FLINK-27555: - I think #2 is the correct way. Maybe we can modify the

[jira] [Commented] (FLINK-17295) Refactor the ExecutionAttemptID to consist of ExecutionVertexID and attemptNumber

[ https://issues.apache.org/jira/browse/FLINK-17295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534269#comment-17534269 ] Zhu Zhu commented on FLINK-17295: - I'd like to revive this ticket, because I think a meaningful

[jira] [Commented] (FLINK-27555) Performance regression in schedulingDownstreamTasks on 02.05.2022

[ https://issues.apache.org/jira/browse/FLINK-27555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534119#comment-17534119 ] Zhu Zhu commented on FLINK-27555: - This benchmark result is how much time it takes to do the scheduling.

[jira] [Assigned] (FLINK-27460) Remove unused notifyPartitionDataAvailable process

[ https://issues.apache.org/jira/browse/FLINK-27460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-27460: --- Assignee: Zhu Zhu > Remove unused notifyPartitionDataAvailable process >

[jira] [Created] (FLINK-27460) Remove unused notifyPartitionDataAvailable process

Zhu Zhu created FLINK-27460: --- Summary: Remove unused notifyPartitionDataAvailable process Key: FLINK-27460 URL: https://issues.apache.org/jira/browse/FLINK-27460 Project: Flink Issue Type:

[jira] [Commented] (FLINK-26909) Support AdaptiveBatch when parallelism is -1 from Cli

[ https://issues.apache.org/jira/browse/FLINK-26909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529319#comment-17529319 ] Zhu Zhu commented on FLINK-26909: - Thanks for offering to take this task! [~Jiangang] I have assigned

[jira] [Assigned] (FLINK-26909) Support AdaptiveBatch when parallelism is -1 from Cli

[ https://issues.apache.org/jira/browse/FLINK-26909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26909: --- Assignee: Liu > Support AdaptiveBatch when parallelism is -1 from Cli >

[jira] [Commented] (FLINK-26909) Support AdaptiveBatch when parallelism is -1 from Cli

[ https://issues.apache.org/jira/browse/FLINK-26909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529288#comment-17529288 ] Zhu Zhu commented on FLINK-26909: - Thanks reporting this! [~Jiangang] I think this is a valid proposal.

[jira] [Updated] (FLINK-26909) Support AdaptiveBatch when parallelism is -1 from Cli

[ https://issues.apache.org/jira/browse/FLINK-26909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26909: Fix Version/s: 1.16.0 > Support AdaptiveBatch when parallelism is -1 from Cli >

[jira] [Commented] (FLINK-27274) Job cannot be recovered, after restarting cluster

[ https://issues.apache.org/jira/browse/FLINK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523625#comment-17523625 ] Zhu Zhu commented on FLINK-27274: - Sorry but from what I see, Flink does not guarantee all jobs to be

[jira] [Commented] (FLINK-27274) Job cannot be recovered, after restarting cluster

[ https://issues.apache.org/jira/browse/FLINK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523597#comment-17523597 ] Zhu Zhu commented on FLINK-27274: - [~macdoor615] Thanks for sharing the information! I think I know the

[jira] [Commented] (FLINK-27274) Job cannot be recovered, after restarting cluster

[ https://issues.apache.org/jira/browse/FLINK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523586#comment-17523586 ] Zhu Zhu commented on FLINK-27274: - Yes, in flink-gum-standalonesession-0-hb3-dev-flink-000.log, no job

[jira] [Comment Edited] (FLINK-27274) Job cannot be recovered, after restarting cluster

[ https://issues.apache.org/jira/browse/FLINK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523586#comment-17523586 ] Zhu Zhu edited comment on FLINK-27274 at 4/18/22 7:48 AM: -- Yes, in

[jira] [Commented] (FLINK-27274) Job cannot be recovered, after restarting cluster

[ https://issues.apache.org/jira/browse/FLINK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523499#comment-17523499 ] Zhu Zhu commented on FLINK-27274: - Sorry but I do not quite understand the problem. By design, if a

[jira] [Comment Edited] (FLINK-26952) Remove old CSV connector

[ https://issues.apache.org/jira/browse/FLINK-26952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517788#comment-17517788 ] Zhu Zhu edited comment on FLINK-26952 at 4/6/22 3:14 AM: - [~slinkydeveloper]

[jira] [Comment Edited] (FLINK-26952) Remove old CSV connector

[ https://issues.apache.org/jira/browse/FLINK-26952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517788#comment-17517788 ] Zhu Zhu edited comment on FLINK-26952 at 4/6/22 3:12 AM: - [~slinkydeveloper]

[jira] [Commented] (FLINK-26952) Remove old CSV connector

[ https://issues.apache.org/jira/browse/FLINK-26952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517788#comment-17517788 ] Zhu Zhu commented on FLINK-26952: - [~slinkydeveloper] FYI, there is already a ticket to migrate TPCDS

[jira] [Assigned] (FLINK-24491) ExecutionGraphInfo may not be archived when the dispatcher terminates

[ https://issues.apache.org/jira/browse/FLINK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-24491: --- Assignee: Zhilong Hong > ExecutionGraphInfo may not be archived when the dispatcher terminates >

[jira] [Commented] (FLINK-24491) ExecutionGraphInfo may not be archived when the dispatcher terminates

[ https://issues.apache.org/jira/browse/FLINK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17514406#comment-17514406 ] Zhu Zhu commented on FLINK-24491: - Thanks for reporting this problem and offering to fix it.

[jira] [Updated] (FLINK-24491) ExecutionGraphInfo may not be archived when the dispatcher terminates

[ https://issues.apache.org/jira/browse/FLINK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24491: Fix Version/s: 1.16.0 (was: 1.15.0) (was: 1.13.7)

[jira] [Commented] (FLINK-26760) The new CSV source (file system source + CSV format) does not support reading files whose file encoding is not UTF-8

[ https://issues.apache.org/jira/browse/FLINK-26760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509632#comment-17509632 ] Zhu Zhu commented on FLINK-26760: - cc [~afedulov] > The new CSV source (file system source + CSV

[jira] [Updated] (FLINK-26760) The new CSV source (file system source + CSV format) does not support reading files whose file encoding is not UTF-8

[ https://issues.apache.org/jira/browse/FLINK-26760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26760: Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile) > The new CSV source (file system source +

[jira] [Reopened] (FLINK-24892) FLIP-187: Adaptive Batch Scheduler

[ https://issues.apache.org/jira/browse/FLINK-24892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reopened FLINK-24892: - Would you add a release note for this feature? [~wanglijie95] > FLIP-187: Adaptive Batch Scheduler >

[jira] [Closed] (FLINK-25226) Add documentation about the AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-25226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25226. --- Resolution: Done Merged into master: 192351ecfb0392fa0ad32f40b84306b1f8d6c69c release-1.15:

[jira] [Closed] (FLINK-26722) the result is wrong when using file connector with csv format

[ https://issues.apache.org/jira/browse/FLINK-26722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26722. --- Resolution: Not A Problem > the result is wrong when using file connector with csv format >

[jira] [Updated] (FLINK-26692) migrate TpcdsTestProgram.java to new source

[ https://issues.apache.org/jira/browse/FLINK-26692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26692: Fix Version/s: 1.16.0 > migrate TpcdsTestProgram.java to new source >

[jira] [Updated] (FLINK-26692) migrate TpcdsTestProgram.java to new source

[ https://issues.apache.org/jira/browse/FLINK-26692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26692: Affects Version/s: 1.15.0 > migrate TpcdsTestProgram.java to new source >

[jira] [Commented] (FLINK-26692) migrate TpcdsTestProgram.java to new source

[ https://issues.apache.org/jira/browse/FLINK-26692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508538#comment-17508538 ] Zhu Zhu commented on FLINK-26692: - Thanks for the offering to take the ticket [~Leo Zhou]. I have assign

[jira] [Assigned] (FLINK-26692) migrate TpcdsTestProgram.java to new source

[ https://issues.apache.org/jira/browse/FLINK-26692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26692: --- Assignee: zl > migrate TpcdsTestProgram.java to new source >

[jira] [Comment Edited] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507075#comment-17507075 ] Zhu Zhu edited comment on FLINK-26548 at 3/15/22, 5:19 PM: --- As discussed in

[jira] [Commented] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507075#comment-17507075 ] Zhu Zhu commented on FLINK-26548: - As discussed in #19040, a proper fix of this problem would be to

[jira] [Updated] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26548: Priority: Critical (was: Blocker) > the source parallelism is not set correctly with

[jira] [Updated] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26548: Fix Version/s: 1.16.0 (was: 1.15.0) > the source parallelism is not set correctly

[jira] [Commented] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504192#comment-17504192 ] Zhu Zhu commented on FLINK-26548: - Thanks for reporting this issue and offering to fix it! [~Leo Zhou] I

[jira] [Assigned] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26548: --- Assignee: zl > the source parallelism is not set correctly with AdaptiveBatchScheduler >

[jira] [Closed] (FLINK-26579) The default source parallelism configuration in adaptive batch scheduling does not take effect

[ https://issues.apache.org/jira/browse/FLINK-26579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26579. --- Fix Version/s: (was: 1.15.0) Resolution: Duplicate > The default source parallelism

[jira] [Closed] (FLINK-26517) Normalize the decided parallelism to power of 2 when using adaptive batch scheduler

[ https://issues.apache.org/jira/browse/FLINK-26517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26517. --- Resolution: Fixed master/release-1.15: 4d42c642cc3c45acf25d41172f6a2132d4c6c60b > Normalize the decided

[jira] [Updated] (FLINK-26517) Normalize the decided parallelism to power of 2 when using adaptive batch scheduler

[ https://issues.apache.org/jira/browse/FLINK-26517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26517: Affects Version/s: 1.15.0 > Normalize the decided parallelism to power of 2 when using adaptive batch >

[jira] [Assigned] (FLINK-26517) Normalize the decided parallelism to power of 2 when using adaptive batch scheduler

[ https://issues.apache.org/jira/browse/FLINK-26517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26517: --- Assignee: Lijie Wang > Normalize the decided parallelism to power of 2 when using adaptive batch

[jira] [Comment Edited] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500466#comment-17500466 ] Zhu Zhu edited comment on FLINK-26400 at 3/3/22, 2:44 AM: -- Here's what I see on

[jira] [Commented] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500466#comment-17500466 ] Zhu Zhu commented on FLINK-26400: - Here's what I see on the page "Limited integration with Flink’s Web

[jira] [Updated] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26400: Attachment: errors_on_opening_job_page_when_job_gets_no_resources.png > Release Testing: Explicit

[jira] [Comment Edited] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1740#comment-1740 ] Zhu Zhu edited comment on FLINK-26400 at 3/2/22, 9:09 AM: -- I have done the test

[jira] [Commented] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1740#comment-1740 ] Zhu Zhu commented on FLINK-26400: - I have done the test and the result looks good. The stopped

[jira] [Commented] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499370#comment-17499370 ] Zhu Zhu commented on FLINK-26400: - I'd like to take this ticket if no one else already plans to take it.

[jira] [Closed] (FLINK-25225) Add e2e TPCDS tests to run against the AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25225. --- Resolution: Done master/release-1.15: 5c7a432778f2f8494e104fa89ea08a71e83978b1 > Add e2e TPCDS tests to

[jira] [Updated] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

[ https://issues.apache.org/jira/browse/FLINK-26168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26168: Component/s: Runtime / Coordination > The judgment of chainable ignores StreamExchangeMode when

[jira] [Closed] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

[ https://issues.apache.org/jira/browse/FLINK-26168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26168. --- Resolution: Done master/release-1.15: 8f3a0251d195ed2532abc31e602029dfcbf7bc77 > The judgment of chainable

[jira] [Commented] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

[ https://issues.apache.org/jira/browse/FLINK-26148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493154#comment-17493154 ] Zhu Zhu commented on FLINK-26148: - [~wanglijie95] would you update FLIP-187 for the configuration name

[jira] [Closed] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

[ https://issues.apache.org/jira/browse/FLINK-26148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26148. --- Resolution: Done master/release-1.15: 4f20772ca2e36358f51d656b78e45a3e966d6f9e > Change the format of

[jira] [Assigned] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

[ https://issues.apache.org/jira/browse/FLINK-26168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26168: --- Assignee: Lijie Wang > The judgment of chainable ignores StreamExchangeMode when partitioner is >

[jira] [Updated] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

[ https://issues.apache.org/jira/browse/FLINK-26168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26168: Fix Version/s: 1.15.0 > The judgment of chainable ignores StreamExchangeMode when partitioner is >

[jira] [Updated] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

[ https://issues.apache.org/jira/browse/FLINK-26148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26148: Fix Version/s: 1.15.0 > Change the format of adaptive batch scheduler config option to >

[jira] [Assigned] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

[ https://issues.apache.org/jira/browse/FLINK-26148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26148: --- Assignee: Lijie Wang > Change the format of adaptive batch scheduler config option to >

[jira] [Assigned] (FLINK-25225) Add e2e TPCDS tests to run against the AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25225: --- Assignee: Lijie Wang > Add e2e TPCDS tests to run against the AdaptiveBatchScheduler >

[jira] [Assigned] (FLINK-25226) Add documentation about the AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-25226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25226: --- Assignee: Lijie Wang > Add documentation about the AdaptiveBatchScheduler >

[jira] [Closed] (FLINK-25046) Convert unspecified edge to rescale when using adapive batch scheduler

[ https://issues.apache.org/jira/browse/FLINK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25046. --- Resolution: Done master/release-1.15: d0859f6a74e883a9f3123d2e83b154568e202f7a > Convert unspecified edge

[jira] [Assigned] (FLINK-25046) Convert unspecified edge to rescale when using adapive batch scheduler

[ https://issues.apache.org/jira/browse/FLINK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25046: --- Assignee: Lijie Wang > Convert unspecified edge to rescale when using adapive batch scheduler >

[jira] [Updated] (FLINK-25046) Convert unspecified edge to rescale when using adapive batch scheduler

[ https://issues.apache.org/jira/browse/FLINK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25046: Fix Version/s: 1.15.0 > Convert unspecified edge to rescale when using adapive batch scheduler >

[jira] [Closed] (FLINK-26004) Introduce ForwardForConsecutiveHashPartitioner

[ https://issues.apache.org/jira/browse/FLINK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26004. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: b4d5b66df4066ab9d97e9263714c3a8bcc3063a2

[jira] [Closed] (FLINK-25996) Introduce job property isDynamicGraph to ExecutionConfig

[ https://issues.apache.org/jira/browse/FLINK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25996. --- Resolution: Done master/release-1.15: 90159f4c7f364f9264e0373c0b1ffa7cafa04cbc > Introduce job property

[jira] [Assigned] (FLINK-26004) Introduce ForwardForConsecutiveHashPartitioner

[ https://issues.apache.org/jira/browse/FLINK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26004: --- Assignee: Lijie Wang > Introduce ForwardForConsecutiveHashPartitioner >

[jira] [Assigned] (FLINK-25996) Introduce job property isDynamicGraph to ExecutionConfig

[ https://issues.apache.org/jira/browse/FLINK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25996: --- Assignee: Lijie Wang > Introduce job property isDynamicGraph to ExecutionConfig >

[jira] [Updated] (FLINK-25995) Make implicit assumption of SQL local hash explicit

[ https://issues.apache.org/jira/browse/FLINK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25995: Summary: Make implicit assumption of SQL local hash explicit (was: Make implicit assumption of SQL local

[jira] [Updated] (FLINK-25995) Make implicit assumption of SQL local hash explicit

[ https://issues.apache.org/jira/browse/FLINK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25995: Description: If there are multiple consecutive and the same hash shuffles, SQL planner will change them

[jira] [Updated] (FLINK-26004) Introduce ForwardForConsecutiveHashPartitioner

[ https://issues.apache.org/jira/browse/FLINK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26004: Description: If there are multiple consecutive and the same hash shuffles, SQL planner will change them

[jira] [Updated] (FLINK-26004) Introduce ForwardForConsecutiveHashPartitioner

[ https://issues.apache.org/jira/browse/FLINK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26004: Description: If there are multiple consecutive the same hash shuffle(i.e. keyBy), SQL planner will

[jira] [Updated] (FLINK-25996) Introduce job property isDynamicGraph to ExecutionConfig

[ https://issues.apache.org/jira/browse/FLINK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25996: Description: To enable FLINK-25995 and FLINK-25046 only in dynamic graph scenario, we need a property

[jira] [Updated] (FLINK-25995) Make implicit assumption of SQL local keyBy/groupBy explicit

[ https://issues.apache.org/jira/browse/FLINK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25995: Description: If there are multiple consecutive the same groupBy(i.e. keyBy), SQL planner will change

[jira] [Updated] (FLINK-25995) Make implicit assumption of SQL local keyBy/groupBy explicit

[ https://issues.apache.org/jira/browse/FLINK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25995: Description: If there are multiple consecutive the same groupBy(i.e. keyBy), SQL planner will change

[jira] [Created] (FLINK-25996) Introduce job property isDynamicGraph to ExecutionConfig

Zhu Zhu created FLINK-25996: --- Summary: Introduce job property isDynamicGraph to ExecutionConfig Key: FLINK-25996 URL: https://issues.apache.org/jira/browse/FLINK-25996 Project: Flink Issue Type:

[jira] [Created] (FLINK-25995) Make implicit assumption of SQL local keyBy/groupBy explicit

Zhu Zhu created FLINK-25995: --- Summary: Make implicit assumption of SQL local keyBy/groupBy explicit Key: FLINK-25995 URL: https://issues.apache.org/jira/browse/FLINK-25995 Project: Flink Issue

[jira] [Closed] (FLINK-25045) Introduce AdaptiveBatchScheduler

[ https://issues.apache.org/jira/browse/FLINK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25045. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: f42a92ccfbace9871834dd039a4e2025926b190c

[jira] [Closed] (FLINK-25035) Shuffle Service Supports Consuming Subpartition Range

[ https://issues.apache.org/jira/browse/FLINK-25035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25035. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: f4fd4f8bb66867821cb0f171218d85f8386b0897

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482848#comment-17482848 ] Zhu Zhu commented on FLINK-25649: - Yes, your Flink session uses kubernetes to serve as its HA service,

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482307#comment-17482307 ] Zhu Zhu commented on FLINK-25649: - I took a look at the logs. Looks to me the problem is the slow leader

[jira] [Comment Edited] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482307#comment-17482307 ] Zhu Zhu edited comment on FLINK-25649 at 1/26/22, 7:40 AM: --- I took a look at

[jira] [Closed] (FLINK-25668) Support calcuate network memory for dynamic graph.

[ https://issues.apache.org/jira/browse/FLINK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25668. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: 7962a5d9c47f49f435f822a1af2c4141c42a849b

[jira] [Closed] (FLINK-25669) Support register operator coordinators for newly initialized ExecutionJobVertex.

[ https://issues.apache.org/jira/browse/FLINK-25669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25669. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.5: 8fc657b899ec740a348c84a6f387c3806584f999

[jira] [Closed] (FLINK-25036) Introduce vertex wise scheduling strategy

[ https://issues.apache.org/jira/browse/FLINK-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25036. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: e5c1e67e2169534d5e837e5690360b075b66dd75

[jira] [Closed] (FLINK-25033) Let some scheduler components updatable

[ https://issues.apache.org/jira/browse/FLINK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25033. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: 82b07035719ac25c9256a1f273019410ee3ca4e7

[jira] [Comment Edited] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479064#comment-17479064 ] Zhu Zhu edited comment on FLINK-25649 at 1/20/22, 4:25 AM: --- You can also send

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479064#comment-17479064 ] Zhu Zhu commented on FLINK-25649: - You can also send the logs to me (reed...@gmail.com). > Scheduling

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478365#comment-17478365 ] Zhu Zhu commented on FLINK-25649: - >> Would it make sens to say that we encounter this issue because 2

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17477072#comment-17477072 ] Zhu Zhu commented on FLINK-25649: - >From your description, it's possible that your cluster does not have

[jira] [Assigned] (FLINK-25668) Support calcuate network memory for dynamic graph.

[ https://issues.apache.org/jira/browse/FLINK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25668: --- Assignee: Lijie Wang > Support calcuate network memory for dynamic graph. >

[jira] [Assigned] (FLINK-25669) Support register operator coordinators for newly initialized ExecutionJobVertex.

[ https://issues.apache.org/jira/browse/FLINK-25669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25669: --- Assignee: Lijie Wang > Support register operator coordinators for newly initialized >

<    2   3   4   5   6   7   8   9   10   11   >