[jira] [Commented] (FLINK-32872) Add option to control the default partitioner when the parallelism of upstream and downstream operator does not match

2023-09-05 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762051#comment-17762051 ] Weihua Hu commented on FLINK-32872: --- [~Zhanghao Chen] Thanks for bring this. We need a FLIP and public

[jira] [Assigned] (FLINK-33022) When FailureEnricherUtils load FailureEnricherFactory failed should throw exception or add some error logs

2023-09-06 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33022: - Assignee: Leonardo Zanivan > When FailureEnricherUtils load FailureEnricherFactory failed

[jira] [Assigned] (FLINK-33022) When FailureEnricherUtils load FailureEnricherFactory failed should throw exception or add some error logs

2023-09-06 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33022: - Assignee: Panagiotis Garefalakis (was: Leonardo Zanivan) > When FailureEnricherUtils load

[jira] [Assigned] (FLINK-31895) End-to-end integration tests for failure labels

2023-09-10 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-31895: - Assignee: Matt Wang (was: Matt Wang) > End-to-end integration tests for failure labels >

[jira] [Assigned] (FLINK-33061) Translate failure-enricher documentation to Chinese

2023-09-10 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33061: - Assignee: Matt Wang (was: Matt Wang) > Translate failure-enricher documentation to Chinese >

[jira] [Assigned] (FLINK-33061) Translate failure-enricher documentation to Chinese

2023-09-07 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33061: - Assignee: Matt Wang > Translate failure-enricher documentation to Chinese >

[jira] [Assigned] (FLINK-31895) End-to-end integration tests for failure labels

2023-09-07 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-31895: - Assignee: Matt Wang > End-to-end integration tests for failure labels >

[jira] [Comment Edited] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-31 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760207#comment-17760207 ] Weihua Hu edited comment on FLINK-32821 at 8/31/23 10:41 AM: - master:

[jira] [Resolved] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-31 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-32821. --- Fix Version/s: 1.18.0 Resolution: Fixed > Streaming examples failed to execute due to error

[jira] [Updated] (FLINK-32803) Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management

2023-08-29 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-32803: -- Attachment: image-2023-08-30-10-57-11-049.png > Release Testing: Verify FLINK-32165 - Improve

[jira] [Updated] (FLINK-32803) Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management

2023-08-29 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-32803: -- Attachment: image-2023-08-30-10-56-09-174.png > Release Testing: Verify FLINK-32165 - Improve

[jira] [Updated] (FLINK-32803) Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management

2023-08-29 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-32803: -- Attachment: image-2023-08-30-10-58-34-939.png > Release Testing: Verify FLINK-32165 - Improve

[jira] [Commented] (FLINK-32803) Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management

2023-08-29 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760212#comment-17760212 ] Weihua Hu commented on FLINK-32803: --- Hi, all I have tested this feature and it looks good. Logs

[jira] [Resolved] (FLINK-33061) Translate failure-enricher documentation to Chinese

2023-09-15 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-33061. --- Fix Version/s: 1.19.0 Resolution: Fixed Resolved in master:

[jira] [Resolved] (FLINK-33022) Log an error when enrichers defined as part of the configuration can not be found/loaded

2023-09-14 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-33022. --- Fix Version/s: 1.19.0 Release Note: Resolved in master:

[jira] [Commented] (FLINK-33022) Log an error when enrichers defined as part of the configuration can not be found/loaded

2023-09-14 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765421#comment-17765421 ] Weihua Hu commented on FLINK-33022: --- Resolved in master: b51ee30c3d1a212947398d880a676f07f46f36be >

[jira] [Updated] (FLINK-33022) Log an error when enrichers defined as part of the configuration can not be found/loaded

2023-09-14 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-33022: -- Release Note: (was: Resolved in master: b51ee30c3d1a212947398d880a676f07f46f36be) > Log an error

[jira] [Commented] (FLINK-32803) Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management

2023-09-04 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17761754#comment-17761754 ] Weihua Hu commented on FLINK-32803: --- [~chesnay], Hi, is there any other scenarios you would like to

[jira] [Resolved] (FLINK-33160) Log the remote address when an exception occurs in the PartitionRequestQueue

2023-11-01 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-33160. --- Resolution: Fixed resolved in master: 32652e1ea10d2578f583f37aeb329e34ad0464c7 > Log the remote

[jira] [Updated] (FLINK-25371) Include data port as part of the host info for subtask detail panel on Web UI

2023-09-24 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-25371: -- Parent: FLINK-33146 Issue Type: Sub-task (was: Improvement) > Include data port as part of

[jira] [Assigned] (FLINK-33146) FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-24 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33146: - Assignee: Zhanghao Chen > FLIP-363: Unify the Representation of TaskManager Location in REST

[jira] [Assigned] (FLINK-33148) Update Web UI to adopt the new "endpoint" field in REST API

2023-09-24 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33148: - Assignee: Zhanghao Chen > Update Web UI to adopt the new "endpoint" field in REST API >

[jira] [Assigned] (FLINK-33147) Introduce a new "endpoint" field in REST API to represent TaskManager endpoint (host + port) and deprecate the "host" field

2023-09-24 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33147: - Assignee: Zhanghao Chen > Introduce a new "endpoint" field in REST API to represent

[jira] [Commented] (FLINK-33096) Flink on k8s,if one taskmanager pod was crashed,the whole flink job will be failed

2023-09-18 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766335#comment-17766335 ] Weihua Hu commented on FLINK-33096: --- [~wawa] I think it's because the job is failed after some TM pod

[jira] [Resolved] (FLINK-31895) End-to-end integration tests for failure labels

2023-09-18 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-31895. --- Fix Version/s: 1.19.0 Resolution: Fixed Resolved in master:

[jira] [Assigned] (FLINK-33126) Fix EventTimeAllWindowCheckpointingITCase jobName typo

2023-09-20 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33126: - Assignee: Yue Ma > Fix EventTimeAllWindowCheckpointingITCase jobName typo >

[jira] [Commented] (FLINK-32846) [JUnit5 Migration] The metrics, minicluster and net packages of flink-runtime module

2023-09-20 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767056#comment-17767056 ] Weihua Hu commented on FLINK-32846: --- Metrics merged in master:

[jira] [Assigned] (FLINK-33126) Fix EventTimeAllWindowCheckpointingITCase jobName typo

2023-09-20 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-33126: - Assignee: Yue Ma (was: Yue Ma) > Fix EventTimeAllWindowCheckpointingITCase jobName typo >

[jira] [Resolved] (FLINK-32846) [JUnit5 Migration] The metrics, minicluster and net packages of flink-runtime module

2023-09-20 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-32846. --- Fix Version/s: 1.19.0 Resolution: Fixed > [JUnit5 Migration] The metrics, minicluster and

[jira] [Resolved] (FLINK-32851) [JUnit5 Migration] The rest package of flink-runtime module

2023-09-21 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-32851. --- Fix Version/s: 1.19.0 Resolution: Fixed master: 4817db916889a7701481fb04333a7f8da9f5b583 >

[jira] [Assigned] (FLINK-32114) Make FailureEnricherContext more flexible and include task specific fields

2023-09-19 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-32114: - Assignee: Matt Wang > Make FailureEnricherContext more flexible and include task specific

[jira] [Resolved] (FLINK-33126) Fix EventTimeAllWindowCheckpointingITCase jobName typo

2023-09-21 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-33126. --- Fix Version/s: 1.19.0 Resolution: Fixed master: 4f09bbb39239f5523da8ecb7c7cd5ac9fd34c0e5 >

[jira] [Commented] (FLINK-33160) Log the remote address when an exception occurs in the PartitionRequestQueue

2023-10-07 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17772916#comment-17772916 ] Weihua Hu commented on FLINK-33160: --- [~lsdy] makes sense to me, would you like prepare a PR for it? >

[jira] [Commented] (FLINK-32879) slotmanager.max-total-resource.cpu/memory should be ignored in standalone mode.

2023-08-17 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755787#comment-17755787 ] Weihua Hu commented on FLINK-32879: --- Resolved in master: c8cbb0e2dec6ed505ce749c453e4f69ff0aecc95 >

[jira] [Resolved] (FLINK-32879) slotmanager.max-total-resource.cpu/memory should be ignored in standalone mode.

2023-08-17 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-32879. --- Fix Version/s: 1.18.0 (was: 1.19.0) Resolution: Fixed >

[jira] [Created] (FLINK-32882) FineGrainedSlotManager cause NPE when clear pending taskmanager twice

2023-08-16 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32882: - Summary: FineGrainedSlotManager cause NPE when clear pending taskmanager twice Key: FLINK-32882 URL: https://issues.apache.org/jira/browse/FLINK-32882 Project: Flink

[jira] [Commented] (FLINK-32803) Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management

2023-08-22 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757793#comment-17757793 ] Weihua Hu commented on FLINK-32803: --- I would like to take this issue. [~chesnay] [~renqs]  > Release

[jira] [Resolved] (FLINK-32882) FineGrainedSlotManager cause NPE when clear pending taskmanager twice

2023-08-16 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-32882. --- Fix Version/s: 1.18.0 Resolution: Fixed master: b56ae7822f6e4ff3ad67991f1c7916a435c960e9 >

[jira] [Resolved] (FLINK-32880) Redundant taskManagers should always be fulfilled in FineGrainedSlotManager

2023-08-18 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-32880. --- Fix Version/s: 1.18.0 Release Note: Resolved in master:

[jira] [Commented] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-17 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755548#comment-17755548 ] Weihua Hu commented on FLINK-32821: --- Hi, [~afedulov] Thanks for you attention.  the change in

[jira] [Commented] (FLINK-32980) Support env.java.opts.all & env.java.opts.cli config for starting Session cluster CLIs

2023-08-28 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759548#comment-17759548 ] Weihua Hu commented on FLINK-32980: --- [~Zhanghao Chen] Thanks for reporting this. you are assigned >

[jira] [Assigned] (FLINK-32980) Support env.java.opts.all & env.java.opts.cli config for starting Session cluster CLIs

2023-08-28 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-32980: - Assignee: Zhanghao Chen > Support env.java.opts.all & env.java.opts.cli config for starting

[jira] [Assigned] (FLINK-32771) Remove the invalid config option slotmanager.request-timeout

2023-08-13 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu reassigned FLINK-32771: - Assignee: Weihua Hu (was: Weihua Hu) > Remove the invalid config option

[jira] [Resolved] (FLINK-32771) Remove the invalid config option slotmanager.request-timeout

2023-08-15 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-32771. --- Resolution: Fixed > Remove the invalid config option slotmanager.request-timeout >

[jira] [Commented] (FLINK-32771) Remove the invalid config option slotmanager.request-timeout

2023-08-15 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754838#comment-17754838 ] Weihua Hu commented on FLINK-32771: --- master: b3557cfdc0a2897356027c16d97161c11680c802 > Remove the

[jira] [Resolved] (FLINK-32980) Support env.java.opts.all & env.java.opts.cli config for starting Session cluster CLIs

2023-08-28 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-32980. --- Release Note: Resolved in master: 6dbb9b8d3fcfe88a85b22e2f177e8fea7585702e Resolution: Fixed

[jira] [Commented] (FLINK-32980) Support env.java.opts.all & env.java.opts.cli config for starting Session cluster CLIs

2023-08-28 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759785#comment-17759785 ] Weihua Hu commented on FLINK-32980: --- Resolved in master: 6dbb9b8d3fcfe88a85b22e2f177e8fea7585702e >

[jira] [Updated] (FLINK-32980) Support env.java.opts.all & env.java.opts.cli config for starting Session cluster CLIs

2023-08-28 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-32980: -- Release Note: (was: Resolved in master: 6dbb9b8d3fcfe88a85b22e2f177e8fea7585702e) > Support

[jira] [Closed] (FLINK-32984) Display the host port information on the suttasks page of SubtaskExecution

2023-08-28 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu closed FLINK-32984. - Resolution: Duplicate > Display the host port information on the suttasks page of SubtaskExecution >

[jira] [Resolved] (FLINK-33147) Introduce a new "endpoint" field in REST API to represent TaskManager endpoint (host + port) and deprecate the "host" field

2023-11-09 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu resolved FLINK-33147. --- Resolution: Fixed  resolved in master: f77dbdfd0c7d510ae32ce932c7b84ed968496130 > Introduce a new

[jira] [Closed] (FLINK-24957) show `host:port` information in `subtasks` tab

2023-11-09 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu closed FLINK-24957. - Resolution: Duplicate > show `host:port` information in `subtasks` tab >

[jira] [Commented] (FLINK-26932) TaskManager hung in cleanupAllocationBaseDirs not exit.

2022-08-11 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17578304#comment-17578304 ] Weihua Hu commented on FLINK-26932: --- I think the cleanup could be handled in the discardExecutor

[jira] [Created] (FLINK-30525) Cannot open jobmanager configuration web page

2022-12-28 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-30525: - Summary: Cannot open jobmanager configuration web page Key: FLINK-30525 URL: https://issues.apache.org/jira/browse/FLINK-30525 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-30525) Cannot open jobmanager configuration web page

2022-12-28 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652489#comment-17652489 ] Weihua Hu commented on FLINK-30525: --- [~chesnay] looking forward to your opinions on it. > Cannot

[jira] [Commented] (FLINK-17372) SlotManager should expose total required resources

2022-12-28 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652480#comment-17652480 ] Weihua Hu commented on FLINK-17372: --- Hi. This issue is solved by

[jira] [Created] (FLINK-30517) Decrease log output interval while waiting for YARN JobManager be allocated

2022-12-28 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-30517: - Summary: Decrease log output interval while waiting for YARN JobManager be allocated Key: FLINK-30517 URL: https://issues.apache.org/jira/browse/FLINK-30517 Project: Flink

[jira] [Commented] (FLINK-30525) Cannot open jobmanager configuration web page

2023-01-08 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655952#comment-17655952 ] Weihua Hu commented on FLINK-30525: --- [~renqs] Can you take a look at this? This will affect the

[jira] [Created] (FLINK-30084) Remove unused ResourceActions.notifyAllocationFailure

2022-11-18 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-30084: - Summary: Remove unused ResourceActions.notifyAllocationFailure Key: FLINK-30084 URL: https://issues.apache.org/jira/browse/FLINK-30084 Project: Flink Issue Type:

[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-11-16 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635183#comment-17635183 ] Weihua Hu commented on FLINK-29572: --- [~AlexXXX] IMO, it's a bug to use loopback. we will remove it in

[jira] [Commented] (FLINK-8712) Cannot execute job with multiple slot sharing groups on LocalExecutor

2022-11-16 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635180#comment-17635180 ] Weihua Hu commented on FLINK-8712: -- [~xtsong] Agree with you, maybe we can close this issue since it is

[jira] [Commented] (FLINK-27341) TaskManager running together with JobManager are bind to 127.0.0.1

2022-11-15 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634637#comment-17634637 ] Weihua Hu commented on FLINK-27341: --- [~gaoyunhaii] I tested it in Kubernetes/Docker/Standalone.

[jira] [Updated] (FLINK-29870) split ResourceNotEnoughNotifier from ResourceActions

2022-11-03 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-29870: -- Description: SlotManager determines whether a resource can be allocated by the return value of

[jira] [Created] (FLINK-29870) Split ResourceActions to ResourceAllocator and ResourceAllocationNotifier

2022-11-03 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-29870: - Summary: Split ResourceActions to ResourceAllocator and ResourceAllocationNotifier Key: FLINK-29870 URL: https://issues.apache.org/jira/browse/FLINK-29870 Project: Flink

[jira] [Created] (FLINK-29869) make ResourceActions declarative

2022-11-03 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-29869: - Summary: make ResourceActions declarative Key: FLINK-29869 URL: https://issues.apache.org/jira/browse/FLINK-29869 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-8712) Cannot execute job with multiple slot sharing groups on LocalExecutor

2022-11-08 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630829#comment-17630829 ] Weihua Hu commented on FLINK-8712: -- [~xtsong], JobGraph::getMaximumParallelism is only used for

[jira] [Commented] (FLINK-8712) Cannot execute job with multiple slot sharing groups on LocalExecutor

2022-11-08 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630750#comment-17630750 ] Weihua Hu commented on FLINK-8712: -- Hi, [~trohrmann] [~xtsong] Could you help take a look at this issue

[jira] [Commented] (FLINK-29852) The operator is repeatedly displayed on the Flink Web UI

2022-11-09 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630841#comment-17630841 ] Weihua Hu commented on FLINK-29852: --- I can't reproduce this with this jar.{*}{*}   *My Flink version

[jira] [Updated] (FLINK-29852) The operator is repeatedly displayed on the Flink Web UI

2022-11-09 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-29852: -- Attachment: image-2022-11-09-16-09-44-233.png > The operator is repeatedly displayed on the Flink Web

[jira] [Commented] (FLINK-15358) [configuration] the global configuration will trim the rest of value after a `#` comment sign

2022-11-08 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630787#comment-17630787 ] Weihua Hu commented on FLINK-15358: --- [~chesnay] [~mxm]  As[

[jira] [Commented] (FLINK-27341) TaskManager running together with JobManager are bind to 127.0.0.1

2022-11-06 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629614#comment-17629614 ] Weihua Hu commented on FLINK-27341: --- Hi, [~chesnay] , [~gaoyunhaii]  I think this was introduced by

[jira] [Commented] (FLINK-15358) [configuration] the global configuration will trim the rest of value after a `#` comment sign

2022-11-08 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630314#comment-17630314 ] Weihua Hu commented on FLINK-15358: --- [~wangyang0918] [~chesnay] How about using snakeYaml or Jackson

[jira] [Commented] (FLINK-18229) Pending worker requests should be properly cleared

2022-11-04 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628727#comment-17628727 ] Weihua Hu commented on FLINK-18229: --- Hi, [~xtsong] I have updated the design doc. To make the changes

[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-11-04 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628839#comment-17628839 ] Weihua Hu commented on FLINK-29572: --- Hi, @songxintong, I think this was introduced by FLINK-24474. It

[jira] [Commented] (FLINK-8712) Cannot execute job with multiple slot sharing groups on LocalExecutor

2022-11-09 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631058#comment-17631058 ] Weihua Hu commented on FLINK-8712: -- [~Weijie Guo] I agree with you, change

[jira] (FLINK-8712) Cannot execute job with multiple slot sharing groups on LocalExecutor

2022-11-09 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8712 ] Weihua Hu deleted comment on FLINK-8712: -- was (Author: huwh): [~xtsong],  IMO, there are two options for batch job: 1. Calculate the accurate min required slot number according to whether the

[jira] [Commented] (FLINK-8712) Cannot execute job with multiple slot sharing groups on LocalExecutor

2022-11-09 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631023#comment-17631023 ] Weihua Hu commented on FLINK-8712: -- [~xtsong],  IMO, there are two options for batch job: 1. Calculate

[jira] [Commented] (FLINK-29852) The operator is repeatedly displayed on the Flink Web UI

2022-11-08 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630406#comment-17630406 ] Weihua Hu commented on FLINK-29852: --- Hi [~JasonLee] , I can't reproduce this problem with flink-1.16

[jira] [Commented] (FLINK-8712) Cannot execute job with multiple slot sharing groups on LocalExecutor

2022-11-08 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630424#comment-17630424 ] Weihua Hu commented on FLINK-8712: -- Hi, [~Weijie Guo] , MiniCluster already supports user to configure

[jira] [Commented] (FLINK-27341) TaskManager running together with JobManager are bind to 127.0.0.1

2022-11-10 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631543#comment-17631543 ] Weihua Hu commented on FLINK-27341: --- [~gaoyunhaii] yes, we can directly remove the LOOPBACK, i will do

[jira] [Commented] (FLINK-29970) Prometheus cannot collect flink metrics

2022-11-15 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634355#comment-17634355 ] Weihua Hu commented on FLINK-29970: --- [~zhongyangyang], Hi, there are some typo in your configuration.

[jira] [Created] (FLINK-31498) DeclartiveSlotManager always request redundant task manager when resource is not enough

2023-03-17 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31498: - Summary: DeclartiveSlotManager always request redundant task manager when resource is not enough Key: FLINK-31498 URL: https://issues.apache.org/jira/browse/FLINK-31498

[jira] [Commented] (FLINK-31518) HighAvailabilityServiceUtils resolves wrong webMonitorAddress in Standalone mode

2023-03-20 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702579#comment-17702579 ] Weihua Hu commented on FLINK-31518: --- Could you describe the use scenario in more detail? IIUC, when

[jira] [Updated] (FLINK-31529) Let yarn client exit early before JobManager running

2023-03-20 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weihua Hu updated FLINK-31529: -- Description: Currently the YarnClusterDescriptor always wait yarn application status to be RUNNING

[jira] [Created] (FLINK-31443) FineGrainedSlotManager maintain some redundant task managers

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31443: - Summary: FineGrainedSlotManager maintain some redundant task managers Key: FLINK-31443 URL: https://issues.apache.org/jira/browse/FLINK-31443 Project: Flink

[jira] [Created] (FLINK-31445) Split resource allocate/release related logic from FineGrainedSlotManager to TaskManagerTracker

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31445: - Summary: Split resource allocate/release related logic from FineGrainedSlotManager to TaskManagerTracker Key: FLINK-31445 URL: https://issues.apache.org/jira/browse/FLINK-31445

[jira] [Created] (FLINK-31448) Use FineGrainedSlotManager as the default SlotManager

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31448: - Summary: Use FineGrainedSlotManager as the default SlotManager Key: FLINK-31448 URL: https://issues.apache.org/jira/browse/FLINK-31448 Project: Flink Issue Type:

[jira] [Created] (FLINK-31447) Aligning unit tests of FineGrainedSlotManager with DeclarativeSlotManager

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31447: - Summary: Aligning unit tests of FineGrainedSlotManager with DeclarativeSlotManager Key: FLINK-31447 URL: https://issues.apache.org/jira/browse/FLINK-31447 Project: Flink

[jira] [Created] (FLINK-31439) FLIP-298: Unifying the Implementation of SlotManager

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31439: - Summary: FLIP-298: Unifying the Implementation of SlotManager Key: FLINK-31439 URL: https://issues.apache.org/jira/browse/FLINK-31439 Project: Flink Issue Type:

[jira] [Created] (FLINK-31441) FineGrainedSlotManager support select slot evenly

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31441: - Summary: FineGrainedSlotManager support select slot evenly Key: FLINK-31441 URL: https://issues.apache.org/jira/browse/FLINK-31441 Project: Flink Issue Type:

[jira] [Created] (FLINK-31444) FineGrainedSlotManager reclaims slots when job is finished

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31444: - Summary: FineGrainedSlotManager reclaims slots when job is finished Key: FLINK-31444 URL: https://issues.apache.org/jira/browse/FLINK-31444 Project: Flink Issue

[jira] [Created] (FLINK-31449) Remove DeclarativeSlotManager related logic

2023-03-14 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-31449: - Summary: Remove DeclarativeSlotManager related logic Key: FLINK-31449 URL: https://issues.apache.org/jira/browse/FLINK-31449 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-31457) Support waiting for required resources in DefaultScheduler during job restart

2023-03-15 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17700961#comment-17700961 ] Weihua Hu commented on FLINK-31457: --- [~a.pilipenko] IIUC, this issue is caused by

[jira] [Commented] (FLINK-31233) no error should be logged when retrieving the task manager's stdout if it does not exist

2023-03-22 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703857#comment-17703857 ] Weihua Hu commented on FLINK-31233: --- [~Weijie Guo] Thanks for your attention. Yes, the stdout file

[jira] [Comment Edited] (FLINK-31589) Reduce the pressure of the list pod method on the k8s cluster

2023-03-23 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704103#comment-17704103 ] Weihua Hu edited comment on FLINK-31589 at 3/23/23 11:56 AM: - [~spoon-lz]

[jira] [Commented] (FLINK-31589) Reduce the pressure of the list pod method on the k8s cluster

2023-03-23 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704103#comment-17704103 ] Weihua Hu commented on FLINK-31589: --- [~spoon-lz] thanks for reporting this.

[jira] [Commented] (FLINK-27104) ClassNotFound when submit jobs to session cluster with external jars

2023-03-24 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704536#comment-17704536 ] Weihua Hu commented on FLINK-27104: --- [~Wencong Liu] I gauss it's typo. Should be

[jira] [Commented] (FLINK-31144) Slow scheduling on large-scale batch jobs

2023-03-13 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699644#comment-17699644 ] Weihua Hu commented on FLINK-31144: --- [~martijnvisser], yes, this change will improve the performance

[jira] [Commented] (FLINK-31557) Metric viewUpdater and reporter task in a SingleThreadScheduledExecutor lead to inaccurate PerSecond related metrics

2023-03-21 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703472#comment-17703472 ] Weihua Hu commented on FLINK-31557: --- [~LiuZeshan] The MeterView does not record timestamp for each

[jira] [Commented] (FLINK-31557) Metric viewUpdater and reporter task in a SingleThreadScheduledExecutor lead to inaccurate PerSecond related metrics

2023-03-22 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703550#comment-17703550 ] Weihua Hu commented on FLINK-31557: --- [~chesnay] could you assign this to me? I will add a new

[jira] [Commented] (FLINK-31468) Allow setting JobResourceRequirements through DispatcherGateway

2023-03-21 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703115#comment-17703115 ] Weihua Hu commented on FLINK-31468: --- Hi, [~dmvk] I would like take this ticket if possible > Allow

  1   2   3   >