[jira] [Commented] (FLINK-25087) Move heartbeats from akka to the dedicated thread pool in JM

2022-06-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553830#comment-17553830 ] Zhanghao Chen commented on FLINK-25087: --- [~zjureel] Since MainThreadExecutor#schedule, which is

[jira] [Commented] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-19 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620760#comment-17620760 ] Zhanghao Chen commented on FLINK-29615: --- Hi, [~xtsong]. Could you help take a look at this? We

[jira] [Updated] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-19 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-29615: -- Description: We are exploring autoscaling Flink with Reactive mode using metrics from Flink

[jira] [Updated] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-19 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-29615: -- Description: We are exploring autoscaling Flink with Reactive mode using metrics from Flink

[jira] [Commented] (FLINK-28973) Extending /jars/:jarid/plan API to support setting Flink configs

2022-10-27 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625399#comment-17625399 ] Zhanghao Chen commented on FLINK-28973: --- Hi [~gaoyunhaii]. The concern is totally valid, but as

[jira] [Commented] (FLINK-12312) Temporarily disable CLI command for rescaling

2022-09-15 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17605581#comment-17605581 ] Zhanghao Chen commented on FLINK-12312: --- [~gjy] the attached mail thread seems to be unrelated.

[jira] [Commented] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616924#comment-17616924 ] Zhanghao Chen commented on FLINK-29615: --- [~chesnay] could you help take a look? I've prepared a

[jira] [Updated] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-29615: -- Description: *Problem* MetricStore does not remove metrics of nonexistent subtasks when

[jira] [Updated] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-29615: -- Description: *Problem* MetricStore does not remove metrics of nonexistent subtasks when

[jira] [Updated] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-29615: -- Description: *Problem* MetricStore does not remove metrics of nonexistent subtasks when

[jira] [Created] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-29615: - Summary: MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism Key: FLINK-29615 URL:

[jira] [Commented] (FLINK-25586) ExecutionGraphInfoStore in session cluster should split failed and successful jobs

2022-08-07 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576478#comment-17576478 ] Zhanghao Chen commented on FLINK-25586: --- [~dmvk] [~xtsong] What do you guys think about it? If you

[jira] [Commented] (FLINK-12130) Apply command line options to configuration before installing security modules

2022-08-07 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576481#comment-17576481 ] Zhanghao Chen commented on FLINK-12130: --- Hi, [~aljoscha], we also need this feature in our

[jira] [Created] (FLINK-28973) Extending /jars/:jarid/plan API to support setting Flink configs

2022-08-15 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-28973: - Summary: Extending /jars/:jarid/plan API to support setting Flink configs Key: FLINK-28973 URL: https://issues.apache.org/jira/browse/FLINK-28973 Project: Flink

[jira] [Commented] (FLINK-18572) Flink web UI doesn't display tolerable-failed-checkpoints

2022-08-08 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577144#comment-17577144 ] Zhanghao Chen commented on FLINK-18572: --- Verified that this is already included in Web UI in Flink

[jira] [Commented] (FLINK-30513) HA storage dir leaks on cluster termination

2022-12-28 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652438#comment-17652438 ] Zhanghao Chen commented on FLINK-30513: --- Hi [~wangyang0918], looking forward to your opinions on

[jira] [Commented] (FLINK-30513) HA storage dir leaks on cluster termination

2023-01-12 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676395#comment-17676395 ] Zhanghao Chen commented on FLINK-30513: --- [~wangyang0918] Could you assign this task to me? I can

[jira] [Created] (FLINK-30513) HA storage dir leaks on cluster termination

2022-12-27 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-30513: - Summary: HA storage dir leaks on cluster termination Key: FLINK-30513 URL: https://issues.apache.org/jira/browse/FLINK-30513 Project: Flink Issue Type:

[jira] [Updated] (FLINK-30513) HA storage dir leaks on cluster termination

2022-12-27 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-30513: -- Issue Type: Bug (was: Improvement) > HA storage dir leaks on cluster termination >

[jira] [Updated] (FLINK-30513) HA storage dir leaks on cluster termination

2022-12-27 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-30513: -- Description: *Problem* We found that HA storage dir leaks on cluster termination for a Flink

[jira] [Commented] (FLINK-30101) Always use StandaloneClientHAServices to create RestClusterClient when retriving a Flink on YARN cluster client

2022-11-22 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637155#comment-17637155 ] Zhanghao Chen commented on FLINK-30101: --- Thanks, you made a point. I did not take the case where

[jira] [Closed] (FLINK-30101) Always use StandaloneClientHAServices to create RestClusterClient when retriving a Flink on YARN cluster client

2022-11-22 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen closed FLINK-30101. - Resolution: Incomplete > Always use StandaloneClientHAServices to create RestClusterClient when

[jira] [Created] (FLINK-30101) YARN client should

2022-11-20 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-30101: - Summary: YARN client should Key: FLINK-30101 URL: https://issues.apache.org/jira/browse/FLINK-30101 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-30101) Always use StandaloneClientHAServices to create RestClusterClient when retriving a Flink on YARN cluster client

2022-11-20 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-30101: -- Description: *Problem* Currently, the procedure of retrieving a Flink on YARN cluster client

[jira] [Updated] (FLINK-30101) Always use StandaloneClientHAServices to create RestClusterClient when retriving a Flink on YARN cluster client

2022-11-20 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-30101: -- Summary: Always use StandaloneClientHAServices to create RestClusterClient when retriving a

[jira] [Commented] (FLINK-30101) Always use StandaloneClientHAServices to create RestClusterClient when retriving a Flink on YARN cluster client

2022-11-20 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17636408#comment-17636408 ] Zhanghao Chen commented on FLINK-30101: --- [~xtsong] Looking forwarding to your opinions on the

[jira] [Updated] (FLINK-30829) Make the backpressure tab could be sort by the backpressure level

2023-01-30 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-30829: -- External issue URL: (was: https://issues.apache.org/jira/browse/FLINK-29998) > Make the

[jira] [Commented] (FLINK-30829) Make the backpressure tab could be sort by the backpressure level

2023-01-30 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682129#comment-17682129 ] Zhanghao Chen commented on FLINK-30829: --- Hi, [~yunta]. If you think this is valid, could you

[jira] [Created] (FLINK-30829) Make the backpressure tab could be sort by the backpressure level

2023-01-30 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-30829: - Summary: Make the backpressure tab could be sort by the backpressure level Key: FLINK-30829 URL: https://issues.apache.org/jira/browse/FLINK-30829 Project: Flink

[jira] [Updated] (FLINK-30829) Make the backpressure tab could be sort by the backpressure level

2023-01-30 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-30829: -- External issue URL: https://issues.apache.org/jira/browse/FLINK-29998 > Make the backpressure

[jira] [Created] (FLINK-31358) Display consumed split/partition/queue info on Web UI

2023-03-07 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31358: - Summary: Display consumed split/partition/queue info on Web UI Key: FLINK-31358 URL: https://issues.apache.org/jira/browse/FLINK-31358 Project: Flink

[jira] [Commented] (FLINK-31245) Adaptive scheduler does not reset the state of GlobalAggregateManager when rescaling

2023-02-27 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694008#comment-17694008 ] Zhanghao Chen commented on FLINK-31245: --- [~dmvk] Looking forward to your opinions on this.

[jira] [Updated] (FLINK-31245) Adaptive scheduler does not reset the state of GlobalAggregateManager when rescaling

2023-02-27 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-31245: -- Description: *Problem* GlobalAggregateManager is used to share state amongst parallel tasks

[jira] [Created] (FLINK-31245) Adaptive scheduler does not reset the state of GlobalAggregateManager when rescaling

2023-02-27 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31245: - Summary: Adaptive scheduler does not reset the state of GlobalAggregateManager when rescaling Key: FLINK-31245 URL: https://issues.apache.org/jira/browse/FLINK-31245

[jira] [Commented] (FLINK-31245) Adaptive scheduler does not reset the state of GlobalAggregateManager when rescaling

2023-02-27 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694020#comment-17694020 ] Zhanghao Chen commented on FLINK-31245: --- Thanks [~dmvk]. I'll open a discussion in dev mailing

[jira] [Commented] (FLINK-30513) HA storage dir leaks on cluster termination

2023-02-20 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691123#comment-17691123 ] Zhanghao Chen commented on FLINK-30513: --- [~wangyang0918] Could you help review the PR when you are

[jira] [Commented] (FLINK-31266) dashboard info error (received and send alway show 0 when having data)

2023-02-28 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694814#comment-17694814 ] Zhanghao Chen commented on FLINK-31266: --- Are you using connectors that implements FLIP-33

[jira] [Commented] (FLINK-30829) Make the backpressure tab could be sort by the backpressure level

2023-02-27 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694054#comment-17694054 ] Zhanghao Chen commented on FLINK-30829: --- After a second thought, I agree with [~yunta] that

[jira] [Created] (FLINK-31826) Incorrect estimation of the target data rate of a vertex when only a subset of its upstream vertex's output is consumed

2023-04-17 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31826: - Summary: Incorrect estimation of the target data rate of a vertex when only a subset of its upstream vertex's output is consumed Key: FLINK-31826 URL:

[jira] [Closed] (FLINK-31826) Incorrect estimation of the target data rate of a vertex when only a subset of its upstream vertex's output is consumed

2023-04-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen closed FLINK-31826. - Resolution: Duplicate > Incorrect estimation of the target data rate of a vertex when only a

[jira] [Created] (FLINK-31827) Incorrect estimation of the target data rate of a vertex when only a subset of its upstream vertex's output is consumed

2023-04-17 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31827: - Summary: Incorrect estimation of the target data rate of a vertex when only a subset of its upstream vertex's output is consumed Key: FLINK-31827 URL:

[jira] [Commented] (FLINK-31826) Incorrect estimation of the target data rate of a vertex when only a subset of its upstream vertex's output is consumed

2023-04-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713165#comment-17713165 ] Zhanghao Chen commented on FLINK-31826: --- I'm sorry that I created duplicated issues due to a

[jira] [Commented] (FLINK-31827) Incorrect estimation of the target data rate of a vertex when only a subset of its upstream vertex's output is consumed

2023-04-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713192#comment-17713192 ] Zhanghao Chen commented on FLINK-31827: --- Thanks [~gyfora]. By "target jobvertex level in/out

[jira] [Updated] (FLINK-31936) Support setting scale up max factor

2023-04-25 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-31936: -- Description: Currently, only scale down max factor is supported to be configured. We should

[jira] [Updated] (FLINK-31936) Support setting scale up max factor

2023-04-25 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-31936: -- Description: Currently, only scale down max factor is supported to be configured. We should

[jira] [Commented] (FLINK-31936) Support setting scale up max factor

2023-04-25 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716235#comment-17716235 ] Zhanghao Chen commented on FLINK-31936: --- Hi, [~gyfora], if you think this issue is worthful to do,

[jira] [Created] (FLINK-31936) Support setting scale up max factor

2023-04-25 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31936: - Summary: Support setting scale up max factor Key: FLINK-31936 URL: https://issues.apache.org/jira/browse/FLINK-31936 Project: Flink Issue Type:

[jira] [Commented] (FLINK-31898) Flink k8s autoscaler does not work as expected

2023-04-23 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715565#comment-17715565 ] Zhanghao Chen commented on FLINK-31898: --- [~lufovic77] Could you provide more details about the

[jira] [Created] (FLINK-31769) Add percentiles to aggregated metrics

2023-04-11 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31769: - Summary: Add percentiles to aggregated metrics Key: FLINK-31769 URL: https://issues.apache.org/jira/browse/FLINK-31769 Project: Flink Issue Type:

[jira] [Commented] (FLINK-32127) Source busy time is inaccurate in many cases

2023-05-18 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724124#comment-17724124 ] Zhanghao Chen commented on FLINK-32127: --- Hi [~Wencong Liu]. I think the key problem here is that

[jira] [Closed] (FLINK-32124) Add option to enable partition alignment for sources

2023-05-18 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen closed FLINK-32124. - Resolution: Invalid > Add option to enable partition alignment for sources >

[jira] [Commented] (FLINK-32124) Add option to enable partition alignment for sources

2023-05-18 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724125#comment-17724125 ] Zhanghao Chen commented on FLINK-32124: --- Hi [~gyfora]. I confirmed that operator actually aligns

[jira] [Commented] (FLINK-32858) [JUnit5 Migration] The util package of flink-runtime module

2023-08-11 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753195#comment-17753195 ] Zhanghao Chen commented on FLINK-32858: --- Hi [~fanrui], I'd be willing to volunteer, could you

[jira] [Commented] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-11 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753194#comment-17753194 ] Zhanghao Chen commented on FLINK-32821: --- Hi [~huweihua], thanks for notifying me of that, I missed

[jira] [Commented] (FLINK-32822) Add connector option to control whether to enable auto-commit of offsets when checkpoints is enabled

2023-08-11 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753131#comment-17753131 ] Zhanghao Chen commented on FLINK-32822: --- Hi [~mason6345] , the pain point of monitoring lag from

[jira] [Comment Edited] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-10 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753000#comment-17753000 ] Zhanghao Chen edited comment on FLINK-32821 at 8/11/23 12:42 AM: - Hi

[jira] [Commented] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-10 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753000#comment-17753000 ] Zhanghao Chen commented on FLINK-32821: --- Hi [~afedulov] , I execute them using the same procedure

[jira] [Comment Edited] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-10 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753000#comment-17753000 ] Zhanghao Chen edited comment on FLINK-32821 at 8/11/23 12:43 AM: - Hi

[jira] [Commented] (FLINK-25371) Include data port as part of the host info for subtask detail panel on Web UI

2023-08-07 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751854#comment-17751854 ] Zhanghao Chen commented on FLINK-25371: --- Hi [~huwh] , what do you think about this? > Include

[jira] [Created] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-09 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32821: - Summary: Streaming examples failed to execute due to error in packaging Key: FLINK-32821 URL: https://issues.apache.org/jira/browse/FLINK-32821 Project: Flink

[jira] [Commented] (FLINK-32820) ParameterTool is mistakenly marked as deprecated

2023-08-09 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752472#comment-17752472 ] Zhanghao Chen commented on FLINK-32820: --- This is also related to the fix of [FLINK-32821]

[jira] [Created] (FLINK-32820) ParameterTool is mistakenly marked as deprecated

2023-08-09 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32820: - Summary: ParameterTool is mistakenly marked as deprecated Key: FLINK-32820 URL: https://issues.apache.org/jira/browse/FLINK-32820 Project: Flink Issue

[jira] [Updated] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-09 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32821: -- Issue Type: Bug (was: Improvement) > Streaming examples failed to execute due to error in

[jira] [Updated] (FLINK-32820) ParameterTool is mistakenly marked as deprecated

2023-08-09 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32820: -- Issue Type: Bug (was: Improvement) > ParameterTool is mistakenly marked as deprecated >

[jira] [Created] (FLINK-32822) Add connector option to control whether to enable auto-commit of offsets when checkpoints is enabled

2023-08-09 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32822: - Summary: Add connector option to control whether to enable auto-commit of offsets when checkpoints is enabled Key: FLINK-32822 URL:

[jira] [Updated] (FLINK-32822) Add connector option to control whether to enable auto-commit of offsets when checkpoints is enabled

2023-08-09 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32822: -- Description: When checkpointing is enabled, Flink Kafka connector commits the current

[jira] [Commented] (FLINK-32820) ParameterTool is mistakenly marked as deprecated

2023-08-10 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752756#comment-17752756 ] Zhanghao Chen commented on FLINK-32820: --- Thanks for the comment, I'll prepare a PR that reverts

[jira] [Updated] (FLINK-32037) The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler

2023-05-08 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32037: -- Description: *Background* After FLINK-30213, in case of parallelism changes to the JobGraph,

[jira] [Created] (FLINK-32037) The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler

2023-05-08 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32037: - Summary: The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler Key: FLINK-32037 URL:

[jira] [Updated] (FLINK-32037) The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler

2023-05-08 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32037: -- Issue Type: Bug (was: Improvement) > The edge on Web UI is wrong after parallelism changes

[jira] [Updated] (FLINK-32037) The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler

2023-05-08 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32037: -- Description: *Background* After FLINK-30213, in case of parallelism changes to the JobGraph,

[jira] [Updated] (FLINK-31991) Update Autoscaler doc to reflect the changes brought by the new source scaling logic

2023-05-03 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-31991: -- Description: The current statements on job requirements are outdated: ??- All sources must

[jira] [Created] (FLINK-31991) Update Autoscaler doc to reflect the changes brought by the new source scaling logic

2023-05-03 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-31991: - Summary: Update Autoscaler doc to reflect the changes brought by the new source scaling logic Key: FLINK-31991 URL: https://issues.apache.org/jira/browse/FLINK-31991

[jira] [Created] (FLINK-32124) Add option to enable partition alignment for sources

2023-05-18 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32124: - Summary: Add option to enable partition alignment for sources Key: FLINK-32124 URL: https://issues.apache.org/jira/browse/FLINK-32124 Project: Flink Issue

[jira] [Commented] (FLINK-32124) Add option to enable partition alignment for sources

2023-05-18 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723801#comment-17723801 ] Zhanghao Chen commented on FLINK-32124: --- Thanks [~gyfora]. I'll follow up there. > Add option to

[jira] [Updated] (FLINK-32127) Source busy time is inaccurate in many cases

2023-05-18 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32127: -- Description: We found that source busy time is inaccurate in many cases. The reason is that

[jira] [Updated] (FLINK-32127) Source busy time is inaccurate in many cases

2023-05-18 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32127: -- Description: We found that source busy time is inaccurate in many cases. The reason is that

[jira] [Created] (FLINK-32127) Source busy time is inaccurate in many cases

2023-05-18 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-32127: - Summary: Source busy time is inaccurate in many cases Key: FLINK-32127 URL: https://issues.apache.org/jira/browse/FLINK-32127 Project: Flink Issue Type:

[jira] [Commented] (FLINK-32119) Disable key group alignment for determining source parallelism

2023-05-18 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723800#comment-17723800 ] Zhanghao Chen commented on FLINK-32119: --- +1 for "partition skew is probably worse than key group

[jira] [Commented] (FLINK-32848) [JUnit5 Migration] The persistence, query, registration, rpc and shuffle packages of flink-runtime module

2023-08-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753668#comment-17753668 ] Zhanghao Chen commented on FLINK-32848: --- Hi [~fanrui], could you assign it to me as well? I'm done

[jira] [Updated] (FLINK-32821) Streaming examples failed to execute due to error in packaging

2023-08-14 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-32821: -- Description: 6 out of the 7 streaming examples failed to run: * Iteration & SessionWindowing

[jira] [Commented] (FLINK-32858) [JUnit5 Migration] The util package of flink-runtime module

2023-08-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753667#comment-17753667 ] Zhanghao Chen commented on FLINK-32858: --- Hi [~fanrui], I've prepared a MR, help review when you

[jira] [Created] (FLINK-34230) Update flink-docs README: add -Pskip-webui-build to the config doc generation command

2024-01-24 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34230: - Summary: Update flink-docs README: add -Pskip-webui-build to the config doc generation command Key: FLINK-34230 URL: https://issues.apache.org/jira/browse/FLINK-34230

[jira] [Updated] (FLINK-34230) Update flink-docs README: add -Pskip-webui-build to the config doc generation command

2024-01-24 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-34230: -- Description: I used to generate Flink config docs with the command listed in flink-docs

[jira] [Updated] (FLINK-34230) Update flink-docs README: add -Pskip-webui-build to the config doc generation command

2024-01-24 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-34230: -- Description: I used to generate Flink config docs with the command listed in flink-docs

[jira] [Commented] (FLINK-34392) Release Testing Instructions: Verify FLINK-33146 Unify the Representation of TaskManager Location in REST API and Web UI

2024-02-06 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815086#comment-17815086 ] Zhanghao Chen commented on FLINK-34392: --- Closing it as it does not require cross-team testing >

[jira] [Commented] (FLINK-34392) Release Testing Instructions: Verify FLINK-33146 Unify the Representation of TaskManager Location in REST API and Web UI

2024-02-06 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815087#comment-17815087 ] Zhanghao Chen commented on FLINK-34392: --- [~lincoln.86xy] Hi, I cannot close it. Could you help

[jira] [Commented] (FLINK-33962) Chaining-agnostic OperatorID generation for improved state compatibility on parallelism change

2024-02-07 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815195#comment-17815195 ] Zhanghao Chen commented on FLINK-33962: --- Hi [~srichter], I'm trying to make the hasher upgrade

[jira] [Commented] (FLINK-33265) Support source parallelism setting for Kafka connector

2024-02-04 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814181#comment-17814181 ] Zhanghao Chen commented on FLINK-33265: --- Hi [~lincoln.86xy], SuDewei will be doing this. Could you

[jira] [Updated] (FLINK-34354) Release Testing: Verify FLINK-34037 Improve Serialization Configuration and Usage in Flink

2024-02-21 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-34354: -- Description: This issue aims to verify

[jira] [Updated] (FLINK-34354) Release Testing: Verify FLINK-34037 Improve Serialization Configuration and Usage in Flink

2024-02-21 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-34354: -- Description: This issue aims to verify

[jira] [Updated] (FLINK-34354) Release Testing: Verify FLINK-34037 Improve Serialization Configuration and Usage in Flink

2024-02-21 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-34354: -- Description: This issue aims to verify

[jira] [Updated] (FLINK-34354) Release Testing: Verify FLINK-34037 Improve Serialization Configuration and Usage in Flink

2024-02-21 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-34354: -- Description: This issue aims to verify

[jira] [Commented] (FLINK-33891) Remove the obsolete SingleJobGraphStore

2023-12-19 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798819#comment-17798819 ] Zhanghao Chen commented on FLINK-33891: --- [~huweihua] Could you help take a look? > Remove the

[jira] [Created] (FLINK-33891) Remove the obsolete SingleJobGraphStore

2023-12-19 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33891: - Summary: Remove the obsolete SingleJobGraphStore Key: FLINK-33891 URL: https://issues.apache.org/jira/browse/FLINK-33891 Project: Flink Issue Type:

[jira] [Updated] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2023-12-24 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-33681: -- Attachment: (was: screenshot-20231225-120421-1.png) > Display source/sink

[jira] [Commented] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2023-12-24 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800234#comment-17800234 ] Zhanghao Chen commented on FLINK-33681: --- [~renqs] Hi, I'm reaching out to you to have some inputs.

[jira] [Updated] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2023-12-24 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-33681: -- Attachment: screenshot-20231225-120421-1.png > Display source/sink numRecordsIn/Out &

[jira] [Commented] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2023-12-24 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800237#comment-17800237 ] Zhanghao Chen commented on FLINK-33681: --- Attached is a working demo:

[jira] [Updated] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

2023-12-24 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-33681: -- Attachment: screenshot-20231225-120421.png > Display source/sink numRecordsIn/Out &

<    1   2   3   4   >