[jira] [Created] (FLINK-10969) expose API or metric for total number of keys stored in state backend

2018-11-21 Thread Steven Zhen Wu (JIRA)
Steven Zhen Wu created FLINK-10969: -- Summary: expose API or metric for total number of keys stored in state backend Key: FLINK-10969 URL: https://issues.apache.org/jira/browse/FLINK-10969 Project: Fl

[jira] [Updated] (FLINK-10969) expose API or metric for total number of keys stored in state backend

2018-11-21 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-10969: --- Description: [~srichter] mentioned it might make sense to provide two versions: exact count

[jira] [Created] (FLINK-10970) expose metric for total state size in terms of bytes

2018-11-21 Thread Steven Zhen Wu (JIRA)
Steven Zhen Wu created FLINK-10970: -- Summary: expose metric for total state size in terms of bytes Key: FLINK-10970 URL: https://issues.apache.org/jira/browse/FLINK-10970 Project: Flink Issu

[jira] [Commented] (FLINK-10452) Expose Additional Metrics to Reason about Statesize

2018-11-22 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16696156#comment-16696156 ] Steven Zhen Wu commented on FLINK-10452: I saw two tickets that I filed are mark

[jira] [Commented] (FLINK-7883) Make savepoints atomic with respect to state and side effects

2018-11-24 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16697931#comment-16697931 ] Steven Zhen Wu commented on FLINK-7883: --- We would love to see this happening. it is

[jira] [Created] (FLINK-10360) support timeout in savepoint REST api

2018-09-17 Thread Steven Zhen Wu (JIRA)
Steven Zhen Wu created FLINK-10360: -- Summary: support timeout in savepoint REST api Key: FLINK-10360 URL: https://issues.apache.org/jira/browse/FLINK-10360 Project: Flink Issue Type: Improve

[jira] [Updated] (FLINK-10360) support timeout in savepoint REST api

2018-09-18 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-10360: --- Description: right now, savepoint share the same timeout config as checkpoint. With increme

[jira] [Commented] (FLINK-14271) Deprecate legacy RestartPipelinedRegionStrategy

2019-10-02 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942945#comment-16942945 ] Steven Zhen Wu commented on FLINK-14271: [~zhuzh] we don't use the region failov

[jira] [Created] (FLINK-14315) NPE with JobMaster.disconnectTaskManager

2019-10-02 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-14315: -- Summary: NPE with JobMaster.disconnectTaskManager Key: FLINK-14315 URL: https://issues.apache.org/jira/browse/FLINK-14315 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-03 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-14316: -- Summary: stuck in "Job leader ... lost leadership" error Key: FLINK-14316 URL: https://issues.apache.org/jira/browse/FLINK-14316 Project: Flink Issue Typ

[jira] [Commented] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-04 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944638#comment-16944638 ] Steven Zhen Wu commented on FLINK-14316: [~trohrmann] don't know. we are just be

[jira] [Updated] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-07 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-14316: --- Attachment: FLINK-14316.tgz > stuck in "Job leader ... lost leadership" error >

[jira] [Commented] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-07 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946322#comment-16946322 ] Steven Zhen Wu commented on FLINK-14316: [~trohrmann] in the uploaded tar ball,

[jira] [Comment Edited] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-07 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946322#comment-16946322 ] Steven Zhen Wu edited comment on FLINK-14316 at 10/7/19 11:07 PM:

[jira] [Comment Edited] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-07 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946326#comment-16946326 ] Steven Zhen Wu edited comment on FLINK-14316 at 10/7/19 11:10 PM:

[jira] [Commented] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-07 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946326#comment-16946326 ] Steven Zhen Wu commented on FLINK-14316: >From TM log, I also noticed that ZooKe

[jira] [Commented] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-07 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946327#comment-16946327 ] Steven Zhen Wu commented on FLINK-14316: My colleague [~pgoyal] will attach a pa

[jira] [Created] (FLINK-14358) [Web UI] configuration tab for jobmanager has improper width for prop key

2019-10-09 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-14358: -- Summary: [Web UI] configuration tab for jobmanager has improper width for prop key Key: FLINK-14358 URL: https://issues.apache.org/jira/browse/FLINK-14358 Project

[jira] [Updated] (FLINK-14358) [Web UI] configuration tab for jobmanager has improper width for prop key

2019-10-09 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-14358: --- Description: You can see the key column shows only 2 chars which make it not readable.   !

[jira] [Updated] (FLINK-14358) [Web UI] configuration tab for jobmanager has improper width for prop key

2019-10-09 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-14358: --- Description: You can see the key column shows only 2 chars which make it not readable. This

[jira] [Commented] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2019-10-13 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16950470#comment-16950470 ] Steven Zhen Wu commented on FLINK-14316: [~trohrmann] we would love to hear your

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

2019-06-06 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857778#comment-16857778 ] Steven Zhen Wu commented on FLINK-12619: It is very useful to support optimized/

[jira] [Created] (FLINK-12781) run job REST api doesn't return complete stack trace for start job failure

2019-06-07 Thread Steven Zhen Wu (JIRA)
Steven Zhen Wu created FLINK-12781: -- Summary: run job REST api doesn't return complete stack trace for start job failure Key: FLINK-12781 URL: https://issues.apache.org/jira/browse/FLINK-12781 Projec

[jira] [Updated] (FLINK-12781) run job REST api doesn't return complete stack trace for start job failure

2019-06-07 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-12781: --- Description: We use REST api to start a job in Flink cluster. https://ci.apache.org/projects

[jira] [Updated] (FLINK-12781) run job REST api doesn't return complete stack trace for start job failure

2019-06-07 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-12781: --- Description: We use REST api to start a job in Flink cluster. [https://ci.apache.org/projec

[jira] [Updated] (FLINK-12781) run job REST api doesn't return complete stack trace for start job failure

2019-06-07 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-12781: --- Description: We use REST api to start a job in Flink cluster. https://ci.apache.org/projects

[jira] [Updated] (FLINK-12781) run job REST api doesn't return complete stack trace for start job failure

2019-06-07 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-12781: --- Description: We use REST api to start a job in Flink cluster. https://ci.apache.org/projects

[jira] [Updated] (FLINK-12781) run job REST api doesn't return complete stack trace for start job failure

2019-06-07 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-12781: --- Description: We use REST api to start a job in Flink cluster. https://ci.apache.org/projects

[jira] [Updated] (FLINK-12781) REST handler should return full stack trace instead of just error msg

2019-06-07 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-12781: --- Summary: REST handler should return full stack trace instead of just error msg (was: run jo

[jira] [Assigned] (FLINK-12781) REST handler should return full stack trace instead of just error msg

2019-06-08 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu reassigned FLINK-12781: -- Assignee: Steven Zhen Wu > REST handler should return full stack trace instead of jus

[jira] [Updated] (FLINK-12781) REST handler should return full stack trace instead of just error msg

2019-06-08 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-12781: --- Affects Version/s: 1.7.2 > REST handler should return full stack trace instead of just error

[jira] [Created] (FLINK-35384) Expose metrics group to custom Partitioner

2024-05-16 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-35384: -- Summary: Expose metrics group to custom Partitioner Key: FLINK-35384 URL: https://issues.apache.org/jira/browse/FLINK-35384 Project: Flink Issue Type: Im

[jira] [Updated] (FLINK-35384) Expose metrics group to custom Partitioner

2024-05-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-35384: --- Description: I am trying to implement a custom range partitioner in the Flink Iceberg sink.

[jira] [Updated] (FLINK-35384) Expose TaskIOMetricGroup to custom Partitioner

2024-05-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-35384: --- Summary: Expose TaskIOMetricGroup to custom Partitioner (was: Expose metrics group to custo

[jira] [Commented] (FLINK-35384) Expose TaskIOMetricGroup to custom Partitioner

2024-05-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847116#comment-17847116 ] Steven Zhen Wu commented on FLINK-35384: one potential risk of this type of API

[jira] [Comment Edited] (FLINK-35384) Expose TaskIOMetricGroup to custom Partitioner

2024-05-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847116#comment-17847116 ] Steven Zhen Wu edited comment on FLINK-35384 at 5/17/24 12:06 AM:

[jira] [Updated] (FLINK-35384) Expose TaskIOMetricGroup to custom Partitioner via init Context

2024-05-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-35384: --- Summary: Expose TaskIOMetricGroup to custom Partitioner via init Context (was: Expose TaskI

[jira] [Commented] (FLINK-20575) flink application failed to restore from check-point

2020-12-11 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248056#comment-17248056 ] Steven Zhen Wu commented on FLINK-20575: Just from personal experience. Because

[jira] [Created] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

2020-11-02 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-19934: -- Summary: [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable) Key: FLINK-19934 URL: https://issues.apache.org/jira/browse/FLINK-19934 Project: F

[jira] [Updated] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

2020-11-02 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19934: --- Description: Here is the motivation use case. We are implementing event-time alignment acro

[jira] [Commented] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

2020-11-03 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225572#comment-17225572 ] Steven Zhen Wu commented on FLINK-19934: [~sewen] we thought about that. the dif

[jira] [Comment Edited] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

2020-11-03 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225572#comment-17225572 ] Steven Zhen Wu edited comment on FLINK-19934 at 11/3/20, 5:43 PM:

[jira] [Comment Edited] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

2020-11-03 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225572#comment-17225572 ] Steven Zhen Wu edited comment on FLINK-19934 at 11/3/20, 5:46 PM:

[jira] [Commented] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

2020-11-04 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226460#comment-17226460 ] Steven Zhen Wu commented on FLINK-19816: This happened again for the same job in

[jira] [Comment Edited] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

2020-11-04 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226460#comment-17226460 ] Steven Zhen Wu edited comment on FLINK-19816 at 11/5/20, 3:53 AM:

[jira] [Comment Edited] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

2020-11-04 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226460#comment-17226460 ] Steven Zhen Wu edited comment on FLINK-19816 at 11/5/20, 6:10 AM:

[jira] [Commented] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

2020-11-05 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226740#comment-17226740 ] Steven Zhen Wu commented on FLINK-19816: [~trohrmann] thanks a lot for taking a

[jira] [Updated] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.runInCoordinatorThread(Runnable)

2020-11-06 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19934: --- Summary: [FLIP-27 source] add new API: SplitEnumeratorContext.runInCoordinatorThread(Runnabl

[jira] [Commented] (FLINK-19802) Let BulkFormat createReader and restoreReader methods accept Splits directly

2020-11-06 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227644#comment-17227644 ] Steven Zhen Wu commented on FLINK-19802: [~sewen][~lzljs3620320] to make the `Bu

[jira] [Commented] (FLINK-19802) Let BulkFormat createReader and restoreReader methods accept Splits directly

2020-11-08 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17228338#comment-17228338 ] Steven Zhen Wu commented on FLINK-19802: [~sewen] sorry, I didn't mean that we n

[jira] [Created] (FLINK-20174) Make BulkFormat more extensible

2020-11-16 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-20174: -- Summary: Make BulkFormat more extensible Key: FLINK-20174 URL: https://issues.apache.org/jira/browse/FLINK-20174 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-20174) Make BulkFormat more extensible

2020-11-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-20174: --- Description: Right now, BulkFormat has the generic `SpitT` type extending from `FileSourceS

[jira] [Updated] (FLINK-20174) Make BulkFormat more extensible

2020-11-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-20174: --- Description: Right now, BulkFormat has the generic `SpitT` type extending from `FileSourceS

[jira] [Commented] (FLINK-20174) Make BulkFormat more extensible

2020-11-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233260#comment-17233260 ] Steven Zhen Wu commented on FLINK-20174: [~lzljs3620320] thanks a lot for sharin

[jira] [Comment Edited] (FLINK-20174) Make BulkFormat more extensible

2020-11-16 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233260#comment-17233260 ] Steven Zhen Wu edited comment on FLINK-20174 at 11/17/20, 5:20 AM: ---

[jira] [Commented] (FLINK-20174) Make BulkFormat more extensible

2020-11-17 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233755#comment-17233755 ] Steven Zhen Wu commented on FLINK-20174: I tried the change of setting up InputF

[jira] [Comment Edited] (FLINK-20174) Make BulkFormat more extensible

2020-11-17 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233755#comment-17233755 ] Steven Zhen Wu edited comment on FLINK-20174 at 11/17/20, 5:23 PM: ---

[jira] [Commented] (FLINK-20114) Test Kafka Source based on the new Source API 

2020-11-17 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233762#comment-17233762 ] Steven Zhen Wu commented on FLINK-20114: [~rmetzger] sorry. it might be difficul

[jira] [Commented] (FLINK-20390) Programmatic access to the back-pressure

2020-11-27 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239806#comment-17239806 ] Steven Zhen Wu commented on FLINK-20390: not sure what is the input/source. If i

[jira] [Commented] (FLINK-14316) stuck in "Job leader ... lost leadership" error

2020-03-31 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072298#comment-17072298 ] Steven Zhen Wu commented on FLINK-14316: [~trohrmann] thanks a lot for the follo

[jira] [Commented] (FLINK-19016) Checksum mismatch when restore from RocksDB

2020-09-17 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197779#comment-17197779 ] Steven Zhen Wu commented on FLINK-19016: We have seen a similar problem when the

[jira] [Commented] (FLINK-19016) Checksum mismatch when restore from RocksDB

2020-09-21 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199720#comment-17199720 ] Steven Zhen Wu commented on FLINK-19016: [~sewen] we didn't dig deeper and we do

[jira] [Created] (FLINK-19401) Job stuck in restart loop due to "Could not find registered job manager"

2020-09-24 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-19401: -- Summary: Job stuck in restart loop due to "Could not find registered job manager" Key: FLINK-19401 URL: https://issues.apache.org/jira/browse/FLINK-19401 Project:

[jira] [Updated] (FLINK-19401) Job stuck in restart loop due to "Could not find registered job manager"

2020-09-24 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19401: --- Description: Flink job sometimes got into a restart loop for many hours and can't recover u

[jira] [Commented] (FLINK-20174) Make BulkFormat more extensible

2021-01-18 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267590#comment-17267590 ] Steven Zhen Wu commented on FLINK-20174: [~sewen] [~lzljs3620320] Can you take a

[jira] [Comment Edited] (FLINK-20174) Make BulkFormat more extensible

2021-01-19 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267590#comment-17267590 ] Steven Zhen Wu edited comment on FLINK-20174 at 1/19/21, 6:59 PM:

[jira] [Commented] (FLINK-17571) A better way to show the files used in currently checkpoints

2020-05-09 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103518#comment-17103518 ] Steven Zhen Wu commented on FLINK-17571: [~pnowojski] what is the usage of the r

[jira] [Comment Edited] (FLINK-17571) A better way to show the files used in currently checkpoints

2020-05-09 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103518#comment-17103518 ] Steven Zhen Wu edited comment on FLINK-17571 at 5/9/20, 10:59 PM:

[jira] [Commented] (FLINK-19401) Job stuck in restart loop due to "Could not find registered job manager"

2020-09-28 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203298#comment-17203298 ] Steven Zhen Wu commented on FLINK-19401: [~trohrmann] emailed you the JM logs wi

[jira] [Comment Edited] (FLINK-19401) Job stuck in restart loop due to "Could not find registered job manager"

2020-09-28 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203298#comment-17203298 ] Steven Zhen Wu edited comment on FLINK-19401 at 9/29/20, 12:25 AM: ---

[jira] [Commented] (FLINK-19401) Job stuck in restart loop due to excessive checkpoint recoveries which block the JobMaster

2020-09-29 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204031#comment-17204031 ] Steven Zhen Wu commented on FLINK-19401: [~trohrmann] thanks a lot for looking i

[jira] [Commented] (FLINK-19401) Job stuck in restart loop due to excessive checkpoint recoveries which block the JobMaster

2020-09-30 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204732#comment-17204732 ] Steven Zhen Wu commented on FLINK-19401: [~trohrmann] just to clarify, do you me

[jira] [Commented] (FLINK-19401) Job stuck in restart loop due to excessive checkpoint recoveries which block the JobMaster

2020-10-05 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17208437#comment-17208437 ] Steven Zhen Wu commented on FLINK-19401: [~roman_khachatryan] I don't know if re

[jira] [Comment Edited] (FLINK-19401) Job stuck in restart loop due to excessive checkpoint recoveries which block the JobMaster

2020-10-05 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17208437#comment-17208437 ] Steven Zhen Wu edited comment on FLINK-19401 at 10/6/20, 12:42 AM: ---

[jira] [Created] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

2021-02-11 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-21364: -- Summary: piggyback finishedSplitIds in RequestSplitEvent Key: FLINK-21364 URL: https://issues.apache.org/jira/browse/FLINK-21364 Project: Flink Issue Typ

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

2021-02-11 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283152#comment-17283152 ] Steven Zhen Wu commented on FLINK-21364: cc [~sewen] [~jqin] [~thomasWeise] > p

[jira] [Updated] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

2021-02-11 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-21364: --- Description: For some split assignment strategy, the enumerator/assigner needs to track the

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

2021-02-12 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284024#comment-17284024 ] Steven Zhen Wu commented on FLINK-21364: For pull based source (like file/Iceber

[jira] [Comment Edited] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

2021-02-12 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284024#comment-17284024 ] Steven Zhen Wu edited comment on FLINK-21364 at 2/12/21, 10:57 PM: ---

[jira] [Created] (FLINK-8042) retry individual failover-strategy for some time first before reverting to full job restart

2017-11-09 Thread Steven Zhen Wu (JIRA)
Steven Zhen Wu created FLINK-8042: - Summary: retry individual failover-strategy for some time first before reverting to full job restart Key: FLINK-8042 URL: https://issues.apache.org/jira/browse/FLINK-8042

[jira] [Created] (FLINK-8043) increment job restart metric when fine grained recovery reverted to full job restart

2017-11-09 Thread Steven Zhen Wu (JIRA)
Steven Zhen Wu created FLINK-8043: - Summary: increment job restart metric when fine grained recovery reverted to full job restart Key: FLINK-8043 URL: https://issues.apache.org/jira/browse/FLINK-8043

[jira] [Reopened] (FLINK-9693) Possible memory leak in jobmanager retaining archived checkpoints

2018-07-25 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu reopened FLINK-9693: --- Till, I cherry picked your fix for 1.4 branch. we are still seeing the memory leak issue. will a

[jira] [Updated] (FLINK-9693) Possible memory leak in jobmanager retaining archived checkpoints

2018-07-25 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-9693: -- Attachment: 20180725_jm_mem_leak.png > Possible memory leak in jobmanager retaining archived ch

[jira] [Commented] (FLINK-9693) Possible memory leak in jobmanager retaining archived checkpoints

2018-07-25 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16556325#comment-16556325 ] Steven Zhen Wu commented on FLINK-9693: --- One more observation. we are seeing this i

[jira] [Comment Edited] (FLINK-9693) Possible memory leak in jobmanager retaining archived checkpoints

2018-07-25 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16556325#comment-16556325 ] Steven Zhen Wu edited comment on FLINK-9693 at 7/25/18 9:56 PM: ---

[jira] [Comment Edited] (FLINK-9693) Possible memory leak in jobmanager retaining archived checkpoints

2018-07-25 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16556325#comment-16556325 ] Steven Zhen Wu edited comment on FLINK-9693 at 7/25/18 11:23 PM: --

[jira] [Comment Edited] (FLINK-9693) Possible memory leak in jobmanager retaining archived checkpoints

2018-07-25 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16556325#comment-16556325 ] Steven Zhen Wu edited comment on FLINK-9693 at 7/26/18 5:15 AM: ---

[jira] [Comment Edited] (FLINK-9693) Possible memory leak in jobmanager retaining archived checkpoints

2018-07-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16556325#comment-16556325 ] Steven Zhen Wu edited comment on FLINK-9693 at 7/27/18 12:57 AM: --

[jira] [Updated] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-7143: -- Description: while deploying Flink 1.3 release to hundreds of routing jobs, we found some issue

[jira] [Updated] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-7143: -- Description: while deploying Flink 1.3 release to hundreds of routing jobs, we found some issue

[jira] [Created] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
Steven Zhen Wu created FLINK-7143: - Summary: Partition assignment for Kafka consumer is not stable Key: FLINK-7143 URL: https://issues.apache.org/jira/browse/FLINK-7143 Project: Flink Issue T

[jira] [Updated] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-7143: -- Description: while deploying Flink 1.3 release to hundreds of routing jobs, we found some issue

[jira] [Updated] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-7143: -- Description: while deploying Flink 1.3 release to hundreds of routing jobs, we found some issue

[jira] [Updated] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-7143: -- Description: while deploying Flink 1.3 release to hundreds of routing jobs, we found some issue

[jira] [Updated] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-7143: -- Description: while deploying Flink 1.3 release to hundreds of routing jobs, we found some issue

[jira] [Updated] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-7143: -- Description: while deploying Flink 1.3 release to hundreds of routing jobs, we found some issue

[jira] [Updated] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-7143: -- Description: while deploying Flink 1.3 release to hundreds of routing jobs, we found some issue

[jira] [Commented] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081420#comment-16081420 ] Steven Zhen Wu commented on FLINK-7143: --- regarding test coverage, we need a test tha

[jira] [Comment Edited] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081420#comment-16081420 ] Steven Zhen Wu edited comment on FLINK-7143 at 7/11/17 4:51 AM:

[jira] [Commented] (FLINK-7143) Partition assignment for Kafka consumer is not stable

2017-07-10 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081665#comment-16081665 ] Steven Zhen Wu commented on FLINK-7143: --- I see. change is for support of multiple to

  1   2   3   >