[jira] [Commented] (FLINK-32480) Keyed State always returns new value instance

2023-08-14 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754403#comment-17754403 ] Kezhu Wang commented on FLINK-32480: Flink never provide such a guarantee. The "Expected behavior"

[jira] [Commented] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2022-03-09 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503954#comment-17503954 ] Kezhu Wang commented on FLINK-21564: [~pedrosbs] [~renqs] I think it has been fixed in

[jira] [Updated] (FLINK-12491) Incorrect documentation for directory path separators of CoreOptions.TMP_DIRS

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-12491: --- Fix Version/s: 1.14.0 > Incorrect documentation for directory path separators of

[jira] [Updated] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-21564: --- Fix Version/s: 1.14.0 > CommonTestUtils.waitUntilCondition could fail with condition meets before >

[jira] [Updated] (FLINK-12491) Incorrect documentation for directory path separators of CoreOptions.TMP_DIRS

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-12491: --- Labels: pull-request-available (was: pull-request-available stale-assigned) > Incorrect

[jira] [Updated] (FLINK-11409) Make `ProcessFunction`, `ProcessWindowFunction` and etc. pure interfaces

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-11409: --- Fix Version/s: 2.0.0 > Make `ProcessFunction`, `ProcessWindowFunction` and etc. pure interfaces >

[jira] [Commented] (FLINK-12491) Incorrect documentation for directory path separators of CoreOptions.TMP_DIRS

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329916#comment-17329916 ] Kezhu Wang commented on FLINK-12491: I guess it is still valid. > Incorrect documentation for

[jira] [Updated] (FLINK-21317) Downstream keyed state not work after FlinkKafkaShuffle

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-21317: --- Fix Version/s: 1.13.1 1.14.0 > Downstream keyed state not work after

[jira] [Commented] (FLINK-21317) Downstream keyed state not work after FlinkKafkaShuffle

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329911#comment-17329911 ] Kezhu Wang commented on FLINK-21317: [~flink-jira-bot] Still valid. I will update fixVersion to gain

[jira] [Commented] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329910#comment-17329910 ] Kezhu Wang commented on FLINK-21578: Still valid. I will update fix version to 1.14 to gain

[jira] [Updated] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-21578: --- Fix Version/s: 1.14.0 > Closeable Sink Committer/GlobalCommitter were created to function in

[jira] [Updated] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-21578: --- Labels: (was: stale-major) > Closeable Sink Committer/GlobalCommitter were created to function in

[jira] [Updated] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-04-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-21564: --- Labels: pull-request-available (was: pull-request-available stale-assigned) >

[jira] [Updated] (FLINK-22345) CoordinatorEventsExactlyOnceITCase hangs on azure

2021-04-21 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-22345: --- Attachment: (was: image.png) > CoordinatorEventsExactlyOnceITCase hangs on azure >

[jira] [Updated] (FLINK-22345) CoordinatorEventsExactlyOnceITCase hangs on azure

2021-04-21 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-22345: --- Attachment: image.png > CoordinatorEventsExactlyOnceITCase hangs on azure >

[jira] [Commented] (FLINK-21996) Transient RPC failure without TaskManager failure can lead to split assignment loss

2021-04-12 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319367#comment-17319367 ] Kezhu Wang commented on FLINK-21996: bq. We cannot trigger checkpoints while we are "in limbo"

[jira] [Commented] (FLINK-21996) Transient RPC failure without TaskManager failure can lead to split assignment loss

2021-04-12 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319358#comment-17319358 ] Kezhu Wang commented on FLINK-21996: [~sewen] Taking no source tasks into account, these guarantees

[jira] [Commented] (FLINK-18071) CoordinatorEventsExactlyOnceITCase.checkListContainsSequence fails on CI

2021-04-11 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318962#comment-17318962 ] Kezhu Wang commented on FLINK-18071: Sure, I will take a look at. Thanks for delivery. [~sewen] >

[jira] [Comment Edited] (FLINK-21996) Transient RPC failure without TaskManager failure can lead to split assignment loss

2021-04-10 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318585#comment-17318585 ] Kezhu Wang edited comment on FLINK-21996 at 4/10/21, 8:11 PM: -- Is there any

[jira] [Commented] (FLINK-21996) Transient RPC failure without TaskManager failure can lead to split assignment loss

2021-04-10 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318585#comment-17318585 ] Kezhu Wang commented on FLINK-21996: Is there any design guarantee for no source operator

[jira] [Commented] (FLINK-21386) FromElements ignores returns()

2021-04-07 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316150#comment-17316150 ] Kezhu Wang commented on FLINK-21386: Hi [~dwysakowicz], I could give it a try. > FromElements

[jira] [Commented] (FLINK-18071) CoordinatorEventsExactlyOnceITCase.checkListContainsSequence fails on CI

2021-04-05 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314987#comment-17314987 ] Kezhu Wang commented on FLINK-18071: Hi all, I pushed a  [poc

[jira] [Commented] (FLINK-18071) CoordinatorEventsExactlyOnceITCase.checkListContainsSequence fails on CI

2021-04-02 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314074#comment-17314074 ] Kezhu Wang commented on FLINK-18071: Hi all, I dug and thought some time about this. I want to share

[jira] [Created] (FLINK-22108) Ephemeral socket address was checkpointed to state and restored back in CollectSinkOperatorCoordinator

2021-04-02 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-22108: -- Summary: Ephemeral socket address was checkpointed to state and restored back in CollectSinkOperatorCoordinator Key: FLINK-22108 URL:

[jira] [Commented] (FLINK-21990) SourceStreamTask will always hang if the CheckpointedFunction#snapshotState throws an exception.

2021-03-28 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310387#comment-17310387 ] Kezhu Wang commented on FLINK-21990: A {{disableChaining}} in between failed source and downstream

[jira] [Commented] (FLINK-21990) SourceStreamTask will always hang if the CheckpointedFunction#snapshotState throws an exception.

2021-03-28 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310372#comment-17310372 ] Kezhu Wang commented on FLINK-21990: Ideally, this should be fixed in

[jira] [Commented] (FLINK-21821) Clean up Task/StreamTask cancellation and remove unnecessary concurrency

2021-03-24 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307891#comment-17307891 ] Kezhu Wang commented on FLINK-21821: Good catch [~pnowojski]. But this would also risk to whole task

[jira] [Commented] (FLINK-20329) Elasticsearch7DynamicSinkITCase hangs

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307580#comment-17307580 ] Kezhu Wang commented on FLINK-20329: Another case: 

[jira] [Closed] (FLINK-21821) Clean up Task/StreamTask cancellation and remove unnecessary concurrency

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang closed FLINK-21821. -- Resolution: Not A Problem > Clean up Task/StreamTask cancellation and remove unnecessary concurrency

[jira] [Commented] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307117#comment-17307117 ] Kezhu Wang commented on FLINK-21578: bq. Make createCommitter return non-optional object and by

[jira] [Commented] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307116#comment-17307116 ] Kezhu Wang commented on FLINK-21133: [~sewen] [~becket_qin] Good news! > FLIP-27 Source does not

[jira] [Commented] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307100#comment-17307100 ] Kezhu Wang commented on FLINK-21133: [~trohrmann] [~pnowojski] [~becket_qin] [~sewen] Hi all, should

[jira] [Commented] (FLINK-21386) FromElements ignores returns()

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307087#comment-17307087 ] Kezhu Wang commented on FLINK-21386: Hi [~chesnay] could I take over this ? > FromElements ignores

[jira] [Commented] (FLINK-21317) Downstream keyed state not work after FlinkKafkaShuffle

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307086#comment-17307086 ] Kezhu Wang commented on FLINK-21317: Hi [~ym] [~pnowojski], anyone is working on this ? 1.13 is 

[jira] [Commented] (FLINK-21817) New Kafka Source might break subtask and split assignment upon rescale

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307079#comment-17307079 ] Kezhu Wang commented on FLINK-21817: +1 for gradual procedure. {quote} But we may even skip this for

[jira] [Commented] (FLINK-21821) Clean up Task/StreamTask cancellation and remove unnecessary concurrency

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307050#comment-17307050 ] Kezhu Wang commented on FLINK-21821: I am going to close this ticket as there is no more concern

[jira] [Commented] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307040#comment-17307040 ] Kezhu Wang commented on FLINK-21467: I also think it is part of FLIP-147 [~pnowojski]. I believed

[jira] [Commented] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306896#comment-17306896 ] Kezhu Wang commented on FLINK-21564: A small improvement is still a good. I will open a pr in days.

[jira] [Commented] (FLINK-21626) Consider shaping newly introduced RuntimeContext.getJobId to return JobID with no Optional wrapper

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306807#comment-17306807 ] Kezhu Wang commented on FLINK-21626: [~roman_khachatryan] Thanks, I will. > Consider shaping newly

[jira] [Commented] (FLINK-21817) New Kafka Source might break subtask and split assignment upon rescale

2021-03-23 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306805#comment-17306805 ] Kezhu Wang commented on FLINK-21817: I guess we four are probably talking about two inconsistencies:

[jira] [Commented] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-03-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306227#comment-17306227 ] Kezhu Wang commented on FLINK-21467: Hi  [~pnowojski], here are my imaginative paths: 1. An

[jira] [Comment Edited] (FLINK-21821) Clean up Task/StreamTask cancellation and remove unnecessary concurrency

2021-03-21 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305690#comment-17305690 ] Kezhu Wang edited comment on FLINK-21821 at 3/21/21, 2:42 PM: -- Thanks for

[jira] [Commented] (FLINK-21821) Clean up Task/StreamTask cancellation and remove unnecessary concurrency

2021-03-21 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305690#comment-17305690 ] Kezhu Wang commented on FLINK-21821: Thanks for more context [~pnowojski]. After close look to

[jira] [Commented] (FLINK-21798) Guard MemorySegment against multiple frees.

2021-03-16 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303080#comment-17303080 ] Kezhu Wang commented on FLINK-21798: [~xintongsong] You are right. It is always a good to catch

[jira] [Commented] (FLINK-21798) Guard MemorySegment against multiple frees.

2021-03-16 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303047#comment-17303047 ] Kezhu Wang commented on FLINK-21798: Inspired by

[jira] [Commented] (FLINK-21728) DegreesWithExceptionITCase crash

2021-03-16 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302745#comment-17302745 ] Kezhu Wang commented on FLINK-21728: [~dwysakowicz] [~pnowojski] Good catch! But I also think it

[jira] [Created] (FLINK-21821) StreamTask.cancelables was closed concurrent between task canceler and task thread

2021-03-16 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21821: -- Summary: StreamTask.cancelables was closed concurrent between task canceler and task thread Key: FLINK-21821 URL: https://issues.apache.org/jira/browse/FLINK-21821

[jira] [Commented] (FLINK-21728) DegreesWithExceptionITCase crash

2021-03-16 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302442#comment-17302442 ] Kezhu Wang commented on FLINK-21728: I guess so. There are actually two cases: 1. Concurrency

[jira] [Created] (FLINK-21817) FLIP-27 Source might break subtask and split assignment upon rescale

2021-03-16 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21817: -- Summary: FLIP-27 Source might break subtask and split assignment upon rescale Key: FLINK-21817 URL: https://issues.apache.org/jira/browse/FLINK-21817 Project: Flink

[jira] [Created] (FLINK-21806) ContinuousEventTimeTrigger should register its first timer base on current watermark

2021-03-15 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21806: -- Summary: ContinuousEventTimeTrigger should register its first timer base on current watermark Key: FLINK-21806 URL: https://issues.apache.org/jira/browse/FLINK-21806

[jira] [Commented] (FLINK-11408) ContinuousProcessingTimeTrigger: NPE on clear() and state is lost on merge

2021-03-15 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302181#comment-17302181 ] Kezhu Wang commented on FLINK-11408: I think it is same as FLINK-5717 and similar to event time

[jira] [Commented] (FLINK-21728) DegreesWithExceptionITCase crash

2021-03-15 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301856#comment-17301856 ] Kezhu Wang commented on FLINK-21728: [~dwysakowicz] You are right. That is not possible. Besides

[jira] [Commented] (FLINK-21753) Cycle references between memory manager and gc cleaner action

2021-03-15 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301506#comment-17301506 ] Kezhu Wang commented on FLINK-21753: [~nicholasjiang] Only that two branches need this, not master.

[jira] [Commented] (FLINK-21419) Remove GC cleaner mechanism for unsafe memory segments

2021-03-15 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301504#comment-17301504 ] Kezhu Wang commented on FLINK-21419: [~xintongsong] Thanks for the backgrounds and explanation. With

[jira] [Commented] (FLINK-21419) Remove GC cleaner mechanism for unsafe memory segments

2021-03-15 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301408#comment-17301408 ] Kezhu Wang commented on FLINK-21419: Glad to see, we all lean to fail concurrent free by default, at

[jira] [Commented] (FLINK-21753) Cycle references between memory manager and gc cleaner action

2021-03-14 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301395#comment-17301395 ] Kezhu Wang commented on FLINK-21753: HI [~xintongsong], I am interesting in fix for 1.12/1.11

[jira] [Commented] (FLINK-21728) DegreesWithExceptionITCase crash

2021-03-14 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301166#comment-17301166 ] Kezhu Wang commented on FLINK-21728: After hundred rounds in my local environment, I run into

[jira] [Commented] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-03-13 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301066#comment-17301066 ] Kezhu Wang commented on FLINK-21467: Hi [~pnowojski], I guess it depends on various subtleties: #

[jira] [Updated] (FLINK-21626) Consider shaping newly introduced RuntimeContext.getJobId to return JobID with no Optional wrapper

2021-03-13 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kezhu Wang updated FLINK-21626: --- Fix Version/s: 1.13.0 > Consider shaping newly introduced RuntimeContext.getJobId to return JobID

[jira] [Commented] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-03-13 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300887#comment-17300887 ] Kezhu Wang commented on FLINK-21578: [~gaoyunhaii] Not exactly. The problem is interference between

[jira] [Commented] (FLINK-21753) Cycle references between memory manager and gc cleaner action

2021-03-13 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300846#comment-17300846 ] Kezhu Wang commented on FLINK-21753: It is a good direction, master does not have this since

[jira] [Created] (FLINK-21753) Cycle references between memory manager and gc cleaner action

2021-03-12 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21753: -- Summary: Cycle references between memory manager and gc cleaner action Key: FLINK-21753 URL: https://issues.apache.org/jira/browse/FLINK-21753 Project: Flink

[jira] [Commented] (FLINK-21419) Remove GC cleaner mechanism for unsafe memory segments

2021-03-12 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300222#comment-17300222 ] Kezhu Wang commented on FLINK-21419: # detecting concurrent frees: To detect and guard concurrent

[jira] [Commented] (FLINK-21419) Remove GC cleaner mechanism for unsafe memory segments

2021-03-12 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300149#comment-17300149 ] Kezhu Wang commented on FLINK-21419: >From all my experiences, native resources should always be

[jira] [Commented] (FLINK-21419) Remove GC cleaner mechanism for unsafe memory segments

2021-03-12 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300138#comment-17300138 ] Kezhu Wang commented on FLINK-21419: Hi [~xintongsong] & [~nicholasjiang], I think the cause of

[jira] [Commented] (FLINK-21419) Remove GC cleaner mechanism for unsafe memory segments

2021-03-11 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299989#comment-17299989 ] Kezhu Wang commented on FLINK-21419: Coming from FLINK-21728, given the severity of native memory

[jira] [Commented] (FLINK-21728) DegreesWithExceptionITCase crash

2021-03-11 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299749#comment-17299749 ] Kezhu Wang commented on FLINK-21728: [~dwysakowicz] Installing {{openjdk-8-dbg}} gives one more

[jira] [Commented] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-03-10 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299284#comment-17299284 ] Kezhu Wang commented on FLINK-21578: Hi [~gaoyunhaii], in current situation there is no where in api

[jira] [Commented] (FLINK-21317) Downstream keyed state not work after FlinkKafkaShuffle

2021-03-10 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298744#comment-17298744 ] Kezhu Wang commented on FLINK-21317: Hi [~ym], you are right,

[jira] [Commented] (FLINK-21635) Driver name is optional for DriverManager.getConnection but a must in JdbcConnectionOptions

2021-03-05 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296011#comment-17296011 ] Kezhu Wang commented on FLINK-21635: I think we could go through `Nullable` first to make

[jira] [Commented] (FLINK-21635) Driver name is optional for DriverManager.getConnection but a must in JdbcConnectionOptions

2021-03-05 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295979#comment-17295979 ] Kezhu Wang commented on FLINK-21635: [~jark] Thank you for inspiration. I thought a bit and try to

[jira] [Created] (FLINK-21635) Driver name is optional for DriverManager.getConnection but a must in JdbcConnectionOptions

2021-03-05 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21635: -- Summary: Driver name is optional for DriverManager.getConnection but a must in JdbcConnectionOptions Key: FLINK-21635 URL: https://issues.apache.org/jira/browse/FLINK-21635

[jira] [Created] (FLINK-21626) Consider shaping newly introduced RuntimeContext.getJobId to return JobID with no Optional wrapper

2021-03-04 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21626: -- Summary: Consider shaping newly introduced RuntimeContext.getJobId to return JobID with no Optional wrapper Key: FLINK-21626 URL: https://issues.apache.org/jira/browse/FLINK-21626

[jira] [Commented] (FLINK-21522) Iterative stream could not work with stop-with-savepoint

2021-03-04 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295736#comment-17295736 ] Kezhu Wang commented on FLINK-21522: Hi for all watchers and subscribers, the reported case is not

[jira] [Commented] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-03-03 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295040#comment-17295040 ] Kezhu Wang commented on FLINK-21564: [~nicholasjiang] Not about simplification, but guarantee to

[jira] [Commented] (FLINK-21581) Add PublicEvolving to RuntimeContext.jobId

2021-03-03 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294977#comment-17294977 ] Kezhu Wang commented on FLINK-21581: [~roman_khachatryan] [~chesnay] Sorry for boring and 

[jira] [Commented] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-03-03 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294959#comment-17294959 ] Kezhu Wang commented on FLINK-21564: [~nicholasjiang] I guess the procedure you draw will fail in

[jira] [Commented] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-03-03 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294510#comment-17294510 ] Kezhu Wang commented on FLINK-21564: Hi [~nicholasjiang], I would prefer following due to possible

[jira] [Created] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-03-02 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21578: -- Summary: Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition Key: FLINK-21578 URL:

[jira] [Commented] (FLINK-17510) StreamingKafkaITCase. testKafka timeouts on downloading Kafka

2021-03-02 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294216#comment-17294216 ] Kezhu Wang commented on FLINK-17510:

[jira] [Created] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-03-02 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21564: -- Summary: CommonTestUtils.waitUntilCondition could fail with condition meets before Key: FLINK-21564 URL: https://issues.apache.org/jira/browse/FLINK-21564 Project: Flink

[jira] [Commented] (FLINK-21386) FromElements ignores returns()

2021-03-01 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292839#comment-17292839 ] Kezhu Wang commented on FLINK-21386: [~chesnay] It works for function also, I have verified that.

[jira] [Commented] (FLINK-21386) FromElements ignores returns()

2021-03-01 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292765#comment-17292765 ] Kezhu Wang commented on FLINK-21386:  [~chesnay] Combination of #1 and #3 could solve this. In

[jira] [Commented] (FLINK-21025) SQLClientHBaseITCase fails when untarring HBase

2021-02-28 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292359#comment-17292359 ] Kezhu Wang commented on FLINK-21025: Another instance

[jira] [Created] (FLINK-21522) Iterative stream could not work with stop-with-savepoint

2021-02-28 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21522: -- Summary: Iterative stream could not work with stop-with-savepoint Key: FLINK-21522 URL: https://issues.apache.org/jira/browse/FLINK-21522 Project: Flink Issue

[jira] [Commented] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-02-27 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292316#comment-17292316 ] Kezhu Wang commented on FLINK-21467: Hi [~pnowojski], I think the "non deterministic logic" could

[jira] [Commented] (FLINK-21386) FromElements ignores returns()

2021-02-27 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292152#comment-17292152 ] Kezhu Wang commented on FLINK-21386: I think implementing {{OutputTypeConfigurable}} for

[jira] [Commented] (FLINK-20658) Make sure jdbc connection is established by target driver

2021-02-26 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291751#comment-17291751 ] Kezhu Wang commented on FLINK-20658: [~jark] Sorry for so late response. I confirmed my previous

[jira] [Commented] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-02-25 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290781#comment-17290781 ] Kezhu Wang commented on FLINK-21467: Hi [~pnowojski], I see the possibility. But I think there is

[jira] [Created] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-02-23 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21467: -- Summary: Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times Key: FLINK-21467 URL:

[jira] [Commented] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-02-22 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288477#comment-17288477 ] Kezhu Wang commented on FLINK-21133: [~trohrmann] Great summarization! About user-case#2, we may

[jira] [Commented] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-02-20 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287735#comment-17287735 ] Kezhu Wang commented on FLINK-21133: [~becket_qin] [~pnowojski] [~sewen] Thanks all for recently

[jira] [Comment Edited] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-02-16 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285319#comment-17285319 ] Kezhu Wang edited comment on FLINK-21133 at 2/16/21, 4:21 PM: -- {quote}But

[jira] [Commented] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-02-16 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285319#comment-17285319 ] Kezhu Wang commented on FLINK-21133: {quote}But this assumption doesn't hold with the legacy

[jira] [Commented] (FLINK-21317) Downstream keyed state not work after FlinkKafkaShuffle

2021-02-16 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285250#comment-17285250 ] Kezhu Wang commented on FLINK-21317: [~pnowojski] Yeh, I could prepare a fix if my proposed

[jira] [Commented] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-02-16 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285207#comment-17285207 ] Kezhu Wang commented on FLINK-21133: {quote}I think what stop-with-savepoint should really do is

[jira] [Commented] (FLINK-21214) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint Failed

2021-02-13 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284169#comment-17284169 ] Kezhu Wang commented on FLINK-21214: Another instance:

[jira] [Commented] (FLINK-20580) Missing null value handling for SerializedValue's getByteArray()

2021-02-12 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283726#comment-17283726 ] Kezhu Wang commented on FLINK-20580: {quote} If we want to support null values, then returning an

[jira] [Commented] (FLINK-20580) Missing null value handling for SerializedValue's getByteArray()

2021-02-12 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283680#comment-17283680 ] Kezhu Wang commented on FLINK-20580: I am kind of prefer third option. If we allow nullable value

[jira] [Commented] (FLINK-20580) Missing null value handling for SerializedValue's getByteArray()

2021-02-12 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283659#comment-17283659 ] Kezhu Wang commented on FLINK-20580: Hi [~trohrmann], after digging a bit, I think we had third

  1   2   >