[jira] [Resolved] (FLINK-33733) [FLIP-321] Update the stability docs to add the migration periods.

2023-12-15 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-33733. -- Fix Version/s: 1.19.0 Resolution: Fixed > [FLIP-321] Update the stability docs to add

[jira] [Commented] (FLINK-33733) [FLIP-321] Update the stability docs to add the migration periods.

2023-12-15 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17797081#comment-17797081 ] Jiangjie Qin commented on FLINK-33733: -- Just realized that I forgot to make the PR title start with

[jira] [Assigned] (FLINK-33733) [FLIP-321] Update the stability docs to add the migration periods.

2023-12-03 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-33733: Assignee: Jiangjie Qin > [FLIP-321] Update the stability docs to add the migration

[jira] [Created] (FLINK-33733) [FLIP-321] Update the stability docs to add the migration periods.

2023-12-03 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-33733: Summary: [FLIP-321] Update the stability docs to add the migration periods. Key: FLINK-33733 URL: https://issues.apache.org/jira/browse/FLINK-33733 Project: Flink

[jira] [Resolved] (FLINK-20767) [FLIP-356] Add nested field support for SupportsFilterPushDown

2023-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-20767. -- Fix Version/s: 1.19.0 Resolution: Implemented PR is merged to master:

[jira] [Commented] (FLINK-32398) Support Avro SpecificRecord in DataStream and Table conversion.

2023-06-20 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735328#comment-17735328 ] Jiangjie Qin commented on FLINK-32398: -- [~twalthr] [~jark] If this already works and I missed

[jira] [Created] (FLINK-32398) Support Avro SpecificRecord in DataStream and Table conversion.

2023-06-20 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-32398: Summary: Support Avro SpecificRecord in DataStream and Table conversion. Key: FLINK-32398 URL: https://issues.apache.org/jira/browse/FLINK-32398 Project: Flink

[jira] [Updated] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-31654: - Description: Currently {{DataStreamUtils.reinterpretAsKeyedStream()}} does not work well with

[jira] [Updated] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-31654: - Fix Version/s: 1.16.2 > DataStreamUtils.reinterpretAsKeyedStream() should not override the user

[jira] [Updated] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-31654: - Fix Version/s: 1.18.0 1.17.1 > DataStreamUtils.reinterpretAsKeyedStream()

[jira] [Assigned] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-31654: Assignee: Jiangjie Qin > DataStreamUtils.reinterpretAsKeyedStream() should not override

[jira] [Created] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-31654: Summary: DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy. Key: FLINK-31654 URL:

[jira] [Commented] (FLINK-31324) Broken SingleThreadFetcherManager constructor API

2023-03-06 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696756#comment-17696756 ] Jiangjie Qin commented on FLINK-31324: -- I think `SingleThreadFetcherManager` is indeed somewhat

[jira] [Commented] (FLINK-30935) Add KafkaSerializer deserialize check when using SimpleVersionedSerializer

2023-02-09 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686336#comment-17686336 ] Jiangjie Qin commented on FLINK-30935: -- Sounds good to me. > Add KafkaSerializer deserialize check

[jira] [Created] (FLINK-30645) [FLIP-286] The scope/stability annotation in AbstractStreamOperator are inconsistent.

2023-01-12 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-30645: Summary: [FLIP-286] The scope/stability annotation in AbstractStreamOperator are inconsistent. Key: FLINK-30645 URL: https://issues.apache.org/jira/browse/FLINK-30645

[jira] [Resolved] (FLINK-30424) Add source operator restore readerState log to distinguish split is from newPartitions or split state

2022-12-16 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-30424. -- Resolution: Fixed Merged to master: 528186b62da92ecde0fa308f1df0cc6f95495f4d > Add source

[jira] [Updated] (FLINK-30424) Add source operator restore readerState log to distinguish split is from newPartitions or split state

2022-12-16 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-30424: - Fix Version/s: 1.17.0 > Add source operator restore readerState log to distinguish split is

[jira] [Commented] (FLINK-28411) OperatorCoordinator exception may fail Session Cluster

2022-07-05 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562909#comment-17562909 ] Jiangjie Qin commented on FLINK-28411: -- [~martijnvisser] Yes, I think this is a problem. I need to

[jira] [Commented] (FLINK-27554) The asf-site does not build on Apple Silicon

2022-05-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536975#comment-17536975 ] Jiangjie Qin commented on FLINK-27554: -- Thanks for digging into this, [~xtsong]. I think this is a

[jira] [Updated] (FLINK-27554) The asf-site does not build on Apple Silicon

2022-05-09 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-27554: - Description: It looks that the ASF website does not build on my laptop with Apple silicon. It

[jira] [Updated] (FLINK-27554) The asf-site does not build on Apple Silicon

2022-05-09 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-27554: - Description: It looks that the ASF website does not build on my laptop with Apple silicon. It

[jira] [Created] (FLINK-27554) The asf-site does not build on Apple Silicon

2022-05-09 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-27554: Summary: The asf-site does not build on Apple Silicon Key: FLINK-27554 URL: https://issues.apache.org/jira/browse/FLINK-27554 Project: Flink Issue Type:

[jira] [Closed] (FLINK-27295) UnalignedCheckpointITCase failed due to OperatorCoordinatorHolder cannot mark checkpoint

2022-04-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-27295. Resolution: Duplicate Duplicate of FLINK-27148 > UnalignedCheckpointITCase failed due to

[jira] [Commented] (FLINK-27295) UnalignedCheckpointITCase failed due to OperatorCoordinatorHolder cannot mark checkpoint

2022-04-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524679#comment-17524679 ] Jiangjie Qin commented on FLINK-27295: -- It looks a duplicate of FLINK-27148. >

[jira] [Resolved] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-20 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-26723. -- Fix Version/s: 1.15.0 1.14.4 Resolution: Fixed PR Merged. master: 

[jira] [Assigned] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-26723: Assignee: zoucao > Fix the content of exception in SourceCoordinatorContext >

[jira] [Comment Edited] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508760#comment-17508760 ] Jiangjie Qin edited comment on FLINK-26723 at 3/18/22, 12:51 PM: -

[jira] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723 ] Jiangjie Qin deleted comment on FLINK-26723: -- was (Author: becket_qin): Do you want to submit a patch? > Fix the content of exception in SourceCoordinatorContext >

[jira] [Commented] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508760#comment-17508760 ] Jiangjie Qin commented on FLINK-26723: -- [~zoucao]  yes, we should get the splits from the

[jira] [Commented] (FLINK-26723) Fix the content of exception in SourceCoordinatorContext

2022-03-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508762#comment-17508762 ] Jiangjie Qin commented on FLINK-26723: -- Do you want to submit a patch? > Fix the content of

[jira] [Commented] (FLINK-26394) CheckpointCoordinator.isTriggering can not be reset if a checkpoint expires while the checkpointCoordinator task is queuing in the SourceCoordinator executor.

2022-03-13 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17505968#comment-17505968 ] Jiangjie Qin commented on FLINK-26394: -- Good catch. We need to recycle the futures that are handled

[jira] [Commented] (FLINK-25256) Savepoints do not work with ExternallyInducedSources

2022-03-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503274#comment-17503274 ] Jiangjie Qin commented on FLINK-25256: -- [~Brian Zhou] I think [~renqs] and [~Leonard] seems the

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

2022-03-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503240#comment-17503240 ] Jiangjie Qin commented on FLINK-21364: -- [~stevenz3wu] Sorry for the late response. I somehow missed

[jira] [Commented] (FLINK-25256) Savepoints do not work with ExternallyInducedSources

2022-03-02 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500468#comment-17500468 ] Jiangjie Qin commented on FLINK-25256: -- [~dwysakowicz] Pravega essentially uses an in-band

[jira] [Resolved] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-23 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-24607. -- Resolution: Fixed > SourceCoordinator may miss to close SplitEnumerator when failover

[jira] [Updated] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-23 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24607: - Fix Version/s: 1.13.7 > SourceCoordinator may miss to close SplitEnumerator when failover

[jira] [Commented] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-23 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497109#comment-17497109 ] Jiangjie Qin commented on FLINK-24607: -- Patch merged. Master: 

[jira] [Updated] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-22 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24607: - Fix Version/s: (was: 1.13.7) > SourceCoordinator may miss to close SplitEnumerator when

[jira] [Commented] (FLINK-24844) CassandraConnectorITCase.testCassandraBatchPojoFormat fails on AZP

2022-02-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492363#comment-17492363 ] Jiangjie Qin commented on FLINK-24844: -- Another failure.

[jira] [Assigned] (FLINK-26029) Generalize the checkpoint protocol of OperatorCoordinator.

2022-02-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-26029: Assignee: Dong Lin > Generalize the checkpoint protocol of OperatorCoordinator. >

[jira] [Commented] (FLINK-24439) Introduce CoordinatorStore

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489279#comment-17489279 ] Jiangjie Qin commented on FLINK-24439: -- [~pnowojski] This effectively introduces a cross-operator

[jira] [Updated] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24607: - Fix Version/s: 1.15.0 1.13.6 1.14.4 > SourceCoordinator

[jira] [Assigned] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-24607: Assignee: Jiangjie Qin > SourceCoordinator may miss to close SplitEnumerator when

[jira] [Commented] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489273#comment-17489273 ] Jiangjie Qin commented on FLINK-24607: -- [~jark] [~dmvk] Sorry I did not notice the attached log

[jira] [Updated] (FLINK-26029) Generalize the checkpoint protocol of OperatorCoordinator.

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-26029: - Labels: extensibility (was: ) > Generalize the checkpoint protocol of OperatorCoordinator. >

[jira] [Updated] (FLINK-26029) Generalize the checkpoint protocol of OperatorCoordinator.

2022-02-08 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-26029: - Fix Version/s: 1.16.0 > Generalize the checkpoint protocol of OperatorCoordinator. >

[jira] [Created] (FLINK-26029) Generalize the checkpoint protocol of OperatorCoordinator.

2022-02-08 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-26029: Summary: Generalize the checkpoint protocol of OperatorCoordinator. Key: FLINK-26029 URL: https://issues.apache.org/jira/browse/FLINK-26029 Project: Flink

[jira] [Commented] (FLINK-24607) SourceCoordinator may miss to close SplitEnumerator when failover frequently

2022-01-12 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475066#comment-17475066 ] Jiangjie Qin commented on FLINK-24607: -- [~dmvk] I am not sure about the exact cause of this issue.

[jira] [Updated] (FLINK-25152) FLIP-188: Introduce Built-in Dynamic Table Storage

2022-01-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-25152: - Fix Version/s: table-store-0.1.0 (was: 1.15.0) > FLIP-188: Introduce

[jira] [Updated] (FLINK-25152) FLIP-188: Introduce Built-in Dynamic Table Storage

2022-01-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-25152: - Component/s: Table Store > FLIP-188: Introduce Built-in Dynamic Table Storage >

[jira] [Assigned] (FLINK-10737) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint failed on Travis

2021-11-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-10737: Assignee: Qingsheng Ren (was: Jiangjie Qin) >

[jira] [Commented] (FLINK-10737) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint failed on Travis

2021-11-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450837#comment-17450837 ] Jiangjie Qin commented on FLINK-10737: -- [~trohrmann] I probably won't be able to look into the

[jira] [Commented] (FLINK-24949) KafkaITCase.testBigRecordJob fails on azure

2021-11-21 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447195#comment-17447195 ] Jiangjie Qin commented on FLINK-24949: -- [~gaoyunhaii] not sure if this is the same cause. [~renqs]

[jira] [Updated] (FLINK-24376) Operator name in OperatorCoordinator should not use chained name

2021-10-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24376: - Fix Version/s: 1.14.1 > Operator name in OperatorCoordinator should not use chained name >

[jira] [Updated] (FLINK-24376) Operator name in OperatorCoordinator should not use chained name

2021-10-11 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-24376: - Affects Version/s: (was: 1.14.1) > Operator name in OperatorCoordinator should not use

[jira] [Resolved] (FLINK-22915) FLIP-173: Support DAG of algorithms

2021-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22915. -- Resolution: Implemented Merged to master: 5ff346ea1a508a00b89759492f09e7330e69baef >

[jira] [Updated] (FLINK-22915) FLIP-173: Support DAG of algorithms

2021-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-22915: - Fix Version/s: 0.1.0 > FLIP-173: Support DAG of algorithms >

[jira] [Assigned] (FLINK-22915) FLIP-173: Support DAG of algorithms

2021-09-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22915: Assignee: Dong Lin > FLIP-173: Support DAG of algorithms >

[jira] [Resolved] (FLINK-24277) Offset commit should be disabled if consumer group ID is not specified in KafkaSource

2021-09-18 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-24277. -- Fix Version/s: 1.13.3 1.12.6 Assignee: Qingsheng Ren

[jira] [Resolved] (FLINK-24059) SourceReaderTestBase should allow NUM_SPLITS to be overridden in implementation

2021-09-15 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-24059. -- Resolution: Fixed Merged to master: d4c483fadd3df32045fbb2ee117d0a6eeab9276e Cherry-picked

[jira] [Resolved] (FLINK-23773) KafkaPartitionSplitReader should remove empty splits from fetcher

2021-09-13 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-23773. -- Resolution: Fixed PR merged to master: fe17ca6042c570ce603bf4308775f61db1d515c9 cherry-picked

[jira] [Resolved] (FLINK-23971) PulsarSourceITCase.testIdleReader failed on azure

2021-09-01 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-23971. -- Resolution: Fixed PR merged to master: ad052cc056c7d6e63d8356dbd22d6a98b54743c3

[jira] [Assigned] (FLINK-24059) SourceReaderTestBase should allow NUM_SPLITS to be overridden in implementation

2021-08-30 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-24059: Assignee: Brian Zhou > SourceReaderTestBase should allow NUM_SPLITS to be overridden in

[jira] [Resolved] (FLINK-23686) KafkaSource metric "commitsSucceeded" should count per-commit instead of per-partition

2021-08-30 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-23686. -- Resolution: Fixed Merged to master / release-1.14: 62931a1665e6a6976d088ed49375f9fdf00229d9

[jira] [Resolved] (FLINK-22702) KafkaSourceITCase.testRedundantParallelism failed

2021-08-26 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22702. -- Resolution: Fixed Merged to master.  83b9ee8a3afd3e3c5512b4a495f97c01c1be11c2 >

[jira] [Commented] (FLINK-22766) Report metrics of KafkaConsumer in Kafka new source

2021-07-12 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379537#comment-17379537 ] Jiangjie Qin commented on FLINK-22766: -- Merged to release-1.13: 

[jira] [Commented] (FLINK-16634) The PartitionDiscoverer in FlinkKafkaConsumer should not use the user provided client.id.

2021-07-07 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377082#comment-17377082 ] Jiangjie Qin commented on FLINK-16634: -- [~liufangliang] Done. > The PartitionDiscoverer in

[jira] [Assigned] (FLINK-16634) The PartitionDiscoverer in FlinkKafkaConsumer should not use the user provided client.id.

2021-07-07 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-16634: Assignee: Fangliang Liu > The PartitionDiscoverer in FlinkKafkaConsumer should not use

[jira] [Resolved] (FLINK-22766) Report metrics of KafkaConsumer in Kafka new source

2021-07-05 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22766. -- Resolution: Fixed Merged to master: b094a932845db5539fc07b032d49d0bcefd15df2 > Report

[jira] [Assigned] (FLINK-22766) Report metrics of KafkaConsumer in Kafka new source

2021-07-05 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22766: Assignee: Qingsheng Ren > Report metrics of KafkaConsumer in Kafka new source >

[jira] [Resolved] (FLINK-22147) Refactor Partition Discovery Logic in KafkaSourceEnumerator

2021-06-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22147. -- Fix Version/s: 1.14.0 Resolution: Implemented Merged to master. 

[jira] [Assigned] (FLINK-22147) Refactor Partition Discovery Logic in KafkaSourceEnumerator

2021-06-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22147: Assignee: Qingsheng Ren > Refactor Partition Discovery Logic in KafkaSourceEnumerator >

[jira] [Assigned] (FLINK-22722) Add Documentation for Kafka New Source

2021-05-31 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22722: Assignee: Qingsheng Ren > Add Documentation for Kafka New Source >

[jira] [Resolved] (FLINK-22722) Add Documentation for Kafka New Source

2021-05-31 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-22722. -- Resolution: Fixed Merged to master:  b582991b8b2b8dadb89e71d5002c4a9cc2055e34 > Add

[jira] [Commented] (FLINK-22133) SplitEmumerator does not provide checkpoint id in snapshot

2021-05-07 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340604#comment-17340604 ] Jiangjie Qin commented on FLINK-22133: -- Thanks for the explanation, Thomas. So here are the pros

[jira] [Commented] (FLINK-22133) SplitEmumerator does not provide checkpoint id in snapshot

2021-05-06 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340493#comment-17340493 ] Jiangjie Qin commented on FLINK-22133: -- [~thw] I think we only plan to backport some backwards

[jira] [Commented] (FLINK-20114) Test Kafka Source based on the new Source API 

2021-04-29 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335209#comment-17335209 ] Jiangjie Qin commented on FLINK-20114: -- [~trohrmann] Sorry for the confusion. The ticket was left

[jira] [Closed] (FLINK-11681) Add an AbstractMetric to combine the metric definition and metric management.

2021-04-28 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-11681. Resolution: Abandoned After some discussion, we have not reached consensus on whether this is

[jira] [Commented] (FLINK-10806) Support multiple consuming offsets when discovering a new topic

2021-04-28 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335079#comment-17335079 ] Jiangjie Qin commented on FLINK-10806: -- After FLIP-27, the DataStream source allows users to

[jira] [Assigned] (FLINK-16634) The PartitionDiscoverer in FlinkKafkaConsumer should not use the user provided client.id.

2021-04-28 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-16634: Assignee: Qingsheng Ren > The PartitionDiscoverer in FlinkKafkaConsumer should not use

[jira] [Closed] (FLINK-20108) SingleThreadFetcherManager may add splits to a shutting down SplitFetcher

2021-04-28 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-20108. Fix Version/s: (was: 1.11.4) 1.11.3 Resolution: Fixed FLINK-18128

[jira] [Commented] (FLINK-11654) Multiple transactional KafkaProducers writing to same cluster have clashing transaction IDs

2021-04-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331360#comment-17331360 ] Jiangjie Qin commented on FLINK-11654: -- [~1wc] Technically speaking we still need a FLIP for this

[jira] [Resolved] (FLINK-12396) KafkaITCase.testOneSourceMultiplePartitions doesn't fail properly

2021-04-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-12396. -- Resolution: Fixed Closing the ticket as we haven't seen this issue for over a year. >

[jira] [Commented] (FLINK-22357) Mark FLIP-27 Source API as stable

2021-04-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331354#comment-17331354 ] Jiangjie Qin commented on FLINK-22357: -- [~sewen] Thanks for the proposal. The plan sounds good to

[jira] [Assigned] (FLINK-13052) Supporting multi-topic when using kafkaTableSourceSinkFactoryBase.createStreamTableSource

2021-04-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-13052: Assignee: Qingsheng Ren > Supporting multi-topic when using >

[jira] [Assigned] (FLINK-11793) Make KafkaProducer more resilient to Kafka Broker Failures

2021-04-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-11793: Assignee: Qingsheng Ren > Make KafkaProducer more resilient to Kafka Broker Failures >

[jira] [Closed] (FLINK-11736) flink kafka producer failed with NOT_LEADER_FOR_PARTITION

2021-04-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-11736. Resolution: Not A Bug Close the issue as not a bug because it is a user config issue. > flink

[jira] [Closed] (FLINK-10876) Deadlock if closing firstly pending transactions in FlinkKafkaProducer(011).close()

2021-04-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-10876. Resolution: Fixed Closing the issue as it has not occurred since FLINK-10455 was fixed. >

[jira] [Closed] (FLINK-15703) FlinkKafkaConsumer should enable partition discovery by default.

2021-04-24 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin closed FLINK-15703. Fix Version/s: (was: 1.13.0) Resolution: Won't Fix After some discussion, we decided

[jira] [Resolved] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-04-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved FLINK-21133. -- Resolution: Fixed Patch merged. master:  a9cf18b4d25f130e0bd24d51b128bbcf71892b45

[jira] [Updated] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-04-19 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-21133: - Fix Version/s: (was: 1.11.4) > FLIP-27 Source does not work with synchronous savepoint >

[jira] [Updated] (FLINK-22282) Move creation of SplitEnumerator to the SourceCoordinator thread

2021-04-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-22282: - Issue Type: Bug (was: Task) > Move creation of SplitEnumerator to the SourceCoordinator thread

[jira] [Updated] (FLINK-22282) Move creation of SplitEnumerator to the SourceCoordinator thread

2021-04-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-22282: - Priority: Critical (was: Major) > Move creation of SplitEnumerator to the SourceCoordinator

[jira] [Updated] (FLINK-22282) Move creation of SplitEnumerator to the SourceCoordinator thread

2021-04-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-22282: - Issue Type: Improvement (was: Bug) > Move creation of SplitEnumerator to the SourceCoordinator

[jira] [Updated] (FLINK-22282) Move creation of SplitEnumerator to the SourceCoordinator thread

2021-04-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-22282: - Fix Version/s: 1.12.3 1.13.0 > Move creation of SplitEnumerator to the

[jira] [Assigned] (FLINK-22282) Move creation of SplitEnumerator to the SourceCoordinator thread

2021-04-14 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned FLINK-22282: Assignee: Jiangjie Qin > Move creation of SplitEnumerator to the SourceCoordinator

[jira] [Created] (FLINK-22282) Move creation of SplitEnumerator to the SourceCoordinator thread

2021-04-14 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-22282: Summary: Move creation of SplitEnumerator to the SourceCoordinator thread Key: FLINK-22282 URL: https://issues.apache.org/jira/browse/FLINK-22282 Project: Flink

[jira] [Updated] (FLINK-20431) KafkaSourceReaderTest.testCommitOffsetsWithoutAliveFetchers:133->lambda$testCommitOffsetsWithoutAliveFetchers$3:134 expected:<10> but was:<1>

2021-04-07 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-20431: - Fix Version/s: (was: 1.13.0) 1.13.1 >

[jira] [Updated] (FLINK-15493) FlinkKafkaInternalProducerITCase.testProducerWhenCommitEmptyPartitionsToOutdatedTxnCoordinator failed on travis

2021-04-07 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated FLINK-15493: - Fix Version/s: (was: 1.13.0) 1.13.1 >

[jira] [Commented] (FLINK-20379) Update KafkaRecordDeserializationSchema to enable reuse of DeserializationSchema and KafkaDeserializationSchema

2021-04-07 Thread Jiangjie Qin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316083#comment-17316083 ] Jiangjie Qin commented on FLINK-20379: -- Sure. The commit in master branch is following. It is the

  1   2   3   4   5   6   >