[jira] [Created] (FLINK-30585) Improve flame graph performance at subtask level

2023-01-05 Thread Rui Fan (Jira)
Rui Fan created FLINK-30585: --- Summary: Improve flame graph performance at subtask level Key: FLINK-30585 URL: https://issues.apache.org/jira/browse/FLINK-30585 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30584) Update the flame graph doc of subtask level

2023-01-05 Thread Rui Fan (Jira)
Rui Fan created FLINK-30584: --- Summary: Update the flame graph doc of subtask level Key: FLINK-30584 URL: https://issues.apache.org/jira/browse/FLINK-30584 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30583) Provide the flame graph to the subtask level

2023-01-05 Thread Rui Fan (Jira)
Rui Fan created FLINK-30583: --- Summary: Provide the flame graph to the subtask level Key: FLINK-30583 URL: https://issues.apache.org/jira/browse/FLINK-30583 Project: Flink Issue Type: Bug

Re: Re: [DISCUSS] Allow source readers extending SourceReaderBase to override numRecordsIn report logic

2023-01-05 Thread Dong Lin
Hi John and Wencong, Thanks for the reply! It is nice that optional-2 can address the problem without affecting the existing source connectors as far as functionality is concerned. One potential concern with this approach is that it might increase the Flink runtime overhead by adding one more

Re: [DISCUSS] FLIP-282: Introduce Delete & Update API

2023-01-05 Thread Jingsong Li
Thanks yuxia for your explanation. But what I mean is that this may lead to confusion for implementers and users. You can use comments to explain it. However, a good interface can make the mechanism clearer through code design. So here, I still think an independent SupportsXX interface can make

[jira] [Created] (FLINK-30582) Flink-avro Flink-orc free for flink-table-store-format

2023-01-05 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30582: Summary: Flink-avro Flink-orc free for flink-table-store-format Key: FLINK-30582 URL: https://issues.apache.org/jira/browse/FLINK-30582 Project: Flink Issue

Re: flink add multiple sink in sequence

2023-01-05 Thread Shammon FY
Hi @Great I think the two sinks in your example are equivalent and independent. If there are some logical relationships between two sinks, you may need to create a new combined sink and do it yourself. On Thu, Jan 5, 2023 at 11:48 PM Great Info wrote: > > I have a stream from Kafka, after

[ANNOUNCE] Flink 1.17 feature freeze extended until January 31st, 2023

2023-01-05 Thread Qingsheng Ren
Hi devs, As discussed previously in the mailing list [1], the release managers of Flink 1.17 have decided to extend the feature freeze until *January 31st, 2023*, which gives us 3 weeks for development from now. Considering the entire timeline, there will be no extension after January 31st,

[jira] [Created] (FLINK-30581) Deprecate FileStoreTableITCase and use CatalogITCaseBase

2023-01-05 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30581: Summary: Deprecate FileStoreTableITCase and use CatalogITCaseBase Key: FLINK-30581 URL: https://issues.apache.org/jira/browse/FLINK-30581 Project: Flink

[jira] [Created] (FLINK-30580) [umbrella] Refactor tests for table store

2023-01-05 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30580: Summary: [umbrella] Refactor tests for table store Key: FLINK-30580 URL: https://issues.apache.org/jira/browse/FLINK-30580 Project: Flink Issue Type:

[jira] [Created] (FLINK-30579) Introducing cofigurable option to enable hive native function

2023-01-05 Thread dalongliu (Jira)
dalongliu created FLINK-30579: - Summary: Introducing cofigurable option to enable hive native function Key: FLINK-30579 URL: https://issues.apache.org/jira/browse/FLINK-30579 Project: Flink

[jira] [Created] (FLINK-30578) AVRO-3700: Publish SBOM artifacts

2023-01-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created FLINK-30578: - Summary: AVRO-3700: Publish SBOM artifacts Key: FLINK-30578 URL: https://issues.apache.org/jira/browse/FLINK-30578 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-30577) OpenShift FlinkSessionJob artifact write error on non-default namespaces

2023-01-05 Thread James Busche (Jira)
James Busche created FLINK-30577: Summary: OpenShift FlinkSessionJob artifact write error on non-default namespaces Key: FLINK-30577 URL: https://issues.apache.org/jira/browse/FLINK-30577 Project:

Re: CDC from Oracle database reading directly logs - integration with OpenLogReplicator

2023-01-05 Thread Adam Leszczyński
Thanks Leonard, Jark, I will just reply on the dev list for this topic as this is more related with development. Sorry, I have sent on 2 lists - I don’t want to add more chaos here. The answer to your question is not straight, so I will start from a broader picture. Maybe first I will

flink add multiple sink in sequence

2023-01-05 Thread Great Info
I have a stream from Kafka, after reading it and doing some transformations/enrichment I need to store the final data stream in the database and publish it to Kafka so I am planning to add two sinks like below *finalInputStream.addSink(dataBaseSink); // Sink1finalInputStream.addSink(

[jira] [Created] (FLINK-30576) JdbcOutputFormat refactor

2023-01-05 Thread Jira
João Boto created FLINK-30576: - Summary: JdbcOutputFormat refactor Key: FLINK-30576 URL: https://issues.apache.org/jira/browse/FLINK-30576 Project: Flink Issue Type: Improvement

Re:Re: [DISCUSS] Allow source readers extending SourceReaderBase to override numRecordsIn report logic

2023-01-05 Thread Wencong Liu
Hi, All Thanks for the reply! I think both John and Dong's opinions are reasonable. John's Suggestion 2 is a good implementation. It does not affect the existing source connectors, but also provides support for custom counter in the future implementation. WDYT? Best, Wencong Liu

[DISCUSS] FLIP-285: Refactoring the leader election code base in Flink

2023-01-05 Thread Matthias Pohl
Hi everyone, I brought up FLINK-26522 [1] in the mailing list discussion about consolidating the HighAvailabilityServices interfaces [2], previously. There, it was concluded that the community still wants the ability to have per-component leader election and, therefore, keep the

[jira] [Created] (FLINK-30575) Autoscaler doesn't scale down on 0 load

2023-01-05 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-30575: -- Summary: Autoscaler doesn't scale down on 0 load Key: FLINK-30575 URL: https://issues.apache.org/jira/browse/FLINK-30575 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-30574) Do not scale further up if last scaling was ineffective

2023-01-05 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-30574: -- Summary: Do not scale further up if last scaling was ineffective Key: FLINK-30574 URL: https://issues.apache.org/jira/browse/FLINK-30574 Project: Flink Issue

[jira] [Created] (FLINK-30573) Table Store dedicated compact job may skip some records when checkpoint interval is long

2023-01-05 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30573: --- Summary: Table Store dedicated compact job may skip some records when checkpoint interval is long Key: FLINK-30573 URL: https://issues.apache.org/jira/browse/FLINK-30573

Re: [VOTE] FLIP-274: Introduce metric group for OperatorCoordinator

2023-01-05 Thread Hang Ruan
Hi, Martijn, Thanks for your reply. Very glad for your help to review it. Let's make this vote last until Jan 10th. Best, Hang Leonard Xu 于2023年1月5日周四 16:16写道: > Thanks for driving this FLIP, Hang! > > +1 (binding) > > Best, > Leonard > > > On Jan 5, 2023, at 3:08 AM, Martijn Visser > wrote:

[jira] [Created] (FLINK-30572) Make parquet as default data file format

2023-01-05 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30572: Summary: Make parquet as default data file format Key: FLINK-30572 URL: https://issues.apache.org/jira/browse/FLINK-30572 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-280: Introduce a new explain mode to provide SQL advice

2023-01-05 Thread Jane Chan
Hi, devs, After discussing with Godfrey , Lincoln , and Jark , I've updated the FLIP document[1] and look forward to your opinions and suggestions. The highlight difference is listed as follows. - *The proposed syntax changes from EXPLAIN ANALYZED_PHYSICAL_PLAN to EXPLAIN PLAN_ADVICE *.

[jira] [Created] (FLINK-30571) Compute scale parallelism based on observed scalability

2023-01-05 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-30571: -- Summary: Compute scale parallelism based on observed scalability Key: FLINK-30571 URL: https://issues.apache.org/jira/browse/FLINK-30571 Project: Flink Issue

[jira] [Created] (FLINK-30570) RexNodeExtractor#isSupportedPartitionPredicate generates unexpected partition predicates

2023-01-05 Thread Aitozi (Jira)
Aitozi created FLINK-30570: -- Summary: RexNodeExtractor#isSupportedPartitionPredicate generates unexpected partition predicates Key: FLINK-30570 URL: https://issues.apache.org/jira/browse/FLINK-30570

Re: [VOTE] FLIP-274: Introduce metric group for OperatorCoordinator

2023-01-05 Thread Leonard Xu
Thanks for driving this FLIP, Hang! +1 (binding) Best, Leonard > On Jan 5, 2023, at 3:08 AM, Martijn Visser wrote: > > Hi Hang, > > I haven't had time to read the FLIP yet since this is still a holiday > period in Europe. I would like to read it in the next few days. Can you > keep the vote