Re: [DISCUSS] FLIP-205: Support cache in DataStream for Batch Processing

2022-01-06 Thread Gen Luo
Hi Xuannan, Thanks for the reply. I do agree that dynamic tables and cached partitions are similar features aiming different cases. In my opinion, the main difference of the implementations is to cache only the data or the whole result partition. To cache only the data, we can translate the

[jira] [Created] (FLINK-25555) FLIP-191: Extend unified Sink interface to support small file compaction

2022-01-06 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-2: --- Summary: FLIP-191: Extend unified Sink interface to support small file compaction Key: FLINK-2 URL: https://issues.apache.org/jira/browse/FLINK-2 Project:

[jira] [Created] (FLINK-25554) DistributedCacheDfsTest.testSubmittingJobViaRestClusterClient fails on AZP

2022-01-06 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-25554: - Summary: DistributedCacheDfsTest.testSubmittingJobViaRestClusterClient fails on AZP Key: FLINK-25554 URL: https://issues.apache.org/jira/browse/FLINK-25554

Re: [DISCUSS] Moving connectors from Flink to external connector repositories

2022-01-06 Thread Qingsheng Ren
Thanks Martijn for driving this! I’m +1 for Martijn’s proposal. It’s important to avoid making some connectors above others, and all connectors should share the same quality standard. Keeping some basic connectors like FileSystem is reasonable since it’s crucial for new users to try and

[jira] [Created] (FLINK-25561) Execution mode of batch mode job web ui shows pipeline

2022-01-06 Thread Echo Lee (Jira)
Echo Lee created FLINK-25561: Summary: Execution mode of batch mode job web ui shows pipeline Key: FLINK-25561 URL: https://issues.apache.org/jira/browse/FLINK-25561 Project: Flink Issue Type:

[VOTE] Create a separate sub project for FLIP-188: flink-store

2022-01-06 Thread Jingsong Li
Hi everyone, I'd like to start a vote for create a separate sub project for FLIP-188 [1]: `flink-store`. - If you agree with the name `flink-store`, please just +1 - If you have a better suggestion, please write your suggestion, followed by a reply that can +1 to the name that has appeared - If

Re: [DISCUSS] FLIP-188: Introduce Built-in Dynamic Table Storage

2022-01-06 Thread Jingsong Li
Hi everyone, Vote for create a separate sub project for FLIP-188 thread is here: https://lists.apache.org/thread/wzzhr27cvrh6w107bn464m1m1ycfll1z Best, Jingsong On Fri, Jan 7, 2022 at 3:30 PM Jingsong Li wrote: > > Hi Timo, > > I think we can consider exposing to DataStream users in the

Re: [DISCUSS] Change some default config values of blocking shuffle

2022-01-06 Thread Yingjie Cao
Hi all, Thanks very much for all of the feedbacks. It seems that we have reached a consensus. I will start a vote soon. Best, Yingjie Yun Gao 于2022年1月5日周三 16:08写道: > Very thanks @Yingjie for completing the experiments! > > Also +1 for changing the default config values. From the experiments,

[jira] [Created] (FLINK-25562) hive sql connector 依赖冲突

2022-01-06 Thread ziqiang.wang (Jira)
ziqiang.wang created FLINK-25562: Summary: hive sql connector 依赖冲突 Key: FLINK-25562 URL: https://issues.apache.org/jira/browse/FLINK-25562 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-25563) Support sink parallelism configuration to Elasticsearch connector

2022-01-06 Thread Yubin Li (Jira)
Yubin Li created FLINK-25563: Summary: Support sink parallelism configuration to Elasticsearch connector Key: FLINK-25563 URL: https://issues.apache.org/jira/browse/FLINK-25563 Project: Flink

Re: [DISCUSS] FLIP-188: Introduce Built-in Dynamic Table Storage

2022-01-06 Thread Jingsong Li
Hi Timo, I think we can consider exposing to DataStream users in the future, if the API definition is clear after. I am fine with `flink-table-store` too. But I tend to prefer shorter and clearer name: `flink-store`. I think I can create a separate thread to vote. Looking forward to your

[jira] [Created] (FLINK-25558) TableResult OK may be empty if returned by multiple queries

2022-01-06 Thread Paul Lin (Jira)
Paul Lin created FLINK-25558: Summary: TableResult OK may be empty if returned by multiple queries Key: FLINK-25558 URL: https://issues.apache.org/jira/browse/FLINK-25558 Project: Flink Issue

[jira] [Created] (FLINK-25557) Introduce incremental/full checkpoint size stats

2022-01-06 Thread Yun Tang (Jira)
Yun Tang created FLINK-25557: Summary: Introduce incremental/full checkpoint size stats Key: FLINK-25557 URL: https://issues.apache.org/jira/browse/FLINK-25557 Project: Flink Issue Type:

[jira] [Created] (FLINK-25556) Extra waiting of final checkpoint in benchmarks

2022-01-06 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-25556: - Summary: Extra waiting of final checkpoint in benchmarks Key: FLINK-25556 URL: https://issues.apache.org/jira/browse/FLINK-25556 Project: Flink

Re: [DISCUSS] Releasing Flink 1.14.3

2022-01-06 Thread Thomas Weise
Hi Martijn, Thanks for preparing the release. Did a volunteer check in with you? If not, I would like to take this up. Thomas On Mon, Dec 27, 2021 at 7:11 AM Martijn Visser wrote: > > Thank you all! That means that there's currently no more blocker to start > with the Flink 1.14.3 release. > >

[jira] [Created] (FLINK-25559) SQL JOIN causes data loss

2022-01-06 Thread Zongwen Li (Jira)
Zongwen Li created FLINK-25559: -- Summary: SQL JOIN causes data loss Key: FLINK-25559 URL: https://issues.apache.org/jira/browse/FLINK-25559 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-25560) Add

2022-01-06 Thread Bruce Wong (Jira)
Bruce Wong created FLINK-25560: -- Summary: Add Key: FLINK-25560 URL: https://issues.apache.org/jira/browse/FLINK-25560 Project: Flink Issue Type: Improvement Reporter: Bruce Wong

Re: [DISCUSS] Releasing Flink 1.14.3

2022-01-06 Thread Martijn Visser
Hi Thomas, Thanks for volunteering! There was no volunteer yet, so would be great if you could help out. Best regards, Martijn Op vr 7 jan. 2022 om 01:54 schreef Thomas Weise > Hi Martijn, > > Thanks for preparing the release. Did a volunteer check in with you? > If not, I would like to take