Re: [VOTE] FLIP-238: Introduce FLIP-27-based Data Generator Source

2022-07-19 Thread Robert Metzger
+1 On Wed, Jul 20, 2022 at 4:41 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(non-binding) > > New Source can better support some features, such as > Unaligned Checkpoint, Watermark alignment, etc. > The data generator based on the new Source is very helpful > for daily testing. > > Very much

[jira] [Created] (FLINK-28614) Empty local state folders not cleanup on retrieving local state

2022-07-19 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-28614: -- Summary: Empty local state folders not cleanup on retrieving local state Key: FLINK-28614 URL: https://issues.apache.org/jira/browse/FLINK-28614 Project: Flink

邮件退订

2022-07-19 Thread cason0126
邮件退订 | | cason0126 | | cason0...@163.com |

Re: [VOTE] FLIP-238: Introduce FLIP-27-based Data Generator Source

2022-07-19 Thread Rui Fan
+1(non-binding) New Source can better support some features, such as Unaligned Checkpoint, Watermark alignment, etc. The data generator based on the new Source is very helpful for daily testing. Very much looking forward to using it. Best wishes Rui Fan On Wed, Jul 20, 2022 at 4:22 AM Martijn

Re: [DISCUSS] FLIP-247 Bulk fetch of table and column statistics for given partitions

2022-07-19 Thread Jingsong Li
Hi Jing, I understand that the statistics for partitions are currently only used by Hive, so we can look at the Hive implementation: See HiveCatalog.getPartitionStatistics. To get the statistics, we actually get them from the org.apache.hadoop.hive.metastore.api.Partition object. According to

[DISCUSS] Handling of removed splits for FLIP-27

2022-07-19 Thread Xinbin Huang
Hi everyone, I would like to start a discussion about state recovery of removed splits for the source API (FLIP-27). By looking at the implementation and behavior we observed, it seems that the source reader doesn't correctly handle a split being discovered as "removed" from the enumerator.

Re: [VOTE] FLIP-238: Introduce FLIP-27-based Data Generator Source

2022-07-19 Thread Martijn Visser
+1 (binding) Thanks for the efforts Alex! Op di 19 jul. 2022 om 21:31 schreef Alexander Fedulov < alexan...@ververica.com>: > Hi everyone, > > following the discussion in [1], I would like to open up a vote for > adding a FLIP-27-based Data Generator Source [2]. > > The addition of this source

[VOTE] FLIP-238: Introduce FLIP-27-based Data Generator Source

2022-07-19 Thread Alexander Fedulov
Hi everyone, following the discussion in [1], I would like to open up a vote for adding a FLIP-27-based Data Generator Source [2]. The addition of this source also unblocks the currently pending efforts for deprecating the Source Function API [3]. The poll will be open until July 25 (72h +

Re: [VOTE] FLIP-251: Support collecting arbitrary number of streams

2022-07-19 Thread Alexander Fedulov
+1 Looking forward to using the API to simplify tests setups. Best, Alexander Fedulov On Tue, Jul 19, 2022 at 2:31 PM Martijn Visser wrote: > Thanks for creating the FLIP and opening the vote Chesnay. > > +1 (binding) > > Op di 19 jul. 2022 om 10:26 schreef Chesnay Schepler : > > > I'd like to

Re: [DISCUSS] TLS issues

2022-07-19 Thread Jean-Damien Hatzenbuhler
Hello Martijn, Thank you I will propose PRs to correct those issues. Regards, Jean-Damien HATZENBUHLER On Tue, Jul 19, 2022 at 5:04 PM Martijn Visser wrote: > Hi Jean-Damien, > > First of all, thanks for filing those tickets. We would very much > appreciate getting PRs to improve on this.

Re: [DISCUSS] TLS issues

2022-07-19 Thread Martijn Visser
Hi Jean-Damien, First of all, thanks for filing those tickets. We would very much appreciate getting PRs to improve on this. I've assigned them to you. With regards to backports, this depends on the compatibility of the PRs. If they would not break anything that we can't break in a patch

[DISCUSS] TLS issues

2022-07-19 Thread Jean-Damien Hatzenbuhler
Hello, I created two JIRA tickets regarding TLS issues in flink: - https://issues.apache.org/jira/browse/FLINK-28520 - https://issues.apache.org/jira/browse/FLINK-28521 I didn’t receive any

[jira] [Created] (FLINK-28613) PyFlink 1.15 unable to start in Application Mode in k8s

2022-07-19 Thread Clive Wong (Jira)
Clive Wong created FLINK-28613: -- Summary: PyFlink 1.15 unable to start in Application Mode in k8s Key: FLINK-28613 URL: https://issues.apache.org/jira/browse/FLINK-28613 Project: Flink Issue

Re: [DISCUSS] FLIP-247 Bulk fetch of table and column statistics for given partitions

2022-07-19 Thread Jing Ge
Thanks Jingsong for the suggestion. Do you mean using a different naming convention? There is a thought and description in the FLIP about using "list" or "bulkGet": - bulkGetPartitionStatistics(...) has been chosen over listPartitionStatistics(...), because, comparing to database and

[jira] [Created] (FLINK-28612) Cancel pending slot allocation after canceling executions

2022-07-19 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-28612: --- Summary: Cancel pending slot allocation after canceling executions Key: FLINK-28612 URL: https://issues.apache.org/jira/browse/FLINK-28612 Project: Flink Issue Type:

Re: [VOTE] FLIP-251: Support collecting arbitrary number of streams

2022-07-19 Thread Martijn Visser
Thanks for creating the FLIP and opening the vote Chesnay. +1 (binding) Op di 19 jul. 2022 om 10:26 schreef Chesnay Schepler : > I'd like to proceed with the vote for FLIP-251 [1], as no objections or > issues were raised in [2]. > > The vote will last for at least 72 hours unless there is an

[jira] [Created] (FLINK-28611) Support ElementwiseProduct in FlinkML

2022-07-19 Thread weibo zhao (Jira)
weibo zhao created FLINK-28611: -- Summary: Support ElementwiseProduct in FlinkML Key: FLINK-28611 URL: https://issues.apache.org/jira/browse/FLINK-28611 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-28610) Enable speculative execution of sources

2022-07-19 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-28610: --- Summary: Enable speculative execution of sources Key: FLINK-28610 URL: https://issues.apache.org/jira/browse/FLINK-28610 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-28609) Flink-Pulsar connector fails on larger schemas

2022-07-19 Thread Jacek Wislicki (Jira)
Jacek Wislicki created FLINK-28609: -- Summary: Flink-Pulsar connector fails on larger schemas Key: FLINK-28609 URL: https://issues.apache.org/jira/browse/FLINK-28609 Project: Flink Issue

[SUMMARY] Flink 1.16 release sync of 2022-07-19

2022-07-19 Thread Xingbo Huang
Hi everyone, I would like to give you a brief update of the Flink 1.16 release status till 2022-07-19. Currently, we have 12 features that have been completed for this release and 41 features are still expected to make it. We only have 3 weeks remaining until the feature freeze (at 2022-08-09).

[VOTE] FLIP-251: Support collecting arbitrary number of streams

2022-07-19 Thread Chesnay Schepler
I'd like to proceed with the vote for FLIP-251 [1], as no objections or issues were raised in [2]. The vote will last for at least 72 hours unless there is an objection or insufficient votes. [1]

[jira] [Created] (FLINK-28608) Make Hadoop FS token renewer configurable

2022-07-19 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-28608: - Summary: Make Hadoop FS token renewer configurable Key: FLINK-28608 URL: https://issues.apache.org/jira/browse/FLINK-28608 Project: Flink Issue Type:

[jira] [Created] (FLINK-28607) Table-API print connector encoding issue

2022-07-19 Thread Sarah Cho (Jira)
Sarah Cho created FLINK-28607: - Summary: Table-API print connector encoding issue Key: FLINK-28607 URL: https://issues.apache.org/jira/browse/FLINK-28607 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28606) Preserve distributed consistency of OperatorEvents from OperatorCoordinator to subtasks

2022-07-19 Thread Yunfeng Zhou (Jira)
Yunfeng Zhou created FLINK-28606: Summary: Preserve distributed consistency of OperatorEvents from OperatorCoordinator to subtasks Key: FLINK-28606 URL: https://issues.apache.org/jira/browse/FLINK-28606

[jira] [Created] (FLINK-28605) Throw exception intentionally when new snapshots are committed during restore

2022-07-19 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28605: --- Summary: Throw exception intentionally when new snapshots are committed during restore Key: FLINK-28605 URL: https://issues.apache.org/jira/browse/FLINK-28605 Project:

[jira] [Created] (FLINK-28604) job failover and not restore from checkpoint in zookeeper HA mode

2022-07-19 Thread KevinyhZou (Jira)
KevinyhZou created FLINK-28604: -- Summary: job failover and not restore from checkpoint in zookeeper HA mode Key: FLINK-28604 URL: https://issues.apache.org/jira/browse/FLINK-28604 Project: Flink