[jira] [Created] (FLINK-29858) Jdbc reading supports setting multiple queryTemplates

2022-11-02 Thread waywtdcc (Jira)
waywtdcc created FLINK-29858: Summary: Jdbc reading supports setting multiple queryTemplates Key: FLINK-29858 URL: https://issues.apache.org/jira/browse/FLINK-29858 Project: Flink Issue Type:

Re: [DISCUSS] Issue tracking workflow

2022-11-02 Thread Xintong Song
Thanks all for the valuable feedback, opinions and suggestions. # Option 1. I know this is the first choice for pretty much everyone. Many people from the Flink community (including myself) have shared their opinion with Infra. However, based on the feedback so far, TBH I don't think things would

[jira] [Created] (FLINK-29857) Fix HiveServer2Endpoint crush when using Hive3 Beeline

2022-11-02 Thread yuzelin (Jira)
yuzelin created FLINK-29857: --- Summary: Fix HiveServer2Endpoint crush when using Hive3 Beeline Key: FLINK-29857 URL: https://issues.apache.org/jira/browse/FLINK-29857 Project: Flink Issue Type: Bug

Re: [DISCUSS] Flink release retro

2022-11-02 Thread Xingbo Huang
Thanks for starting the discussion, Matthias! When I was the 1.16 release manager, I checked the dev mailing list to see what the release managers of the previous two versions did throughout the release cycle. In release 1.16, after each release sync meeting, we would send a summary email, which

[jira] [Created] (FLINK-29856) Triggering savepoint does not trigger source operator checkpoint

2022-11-02 Thread Mason Chen (Jira)
Mason Chen created FLINK-29856: -- Summary: Triggering savepoint does not trigger source operator checkpoint Key: FLINK-29856 URL: https://issues.apache.org/jira/browse/FLINK-29856 Project: Flink

[jira] [Created] (FLINK-29855) UDF randomly processed input data twice

2022-11-02 Thread Xinyi Yan (Jira)
Xinyi Yan created FLINK-29855: - Summary: UDF randomly processed input data twice Key: FLINK-29855 URL: https://issues.apache.org/jira/browse/FLINK-29855 Project: Flink Issue Type: Bug

Re: [DISCUSS] Flink release retro

2022-11-02 Thread Jing Ge
Hi all, I figure it is a good idea and +1 for the async retro. More developers will learn from what the release process looks like, which will give them context to engage in future releases. It would be great if the conversation could somehow follow the traditional retro pattern, e.g. tagged with

[jira] [Created] (FLINK-29854) Make Record Size Flush Strategy Optional for Async Sink

2022-11-02 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-29854: - Summary: Make Record Size Flush Strategy Optional for Async Sink Key: FLINK-29854 URL: https://issues.apache.org/jira/browse/FLINK-29854 Project: Flink

Re: [VOTE] Release Apache Flink Elasticsearch connector 3.0.0, rc1

2022-11-02 Thread Danny Cranmer
Hey, It is very exciting to see the first RC for an externalized connector! Thanks for all the effort setting up the release scripts and processes Chesnay. Just to confirm before I start verifying this, will there be an RC2 to bump the Jackson version? Danny, On Wed, Nov 2, 2022 at 6:22 PM

Re: [DISCUSS] FLIP-264 Extract BaseCoordinatorContext

2022-11-02 Thread gang ye
Hi Max and Qingsheng, Thanks for the feedback. The initial motivation to propose this is to reduce the duplicated code since ShuffleCoordinator would need similar communication logic as SourceCoordinator to talk with operators. I understand your concern that OperatorCoordinator is an internal

Re: [VOTE] Release Apache Flink Elasticsearch connector 3.0.0, rc1

2022-11-02 Thread Chesnay Schepler
Yeah we should bump that to be closer to the connector version released with 1.16.0. On 02/11/2022 15:53, Sergey Nuyanzin wrote: still checking however there is at least one finding I would like to highlight currently elasticsearch connector depends on jackson-bom 2.13.2.20220328 which has 2

[jira] [Created] (FLINK-29853) Older jackson-databind found in flink-kubernetes-operator-1.2.0-shaded.jar

2022-11-02 Thread James Busche (Jira)
James Busche created FLINK-29853: Summary: Older jackson-databind found in flink-kubernetes-operator-1.2.0-shaded.jar Key: FLINK-29853 URL: https://issues.apache.org/jira/browse/FLINK-29853 Project:

[RESULT][VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

2022-11-02 Thread Piotr Nowojski
Hi everyone, The proposal [1] has been accepted. I've created a ticket to follow the actual implementation: https://issues.apache.org/jira/browse/FLINK-29807 Binding votes in favour: Chesnay Yuan Dawid Gordon Konstantin Piotr Non-binding: Hangxiang Yu there were no votes against. Best,

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

2022-11-02 Thread Piotr Nowojski
Thanks for the vote. +1 (binding) from my side as well. The proposal has been accepted. I've created a ticket to follow the actual implementation: https://issues.apache.org/jira/browse/FLINK-29807 Binding votes in favour: Chesnay Yuan Dawid Gordon Konstantin Piotr Non-binding: Hangxiang Yu

[jira] [Created] (FLINK-29852) The operator is repeatedly displayed on the Flink Web UI

2022-11-02 Thread JasonLee (Jira)
JasonLee created FLINK-29852: Summary: The operator is repeatedly displayed on the Flink Web UI Key: FLINK-29852 URL: https://issues.apache.org/jira/browse/FLINK-29852 Project: Flink Issue Type:

Re: [VOTE] Release Apache Flink Elasticsearch connector 3.0.0, rc1

2022-11-02 Thread Sergey Nuyanzin
still checking however there is at least one finding I would like to highlight currently elasticsearch connector depends on jackson-bom 2.13.2.20220328 which has 2 CVEs CVE-2022-42003[1] CVE-2022-42004[2] fixed in 2.13.4.20221013 [3] Does it make sense to include it in this version? [1]

[jira] [Created] (FLINK-29851) Upgrade to Fabric8 6.x.x and JOSDK 4.x.x

2022-11-02 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-29851: -- Summary: Upgrade to Fabric8 6.x.x and JOSDK 4.x.x Key: FLINK-29851 URL: https://issues.apache.org/jira/browse/FLINK-29851 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-29850) Flink Table Store quick start guide does not work

2022-11-02 Thread Alex Sorokoumov (Jira)
Alex Sorokoumov created FLINK-29850: --- Summary: Flink Table Store quick start guide does not work Key: FLINK-29850 URL: https://issues.apache.org/jira/browse/FLINK-29850 Project: Flink

Re: [DISCUSS] Issue tracking workflow

2022-11-02 Thread Chesnay Schepler
Calcite just requested a separate mailing list for users to request a JIRA account. I think I'd try going a similar route. While I prefer the openness of github issues, they are really limited, and while some things can be replicated with labels (like fix versions / components), things like

Re: [DISCUSS] Release Flink 1.15.3

2022-11-02 Thread Fabian Paul
Thanks for all the replies. @xintong I'll definitely come back to your offer when facing steps that require PMC rights for the release. I checked the JIRA and found four blocking/critical issues affecting 1.15.2 - FLINK-29830 - FLINK-29492

[VOTE] Release Apache Flink Elasticsearch connector 3.0.0, rc1

2022-11-02 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #1 for the version 3.0.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

2022-11-02 Thread Martijn Visser
Hi David, I believe that for the DataStream this is indeed documented [1] but it might be missed given that there is a lot of documentation and you need to know that your problem is related to idleness. For the Table API I think this is never mentioned, so it should definitely be at least

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

2022-11-02 Thread David Anderson
> > For the partition > idleness problem could you elaborate more about it? I assume both > FlinkKafkaConsumer and KafkaSource need a WatermarkStrategy to decide > whether to mark the partition as idle. As a matter of fact, no, that's not the case -- which is why I mentioned it. The

Re: [DISCUSS] Flink release retro

2022-11-02 Thread Martijn Visser
Hi Matthias, I think it's a good idea to capture how this release cycle has progressed. I'm not sure that a classical "retrospective" is the best solution, since it would require multiple people in different timezones to attend a virtual meeting. So I would +1 an async retrospective, which could

[DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

2022-11-02 Thread Yun Gao
Hi everyone, I would like to open a discussion[1] on how to properly handle the processing timers on job termination. Currently all the processing timers would be ignored on job termination. This behavior is not suitable for some cases like WindowOperator. Thus we'd like to provide more options

[GitHub] [flink-connector-shared-utils] MartijnVisser commented on pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
MartijnVisser commented on PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#issuecomment-1299988788 > Thanks @zentol and @MartijnVisser for driving this, but I saw `dev` mail list received all PR updates information from this repo, is there some settings

[GitHub] [flink-connector-shared-utils] leonardBang commented on pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
leonardBang commented on PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#issuecomment-1299982431 Thanks @zentol and @zentol for driving this, but I saw `dev` mail list received all PR updates information from this repo, is there some settings incorrect? --

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011501540 ## stage_jars.sh: ## @@ -0,0 +1,55 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011501540 ## stage_jars.sh: ## @@ -0,0 +1,55 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor

Re: [DISCUSS] Flink release retro

2022-11-02 Thread Qingsheng Ren
Thanks for starting the discussion Matthias! I think having a retro after a release cycle would be quite helpful to standardizing the procedure of the release, and also could avoid new release managers getting stuck on the same issue that happened before. I prefer the second option that RMs could

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011369044 ## README.md: ## @@ -1 +1,79 @@ -This repository contains utilities for [Apache Flink](https://flink.apache.org/) connectors. \ No newline at end of

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011368848 ## _utils.sh: ## @@ -0,0 +1,59 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[jira] [Created] (FLINK-29849) Event time temporal join on an upsert source may produce incorrect execution plan

2022-11-02 Thread lincoln lee (Jira)
lincoln lee created FLINK-29849: --- Summary: Event time temporal join on an upsert source may produce incorrect execution plan Key: FLINK-29849 URL: https://issues.apache.org/jira/browse/FLINK-29849

[jira] [Created] (FLINK-29848) Port BinaryRowDataUtil to Flink Table Store

2022-11-02 Thread Jane Chan (Jira)
Jane Chan created FLINK-29848: - Summary: Port BinaryRowDataUtil to Flink Table Store Key: FLINK-29848 URL: https://issues.apache.org/jira/browse/FLINK-29848 Project: Flink Issue Type:

[jira] [Created] (FLINK-29847) Store/cache JarUploadResponseBody

2022-11-02 Thread Daren Wong (Jira)
Daren Wong created FLINK-29847: -- Summary: Store/cache JarUploadResponseBody Key: FLINK-29847 URL: https://issues.apache.org/jira/browse/FLINK-29847 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29846) Upgrade Archunit to 1.0.0

2022-11-02 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-29846: -- Summary: Upgrade Archunit to 1.0.0 Key: FLINK-29846 URL: https://issues.apache.org/jira/browse/FLINK-29846 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-29845) ThroughputCalculator throws java.lang.IllegalArgumentException: Time should be non negative under very low throughput cluster

2022-11-02 Thread Jingxiao GU (Jira)
Jingxiao GU created FLINK-29845: --- Summary: ThroughputCalculator throws java.lang.IllegalArgumentException: Time should be non negative under very low throughput cluster Key: FLINK-29845 URL:

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011297983 ## _init.sh: ## @@ -0,0 +1,45 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011301544 ## publish_git_tag.sh: ## @@ -0,0 +1,46 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011301075 ## README.md: ## @@ -1 +1,79 @@ -This repository contains utilities for [Apache Flink](https://flink.apache.org/) connectors. \ No newline at end of

Re: [DISCUSS] FLIP-264 Extract BaseCoordinatorContext

2022-11-02 Thread Qingsheng Ren
Thanks Gang and Steven for the FLIP. Actually I share the same concern with Piotr and Maximilian. OperatorCoordinator is marked as @Internal intentionally considering some existing issues, like consistency between non-source operator and coordinator on checkpoint. I'm wondering if it is useful to

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011297983 ## _init.sh: ## @@ -0,0 +1,45 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[GitHub] [flink-connector-shared-utils] zentol commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-02 Thread GitBox
zentol commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1011296837 ## check_environment.sh: ## @@ -0,0 +1,67 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#