Re: [VOTE] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

+1(binding) Best regards, Jing On Tue, Apr 25, 2023 at 5:17 AM Rui Fan <1996fan...@gmail.com> wrote: > +1 (binding) > > Best, > Rui Fan > > On Tue, Apr 25, 2023 at 10:06 AM Biao Geng wrote: > > > +1 (non-binding) > > Best, > > Biao Geng > > > > Martijn Visser 于2023年4月24日周一 20:20写道： > > > > >

[jira] [Created] (FLINK-31931) Exception history page should not link to a non-existent TM log page.

Junrui Li created FLINK-31931: - Summary: Exception history page should not link to a non-existent TM log page. Key: FLINK-31931 URL: https://issues.apache.org/jira/browse/FLINK-31931 Project: Flink

Re: [VOTE] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

+1 (binding) Best, Rui Fan On Tue, Apr 25, 2023 at 10:06 AM Biao Geng wrote: > +1 (non-binding) > Best, > Biao Geng > > Martijn Visser 于2023年4月24日周一 20:20写道： > > > +1 (binding) > > > > On Mon, Apr 24, 2023 at 4:10 AM Feng Jin wrote: > > > > > +1 (non-binding) > > > > > > > > > Best, > > >

RE: [DISCUSS] Status of Statefun Project

Hey all, I share the same sentiment as others here. It would be a shame if statefun went away. At the very least, it would be nice to see it go into maintenance mode just to maintain compatibility with Flink releases. I do come with a different proposal though. Feel free to let me know if I'm off

Re: [SUMMARY] Flink 1.18 Release Sync 04/18/2023

Hi Qingsheng, Thanks for sharing the sync summary. Since most developers in China would have a 5-day Labor Day Holiday on May 2nd, do we consider changing the sync meeting date after May 4th? Best Yun Tang

Re: [VOTE] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

+1 (non-binding) Best, Biao Geng Martijn Visser 于2023年4月24日周一 20:20写道： > +1 (binding) > > On Mon, Apr 24, 2023 at 4:10 AM Feng Jin wrote: > > > +1 (non-binding) > > > > > > Best, > > Feng > > > > On Mon, Apr 24, 2023 at 9:55 AM Hang Ruan > wrote: > > > > > +1 (non-binding) > > > > > > Best, >

[jira] [Created] (FLINK-31930) MetricQueryService works not properly in k8s with IPv6 stack

caiyi created FLINK-31930: - Summary: MetricQueryService works not properly in k8s with IPv6 stack Key: FLINK-31930 URL: https://issues.apache.org/jira/browse/FLINK-31930 Project: Flink Issue Type:

[jira] [Created] (FLINK-31929) HighAvailabilityServicesUtils.getWebMonitorAddress works not properly in IPv6 stack of k8s

caiyi created FLINK-31929: - Summary: HighAvailabilityServicesUtils.getWebMonitorAddress works not properly in IPv6 stack of k8s Key: FLINK-31929 URL: https://issues.apache.org/jira/browse/FLINK-31929

[jira] [Created] (FLINK-31928) flink-kubernetes works not properly in IPv6 environment in k8s

caiyi created FLINK-31928: - Summary: flink-kubernetes works not properly in IPv6 environment in k8s Key: FLINK-31928 URL: https://issues.apache.org/jira/browse/FLINK-31928 Project: Flink Issue

Re: [SUMMARY] Flink 1.18 Release Sync 04/18/2023

Hi Qingsheng, Thanks for sharing the summary! Best regards, Jing On Mon, Apr 24, 2023 at 1:50 PM Qingsheng Ren wrote: > Hi devs, > > I'd like to share some highlights in the 1.18 release sync on 04/18/2023 > (Sorry for the late summary!): > > - Feature list: @contributors please add your

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

Thanks Chesnay for working on this. Would you like to share more info about the JDK bug? Best regards, Jing On Mon, Apr 24, 2023 at 11:39 AM Chesnay Schepler wrote: > As it turns out Kryo isn't a blocker; we ran into a JDK bug. > > On 31/03/2023 08:57, Chesnay Schepler wrote: > > >

Re: [VOTE] Release flink-connector-cassandra v3.1.0, release candidate #1

Hi, Thanks Danny for driving this new release. It now contains the new source, thanks. I'm off but I wanted to test this release still. I made a very quick job (1) to read from a Cassandra cluster with the new source. I found an issue: the source raises a j"ava.lang.NoClassDefFoundError:

[jira] [Created] (FLINK-31927) Cassandra source raises an exception on Flink 1.16.0 on a real Cassandra cluster

Etienne Chauchot created FLINK-31927: Summary: Cassandra source raises an exception on Flink 1.16.0 on a real Cassandra cluster Key: FLINK-31927 URL: https://issues.apache.org/jira/browse/FLINK-31927

[jira] [Created] (FLINK-31926) Implement rename Table in GlueCatalog

Samrat Deb created FLINK-31926: -- Summary: Implement rename Table in GlueCatalog Key: FLINK-31926 URL: https://issues.apache.org/jira/browse/FLINK-31926 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31925) Sync benchmark dependency versions with the version used in Flink

Martijn Visser created FLINK-31925: -- Summary: Sync benchmark dependency versions with the version used in Flink Key: FLINK-31925 URL: https://issues.apache.org/jira/browse/FLINK-31925 Project: Flink

[jira] [Created] (FLINK-31924) [Flink operator] Flink Autoscale - Limit the max number of scale ups

Sriram Ganesh created FLINK-31924: - Summary: [Flink operator] Flink Autoscale - Limit the max number of scale ups Key: FLINK-31924 URL: https://issues.apache.org/jira/browse/FLINK-31924 Project:

Re: [VOTE] FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

+1 (binding) On Mon, Apr 24, 2023 at 4:10 AM Feng Jin wrote: > +1 (non-binding) > > > Best, > Feng > > On Mon, Apr 24, 2023 at 9:55 AM Hang Ruan wrote: > > > +1 (non-binding) > > > > Best, > > Hang > > > > Paul Lam 于2023年4月23日周日 11:58写道： > > > > > +1 (non-binding) > > > > > > Best, > > > Paul

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

Thank you all! I'm so honored and happy to work with all contributors in the Apache Flink community. Let's make Flink better together! Cheers, Qingsheng On Mon, Apr 24, 2023 at 3:39 PM Jing Ge wrote: > Congrats! Qingsheng! > > > > Best regards, > > Jing > > On Mon, Apr 24, 2023 at 9:35 AM

[SUMMARY] Flink 1.18 Release Sync 04/18/2023

Hi devs, I'd like to share some highlights in the 1.18 release sync on 04/18/2023 (Sorry for the late summary!): - Feature list: @contributors please add your features to the list in release 1.18 wiki page [1] so that we could track the overall progress. - CI instabilities: owners of issues have

[jira] [Created] (FLINK-31923) Connector weekly runs are only testing main branches instead of all supported branches

Martijn Visser created FLINK-31923: -- Summary: Connector weekly runs are only testing main branches instead of all supported branches Key: FLINK-31923 URL: https://issues.apache.org/jira/browse/FLINK-31923

Kubernetes Operator 1.5.0 release planning

Hi Devs! According to our release cadence, it's time for our next operator minor release. Since 1.4.0 we have made some significant improvements for both the core operator logic and the autoscaler. As there are still some minor tickets in the pipeline I suggest to target May 1 as the release

[jira] [Created] (FLINK-31922) Port over Kinesis Client configurations for retry and backoff

Hong Liang Teoh created FLINK-31922: --- Summary: Port over Kinesis Client configurations for retry and backoff Key: FLINK-31922 URL: https://issues.apache.org/jira/browse/FLINK-31922 Project: Flink

Re: [DISCUSS] FLIP-287: Extend Sink#InitContext to expose ExecutionConfig and JobID

Hi @Gordon, `InitContext#createInputSerializer()` is a great option and will solve more than one problem, but I cant find a way to get the TypeInformation on InitContextImpl (I can be missing something) On current (legacy) implementations we rely on interface ´ InputTypeConfigurable´ to get

[jira] [Created] (FLINK-31921) Create a mini cluster based metric collection test

Maximilian Michels created FLINK-31921: -- Summary: Create a mini cluster based metric collection test Key: FLINK-31921 URL: https://issues.apache.org/jira/browse/FLINK-31921 Project: Flink

[jira] [Created] (FLINK-31920) Flaky tests

Maximilian Michels created FLINK-31920: -- Summary: Flaky tests Key: FLINK-31920 URL: https://issues.apache.org/jira/browse/FLINK-31920 Project: Flink Issue Type: Bug

[ANNOUNCE] Apache flink-connector-aws 4.1.0 for Flink 1.17 released

The Apache Flink community is very happy to announce the release of Apache flink-connector-aws 4.1.0 for Apache Flink 1.17. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is

[ANNOUNCE] Apache flink-connector-mongodb 1.0.1 released

The Apache Flink community is very happy to announce the release of Apache flink-connector-mongodb 1.0.1 for Apache Flink 1.16 and 1.17. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

As it turns out Kryo isn't a blocker; we ran into a JDK bug. On 31/03/2023 08:57, Chesnay Schepler wrote: https://github.com/EsotericSoftware/kryo/wiki/Migration-to-v5#migration-guide Kroy themselves state that v5 likely can't read v2 data. However, both versions can be on the classpath

[jira] [Created] (FLINK-31919) Skip ClosureCleaner if object can be serialized

Chesnay Schepler created FLINK-31919: Summary: Skip ClosureCleaner if object can be serialized Key: FLINK-31919 URL: https://issues.apache.org/jira/browse/FLINK-31919 Project: Flink

[RESULT] [VOTE] flink-connector-mongodb 1.0.1, release candidate #1

I'm happy to announce that we have unanimously approved this release. There are 8 approving votes, 3 of which are binding: * Jiabao Sun * Elphas Toringepi * Hong Teoh * Samrat Deb * Martijn Visser (binding) * Leonard Xu (binding) * Ahmed Hamdy * Danny Cranmer (binding) There are no disapproving

Re: [VOTE] Release flink-connector-mongodb v1.0.1, release candidate #1

Thanks all, this vote is now closed. I will announce the results in a separate thread. On Mon, Apr 24, 2023 at 10:21 AM Danny Cranmer wrote: > +1 (binding) > > - Release notes look ok > - Verified signature and hashes of source archive > - Tag is present in Github > - Contents of Maven repo

Re: [VOTE] Release flink-connector-mongodb v1.0.1, release candidate #1

+1 (binding) - Release notes look ok - Verified signature and hashes of source archive - Tag is present in Github - Contents of Maven repo look good - No binaries in the source archive - Built source with Maven, tests pass - Verified NOTICE files - NOTICE file year needs updating to 2023,

Re: [VOTE] Release flink-connector-pulsar, release candidate #1

+1 (binding) - Release notes look ok - Verified signature and hashes of source archive - Tag is present in Github - Reviewed Web PR - Contents of MAven repo look good - No binaries in the source archive - Built source with Maven - Verified NOTICE files Some observations - Nightly CI is failing

[jira] [Created] (FLINK-31918) Pulsar Source does not failing build against Flink 1.18 on nightly CI

Danny Cranmer created FLINK-31918: - Summary: Pulsar Source does not failing build against Flink 1.18 on nightly CI Key: FLINK-31918 URL: https://issues.apache.org/jira/browse/FLINK-31918 Project:

[jira] [Created] (FLINK-31917) Loss of Idempotence in JsonSerDe Round Trip for AggregateCall and RexNode

Jane Chan created FLINK-31917: - Summary: Loss of Idempotence in JsonSerDe Round Trip for AggregateCall and RexNode Key: FLINK-31917 URL: https://issues.apache.org/jira/browse/FLINK-31917 Project: Flink

[jira] [Created] (FLINK-31916) Python API only respects deprecated env.java.opts key

Chesnay Schepler created FLINK-31916: Summary: Python API only respects deprecated env.java.opts key Key: FLINK-31916 URL: https://issues.apache.org/jira/browse/FLINK-31916 Project: Flink

[jira] [Created] (FLINK-31915) Python API incorrectly passes env.java.opts as single argument

Chesnay Schepler created FLINK-31915: Summary: Python API incorrectly passes env.java.opts as single argument Key: FLINK-31915 URL: https://issues.apache.org/jira/browse/FLINK-31915 Project:

[jira] [Created] (FLINK-31914) Failing to close FlinkKafkaInternalProducer created in KafkaWriter with exactly-once semantic results in memory leak

datariver created FLINK-31914: - Summary: Failing to close FlinkKafkaInternalProducer created in KafkaWriter with exactly-once semantic results in memory leak Key: FLINK-31914 URL:

[jira] [Created] (FLINK-31913) sql-client.sh does not respect env.java.opts.all/client

Chesnay Schepler created FLINK-31913: Summary: sql-client.sh does not respect env.java.opts.all/client Key: FLINK-31913 URL: https://issues.apache.org/jira/browse/FLINK-31913 Project: Flink

[jira] [Created] (FLINK-31912) Upgrade bytebuddy

Chesnay Schepler created FLINK-31912: Summary: Upgrade bytebuddy Key: FLINK-31912 URL: https://issues.apache.org/jira/browse/FLINK-31912 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31911) Bad address construction in SqlClientTest

Chesnay Schepler created FLINK-31911: Summary: Bad address construction in SqlClientTest Key: FLINK-31911 URL: https://issues.apache.org/jira/browse/FLINK-31911 Project: Flink Issue

[jira] [Created] (FLINK-31910) Using BroadcastUtils#withBroadcast in iteration perround mode got stuck

Zhipeng Zhang created FLINK-31910: - Summary: Using BroadcastUtils#withBroadcast in iteration perround mode got stuck Key: FLINK-31910 URL: https://issues.apache.org/jira/browse/FLINK-31910 Project:

[RESULT] [VOTE] flink-connector-aws 4.1.0 for Flink 1.17

I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * Elphas * Robert (binding) * Samrat * Martijn (binding) * Danny (binding) There are no disapproving votes. Thanks everyone! Danny

Re: [VOTE] Release flink-connector-aws, 4.1.0 for Flink 1.17

Thanks all, this VOTE is now closed and I will follow up with the results. On Mon, Apr 24, 2023 at 8:45 AM Danny Cranmer wrote: > +1 (binding) > > - Verified signatures and hashes > - Content of maven repo look good > - Ran simple EFO and non-EFO Kinesis source test job locally > > On Wed, Apr

Re: [VOTE] Release flink-connector-aws, 4.1.0 for Flink 1.17

+1 (binding) - Verified signatures and hashes - Content of maven repo look good - Ran simple EFO and non-EFO Kinesis source test job locally On Wed, Apr 19, 2023 at 7:30 PM Martijn Visser wrote: > +1 (binding) > > - Validated hashes > - Verified signature > - Verified that no binaries exist in

[jira] [Created] (FLINK-31908) cast expr to type with not null should not change nullable of expr

jackylau created FLINK-31908: Summary: cast expr to type with not null should not change nullable of expr Key: FLINK-31908 URL: https://issues.apache.org/jira/browse/FLINK-31908 Project: Flink

[jira] [Created] (FLINK-31909) Using BroadcastUtils#withBroadcast in iteration perround mode got stuck

Zhipeng Zhang created FLINK-31909: - Summary: Using BroadcastUtils#withBroadcast in iteration perround mode got stuck Key: FLINK-31909 URL: https://issues.apache.org/jira/browse/FLINK-31909 Project:

Re: Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

Hi Mang, Thanks for clarifying it. I am trying to understand your thoughts. Do you actually mean the boundedness[1] instead of the execution modes[2]? I.e. the atomic CTAS will be only supported for bounded data. Best regards, Jing [1]

Re: [DISCUSS FLINKSQL PARALLELISM]

Hi Green, Since FLIP-292 opened the door to do fine-grained tuning at operator level for Flink SQL jobs, I would also suggest leveraging the compiled json to do further config optimization like Yun Tang already mentioned. We should consider making it(leveraging the compiled json plan) the stand

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

Congrats! Qingsheng! Best regards, Jing On Mon, Apr 24, 2023 at 9:35 AM Zakelly Lan wrote: > Congratulations, Qingsheng! > > Best regards, > Zakelly > > On Mon, Apr 24, 2023 at 11:52 AM Matthias Pohl > wrote: > > > > Congratulations, Qingsheng! :) > > > > On Mon, Apr 24, 2023, 05:17 Yangze

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

Congratulations, Leonard! Best regards, Zakelly On Mon, Apr 24, 2023 at 3:25 PM Jing Ge wrote: > > Congrats! Leonard! > > > > Best regards, > > Jing > > On Mon, Apr 24, 2023 at 5:53 AM Matthias Pohl > wrote: > > > Congrats, Leonard :) > > > > On Mon, Apr 24, 2023, 05:17 Yangze Guo wrote: > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

Congratulations, Qingsheng! Best regards, Zakelly On Mon, Apr 24, 2023 at 11:52 AM Matthias Pohl wrote: > > Congratulations, Qingsheng! :) > > On Mon, Apr 24, 2023, 05:17 Yangze Guo wrote: > > > Congratulations, Qingsheng! > > > > Best, > > Yangze Guo > > > > On Mon, Apr 24, 2023 at 10:05 AM

[jira] [Created] (FLINK-31907) Remove unused fields inside of ExecutionSlotSharingGroupBuilder

Rui Fan created FLINK-31907: --- Summary: Remove unused fields inside of ExecutionSlotSharingGroupBuilder Key: FLINK-31907 URL: https://issues.apache.org/jira/browse/FLINK-31907 Project: Flink Issue

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

Congrats! Leonard! Best regards, Jing On Mon, Apr 24, 2023 at 5:53 AM Matthias Pohl wrote: > Congrats, Leonard :) > > On Mon, Apr 24, 2023, 05:17 Yangze Guo wrote: > > > Congratulations, Leonard! > > > > Best, > > Yangze Guo > > > > On Mon, Apr 24, 2023 at 10:05 AM Shuo Cheng wrote: > > >

[jira] [Created] (FLINK-31906) typeof should only return type exclude nullable

jackylau created FLINK-31906: Summary: typeof should only return type exclude nullable Key: FLINK-31906 URL: https://issues.apache.org/jira/browse/FLINK-31906 Project: Flink Issue Type:

[jira] [Created] (FLINK-31905) Exception thrown when accessing nested field of the result of Python UDF with complex type

Dian Fu created FLINK-31905: --- Summary: Exception thrown when accessing nested field of the result of Python UDF with complex type Key: FLINK-31905 URL: https://issues.apache.org/jira/browse/FLINK-31905

[jira] [Created] (FLINK-31904) fix current serveral flink nullable type handle

jackylau created FLINK-31904: Summary: fix current serveral flink nullable type handle Key: FLINK-31904 URL: https://issues.apache.org/jira/browse/FLINK-31904 Project: Flink Issue Type:

[jira] [Created] (FLINK-31903) Caching records fails in BroadcastUtils#withBroadcastStream

Zhipeng Zhang created FLINK-31903: - Summary: Caching records fails in BroadcastUtils#withBroadcastStream Key: FLINK-31903 URL: https://issues.apache.org/jira/browse/FLINK-31903 Project: Flink

[jira] [Created] (FLINK-31902) cast expr to type with not null should throw exception like calcite

jackylau created FLINK-31902: Summary: cast expr to type with not null should throw exception like calcite Key: FLINK-31902 URL: https://issues.apache.org/jira/browse/FLINK-31902 Project: Flink

[jira] [Created] (FLINK-31901) AbstractBroadcastWrapperOperator should not block checkpoint barriers when processing cached records

Zhipeng Zhang created FLINK-31901: - Summary: AbstractBroadcastWrapperOperator should not block checkpoint barriers when processing cached records Key: FLINK-31901 URL: