[ANNOUNCE] Apache Flink Stateful Functions 3.1.1 released

The Apache Flink community is very happy to announce the release of Apache Flink Stateful Functions (StateFun) 3.1.1. This is a bugfix release that addresses the recent log4j vulnerabilities, users are encouraged to upgrade. StateFun is a cross-platform stack for building Stateful Serverless

[jira] [Created] (FLINK-25422) Azure pipelines are failing due to Python tests unable to install dependencies

Martijn Visser created FLINK-25422: -- Summary: Azure pipelines are failing due to Python tests unable to install dependencies Key: FLINK-25422 URL: https://issues.apache.org/jira/browse/FLINK-25422

Re: Sending watermarks into Kafka

I just realized I did not mention a key concept in my idea: All watermarks are sent into all Kafka partitions so every consumer gets all watermarks from all upstream producing tasks. On Wed, Dec 22, 2021 at 11:33 AM Niels Basjes wrote: > > Perhaps for this an explicit config is needed per

[jira] [Created] (FLINK-25420) Port JDBC Source to new Source API (FLIP-27)

Martijn Visser created FLINK-25420: -- Summary: Port JDBC Source to new Source API (FLIP-27) Key: FLINK-25420 URL: https://issues.apache.org/jira/browse/FLINK-25420 Project: Flink Issue Type:

[DISCUSS] Slimmed down docker images.

Hi, I did some quick prototyping on the slimmed down docker images, and I was able to cut the docker image size by ~40% with a minimum effort [1] (using a multi-stage build + trimming examples / opt + using slimmed down JRE image). I think this might be a low hanging fruit for reducing MTTR in

[jira] [Created] (FLINK-25421) Port JDBC Sink to new Unified Sink API (FLIP-143)

Martijn Visser created FLINK-25421: -- Summary: Port JDBC Sink to new Unified Sink API (FLIP-143) Key: FLINK-25421 URL: https://issues.apache.org/jira/browse/FLINK-25421 Project: Flink Issue

[jira] [Created] (FLINK-25424) Checkpointing is currently not supported for operators that implement InputSelectable

Zhipeng Zhang created FLINK-25424: - Summary: Checkpointing is currently not supported for operators that implement InputSelectable Key: FLINK-25424 URL: https://issues.apache.org/jira/browse/FLINK-25424

[jira] [Created] (FLINK-25423) Enable loading state backend via configuration in state processor api

Yun Tang created FLINK-25423: Summary: Enable loading state backend via configuration in state processor api Key: FLINK-25423 URL: https://issues.apache.org/jira/browse/FLINK-25423 Project: Flink

[jira] [Created] (FLINK-25414) Provide metrics to measure how long task has been blocked

Piotr Nowojski created FLINK-25414: -- Summary: Provide metrics to measure how long task has been blocked Key: FLINK-25414 URL: https://issues.apache.org/jira/browse/FLINK-25414 Project: Flink

[jira] [Created] (FLINK-25417) Too many connections for TM

fanrui created FLINK-25417: -- Summary: Too many connections for TM Key: FLINK-25417 URL: https://issues.apache.org/jira/browse/FLINK-25417 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-25418) flink任务中指定了dir_cache没网的时候还是会去请求下载python第三方库，t_env.set_python_requirements(dir_requirements, dir_cache)

yangcai created FLINK-25418: --- Summary: flink任务中指定了dir_cache没网的时候还是会去请求下载python第三方库，t_env.set_python_requirements(dir_requirements, dir_cache) Key: FLINK-25418 URL: https://issues.apache.org/jira/browse/FLINK-25418

[jira] [Created] (FLINK-25419) Support the metadata column to generate dynamic index

jinfeng created FLINK-25419: --- Summary: Support the metadata column to generate dynamic index Key: FLINK-25419 URL: https://issues.apache.org/jira/browse/FLINK-25419 Project: Flink Issue Type:

Re: [DISCUSS] Releasing Flink 1.14.3

Hi Martijn, FLINK-25271 has been merged to 1.14 branch. Best, D. On Wed, Dec 22, 2021 at 7:27 AM 任庆盛 wrote: > Hi Martjin, > > Thanks for the effort on Flink 1.14.3. FLINK-25132 has been merged on > master and is waiting for CI on release-1.14. I think it can be closed > today. > > Cheers, > >

Re: [DISCUSS] Changing the minimal supported version of Hadoop

Agreed, if we drop the CI for lower versions, there is actually no point of having safeguards as we can't really test for them. Maybe one more thought (it's more of a feeling), I feel that users running really old Hadoop versions are usually slower to adopt (they most likely use what the current

[jira] [Created] (FLINK-25415) implement retrial on connections to Cassandra container

Etienne Chauchot created FLINK-25415: Summary: implement retrial on connections to Cassandra container Key: FLINK-25415 URL: https://issues.apache.org/jira/browse/FLINK-25415 Project: Flink

Re: Sending watermarks into Kafka

On Tue, Dec 21, 2021 at 9:42 PM Matthias J. Sax wrote: > Your high level layout make sense. However, I think there are a few > problems doing it with Flink: > > (1) How to encode the watermark? It could break downstream consumers > that don't know what to do with them (eg, crash on

Re: Sending watermarks into Kafka

> Perhaps for this an explicit config is needed per source id (pattern?): > - Important producer: expire after 24 hours. > - Yet another IOT sensor: expire after 1 minute. > - and a default. Do note that this actually does something I'm not a fan of: Introduce a "Processing time" conclusion (the

[jira] [Created] (FLINK-25416) Build unified Parquet BulkFormat for both Table API and DataStream API

Jing Ge created FLINK-25416: --- Summary: Build unified Parquet BulkFormat for both Table API and DataStream API Key: FLINK-25416 URL: https://issues.apache.org/jira/browse/FLINK-25416 Project: Flink