how to convert Table to DataStream / DataSet by TableEnvironment on Batch mode?

Hi, community! When dealing with retractable stream, i meet a problem about converting Table to DataSet / DataStream on batch mode in Flink-1.13.5. scenario and process: - 1. Database CDC to Kafka - 2. Sync data into Hive with HoodieTableFormat(Apache Hudi) - 3. Incremental processing hoodie

Rescaling REST API not working

Hello, I tried to call the rescaling api with patch to automatically rescale, but it shows 503, is it deprecated? because it is present in the docs too, and if it is deprecated, is there any API through which I can rescale directly? Because the mode which we are using is not the reactive mode, we n

Re: [ANNOUNCE] Apache Flink 1.1.4.4 released

Thanks a lot for being our release manager Konstantin and everyone who contributed. I have a question about pyflink. I see that there are no corresponding wheel packages uploaded on pypi, only the source package is uploaded. Is there something wrong with building the wheel packages? Best, Xingbo

Re: Interval join operator is not forwarding watermarks correctly

For completeness, this still happens with Flink 1.14.4 Regards, Alexis. From: Alexis Sarda-Espinosa Sent: Friday, March 11, 2022 12:21 AM To: user@flink.apache.org Cc: pnowoj...@apache.org Subject: Re: Interval join operator is not forwarding watermarks correct

Re: [ANNOUNCE] Apache Flink 1.1.4.4 released

Thanks a lot for being our release manager Konstantin and everyone who involved! Best, Leonard > 2022年3月15日 下午9:34，Martijn Visser 写道： > > Thank you Konstantin and everyone who contributed!

回复：Re: Fwd: [DISCUSS] Flink's supported APIs and Hive query syntax

Hi, thanks for the inputs. ​I wrote a google doc “Plan for decoupling Hive connector with Flink planner” [1] that shows how to decouple Hive connector with planner. [1] https://docs.google.com/document/d/1LMQ_mWfB_mkYkEBCUa2DgCO2YdtiZV7YRs2mpXyjdP4/edit?usp=sharing Best, Yuxia.--

Re: [ANNOUNCE] Apache Flink 1.1.4.4 released

Thank you Konstantin and everyone who contributed! On Tue, 15 Mar 2022 at 14:22, Konstantin Knauf wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.14.4, which is the third bugfix release for the Apache Flink 1.14 > series. > > Apache Flink® is an open

[ANNOUNCE] Apache Flink 1.1.4.4 released

The Apache Flink community is very happy to announce the release of Apache Flink 1.14.4, which is the third bugfix release for the Apache Flink 1.14 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming a

RocksDB metrics for effective memory consumption

Hi, I am working on the analysis of the memory consumption of RocksDB state backend for simple DAGs. I would like to check fine-grained memory utilization of RocksDB with the native metrics (reported on Prometheus+Grafana). RocksDB uses Managed memory allocated to each TaskManager but this valu

Re: Setting S3 as State Backend in SQL Client

Just tried editing flink-conf.yaml and it seems SQL Client does not respect that also. Is this an intended behavior? On Tue, Mar 15, 2022 at 7:14 PM dz902 wrote: > Hi, > > I'm using Flink 1.14 and was unable to set S3 as state backend. I tried > combination of: > > SET state.backend='filesystem'

Setting S3 as State Backend in SQL Client

Hi, I'm using Flink 1.14 and was unable to set S3 as state backend. I tried combination of: SET state.backend='filesystem'; SET state.checkpoints.dir='s3://xxx/checkpoints/'; SET state.backend.fs.checkpointdir='s3://xxx/checkpoints/'; SET state.checkpoint-storage='filesystem' As well as: SET st

Flink sql client support k8s application mode？

Does Flink SQL client support k8s application mode?