Re: [ANNOUNCE] Apache Flink 1.17.0 released

2023-03-24 Thread Panagiotis Garefalakis
Congrats all! Well done! Cheers, Panagiotis On Fri, Mar 24, 2023 at 2:46 AM Qingsheng Ren wrote: > I'd like to say thank you to all contributors of Flink 1.17. Your support > and great work together make this giant step forward! > > Also like Matthias mentioned, feel free to leave us any

Re: [ANNOUNCE] Apache Flink 1.17.0 released

2023-03-24 Thread Panagiotis Garefalakis
Congrats all! Well done! Cheers, Panagiotis On Fri, Mar 24, 2023 at 2:46 AM Qingsheng Ren wrote: > I'd like to say thank you to all contributors of Flink 1.17. Your support > and great work together make this giant step forward! > > Also like Matthias mentioned, feel free to leave us any

Re: Bootstrapping multiple state within same operator

2023-03-24 Thread David Artiga
That sounds like a great hack :D I'll give it a try for sure. Thank you! /David On Fri, Mar 24, 2023 at 5:25 PM Schwalbe Matthias < matthias.schwa...@viseca.ch> wrote: > Hi David, > > … coming in late into this discussion > > > > We had a very similar problem and I found a simple way to

RE: Bootstrapping multiple state within same operator

2023-03-24 Thread Schwalbe Matthias
Hi David, … coming in late into this discussion We had a very similar problem and I found a simple way to implement priming savepoints with mixed keyed/operator state. The trick is this: * In your KeyedStateBootstrapFunction also implement CheckpointedFunction * In initializeState() you

Share Your Apache Flink Expertise at Community Over Code 2023 Fintech Track

2023-03-24 Thread Javier Borkenztain
Hello Apache Flink Community, I hope you are all doing well. As active Apache Software Foundation (ASF) community members, we share a strong interest in open-source technologies and their ability to drive innovation across various industries. In this spirit, I am thrilled to invite you to

RE: Is it possible to preserve chaining for multi-input operators?

2023-03-24 Thread Schwalbe Matthias
Hi Viacheslav, … back from vacation … you are welcome, glad to hear it worked out  Thias From: Viacheslav Chernyshev Sent: Thursday, March 16, 2023 5:34 PM To: user@flink.apache.org Subject: Re: Is it possible to preserve chaining for multi-input operators? Hi Matthias, Just wanted to

Re: [ANNOUNCE] Apache Flink 1.17.0 released

2023-03-24 Thread Qingsheng Ren
I'd like to say thank you to all contributors of Flink 1.17. Your support and great work together make this giant step forward! Also like Matthias mentioned, feel free to leave us any suggestions and let's improve the releasing procedure together. Cheers, Qingsheng On Fri, Mar 24, 2023 at 5:00 

Table API function and expression vs SQL

2023-03-24 Thread ravi_suryavanshi.yahoo.com via user
Hello Team,Need your advice on which method is recommended considering don't want to change my query code when the Flink is updated/upgraded to the higher version. Here I am seeking advice for writing the SQL using java code(Table API  function and Expression) or using pure SQL. I am assuming

Re: Is there a way to control the parallelism of auto-generated Flink operators of the FlinkSQL job graph?

2023-03-24 Thread Hang Ruan
Hi, Elkhan, I think this is an intended behavior. If the parallelism of an operator is not specified, it will be the same as the previous one instead of the default parallelism. Actually the table planner will help us to do most jobs. There should not be a way to modify the parallelism for every

Re: flink sql作业监控指标operator name和task name超长导致prometheus OOM问题

2023-03-24 Thread Weihua Hu
Hi, 现在不会过滤指标,可以尝试修改 PrometheusReporter 将不需要的 label 过滤掉 https://github.com/apache/flink/blob/master/flink-metrics/flink-metrics-prometheus/src/main/java/org/apache/flink/metrics/prometheus/AbstractPrometheusReporter.java#L104 需要注意这里的 key 的格式是 这种 Best, Weihua On Fri, Mar 24, 2023 at 2:47 PM

Re: flink写入mysql数据异常

2023-03-24 Thread Shammon FY
Hi 退订发送邮件到 user-zh-unsubscr...@flink.apache.org On Fri, Mar 24, 2023 at 1:23 PM 孙冬燕 wrote: > 退订 > -- > 发件人:小昌同学 > 发送时间:2023年3月24日(星期五) 13:22 > 收件人:user-zh > 抄 送:user-zh > 主 题:回复: flink写入mysql数据异常 > 好滴呀,谢谢您的建议; > >

flink sql作业监控指标operator name和task name超长导致prometheus OOM问题

2023-03-24 Thread casel.chen
使用prometheus监控flink sql作业,发现没一会儿工夫就将prometheus内存(30GB)占满了,查了一下是因为作业指标名称过长导致的,像flink sql作业这种operator name和task name默认是根据sql内容拼装的,一旦sql出现的列名很多就会导致指标名称过长。 请问这种情况Flink社区有什么建议?prometheus抓取的时候能够过滤掉吗?只保留operator_id和task_id。 要是自己想将现有拼装名称修改成哈希值的话应该改哪个类呢?谢谢!