Re: Java 17 for Flink 1.17 supported?

2023-07-31 Thread xiangyu feng
Hi Patricia, JDK17 will be supported in 1.18 release. See more in this jira[1]. [1] https://issues.apache.org/jira/browse/FLINK-15736 Best, Xiangyu patricia lee 于2023年7月31日周一 16:25写道: > Hi, > > I was advised to upgrade the JDK of our flink 1.7 to 17. However, in the > documeation it only

RE: Flink netty connector for TCP source

2023-07-31 Thread Kamal Mittal via user
Hello, I created a custom server socket source in which opened server socket in split enumerator, source parallelism is =2 and it gives error while running - “Address is already in use” i.e. it tried to open two server sockets as per parallelism which is not correct as parallelism is

Re: Kafka Exception

2023-07-31 Thread Hang Ruan
Hi, Kenan. Maybe you should set the `client.id.prefix` to avoid the conflict. Best, Hang liu ron 于2023年7月31日周一 19:36写道: > Hi, Kenan > > After studying the source code and searching google for related > information, I think this should be caused by duplicate client_id [1], you > can check if

Re: Flink netty connector for TCP source

2023-07-31 Thread Hang Ruan
Hi, Kamal. The SplitEnumerator is contained in the SourceCoordinator. They are only used in JM. Best, Hang Kamal Mittal via user 于2023年8月1日周二 10:43写道: > Thanks. > > > > I looked at the link for custom data sources, one query here that how to > make sure for Split enumerator to execute on Job

RE: Flink netty connector for TCP source

2023-07-31 Thread Kamal Mittal via user
Thanks. I looked at the link for custom data sources, one query here that how to make sure for Split enumerator to execute on Job Manager rather than at Task manager? From: liu ron Sent: 31 July 2023 10:06 PM To: user@flink.apache.org Subject: Re: Flink netty connector for TCP source Hi,

Investigating use of Custom Trigger to smooth CPU usage

2023-07-31 Thread Tucker Harvey via user
Hello Flink community! My team is trying to optimize CPU usage on a running job, and we're exploring the option of offsetting the trigger time for smoother CPU patterns. Since adjusting the window will compromise job correctness, we plan to pursue a custom trigger implementation. We were

Re: Parallelism under reactive scaling with slot sharing groups

2023-07-31 Thread Allen Wang
We were using Flink 1.16. I did some research and it looks like it is fixed in Flink 1.17. On Thu, Jul 27, 2023 at 9:43 PM Weihua Hu wrote: > Hi, > > Which Flink version are you using? I haven't reproduced this issue by > using the master

Re: Unsubscribe

2023-07-31 Thread liu ron
Hi, Please send an email to user-unsubscr...@flink.apache.org in order to be removed from the User mailing list. Best, Ron yunchao li 于2023年7月17日周一 09:14写道: > Unsubscribe -- > >>

Re: Unsubscribe

2023-07-31 Thread liu ron
Hi, wang Please send an email to user-unsubscr...@flink.apache.org in order to be removed from the User mailing list. Best, Ron wang <24248...@163.com> 于2023年7月17日周一 23:10写道: > Unsubscribe >

Re: Unsubscribe

2023-07-31 Thread liu ron
Hi, William Please send an email to user-unsubscr...@flink.apache.org in order to be removed from the User mailing list. Best, Ron William Wang 于2023年7月17日周一 14:59写道: > >

Re: Flink netty connector for TCP source

2023-07-31 Thread liu ron
Hi, Kamal Currently, we don't provide the connector like TCP source in Flink main repo. If you need this connector, you can try to implement it refer to the FLIP-27 source docs [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/sources/ Best, Ron Shammon FY

Re: Metrics are not reported in Python UDF (used inside FlinkSQL) when exception is raised

2023-07-31 Thread liu ron
Hi, Elkhan I have one question, what metrics are not reported? Best, Ron Elkhan Dadashov 于2023年7月28日周五 05:46写道: > Hi Flinkers, > > Wanted to check if anyone else has faced this issue before: > > When Python UDF (which is used inside FlinkSQL) raises an exception, then > metrics get lost and

Re: Flink sql client doesn't work with "partition by" clause

2023-07-31 Thread liu ron
Hi, dongwoo You can check the SqlClient log first, I think the exception has been logged in SqlClient log file. Best, Ron Dongwoo Kim 于2023年7月31日周一 22:38写道: > > > -- Forwarded message - > 보낸사람: Dongwoo Kim > Date: 2023년 7월 31일 (월) 오후 11:36 > Subject: Re: Flink sql client

Fwd: Flink sql client doesn't work with "partition by" clause

2023-07-31 Thread Dongwoo Kim
-- Forwarded message - 보낸사람: Dongwoo Kim Date: 2023년 7월 31일 (월) 오후 11:36 Subject: Re: Flink sql client doesn't work with "partition by" clause To: liu ron Hi, ron. Actually I'm not receiving any exception message when executing the *partition by* clause in the Flink SQL

Re: Logs of Kafka payload in Table Api connector of Apache Flink

2023-07-31 Thread liu ron
Hi, elakiya If you want to log the deserialize avro record, you should modify the code in [1]. 1. https://github.com/apache/flink/blob/70e635983dc9aa4bd772042f34a04099256a8750/flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/RegistryAvroDeserializationSchema.java#L81 Best,

Re: Kafka Exception

2023-07-31 Thread liu ron
Hi, Kenan After studying the source code and searching google for related information, I think this should be caused by duplicate client_id [1], you can check if there are other jobs using the same group_id in consuming this topic. group_id is used in Flink to assemble client_id [2], if there are

Re: Suggestions for Open Source FLINK SQL editor

2023-07-31 Thread liu ron
Hi Rajat, I also think Zeppelin may be a good choice. Best, Ron Guanghui Zhang 于2023年7月28日周五 20:45写道: > Hi, Guozhen, our team also use flink as ad-hoc query engine. Can we talk > aboat it > > Guozhen Yang 于2023年7月20日周四 11:58写道: > >> Hi Rajat, >> >> We are using apache zeppelin as our entry

Re: Java 17 for Flink 1.17 supported?

2023-07-31 Thread Tamir Sagi
Hey, JDK 17 support Epic [1] is closed and seems to be delivered along with Flink 1.18. [1] https://issues.apache.org/jira/browse/FLINK-15736 From: patricia lee Sent: Monday, July 31, 2023 11:24 AM To: user@flink.apache.org Subject: Java 17 for Flink 1.17

Java 17 for Flink 1.17 supported?

2023-07-31 Thread patricia lee
Hi, I was advised to upgrade the JDK of our flink 1.7 to 17. However, in the documeation it only says in bold "Java 11". Is java 17 support will starton flink 1.18 release? Thanks