Re: [DISCUSS] Status of Statefun Project

2023-08-11 Thread Galen Warren via user
I'm done with the code to make Statefun compatible with Flink 1.16, and all the tests (including e2e succeed). The required changes were pretty minimal. I'm running into a bit of a chicken/egg problem executing the tests in flink-statefun-playground

Conversion expects insert-only records but DataStream API record contains: UPDATE_BEFORE

2023-08-11 Thread ??????
Flink??1.15.2 I am now going to change the data stream from DataStream

Flink throws exception when submitting a job through Jenkins and Spinnaker

2023-08-11 Thread elakiya udhayanan
Hi Team, We are using Apache Flink 1.16.1 configured as a standalone Kubernetes pod ,for one of our applications to read from confluent Kafka topics to do event correlation. We are using the flink's Table API join for the same (in SQL format).We are able to submit the job using the flink's UI. For

Re: Local process and Docker have different behavior

2023-08-11 Thread liu ron
Hi, Daniel > 1. The file source appears to not always read all of the files that are in my source directory. There are 3 files that I'm reading in a directory. It will sometimes skip one, seemingly at random. What version of Flink are you using? This looks strange, I think you could check the log

Re: Questions related to Autoscaler

2023-08-11 Thread liu ron
Hi, zhanghao Thanks for your reply, it also looks good to me. Chen Zhanghao 于2023年8月11日周五 09:23写道: > Q1: if you use operator to submit a standalone mode job with reactive mode > enabled, KEDA should still work. > > Q2: For Flink versions, 1.17 is recommended, but 1.15 is also okay if you > back

Re: Global/Shared objects

2023-08-11 Thread liu ron
Hi, Kamal This is possible, you can use static variable. Best, Ron Hang Ruan 于2023年8月11日周五 13:46写道: > Hi, Kamal. > > Each TaskManager is a JVM process and each task slot is a thread of the > TaskManager. More information see [1]. > The static fields could be shared among subtasks in the same T