Flink JDBC connect with secret

Hi, We plan to use JDBC SQL connector to read/write database. I saw JDBC connector use username and password. Is it possible to use secret(*.crt) to access database. I didn't find guideline how to use it. How to config jdbc with secret? val jdbc: JdbcConnectionOptions =

Re: High availability data clean up

Thanks for the replies, Yangze and Vijay! We are using standalone Flink on K8s (we created a K8s operator to manage the life cycle of the flink clusters (session mode)). Seems there is no way for the operator to know when these HA related configMaps are created (if the operator somehow can know

Re: SplitEnumeratorContext callAsync() cleanup

Hi Fabian, Here we are: https://issues.apache.org/jira/browse/FLINK-24622 Feel free to modify the description as I lazily copied and pasted our discussion here. Best, Mason > On Oct 22, 2021, at 3:31 AM, Fabian Paul wrote: > > Hi Mason, >

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thanks Chesnay and Martijn for managing this release and to everyone who contributed to it. Cheers, Till On Fri, Oct 22, 2021 at 11:04 AM Yangze Guo wrote: > Thank Chesnay, Martijn, and everyone involved! > > Best, > Yangze Guo > > On Fri, Oct 22, 2021 at 4:25 PM Yun Tang wrote: > > > >

Re: Upgrade from 1.13.1 to 1.13.2/1.13.3 failing

The only suggestion I can offer is to take a savepoint with 1.13.1 and try to restore from that. We will investigate the problem in https://issues.apache.org/jira/browse/FLINK-24621; currently we don't know why you are experiencing this issue. On 22/10/2021 16:02, Sweta Kalakuntla wrote:

Upgrade from 1.13.1 to 1.13.2/1.13.3 failing

Hi, We are seeing error while upgrading minor versions from 1.13.1 to 1.13.2. JobManager is unable to recover the checkpoint state. What would be the solution to this issue? Caused by: org.apache.flink.util.FlinkException: Could not retrieve checkpoint 2844 from state handle under

Re: Fwd: How to deserialize Avro enum type in Flink SQL?

Hi Peter, don't get confused by the year 2017 in the ticket. We had better Avro support in the meantime but this was based on the old type system around TypeInformation. Now we need to build up this support again for the new type system. I just found this ticket and found that the title fits.

flink to ignite

Any one has experience on this sink? Does it behave well on production?https://ignite.apache.org/docs/latest/extensions-and-integrations/streaming/flink-streamer We use Ignite widely in our products, will like to inject some data from flink directly to Ignite cache. Thanks.

Re: SplitEnumeratorContext callAsync() cleanup

Hi Mason, This seems to be a bug with the current KafkaSource and also the unified Sources in general. Can you open a bug ticket in jira? I think the enumerator should take of first joining all the async threads before closing the enumerator. Best, Fabian

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thank Chesnay, Martijn, and everyone involved! Best, Yangze Guo On Fri, Oct 22, 2021 at 4:25 PM Yun Tang wrote: > > Thanks for Chesnay & Martijn and everyone who made this release happen. > > Best > Yun Tang > > From: JING ZHANG > Sent: Friday, October 22, 2021

Re: how to delete all rows one by one in batch execution mode;shutdown cluster after all tasks finished

Hi! Thanks for your reply! I think i didn't make myself clear for problem 1, so i draw a picture. 1."tables in DB": things start at the database, and we sync the tables' changelog to dynamic tables by CDC tool. Each changelog includes RowData and RowKind such as INSERT / UPDATE / DELETE.

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thanks for Chesnay & Martijn and everyone who made this release happen. Best Yun Tang From: JING ZHANG Sent: Friday, October 22, 2021 10:17 To: dev Cc: Martijn Visser ; Jingsong Li ; Chesnay Schepler ; user Subject: Re: [ANNOUNCE] Apache Flink 1.13.3 released

Re: High availability data clean up

In HA mode the configMap will be retained after deletion of the deployment: https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/ha/kubernetes_ha/ ( Refer High availability data clean up) On Fri, Oct 22, 2021 at 8:13 AM Yangze Guo wrote: > For application mode, when the