Re: Disable hostname verification in Opensearch Connector

Hi, Eugenio. Maybe you could configure RestClientBuilder manually to setSSLHostnameVerifier ? On Fri, Jun 23, 2023 at 4:06 PM Eugenio Marotti < ing.eugenio.maro...@gmail.com> wrote: > Hi, > > I’m currently using the Opensearch Connector for the Table API. For > testing I need to disable the

Re: table.exec.state.ttl not working as expected

Hi, neha. Could you share more information: 1. Which State Backend are you using? If it's RocksDB, is incremental checkpointing enabled? 2. Which specific operator is experiencing an increase in Checkpoint data size? (You can check the Checkpoint size changes of different subtasks

Re: Savepoint Failing - Flink 1.16.2 - Scala12

Hi, Shrihari. It seems related to https://issues.apache.org/jira/browse/FLINK-28758 which is unresolved now. It should only occur in FlinkKafkaConsumer, So you could migrate to KafkaSource to avoid this issue. On Sat, Jun 24, 2023 at 2:46 AM Shrihari R wrote: > I am trying to stop the job by

Re: RocksDB State Backend GET returns null intermittently

Hi, Prabhu. This is a correctness issue. IIUC, It should not be related to the size of the block cache, write buffer, or whether the bloom filter is enabled. Is your job a DataStream job? Does the job contain a custom Serializer? You could check or share the logic of the Serializer, as this is

Re: Unsubscribe

Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from user@flink.apache.org, and you can refer [1][2] for more details. 请发送任意内容的邮件到 user-unsubscr...@flink.apache.org 地址来取消订阅来自 user@flink.apache.org 邮件组的邮件，你可以参考[1][2] 管理你的邮件订阅。 Best, Hang [1]

Re: Admin Client Configs

Hi, Razin. You could pass these Kafka configuration in the format 'properties.*'. For example, 'properties.allow.auto.create.topics' = 'false'. See more in Kafka connector docs[1]. Best, Hang [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/table/kafka/#properties

Re: Query on Flink SQL primary key for nested field

Hi elakiya, I think you may need to spread the columns in key and value format, then you can use the specific column as a primary key in the ddl. Best, Shammon FY On Fri, Jun 23, 2023 at 6:36 PM elakiya udhayanan wrote: > Hi team, > > I have a Kafka topic named employee which uses confluent

ERROR: Using customized egress connector within Flink StateFun

Hi, I've managed to use a customized egress connector in Flink Statefun but encountered some errors. I have implemented the following code. File:ModuleWithSinkSpec.java import java.util.Map; import org.apache.flink.statefun.flink.io.datastream.SinkFunctionSpec; import

Waiting for completion of multiple asynchronous messages in StateFun

Hi : ) I'm learning statefun and have a question: *How to implement the functionality of waiting for completion of multiple asynchronous messages.* For example, if Function A needs to send message b to multiple instances (B1, B2, B3) of Function B after A receiving message a. Each instance of

Re: [DISCUSS] Status of Statefun Project

Great -- thanks! I'm going to be out of town for about a week but I'll take a look at this when I'm back. On Tue, Jun 20, 2023 at 8:46 AM Martijn Visser wrote: > Hi Galen, > > Yes, I'll be more than happy to help with Statefun releases. > > Best regards, > > Martijn > > On Tue, Jun 20, 2023 at

PyFlink SQL from Kafka to Iceberg issues

Hey folks, Nice to meet ya'll! I'm trying to get the following stack up and running locally: - Kafka as source - pyFlink SQL - Iceberg on top of MinIO The goal is to have a pyflink script that reads data from a Kafka topic, does some transformations, and dumps it into an iceberg table. I have