Re: PyFlink SQL from Kafka to Iceberg issues

2023-07-09 Thread Dániel Pálma
t: name: flinkberg Best, Dani On Thu, Jun 29, 2023 at 9:06 AM Martijn Visser wrote: > Hi Dani, > > There are two things that I notice: > > 1. You're mixing different Flink versions (1.16 and 1.17): all Flink > artifacts should be from the same Flink version > 2. S3 plugins need

PyFlink SQL from Kafka to Iceberg issues

2023-06-24 Thread Dániel Pálma
Hey folks, Nice to meet ya'll! I'm trying to get the following stack up and running locally: - Kafka as source - pyFlink SQL - Iceberg on top of MinIO The goal is to have a pyflink script that reads data from a Kafka topic, does some transformations, and dumps it into an iceberg table. I have