Hello,
I ran into some issues when using the new KafkaSourceBuilder (running Flink 
1.12.2, scala 2.12.13, on ververica platform in a container with java 8). 
Initially it generated warnings on kafka configuration, but the job was able to 
consume and produce messages.


The configuration 'client.id.prefix' was supplied but isn't a known config.
The configuration 'partition.discovery.interval.ms' was supplied but isn't a 
known config.


Finally the job crashed with a checkpointing error:


java.lang.Exception: Could not perform checkpoint 10 for operator Source: 
progress source (4/6)#9.
....
Caused by: org.apache.flink.runtime.checkpoint.CheckpointException: Could not 
complete snapshot 10 for operator Source: progress source (4/6)#9. Failure 
reason: Checkpoint was declined.
...
Caused by: java.lang.IllegalArgumentException: Invalid negative offset



Switching back to using FlinkKafkaConsumer, the warnings on the kafka config 
disapeared, and the job was able to checkpoint successfully.

I'm wondering if the warnings and the errors are connected, and if there is a 
compatibility issue between the newer KafkaSourceBuilder and Kafka 2.5 ?

Thanks,
L

Reply via email to