Re: How to migrate Kafka Producer ?

2019-01-07 Thread Edward Rojas
Hi Piotr, Thank you for looking into this. Do you have an idea when next version (1.7.2) will be available ? Also, could you validate / invalidate the approach I proposed in the previous comment ? Edward Rojas wrote > Regarding the kafka producer I am just updating the job with the new >

Re: How to migrate Kafka Producer ?

2019-01-02 Thread Piotr Nowojski
Hi Edward, Sorry for coming back so late (because of holiday season). You are unfortunately right. Our FlinkKafkaProducer should have been upgrade-able, but it is not. I have created a bug for this [1]. For the time being, until we fix the issue, you should be able to stick to 0.11 producer

Re: How to migrate Kafka Producer ?

2018-12-19 Thread Edward Alexander Rojas Clavijo
Hi Dawid, Piotr, I see that for the kafka consumer base there are some migration tests here: https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBaseMigrationTest.java As the kafka

Re: How to migrate Kafka Producer ?

2018-12-19 Thread Dawid Wysakowicz
Hi Edward, AFAIK we do not support migrating state from one connector to another one, which is in fact the case for kafka 0.11 and the "universal" one. You might try to use the project bravo[1] to migrate the state manually, but unfortunately you have to understand the internals of both of the

How to migrate Kafka Producer ?

2018-12-18 Thread Edward Rojas
Hi, I'm planning to migrate from kafka connector 0.11 to the new universal kafka connector 1.0.0+ but I'm having some troubles. The kafka consumer seems to be compatible but when trying to migrate the kafka producer I get an incompatibility error for the state migration. It looks like the