Re: Can checkpoints be used to migrate jobs between Flink versions ?

2019-01-09 Thread Edward Alexander Rojas Clavijo
run -s" parameter. > > > > Could you help to clarify if this is advised (and supported) or we should > > stick to the use of savepoints for this kind of manipulations ? > > > > > > Thanks in advance for your help. > > > > Edward > > > > > > > > -- > > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ > > -- *Edward Alexander Rojas Clavijo* *Software EngineerHybrid CloudIBM France*

Re: How to migrate Kafka Producer ?

2018-12-19 Thread Edward Alexander Rojas Clavijo
Hi Dawid, Piotr, I see that for the kafka consumer base there are some migration tests here: https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBaseMigrationTest.java As the kafka

Re: BucketingSink vs StreamingFileSink

2018-11-21 Thread Edward Alexander Rojas Clavijo
for this case it's > > recommended to use that option(?). > > Is it possible to use the Parquet writers even when the schema of the > data > > may evolve ? > > > > Thanks in advance for your help. > > (Sorry if I put too many questions in the same message) > > > > > > > > -- > > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ > > -- *Edward Alexander Rojas Clavijo* *Software EngineerHybrid CloudIBM France*

Re: After OutOfMemoryError State can not be readed

2018-09-07 Thread Edward Alexander Rojas Clavijo
m.readUTF(DataInputStream.java:618) >> at java.io.DataInputStream.readUTF(DataInputStream.java:573) >> at >> >> org.apache.flink.api.java.typeutils.runtime.PojoSerializer.deserialize(PojoSerializer.java:381) >> at >> >> org.apache.flink.contrib.streaming.state.RocksDBValueState.value(RocksDBValueState.java:87) >> ... 12 more >> >> >> Thanks in advance for any help >> >> >> >> >> -- >> Sent from: >> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >> > > -- *Edward Alexander Rojas Clavijo* *Software EngineerHybrid CloudIBM France*

Re: Dynamically deleting kafka topics does not remove partitions from kafkaConsumer

2018-05-07 Thread Edward Alexander Rojas Clavijo
Hello, I've being working on a fix for this, I posted more details on the JIRA ticket. Regards, Edward 2018-05-07 5:51 GMT+02:00 Tzu-Li (Gordon) Tai : > Ah, correct, sorry for the incorrect link. > Thanks Ted! > > > On 7 May 2018 at 11:43:12 AM, Ted Yu (yuzhih...@gmail.com)

Re: Regression: On Flink 1.5 CLI -m,--jobmanager option not working

2018-04-27 Thread Edward Alexander Rojas Clavijo
https://issues.apache.org/jira/browse/FLINK-9255. >> >> Do you have any thoughts about it ? >> >> Regards, >> Edward >> >> >> >> -- >> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4. >> nabble.com/ >> >> > -- *Edward Alexander Rojas Clavijo* *Software EngineerHybrid CloudIBM France*

Re: SSL config on Kubernetes - Dynamic IP

2018-03-29 Thread Edward Alexander Rojas Clavijo
, Edward 2018-03-28 17:22 GMT+02:00 Edward Alexander Rojas Clavijo < edward.roja...@gmail.com>: > Hi Till, > > I just created the JIRA ticket: https://issues.apache.org/ > jira/browse/FLINK-9103 > > I added the JobManager and TaskManager logs, Hope this helps to resolve

Re: SSL config on Kubernetes - Dynamic IP

2018-03-28 Thread Edward Alexander Rojas Clavijo
t can >> theoretically take a different IP? Or do I miss something? >> >> -- >> Christophe >> >> On Tue, Mar 27, 2018 at 3:24 PM, Edward Alexander Rojas Clavijo < >> edward.roja...@gmail.com> wrote: >> >>> Hi all, >>> &

SSL config on Kubernetes - Dynamic IP

2018-03-27 Thread Edward Alexander Rojas Clavijo
Hi all, Currently I have a Flink 1.4 cluster running on kubernetes and with SSL configuration based on https://ci.apache.org/projects/flink/flink-docs- master/ops/security-ssl.html. However, as the IP of the nodes are dynamic (from the nature of kubernetes), we are using only the DNS which we