Reply: Re: Ipv6 supported?

Thanks for info Fabian! -Yow Hi, The networking libraries that Flink uses (Netty & Akka) support seem to support IPv6. So, it might work. However, I'm not aware of anybody running Flink on IPv6. Maybe somebody with more info could help out here? Best, Fabian Am Do., 6. Juni 2019 um 16:25

What happens when: high-availability.storageDir: is not available?

In HA setup what would happen if high-availability.storageDir: was unavailable?

Re: Flink 1.7.1 flink-s3-fs-hadoop-1.7.1 doesn't delete older chk- directories

Hi Fabian, Thank you. Your observation is correct. The stale directories belong to the failed checkpoints. So it is related to FLINK-10855. I will closely follow FLINK-10855 and test when fix is available Thank You, anaray -- Sent from:

Avro serde classes in Flink

Hello - Is there any specific reason we have AvroDeserializationSchema in Flink but not AvroSerializationSchema ? Instead we have AvroRowSerializationSchema, which serializes objects that are represented in (nested) Flink rows. regards. -- Debasish Ghosh http://manning.com/ghosh2

Re: RE: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

Hi Georgi, Thanks for your feedback. And glad to hear you are using queryable state. I agree that implementation of option 1 is easier than others. However, when we design the new architecture we need to consider more aspects .e.g. scalability. So it seems option 3 is more suitable. Actually,

RE: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

Hi Vino, I was investigating the current architecture and AFAIK the first proposal will be a lot easier to implement, cause currently JM has the information about the states (where, which etc thanks to KvStateLocationRegistry. Correct me if I’m wrong) We are using the feature and it’s indeed

Re: No yarn option in self-built flink version

Hey Arnaud, I think you need to active the Hadoop profile via -Pinclude-hadoop (the default was changed to not include Hadoop as far as I know). For more details, check out:

Re: Building Flink distribution with Scala2.12

https://ci.apache.org/projects/flink/flink-docs-master/flinkDev/building.html#scala-versions On 29/05/2019 15:29, Boris Lublinsky wrote: Thanks Martijn, this was it. It would be nice to have this in documentation. Boris Lublinsky FDP Architect boris.lublin...@lightbend.com

No yarn option in self-built flink version

Hello, I am trying to build my own flink distribution with proper Cloudera dependencies. Reading https://ci.apache.org/projects/flink/flink-docs-stable/flinkDev/building.html I've done : git clone https://github.com/apache/flink cd flink git checkout tags/release-1.8.0 $MAVEN_HOME/bin/mvn clean

Re: NotSerializableException: DropwizardHistogramWrapper inside AggregateFunction

Hi, There are two ways: 1. make the non-serializable member variable transient (meaning that it won't be serialized) and check in the aggregate call if it has been initialized or not. 2. implement your own serialization logic by overriding readObject() and writeObject() [1]. Best, Fabian [1]

Re: Flink 1.7.1 flink-s3-fs-hadoop-1.7.1 doesn't delete older chk- directories

Hi, I found a few issues in Jira that are related to not deleted checkpoint directories, but only FLINK-10855 [1] seems to be a possible reason in your case. Is it possible that the checkpoints of the remaining directories failed? If that's not the case, would you mind creating a Jira issue and

Re: Ipv6 supported?

Hi, The networking libraries that Flink uses (Netty & Akka) support seem to support IPv6. So, it might work. However, I'm not aware of anybody running Flink on IPv6. Maybe somebody with more info could help out here? Best, Fabian Am Do., 6. Juni 2019 um 16:25 Uhr schrieb Siew Wai Yow : > Hi