RE: Flink 1.11.3 NoClassDefFoundError: Could not initialize class

2021-05-25 Thread Georgi Stoyanov
) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:721) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:546) at java.lang.Thread.run(Thread.java:748) From: Piotr Nowojski Sent: Tuesday, May 25, 2021 6:18 PM To: Georgi Stoyanov Cc: user@flink.apache.org Subject: Re: Flink 1.11.3 NoClassDefFoundError

Flink 1.11.3 NoClassDefFoundError: Could not initialize class

2021-05-25 Thread Georgi Stoyanov
Hi all, We have running several Flink jobs on k8s with flink 1.11.3 and recently we notice that some of them are constantly restarting with the following exception. After restart, everything is working as expected. Could this be a bug? 2021-05-25 17:04:42

Sync two DataStreams

2020-04-03 Thread Georgi Stoyanov
Hi, I want to implement a flow where the data from one stream is needed to validate data for second stream when the job is started without a savepoint or checkpoint. Both of them are reading from kafka. I want the data in the first one to be fully read and then to check the events from the

RE: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-06-07 Thread Georgi Stoyanov
Hi Vino, I was investigating the current architecture and AFAIK the first proposal will be a lot easier to implement, cause currently JM has the information about the states (where, which etc thanks to KvStateLocationRegistry. Correct me if I’m wrong) We are using the feature and it’s indeed

get custom gauge metric from WebMonitorEndpoint

2019-04-23 Thread Georgi Stoyanov
I've got custom metric -> [cid:0dbd2582-19b6-4a0e-9dff-49471e973c4c] And I'm using them as suggested in the documentation -> getRuntimeContext().getMetricGroup().gauge("MyCustomMetric", new TestMetric()); I want to get this metric with GET method, but so far I tried almost everything in the

Upgrade Flink with newer Java version

2018-10-01 Thread Georgi Stoyanov
Hi, Oracle will stop support for Java 8 on Jan 2019. Do you guys plans to upgrade the version? If so, do you have ticket which we can watch for updates? Regards, G. Stoyanov

RE: Looking for a working POM file example for EMR cluster

2018-06-01 Thread Georgi Stoyanov
Hi, Did you check solutions from here - https://stackoverflow.com/questions/48904881/could-not-resolve-substitution-to-a-value-akka-stream-materializer-in-aws-la Regards, Georgi Stoyanov From: Sandybayev, Turar (CAI - Atlanta) Sent: Thursday, May 31

Delete Flink logs from YARN in a lifetime running job

2018-05-22 Thread Georgi Stoyanov
Hi guys, I have the following set – Yarn on top of Hadoop 2.8 and Flink on it and running it on 2-3 nodes. The problem is that during the running of the job the log files are growing and I’m not able to delete them, cause there is lock on them. I don’t want to stop the job in order to release

RE: How to Flink can solve this example

2018-05-18 Thread Georgi Stoyanov
Hi Esa :) I don't think that there are people here that want to make your homework. Think about, read flink's documentation and ask concrete questions. Anyway - I took a look and think that it's possible. Regards, Georgi From: Esa Heikkinen [mailto:esa.heikki...@student.tut.fi] Sent: Thursday,

RE: Using two different configurations for StreamExecutionEnvironment

2018-05-09 Thread Georgi Stoyanov
From: Chesnay Schepler <ches...@apache.org> Sent: Wednesday, May 9, 2018 3:19:19 PM To: Georgi Stoyanov; user@flink.apache.org Subject: Re: Using two different configurations for StreamExecutionEnvironment The jobs are still executed in local JVM along with the cluster, so

RE: Using two different configurations for StreamExecutionEnvironment

2018-05-09 Thread Georgi Stoyanov
t Rule and takes care of everything needed to run any job against the cluster it sets up internally. For previous versions have your test class extend StreamingMultipleProgramsTestBase. The test method would simply call the main method of your job. On 09.05.2018 11:55, Georgi Stoyanov wrote: Hi,

RE: Recommended books

2018-05-09 Thread Georgi Stoyanov
Hi Esa, Afaik, there’s no other resource about using Scala in Flink except the documentation & the blog - https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/scala_api_extensions.html https://flink.apache.org/blog/ If you want something only for scala -

Using two different configurations for StreamExecutionEnvironment

2018-05-09 Thread Georgi Stoyanov
Hi, folks We have an Util that creates for us StreamExecutionEnvironment with some Checkpoint Configurations. The configuration for externalized checkpoints and state backend fails running of the job locally from IntelliJ. As a solution we currently comment those two configurations, but I

Configure provided libraries with maven

2018-05-03 Thread Georgi Stoyanov
some libraries to be duplicated/overlapping) Regards, Georgi Stoyanov

Use gradle with flink

2018-04-24 Thread Georgi Stoyanov
Hi guys, I’m wondering is it possible to setup my java flink application with gradle? I’m confused cause everywhere win the stackoverflow/documentation is used maven only :/ Kind Regards, Georgi Stoyanov