Re: Suggestions on contributions

Hi, one thing that is often overlooked are examples. So if you have experience in some are and think you could benefit from implementing something in Flink then we would also be happy to have that example as part of Flink or in some other repository. This way users can learn by studying from

Re: Suggestions on contributions

Hi Aljoscha, thank you for your tip as well. I've started working on an issue on the examples, it can be a starting point to work on the examples some more. If I work on that, do you think I'd need a JIRA ticket to track that or it's enough to produce a PR with the examples? On Wed, Jan 20, 2016

[jira] [Created] (FLINK-3266) LocalFlinkMiniCluster leaks resources when multiple jobs are submitted

Gabor Gevay created FLINK-3266: -- Summary: LocalFlinkMiniCluster leaks resources when multiple jobs are submitted Key: FLINK-3266 URL: https://issues.apache.org/jira/browse/FLINK-3266 Project: Flink

[jira] [Created] (FLINK-3268) Unstable test JobManagerSubmittedJobGraphsRecoveryITCase

Stephan Ewen created FLINK-3268: --- Summary: Unstable test JobManagerSubmittedJobGraphsRecoveryITCase Key: FLINK-3268 URL: https://issues.apache.org/jira/browse/FLINK-3268 Project: Flink Issue

[jira] [Created] (FLINK-3267) Disable reference tracking in Kryo fallback serializer

Stephan Ewen created FLINK-3267: --- Summary: Disable reference tracking in Kryo fallback serializer Key: FLINK-3267 URL: https://issues.apache.org/jira/browse/FLINK-3267 Project: Flink Issue

[jira] [Created] (FLINK-3269) Return value from DataInputStream#read() should be checked in PythonPlanReceiver

Ted Yu created FLINK-3269: - Summary: Return value from DataInputStream#read() should be checked in PythonPlanReceiver Key: FLINK-3269 URL: https://issues.apache.org/jira/browse/FLINK-3269 Project: Flink

Re: maven dependency problem when building stream job

Hi Martin! It looks like your project added a rule to not allow a higher netty.io version. Any specific reason that the rule was added? Would be good to understand that, because the rule stands in conflict with Flink's dependencies. Flink internally has multiple uses of netty: Akka remote, Flink

[jira] [Created] (FLINK-3264) Add load shedding policy into Kafka Consumers

Robert Metzger created FLINK-3264: - Summary: Add load shedding policy into Kafka Consumers Key: FLINK-3264 URL: https://issues.apache.org/jira/browse/FLINK-3264 Project: Flink Issue Type:

Suggestions on contributions

Hello everyone, I’m Stefano Baghino and I’m a Software Engineer at Radicalbit ( www.radicalbit.io). Our company is working on a brand new OSS distribution focused on distributed, low-latency processing (“Fast Data”). Flink will play a pivotal role on our platform and we’re starting to work on

Re: Suggestions on contributions

Hi Stefano, awesome news. New contributors are always very welcome. I saw recently that you've recently looked into different starter issues, but you were a bit out of luck because others were already working on them. I saw your request on the "Rework examples" issue. I'll respond to it soon. I

Re: maven dependency problem when building stream job

Its using a maven-enforcer-plugin (see config below). The project itself does not use netty. I just discovered that I still compile fine from within IntelliJ I just cannot built it externally with maven (which I need to package the jar to deploy on Yarn). cheers Martin maven-enforcer-plugin

Re: maven dependency problem when building stream job

Hi Martin. can you try to exclude the netty dependency from your Flink dependencies? Another approach would be to disable the check, or add an exception to it ;) Why did you add the check in the first place? On Wed, Jan 20, 2016 at 2:13 PM, Martin Neumann wrote: > Its using

Re: Suggestions on contributions

Hi Robert, thanks for the quick reply and for the tips. Most of my past experience has been on geographical information systems, I'm currently evaluating the possibility of making some experiments at using Flink to process georeferenced data. Cassandra is a very interesting area and we'll

maven dependency problem when building stream job

Hi, I have a weird problem. Yesterday I had to clean my local maven cache for a different application. Since afterwards one of my Flink streaming jobs does not compile anymore. I didn't change any code just made maven pull all dependencies again. I'm totally stomped by this, please help me!

Re: maven dependency problem when building stream job

Hi Martin, is the logproc-flink project using the maven-enforcer-plugin to enforce a minimum version of netty? We recently downgraded (a minor version) of netty because of an issue. Maybe that's the issue. Can you check the enforcer rules of your project? On Wed, Jan 20, 2016 at 1:48 PM, Martin

Re: maven dependency problem when building stream job

Its a fork of a different project, so I didn't add it myself. I disabled it for now and so far it works, I will try to find out why it was there in the first place and if necessary find a workaround. thanks for the help Martin On Wed, Jan 20, 2016 at 2:32 PM, Robert Metzger

Re: Suggestions on contributions

Hi, somebody recently asked on the ML for a Cassandra connector: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Sink-Cassandra-td4107.html In that thread you'll also find this repository:

Re: Suggestions on contributions

Thank you very much for the pointers, we'll look into it. On Wed, Jan 20, 2016 at 3:09 PM, Robert Metzger wrote: > Hi, > > somebody recently asked on the ML for a Cassandra connector: > > >

[jira] [Created] (FLINK-3265) Unstable RabbitMQ test: MessageAcknowledgingSourceBase.notifyCheckpointComplete: ConcurrentModificationException

Robert Metzger created FLINK-3265: - Summary: Unstable RabbitMQ test: MessageAcknowledgingSourceBase.notifyCheckpointComplete: ConcurrentModificationException Key: FLINK-3265 URL:

Re: What is the topic & offset used for in KeyedDeserializationSchema.deserialize()?

Hi Gordon, I'll move the KeyedDeserializationSchema to the Kafka module. On Wed, Jan 20, 2016 at 8:24 AM, Tzu-Li (Gordon) Tai wrote: > Hi Stephan, > > A comment on this. For KeyedDeserializationSchema, I don't think it is > necessary. > As previously explained, the