Re: Flink Scala performance

2015-07-15 Thread Aljoscha Krettek
Hi, that depends. How are you executing the program? Inside an IDE? By starting a local cluster? And then, how big is your input data? Cheers, Aljoscha On Wed, 15 Jul 2015 at 23:45 Vinh June hoangthevinh@gmail.com wrote: I just realized that Flink program takes a lot of time to run, for

Re: problem with union

2015-07-15 Thread Maximilian Michels
Hi Michele, Thanks for reporting the problem. It seems like we changed the way we compare generic types like your GValue type. I'm debugging that now. We can get a fix in for the 0.9.1 release. Cheers, Max On Tue, Jul 14, 2015 at 5:35 PM, Michele Bertoni michele1.bert...@mail.polimi.it wrote:

Re: Flink Kafka runtime error

2015-07-15 Thread Wendong
Just found a workaround. I downloaded kafka_2.10-0.8.2.1.jar and flink-connector-kafka-0.9.0.jar, then put them into $FLINK_HOME/lib/. Now the runtime error is gone. But this is just a workaound. I believe there is a better solution. Wendong -- View this message in context:

Re: how can handles Any , All query on flink

2015-07-15 Thread hagersaleh
very thanks -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/how-can-handles-Any-All-query-on-flink-tp1997p2067.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: How can handles Exist ,not Exist query on flink

2015-07-15 Thread hagersaleh
please help I want example -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-can-handles-Exist-not-Exist-query-on-flink-tp1939p2068.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: open multiple file from list of uri

2015-07-15 Thread Michele Bertoni
uhm, it doesn’t seem to work: it calls the configure() method that checks if filePath is null and throws an exception Actually i set that field only during the createInputSplits that is some steps later Il giorno 15/lug/2015, alle ore 13:16, Stephan Ewen

Re: problem with union

2015-07-15 Thread Maximilian Michels
I was able to reproduce this problem. It turns out, this has already been fixed in the snapshot version: https://issues.apache.org/jira/browse/FLINK-2229 The fix will be included in the upcoming 0.9.1 release. Thank you again for reporting! Kind regards, Max On Wed, Jul 15, 2015 at 11:33 AM,

Re: Order groups by their keys

2015-07-15 Thread Fabian Hueske
Yes, going to parallelism 1 is another option but you don't have to use a fake-reduce to enforce sorting. You can simply do: DataSetTuple3Integer, String, String result = ... result .sortPartition(1, Order.ASCENDING).setParallelism(1) // sort on first String field .output(...); Fabian

Re: How to cancel a Flink DataSource from the driver code?

2015-07-15 Thread Stephan Ewen
Hi! You can also cancel jobs via the command line. See here: https://ci.apache.org/projects/flink/flink-docs-release-0.9/apis/cli.html There is also a way to do that programmatically, from Java or Scala. Greetings, Stephan On Wed, Jul 15, 2015 at 4:58 PM, LINZ, Arnaud al...@bouyguestelecom.fr