Re: Flink 0.9 built with Scala 2.11

2015-07-06 Thread Alexander Alexandrov
Because we are using Scala in our runtime, all modules are Scala dependent module. If all modules will need the suffix after your PR is merged, why would you talk about pure/non-pure distinction in the documentation? This adds complexity and may cause confusion which at the moment can be spared.

Redesigned Features page

2015-07-06 Thread Stephan Ewen
Hi all! I think that the Features page of the website is a bit out of date. I made an effort to stub a new one. It is committed under features_new.md and not yet built as an HTML page. If you want to take a look and help building this, pull the flink-web git repository and build the website

Read 727 gz files ()

2015-07-06 Thread Felix Neutatz
Hi, I want to do some simple aggregations on 727 gz files (68 GB total) from HDFS. See code here: https://github.com/FelixNeutatz/wikiTrends/blob/master/extraction/src/main/scala/io/sanfran/wikiTrends/extraction/flink/Stats.scala We are using a Flink-0.9 SNAPSHOT. I get the following error:

Re: Redesigned Features page

2015-07-06 Thread Fabian Hueske
I'll be happy to help, eh draw ;-) 2015-07-06 15:22 GMT+02:00 Stephan Ewen se...@apache.org: Hi all! I think that the Features page of the website is a bit out of date. I made an effort to stub a new one. It is committed under features_new.md and not yet built as an HTML page. If you

Re: Read 727 gz files ()

2015-07-06 Thread Stephan Ewen
I think the error is pretty much exactly in the stack trace: Caused by: java.io.FileNotFoundException: /data/4/hadoop/tmp/flink-io-0e2460bf-964b-4883-8eee-12869b9476ab/ 995a38a2c92536383d0057e3482999a9.000329.channel (Too many open files in system) On Mon, Jul 6, 2015 at 3:31 PM, Felix

[jira] [Created] (FLINK-2321) The seed for the SVM classifier is currently static

2015-07-06 Thread Theodore Vasiloudis (JIRA)
Theodore Vasiloudis created FLINK-2321: -- Summary: The seed for the SVM classifier is currently static Key: FLINK-2321 URL: https://issues.apache.org/jira/browse/FLINK-2321 Project: Flink

Re: Read 727 gz files ()

2015-07-06 Thread Felix Neutatz
So do you know how to solve this issue apart from increasing the current file-max (4748198)? 2015-07-06 15:35 GMT+02:00 Stephan Ewen se...@apache.org: I think the error is pretty much exactly in the stack trace: Caused by: java.io.FileNotFoundException:

Re: [ml] Convergence Criterias

2015-07-06 Thread Sachin Goel
Sure. Usually, the convergence criterion can be user defined. For example, for a linear regression problem, user might want to run the training until the relative change in squared error falls below a specific threshold, or the weights fail to shift by a relative or absolute percentage.

Flink on Wikipedia

2015-07-06 Thread Matthias J. Sax
Hi squirrels, I am happy to announce Flink on Wikipedia: https://en.wikipedia.org/wiki/Apache_Flink The Logo Request is still pending, but should be online soon. -Matthias signature.asc Description: OpenPGP digital signature

Re: Redesigned Features page

2015-07-06 Thread Maximilian Michels
Hi Stephan, Thanks for the feature page update. I think it is much more informative and better structured now. By the way, you could also open a pull request for your changes on https://github.com/apache/flink-web/pulls Cheers, Max On Mon, Jul 6, 2015 at 3:28 PM, Fabian Hueske