Re: Improve the documentation of the Flink Architecture and internals

2015-03-16 Thread Aljoscha Krettek
Why do you wan't to split stuff between the doc in the repository and the wiki. I for one would always be to lazy to check stuff in a wiki when there is also a documentation. Plus, this would lead to additional overhead in deciding what goes where and syncing between the two places for

Introduction of new Gelly developper

2015-03-16 Thread Yi ZHOU
Hello, everyone, I am ZHOU Yi, a student working in graph algorithm, especially graph combinatorial algorithms. I am glad to join the Flink devlopping group. I am working on Gelly graph library, hopping to devote improvements and new features to Gelly graph library (algorithms library, graph

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-16 Thread Maximilian Michels
+1 for enforcing a more strict Java code style. However, let's not introduce a line legth of 100 like in Scala. I think that's hurting readability of the code. On Sat, Mar 14, 2015 at 4:41 PM, Ufuk Celebi u...@apache.org wrote: On Saturday, March 14, 2015, Aljoscha Krettek aljos...@apache.org

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-16 Thread Alexander Alexandrov
+1 for not limiting the line length. 2015-03-16 14:39 GMT+01:00 Stephan Ewen se...@apache.org: +1 for not limiting the line length. Everyone should have a good sense to break lines. When in exceptional cases people violate this, it is usually for a good reason. On Mon, Mar 16, 2015 at 2:18

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-16 Thread Hermann Gábor
+1 for the stricter Java code styles. We should not forget about providing code formatter settings for Eclipse and Intellij IDEA (as mentioned above). That would help a lot. (Of course if we'll use Google Code Style, they already provide such files

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-16 Thread Márton Balassi
+1 for Max's suggestion. On Mon, Mar 16, 2015 at 10:32 AM, Ufuk Celebi u...@apache.org wrote: On Fri, Mar 13, 2015 at 6:08 PM, Maximilian Michels m...@apache.org wrote: Thanks for starting the discussion. We should definitely not keep flink-expressions. I'm in favor of DataTable for

[jira] [Created] (FLINK-1706) Add disk spilling to BarrierBuffer

2015-03-16 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-1706: - Summary: Add disk spilling to BarrierBuffer Key: FLINK-1706 URL: https://issues.apache.org/jira/browse/FLINK-1706 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-16 Thread Hermann Gábor
+1 for DataTable On Mon, Mar 16, 2015 at 4:11 PM Till Rohrmann trohrm...@apache.org wrote: +1 for DataTable On Mon, Mar 16, 2015 at 10:34 AM, Márton Balassi balassi.mar...@gmail.com wrote: +1 for Max's suggestion. On Mon, Mar 16, 2015 at 10:32 AM, Ufuk Celebi u...@apache.org wrote:

[jira] [Created] (FLINK-1708) KafkaSink not working from Usercode classloader

2015-03-16 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1708: - Summary: KafkaSink not working from Usercode classloader Key: FLINK-1708 URL: https://issues.apache.org/jira/browse/FLINK-1708 Project: Flink Issue Type:

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-16 Thread Till Rohrmann
Do we already enforce the official Scala style guide strictly? On Mon, Mar 16, 2015 at 4:57 PM, Aljoscha Krettek aljos...@apache.org wrote: I'm already always sticking to the official Scala style guide, with the exception of 100 line length. On Mar 16, 2015 3:27 PM, Till Rohrmann

[jira] [Created] (FLINK-1709) Add support for programs with higher-than-slot parallelism

2015-03-16 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1709: -- Summary: Add support for programs with higher-than-slot parallelism Key: FLINK-1709 URL: https://issues.apache.org/jira/browse/FLINK-1709 Project: Flink Issue

Re: Could not build up connection to JobManager

2015-03-16 Thread Till Rohrmann
It is really strange. It's right that the CliFrontend now resolves localhost to the correct local address 10.218.100.122. Moreover, according to the logs, the JobManager is also started and binds to akka.tcp:// flink@10.218.100.122:6123. According to the logs, this is also the address the

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-16 Thread Fabian Hueske
I am also more in favor of Rel and Relation, but DataTable nicely follows the terms DataSet and DataStream. On Mar 16, 2015 4:58 PM, Aljoscha Krettek aljos...@apache.org wrote: I like Relation or Rel, is shorter. On Mar 16, 2015 4:52 PM, Hermann Gábor reckone...@gmail.com wrote: +1 for

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-16 Thread Aljoscha Krettek
I'm already always sticking to the official Scala style guide, with the exception of 100 line length. On Mar 16, 2015 3:27 PM, Till Rohrmann trohrm...@apache.org wrote: +1 for stricter Java code styles. I haven't looked into the Google Code Style but maybe we make it easier for new contributors

Re: Could not build up connection to JobManager

2015-03-16 Thread Till Rohrmann
Could you please upload the logs? They would be really helpful. On Mon, Mar 16, 2015 at 6:11 PM, Dulaj Viduranga vidura...@icloud.com wrote: Hi, I tested the update but it’s still the same. I think it isn’t a problem with my system because, I have an XAMPP server working totally fine (I

Re: Improve the documentation of the Flink Architecture and internals

2015-03-16 Thread Stephan Ewen
I have put my suggested version of an outline for the docs into the wiki. Regardless where the docs end up (wiki or repository), we can use the wiki to outline the docs. https://cwiki.apache.org/confluence/display/FLINK/Flink+Internals Some pages contain some stub or outline, others are

Re: Improve the documentation of the Flink Architecture and internals

2015-03-16 Thread Stephan Ewen
I think the Wiki has a much lower barrier of entry to fix docs, especially for external people. The docs, with the Jekyll setup, is rather tricky. I would very much like that all kinds of people contribute to the docs about the internals, not just the usual three suspects that have done this so

Re: Could not build up connection to JobManager

2015-03-16 Thread Ufuk Celebi
There was an issue for this: https://issues.apache.org/jira/browse/FLINK-1634 Can we close it then? On Sat, Mar 14, 2015 at 9:16 PM, Dulaj Viduranga vidura...@icloud.com wrote: Hay Stephan, Great to know you could fix the issue. Thank you on the update. Best regards. On Mar 14, 2015, at

Re: [DISCUSS] Offer Flink with Scala 2.11

2015-03-16 Thread Alexander Alexandrov
Popping up this thread. The PR build passes and we need some sort of strategy (add suffix to packages or force manual build for 2.11) before we merge. 2015-03-11 19:15 GMT+01:00 Robert Metzger rmetz...@apache.org: Thank you for opening the pull request. It looks great so far. There came up