[GitHub] flink pull request: Rename coGroupDataSet.scala to CoGroupDataSet....

2015-01-19 Thread hsaputra
GitHub user hsaputra opened a pull request: https://github.com/apache/flink/pull/324 Rename coGroupDataSet.scala to CoGroupDataSet.scala, and crossDataSet.scala to CrossDataSet.scala This PR contains changes to follow Scala style: -) Rename coGroupDataSet.scala to

[GitHub] flink pull request: [FLINK-1376] [runtime] Add proper shared slot ...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/318#discussion_r23195339 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/instance/SharedSlot.java --- @@ -0,0 +1,154 @@ +/* + * Licensed to the Apache

[jira] [Created] (FLINK-1419) DistributedCache doesn't preserver files for subsequent operations

2015-01-19 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-1419: --- Summary: DistributedCache doesn't preserver files for subsequent operations Key: FLINK-1419 URL: https://issues.apache.org/jira/browse/FLINK-1419 Project:

[GitHub] flink pull request: [FLINK-1003] Added spread out scheduling strat...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/60#issuecomment-70477464 I agree, too much has changed since the PR was opened. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282554#comment-14282554 ] Ufuk Celebi commented on FLINK-1372: [~till.rohrmann] do you have something to add?

[GitHub] flink pull request: [FLINK-1376] [runtime] Add proper shared slot ...

2015-01-19 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/318#discussion_r23163714 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/instance/SharedSlot.java --- @@ -0,0 +1,154 @@ +/* + * Licensed to the Apache Software

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282593#comment-14282593 ] Till Rohrmann commented on FLINK-1372: -- It always depends on the location from where

[GitHub] flink pull request: [FLINK-1328] Reworked semantic annotations

2015-01-19 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/311#issuecomment-70517390 IMO, users should only be allowed to set semantic properties though field expression strings. There should be no need to implement an own SemanticProperty class or

[GitHub] flink pull request: [FLINK-1372] [runtime] Fix akka logging

2015-01-19 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/321 [FLINK-1372] [runtime] Fix akka logging Fixes logging settings. The logging is now exclusively controlled by the logging properties provided to the system and thus removes akka.loglevel config

[jira] [Updated] (FLINK-1296) Add support for very large record for sorting

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1296: -- Fix Version/s: (was: 0.8) 0.9 Add support for very large record for

[jira] [Updated] (FLINK-1240) We cannot use sortGroup on a global reduce

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1240: -- Fix Version/s: (was: 0.8) 0.9 We cannot use sortGroup on a global

[jira] [Updated] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-937: - Fix Version/s: (was: 0.8) 0.9 Change the YARN Client to allocate all

[jira] [Updated] (FLINK-987) Extend TypeSerializers and -Comparators to work directly on Memory Segments

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-987: - Fix Version/s: (was: 0.8) 0.9 Extend TypeSerializers and -Comparators to

[jira] [Updated] (FLINK-1278) Remove the Record special code paths

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1278: -- Fix Version/s: (was: 0.8) 0.9 Remove the Record special code paths

[jira] [Updated] (FLINK-1297) Add support for tracking statistics of intermediate results

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1297: -- Fix Version/s: (was: 0.8) 0.9 Add support for tracking statistics of

[jira] [Updated] (FLINK-938) Change start-cluster.sh script so that users don't have to configure the JobManager address

2015-01-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-938: - Fix Version/s: (was: 0.8) 0.9 Change start-cluster.sh script so that users

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23169293 --- Diff: flink-clients/src/main/java/org/apache/flink/client/CliFrontend.java --- @@ -860,8 +910,50 @@ protected Properties getYarnProperties() throws

[GitHub] flink pull request: [FLINK-1406] update Flink compatibility notice

2015-01-19 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/314#issuecomment-70519951 Good to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-1392] Add Kryo serializer for Protobuf

2015-01-19 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/322 [FLINK-1392] Add Kryo serializer for Protobuf I've checked the added dependencies and its not overriding any versions and no transitive dependencies are added. You can merge this pull request into

[jira] [Assigned] (FLINK-1419) DistributedCache doesn't preserver files for subsequent operations

2015-01-19 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-1419: --- Assignee: Chesnay Schepler DistributedCache doesn't preserver files for subsequent

[jira] [Commented] (FLINK-1400) In local mode, the default TaskManager won't listen on the data port.

2015-01-19 Thread Sergey Dudoladov (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282314#comment-14282314 ] Sergey Dudoladov commented on FLINK-1400: - Thanks, Stephan. This solves my

[GitHub] flink pull request: [FLINK-1003] Added spread out scheduling strat...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann closed the pull request at: https://github.com/apache/flink/pull/60 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (FLINK-1003) Spread out scheduling strategy

2015-01-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reassigned FLINK-1003: Assignee: (was: Till Rohrmann) Spread out scheduling strategy

[jira] [Commented] (FLINK-1098) flatArray() operator that converts arrays to elements

2015-01-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282286#comment-14282286 ] Fabian Hueske commented on FLINK-1098: -- I like the idea +1 flatArray() operator

[GitHub] flink pull request: [FLINK-1296] Add sorter support for very large...

2015-01-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/249#issuecomment-70470401 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Commented] (FLINK-1418) Make 'print()' output on the client command line, rather than on the task manager sysout

2015-01-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282360#comment-14282360 ] Fabian Hueske commented on FLINK-1418: -- I agree, printing to the TMs std-out is

[jira] [Commented] (FLINK-1419) DistributedCache doesn't preserver files for subsequent operations

2015-01-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282393#comment-14282393 ] Fabian Hueske commented on FLINK-1419: -- I think it is fine to make files in the DC

[GitHub] flink pull request: [FLINK-1165] No createCollectionsEnvironment i...

2015-01-19 Thread ajaybhat
GitHub user ajaybhat opened a pull request: https://github.com/apache/flink/pull/320 [FLINK-1165] No createCollectionsEnvironment in Java API This commit adds a new method to ExecutionEnvironment to create a CollectionEnvironment, and applies the method to cases where a

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23169866 --- Diff: flink-clients/src/main/java/org/apache/flink/client/FlinkYarnSessionCli.java --- @@ -0,0 +1,429 @@ +/* + * Licensed to the Apache

[jira] [Commented] (FLINK-1098) flatArray() operator that converts arrays to elements

2015-01-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282679#comment-14282679 ] Stephan Ewen commented on FLINK-1098: - Can we do this with a special flatMapFunction,

[jira] [Commented] (FLINK-1400) In local mode, the default TaskManager won't listen on the data port.

2015-01-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282690#comment-14282690 ] Stephan Ewen commented on FLINK-1400: - Good point. The Webfrontend could write {{-1}}

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172243 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172407 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172849 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnClient.java --- @@ -0,0 +1,653 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23171500 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/net/NetUtils.java --- @@ -86,7 +86,7 @@ public static InetAddress

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172012 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23173072 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/FlinkYarnClient.java --- @@ -0,0 +1,653 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23170694 --- Diff: flink-clients/src/main/java/org/apache/flink/client/FlinkYarnSessionCli.java --- @@ -0,0 +1,429 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172386 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282739#comment-14282739 ] Till Rohrmann commented on FLINK-1372: -- I think, it should work now with my latest

[GitHub] flink pull request: [FLINK-1295][FLINK-883] Allow to deploy 'job o...

2015-01-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/292#discussion_r23172158 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -0,0 +1,379 @@ +/** + * Licensed to the Apache Software

[jira] [Commented] (FLINK-1372) TaskManager and JobManager do not log startup settings any more

2015-01-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282729#comment-14282729 ] Stephan Ewen commented on FLINK-1372: - The logging of startup options would happen in