[GitHub] flink pull request: [FLINK-1350] [runtime] Add blocking result par...

2015-03-10 Thread uce
GitHub user uce opened a pull request: https://github.com/apache/flink/pull/471 [FLINK-1350] [runtime] Add blocking result partition variant - **Renames** runtime intermediate result classes (after an offline discussion with @StephanEwen I realized that calling subpartitions

[jira] [Commented] (FLINK-1350) Add blocking intermediate result partitions

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354633#comment-14354633 ] ASF GitHub Bot commented on FLINK-1350: --- GitHub user uce opened a pull request:

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/454#issuecomment-78022132 Here are some points to double check - You exclude all the `flink-clients` web docs from the uberjar. I would guess this breaks the webclient, because it uses

[jira] [Commented] (FLINK-1219) Add support for Apache Tez as execution engine

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354597#comment-14354597 ] ASF GitHub Bot commented on FLINK-1219: --- Github user rmetzger commented on a diff in

[jira] [Created] (FLINK-1671) Add execution modes for programs

2015-03-10 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1671: --- Summary: Add execution modes for programs Key: FLINK-1671 URL: https://issues.apache.org/jira/browse/FLINK-1671 Project: Flink Issue Type: Bug Affects

[GitHub] flink pull request: [FLINK-1219] Add support for Apache Tez as exe...

2015-03-10 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/189#issuecomment-78025522 The documentation is very well written. I've tried the pull request on a Hortonworks Sandbox with HDP 2.2. They have Tez 0.5.2.2.2.0.0 installed there.

[jira] [Created] (FLINK-1672) Refactor task registration/unregistration

2015-03-10 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1672: -- Summary: Refactor task registration/unregistration Key: FLINK-1672 URL: https://issues.apache.org/jira/browse/FLINK-1672 Project: Flink Issue Type: Improvement

[jira] [Closed] (FLINK-1368) Change memory management settings for Streaming programs

2015-03-10 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-1368. - Resolution: Duplicate Replaced by the more general https://issues.apache.org/jira/browse/FLINK-1671

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/454#discussion_r26108289 --- Diff: flink-shaded-hadoop/flink-shaded-include-yarn/pom.xml --- @@ -0,0 +1,286 @@ +?xml version=1.0 encoding=UTF-8? +!-- +Licensed to the

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354600#comment-14354600 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354601#comment-14354601 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354599#comment-14354599 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354603#comment-14354603 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354602#comment-14354602 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/454#discussion_r26108269 --- Diff: flink-shaded-hadoop/flink-shaded-hadoop2/pom.xml --- @@ -0,0 +1,183 @@ +?xml version=1.0 encoding=UTF-8? +!-- +Licensed to the Apache

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/454#discussion_r26108259 --- Diff: flink-shaded-hadoop/flink-shaded-hadoop2/pom.xml --- @@ -0,0 +1,183 @@ +?xml version=1.0 encoding=UTF-8? +!-- +Licensed to the Apache

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/454#discussion_r26108281 --- Diff: flink-shaded-hadoop/flink-shaded-include-yarn/pom.xml --- @@ -0,0 +1,286 @@ +?xml version=1.0 encoding=UTF-8? +!-- +Licensed to the

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/454#discussion_r26108286 --- Diff: flink-shaded-hadoop/flink-shaded-include-yarn/pom.xml --- @@ -0,0 +1,286 @@ +?xml version=1.0 encoding=UTF-8? +!-- +Licensed to the

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354605#comment-14354605 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354604#comment-14354604 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354606#comment-14354606 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/454#discussion_r26108294 --- Diff: flink-shaded-hadoop/flink-shaded-include-yarn/pom.xml --- @@ -0,0 +1,286 @@ +?xml version=1.0 encoding=UTF-8? +!-- +Licensed to the

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/454#discussion_r26108278 --- Diff: flink-shaded-hadoop/flink-shaded-include-yarn/pom.xml --- @@ -0,0 +1,286 @@ +?xml version=1.0 encoding=UTF-8? +!-- +Licensed to the

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354608#comment-14354608 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on the

[jira] [Created] (FLINK-1670) Collect method for streaming

2015-03-10 Thread JIRA
Márton Balassi created FLINK-1670: - Summary: Collect method for streaming Key: FLINK-1670 URL: https://issues.apache.org/jira/browse/FLINK-1670 Project: Flink Issue Type: New Feature

[jira] [Commented] (FLINK-1652) Wrong superstep number in VertexCentricIteration in Collection mode

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354634#comment-14354634 ] ASF GitHub Bot commented on FLINK-1652: --- Github user vasia commented on the pull

[GitHub] flink pull request: [FLINK-1652] fixes superstep increment in Coll...

2015-03-10 Thread vasia
Github user vasia commented on the pull request: https://github.com/apache/flink/pull/464#issuecomment-78026811 Thanks for the tip! I'll update the test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354598#comment-14354598 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on a diff

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/454#discussion_r26108253 --- Diff: flink-shaded-hadoop/flink-shaded-hadoop1/pom.xml --- @@ -0,0 +1,79 @@ +?xml version=1.0 encoding=UTF-8? +!-- +Licensed to the Apache

[GitHub] flink pull request: [streaming] [wip] Fault tolerance prototype (f...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/459#issuecomment-78028222 Testing so far indicates all issues are fixed. Rebasing worked without problems... --- If your project is set up for it, you can reply to this email and have your

[jira] [Commented] (FLINK-1219) Add support for Apache Tez as execution engine

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354624#comment-14354624 ] ASF GitHub Bot commented on FLINK-1219: --- Github user rmetzger commented on the pull

[jira] [Created] (FLINK-1673) Colocate Flink Kafka consumer

2015-03-10 Thread JIRA
Márton Balassi created FLINK-1673: - Summary: Colocate Flink Kafka consumer Key: FLINK-1673 URL: https://issues.apache.org/jira/browse/FLINK-1673 Project: Flink Issue Type: Improvement

[GitHub] flink pull request: [streaming] [wip] Fault tolerance prototype (f...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/459#issuecomment-78048064 Last check on Travis before merging. There are a couple of followup changes I would propose, let's start a separate thread about this on the mailing list.

[GitHub] flink pull request: [streaming] [wip] Fault tolerance prototype (f...

2015-03-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/459 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/454#issuecomment-78047798 Looks good to me. +1 to merge, if Travis (or Bob the Builder) agrees --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Commented] (FLINK-1617) GSoC project: Query optimisation layer for Flink Streaming

2015-03-10 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354817#comment-14354817 ] Gyula Fora commented on FLINK-1617: --- Hello! Thank you for the interest. I suggest you

[jira] [Commented] (FLINK-1671) Add execution modes for programs

2015-03-10 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354825#comment-14354825 ] Robert Metzger commented on FLINK-1671: --- That sounds pretty awesome. I agree to make

[jira] [Assigned] (FLINK-1544) Extend streaming aggregation tests to include POJOs

2015-03-10 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Péter Szabó reassigned FLINK-1544: -- Assignee: Péter Szabó Extend streaming aggregation tests to include POJOs

[GitHub] flink pull request: [FLINK-1605] Bundle all hadoop dependencies an...

2015-03-10 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/454#issuecomment-78047279 Thank you for reviewing the change. * The exclusions for the `flink-clients` were indeed wrong. Good catch! * It doesn't make much sense to set a main class

[GitHub] flink pull request: [FLINK-1622][java-api][scala-api] add a partia...

2015-03-10 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/466#discussion_r26120661 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/operators/SortedGrouping.java --- @@ -156,6 +156,23 @@ public SortedGrouping(DataSetT set, KeysT

[jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354844#comment-14354844 ] ASF GitHub Bot commented on FLINK-1605: --- Github user StephanEwen commented on the

[jira] [Commented] (FLINK-1676) enableForceKryo() is not working as expected

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355209#comment-14355209 ] ASF GitHub Bot commented on FLINK-1676: --- GitHub user rmetzger opened a pull request:

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355233#comment-14355233 ] ASF GitHub Bot commented on FLINK-1622: --- Github user aljoscha commented on the pull

[jira] [Resolved] (FLINK-1567) Add option to switch between Avro and Kryo serialization for GenericTypes

2015-03-10 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1567. --- Resolution: Fixed Fix Version/s: 0.8.2 0.9 Resolved for 0.8 in

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355163#comment-14355163 ] ASF GitHub Bot commented on FLINK-1622: --- Github user mxm commented on the pull

[jira] [Commented] (FLINK-1512) Add CsvReader for reading into POJOs.

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355172#comment-14355172 ] ASF GitHub Bot commented on FLINK-1512: --- Github user chiwanpark commented on the

[GitHub] flink pull request: Cleanup of low level Kafka consumer (Persisten...

2015-03-10 Thread gaborhermann
GitHub user gaborhermann opened a pull request: https://github.com/apache/flink/pull/474 Cleanup of low level Kafka consumer (PersistentKafkaSource) * When there are more partitions of topic than parallel subtasks listening partitions get distributed between subtask in order to

[GitHub] flink pull request: [FLINK-1622][java-api][scala-api] add a partia...

2015-03-10 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/466#issuecomment-78093403 @aljoscha @fhueske For a general combine, the operator can be used without grouping. When we want to combine elements before performing a proper groupReduce with a groupBy,

[GitHub] flink pull request: [FLINK-1622][java-api][scala-api] add a partia...

2015-03-10 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/466#discussion_r26139203 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/operators/GroupReducePartialOperator.java --- @@ -0,0 +1,229 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-1664) Forbid sorting on POJOs

2015-03-10 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355054#comment-14355054 ] Maximilian Michels commented on FLINK-1664: --- +1 Forbid sorting on POJOs

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355040#comment-14355040 ] ASF GitHub Bot commented on FLINK-1622: --- Github user mxm commented on the pull

[jira] [Commented] (FLINK-1106) Deprecate old Record API

2015-03-10 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355063#comment-14355063 ] Stephan Ewen commented on FLINK-1106: - A bit of test coverage depends on the

[GitHub] flink pull request: [FLINK-1567] Add switch to use the AvroSeriali...

2015-03-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/413 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-1654) Wrong scala example of POJO type in documentation

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356085#comment-14356085 ] ASF GitHub Bot commented on FLINK-1654: --- GitHub user chiwanpark opened a pull

[GitHub] flink pull request: [FLINK-1654] Wrong scala example of POJO type ...

2015-03-10 Thread chiwanpark
GitHub user chiwanpark opened a pull request: https://github.com/apache/flink/pull/478 [FLINK-1654] Wrong scala example of POJO type in documentation More detail description and discussion in [JIRA](https://issues.apache.org/jira/browse/FLINK-1654). You can merge this pull request

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355035#comment-14355035 ] ASF GitHub Bot commented on FLINK-1622: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355081#comment-14355081 ] ASF GitHub Bot commented on FLINK-377: -- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-1525) Provide utils to pass -D parameters to UDFs

2015-03-10 Thread Wepngong Ngeh Benaiah (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355112#comment-14355112 ] Wepngong Ngeh Benaiah commented on FLINK-1525: -- hello Roger Metzger! I will

[jira] [Created] (FLINK-1675) Rework Accumulators

2015-03-10 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1675: --- Summary: Rework Accumulators Key: FLINK-1675 URL: https://issues.apache.org/jira/browse/FLINK-1675 Project: Flink Issue Type: Bug Components:

[GitHub] flink pull request: [FLINK-1622][java-api][scala-api] add a partia...

2015-03-10 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/466#issuecomment-78076027 @aljoscha Thanks for the comments. I agree, the tests are a bit shady because they test the operator by first performing a partial, then a full reduce. Using a custom

[GitHub] flink pull request: [FLINK-1594] [streaming] [wip] DataStream supp...

2015-03-10 Thread gaborhermann
GitHub user gaborhermann opened a pull request: https://github.com/apache/flink/pull/472 [FLINK-1594] [streaming] [wip] DataStream supports self-connection * Added StreamEdge abstraction, so more than one edge can be defined between stream operators. * Added

[jira] [Commented] (FLINK-1106) Deprecate old Record API

2015-03-10 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355056#comment-14355056 ] Maximilian Michels commented on FLINK-1106: --- +1 Deprecate old Record API

[GitHub] flink pull request: [FLINK-1622][java-api][scala-api] add a partia...

2015-03-10 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/466#issuecomment-78084575 Yes, I've got a couple of comments as well. First of all, as @mxm said, I would propose to call this operator ``combine`` because it is a generalized combiner

[jira] [Created] (FLINK-1676) enableForceKryo() is not working as expected

2015-03-10 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1676: - Summary: enableForceKryo() is not working as expected Key: FLINK-1676 URL: https://issues.apache.org/jira/browse/FLINK-1676 Project: Flink Issue Type: Bug

[GitHub] flink pull request: [FLINK-1622][java-api][scala-api] add a partia...

2015-03-10 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/466#discussion_r26130234 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/operators/base/GroupReducePartialOperatorBase.java --- @@ -0,0 +1,150 @@ +/* + * Licensed

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355037#comment-14355037 ] ASF GitHub Bot commented on FLINK-1622: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-1594) DataStreams don't support self-join

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355053#comment-14355053 ] ASF GitHub Bot commented on FLINK-1594: --- GitHub user gaborhermann opened a pull

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355003#comment-14355003 ] ASF GitHub Bot commented on FLINK-1622: --- Github user hsaputra commented on the pull

[GitHub] flink pull request: [FLINK-1622][java-api][scala-api] add a partia...

2015-03-10 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/466#discussion_r26130403 --- Diff: flink-scala/src/main/scala/org/apache/flink/api/scala/GroupedDataSet.scala --- @@ -355,6 +355,63 @@ class GroupedDataSet[T: ClassTag]( }

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355121#comment-14355121 ] ASF GitHub Bot commented on FLINK-1622: --- Github user fhueske commented on a diff in

[jira] [Commented] (FLINK-1567) Add option to switch between Avro and Kryo serialization for GenericTypes

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355154#comment-14355154 ] ASF GitHub Bot commented on FLINK-1567: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-1272) Add a reduceWithKey function

2015-03-10 Thread Suneel Marthi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355591#comment-14355591 ] Suneel Marthi commented on FLINK-1272: -- Please go ahead and assign it to yourself,

[jira] [Assigned] (FLINK-1272) Add a reduceWithKey function

2015-03-10 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske reassigned FLINK-1272: Assignee: Fabian Hueske (was: Suneel Marthi) Add a reduceWithKey function

[jira] [Commented] (FLINK-1272) Add a reduceWithKey function

2015-03-10 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355629#comment-14355629 ] Fabian Hueske commented on FLINK-1272: -- OK, thanks! Add a reduceWithKey function

[jira] [Commented] (FLINK-1652) Wrong superstep number in VertexCentricIteration in Collection mode

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355671#comment-14355671 ] ASF GitHub Bot commented on FLINK-1652: --- Github user vasia commented on the pull

[GitHub] flink pull request: [FLINK-1652] fixes superstep increment in Coll...

2015-03-10 Thread vasia
Github user vasia commented on the pull request: https://github.com/apache/flink/pull/464#issuecomment-78144826 Alright, I updated the test. I'll merge after Mr. Travis gives us the green light :) --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Created] (FLINK-1679) Document how degree of parallelism / parallelism / slots are connected to each other

2015-03-10 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1679: - Summary: Document how degree of parallelism / parallelism / slots are connected to each other Key: FLINK-1679 URL: https://issues.apache.org/jira/browse/FLINK-1679

[jira] [Created] (FLINK-1680) Upgrade Flink dependencies for Tachyon to 0.6.0

2015-03-10 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1680: Summary: Upgrade Flink dependencies for Tachyon to 0.6.0 Key: FLINK-1680 URL: https://issues.apache.org/jira/browse/FLINK-1680 Project: Flink Issue Type:

[GitHub] flink pull request: [FLINK-1676] Rework ExecutionConfig.enableForc...

2015-03-10 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/473#discussion_r26156796 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/PojoTypeInfo.java --- @@ -310,6 +310,9 @@ public int getFieldIndex(String

[jira] [Created] (FLINK-1683) Scheduling preferences for non-unary tasks are not correctly computed

2015-03-10 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1683: Summary: Scheduling preferences for non-unary tasks are not correctly computed Key: FLINK-1683 URL: https://issues.apache.org/jira/browse/FLINK-1683 Project: Flink

[jira] [Created] (FLINK-1681) Remove the old Record API

2015-03-10 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1681: Summary: Remove the old Record API Key: FLINK-1681 URL: https://issues.apache.org/jira/browse/FLINK-1681 Project: Flink Issue Type: Task Affects

[jira] [Updated] (FLINK-1682) Port Record-API based optimizer tests to new Java API

2015-03-10 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1682: - Issue Type: Sub-task (was: Task) Parent: FLINK-1681 Port Record-API based optimizer

[jira] [Commented] (FLINK-1676) enableForceKryo() is not working as expected

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355536#comment-14355536 ] ASF GitHub Bot commented on FLINK-1676: --- Github user StephanEwen commented on a diff

[jira] [Created] (FLINK-1682) Port Record-API based optimizer tests to new Java API

2015-03-10 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1682: Summary: Port Record-API based optimizer tests to new Java API Key: FLINK-1682 URL: https://issues.apache.org/jira/browse/FLINK-1682 Project: Flink Issue

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-03-10 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/202#discussion_r26102129 --- Diff: flink-addons/flink-language-binding/src/main/python/org/apache/flink/languagebinding/api/python/dill/__diff.py --- @@ -0,0 +1,247 @@

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354434#comment-14354434 ] ASF GitHub Bot commented on FLINK-377: -- Github user zentol commented on a diff in the

[jira] [Commented] (FLINK-1677) Properly Suppress Sysout Printing for the Degrees with exception test suite

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355761#comment-14355761 ] ASF GitHub Bot commented on FLINK-1677: --- GitHub user andralungu opened a pull

[GitHub] flink pull request: [FLINK-1677][gelly] Suppresed Sysout Printing

2015-03-10 Thread andralungu
GitHub user andralungu opened a pull request: https://github.com/apache/flink/pull/475 [FLINK-1677][gelly] Suppresed Sysout Printing For the DegreesWithException test suite. Also added a mini cluster instance to speed up tests You can merge this pull request into a Git

[jira] [Updated] (FLINK-1343) Branching Join Program Deadlocks

2015-03-10 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1343: - Assignee: (was: Fabian Hueske) Branching Join Program Deadlocks

[jira] [Updated] (FLINK-1343) Branching Join Program Deadlocks

2015-03-10 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1343: - Component/s: (was: Optimizer) Distributed Runtime Branching Join Program

[GitHub] flink pull request: [FLINK-1676] Rework ExecutionConfig.enableForc...

2015-03-10 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/473#discussion_r26170417 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/PojoTypeInfo.java --- @@ -310,6 +310,9 @@ public int getFieldIndex(String fieldName)

[jira] [Commented] (FLINK-1617) GSoC project: Query optimisation layer for Flink Streaming

2015-03-10 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355858#comment-14355858 ] Gabor Gevay commented on FLINK-1617: Hello! I am also interested in working on this

[GitHub] flink pull request: [FLINK-1594] [streaming] [wip] DataStream supp...

2015-03-10 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/472#issuecomment-78172073 Looks good to me, and travis passes, I will merge tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Commented] (FLINK-1683) Scheduling preferences for non-unary tasks are not correctly computed

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355947#comment-14355947 ] ASF GitHub Bot commented on FLINK-1683: --- GitHub user fhueske opened a pull request:

[jira] [Commented] (FLINK-1525) Provide utils to pass -D parameters to UDFs

2015-03-10 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355904#comment-14355904 ] Robert Metzger commented on FLINK-1525: --- Hi, great. We're always happy about new

[jira] [Commented] (FLINK-1594) DataStreams don't support self-join

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355943#comment-14355943 ] ASF GitHub Bot commented on FLINK-1594: --- Github user gyfora commented on the pull

[GitHub] flink pull request: [FLINK-1683] [jobmanager]� Fix scheduling pref...

2015-03-10 Thread fhueske
GitHub user fhueske opened a pull request: https://github.com/apache/flink/pull/476 [FLINK-1683] [jobmanager] Fix scheduling preference choice for non-unary execution tasks Fix validated on a cluster setup. You can merge this pull request into a Git repository by running: $

[jira] [Commented] (FLINK-1576) Change the Gelly examples to be consistent with the other Flink examples

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354538#comment-14354538 ] ASF GitHub Bot commented on FLINK-1576: --- GitHub user vasia opened a pull request:

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354544#comment-14354544 ] ASF GitHub Bot commented on FLINK-1622: --- Github user aljoscha commented on a diff in

[jira] [Commented] (FLINK-1622) Add GroupReducePartial Operator

2015-03-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354554#comment-14354554 ] ASF GitHub Bot commented on FLINK-1622: --- Github user aljoscha commented on a diff in

  1   2   >