[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301892#comment-14301892 ] ASF GitHub Bot commented on FLINK-377: -- Github user rmetzger commented on a diff in

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/202#discussion_r23955578 --- Diff: docs/python_programming_guide.md --- @@ -0,0 +1,600 @@ +--- +title: Python Programming Guide +--- +!-- +Licensed to the Apache

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/202#issuecomment-72533930 Wordcount with build-in data works :+1: nice. ``` robert@robert-tower ...k-0.9-SNAPSHOT-bin/flink-0.9-SNAPSHOT (git)-[papipr] % ./bin/pyflink3.sh pyflink.py -

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301888#comment-14301888 ] ASF GitHub Bot commented on FLINK-377: -- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/202#discussion_r23952693 --- Diff: flink-addons/flink-language-binding/src/main/python/org/apache/flink/languagebinding/api/python/dill/__diff.py --- @@ -0,0 +1,247 @@

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/202#discussion_r23958310 --- Diff: flink-addons/flink-language-binding/src/main/java/org/apache/flink/languagebinding/api/java/common/OperationInfo.java --- @@ -0,0 +1,48 @@ +/**

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301925#comment-14301925 ] ASF GitHub Bot commented on FLINK-377: -- Github user zentol commented on a diff in the

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/202#issuecomment-72526181 I've tested the changes again, because I would really like to merge them The bin/pyflink3.sh script only works when called from the flink root dir ```

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301803#comment-14301803 ] ASF GitHub Bot commented on FLINK-377: -- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/202#discussion_r23954389 --- Diff: flink-addons/flink-language-binding/src/main/java/org/apache/flink/languagebinding/api/java/common/OperationInfo.java --- @@ -0,0 +1,48 @@ +/**

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread zentol
Github user zentol commented on the pull request: https://github.com/apache/flink/pull/202#issuecomment-72537053 hard to find error messages what do you mean by that? what did you run the job with (data size, dop) ? --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302010#comment-14302010 ] ASF GitHub Bot commented on FLINK-377: -- Github user fhueske commented on the pull

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/202#issuecomment-72547127 Asking others to implement the standard example programs has worked quite well to identify issues with new APIs. How about, we look for people who try out the API by

[GitHub] flink pull request: [Discuss] Simplify SplittableIterator interfac...

2015-02-02 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/338#issuecomment-72561341 +1 @rmetzger Can you create a JIRA for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/202#discussion_r23973573 --- Diff: flink-addons/flink-language-binding/src/main/python/org/apache/flink/languagebinding/api/python/dill/__diff.py --- @@ -0,0 +1,247 @@

[jira] [Updated] (FLINK-1314) Update website about #flink chat room in freenode IRC

2015-02-02 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra updated FLINK-1314: - Attachment: FLINK-1314.patch Attach proposed changes Update website about #flink chat room in

[jira] [Commented] (FLINK-1303) HadoopInputFormat does not work with Scala API

2015-02-02 Thread Yiannis Gkoufas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302582#comment-14302582 ] Yiannis Gkoufas commented on FLINK-1303: Since I am a total beginner in scala, may

[jira] [Comment Edited] (FLINK-1314) Update website about #flink chat room in freenode IRC

2015-02-02 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302650#comment-14302650 ] Henry Saputra edited comment on FLINK-1314 at 2/3/15 1:58 AM: --

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302302#comment-14302302 ] ASF GitHub Bot commented on FLINK-377: -- Github user zentol commented on the pull

[GitHub] flink pull request: Add support for Subclasses, Interfaces, Abstra...

2015-02-02 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/236#issuecomment-72432067 That is not a really good solution, IMHO. Can we have a special tag that signifies that the deserialization is delegated to Kryo? How about this flow:

[GitHub] flink pull request: [FLINK-1105] Add support for locally sorted ou...

2015-02-02 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/347#discussion_r23914605 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/operators/DataSink.java --- @@ -83,6 +93,107 @@ public DataSink(DataSetT data, OutputFormatT

[jira] [Commented] (FLINK-1105) Add support for locally sorted output

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301080#comment-14301080 ] ASF GitHub Bot commented on FLINK-1105: --- Github user rmetzger commented on a diff in

[GitHub] flink pull request: Add support for Subclasses, Interfaces, Abstra...

2015-02-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/236#issuecomment-72433217 Yes, it is not a good solution But what you propose isn't either: If we use Kryo for those subclasses that we cannot handle then nothing works anymore. The whole reason

[jira] [Commented] (FLINK-1105) Add support for locally sorted output

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301085#comment-14301085 ] ASF GitHub Bot commented on FLINK-1105: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-1105] Add support for locally sorted ou...

2015-02-02 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/347#discussion_r23914766 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/operators/DataSink.java --- @@ -83,6 +93,107 @@ public DataSink(DataSetT data, OutputFormatT

[jira] [Commented] (FLINK-1105) Add support for locally sorted output

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301087#comment-14301087 ] ASF GitHub Bot commented on FLINK-1105: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-1105] Add support for locally sorted ou...

2015-02-02 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/347#issuecomment-72430165 The change is good to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink pull request: Add support for Subclasses, Interfaces, Abstra...

2015-02-02 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/236#issuecomment-72434125 Dang, I see your point. We need something more clever then... Can we (for now) at least make sure that it fails early: Get an exception when registering a

[jira] [Assigned] (FLINK-1465) GlobalBufferPool reports negative memory allocation

2015-02-02 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi reassigned FLINK-1465: -- Assignee: Ufuk Celebi GlobalBufferPool reports negative memory allocation

[jira] [Commented] (FLINK-1465) GlobalBufferPool reports negative memory allocation

2015-02-02 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301332#comment-14301332 ] Ufuk Celebi commented on FLINK-1465: I will ping you again, but I've checked the

[GitHub] flink pull request: [FLINK-1458] Allow Interfaces and abstract typ...

2015-02-02 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/357 [FLINK-1458] Allow Interfaces and abstract types in TypeExtractor Kryo already supports them, so it was just a question of the TypeExtractor allowing them. I also added tests for this.

[jira] [Created] (FLINK-1469) Initialize network environment at task manager startup

2015-02-02 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1469: -- Summary: Initialize network environment at task manager startup Key: FLINK-1469 URL: https://issues.apache.org/jira/browse/FLINK-1469 Project: Flink Issue Type:

[jira] [Commented] (FLINK-1369) The Pojo Serializers/Comparators fail when using Subclasses or Interfaces

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301387#comment-14301387 ] ASF GitHub Bot commented on FLINK-1369: --- Github user fhueske closed the pull request

[GitHub] flink pull request: [FLINK-1369] [types] Add support for Subclasse...

2015-02-02 Thread fhueske
Github user fhueske closed the pull request at: https://github.com/apache/flink/pull/316 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (FLINK-1458) Interfaces and abstract classes are not valid types

2015-02-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned FLINK-1458: --- Assignee: Aljoscha Krettek Interfaces and abstract classes are not valid types

[jira] [Commented] (FLINK-1201) Graph API for Flink

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301348#comment-14301348 ] ASF GitHub Bot commented on FLINK-1201: --- Github user cebe commented on the pull

[jira] [Created] (FLINK-1468) Config parse failure fails task manager startup w/o an error message

2015-02-02 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1468: -- Summary: Config parse failure fails task manager startup w/o an error message Key: FLINK-1468 URL: https://issues.apache.org/jira/browse/FLINK-1468 Project: Flink

[jira] [Commented] (FLINK-1452) Add flink-contrib maven module and README.md with the rules

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301623#comment-14301623 ] ASF GitHub Bot commented on FLINK-1452: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: FLINK-1452: Rename 'flink-addons' to 'flink-st...

2015-02-02 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/355#issuecomment-72512040 Thank you for the review. I'm going to merge it now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink pull request: FLINK-1452: Rename 'flink-addons' to 'flink-st...

2015-02-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/355 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-1452) Add flink-contrib maven module and README.md with the rules

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301629#comment-14301629 ] ASF GitHub Bot commented on FLINK-1452: --- Github user asfgit closed the pull request

[jira] [Resolved] (FLINK-1452) Add flink-contrib maven module and README.md with the rules

2015-02-02 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1452. --- Resolution: Fixed Resolved in

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301840#comment-14301840 ] ASF GitHub Bot commented on FLINK-377: -- Github user zentol commented on a diff in the

[jira] [Resolved] (FLINK-1093) Add non-multiplexing NetworkConnectionManager

2015-02-02 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi resolved FLINK-1093. Resolution: Not a Problem Add non-multiplexing NetworkConnectionManager

[jira] [Commented] (FLINK-1318) Make quoted String parsing optional and configurable for CSVInputFormats

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301509#comment-14301509 ] ASF GitHub Bot commented on FLINK-1318: --- Github user fhueske commented on the pull

[GitHub] flink pull request: [FLINK-1318] CsvInputFormat: Made quoted strin...

2015-02-02 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/265#issuecomment-72501228 I added documentation. Any objections against merging this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] flink pull request: [FLINK-1105] Add support for locally sorted ou...

2015-02-02 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/347#issuecomment-72501446 @rmetzger thanks for the feedback. I addressed your comment. Plan to merge this tomorrow, unless somebody objects. --- If your project is set up for it, you can reply

[jira] [Commented] (FLINK-1452) Add flink-contrib maven module and README.md with the rules

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301540#comment-14301540 ] ASF GitHub Bot commented on FLINK-1452: --- Github user fhueske commented on the pull

[jira] [Commented] (FLINK-819) OutOfMemoryError from TaskManager is causing hard to understand exceptions and blocking JobManager

2015-02-02 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301469#comment-14301469 ] Ufuk Celebi commented on FLINK-819: --- Has this been resolved with Akka and the

[jira] [Commented] (FLINK-1105) Add support for locally sorted output

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301512#comment-14301512 ] ASF GitHub Bot commented on FLINK-1105: --- Github user fhueske commented on the pull

[GitHub] flink pull request: FLINK-1452: Rename 'flink-addons' to 'flink-st...

2015-02-02 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/355#issuecomment-72503732 +1 for merging. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-02 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/202#discussion_r23950076 --- Diff: docs/python_programming_guide.md --- @@ -0,0 +1,600 @@ +--- +title: Python Programming Guide +--- +!-- +Licensed to the Apache

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301734#comment-14301734 ] ASF GitHub Bot commented on FLINK-377: -- Github user rmetzger commented on a diff in

[jira] [Commented] (FLINK-1320) Add an off-heap variant of the managed memory

2015-02-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301746#comment-14301746 ] ASF GitHub Bot commented on FLINK-1320: --- Github user hsaputra commented on a diff in