[jira] [Closed] (FLINK-1474) Cross produces wrong results for non-tiny inputs

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-1474. Resolution: Not a Problem Turned out that the problem was caused by the FilterFunction and not the

[jira] [Commented] (FLINK-1201) Graph API for Flink

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305397#comment-14305397 ] ASF GitHub Bot commented on FLINK-1201: --- Github user vasia commented on the pull

[GitHub] flink pull request: [FLINK-1318] CsvInputFormat: Made quoted strin...

2015-02-04 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/265#issuecomment-72886847 Other comments on the API breaking. If not, I'd merge it... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305468#comment-14305468 ] ASF GitHub Bot commented on FLINK-1442: --- Github user hsaputra commented on a diff in

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305494#comment-14305494 ] ASF GitHub Bot commented on FLINK-1396: --- GitHub user aljoscha opened a pull request:

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/363 [FLINK-1396][FLINK-1303] Hadoop Input/Output directly in API This adds methods on ExecutionEnvironment for reading with Hadoop Input/OutputFormat. This also adds support in the Scala

[GitHub] flink pull request: [FLINK-1201] Add flink-gelly to flink-addons (...

2015-02-04 Thread vasia
Github user vasia commented on the pull request: https://github.com/apache/flink/pull/335#issuecomment-72883525 @balidani that's OK :) @cebe we've got the acknowledgement for you, thanks! @andralungu has submitted hers today. --- If your project is set up for it, you can

[GitHub] flink pull request: Qa bot

2015-02-04 Thread flinkqa
GitHub user flinkqa opened a pull request: https://github.com/apache/flink/pull/362 Qa bot You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink qa-bot Alternatively you can review and apply these changes as the patch

[jira] [Commented] (FLINK-1318) Make quoted String parsing optional and configurable for CSVInputFormats

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305450#comment-14305450 ] ASF GitHub Bot commented on FLINK-1318: --- Github user fhueske commented on the pull

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24097257 --- Diff: flink-runtime/src/test/scala/org/apache/flink/runtime/testingUtils/TestingMemoryArchivist.scala --- @@ -31,10 +31,11 @@ trait

[GitHub] flink pull request: Qa bot

2015-02-04 Thread flinkqa
Github user flinkqa closed the pull request at: https://github.com/apache/flink/pull/362 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: Qa bot

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/362#issuecomment-72886592 Sorry guys, I was confused with the different repositories. I'll close it again. --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Commented] (FLINK-1318) Make quoted String parsing optional and configurable for CSVInputFormats

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305411#comment-14305411 ] ASF GitHub Bot commented on FLINK-1318: --- Github user mxm commented on the pull

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304854#comment-14304854 ] ASF GitHub Bot commented on FLINK-1442: --- Github user StephanEwen commented on the

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24072128 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304846#comment-14304846 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304867#comment-14304867 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304848#comment-14304848 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24072204 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24072529 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304857#comment-14304857 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a

[jira] [Resolved] (FLINK-823) Improve Semantic Annotations

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske resolved FLINK-823. - Resolution: Fixed Assignee: Fabian Hueske Fixed with

[jira] [Created] (FLINK-1475) Minimize log output of yarn test cases

2015-02-04 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1475: Summary: Minimize log output of yarn test cases Key: FLINK-1475 URL: https://issues.apache.org/jira/browse/FLINK-1475 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-837) Allow FunctionAnnotations on Methods

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305858#comment-14305858 ] Fabian Hueske commented on FLINK-837: - [~StephanEwen] Is this issue solved with the

[jira] [Closed] (FLINK-1296) Add support for very large record for sorting

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-1296. Resolution: Fixed Fixed in 482565608414fea8df7ed86d5d9a8d90fdfcd4f7 Add support for very large

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/363#discussion_r24117856 --- Diff: docs/hadoop_compatibility.md --- @@ -52,56 +63,70 @@ Add the following dependency to your `pom.xml` to use the Hadoop Compatibility L ###

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305914#comment-14305914 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/358#issuecomment-72937500 Thank you. Thats good to hear. On 04.02.2015, at 21:56, Daniel Warneke notificati...@github.com wrote: Tested the code and everything works

[jira] [Commented] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305936#comment-14305936 ] ASF GitHub Bot commented on FLINK-592: -- Github user rmetzger commented on the pull

[jira] [Closed] (FLINK-454) Add ProgramInput/OutputFormats

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-454. --- Resolution: Duplicate Is subsumed by issues around FLINK-986 to cache intermediate results. Add

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/363#discussion_r24117714 --- Diff: docs/hadoop_compatibility.md --- @@ -52,56 +63,70 @@ Add the following dependency to your `pom.xml` to use the Hadoop Compatibility L ###

[jira] [Commented] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305934#comment-14305934 ] ASF GitHub Bot commented on FLINK-592: -- Github user warneke commented on the pull

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread warneke
Github user warneke commented on the pull request: https://github.com/apache/flink/pull/358#issuecomment-72937077 Tested the code and everything works as expected now. Great job! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305977#comment-14305977 ] ASF GitHub Bot commented on FLINK-377: -- Github user fhueske commented on the pull

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305905#comment-14305905 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/363#discussion_r24117603 --- Diff: docs/hadoop_compatibility.md --- @@ -38,9 +39,19 @@ This document shows how to use existing Hadoop MapReduce code with Flink. Please ###

[jira] [Commented] (FLINK-1462) Add documentation guide for the graph API

2015-02-04 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306036#comment-14306036 ] Vasia Kalavri commented on FLINK-1462: -- I'm definitely planning to add some pictures

[jira] [Commented] (FLINK-1388) POJO support for writeAsCsv

2015-02-04 Thread Adnan Khan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305996#comment-14305996 ] Adnan Khan commented on FLINK-1388: --- I'll work on this one. POJO support for

[jira] [Updated] (FLINK-1180) Add support for Hadoop MapReduce.* API Mappers and Reducers

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1180: - Summary: Add support for Hadoop MapReduce.* API Mappers and Reducers (was: Expose Map and Reduce

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305910#comment-14305910 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on a diff in

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305921#comment-14305921 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/363#discussion_r24118164 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java --- @@ -458,6 +461,67 @@ public CsvReader readCsvFile(String filePath)

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305956#comment-14305956 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on the pull

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/363#issuecomment-72939364 Looks good. Besides the typos and inline comments, you could also move the `HadoopInputFormatTest` and the `HadoopIOFormatsITCase` to flink-java and flink-tests.

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/358 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093420 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093445 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093429 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093436 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305359#comment-14305359 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305360#comment-14305360 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305358#comment-14305358 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305357#comment-14305357 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[GitHub] flink pull request: [FLINK-1376] [runtime] Add proper shared slot ...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/317#issuecomment-72832512 +1 for removing unnecessary ExecutionGraph information before archiving. --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304876#comment-14304876 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304875#comment-14304875 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/359#discussion_r24073064 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java --- @@ -680,10 +680,20 @@ private static void

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/344#issuecomment-72832200 Ah ok perfect that you already addressed the minor issues. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304882#comment-14304882 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304893#comment-14304893 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on the

[jira] [Commented] (FLINK-819) OutOfMemoryError from TaskManager is causing hard to understand exceptions and blocking JobManager

2015-02-04 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304955#comment-14304955 ] Till Rohrmann commented on FLINK-819: - Should be tested. OutOfMemoryError from

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/359#issuecomment-72859235 Thank you @twalthr! I've verified your change and its fixing the issue I was reporting originally. Except for one minor question, the change is good to

[jira] [Commented] (FLINK-1201) Graph API for Flink

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305052#comment-14305052 ] ASF GitHub Bot commented on FLINK-1201: --- Github user balidani commented on the pull

[GitHub] flink pull request: [FLINK-1201] Add flink-gelly to flink-addons (...

2015-02-04 Thread balidani
Github user balidani commented on the pull request: https://github.com/apache/flink/pull/335#issuecomment-72851434 Sorry, I will only be able to fill the form on Sunday, my internet connection is horrible here. Is that ok? Daniel On Feb 2, 2015 3:53 PM, Carsten Brandt

[jira] [Commented] (FLINK-1471) Allow KeySelectors to implement ResultTypeQueryable

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305091#comment-14305091 ] ASF GitHub Bot commented on FLINK-1471: --- Github user rmetzger commented on the pull

[jira] [Commented] (FLINK-1471) Allow KeySelectors to implement ResultTypeQueryable

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305120#comment-14305120 ] ASF GitHub Bot commented on FLINK-1471: --- Github user rmetzger commented on a diff in

[jira] [Created] (FLINK-1473) Simplify SplittableIterator interface

2015-02-04 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1473: - Summary: Simplify SplittableIterator interface Key: FLINK-1473 URL: https://issues.apache.org/jira/browse/FLINK-1473 Project: Flink Issue Type: Task

[jira] [Resolved] (FLINK-1473) Simplify SplittableIterator interface

2015-02-04 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1473. --- Resolution: Fixed Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/7ac6447f

[GitHub] flink pull request: [Discuss] Simplify SplittableIterator interfac...

2015-02-04 Thread rmetzger
Github user rmetzger closed the pull request at: https://github.com/apache/flink/pull/338 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/359#discussion_r24085603 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java --- @@ -680,10 +680,20 @@ private static void

[jira] [Commented] (FLINK-1473) Simplify SplittableIterator interface

2015-02-04 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305141#comment-14305141 ] Robert Metzger commented on FLINK-1473: --- Code from

[GitHub] flink pull request: [Discuss] Simplify SplittableIterator interfac...

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/338#issuecomment-72861601 Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/7ac6447f. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/358#issuecomment-72856331 Thank you for the good feedback! @mxm and I updated the pull request and addressed your concerns. I'm now running the tests on Travis. If they pass I'm going

[GitHub] flink pull request: Allow KeySelectors to implement ResultTypeQuer...

2015-02-04 Thread aalexandrov
Github user aalexandrov commented on the pull request: https://github.com/apache/flink/pull/354#issuecomment-72857627 I think that this only happens for the primitive types. I think this is by design. If you want to inspect generic parameters, Scala forces you to use the

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/359#discussion_r24085111 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java --- @@ -680,10 +680,20 @@ private static void

[jira] [Commented] (FLINK-1471) Allow KeySelectors to implement ResultTypeQueryable

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305116#comment-14305116 ] ASF GitHub Bot commented on FLINK-1471: --- Github user twalthr commented on a diff in

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/359#discussion_r24085204 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java --- @@ -680,10 +680,20 @@ private static void

[jira] [Created] (FLINK-1474) Cross produces wrong results for non-tiny inputs

2015-02-04 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1474: Summary: Cross produces wrong results for non-tiny inputs Key: FLINK-1474 URL: https://issues.apache.org/jira/browse/FLINK-1474 Project: Flink Issue Type:

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/358#issuecomment-72870536 @warneke Thanks for reporting. If the above issues have been resolved, I suggest to merge the changes. --- If your project is set up for it, you can reply to this email and

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/344#issuecomment-72829676 You can also shoot yourself in the foot with Option, no? There is no substitute for thorough programming... --- If your project is set up for it, you can reply to

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/344#issuecomment-72831706 It is true that thorough programming is always the best, but Option encourages you to apply a more functional programming style which in many cases results in safer

[jira] [Resolved] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-592. -- Resolution: Fixed Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/48d8dd5a Add

[jira] [Commented] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305192#comment-14305192 ] ASF GitHub Bot commented on FLINK-592: -- Github user asfgit closed the pull request at:

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24073173 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24073205 --- Diff: flink-runtime/src/test/scala/org/apache/flink/runtime/testingUtils/TestingMemoryArchivist.scala --- @@ -31,10 +31,11 @@ trait

[jira] [Commented] (FLINK-1376) SubSlots are not properly released in case that a TaskManager fatally fails, leaving the system in a corrupted state

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304900#comment-14304900 ] ASF GitHub Bot commented on FLINK-1376: --- Github user tillrohrmann commented on the

[jira] [Commented] (FLINK-1303) HadoopInputFormat does not work with Scala API

2015-02-04 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304953#comment-14304953 ] Till Rohrmann commented on FLINK-1303: -- {code} val hadoopIF = new

[GitHub] flink pull request: [FLINK1443] Add support for replicating input ...

2015-02-04 Thread fhueske
GitHub user fhueske opened a pull request: https://github.com/apache/flink/pull/360 [FLINK1443] Add support for replicating input formats. InputFormats can be wrapped by a ReplicatingInputFormat which takes care that the full input of the wrapped input format is read in each

[jira] [Closed] (FLINK-228) Evaluate HCatalog

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-228. --- Resolution: Duplicate Duplicate of FLINK-1466 Evaluate HCatalog -

[jira] [Updated] (FLINK-1466) Add InputFormat to read HCatalog tables

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1466: - Description: HCatalog is a metadata repository and InputFormat to make Hive tables accessible to

[jira] [Created] (FLINK-1476) Flink VS Spark on loop test

2015-02-04 Thread xuhong (JIRA)
xuhong created FLINK-1476: - Summary: Flink VS Spark on loop test Key: FLINK-1476 URL: https://issues.apache.org/jira/browse/FLINK-1476 Project: Flink Issue Type: Test Affects Versions: 0.8,