Re: [jira] [Created] (FLINK-1462) Add documentation guide for the graph API

2015-02-04 Thread Ufuk Celebi
I think it is GitHub flavored markdown. GH has a reference with the additions. On Wednesday, February 4, 2015, Vasia Kalavri (JIRA) wrote: > > [ > https://issues.apache.org/jira/browse/FLINK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306036#

[jira] [Created] (FLINK-1476) Flink VS Spark on loop test

2015-02-04 Thread xuhong (JIRA)
xuhong created FLINK-1476: - Summary: Flink VS Spark on loop test Key: FLINK-1476 URL: https://issues.apache.org/jira/browse/FLINK-1476 Project: Flink Issue Type: Test Affects Versions: 0.8, 0.7.0

[jira] [Updated] (FLINK-1466) Add InputFormat to read HCatalog tables

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1466: - Description: HCatalog is a metadata repository and InputFormat to make Hive tables accessible to

[jira] [Closed] (FLINK-228) Evaluate HCatalog

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-228. --- Resolution: Duplicate Duplicate of FLINK-1466 > Evaluate HCatalog > - > >

[jira] [Closed] (FLINK-454) Add ProgramInput/OutputFormats

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-454. --- Resolution: Duplicate Is subsumed by issues around FLINK-986 to cache intermediate results. > Add Prog

[jira] [Closed] (FLINK-1296) Add support for very large record for sorting

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-1296. Resolution: Fixed Fixed in 482565608414fea8df7ed86d5d9a8d90fdfcd4f7 > Add support for very large re

[jira] [Updated] (FLINK-1180) Add support for Hadoop MapReduce.* API Mappers and Reducers

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1180: - Summary: Add support for Hadoop MapReduce.* API Mappers and Reducers (was: Expose Map and Reduce

[jira] [Closed] (FLINK-178) Memory-Temping Data Sink / Source

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-178. --- Resolution: Duplicate Is subsumed by issues around FLINK-986 to cache intermediate results. > Memory-T

[jira] [Commented] (FLINK-1462) Add documentation guide for the graph API

2015-02-04 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306036#comment-14306036 ] Vasia Kalavri commented on FLINK-1462: -- I'm definitely planning to add some pictures

[jira] [Updated] (FLINK-1388) POJO support for writeAsCsv

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-1388: - Assignee: Adnan Khan > POJO support for writeAsCsv > --- > >

[jira] [Commented] (FLINK-1388) POJO support for writeAsCsv

2015-02-04 Thread Adnan Khan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305996#comment-14305996 ] Adnan Khan commented on FLINK-1388: --- I'll work on this one. > POJO support for writeAsC

[GitHub] flink pull request: [FLINK-377] [FLINK-671] Generic Interface / PA...

2015-02-04 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/202#issuecomment-72941023 Got my triangle example also to working on a local setup. :-) Will play around more in the next days. --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-377) Create a general purpose framework for language bindings

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305977#comment-14305977 ] ASF GitHub Bot commented on FLINK-377: -- Github user fhueske commented on the pull requ

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305956#comment-14305956 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on the pull r

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/363#issuecomment-72939364 Looks good. Besides the typos and inline comments, you could also move the `HadoopInputFormatTest` and the `HadoopIOFormatsITCase` to flink-java and flink-tests.

[jira] [Commented] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305936#comment-14305936 ] ASF GitHub Bot commented on FLINK-592: -- Github user rmetzger commented on the pull req

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/358#issuecomment-72937500 Thank you. Thats good to hear. > On 04.02.2015, at 21:56, Daniel Warneke wrote: > > Tested the code and everything works as expected now. Great

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread warneke
Github user warneke commented on the pull request: https://github.com/apache/flink/pull/358#issuecomment-72937077 Tested the code and everything works as expected now. Great job! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305934#comment-14305934 ] ASF GitHub Bot commented on FLINK-592: -- Github user warneke commented on the pull requ

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305921#comment-14305921 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/363#discussion_r24118164 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java --- @@ -458,6 +461,67 @@ public CsvReader readCsvFile(String filePath) {

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305914#comment-14305914 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/363#discussion_r24117856 --- Diff: docs/hadoop_compatibility.md --- @@ -52,56 +63,70 @@ Add the following dependency to your `pom.xml` to use the Hadoop Compatibility L ###

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305910#comment-14305910 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/363#discussion_r24117714 --- Diff: docs/hadoop_compatibility.md --- @@ -52,56 +63,70 @@ Add the following dependency to your `pom.xml` to use the Hadoop Compatibility L ###

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305905#comment-14305905 ] ASF GitHub Bot commented on FLINK-1396: --- Github user fhueske commented on a diff in

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/363#discussion_r24117603 --- Diff: docs/hadoop_compatibility.md --- @@ -38,9 +39,19 @@ This document shows how to use existing Hadoop MapReduce code with Flink. Please ### P

[jira] [Commented] (FLINK-837) Allow FunctionAnnotations on Methods

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305858#comment-14305858 ] Fabian Hueske commented on FLINK-837: - [~StephanEwen] Is this issue solved with the in-

[jira] [Resolved] (FLINK-823) Improve Semantic Annotations

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske resolved FLINK-823. - Resolution: Fixed Assignee: Fabian Hueske Fixed with de8e066ccbd0a31e5746bc0bee524a48bba3a552

[jira] [Created] (FLINK-1475) Minimize log output of yarn test cases

2015-02-04 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1475: Summary: Minimize log output of yarn test cases Key: FLINK-1475 URL: https://issues.apache.org/jira/browse/FLINK-1475 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-1396) Add hadoop input formats directly to the user API.

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305494#comment-14305494 ] ASF GitHub Bot commented on FLINK-1396: --- GitHub user aljoscha opened a pull request:

[GitHub] flink pull request: [FLINK-1396][FLINK-1303] Hadoop Input/Output d...

2015-02-04 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/363 [FLINK-1396][FLINK-1303] Hadoop Input/Output directly in API This adds methods on ExecutionEnvironment for reading with Hadoop Input/OutputFormat. This also adds support in the Scala API

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305468#comment-14305468 ] ASF GitHub Bot commented on FLINK-1442: --- Github user hsaputra commented on a diff in

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24097257 --- Diff: flink-runtime/src/test/scala/org/apache/flink/runtime/testingUtils/TestingMemoryArchivist.scala --- @@ -31,10 +31,11 @@ trait TestingMemoryArchivis

[jira] [Commented] (FLINK-1318) Make quoted String parsing optional and configurable for CSVInputFormats

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305450#comment-14305450 ] ASF GitHub Bot commented on FLINK-1318: --- Github user fhueske commented on the pull r

[GitHub] flink pull request: [FLINK-1318] CsvInputFormat: Made quoted strin...

2015-02-04 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/265#issuecomment-72886847 Other comments on the API breaking. If not, I'd merge it... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] flink pull request: Qa bot

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/362#issuecomment-72886592 Sorry guys, I was confused with the different repositories. I'll close it again. --- If your project is set up for it, you can reply to this email and have your reply ap

[GitHub] flink pull request: Qa bot

2015-02-04 Thread flinkqa
Github user flinkqa closed the pull request at: https://github.com/apache/flink/pull/362 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] flink pull request: Qa bot

2015-02-04 Thread flinkqa
GitHub user flinkqa opened a pull request: https://github.com/apache/flink/pull/362 Qa bot You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink qa-bot Alternatively you can review and apply these changes as the patch a

[jira] [Closed] (FLINK-1474) Cross produces wrong results for non-tiny inputs

2015-02-04 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-1474. Resolution: Not a Problem Turned out that the problem was caused by the FilterFunction and not the C

[jira] [Commented] (FLINK-1318) Make quoted String parsing optional and configurable for CSVInputFormats

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305411#comment-14305411 ] ASF GitHub Bot commented on FLINK-1318: --- Github user mxm commented on the pull reque

[GitHub] flink pull request: [FLINK-1318] CsvInputFormat: Made quoted strin...

2015-02-04 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/265#issuecomment-72883989 Looks good to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[jira] [Commented] (FLINK-1201) Graph API for Flink

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305397#comment-14305397 ] ASF GitHub Bot commented on FLINK-1201: --- Github user vasia commented on the pull req

[GitHub] flink pull request: [FLINK-1201] Add flink-gelly to flink-addons (...

2015-02-04 Thread vasia
Github user vasia commented on the pull request: https://github.com/apache/flink/pull/335#issuecomment-72883525 @balidani that's OK :) @cebe we've got the acknowledgement for you, thanks! @andralungu has submitted hers today. --- If your project is set up for it, you can repl

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305357#comment-14305357 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305358#comment-14305358 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305360#comment-14305360 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093464 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import org.apache.flink.runtime.jobgraph.

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305359#comment-14305359 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093436 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import org.apache.flink.runtime.jobgraph.

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093429 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import org.apache.flink.runtime.jobgraph.

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305356#comment-14305356 ] ASF GitHub Bot commented on FLINK-1442: --- Github user mxm commented on a diff in the

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093445 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import org.apache.flink.runtime.jobgraph.

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24093420 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import org.apache.flink.runtime.jobgraph.

[GitHub] flink pull request: [docs] add documentation for FLink GCE setup u...

2015-02-04 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/flink/pull/361 [docs] add documentation for FLink GCE setup using bdutil Now that bdutil supports Flink setups, we can adjust the documentation. Is the Google Compute Engine setup placed correctly under "Setup

[GitHub] flink pull request: [FLINK1443] Add support for replicating input ...

2015-02-04 Thread fhueske
GitHub user fhueske opened a pull request: https://github.com/apache/flink/pull/360 [FLINK1443] Add support for replicating input formats. InputFormats can be wrapped by a ReplicatingInputFormat which takes care that the full input of the wrapped input format is read in each paralle

[jira] [Commented] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305221#comment-14305221 ] ASF GitHub Bot commented on FLINK-592: -- Github user mxm commented on the pull request:

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/358#issuecomment-72870536 @warneke Thanks for reporting. If the above issues have been resolved, I suggest to merge the changes. --- If your project is set up for it, you can reply to this email and h

[jira] [Created] (FLINK-1474) Cross produces wrong results for non-tiny inputs

2015-02-04 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1474: Summary: Cross produces wrong results for non-tiny inputs Key: FLINK-1474 URL: https://issues.apache.org/jira/browse/FLINK-1474 Project: Flink Issue Type: Bu

[jira] [Resolved] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-592. -- Resolution: Fixed Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/48d8dd5a > Add

[jira] [Commented] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305192#comment-14305192 ] ASF GitHub Bot commented on FLINK-592: -- Github user asfgit closed the pull request at:

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/358 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (FLINK-1473) Simplify SplittableIterator interface

2015-02-04 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305141#comment-14305141 ] Robert Metzger commented on FLINK-1473: --- Code from https://github.com/apache/flink/p

[jira] [Commented] (FLINK-1471) Allow KeySelectors to implement ResultTypeQueryable

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305140#comment-14305140 ] ASF GitHub Bot commented on FLINK-1471: --- Github user twalthr commented on a diff in

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/359#discussion_r24085603 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java --- @@ -680,10 +680,20 @@ private static void validateInputType(Type

[GitHub] flink pull request: [Discuss] Simplify SplittableIterator interfac...

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/338#issuecomment-72861601 Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/7ac6447f. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] flink pull request: [Discuss] Simplify SplittableIterator interfac...

2015-02-04 Thread rmetzger
Github user rmetzger closed the pull request at: https://github.com/apache/flink/pull/338 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[jira] [Resolved] (FLINK-1473) Simplify SplittableIterator interface

2015-02-04 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1473. --- Resolution: Fixed Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/7ac6447f >

[jira] [Created] (FLINK-1473) Simplify SplittableIterator interface

2015-02-04 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1473: - Summary: Simplify SplittableIterator interface Key: FLINK-1473 URL: https://issues.apache.org/jira/browse/FLINK-1473 Project: Flink Issue Type: Task

[jira] [Commented] (FLINK-1471) Allow KeySelectors to implement ResultTypeQueryable

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305120#comment-14305120 ] ASF GitHub Bot commented on FLINK-1471: --- Github user rmetzger commented on a diff in

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/359#discussion_r24085204 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java --- @@ -680,10 +680,20 @@ private static void validateInputType(Typ

[jira] [Commented] (FLINK-1471) Allow KeySelectors to implement ResultTypeQueryable

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305116#comment-14305116 ] ASF GitHub Bot commented on FLINK-1471: --- Github user twalthr commented on a diff in

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/359#discussion_r24085111 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java --- @@ -680,10 +680,20 @@ private static void validateInputType(Type

[jira] [Commented] (FLINK-1471) Allow KeySelectors to implement ResultTypeQueryable

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305091#comment-14305091 ] ASF GitHub Bot commented on FLINK-1471: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/359#issuecomment-72859235 Thank you @twalthr! I've verified your change and its fixing the issue I was reporting originally. Except for one minor question, the change is good to merge.

[GitHub] flink pull request: Allow KeySelectors to implement ResultTypeQuer...

2015-02-04 Thread aalexandrov
Github user aalexandrov commented on the pull request: https://github.com/apache/flink/pull/354#issuecomment-72857627 I think that this only happens for the primitive types. I think this is by design. If you want to inspect generic parameters, Scala forces you to use the Scal

[jira] [Commented] (FLINK-592) Add support for secure YARN clusters with Kerberos Auth

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305078#comment-14305078 ] ASF GitHub Bot commented on FLINK-592: -- Github user rmetzger commented on the pull req

[GitHub] flink pull request: [FLINK-592] Add support for Kerberos secured Y...

2015-02-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/358#issuecomment-72856331 Thank you for the good feedback! @mxm and I updated the pull request and addressed your concerns. I'm now running the tests on Travis. If they pass I'm going t

[jira] [Commented] (FLINK-1201) Graph API for Flink

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305052#comment-14305052 ] ASF GitHub Bot commented on FLINK-1201: --- Github user balidani commented on the pull

[GitHub] flink pull request: [FLINK-1201] Add flink-gelly to flink-addons (...

2015-02-04 Thread balidani
Github user balidani commented on the pull request: https://github.com/apache/flink/pull/335#issuecomment-72851434 Sorry, I will only be able to fill the form on Sunday, my internet connection is horrible here. Is that ok? Daniel On Feb 2, 2015 3:53 PM, "Carsten Brandt"

[jira] [Commented] (FLINK-819) OutOfMemoryError from TaskManager is causing hard to understand exceptions and blocking JobManager

2015-02-04 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304955#comment-14304955 ] Till Rohrmann commented on FLINK-819: - Should be tested. > OutOfMemoryError from TaskM

[jira] [Commented] (FLINK-1303) HadoopInputFormat does not work with Scala API

2015-02-04 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304953#comment-14304953 ] Till Rohrmann commented on FLINK-1303: -- {code} val hadoopIF = new HadoopInputFormat[L

[jira] [Commented] (FLINK-1376) SubSlots are not properly released in case that a TaskManager fatally fails, leaving the system in a corrupted state

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304900#comment-14304900 ] ASF GitHub Bot commented on FLINK-1376: --- Github user tillrohrmann commented on the p

[GitHub] flink pull request: [FLINK-1376] [runtime] Add proper shared slot ...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/317#issuecomment-72832512 +1 for removing unnecessary ExecutionGraph information before archiving. --- If your project is set up for it, you can reply to this email and have your reply appear

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304895#comment-14304895 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on the p

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/344#issuecomment-72832200 Ah ok perfect that you already addressed the minor issues. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304893#comment-14304893 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on the p

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/344#issuecomment-72831706 It is true that thorough programming is always the best, but Option encourages you to apply a more functional programming style which in many cases results in safer c

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304882#comment-14304882 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24073474 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import org.apache.flink.runtime.

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304878#comment-14304878 ] ASF GitHub Bot commented on FLINK-1442: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/344#issuecomment-72829676 You can also shoot yourself in the foot with Option, no? There is no substitute for thorough programming... --- If your project is set up for it, you can reply to thi

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304876#comment-14304876 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304875#comment-14304875 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24073205 --- Diff: flink-runtime/src/test/scala/org/apache/flink/runtime/testingUtils/TestingMemoryArchivist.scala --- @@ -31,10 +31,11 @@ trait TestingMemoryArch

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24073173 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import org.apache.flink.runtime.

[jira] [Commented] (FLINK-1471) Allow KeySelectors to implement ResultTypeQueryable

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304871#comment-14304871 ] ASF GitHub Bot commented on FLINK-1471: --- Github user rmetzger commented on a diff in

[GitHub] flink pull request: [FLINK-1471][java-api] Fixes wrong input valid...

2015-02-04 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/359#discussion_r24073064 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java --- @@ -680,10 +680,20 @@ private static void validateInputType(Typ

[GitHub] flink pull request: [FLINK-1442] Reduce memory consumption of arch...

2015-02-04 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/344#discussion_r24072836 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/MemoryArchivist.scala --- @@ -25,48 +25,82 @@ import org.apache.flink.runtime.

[jira] [Commented] (FLINK-1442) Archived Execution Graph consumes too much memory

2015-02-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304867#comment-14304867 ] ASF GitHub Bot commented on FLINK-1442: --- Github user tillrohrmann commented on a dif

  1   2   >