[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-18 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/393#issuecomment-74833886 I would like to merge this pull request soon. @aljoscha, do you agree that we can investigate the performance for the PojoComparator also when the change is merged?

[jira] [Closed] (FLINK-1575) JobManagerConnectionTest.testResolveUnreachableActorRemoteHost times out on travis

2015-02-18 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger closed FLINK-1575. - Resolution: Invalid The issue is caused by one of my changes (dependency conflict). I'm closing

[jira] [Commented] (FLINK-947) Add support for Named Datasets

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325686#comment-14325686 ] ASF GitHub Bot commented on FLINK-947: -- Github user aljoscha commented on the pull

[GitHub] flink pull request: [FLINK-947] Add a declarative expression API

2015-02-18 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/405#issuecomment-74842606 Yeah, I'm not sure about linq as well. I like the name but realise that it might be problematic. What do the others think. I could call it flink-expressions. I

[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-18 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/393#issuecomment-74843995 Yes. First we need to understand why exactly the performance is so poor. Maybe its an issue we can easily fix. --- If your project is set up for it, you can reply to

[jira] [Commented] (FLINK-1417) Automatically register nested types at Kryo

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325629#comment-14325629 ] ASF GitHub Bot commented on FLINK-1417: --- Github user rmetzger commented on the pull

[GitHub] flink pull request: [FLINK-947] Add a declarative expression API

2015-02-18 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/405#issuecomment-74845397 To me, `flink-expressions` sounds much better than `linq` and it mitigates the risk of law suites :) --- If your project is set up for it, you can reply to this email and

[GitHub] flink pull request: [FLINK-947] Add a declarative expression API

2015-02-18 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/405#issuecomment-74832989 One more thing, the maven module is called flink-linq. Are we certain that we can use the name LINQ without problems here? --- If your project is set up for it, you can

[jira] [Commented] (FLINK-1577) Misleading error messages when cancelling tasks

2015-02-18 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325695#comment-14325695 ] Ufuk Celebi commented on FLINK-1577: {code} 10:56:40,161 ERROR

[jira] [Updated] (FLINK-1573) Add per-job metrics to flink.

2015-02-18 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-1573: -- Fix Version/s: (was: pre-apache) Add per-job metrics to flink.

[jira] [Resolved] (FLINK-1566) WindowIntegrationTest fails

2015-02-18 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora resolved FLINK-1566. --- Resolution: Fixed WindowIntegrationTest fails --- Key:

[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-18 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/393#issuecomment-74843783 Yes please, go ahead. But if our Pojo stuff is really that slow we should think about how to improve that or remove it alltogether. --- If your project is set up for

[jira] [Commented] (FLINK-947) Add support for Named Datasets

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325705#comment-14325705 ] ASF GitHub Bot commented on FLINK-947: -- Github user mxm commented on the pull request:

[jira] [Created] (FLINK-1577) Misleading error messages when cancelling tasks

2015-02-18 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1577: -- Summary: Misleading error messages when cancelling tasks Key: FLINK-1577 URL: https://issues.apache.org/jira/browse/FLINK-1577 Project: Flink Issue Type:

[GitHub] flink pull request: [FLINK-1561] [build system] Use a fresh fork f...

2015-02-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/412 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (FLINK-1561) Improve build server robustness by not reusing JVMs in integration tests

2015-02-18 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-1561. - Resolution: Fixed Fixed via a8c99d5a8fc6a700a670da5443d9a808ac5eaaa0 Improve build server

[jira] [Issue Comment Deleted] (FLINK-1421) Implement a SAMOA Adapter for Flink Streaming

2015-02-18 Thread Fay Beligianni (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fay Beligianni updated FLINK-1421: -- Comment: was deleted (was: Hey Stefan, Thank you very much for the response! Indeed that was

[jira] [Commented] (FLINK-1461) Add sortPartition operator

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326234#comment-14326234 ] ASF GitHub Bot commented on FLINK-1461: --- Github user fhueske commented on the pull

[jira] [Commented] (FLINK-1421) Implement a SAMOA Adapter for Flink Streaming

2015-02-18 Thread Fay Beligianni (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326193#comment-14326193 ] Fay Beligianni commented on FLINK-1421: --- We already tried that workaround for

[jira] [Updated] (FLINK-1582) SocketStream gets stuck when socket closes

2015-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Márton Balassi updated FLINK-1582: -- Labels: starter (was: ) SocketStream gets stuck when socket closes

[jira] [Created] (FLINK-1583) TaskManager reregistration in case of a restart

2015-02-18 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1583: Summary: TaskManager reregistration in case of a restart Key: FLINK-1583 URL: https://issues.apache.org/jira/browse/FLINK-1583 Project: Flink Issue Type:

[GitHub] flink pull request: [FLINK-1461][api-extending] Add SortPartition ...

2015-02-18 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/381#issuecomment-74908224 any further comment on this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[jira] [Created] (FLINK-1582) SocketStream gets stuck when socket closes

2015-02-18 Thread JIRA
Márton Balassi created FLINK-1582: - Summary: SocketStream gets stuck when socket closes Key: FLINK-1582 URL: https://issues.apache.org/jira/browse/FLINK-1582 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-1580) Cleanup TaskManager initialization logic

2015-02-18 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1580: Summary: Cleanup TaskManager initialization logic Key: FLINK-1580 URL: https://issues.apache.org/jira/browse/FLINK-1580 Project: Flink Issue Type: Bug

[jira] [Comment Edited] (FLINK-1421) Implement a SAMOA Adapter for Flink Streaming

2015-02-18 Thread Fay Beligianni (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326196#comment-14326196 ] Fay Beligianni edited comment on FLINK-1421 at 2/18/15 5:13 PM:

[jira] [Commented] (FLINK-1444) Add data properties for data sources

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326240#comment-14326240 ] ASF GitHub Bot commented on FLINK-1444: --- Github user fhueske commented on the pull

[jira] [Commented] (FLINK-1483) Temporary channel files are not properly deleted when Flink is terminated

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326429#comment-14326429 ] ASF GitHub Bot commented on FLINK-1483: --- Github user hsaputra commented on the pull

[GitHub] flink pull request: Remove extra space after open parenthesis in I...

2015-02-18 Thread hsaputra
GitHub user hsaputra opened a pull request: https://github.com/apache/flink/pull/416 Remove extra space after open parenthesis in InstanceConnectionInfo#toString Small update to remove extra space after open parenthesis in InstanceConnectionInfo#toString to be consistent with other

[GitHub] flink pull request: [FLINK-1483] IOManager puts temp files in dedi...

2015-02-18 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/417#discussion_r24931138 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/disk/iomanager/IOManager.java --- @@ -52,26 +57,88 @@ /** * Constructs a

[jira] [Commented] (FLINK-1483) Temporary channel files are not properly deleted when Flink is terminated

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326399#comment-14326399 ] ASF GitHub Bot commented on FLINK-1483: --- GitHub user StephanEwen opened a pull

[jira] [Commented] (FLINK-1483) Temporary channel files are not properly deleted when Flink is terminated

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326411#comment-14326411 ] ASF GitHub Bot commented on FLINK-1483: --- Github user hsaputra commented on a diff in

[GitHub] flink pull request: [FLINK-1483] IOManager puts temp files in dedi...

2015-02-18 Thread hsaputra
Github user hsaputra commented on the pull request: https://github.com/apache/flink/pull/417#issuecomment-74930615 Since the IOManager add shutdown hook to clean up the files, should IOManagerAsync#isProperlyShutDown need to call super.isProperlyShutDown ? --- If your project is set

[jira] [Commented] (FLINK-1466) Add InputFormat to read HCatalog tables

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326134#comment-14326134 ] ASF GitHub Bot commented on FLINK-1466: --- Github user fhueske commented on the pull

[GitHub] flink pull request: [FLINK-1466] Add HCatInputFormats to read from...

2015-02-18 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/411#issuecomment-74894556 @rmetzger Thanks for the feedback. Added support for complex types to the Flink tuple mode and tested it on a local cluster setup. --- If your project is set up for

[jira] [Comment Edited] (FLINK-1552) Allow secondary sorts in Vertex Centric Iteration

2015-02-18 Thread Martin Kiefer (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325769#comment-14325769 ] Martin Kiefer edited comment on FLINK-1552 at 2/18/15 11:47 AM:

[jira] [Commented] (FLINK-1579) Create a Flink History Server

2015-02-18 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325847#comment-14325847 ] Stephan Ewen commented on FLINK-1579: - How much is there in terms of Hadoop History

[jira] [Commented] (FLINK-1466) Add InputFormat to read HCatalog tables

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326147#comment-14326147 ] ASF GitHub Bot commented on FLINK-1466: --- Github user rmetzger commented on the pull

[jira] [Commented] (FLINK-1417) Automatically register nested types at Kryo

2015-02-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325864#comment-14325864 ] ASF GitHub Bot commented on FLINK-1417: --- Github user rmetzger commented on the pull

[jira] [Commented] (FLINK-1201) Graph API for Flink

2015-02-18 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325885#comment-14325885 ] Stephan Ewen commented on FLINK-1201: - I think we can close this, now that Gelly is

[jira] [Commented] (FLINK-1201) Graph API for Flink

2015-02-18 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325918#comment-14325918 ] Vasia Kalavri commented on FLINK-1201: -- sure, I'll close it :) Graph API for Flink

[jira] [Closed] (FLINK-1201) Graph API for Flink

2015-02-18 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasia Kalavri closed FLINK-1201. Resolution: Implemented Graph API for Flink Key:

[jira] [Commented] (FLINK-1552) Allow secondary sorts in Vertex Centric Iteration

2015-02-18 Thread Martin Kiefer (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325769#comment-14325769 ] Martin Kiefer commented on FLINK-1552: -- I worked on Approximate Maximum Weight

[jira] [Resolved] (FLINK-1562) Introduce retries for fetching data from the BLOB manager

2015-02-18 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-1562. - Resolution: Duplicate Subsumed by[FLINK-1578] Introduce retries for fetching data from the BLOB

[jira] [Commented] (FLINK-1421) Implement a SAMOA Adapter for Flink Streaming

2015-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325808#comment-14325808 ] Márton Balassi commented on FLINK-1421: --- When your program is distributed one of the

[jira] [Commented] (FLINK-1579) Create a Flink History Server

2015-02-18 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325851#comment-14325851 ] Robert Metzger commented on FLINK-1579: --- We have to investigate on that:

[jira] [Resolved] (FLINK-1578) Overhaul BLOB manager

2015-02-18 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-1578. - Resolution: Fixed Fixed via cfce493feb70a49d2722dc2a0d79f845f7e0461a Overhaul BLOB manager

[GitHub] flink pull request: [builds] Allow to upload build artifacts to S3

2015-02-18 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/407#issuecomment-74864911 Very good idea. +1 from my side --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Created] (FLINK-1579) Create a Flink History Server

2015-02-18 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1579: - Summary: Create a Flink History Server Key: FLINK-1579 URL: https://issues.apache.org/jira/browse/FLINK-1579 Project: Flink Issue Type: New Feature

[jira] [Resolved] (FLINK-1395) Add Jodatime support to Kryo

2015-02-18 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1395. --- Resolution: Fixed Fix Version/s: 0.9 Resolved for master 0.9 in

[jira] [Resolved] (FLINK-1392) Serializing Protobuf - issue 1

2015-02-18 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1392. --- Resolution: Fixed Fix Version/s: 0.9 Resolved for 0.9 in master with commit:

[jira] [Resolved] (FLINK-1417) Automatically register nested types at Kryo

2015-02-18 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1417. --- Resolution: Fixed Resolved in http://git-wip-us.apache.org/repos/asf/flink/commit/354efec0

[jira] [Resolved] (FLINK-1391) Kryo fails to properly serialize avro collection types

2015-02-18 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved FLINK-1391. --- Resolution: Fixed Fix Version/s: 0.9 Resolved for 0.9 into master with

[GitHub] flink pull request: [FLINK-1417] Automatically register types with...

2015-02-18 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/393#issuecomment-74867033 Merging it now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[jira] [Commented] (FLINK-1388) POJO support for writeAsCsv

2015-02-18 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325971#comment-14325971 ] Robert Metzger commented on FLINK-1388: --- Yes, adding additional tests is always

[GitHub] flink pull request: [FLINK-1466] Add HCatInputFormats to read from...

2015-02-18 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/411#issuecomment-74895705 Cool. Then I think the change is good to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your