[jira] [Created] (FLINK-4436) Unclosed DataOutputBuffer in Utils#setTokensFor()

2016-08-19 Thread Ted Yu (JIRA)
Ted Yu created FLINK-4436: - Summary: Unclosed DataOutputBuffer in Utils#setTokensFor() Key: FLINK-4436 URL: https://issues.apache.org/jira/browse/FLINK-4436 Project: Flink Issue Type: Bug

Re: [DISCUSS] Python API for Fllink libraries

2016-08-19 Thread Chesnay Schepler
Hello, I would say no, as the general reception of the Python API was *tumbleweed* so far. In my opinion this would just lead to a massive increase in code to maintain; we would need at least 2-3 active long-term python contributors. Especially so since ML, CEP and Table are afaik still in

[jira] [Created] (FLINK-4434) Add a testing RPC service

2016-08-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4434: --- Summary: Add a testing RPC service Key: FLINK-4434 URL: https://issues.apache.org/jira/browse/FLINK-4434 Project: Flink Issue Type: Sub-task

[DISCUSS] Python API for Fllink libraries

2016-08-19 Thread Ivan Mushketyk
Hi Flink developers, It seems to me that Flink has two important "selling points": 1. It has Java, Scala and Python APIs 2. I has a number of useful libraries (ML, Gelly, CEP, and Table) But as far as I understand, currently users cannot use any of these libraries using a Python API. It seems

Re: [FLINK-305] Code test coverage - how FLINK using it?

2016-08-19 Thread Pavel Fadeev
Fabian, Till, thanks for your comments! I`ve raised https://issues.apache.org/jira/browse/INFRA-12458 for the same. Will play around to see if this solution acceptable and does not affect build duration too much. 2016-08-19 12:51 GMT+03:00 Till Rohrmann : > Hi Pavel, > > I

[jira] [Created] (FLINK-4433) Refactor the StreamSource.

2016-08-19 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-4433: - Summary: Refactor the StreamSource. Key: FLINK-4433 URL: https://issues.apache.org/jira/browse/FLINK-4433 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-10: Unify Savepoints and Checkpoints

2016-08-19 Thread Aljoscha Krettek
+1 A great proposal. I'd like to suggest one change. In one paragraph you say "If no savepoint path is configured, fail the savepoint.". I think this is problematic because it means that users who forgot to add the setting to the config will be at a dead if they want to update. Can we make it

Re: [DISCUSS] FLIP-10: Unify Savepoints and Checkpoints

2016-08-19 Thread Gyula Fóra
Hi Ufuk, Great initiative in general I agree with pretty much everything in the proposal. Some minor comments: With these changes savepoints and checkpoints become pretty much the same thing so we might as well drop one of the concepts and just refer to checkpoints as savepoints that are

[DISCUSS] FLIP-10: Unify Savepoints and Checkpoints

2016-08-19 Thread Ufuk Celebi
Hey devs! I've created a FLIP to unify savepoints and checkpoints: https://cwiki.apache.org/confluence/display/FLINK/FLIP-10%3A+Unify+Checkpoints+and+Savepoints# Looking forward to your feedback. – Ufuk

[jira] [Created] (FLINK-4432) (YARN) JobManager web port is no longer available in configuration page in web interface

2016-08-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-4432: - Summary: (YARN) JobManager web port is no longer available in configuration page in web interface Key: FLINK-4432 URL: https://issues.apache.org/jira/browse/FLINK-4432

Re: Reducing the JIRA PR message verbosity

2016-08-19 Thread Maximilian Michels
Sure, I've filed a JIRA: https://issues.apache.org/jira/browse/INFRA-12456 On Thu, Aug 18, 2016 at 10:57 AM, Stephan Ewen wrote: > @max - can you contact infra about that? > > On Thu, Aug 18, 2016 at 10:25 AM, Maximilian Michels wrote: > >> Actually that is a

Re: [DISCUSS] FLIP-3 - Organization of Documentation

2016-08-19 Thread Till Rohrmann
I second Aljoscha :-) On Fri, Aug 19, 2016 at 11:53 AM, Aljoscha Krettek wrote: > I checked it out and I liked it. :-) > > On Thu, 18 Aug 2016 at 19:40 Ufuk Celebi wrote: > > > Initial PR for the layout: https://github.com/apache/flink/pull/2387 > > > > On

[jira] [Created] (FLINK-4431) Introduce a "VisibleForTesting" annotation

2016-08-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4431: --- Summary: Introduce a "VisibleForTesting" annotation Key: FLINK-4431 URL: https://issues.apache.org/jira/browse/FLINK-4431 Project: Flink Issue Type:

Re: [DISCUSS] Move Redis and Flume connectors to Apache Bahir and redirect contributions there

2016-08-19 Thread subhankar biswas
+1 On 17-Aug-2016 8:54 PM, "Robert Metzger" wrote: > Hi, > > following the discussions in [1], the community decided to offer > contributors to submit streaming connectors the Flink community can not > maintain to Apache Bahir (there is still the option that we are moving >

Re: [DISCUSS] FLIP-3 - Organization of Documentation

2016-08-19 Thread Aljoscha Krettek
I checked it out and I liked it. :-) On Thu, 18 Aug 2016 at 19:40 Ufuk Celebi wrote: > Initial PR for the layout: https://github.com/apache/flink/pull/2387 > > On Tue, Aug 2, 2016 at 5:18 PM, Aljoscha Krettek > wrote: > > +1 > > > > On Tue, 2 Aug 2016 at

Re: [FLINK-305] Code test coverage - how FLINK using it?

2016-08-19 Thread Fabian Hueske
Hi Pavel, the Cobertura plugin was removed in this PR: https://github.com/apache/flink/pull/454 Not sure if it was accidentally removed or on purpose. It was not included in the regular builds to reduce build time and AFAIK, it wasn't manually used either (otherwise somebody would have noticed

Re: [DISCUSS] Some thoughts about unify Stream SQL and Batch SQL grammer

2016-08-19 Thread Fabian Hueske
Hi Jark, thanks for starting this discussion. Actually, I think we are rather "blocked" on the internal handling of streaming windows in Calcite than the SQL parser. IMO, it should be possible to exchange or modify the parser if we want that. Regarding Calcite's StreamSQL syntax: Except for the

[jira] [Created] (FLINK-4430) prevent BLOCKING partition data lose when task is finished

2016-08-19 Thread Kurt Young (JIRA)
Kurt Young created FLINK-4430: - Summary: prevent BLOCKING partition data lose when task is finished Key: FLINK-4430 URL: https://issues.apache.org/jira/browse/FLINK-4430 Project: Flink Issue

[jira] [Created] (FLINK-4429) Move Redis Sink from Flink to Bahir

2016-08-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-4429: - Summary: Move Redis Sink from Flink to Bahir Key: FLINK-4429 URL: https://issues.apache.org/jira/browse/FLINK-4429 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-4428) Method map/flatMapWithState may need a eviction policy

2016-08-19 Thread Renkai Ge (JIRA)
Renkai Ge created FLINK-4428: Summary: Method map/flatMapWithState may need a eviction policy Key: FLINK-4428 URL: https://issues.apache.org/jira/browse/FLINK-4428 Project: Flink Issue Type: New