[jira] [Created] (FLINK-6055) Supported setting timers on a Non-Keyed Stream

2017-03-14 Thread sunjincheng (JIRA)
sunjincheng created FLINK-6055: -- Summary: Supported setting timers on a Non-Keyed Stream Key: FLINK-6055 URL: https://issues.apache.org/jira/browse/FLINK-6055 Project: Flink Issue Type: New

[jira] [Created] (FLINK-6054) Add new state backend that dynamically stores data in memory and external storage

2017-03-14 Thread Sergio Esteves (JIRA)
Sergio Esteves created FLINK-6054: - Summary: Add new state backend that dynamically stores data in memory and external storage Key: FLINK-6054 URL: https://issues.apache.org/jira/browse/FLINK-6054

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Ismaël Mejía
Awesome great to see this explicit. Thanks. On Tue, Mar 14, 2017 at 3:48 PM, Robert Metzger wrote: > I've decided to put it on the download page. Please check out my PR: > https://github.com/apache/flink-web/pull/50 > > On Tue, Mar 14, 2017 at 2:57 PM, Ufuk Celebi

[jira] [Created] (FLINK-6053) Gauge should only take subclasses of Number, rather than everything

2017-03-14 Thread Bowen Li (JIRA)
Bowen Li created FLINK-6053: --- Summary: Gauge should only take subclasses of Number, rather than everything Key: FLINK-6053 URL: https://issues.apache.org/jira/browse/FLINK-6053 Project: Flink

Re: Machine Learning on Flink - Next steps

2017-03-14 Thread Stephan Ewen
Thanks Theo. Just wrote some comments on the other thread, but it looks like you got it covered already. Let me re-post what I think may help as input: *Concerning Model Evaluation / Serving * - My personal take is that the "model evaluation" over streams will be happening in any case -

Re: [DISCUSS] Flink ML roadmap

2017-03-14 Thread Stephan Ewen
Hi all! Sorry for joining this discussion late (I have already missed some of the deadlines set in this thread). *Here are some thoughts about what we can do immediately* (1) Grow ML community by adding committers with a dedicated. Irrespective of any direction decision, this is a

[jira] [Created] (FLINK-6052) Potential null access in ZooKeeperCompletedCheckpointStore#getLatestCheckpoint()

2017-03-14 Thread Ted Yu (JIRA)
Ted Yu created FLINK-6052: - Summary: Potential null access in ZooKeeperCompletedCheckpointStore#getLatestCheckpoint() Key: FLINK-6052 URL: https://issues.apache.org/jira/browse/FLINK-6052 Project: Flink

Re: [DISCUSS] Project build time and possible restructuring

2017-03-14 Thread Stephan Ewen
Some other thoughts on how repository split would help. I am not sure for all of them, so please comment: - There is less competition for a "commit window". It happens a lot already that you run all tests and want to commit, but there was a commit in the meantime. You rebase, need to re-test,

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-14 Thread Vladislav Pernin
Hi, I would also include the following (not yet resolved) issue in the 1.2.1 scope : https://issues.apache.org/jira/browse/FLINK-6001 NPE on TumblingEventTimeWindows with ContinuousEventTimeTrigger and allowedLateness 2017-03-14 17:34 GMT+01:00 Ufuk Celebi : > Big +1 Gordon! >

[jira] [Created] (FLINK-6051) Wrong metric scope names in documentation

2017-03-14 Thread Joshua Griffith (JIRA)
Joshua Griffith created FLINK-6051: -- Summary: Wrong metric scope names in documentation Key: FLINK-6051 URL: https://issues.apache.org/jira/browse/FLINK-6051 Project: Flink Issue Type: Bug

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-14 Thread Ufuk Celebi
Big +1 Gordon! I think (10) is very critical to have in 1.2.1. – Ufuk On Tue, Mar 14, 2017 at 3:37 PM, Stefan Richter wrote: > Hi, > > I would suggest to also include in 1.2.1: > > (9) https://issues.apache.org/jira/browse/FLINK-6044 >

[jira] [Created] (FLINK-6050) Improve failure reporting when using Future.thenAccept

2017-03-14 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6050: Summary: Improve failure reporting when using Future.thenAccept Key: FLINK-6050 URL: https://issues.apache.org/jira/browse/FLINK-6050 Project: Flink Issue

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-14 Thread Stefan Richter
Hi, I would suggest to also include in 1.2.1: (9) https://issues.apache.org/jira/browse/FLINK-6044 Replaces unintentional calls to InputStream#read(…) with the intended and correct InputStream#readFully(…) Status: PR (10)

[jira] [Created] (FLINK-6049) Parallelize execution of (async) snapshots in AsyncCheckpointRunnable

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6049: - Summary: Parallelize execution of (async) snapshots in AsyncCheckpointRunnable Key: FLINK-6049 URL: https://issues.apache.org/jira/browse/FLINK-6049 Project: Flink

[jira] [Created] (FLINK-6048) Asynchronous snapshots for heap-based operator state backends

2017-03-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6048: - Summary: Asynchronous snapshots for heap-based operator state backends Key: FLINK-6048 URL: https://issues.apache.org/jira/browse/FLINK-6048 Project: Flink

[Discuss] Retraction for Flink Streaming

2017-03-14 Thread Shaoxuan Wang
Hello everyone, Flink is widely used in Alibaba Group, especially in our Search and Recommendation Infra. Retraction is one of the most important features that we needed. We have spent lots of efforts to try to solve this problem, and gladly at the end we develop an approach which can address

[jira] [Created] (FLINK-6047) Master Jira for "Retraction for Flink Streaming"

2017-03-14 Thread Shaoxuan Wang (JIRA)
Shaoxuan Wang created FLINK-6047: Summary: Master Jira for "Retraction for Flink Streaming" Key: FLINK-6047 URL: https://issues.apache.org/jira/browse/FLINK-6047 Project: Flink Issue Type:

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Robert Metzger
I've decided to put it on the download page. Please check out my PR: https://github.com/apache/flink-web/pull/50 On Tue, Mar 14, 2017 at 2:57 PM, Ufuk Celebi wrote: > Thanks Robert, I would like that! > > +1 for adding something to the Downloads page. Maybe add it to the FAQ >

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-14 Thread Aljoscha Krettek
Thanks for kicking off the discussion! I have an open PR for - https://issues.apache.org/jira/browse/FLINK-5808: Missing verification for setParallelism and setMaxParallelism - https://issues.apache.org/jira/browse/FLINK-5713: Protect against NPE in WindowOperator window cleanup On Tue, Mar

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-14 Thread Till Rohrmann
Thanks for kicking off the discussion Tzu-Li. I'd like to add the following issues which have already been merged into the 1.2-release and 1.1-release branch: 1.2.1: (7) https://issues.apache.org/jira/browse/FLINK-5942 Hardens the checkpoint recovery in case of corrupted ZooKeeper data.

Re: Wrong argument used in StreamTask when user-defined backend is used

2017-03-14 Thread Till Rohrmann
Thanks for the pointer. I will fix it. Cheers, Till On Mon, Mar 13, 2017 at 4:28 PM, Vladislav Pernin < vladislav.per...@gmail.com> wrote: > https://github.com/apache/flink/blob/master/flink- > streaming-java/src/main/java/org/apache/flink/streaming/ > runtime/tasks/StreamTask.java#L716 > >

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Ufuk Celebi
Thanks Robert, I would like that! +1 for adding something to the Downloads page. Maybe add it to the FAQ and link from the downloads page or the other way around? I don't know what's better. On Tue, Mar 14, 2017 at 2:52 PM, Robert Metzger wrote: > I'll update the Wikipedia

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Robert Metzger
I'll update the Wikipedia article and include the details into our wiki. In addition, what do you think about adding the "update guarantees" on the download or FAQ page? On Tue, Mar 14, 2017 at 1:18 PM, Ufuk Celebi wrote: > Hey Ismael, > > thanks for bringing this up. I think

[jira] [Created] (FLINK-6046) Add support for oversized messages during deployment

2017-03-14 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-6046: -- Summary: Add support for oversized messages during deployment Key: FLINK-6046 URL: https://issues.apache.org/jira/browse/FLINK-6046 Project: Flink Issue Type:

[jira] [Created] (FLINK-6045) FLINK_CONF_DIR has to be set even though specifying --configDir

2017-03-14 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6045: Summary: FLINK_CONF_DIR has to be set even though specifying --configDir Key: FLINK-6045 URL: https://issues.apache.org/jira/browse/FLINK-6045 Project: Flink

[jira] [Created] (FLINK-6044) TypeSerializerSerializationProxy.read() doesn't verify the read buffer length

2017-03-14 Thread Avihai Berkovitz (JIRA)
Avihai Berkovitz created FLINK-6044: --- Summary: TypeSerializerSerializationProxy.read() doesn't verify the read buffer length Key: FLINK-6044 URL: https://issues.apache.org/jira/browse/FLINK-6044

Re: Machine Learning on Flink - Next steps

2017-03-14 Thread Theodore Vasiloudis
Hello all, ## Executive summary: - Offline-on-streaming most popular, then online and model serving. - Need shepherds to lead development/coordination of each task. - I can shepherd online learning, need shepherds for the other two. so from the people sharing their opinion it seems

[jira] [Created] (FLINK-6043) Display time when exceptions/root cause of failure happened

2017-03-14 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6043: Summary: Display time when exceptions/root cause of failure happened Key: FLINK-6043 URL: https://issues.apache.org/jira/browse/FLINK-6043 Project: Flink

[jira] [Created] (FLINK-6042) Display last n exceptions/causes for job restarts in Web UI

2017-03-14 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6042: Summary: Display last n exceptions/causes for job restarts in Web UI Key: FLINK-6042 URL: https://issues.apache.org/jira/browse/FLINK-6042 Project: Flink

[jira] [Created] (FLINK-6041) Move StreamingFunctionUtils to org.apache.flink.streaming.util

2017-03-14 Thread liuyuzhong7 (JIRA)
liuyuzhong7 created FLINK-6041: -- Summary: Move StreamingFunctionUtils to org.apache.flink.streaming.util Key: FLINK-6041 URL: https://issues.apache.org/jira/browse/FLINK-6041 Project: Flink

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Ufuk Celebi
Hey Ismael, thanks for bringing this up. I think it's a very important to communicate this on the project web page. On Tue, Mar 14, 2017 at 9:30 AM, Ismaël Mejía wrote: > What do you think guys? Has this been discussed before? Maybe this is a > good moment to decide this, if

Re: FLINK-5860 assign to me

2017-03-14 Thread Fabian Hueske
Hi Yaroslav, sure. Just did. I also gave you contributor permissions. You can now also assign other issues to yourself. Best, Fabian 2017-03-14 13:10 GMT+01:00 Yaroslav Mykhaylov : > Hello guys, > > Could somebody please assign FLINK-5860 to me. > > Link:

FLINK-5860 assign to me

2017-03-14 Thread Yaroslav Mykhaylov
Hello guys, Could somebody please assign FLINK-5860 to me. Link: https://issues.apache.org/jira/browse/FLINK-5860 Thanks, Yaroslav Mykhaylov

[DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-14 Thread Tzu-Li (Gordon) Tai
Hi all! I would like to start a discussion for the next bugfix release for 1.1.x and 1.2.x. There’s been quite a few critical fixes for bugs in both the releases recently, and I think they deserve a bugfix release soon. Most of the bugs were reported by users. I’m starting the discussion for

[jira] [Created] (FLINK-6040) DataStreamUserDefinedFunctionITCase occasionally fails

2017-03-14 Thread Zhuoluo Yang (JIRA)
Zhuoluo Yang created FLINK-6040: --- Summary: DataStreamUserDefinedFunctionITCase occasionally fails Key: FLINK-6040 URL: https://issues.apache.org/jira/browse/FLINK-6040 Project: Flink Issue

[jira] [Created] (FLINK-6039) Row of TableFunction should support flexible number of fields

2017-03-14 Thread Zhuoluo Yang (JIRA)
Zhuoluo Yang created FLINK-6039: --- Summary: Row of TableFunction should support flexible number of fields Key: FLINK-6039 URL: https://issues.apache.org/jira/browse/FLINK-6039 Project: Flink

[DISCUSS] Official policy for release maintenance

2017-03-14 Thread Ismaël Mejía
​Following my previous question at user@ and by Fabian’s suggestion I moved the discussion here. Flink has been growing steadily, and many organizations are asking the question of how are the releases of flink maintained in the long term, so maybe it is a good idea to decide and make public the

[jira] [Created] (FLINK-6038) Add links to Apache Bahir Flink streaming connectors

2017-03-14 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-6038: -- Summary: Add links to Apache Bahir Flink streaming connectors Key: FLINK-6038 URL: https://issues.apache.org/jira/browse/FLINK-6038 Project: Flink

Re: Flink as a Service (FaaS)

2017-03-14 Thread shijinkui
Hi, Chen Qin We also met your end-to-end use case. A RPC Source and Sink such as netty source sink can fit such requirements. I’ve submit a natty module in bahir-flink project which only a demo. If use connector source instead of Kafka, how do we make the data persistent? One choice is

[jira] [Created] (FLINK-6037) the estimateRowCount method of DataSetCalc didn't work in SQL

2017-03-14 Thread jingzhang (JIRA)
jingzhang created FLINK-6037: Summary: the estimateRowCount method of DataSetCalc didn't work in SQL Key: FLINK-6037 URL: https://issues.apache.org/jira/browse/FLINK-6037 Project: Flink Issue

[jira] [Created] (FLINK-6036) Let catalog support partition

2017-03-14 Thread jingzhang (JIRA)
jingzhang created FLINK-6036: Summary: Let catalog support partition Key: FLINK-6036 URL: https://issues.apache.org/jira/browse/FLINK-6036 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-6035) The method name(String) is undefined for the type UnsortedGrouping

2017-03-14 Thread Luke Hutchison (JIRA)
Luke Hutchison created FLINK-6035: - Summary: The method name(String) is undefined for the type UnsortedGrouping Key: FLINK-6035 URL: https://issues.apache.org/jira/browse/FLINK-6035 Project: Flink

Flink as a Service (FaaS)

2017-03-14 Thread Chen Qin
Hi there, I am very happy about Flink 1.2 release. It was much more robust and feature rich compare to previous versions. In the following section, I would like to discuss a non typical use case in flink community. With ever increasing popularity of micro services[1] to scale out popular online