[jira] [Created] (FLINK-5804) Add [non-partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL

2017-02-14 Thread sunjincheng (JIRA)
sunjincheng created FLINK-5804: -- Summary: Add [non-partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Key: FLINK-5804 URL: https://issues.apache.org/jira/browse/FLINK-5804

[jira] [Created] (FLINK-5803) Add [partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL

2017-02-14 Thread sunjincheng (JIRA)
sunjincheng created FLINK-5803: -- Summary: Add [partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Key: FLINK-5803 URL: https://issues.apache.org/jira/browse/FLINK-5803

[jira] [Created] (FLINK-5802) Flink SQL calling Hive User-Defined Functions

2017-02-14 Thread Zhuoluo Yang (JIRA)
Zhuoluo Yang created FLINK-5802: --- Summary: Flink SQL calling Hive User-Defined Functions Key: FLINK-5802 URL: https://issues.apache.org/jira/browse/FLINK-5802 Project: Flink Issue Type: New

Handling skewness and Heterogeniety

2017-02-14 Thread Anis Nasir
Dear All, I have few use cases for Flink streaming where the cluster consist of heterogenous machines. Additionally, there is skew present in both the input distribution (e.g., each tuple is drawn from a zipf distribution) and the service time (e.g., service time required for each tuple comes

[jira] [Created] (FLINK-5801) Queryable State from Scala job/client fails with key of type Long

2017-02-14 Thread Patrick Lucas (JIRA)
Patrick Lucas created FLINK-5801: Summary: Queryable State from Scala job/client fails with key of type Long Key: FLINK-5801 URL: https://issues.apache.org/jira/browse/FLINK-5801 Project: Flink

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-14 Thread Haohui Mai
Hi, Thanks for starting the discussion. I can see there are multiple trade-offs in these two approaches. One question I have is that to which extent Flink wants to open its APIs to allow users to access both processing and event time. Before we talk about joins, my understanding for the two

[jira] [Created] (FLINK-5800) Make sure that the CheckpointStreamFactory is instantiated once per operator only

2017-02-14 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-5800: --- Summary: Make sure that the CheckpointStreamFactory is instantiated once per operator only Key: FLINK-5800 URL: https://issues.apache.org/jira/browse/FLINK-5800

[jira] [Created] (FLINK-5799) Let RpcService.scheduleRunnable return ScheduledFuture

2017-02-14 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-5799: Summary: Let RpcService.scheduleRunnable return ScheduledFuture Key: FLINK-5799 URL: https://issues.apache.org/jira/browse/FLINK-5799 Project: Flink Issue

[jira] [Created] (FLINK-5798) Let the RPCService provide a ScheduledExecutorService

2017-02-14 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-5798: Summary: Let the RPCService provide a ScheduledExecutorService Key: FLINK-5798 URL: https://issues.apache.org/jira/browse/FLINK-5798 Project: Flink Issue

Re: FLINK-5734 : Code Generation for NormalizedKeySorter

2017-02-14 Thread Greg Hogan
Pat, Thanks for adding the new test results. This idea for this implementation was Gábor's from the FLINK-3722 description. Since you will be filing a FLIP I recommend including these benchmarks for consideration and discussion on the mailing list. In part because the PR is 4 months old and need

[jira] [Created] (FLINK-5797) incorrect use of port range selector in BootstrapTool

2017-02-14 Thread Yelei Feng (JIRA)
Yelei Feng created FLINK-5797: - Summary: incorrect use of port range selector in BootstrapTool Key: FLINK-5797 URL: https://issues.apache.org/jira/browse/FLINK-5797 Project: Flink Issue Type:

Re: Using QueryableState inside Flink jobs (and Parameter Server implementation)

2017-02-14 Thread Theodore Vasiloudis
Hello all, I would also be really interested in how a PS-like architecture would work in Flink. Note that we not necessarily talking about PS, but generally how QueryableState can be used for ML tasks with I guess a focus on model-parallel training. One suggestion I would make is to take a look

Re: Using QueryableState inside Flink jobs (and Parameter Server implementation)

2017-02-14 Thread Gábor Hermann
Hey Ufuk, I'm happy to contribute. At least I'll get a bit more understanding of the details. Breaking the assumption that only a single thread updates state would brings us from strong isolation guarantees (i.e. serializability at the updates and read committed at the external queries) to

Re: Using QueryableState inside Flink jobs (and Parameter Server implementation)

2017-02-14 Thread Ufuk Celebi
Hey Gabor, great ideas here. It's only slightly related, but I'm currently working on a proposal to improve the queryable state APIs for lookups (partly along the lines of what you suggested with higher level accessors). Maybe you are interested in contributing there? I really like your ideas

[jira] [Created] (FLINK-5795) Improve “UDTF" to support with parameter constructor

2017-02-14 Thread sunjincheng (JIRA)
sunjincheng created FLINK-5795: -- Summary: Improve “UDTF" to support with parameter constructor Key: FLINK-5795 URL: https://issues.apache.org/jira/browse/FLINK-5795 Project: Flink Issue Type:

Re: Using QueryableState inside Flink jobs (and Parameter Server implementation)

2017-02-14 Thread Gábor Hermann
Hi Gyula, Jinkui Shi, Thanks for your thoughts! @Gyula: I'll try and explain a bit more detail. The API could be almost like the QueryableState's. It could be higher-level though: returning Java objects instead of serialized data (because there would not be issues with class loading). Also,

Re: Support for daylight saving timezone changes in Flink

2017-02-14 Thread Till Rohrmann
Hi Swapnil, Flink does not have explicit support for this. It's the responsibility of the user to make sure that the right watermarks are extracted from the incoming events. This also means the correct handling of different time zones. Cheers, Till On Tue, Feb 14, 2017 at 8:41 AM, Swapnil

Re: FLINK-5734 : Code Generation for NormalizedKeySorter

2017-02-14 Thread Gábor Gévay
Hello, Pat, the table in your email is somehow not visible in my gmail, but it is visible here: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/FLINK-5734-Code-Generation-for-NormalizedKeySorter-tt15804.html#a15936 Maybe the problem is caused by the formatting. > FLINK-3722 >