[jira] [Created] (FLINK-6094) Implement and turn on retraction for stream-stream inner join

2017-03-16 Thread Shaoxuan Wang (JIRA)
Shaoxuan Wang created FLINK-6094: Summary: Implement and turn on retraction for stream-stream inner join Key: FLINK-6094 URL: https://issues.apache.org/jira/browse/FLINK-6094 Project: Flink

[jira] [Created] (FLINK-6093) Implement and turn on retraction for table sink

2017-03-16 Thread Shaoxuan Wang (JIRA)
Shaoxuan Wang created FLINK-6093: Summary: Implement and turn on retraction for table sink Key: FLINK-6093 URL: https://issues.apache.org/jira/browse/FLINK-6093 Project: Flink Issue Type:

[jira] [Created] (FLINK-6092) Implement and turn on retraction for table source

2017-03-16 Thread Shaoxuan Wang (JIRA)
Shaoxuan Wang created FLINK-6092: Summary: Implement and turn on retraction for table source Key: FLINK-6092 URL: https://issues.apache.org/jira/browse/FLINK-6092 Project: Flink Issue Type:

[jira] [Created] (FLINK-6091) Implement and turn on the retraction for grouping window aggregate

2017-03-16 Thread Shaoxuan Wang (JIRA)
Shaoxuan Wang created FLINK-6091: Summary: Implement and turn on the retraction for grouping window aggregate Key: FLINK-6091 URL: https://issues.apache.org/jira/browse/FLINK-6091 Project: Flink

[jira] [Created] (FLINK-6090) Implement optimizer for retraction and turn on retraction for over window aggregate

2017-03-16 Thread Shaoxuan Wang (JIRA)
Shaoxuan Wang created FLINK-6090: Summary: Implement optimizer for retraction and turn on retraction for over window aggregate Key: FLINK-6090 URL: https://issues.apache.org/jira/browse/FLINK-6090

[jira] [Created] (FLINK-6089) Implement decoration phase for rewriting predicated logical plan after volcano optimization phase

2017-03-16 Thread Shaoxuan Wang (JIRA)
Shaoxuan Wang created FLINK-6089: Summary: Implement decoration phase for rewriting predicated logical plan after volcano optimization phase Key: FLINK-6089 URL: https://issues.apache.org/jira/browse/FLINK-6089

[jira] [Created] (FLINK-6088) java.lang.NoSuchFieldError: INSTANCE Issue with classloading

2017-03-16 Thread prabhat kumar (JIRA)
prabhat kumar created FLINK-6088: Summary: java.lang.NoSuchFieldError: INSTANCE Issue with classloading Key: FLINK-6088 URL: https://issues.apache.org/jira/browse/FLINK-6088 Project: Flink

[jira] [Created] (FLINK-6087) The file-filter is only applied to directories in ContinuousFileMonitoringFunction

2017-03-16 Thread Yassine Marzougui (JIRA)
Yassine Marzougui created FLINK-6087: Summary: The file-filter is only applied to directories in ContinuousFileMonitoringFunction Key: FLINK-6087 URL: https://issues.apache.org/jira/browse/FLINK-6087

Re: [DISCUSS] FLIP-17 Side Inputs

2017-03-16 Thread Gábor Hermann
Regarding the CoFlatMap workaround, - For keyed streams, do you suggest that having a per-key buffer stored as keyed state would have a large memory overhead? That must be true, although a workaround could be partitioning the data and using a non-keyed stream. Of course that seems hacky, as we

Re: Machine Learning on Flink - Next steps

2017-03-16 Thread Gábor Hermann
@Theodore: thanks for bringing the discussion together. I think it's reasonable to go on all the three directions, just as you suggested. I agree we should concentrate our efforts, but we can do a low-effort evaluation of all the three. I would like to volunteer for shepherding *Offline

[jira] [Created] (FLINK-6086) Rework PythonSender/-Streamer generics

2017-03-16 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-6086: --- Summary: Rework PythonSender/-Streamer generics Key: FLINK-6086 URL: https://issues.apache.org/jira/browse/FLINK-6086 Project: Flink Issue Type:

Re: Bumping API stability check version

2017-03-16 Thread Greg Hogan
Robert, I was going to file a ticket but posted to the mailing list and was hoping for your input. That may be the wrong configuration option but what I was thinking is that: - 1.3.0 should have a compatible API relative to 1.2.0 (no modifications, only additions) - 1.2.1+ should have the same

[jira] [Created] (FLINK-6085) flink as micro service

2017-03-16 Thread Chen Qin (JIRA)
Chen Qin created FLINK-6085: --- Summary: flink as micro service Key: FLINK-6085 URL: https://issues.apache.org/jira/browse/FLINK-6085 Project: Flink Issue Type: Improvement Components:

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-16 Thread Robert Metzger
The cassandra connector is probably not usable in Flink 1.2.0. I would like to include a fix in 1.2.1: https://issues.apache.org/jira/browse/FLINK-6084 Please let me know if this fix becomes a blocker for the 1.2.1 release. If so, I can validate the fix myself to speed up things. On Thu, Mar 16,

[jira] [Created] (FLINK-6084) Cassandra connector does not declare all dependencies

2017-03-16 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6084: - Summary: Cassandra connector does not declare all dependencies Key: FLINK-6084 URL: https://issues.apache.org/jira/browse/FLINK-6084 Project: Flink Issue

Re: Bumping API stability check version

2017-03-16 Thread Robert Metzger
Hi Greg, I was not able to update the version to 1.2.0 when updating to 1.3-SNAPSHOT, because 1.2.0 was not released at that point in time :) But I agree that we should update that version once the release is out. I forgot to do it. I'm not sure if I completely understand

Re: [DISCUSS] Could we Improve tests time and stability?

2017-03-16 Thread Robert Metzger
Hi Dmytro, I'm happy to hear that you are trying to help us improving the test time situation :) We have another discussion here on the dev@ list to split the project into two git repositories to resolve the problem. I agree that your proposed changes could improve the build times, but I'm not

[jira] [Created] (FLINK-6083) [TaskManager] Support readiness/liveness probes

2017-03-16 Thread Andrey (JIRA)
Andrey created FLINK-6083: - Summary: [TaskManager] Support readiness/liveness probes Key: FLINK-6083 URL: https://issues.apache.org/jira/browse/FLINK-6083 Project: Flink Issue Type: New Feature

[DISCUSS] Could we Improve tests time and stability?

2017-03-16 Thread Dmytro Shkvyra
Hi everyone, May be we should remove -XX:-UseGCOverheadLimit option from maven-surefire-plugin args and increase -Xmx to 1536m for forks? We have about 4 GB RAM and 2 cores at test VMs. I think we can make test faster than now. When I tried testing flink-runtime some tests work too slow due to

Extended SQL support for Streaming

2017-03-16 Thread Radu Tudoran
Hi, I have created several JIRA issues with proposal implementation to support more SQL functions for streaming. As there is an ongoing discussion about supporting retraction for the Stream SQL, these features focus on the processing time. Extending them for event time would be done (in most

[jira] [Created] (FLINK-6082) Support window definition for SQL Queries based on WHERE clause with time condition

2017-03-16 Thread radu (JIRA)
radu created FLINK-6082: --- Summary: Support window definition for SQL Queries based on WHERE clause with time condition Key: FLINK-6082 URL: https://issues.apache.org/jira/browse/FLINK-6082 Project: Flink

Bumping API stability check version

2017-03-16 Thread Greg Hogan
Hi, I see in the parent pom.xml that 1.3-SNAPSHOT is checking for API stability against 1.1.4. Also, that this version was only bumped with FLINK-5617 late in the 1.2 development cycle. Should we bump this version as part of the release process, i.e. on the 1.2.0 release updating 1.3-SNAPSHOT

[jira] [Created] (FLINK-6081) Offset/Fetch support for SQL Streaming

2017-03-16 Thread radu (JIRA)
radu created FLINK-6081: --- Summary: Offset/Fetch support for SQL Streaming Key: FLINK-6081 URL: https://issues.apache.org/jira/browse/FLINK-6081 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-6080) Unclosed ObjectOutputStream in NFA#serialize()

2017-03-16 Thread Ted Yu (JIRA)
Ted Yu created FLINK-6080: - Summary: Unclosed ObjectOutputStream in NFA#serialize() Key: FLINK-6080 URL: https://issues.apache.org/jira/browse/FLINK-6080 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6079) Ineffective null check in FlinkKafkaConsumerBase#open()

2017-03-16 Thread Ted Yu (JIRA)
Ted Yu created FLINK-6079: - Summary: Ineffective null check in FlinkKafkaConsumerBase#open() Key: FLINK-6079 URL: https://issues.apache.org/jira/browse/FLINK-6079 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6078) ZooKeeper based high availability services should not close the underlying CuratorFramework

2017-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6078: Summary: ZooKeeper based high availability services should not close the underlying CuratorFramework Key: FLINK-6078 URL: https://issues.apache.org/jira/browse/FLINK-6078

Future of Queryable State Feature

2017-03-16 Thread Joe Olson
I have a question regarding the future direction of the queryable state feature. We are current using this feature in production implemented in a RichFlatMap. It is doing what we need it to do at the scale we need it done in, with the resources we have assigned to it. Win. However, we'd also

[jira] [Created] (FLINK-6077) Support In/Exists/Except/Any /Some/All for Stream SQL

2017-03-16 Thread radu (JIRA)
radu created FLINK-6077: --- Summary: Support In/Exists/Except/Any /Some/All for Stream SQL Key: FLINK-6077 URL: https://issues.apache.org/jira/browse/FLINK-6077 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6076) Let the HeartbeatManager interface extend HeartbeatTarget

2017-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-6076: Summary: Let the HeartbeatManager interface extend HeartbeatTarget Key: FLINK-6076 URL: https://issues.apache.org/jira/browse/FLINK-6076 Project: Flink

[jira] [Created] (FLINK-6075) Support Limit/Top(Sort) for Stream SQL

2017-03-16 Thread radu (JIRA)
radu created FLINK-6075: --- Summary: Support Limit/Top(Sort) for Stream SQL Key: FLINK-6075 URL: https://issues.apache.org/jira/browse/FLINK-6075 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-6074) Fix

2017-03-16 Thread sunjincheng (JIRA)
sunjincheng created FLINK-6074: -- Summary: Fix Key: FLINK-6074 URL: https://issues.apache.org/jira/browse/FLINK-6074 Project: Flink Issue Type: Bug Reporter: sunjincheng --

[jira] [Created] (FLINK-6073) Support for SQL inner queries for proctime

2017-03-16 Thread radu (JIRA)
radu created FLINK-6073: --- Summary: Support for SQL inner queries for proctime Key: FLINK-6073 URL: https://issues.apache.org/jira/browse/FLINK-6073 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-6072) TestCase CheckpointStateRestoreTest::testSetState should be fail

2017-03-16 Thread Guowei Ma (JIRA)
Guowei Ma created FLINK-6072: Summary: TestCase CheckpointStateRestoreTest::testSetState should be fail Key: FLINK-6072 URL: https://issues.apache.org/jira/browse/FLINK-6072 Project: Flink

[jira] [Created] (FLINK-6071) Savepoints should not count in the number of retained checkpoints

2017-03-16 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-6071: --- Summary: Savepoints should not count in the number of retained checkpoints Key: FLINK-6071 URL: https://issues.apache.org/jira/browse/FLINK-6071 Project: Flink

[jira] [Created] (FLINK-6070) Suggestion: add ComparableTuple types

2017-03-16 Thread Luke Hutchison (JIRA)
Luke Hutchison created FLINK-6070: - Summary: Suggestion: add ComparableTuple types Key: FLINK-6070 URL: https://issues.apache.org/jira/browse/FLINK-6070 Project: Flink Issue Type:

Re: [POLL] Who still uses Java 7 with Flink ?

2017-03-16 Thread Bowen Li
There's always a tradeoff we need to make. I'm in favor of upgrading to Java 8 to bring in all new Java features. The common way I've seen (and I agree) other software upgrading major things like this is 1) upgrade for next big release without backward compatibility and notify everyone 2)

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-16 Thread Jinkui Shi
@Tzu-li(Fordon)Tai FLINK-5650 is fix by [1]. Chesnay Scheduler push a PR please. [1] https://github.com/zentol/flink/tree/5650_python_test_debug > 在 2017年3月16日,上午3:37,Stephan Ewen 写道: > > Thanks for the update!

Re: [Discuss] Retraction for Flink Streaming

2017-03-16 Thread Shaoxuan Wang
The doc gets lots of attention. I appreciate everyone for the valuable comments. Hi Fabian, Thanks for your comments. I agree with you that we should ensure that all operators are running in the same mode (either turning on retraction globally or not). From my point of view, I did not see any

[jira] [Created] (FLINK-6069) Add documentation CEP - Watermarks

2017-03-16 Thread Patrick Pircher (JIRA)
Patrick Pircher created FLINK-6069: -- Summary: Add documentation CEP - Watermarks Key: FLINK-6069 URL: https://issues.apache.org/jira/browse/FLINK-6069 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6068) Support If() in built in function of TableAPI

2017-03-16 Thread Zhuoluo Yang (JIRA)
Zhuoluo Yang created FLINK-6068: --- Summary: Support If() in built in function of TableAPI Key: FLINK-6068 URL: https://issues.apache.org/jira/browse/FLINK-6068 Project: Flink Issue Type:

[jira] [Created] (FLINK-6067) ProjectNode and FilterNode cannot merge in Batch TableAPI

2017-03-16 Thread jingzhang (JIRA)
jingzhang created FLINK-6067: Summary: ProjectNode and FilterNode cannot merge in Batch TableAPI Key: FLINK-6067 URL: https://issues.apache.org/jira/browse/FLINK-6067 Project: Flink Issue Type:

[jira] [Created] (FLINK-6066) Separate logical and physical RelNode layer in Flink

2017-03-16 Thread Kurt Young (JIRA)
Kurt Young created FLINK-6066: - Summary: Separate logical and physical RelNode layer in Flink Key: FLINK-6066 URL: https://issues.apache.org/jira/browse/FLINK-6066 Project: Flink Issue Type: