[jira] [Created] (FLINK-7024) Add supported for selecting window proctime/rowtime on row-based Tumble/Slide window

2017-06-27 Thread sunjincheng (JIRA)
sunjincheng created FLINK-7024: -- Summary: Add supported for selecting window proctime/rowtime on row-based Tumble/Slide window Key: FLINK-7024 URL: https://issues.apache.org/jira/browse/FLINK-7024

[jira] [Created] (FLINK-7023) Remaining types for Gelly ValueArrays

2017-06-27 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-7023: - Summary: Remaining types for Gelly ValueArrays Key: FLINK-7023 URL: https://issues.apache.org/jira/browse/FLINK-7023 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7022) Flink Job Manager Scheduler & Web Frontend out of sync when Zookeeper is unavailable on startup

2017-06-27 Thread Scott Kidder (JIRA)
Scott Kidder created FLINK-7022: --- Summary: Flink Job Manager Scheduler & Web Frontend out of sync when Zookeeper is unavailable on startup Key: FLINK-7022 URL: https://issues.apache.org/jira/browse/FLINK-7022

[jira] [Created] (FLINK-7021) Flink Task Manager hangs on startup if one Zookeeper node is unresolvable

2017-06-27 Thread Scott Kidder (JIRA)
Scott Kidder created FLINK-7021: --- Summary: Flink Task Manager hangs on startup if one Zookeeper node is unresolvable Key: FLINK-7021 URL: https://issues.apache.org/jira/browse/FLINK-7021 Project: Flink

Re: [DISCUSS] FLIP-21 - Improve object Copying/Reuse Mode for Streaming Runtime

2017-06-27 Thread Zhenzhong Xu
Stephan, Fully supporting this FLIP. We originally encountered pretty big surprises observing the object copy behavior causing significant performance degradation for our massively parallel use case. In our case, (I think most appropriately SHOULD be the assumptions for all streaming use

Re: [DISCUSS] FLIP-21 - Improve object Copying/Reuse Mode for Streaming Runtime

2017-06-27 Thread Greg Hogan
Hi Stephan, Would this be an appropriate time to discuss allowing reuse to be a per-operator configuration? Object reuse for chained operators has lead to considerable surprise for some users of the DataSet API. This came up during the rework of the object reuse documentation for the DataSet

[DISCUSS] FLIP-21 - Improve object Copying/Reuse Mode for Streaming Runtime

2017-06-27 Thread Stephan Ewen
Hi all! I would like to propose the following FLIP: FLIP-21 - Improve object Copying/Reuse Mode for Streaming Runtime: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=71012982 The FLIP is motivated by the fact that many users run into an unnecessary kind of performance problem

[GitHub] flink-shaded pull request #3: [FLINK-7007] Add README.md

2017-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink-shaded/pull/3#discussion_r124335176 --- Diff: README.md --- @@ -0,0 +1,28 @@ + + +# Apache Flink Shaded Dependencies + +This repository contains a number of shaded

[GitHub] flink-shaded issue #4: Add flink-shaded-netty module

2017-06-27 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink-shaded/pull/4 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[jira] [Created] (FLINK-7020) Upgrade calcite to calcite 1.13

2017-06-27 Thread sunjincheng (JIRA)
sunjincheng created FLINK-7020: -- Summary: Upgrade calcite to calcite 1.13 Key: FLINK-7020 URL: https://issues.apache.org/jira/browse/FLINK-7020 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Backwards compatibility policy.

2017-06-27 Thread Stephan Ewen
I think that this discussion is probably motivated especially by the "legacy state" handling of Flink 1.1. The biggest gain in codebase and productivity would be won only by dropping 1.1 compatibility in Flink 1.4. My gut feeling is that this is reasonable. We support two versions back, which

[jira] [Created] (FLINK-7019) Rework parallelism in Gelly algorithms and examples

2017-06-27 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-7019: - Summary: Rework parallelism in Gelly algorithms and examples Key: FLINK-7019 URL: https://issues.apache.org/jira/browse/FLINK-7019 Project: Flink Issue Type:

[GitHub] flink-shaded pull request #4: Add flink-shaded-netty module

2017-06-27 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink-shaded/pull/4 Add flink-shaded-netty module You can merge this pull request into a Git repository by running: $ git pull https://github.com/zentol/flink-shaded 7013 Alternatively you can review and

[jira] [Created] (FLINK-7018) Reconstruct streamgraph to clear interface

2017-06-27 Thread Xu Pingyong (JIRA)
Xu Pingyong created FLINK-7018: -- Summary: Reconstruct streamgraph to clear interface Key: FLINK-7018 URL: https://issues.apache.org/jira/browse/FLINK-7018 Project: Flink Issue Type:

[jira] [Created] (FLINK-7016) Move inputFormat to InputFormatVertex from TaskConfig

2017-06-27 Thread Xu Pingyong (JIRA)
Xu Pingyong created FLINK-7016: -- Summary: Move inputFormat to InputFormatVertex from TaskConfig Key: FLINK-7016 URL: https://issues.apache.org/jira/browse/FLINK-7016 Project: Flink Issue Type:

[jira] [Created] (FLINK-7015) Separate OperatorConfig from StreamConfig

2017-06-27 Thread Xu Pingyong (JIRA)
Xu Pingyong created FLINK-7015: -- Summary: Separate OperatorConfig from StreamConfig Key: FLINK-7015 URL: https://issues.apache.org/jira/browse/FLINK-7015 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7014) Expose isDeterministic interface to ScalarFunction and TableFunction

2017-06-27 Thread Ruidong Li (JIRA)
Ruidong Li created FLINK-7014: - Summary: Expose isDeterministic interface to ScalarFunction and TableFunction Key: FLINK-7014 URL: https://issues.apache.org/jira/browse/FLINK-7014 Project: Flink

[jira] [Created] (FLINK-7013) Add shaded netty dependency

2017-06-27 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7013: --- Summary: Add shaded netty dependency Key: FLINK-7013 URL: https://issues.apache.org/jira/browse/FLINK-7013 Project: Flink Issue Type: Sub-task

[GitHub] flink-shaded pull request #3: [FLINK-7007] Add README.md

2017-06-27 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink-shaded/pull/3 [FLINK-7007] Add README.md You can merge this pull request into a Git repository by running: $ git pull https://github.com/zentol/flink-shaded 7007 Alternatively you can review and apply

[jira] [Created] (FLINK-7012) remove user-JAR upload when disposing a savepoint the old way

2017-06-27 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7012: -- Summary: remove user-JAR upload when disposing a savepoint the old way Key: FLINK-7012 URL: https://issues.apache.org/jira/browse/FLINK-7012 Project: Flink

Re: [DISCUSS] Backwards compatibility policy.

2017-06-27 Thread Stefan Richter
For many parts of the code, I would agree with Aljoscha. However, I can also see notable exceptions, such as maintaining support for the legacy state from Flink <=1.1. For example, I think dropping support for this can simplify new developments such as fast local recovery or state replication

[jira] [Created] (FLINK-7011) Instable Kafka testStartFromKafkaCommitOffsets failures on Travis

2017-06-27 Thread Tzu-Li (Gordon) Tai (JIRA)
=20170627T065647Z=AWS4-HMAC-SHA256=AKIAJRYRXRSVGNKPKO5A/20170627/us-east-1/s3/aws4_request=host=dbfc90cfc386fef0990325b54ff74ee4d441944687e7fdaa73ce7b0c2b2ec0ea In general, the test {{testStartFromKafkaCommitOffsets}} implementation is a bit of an overkill. Before continuing with the test, it writes