[jira] [Created] (FLINK-12131) Resetting ExecutionVertex in region failover may cause inconsistency of IntermediateResult status

2019-04-08 Thread Zhu Zhu (JIRA)
Zhu Zhu created FLINK-12131: --- Summary: Resetting ExecutionVertex in region failover may cause inconsistency of IntermediateResult status Key: FLINK-12131 URL: https://issues.apache.org/jira/browse/FLINK-12131

[jira] [Created] (FLINK-12130) Apply command line options to configuration before install security modules

2019-04-08 Thread Victor Wong (JIRA)
Victor Wong created FLINK-12130: --- Summary: Apply command line options to configuration before install security modules Key: FLINK-12130 URL: https://issues.apache.org/jira/browse/FLINK-12130 Project:

[jira] [Created] (FLINK-12129) CompressedViews need release heap buffers to reduce memory usage in blink

2019-04-08 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12129: Summary: CompressedViews need release heap buffers to reduce memory usage in blink Key: FLINK-12129 URL: https://issues.apache.org/jira/browse/FLINK-12129 Project:

[jira] [Created] (FLINK-12128) There is a typo on the website

2019-04-08 Thread Kenneth Yang (JIRA)
Kenneth Yang created FLINK-12128: Summary: There is a typo on the website Key: FLINK-12128 URL: https://issues.apache.org/jira/browse/FLINK-12128 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12127) Move network related options to NetworkEnvironmentOptions

2019-04-08 Thread zhijiang (JIRA)
zhijiang created FLINK-12127: Summary: Move network related options to NetworkEnvironmentOptions Key: FLINK-12127 URL: https://issues.apache.org/jira/browse/FLINK-12127 Project: Flink Issue

Re: [Discuss] Semantics of event time for state TTL

2019-04-08 Thread Aljoscha Krettek
I had a discussion with Andrey and now think that also the case event-time-timestamp/watermark-cleanup is a valid case. If you don’t need this for regulatory compliance but just for cleaning up old state, in case where you have re-processing of old data. I think the discussion about whether to

[jira] [Created] (FLINK-12126) Make relaxed rescaling behaviour accessible in REST interface

2019-04-08 Thread Joshua Schneider (JIRA)
Joshua Schneider created FLINK-12126: Summary: Make relaxed rescaling behaviour accessible in REST interface Key: FLINK-12126 URL: https://issues.apache.org/jira/browse/FLINK-12126 Project: Flink

[jira] [Created] (FLINK-12125) Add OVH to poweredby.zh.md and index.zh.md

2019-04-08 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-12125: - Summary: Add OVH to poweredby.zh.md and index.zh.md Key: FLINK-12125 URL: https://issues.apache.org/jira/browse/FLINK-12125 Project: Flink Issue Type:

[jira] [Created] (FLINK-12124) Security is not support dynamicProperties

2019-04-08 Thread zhouqi (JIRA)
zhouqi created FLINK-12124: -- Summary: Security is not support dynamicProperties Key: FLINK-12124 URL: https://issues.apache.org/jira/browse/FLINK-12124 Project: Flink Issue Type: Bug

Re: [Discuss] Semantics of event time for state TTL

2019-04-08 Thread Kostas Kloudas
Hi all, For GDPR: I am not sure about the regulatory requirements of GDPR but I would assume that the time for deletion starts counting from the time an organisation received the data (i.e. the wall-clock ingestion time of the data), and not the "event time" of the data. In other case, an

[jira] [Created] (FLINK-12123) Upgrade Jepsen to 0.1.13 in flink-jepsen

2019-04-08 Thread Gary Yao (JIRA)
Gary Yao created FLINK-12123: Summary: Upgrade Jepsen to 0.1.13 in flink-jepsen Key: FLINK-12123 URL: https://issues.apache.org/jira/browse/FLINK-12123 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-04-08 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-12122: - Summary: Spread out tasks evenly across all available registered TaskManagers Key: FLINK-12122 URL: https://issues.apache.org/jira/browse/FLINK-12122 Project:

Re: [Discuss] Semantics of event time for state TTL

2019-04-08 Thread Aljoscha Krettek
Oh boy, this is an interesting pickle. For *last-access-timestamp*, I think only *event-time-of-current-record* makes sense. I’m looking at this from a GDPR/regulatory compliance perspective. If you update a state, by say storing the event you just received in state, you want to use the exact

[jira] [Created] (FLINK-12121) Use composition instead of inheritance for the InternalKeyContext logic in backend

2019-04-08 Thread Yu Li (JIRA)
Yu Li created FLINK-12121: - Summary: Use composition instead of inheritance for the InternalKeyContext logic in backend Key: FLINK-12121 URL: https://issues.apache.org/jira/browse/FLINK-12121 Project: Flink

[DISCUSS] Adaptive Parallelism of Job Vertex

2019-04-08 Thread Bo WANG
Hi all, In distribution computing system, execution parallelism is vital for both resource efficiency and execution performance. In Flink, execution parallelism is a pre-specified parameter, which is usually an empirical value and thus might not be optimal on the various amount of data processed

Re: SQL CLI and JDBC

2019-04-08 Thread Fabian Hueske
Hi Hanan, I'm not aware of any plans to add a JDBC Driver. One issue with the JDBC interface is that it only works well for queries on batch data and a subset of queries on streaming data. Many streaming SQL queries are not able to emit final results (or need to update previously emitted

Re: [VOTE] Release 1.8.0, release candidate #5

2019-04-08 Thread Aljoscha Krettek
@Thomas There is a note about this in the documentation release notes: https://github.com/apache/flink/blob/5d46437fee92a6e1ec8c0653849a6b27733e99ad/docs/release-notes/flink-1.8.md#change-in-the-maven-modules-of-table-api-flink-11064

Re: [VOTE] Release 1.8.0, release candidate #5

2019-04-08 Thread Tzu-Li (Gordon) Tai
+1 (binding) Carried over from previous vote on earlier RC, with the following additional tests: - Verified a few upgrade scenarios for the key / namespace serializer in RocksDB state backend - Verified checksums and signatures - Built source (without Hadoop, Scala 2.11 + Scala 2.12) with

[jira] [Created] (FLINK-12120) Introduce "select sum(b), count(c) from T group by a" in Blink batch

2019-04-08 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12120: Summary: Introduce "select sum(b), count(c) from T group by a" in Blink batch Key: FLINK-12120 URL: https://issues.apache.org/jira/browse/FLINK-12120 Project: Flink