[jira] [Created] (FLINK-8569) Provide a hook to override the default KeyGroupRangeAssignment

2018-02-06 Thread Nagarjun Guraja (JIRA)
Nagarjun Guraja created FLINK-8569: -- Summary: Provide a hook to override the default KeyGroupRangeAssignment Key: FLINK-8569 URL: https://issues.apache.org/jira/browse/FLINK-8569 Project: Flink

[jira] [Created] (FLINK-8570) Provide a hook in Flink KafkaConsumer(source function) implementation to override assignment of kafka partitions to individual task nodes

2018-02-06 Thread Nagarjun Guraja (JIRA)
Nagarjun Guraja created FLINK-8570: -- Summary: Provide a hook in Flink KafkaConsumer(source function) implementation to override assignment of kafka partitions to individual task nodes Key: FLINK-8570 URL:

[jira] [Created] (FLINK-8571) Provide an enhanced KeyedStream implementation to use ForwardPartitioner

2018-02-06 Thread Nagarjun Guraja (JIRA)
Nagarjun Guraja created FLINK-8571: -- Summary: Provide an enhanced KeyedStream implementation to use ForwardPartitioner Key: FLINK-8571 URL: https://issues.apache.org/jira/browse/FLINK-8571 Project:

[jira] [Created] (FLINK-8564) SELECT DISTINCT without aggregations should not require a retract stream

2018-02-06 Thread Timo Walther (JIRA)
Timo Walther created FLINK-8564: --- Summary: SELECT DISTINCT without aggregations should not require a retract stream Key: FLINK-8564 URL: https://issues.apache.org/jira/browse/FLINK-8564 Project: Flink

Terminating streaming test

2018-02-06 Thread Thomas Weise
Hi, I'm looking for an example of an integration test that runs a streaming job and terminates when the expected result becomes available. I could think of 2 approaches: 1. Modified version of LocalStreamEnvironment that executes the job asynchronously and polls for the result or 2. Source that

Re: Timestamp/watermark support in Kinesis consumer

2018-02-06 Thread Thomas Weise
In addition to lack of watermark support, the Kinesis consumer suffers from a discovery related issue that also needs to be resolved. Shard discovery runs periodically in all subtasks. That's not just inefficient but becomes a real problem when there is a large number of subtasks due to rate

[jira] [Created] (FLINK-8567) Maven-shade-plugin can't relocate Scala classes.

2018-02-06 Thread John Fang (JIRA)
John Fang created FLINK-8567: Summary: Maven-shade-plugin can't relocate Scala classes. Key: FLINK-8567 URL: https://issues.apache.org/jira/browse/FLINK-8567 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8568) flink table's guava classes can't beed relocated by maven-shed-plugin.

2018-02-06 Thread John Fang (JIRA)
John Fang created FLINK-8568: Summary: flink table's guava classes can't beed relocated by maven-shed-plugin. Key: FLINK-8568 URL: https://issues.apache.org/jira/browse/FLINK-8568 Project: Flink

Re: Terminating streaming test

2018-02-06 Thread Ken Krugler
Hi Thomas, Normally the streaming job will terminate when the sources are exhausted and all records have been processed. I assume you have some unbounded source(s), thus this doesn’t work for your case. We’d run into a similar situation with a streaming job that has iterations. Our solution

Re: Terminating streaming test

2018-02-06 Thread Thomas Weise
Hi Ken, Thanks! I would expect more folks to run into this and hence surprised to not find this in LocalStreamEnvironment. Is there a reason for that? In the specific case, we have an unbounded source (Kinesis), but for testing we would like to make it bounded. Hence the earlier question whether

[jira] [Created] (FLINK-8572) Flink1.4版本的document 左边的菜单点击无法跳转，左边的下拉菜单都无法下拉

2018-02-06 Thread PengYang (JIRA)
PengYang created FLINK-8572: --- Summary: Flink1.4版本的document 左边的菜单点击无法跳转，左边的下拉菜单都无法下拉 Key: FLINK-8572 URL: https://issues.apache.org/jira/browse/FLINK-8572 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8573) Print JobID for failed jobs

2018-02-06 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8573: --- Summary: Print JobID for failed jobs Key: FLINK-8573 URL: https://issues.apache.org/jira/browse/FLINK-8573 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-8565) CheckpointOptionsTest unstable

2018-02-06 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8565: --- Summary: CheckpointOptionsTest unstable Key: FLINK-8565 URL: https://issues.apache.org/jira/browse/FLINK-8565 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8566) Replace retract/insert of same record for state retention timer resets

2018-02-06 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-8566: Summary: Replace retract/insert of same record for state retention timer resets Key: FLINK-8566 URL: https://issues.apache.org/jira/browse/FLINK-8566 Project: Flink