Re: TaskManager job lifecycle hooks

2017-12-11 Thread Ben Sidhom
Ah, I see. Yes, that should definitely be good enough (at least for a first pass). Do you know how most users tend to deploy and use Flink in practice? Job-scoped clusters seem preferable for many reasons, but it's possible that that's only really practical when using YARN/Kubernetes/Mesos. Would

[jira] [Created] (FLINK-8241) Remove ResultPartitionWriter related PrepareForTest annotations

2017-12-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8241: --- Summary: Remove ResultPartitionWriter related PrepareForTest annotations Key: FLINK-8241 URL: https://issues.apache.org/jira/browse/FLINK-8241 Project: Flink

[jira] [Created] (FLINK-8240) Create unified interfaces to configure and instatiate TableSources

2017-12-11 Thread Timo Walther (JIRA)
Timo Walther created FLINK-8240: --- Summary: Create unified interfaces to configure and instatiate TableSources Key: FLINK-8240 URL: https://issues.apache.org/jira/browse/FLINK-8240 Project: Flink

Re: [VOTE] Release 1.4.0, release candidate #3

2017-12-11 Thread Tzu-Li (Gordon) Tai
+1 - Staged Apache source & binary convenience releases looks good - Built from source (macOS w/ Scala 2.11, hadoop-free, hadoop-2.8) - Locally tested topic regex subscription for the Kafka consumer - Quickstart projects looks good Other things verified that are carried from previous RC votes -

[jira] [Created] (FLINK-8239) Extend StreamTaskTestHarness to support TwoInput head operators

2017-12-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8239: --- Summary: Extend StreamTaskTestHarness to support TwoInput head operators Key: FLINK-8239 URL: https://issues.apache.org/jira/browse/FLINK-8239 Project: Flink

[jira] [Created] (FLINK-8238) StreamTaskTestHarness should only allow one setup call

2017-12-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8238: --- Summary: StreamTaskTestHarness should only allow one setup call Key: FLINK-8238 URL: https://issues.apache.org/jira/browse/FLINK-8238 Project: Flink

Re: [VOTE] Release 1.4.0, release candidate #3

2017-12-11 Thread Timo Walther
+1 (binding) - build the source locally - run various table programs - checked the resource consumption of table programs with retention enabled and disabled - built a quickstart project - tested the web ui submission (found https://issues.apache.org/jira/browse/FLINK-8187 but this is

[jira] [Created] (FLINK-8237) BucketingSink throws NPE when Writer.duplicate returns null

2017-12-11 Thread JIRA
Gábor Hermann created FLINK-8237: Summary: BucketingSink throws NPE when Writer.duplicate returns null Key: FLINK-8237 URL: https://issues.apache.org/jira/browse/FLINK-8237 Project: Flink

Re: [VOTE] Release 1.4.0, release candidate #3

2017-12-11 Thread Chesnay Schepler
+1 (binding) - checked contents of flink-dist for unshaded dependencies - ran python examples (with/-out arguments) locally - ran jobs on yarn on a cluster testing optional hadoop dependency - verified that quickstarts work - checked JM/TM logs for anything suspicious On 11.12.2017 11:29,

[jira] [Created] (FLINK-8236) Allow to set the parallelism of table queries

2017-12-11 Thread Timo Walther (JIRA)
Timo Walther created FLINK-8236: --- Summary: Allow to set the parallelism of table queries Key: FLINK-8236 URL: https://issues.apache.org/jira/browse/FLINK-8236 Project: Flink Issue Type:

[jira] [Created] (FLINK-8235) Cannot run spotbugs for single module

2017-12-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8235: --- Summary: Cannot run spotbugs for single module Key: FLINK-8235 URL: https://issues.apache.org/jira/browse/FLINK-8235 Project: Flink Issue Type: Bug

Re: [VOTE] Release 1.4.0, release candidate #3

2017-12-11 Thread Fabian Hueske
+1 (binding) - Checked hashes & signatures - Checked no binaries in source release - Checked Flink version in Quickstart pom files Cheers, Fabian 2017-12-11 11:26 GMT+01:00 Stefan Richter : > +1 (non-binding) > > - did extensive cluster tests on Google Cloud with

Re: [VOTE] Release 1.4.0, release candidate #3

2017-12-11 Thread Stefan Richter
+1 (non-binding) - did extensive cluster tests on Google Cloud with special focus on checkpointing and recovery and Kafka 0.11 end-to-end exactly-once + at-least-once. - build from source. > Am 11.12.2017 um 09:53 schrieb Piotr Nowojski : > > Hi, > > +1 (non-binding)

Re: [VOTE] Release 1.4.0, release candidate #3

2017-12-11 Thread Piotr Nowojski
Hi, +1 (non-binding) I have: - verified Scala and Java sample projects are creating and working properly and that Quickstart docs are ok - verified that ChildFirstClassloader allows user to run his application with some custom akka version - tested Kafka 0.11 end to end exactly once - did some

[jira] [Created] (FLINK-8233) Retrieve ExecutionResult by REST polling

2017-12-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8233: Summary: Retrieve ExecutionResult by REST polling Key: FLINK-8233 URL: https://issues.apache.org/jira/browse/FLINK-8233 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8232) Create RestHandler for long running operations

2017-12-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8232: Summary: Create RestHandler for long running operations Key: FLINK-8232 URL: https://issues.apache.org/jira/browse/FLINK-8232 Project: Flink Issue Type:

[jira] [Created] (FLINK-8231) Extend AbstractRestHandler to return response headers

2017-12-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8231: Summary: Extend AbstractRestHandler to return response headers Key: FLINK-8231 URL: https://issues.apache.org/jira/browse/FLINK-8231 Project: Flink Issue