[jira] [Created] (FLINK-8710) AbstractYarnClusterDescriptor doesn't use pre-defined configs in Hadoop's YarnConfiguration

2018-02-19 Thread Bowen Li (JIRA)
Bowen Li created FLINK-8710: --- Summary: AbstractYarnClusterDescriptor doesn't use pre-defined configs in Hadoop's YarnConfiguration Key: FLINK-8710 URL: https://issues.apache.org/jira/browse/FLINK-8710

[jira] [Created] (FLINK-8711) Flink with YARN use wrong SlotsPerTaskManager

2018-02-19 Thread Aleksandr (JIRA)
Aleksandr created FLINK-8711: Summary: Flink with YARN use wrong SlotsPerTaskManager Key: FLINK-8711 URL: https://issues.apache.org/jira/browse/FLINK-8711 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8694) Make notifyDataAvailable call reliable

2018-02-19 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-8694: - Summary: Make notifyDataAvailable call reliable Key: FLINK-8694 URL: https://issues.apache.org/jira/browse/FLINK-8694 Project: Flink Issue Type: Sub-task

Re: Multiple windows on a single stream

2018-02-19 Thread Aljoscha Krettek
Hi Carsten, If you're using event-time windowing you can do something like this: souce = env.addSource(...) window1 = source .keyBy() .window(10 sec) .aggregate()/reduce() window1.addSink(...) window2 = window1 .keyBy() .windwo(30 sec) .aggregate()/reduce() window2.addSink(...)

[jira] [Created] (FLINK-8695) Move RocksDB State Backend from 'flink-contrib' to 'flink-state-backends'

2018-02-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8695: --- Summary: Move RocksDB State Backend from 'flink-contrib' to 'flink-state-backends' Key: FLINK-8695 URL: https://issues.apache.org/jira/browse/FLINK-8695 Project: Flink

Re: Reading a single input file in parallel?

2018-02-19 Thread Fabian Hueske
Hi Niels, Jörn is right, although offering different methods, Flink's InputFormat is very similar to Hadoop's InputFormat interface. The InputFormat.createInputSplits() method generates splits that can be read in parallel. The FileInputFormat splits files by fixed boundaries (usually HDFS

[jira] [Created] (FLINK-8699) Fix concurrency problem in rocksdb full checkpoint

2018-02-19 Thread Sihua Zhou (JIRA)
Sihua Zhou created FLINK-8699: - Summary: Fix concurrency problem in rocksdb full checkpoint Key: FLINK-8699 URL: https://issues.apache.org/jira/browse/FLINK-8699 Project: Flink Issue Type: Bug

[CANCEL] Release flink-shaded 3.0, release candidate #1

2018-02-19 Thread Chesnay Schepler
I'll cancel the vote to include jackson-dataformats-yaml in flink-shaded-jackson. This comes at no overhead btw. since I found another issue: flink-shaded-jackson-module-jsonSchema is not self-contained as it is missing javax.validation:validation-api On 19.02.2018 13:39, Timo Walther

[jira] [Created] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-02-19 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-8704: --- Summary: Migrate tests from TestingCluster to MiniClusterResource Key: FLINK-8704 URL: https://issues.apache.org/jira/browse/FLINK-8704 Project: Flink

[jira] [Created] (FLINK-8705) Integrate Remote(Stream)Environment with Flip-6 cluster

2018-02-19 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8705: Summary: Integrate Remote(Stream)Environment with Flip-6 cluster Key: FLINK-8705 URL: https://issues.apache.org/jira/browse/FLINK-8705 Project: Flink Issue

[jira] [Created] (FLINK-8706) Supported Data Types - Six or Seven

2018-02-19 Thread Matt Hagen (JIRA)
Matt Hagen created FLINK-8706: - Summary: Supported Data Types - Six or Seven Key: FLINK-8706 URL: https://issues.apache.org/jira/browse/FLINK-8706 Project: Flink Issue Type: Bug

Re: [VOTE] Release flink-shaded 3.0, release candidate #1

2018-02-19 Thread Chesnay Schepler
Previous mail contained some funky pipes, let's try this again... Hi everyone, Please review and vote on the release candidate #1 for the version 3.0 of flink-shaded, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete

Re: [VOTE] Release flink-shaded 3.0, release candidate #1

2018-02-19 Thread Timo Walther
Hi Chesnay, thanks for working on a new flink-shaded version. I just had an offline discussion with Stephan Ewen about shading Jackson also in flink-sql-client. The problem is that we use jackson-dataformat-yaml there which is incompatible with our shaded version. Would it be possible to

[jira] [Created] (FLINK-8703) Migrate tests from LocalFlinkMiniCluster to MiniClusterResource

2018-02-19 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-8703: --- Summary: Migrate tests from LocalFlinkMiniCluster to MiniClusterResource Key: FLINK-8703 URL: https://issues.apache.org/jira/browse/FLINK-8703 Project: Flink

[jira] [Created] (FLINK-8696) Remove JobManager local mode from the Unix Shell Scripts

2018-02-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8696: --- Summary: Remove JobManager local mode from the Unix Shell Scripts Key: FLINK-8696 URL: https://issues.apache.org/jira/browse/FLINK-8696 Project: Flink Issue

[jira] [Created] (FLINK-8701) Migrate SavepointMigrationTestBase to MiniClusterResource

2018-02-19 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-8701: --- Summary: Migrate SavepointMigrationTestBase to MiniClusterResource Key: FLINK-8701 URL: https://issues.apache.org/jira/browse/FLINK-8701 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.4.1 released

2018-02-19 Thread Stephan Ewen
Great, thanks a lot for being the release manager, Gordon! On Fri, Feb 16, 2018 at 12:54 AM, Hao Sun wrote: > This is great! > > On Thu, Feb 15, 2018 at 2:50 PM Bowen Li wrote: > >> Congratulations everyone! >> >> On Thu, Feb 15, 2018 at 10:04 AM, Tzu-Li

[jira] [Created] (FLINK-8697) Rename DummyFlinkKafkaConsumer in Kinesis tests

2018-02-19 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8697: --- Summary: Rename DummyFlinkKafkaConsumer in Kinesis tests Key: FLINK-8697 URL: https://issues.apache.org/jira/browse/FLINK-8697 Project: Flink Issue

[jira] [Created] (FLINK-8700) Port tests from FlinkMiniCluster to MiniClusterResource

2018-02-19 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-8700: --- Summary: Port tests from FlinkMiniCluster to MiniClusterResource Key: FLINK-8700 URL: https://issues.apache.org/jira/browse/FLINK-8700 Project: Flink

Re: Flink 1.3.2 -- mvn clean package -Pbuild-jar command takes to much time

2018-02-19 Thread Stephan Ewen
Hi! It looks like something is not correct with your project setup. The build puts countless dependencies of core flink into your application jar (like akka, scala, netty). The important thing is to set the core Flink dependencies to "provided" (they will not be in the Jar file), but keep the

[jira] [Created] (FLINK-8702) Migrate tests from FlinkMiniCluster to MiniClusterResource

2018-02-19 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-8702: --- Summary: Migrate tests from FlinkMiniCluster to MiniClusterResource Key: FLINK-8702 URL: https://issues.apache.org/jira/browse/FLINK-8702 Project: Flink

[VOTE] Release flink-shaded 3.0, release candidate #1

2018-02-19 Thread Chesnay Schepler
|Hi everyone,| |Please review and vote on the release candidate #1 for the version 3.0 of flink-shaded, as follows:| |[ ] +1, Approve the release| |[ ] -1, Do not approve the release (please provide specific comments)| |The complete staging area is available for your review, which includes: *

[VOTE] Release flink-shaded 3.0, release candidate #2

2018-02-19 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #2 for the version 3.0 of flink-shaded, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * GitHub

Re: [VOTE] Release flink-shaded 3.0, release candidate #2

2018-02-19 Thread Chesnay Schepler
+1 * compiles without error * every jar is self-contained * all classes are properly relocated * jackson services are properly relocated * all added dependencies use the Apache License 2.0 o com.fasterxml.jackson.module:jackson-module-jsonSchema +

Re: Flink 1.3.2 -- mvn clean package -Pbuild-jar command takes to much time

2018-02-19 Thread Melekh, Gregory
Thanks for quick reply. If I put all this code in comment the project will compile in 7 seconds. build.log file attached to mail contains debug of “mvn clean package -Pbuild-jar” command. On 19/02/2018, 12:29, "Stephan Ewen" wrote: Hi! It looks like

[jira] [Created] (FLINK-8709) Flaky test: SlotPoolRpcTest.testCancelSlotAllocationWithoutResourceManager

2018-02-19 Thread Bowen Li (JIRA)
Bowen Li created FLINK-8709: --- Summary: Flaky test: SlotPoolRpcTest.testCancelSlotAllocationWithoutResourceManager Key: FLINK-8709 URL: https://issues.apache.org/jira/browse/FLINK-8709 Project: Flink

[jira] [Created] (FLINK-8707) Excessive amount of files opened by flink task manager

2018-02-19 Thread Alexander Gardner (JIRA)
Alexander Gardner created FLINK-8707: Summary: Excessive amount of files opened by flink task manager Key: FLINK-8707 URL: https://issues.apache.org/jira/browse/FLINK-8707 Project: Flink

[jira] [Created] (FLINK-8708) Unintended integer division in StandaloneThreadedGenerator

2018-02-19 Thread Ted Yu (JIRA)
Ted Yu created FLINK-8708: - Summary: Unintended integer division in StandaloneThreadedGenerator Key: FLINK-8708 URL: https://issues.apache.org/jira/browse/FLINK-8708 Project: Flink Issue Type: Bug