[jira] [Created] (FLINK-12013) Support calc and correlate in blink

2019-03-25 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12013: Summary: Support calc and correlate in blink Key: FLINK-12013 URL: https://issues.apache.org/jira/browse/FLINK-12013 Project: Flink Issue Type: New Feature

Re: Applying for membership in development mailing list

2019-03-25 Thread Zili Chen
Hi zhang, Send an e-mail to dev-subscr...@flink.apache.org, following as the reply and you would subscribe develop mailing list. If you mean applying for a contributor role in JIRA, please correct me. Best, tison. 张同学 于2019年3月26日周二 下午12:21写道: > Dear, > I want to be a Flink's developer,

Applying for membership in development mailing list

2019-03-25 Thread 张同学
Dear, I want to be a Flink's developer, apply to join the development mailing list, please approve, thank you!

Re: be a contributor

2019-03-25 Thread Thomas Weise
Added as contributor in JIRA. Welcome! On Mon, Mar 25, 2019 at 7:44 PM 君浩 wrote: > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is AlanLau. email: wayi...@gmail.com. > > > Thanks a lot. >

Re: write buffer low water mark and high water mark setup

2019-03-25 Thread meijies
sorry ,update the format whether newLowWaterMark is greater than defaultHighWaterMark or not, the water mark settings are same.  what do you think? // Low and high water marks for flow control // hack around the impossibility (in the current netty version) to set both watermarks at // the

write buffer low water mark and high water mark setup

2019-03-25 Thread meijies
Hi, Community whether newLowWaterMark is greater than defaultHighWaterMark or not, the water mark settings are same.  what do you think? // Low and high water marks for flow control // hack around the impossibility (in the current netty version) to set both watermarks at // the same time:

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread Shaoxuan Wang
+1 (non-binding) I tested RC4 with the following items: - Maven Central Repository contains all artifacts - Built the source with Maven (ensured all source files have Apache headers), and executed built-in tests via "mvn clean verify" - Manually executed the tests in IntelliJ IDE - Verify that

be a contributor

2019-03-25 Thread 君浩
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is AlanLau. email: wayi...@gmail.com. Thanks a lot.

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread jincheng sun
Hi Aljoscha, I think you are right, increase the timeout config will fix this issue. this depends on the resource of Travis. I would like share some phenomenon during my test (not the flink problem) as follows: :-) During my testing, `mvn clean verify` and `nightly end-to-end test ` both

Re: [DISCUSS] Using Guava in Flink "core" packages

2019-03-25 Thread Thomas Weise
Hi, Thanks for the follow-up. @Aljoscha Krettek if there is consensus, can we also backport FLINK-11501 for 1.8.1? (The Guava dependency was the reason we didn't.) Thanks, Thomas On Mon, Mar 25, 2019 at 8:07 AM Stephan Ewen wrote: > I would be fine with that as well. > > Let's keep the

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

2019-03-25 Thread Stephan Ewen
+1 to an enhancement to the Flink bot as a simple first step. The first step could be as simple as adding a red warning message as a comment to the PR whenever a PR touches a POM file. That needs special attention for various reasons, including (but not only) license checks and file updates. On

[DISCUSS] Remove forceAvro() and forceKryo() from the ExecutionConfig

2019-03-25 Thread Stephan Ewen
Hi all! The ExecutionConfig has some very old settings: forceAvro() and forceKryo(), which are actually misleadingly named. They cause POJOs to use Avro or Kryo rather than the POJO serializer. I think we do not have a good case any more to use Avro for POJOs. POJOs that are also Avro types go

Re: BroadcastStateITCase failure caused by insufficient number of network buffers

2019-03-25 Thread Stephan Ewen
Thanks for reporting this. Here is the issue and the fix for it: https://issues.apache.org/jira/browse/FLINK-12012 On Fri, Mar 15, 2019 at 1:36 PM Yu Li wrote: > Hi All, > > As titled, I found this case failed stably in one of my testing environment > when verifying 1.8.0 release. I'm

[jira] [Created] (FLINK-12012) BroadcastStateITCase does not use Test Environments

2019-03-25 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-12012: Summary: BroadcastStateITCase does not use Test Environments Key: FLINK-12012 URL: https://issues.apache.org/jira/browse/FLINK-12012 Project: Flink Issue

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread Aljoscha Krettek
Thanks for the testing done so far! There has been quite some flakiness on Travis lately, see here: https://travis-ci.org/apache/flink/branches . I’m a bit hesitant to release in this state. Looking at the tests you can see that all of the

Re: Expose per partition Kafka lag metric in Flink Kafka connector

2019-03-25 Thread Shuyi Chen
Thanks a lot, Becket. I am sorry that I was out of the loop for the last few days due to sickness. Let’s keep the discussion continue on the JIRA. Shuyi On Mon, Mar 25, 2019 at 4:46 AM Becket Qin wrote: > Hi Shuyi, > > Thanks for bringing this issue up. Per partition lag is definitely >

Re: Contributor permission apply

2019-03-25 Thread Robert Metzger
Hey, I gave you contributor permissions. On Mon, Mar 25, 2019 at 10:36 AM huang <2440239...@qq.com> wrote: > Hi Guys, > > I want to contribute to Apache Flink. > Would you please give me the permission as a contributor? > My JIRA ID is hyl > > > thanks

Re: [DISCUSS] Using Guava in Flink "core" packages

2019-03-25 Thread Stephan Ewen
I would be fine with that as well. Let's keep the attitude to maintain a slim dependency footprint, but Guava could be part of that small footprint. As long as we ensure it is our vendored (pre-shaded) version and all modules use the same version (managed version in the root pom). Best, Stephan

[jira] [Created] (FLINK-12011) Add Dockerfile with Debian image in Flink distribution

2019-03-25 Thread Mario Georgiev (JIRA)
Mario Georgiev created FLINK-12011: --- Summary: Add Dockerfile with Debian image in Flink distribution Key: FLINK-12011 URL: https://issues.apache.org/jira/browse/FLINK-12011 Project: Flink

[jira] [Created] (FLINK-12010) Kinesis Producer problems on Alpine Linux image

2019-03-25 Thread Mario Georgiev (JIRA)
Mario Georgiev created FLINK-12010: --- Summary: Kinesis Producer problems on Alpine Linux image Key: FLINK-12010 URL: https://issues.apache.org/jira/browse/FLINK-12010 Project: Flink Issue

[jira] [Created] (FLINK-12009) The heartbeat timeout should be larger or equal than the heartbeat timeout

2019-03-25 Thread Bruno Aranda (JIRA)
Bruno Aranda created FLINK-12009: Summary: The heartbeat timeout should be larger or equal than the heartbeat timeout Key: FLINK-12009 URL: https://issues.apache.org/jira/browse/FLINK-12009 Project:

Re: [jira] [Created] (FLINK-12002) Adaptive Parallelism of Job Vertex Execution

2019-03-25 Thread dachuan . qu
On 2019/03/25 08:30:00, "ryantaocer (JIRA)" wrote: > ryantaocer created FLINK-12002: > -- > > Summary: Adaptive Parallelism of Job Vertex Execution > Key: FLINK-12002 > URL:

[jira] [Created] (FLINK-12008) Support read a whole directory or multiple input data files for read apis of HadoopInputs

2019-03-25 Thread vinoyang (JIRA)
vinoyang created FLINK-12008: Summary: Support read a whole directory or multiple input data files for read apis of HadoopInputs Key: FLINK-12008 URL: https://issues.apache.org/jira/browse/FLINK-12008

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread jincheng sun
Great thanks for preparing the RC4 of Flink 1.8.0, Aljoscha! +1 (non-binding) I checked the functional things as follows(Without performance verification): 1. Checking Artifacts: 1). Download the release source code - SUCCESS 2). Check Source release flink-1.8.0-src.tgz.sha512 -

Re: Expose per partition Kafka lag metric in Flink Kafka connector

2019-03-25 Thread Becket Qin
Hi Shuyi, Thanks for bringing this issue up. Per partition lag is definitely something that should be exposed. I replied to the JIRA with some of my concerns. Do you mind keeping the discussion in the JIRA ticket so it is easier for future readers to follow the issue? Thanks, Jiangjie (Becket)

[jira] [Created] (FLINK-12005) [State TTL] Event time support

2019-03-25 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-12005: --- Summary: [State TTL] Event time support Key: FLINK-12005 URL: https://issues.apache.org/jira/browse/FLINK-12005 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-12007) Cannot build for Scala 2.12 on Windows

2019-03-25 Thread Lodovico Giaretta (JIRA)
Lodovico Giaretta created FLINK-12007: - Summary: Cannot build for Scala 2.12 on Windows Key: FLINK-12007 URL: https://issues.apache.org/jira/browse/FLINK-12007 Project: Flink Issue Type:

Re: [DISCUSS] Improve the flinkbot

2019-03-25 Thread shengjk1
+1 Best, Shengjk1 On 03/23/2019 12:08,vino yang wrote: +1 Best, Vino Bowen Li 于2019年3月23日周六 上午12:28写道: +1, sounds good, Jark. On Fri, Mar 22, 2019 at 1:55 AM Fabian Hueske wrote: Hi Jark, Thanks for driving the effort to integrate the Chinese website! We have the policy that new

[jira] [Created] (FLINK-12006) ZooKeeperHaServicesTest is unstable

2019-03-25 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-12006: Summary: ZooKeeperHaServicesTest is unstable Key: FLINK-12006 URL: https://issues.apache.org/jira/browse/FLINK-12006 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12004) Consider about POJO using method chaining when extract TypeInformation

2019-03-25 Thread jiawei chen (JIRA)
jiawei chen created FLINK-12004: --- Summary: Consider about POJO using method chaining when extract TypeInformation Key: FLINK-12004 URL: https://issues.apache.org/jira/browse/FLINK-12004 Project: Flink

Contributor permission apply

2019-03-25 Thread huang?0?3
Hi Guys, I want to contribute to Apache Flink. Would you please give me the permission as a contributor? My JIRA ID is hyl thanks

Re: [DISCUSS] Using Guava in Flink "core" packages

2019-03-25 Thread Aljoscha Krettek
Hi, By now, I think it’s fine to have Guava (our shaded guava) as a dependency in flink-core. It’s a very useful library and I don’t see problems with version clashes because it’s relocated to our namespace. If no-one objects, I would just leave the dependency in as-is and conclude this

[jira] [Created] (FLINK-12003) Revert the config option about mapreduce.output.basename in HadoopOutputFormatBase

2019-03-25 Thread vinoyang (JIRA)
vinoyang created FLINK-12003: Summary: Revert the config option about mapreduce.output.basename in HadoopOutputFormatBase Key: FLINK-12003 URL: https://issues.apache.org/jira/browse/FLINK-12003 Project:

[jira] [Created] (FLINK-12002) Adaptive Parallelism of Job Vertex Execution

2019-03-25 Thread ryantaocer (JIRA)
ryantaocer created FLINK-12002: -- Summary: Adaptive Parallelism of Job Vertex Execution Key: FLINK-12002 URL: https://issues.apache.org/jira/browse/FLINK-12002 Project: Flink Issue Type:

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread Piotr Nowojski
+1 from my side. Previously spotted performance regression seems to be gone, or mostly gone. Piotrek > On 21 Mar 2019, at 17:52, Aljoscha Krettek wrote: > > Hi everyone, > Please review and vote on the release candidate 4 for Flink 1.8.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do

[jira] [Created] (FLINK-12001) Test AvroExternalJarProgramITCase, get `JAR file does not exist` Error.

2019-03-25 Thread sunjincheng (JIRA)
sunjincheng created FLINK-12001: --- Summary: Test AvroExternalJarProgramITCase, get `JAR file does not exist` Error. Key: FLINK-12001 URL: https://issues.apache.org/jira/browse/FLINK-12001 Project:

Re: [DISCUSS] FLIP-33: Standardize connector metrics

2019-03-25 Thread Becket Qin
Hi Stephan, Thanks a lot for the feedback. All makes sense. It is a good suggestion to simply have an onRecord(numBytes, eventTime) method for connector writers. It should meet most of the requirements, individual The configurable metrics feature is something really useful, especially if we can