Re: [VOTE] Release 1.4.2, release candidate #2

2018-02-27 Thread Aljoscha Krettek
I think it would be very good to also include the fix for https://issues.apache.org/jira/browse/FLINK-8798 . Some users have already run into this problem and popular Web Containers that use child-first classloading also all have an exception

Re: Verifying watermarks in integration test

2018-02-27 Thread Thomas Weise
Hi Xingcan, thanks, this is a good way of testing an individual operator. I had written my own mock code to intercept source context and collect the results, this is a much better approach for operator testing. I wonder how I can verify with an embedded Flink cluster though. Even though my

Re: [DISCUS] Flink SQL Client dependency management

2018-02-27 Thread Stephan Ewen
I think one problem with the "one fat jar for all" is that some dependencies clash in the classnames across versions: - Kafka 0.9, 0.10, 0.11, 1.0 - Elasticsearch 2, 4, and 5 There are probably others as well... On Tue, Feb 27, 2018 at 2:57 PM, Timo Walther wrote: > Hi

[jira] [Created] (FLINK-8801) S3's eventual consistent read-after-write may fail yarn deployment of resources to S3

2018-02-27 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-8801: -- Summary: S3's eventual consistent read-after-write may fail yarn deployment of resources to S3 Key: FLINK-8801 URL: https://issues.apache.org/jira/browse/FLINK-8801

[jira] [Created] (FLINK-8800) Set Logging to TRACE for org.apache.flink.runtime.rest.handler.job.metrics.JobVertexMetricsHandler

2018-02-27 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8800: --- Summary: Set Logging to TRACE for org.apache.flink.runtime.rest.handler.job.metrics.JobVertexMetricsHandler Key: FLINK-8800 URL: https://issues.apache.org/jira/browse/FLINK-8800

[jira] [Created] (FLINK-8799) Make AbstractYarnClusterDescriptor immutable

2018-02-27 Thread Gary Yao (JIRA)
Gary Yao created FLINK-8799: --- Summary: Make AbstractYarnClusterDescriptor immutable Key: FLINK-8799 URL: https://issues.apache.org/jira/browse/FLINK-8799 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8798) Make commons-logging a parent-first pattern

2018-02-27 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8798: --- Summary: Make commons-logging a parent-first pattern Key: FLINK-8798 URL: https://issues.apache.org/jira/browse/FLINK-8798 Project: Flink Issue Type: Bug

Re: [DISCUSS] Releasing Flink 1.5.0

2018-02-27 Thread Till Rohrmann
The release branch is now created [1]. Please be aware that we should only commit bug fixes to this branch henceforth. @Bowen, let's wait what Aljoscha says concerning FLINK-8667. If he agrees, then we can still merge it into the release branch. [1]

Re: [DISCUS] Flink SQL Client dependency management

2018-02-27 Thread Timo Walther
Hi Xingcan, thank you for your feedback. Regarding (3) we also thought about that but this approach would not scale very well. Given that we might have fat jars for multiple versions (Kafka 0.8, Kafka 0.6 etc.) such an all-in-one solution JAR file might easily go beyond 1 or 2 GB. I don't

Re: Checkpointing Event Time Watermarks

2018-02-27 Thread Xingcan Cui
Hi Vijay, normally, maybe there’s no need to checkpoint the event times / watermarks since they are automatically generated based on the records. What’s your intention? Best, Xingcan > On 27 Feb 2018, at 8:50 PM, vijay kansal wrote: > > Hi All > > Is there a way to

Re: [DISCUS] Flink SQL Client dependency management

2018-02-27 Thread Xingcan Cui
Hi Timo, thanks for your efforts. Personally, I think the second option would be better and here are my feelings. (1) The SQL client is designed to offer a convenient way for users to manipulate data with Flink. Obviously, the second option would be more easy-to-use. (2) The script will

Checkpointing Event Time Watermarks

2018-02-27 Thread vijay kansal
Hi All Is there a way to checkpoint event time watermarks in Flink ? I tries searching for this, but could not figure out... Vijay Kansal Software Development Engineer LimeRoad

[jira] [Created] (FLINK-8797) Port AbstractOperatorRestoreTestBase to MiniClusterResource

2018-02-27 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-8797: --- Summary: Port AbstractOperatorRestoreTestBase to MiniClusterResource Key: FLINK-8797 URL: https://issues.apache.org/jira/browse/FLINK-8797 Project: Flink

Re: [VOTE] Release 1.4.2, release candidate #2

2018-02-27 Thread Tzu-Li (Gordon) Tai
Sorry for the incorrect vote thread title. This vote is for release candidate #1, not 2. Cheers, Gordon On 27 February 2018 at 8:30:42 PM, Tzu-Li (Gordon) Tai (tzuli...@apache.org) wrote: Hi everyone, Please review and vote on release candidate #1 for Flink 1.4.2, as follows:  [ ] +1, Approve

[VOTE] Release 1.4.2, release candidate #2

2018-02-27 Thread Tzu-Li (Gordon) Tai
Hi everyone, Please review and vote on release candidate #1 for Flink 1.4.2, as follows:  [ ] +1, Approve the release  [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes:  * JIRA release notes [1],  * the

[jira] [Created] (FLINK-8796) Update "Upgrading Applications and Flink Versions" for 1.5

2018-02-27 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8796: Summary: Update "Upgrading Applications and Flink Versions" for 1.5 Key: FLINK-8796 URL: https://issues.apache.org/jira/browse/FLINK-8796 Project: Flink

Re: [DISCUS] Flink SQL Client dependency management

2018-02-27 Thread Stephan Ewen
My first intuition would be to go for approach #2 for the following reasons - I expect that in the long run, the scripts will not be that simple to maintain. We saw that with all shell scripts thus far: they start simple, and then grow with many special cases for this and that setup. - Not

Re: [DISCUSS] Release Flink 1.4.2

2018-02-27 Thread Stephan Ewen
+1 to an immediate 1.4.2 release On Tue, Feb 27, 2018 at 9:43 AM, Ufuk Celebi wrote: > Since users already reported this on the ML, I'm big +1 to release > immediately. > > On Tue, Feb 27, 2018 at 7:45 AM, Tzu-Li (Gordon) Tai > wrote: > > Since we’re

[jira] [Created] (FLINK-8795) Failed to submit JobGraph Apache Flink on Github Master Branch

2018-02-27 Thread kant kodali (JIRA)
kant kodali created FLINK-8795: -- Summary: Failed to submit JobGraph Apache Flink on Github Master Branch Key: FLINK-8795 URL: https://issues.apache.org/jira/browse/FLINK-8795 Project: Flink

[jira] [Created] (FLINK-8794) When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

2018-02-27 Thread yanxiaobin (JIRA)
yanxiaobin created FLINK-8794: - Summary: When using BucketingSink, it happens that one of the files is always in the [.in-progress] state Key: FLINK-8794 URL: https://issues.apache.org/jira/browse/FLINK-8794

Re: How to use Dimension table in Flink TableAPI with StreamExecutionEnvironment ?

2018-02-27 Thread Fabian Hueske
Hi, Liu and Hequn are right. You need to pass at least one parameter into the table function, i.e., select t.col_1 from test t left join lateral table(dim_test(SOME_ATTRIBUTE)) b on true Best, Fabian 2018-02-24 13:24 GMT+01:00 ZhenBao Ye : > hi,i was use 1.4.0。 > >

[jira] [Created] (FLINK-8793) Only key with password are hidden in Flink web interface

2018-02-27 Thread Etienne CARRIERE (JIRA)
Etienne CARRIERE created FLINK-8793: --- Summary: Only key with password are hidden in Flink web interface Key: FLINK-8793 URL: https://issues.apache.org/jira/browse/FLINK-8793 Project: Flink

Re: [DISCUSS] Release Flink 1.4.2

2018-02-27 Thread Ufuk Celebi
Since users already reported this on the ML, I'm big +1 to release immediately. On Tue, Feb 27, 2018 at 7:45 AM, Tzu-Li (Gordon) Tai wrote: > Since we’re still a bit undecided on FLINK-8451, I think it would be best to > release 1.4.2 with FLINK-8741 now. > Otherwise, Kafka