Re: Using the BucketingSink with Flink 1.4.0

Thank you for your responses Stephan and Piotrek! It's great to know that the hadoop-free Bucketing Sink might be available as early as 1.5.x! In the meantime, I have been trying workarounds but I am currently facing issues making it work. I tried including my Hadoop dependencies only in my

Re: [DISCUSS] Inverted (child-first) class loading

@Ken very interesting thought. One for have three options: - forbid duplicate classes - parent first conflict resolution - child first conflict resolution Having number one as the default and let the error message suggest options two and three as options would definitely make users aware

Flink 1.5-SNAPSHOT on Kubernetes

Hi everyone! I'd like to deploy Flink 1.5-SNAPSHOT on Kubernetes for testing purposes and to test some 1.5 features running on the cloud. Is it possible at the moment? Are there any jobmanager / taskmanager 1.5-SNAPSHOT images? If it is possible, could you provide some steps to achieve this?

Re: [DISCUSS] Inverted (child-first) class loading

I can’t believe I’m suggesting this, but perhaps the Elasticsearch “Hammer of Thor” (aka “jar hell”) approach would be appropriate here. Basically they prevent a program from running if there are duplicate classes on the classpath. This causes headaches when you really need a different version

Re: Change build-target to a specific folder

The original code that created the directory used an unsafe plugin. The new way to add it unfortunately works only on UNIX. Checkout the "flink-dist"/pom.xml file where the directory is created: https://github.com/apache/flink/blob/master/flink-dist/pom.xml#L415 If you can find a way to make

Re: Change build-target to a specific folder

The build-target directory is not generated on Windows. We disabled that at some point; don't quite remember why. On 09.03.2018 13:13, mingleizhang wrote: Yes. I am running on windows. So, I can not see a folder called build-target under flink-dist ? At 2018-03-09 19:01:44, "Stephan

[jira] [Created] (FLINK-8912) Web UI does not render error messages correctly in FLIP-6 mode

Gary Yao created FLINK-8912: --- Summary: Web UI does not render error messages correctly in FLIP-6 mode Key: FLINK-8912 URL: https://issues.apache.org/jira/browse/FLINK-8912 Project: Flink Issue

[jira] [Created] (FLINK-8911) Add separate script for nightly end-to-end tests

Aljoscha Krettek created FLINK-8911: --- Summary: Add separate script for nightly end-to-end tests Key: FLINK-8911 URL: https://issues.apache.org/jira/browse/FLINK-8911 Project: Flink Issue

Re:[DISCUSS] Inverted (child-first) class loading

Hi, Stephan It is a great change, keep it and polish it. nice nice nice I think the more fewer NoClassDefFoundError or ClassNotFoundException the user will encounter in the future. But I would like to two question about this functionality. If Im am wrong, please helps me out. Thank you in

[jira] [Created] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

Stefan Richter created FLINK-8910: - Summary: Introduce automated end-to-end test for local recovery (including sticky scheduling) Key: FLINK-8910 URL: https://issues.apache.org/jira/browse/FLINK-8910

Re: [DISCUSS] Add end-to-end tests using Docker Compose

+1 On Fri, 9 Mar 2018 at 5:47 PM Aljoscha Krettek wrote: > Hi All, > > Stephan pointed this out the other day to me, so here goes: as some of > you might now, there are end-to-end tests in flink-end-to-end tests that > run a proper Flink cluster (on the local machine) and

Re:Re: Re: Change build-target to a specific folder

Yes. I am running on windows. So, I can not see a folder called build-target under flink-dist ? At 2018-03-09 19:01:44, "Stephan Ewen" wrote: >There should be a ' build-target' folder created when 'flink-dist' is >built. (actually, a symlink, more precisely) > >If

[jira] [Created] (FLINK-8909) pyflink.sh not working with yarn

Hitesh Tiwari created FLINK-8909: Summary: pyflink.sh not working with yarn Key: FLINK-8909 URL: https://issues.apache.org/jira/browse/FLINK-8909 Project: Flink Issue Type: Bug

[DISCUSS] Inverted (child-first) class loading

Hi all! Flink 1.4 introduces child-first classloading by default, for the application libraries. We added that, because it allows applications to use different versions of many libraries, compared to what Flink uses in its core, or compared to what other dependencies (like Hadoop) pull into the

Re: Using the BucketingSink with Flink 1.4.0

Hi! Yes, the bucketing sink is unfortunately still tied to some specific Hadoop file systems, due to a special way of using truncate() and append(). This is very high up our list post the 1.5 release, possibly even backportable to 1.5.x. The plan is to create a new Bucketing Sink based on

Re: Re: Change build-target to a specific folder

There should be a ' build-target' folder created when 'flink-dist' is built. (actually, a symlink, more precisely) If will not work on Windows, through. Are you running Windows? On Fri, Mar 9, 2018 at 11:34 AM, mingleizhang wrote: > Yes. It is. and I might do a little

[jira] [Created] (FLINK-8908) MapSerializer creates new serializer even if key and value serializers are stateless

Kostas Kloudas created FLINK-8908: - Summary: MapSerializer creates new serializer even if key and value serializers are stateless Key: FLINK-8908 URL: https://issues.apache.org/jira/browse/FLINK-8908

[jira] [Created] (FLINK-8907) Unable to start the process by start-cluster.sh

mingleizhang created FLINK-8907: --- Summary: Unable to start the process by start-cluster.sh Key: FLINK-8907 URL: https://issues.apache.org/jira/browse/FLINK-8907 Project: Flink Issue Type: Bug

Re:Re: Error : Temporary failure in name resolutionost

Okay. I am not sure whether it is a problem. But I will open a jira for this soon. At 2018-03-09 17:37:19, "Aljoscha Krettek" wrote: >Hi, > >Can you please open an issue on Jira about this? And please mark it as >Priority=Blocker and fixVersion=1.5.0. > >Best,

Re:Re: Change build-target to a specific folder

Yes. It is. and I might do a little change for this. At 2018-03-09 17:35:42, "Aljoscha Krettek" wrote: >Is this from the "building Flink" quickstart? I don't mind too much but you >can open a PR if you want to change that. > >> On 9. Mar 2018, at 08:00, mingleizhang

[jira] [Created] (FLINK-8906) Flip6DefaultCLI is not tested in org.apache.flink.client.cli tests

Nico Kruber created FLINK-8906: -- Summary: Flip6DefaultCLI is not tested in org.apache.flink.client.cli tests Key: FLINK-8906 URL: https://issues.apache.org/jira/browse/FLINK-8906 Project: Flink

[jira] [Created] (FLINK-8905) RestClusterClient#getMaxSlots returns 0

Nico Kruber created FLINK-8905: -- Summary: RestClusterClient#getMaxSlots returns 0 Key: FLINK-8905 URL: https://issues.apache.org/jira/browse/FLINK-8905 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8904) Flink-client tests do not restore previous sysout after changing it

Nico Kruber created FLINK-8904: -- Summary: Flink-client tests do not restore previous sysout after changing it Key: FLINK-8904 URL: https://issues.apache.org/jira/browse/FLINK-8904 Project: Flink

[DISCUSS] Add end-to-end tests using Docker Compose

Hi All, Stephan pointed this out the other day to me, so here goes: as some of you might now, there are end-to-end tests in flink-end-to-end tests that run a proper Flink cluster (on the local machine) and execute some tests. This catches bugs that you only catch when using Flink as a user

Re: Error : Temporary failure in name resolutionost

Hi, Can you please open an issue on Jira about this? And please mark it as Priority=Blocker and fixVersion=1.5.0. Best, Aljoscha > On 9. Mar 2018, at 09:49, mingleizhang wrote: > > Hi, > > > I build a flink based on the new code from master branch. And I get the

Re: Change build-target to a specific folder

Is this from the "building Flink" quickstart? I don't mind too much but you can open a PR if you want to change that. > On 9. Mar 2018, at 08:00, mingleizhang wrote: > > Hi, > > > Anyway, the line of cd build-target below confused me for a while at the > first time

[jira] [Created] (FLINK-8903) Error calculation based on rolling window in table API and SQL API

lilizhao created FLINK-8903: --- Summary: Error calculation based on rolling window in table API and SQL API Key: FLINK-8903 URL: https://issues.apache.org/jira/browse/FLINK-8903 Project: Flink

Error : Temporary failure in name resolutionost

Hi, I build a flink based on the new code from master branch. And I get the flink binary of flink-1.6-SNAPSHOT. When I run ./start-cluster.sh by the default flink-conf.yaml. I can not start the process and get the error below: [root@ricezhang-pjhzf bin]# ./start-cluster.sh Starting cluster.

Re: Using the BucketingSink with Flink 1.4.0

Hi, There is an quite old ticket about this issue. Feel free to bump it in the comment to rise it’s priority. https://issues.apache.org/jira/browse/FLINK-5789 Regarding a walk around, maybe someone else will know more. There was a similar

Re: [DISCUSS] Releasing Flink 1.3.3 with only critical fixes

Bear in mind that we have to update all JIRAs that were marked as resolved for 1.3.3. On 09.03.2018 08:47, Tzu-Li (Gordon) Tai wrote: +1 to have a minimal 1.3.3 release with the listed issues. I can also help manage this release. It seems like we don't have any objections with Aljoscha's