Re: clickhouse tests failing

2019-09-12 Thread Gleb Kanterov
These tests are using testcontainers and assume that you have Docker environment locally. On Sun, Sep 8, 2019 at 5:14 PM Lukasz Cwik wrote: > Is passing at head on Jenkins: > https://builds.apache.org/job/beam_PreCommit_Java_Cron/1771/testReport/org.apache.beam.sdk.io.clickhouse/ > > What are

Re: Problems with KafkaIOIT in Beam

2019-09-12 Thread Michał Walenia
Thanks for the reply Cham, I'll check the counters and see if they are consistent. The read and write pipelines are already running separately. I created a question on Stack , feel free to answer there if you

Re: Contributor permission for Beam Jira tickets

2019-09-12 Thread Pablo Estrada
I've added you to contributors! Welcome to Beam! : D On Wed, Sep 11, 2019 at 9:59 AM Алексей Высотин wrote: > Hi all, > > I would like to take part in Beam project development and make a > contribution to it. > Could someone give me an access to Beam's Jira please? So that I will be > able to

Fwd: Gradle Training Roundup

2019-09-12 Thread Lukasz Cwik
Forwarding some events to improve your Gradle-fu so that we can all improve and maintain our build system. -- Forwarded message - From: Alex Leventer Date: Thu, Sep 12, 2019 at 10:55 AM Subject: Gradle Training Roundup To: Hi there, Join us for these upcoming free, online,

Re: How do you write portable runner pipeline on separate python code ?

2019-09-12 Thread Kyle Weaver
+dev I think we should probably point new users of the portable Flink/Spark runners to use loopback or some other non-docker environment, as Docker adds some operational complexity that isn't really needed to run a word count example. For example, Yu's pipeline errored here because the expected

Re: How do you write portable runner pipeline on separate python code ?

2019-09-12 Thread Thomas Weise
This should become much better with 2.16 when we have the Docker images prebuilt. Docker is probably still the best option for Python on a JVM based runner in a local environment that does not have a development setup. On Thu, Sep 12, 2019 at 1:09 PM Kyle Weaver wrote: > +dev I think we

Re: How do you write portable runner pipeline on separate python code ?

2019-09-12 Thread Kyle Weaver
I prefer loopback because a) it writes output files to the local filesystem, as the user expects, and b) you don't have to pull or build docker images, or even have docker installed on your system -- which is one less point of failure. Kyle Weaver | Software Engineer | github.com/ibzib |