New blog post: Splittable DoFn

Hi all, The blog post Powerful and modular IO connectors with Splittable DoFn in Apache Beam just went live - take a look! *One of the most important parts of the Apache Beam ecosystem is its quickly growing set of connectors that

Re: Resampling a timeserie stuck on a GroupByKey

Do you have some job ids that you could share? On Wed, Aug 16, 2017 at 1:18 PM, Tristan Marechaux < tristan.marech...@walnut-algo.com> wrote: > Thanks for the invitation and for the answer. > > I tried the Count resample function and I still have the same issue, so I > guess it doesn't come from

Re: Slack channel

Ah interesting, I guess no one told the Mesos guys that! :D Thanks for the invite though! On Wed, Aug 16, 2017 at 1:25 PM, Lukasz Cwik wrote: > Welcome Griselda, Steve, and Apache. > > Steve, this has come up before but it is against Slack's free tier policy > for having a

Re: Slack channel

Welcome Griselda, Steve, and Apache. Steve, this has come up before but it is against Slack's free tier policy for having a bot which sends invites out automatically. On Wed, Aug 16, 2017 at 10:18 AM, Apache Enthu wrote: > Please could you add me too? > > Thanks, > Almas

Re: Slack channel

Please could you add me too? Thanks, Almas On 16 Aug 2017 22:41, "Steve Niemitz" wrote: > I'll jump on this thread as well, can I get an invite too? > > Also, has anyone though of making this self service? The apache mesos > slack has this set up [1]. > > [1]

Re: Slack channel

I'll jump on this thread as well, can I get an invite too? Also, has anyone though of making this self service? The apache mesos slack has this set up [1]. [1] https://mesos-slackin.herokuapp.com On Aug 16, 2017 1:08 PM, "Griselda Cuevas" wrote: > Hi Manu, I'd like to piggy

Re: Using external python packges in pipeline

On Tue, Aug 15, 2017 at 11:31 PM Chamikara Jayalath wrote: > Please see following regarding managing dependencies for Python SDK. > https://cloud.google.com/dataflow/pipelines/dependencies-python > Actually, we have an updated Apache Beam version of that document.

Re: Slack channel

Hi Manu, I'd like to piggy back on shen's request, could you add me to the channel as well? On 15 August 2017 at 21:32, Manu Zhang wrote: > Invitation sent. Welcome. > > On Wed, Aug 16, 2017 at 11:41 AM shen yu wrote: > >> Hi, I'd like to join the

ConcurrentModificationException while performing checkpoint for Kinesis stream

When flink performs a checkpoint I get randomly ConcurrentModificationException. >From my investigation it looks like the method public boolean advance() throws IOException from

Re: Failed to run Wordcount example

I have seen the same error. There is a word-count-beam subproject under the root from the first command. The project has a different version (0.1) than its parent (2.0.0). It makes all beam dependencies to version 0.1. Once I change the version to 2.0.0, the second command can run successfully. I

Re: Failed to run Wordcount example

I just executed the same commands that you pasted in your email and it worked for me, can you verify that you are not having network issues while downloading the dependencies with maven ? On Wed, Aug 16, 2017 at 10:06 AM, Vincent Wang wrote: > Hi Ismaël, > > I'm running

Re: Failed to run Wordcount example

Hi Ismaël, I'm running the command mvn archetype:generate \ -DarchetypeGroupId=org.apache.beam \ -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \ -DarchetypeVersion=2.0.0 \ -DgroupId=org.example \ -DartifactId=word-count-beam \

Re: Failed to run Wordcount example

Hello, The error message shows that it is looking for the Beam 0.1 version and that version does not exist in maven central. You have to replace the version of Beam in the command you executed with the latest version that means 2.0.0 at this moment and it should work. Regards, Ismaël On Wed,

Re: Using external python packges in pipeline

Please see following regarding managing dependencies for Python SDK. https://cloud.google.com/dataflow/pipelines/dependencies-python Stack Overflow is a better resource for Cloud Dataflow specific questions. https://stackoverflow.com/questions/tagged/google-cloud-dataflow Thanks, Cham On Tue,