Submit WordCount to a Flink cluster

Hello, I am a newbie to Beam. Following the Beam docs, I am trying to submit the example WordCount to a Flink cluster (one jobmanger and one taskmanager running locally in two linked Docker containers with Maven installed). It seems the Beam doc is a bit confusing as to how to submit jobs. In

Re: How to inforce google-cloud-bigquery==0.28.0 installation on the dataflow workers

I answered your similar question in the other thread [1]. Let me know if you have a separate question. Ahmet [1] https://lists.apache.org/thread.html/0d1e0ff046657a5439c834e23da375dc405cb562017b08a508b6e079@%3Cuser.beam.apache.org%3E On Fri, Jul 13, 2018 at 11:04 AM, OrielResearch Eila

Re: google.cloud.bigQuery version on workers - please HELP

On Thu, Jul 12, 2018 at 7:35 PM, OrielResearch Eila Arich-Landkof < e...@orielresearch.org> wrote: > Hi Ahmat, > > > I have received the version from the worker using the following commands: > > *from google.cloud import bigquery* > *logging.info ('bigquery.__version__ is %s

Live coding & reviewing adventures

Hi folks! I've been doing some live coding in my other projects and I figured I'd do some with Apache Beam as well. Today @ 3pm pacific I'm going be doing some impromptu exploration better review tooling possibilities (looking at forking spark-pr-dashboard for other projects like beam and setting