Re: BigQuery table backed by Google Sheet

This sounds like a Dataflow-specific question, so it might be better addressed by a StackOverflow question tagged with google-cloud-dataflow [1]. I'd suggest checking the Dataflow documentation for more information about its security model [2]. You'd likely have to use a service account, as

Re: Slack channel invite pls

Can I also get a slack invite? adinsx...@gmail.com On Thu, May 4, 2017 at 9:36 AM, Lukasz Cwik wrote: > Sent > > On Thu, May 4, 2017 at 9:32 AM, Seshadri Raghunathan > wrote: > >> Hi , >> >> Please add me to the Slack channel in the next possible cycle. >>

Re: KafkaIO nothing received?

@Conrad, Your code should be good to go, I can run it in my local env. There're two points you may have a check: 1). does the topic have data there, you can confirm with kafka cli ' *bin/kafka-console-consumer.sh*'; 2). is the port in bootstrapServers right? By default it's 9092. On Thu, May

Re: Http sink - Does it make sense?

Hi Josh, If you are looking for RestIO, I saw some discussions earlier in the group. This JIRA has more details on it - https://issues.apache.org/jira/browse/BEAM-1946 Hope that helps ! Regards, Seshadri On Thu, May 4, 2017 at 9:19 AM, Josh wrote: > Hi all, > > I'm

Http sink - Does it make sense?

Hi all, I'm computing some counts in a Beam job and want to sink the results to a REST API via HTTP. For example, group incoming elements by a key, count by key, and then every minute write the count to an API which supports incremental updates. Is this something that other people have done with

Re: Slack access?

invite sent.Sent from your iPhone-- Original --From: Conrad Crampton Date: 周五,5月 5,2017 00:06To: user@beam.apache.org Subject: Re: Slack access? Hi, Can I be added to the Slack channel please when next

Re: [HEADS UP] Using "new" filesystem layer

JB, for your second point it seems as though you may not be setting the Hadoop configuration on HadoopFileSystemOptions. Also, I just merged https://github.com/apache/beam/pull/2890 which will auto detect Hadoop configuration based upon your HADOOP_CONF_DIR and YARN_CONF_DIR environment variables.

Slack access?

Hi, Can I be added to the Slack channel please when next updated? conrad.cramp...@secdata.com Many thanks Conrad SecureData, combating cyber threats __ The information contained in this