Re: Beam Spark/Flink runner with DC/OS

y just > a simple matter of staging the right classes on the cluster. > > Pei, any additional thoughts here? > > On Mon, Jan 23, 2017 at 1:58 PM, Chaoran Yu <chaoran...@lightbend.com > <mailto:chaoran...@lightbend.com>> wrote: > Sorry for the spam. But

Re: Beam Spark/Flink runner with DC/OS

Sorry for the spam. But to clarify, I didn’t write the code. I’m using the code described here https://beam.apache.org/get-started/wordcount-example/ <https://beam.apache.org/get-started/wordcount-example/> So the file already exists in GS. > On Jan 23, 2017, at 4:55 PM, Chaoran Yu

Re: Beam Spark/Flink runner with DC/OS

la <amitsel...@gmail.com> wrote: > > Why not try file:// instead ? it doesn't seem like you're using Google > Storage, right ? I mean the input file is on your local FS. > > On Mon, Jan 23, 2017 at 11:34 PM Chaoran Yu <chaoran...@lightbend.com > <mailto:chaoran...@lig

Re: Beam Spark/Flink runner with DC/OS

r processes have access to GS ? could you paste the entire stack trace ?On Mon, Jan 23, 2017 at 11:21 PM Chaoran Yu <chaoran...@lightbend.com> wrote:Thank you Amit for the reply,I just tried two more runners and below is a summary:DirectRunner: worksFlinkRunner: works in local mode. I got a

Re: Regarding Beam Slack Channel

Can anyone add me to the channel as well? Thank you! chaoran...@lightbend.com Chaoran > On Jan 23, 2017, at 1:32 AM, Ritesh Kasat wrote: > > Hello, > > Can someone add me to the Beam slack channel. > > Thanks > Ritesh

Beam Spark/Flink runner with DC/OS

are greatly appreciated. Thank you, Chaoran Yu