Re: Slack

Done. Welcome! On Mon, Mar 13, 2017 at 2:29 PM Alexander Gallego wrote: > same for me please. > > > > > .alex > > > > On Fri, Mar 10, 2017 at 3:01 PM, Amit Sela wrote: > > Done > > On Fri, Mar 10, 2017, 21:59 Devon Meunier

Re: Slack

same for me please. .alex On Fri, Mar 10, 2017 at 3:01 PM, Amit Sela wrote: > Done > > On Fri, Mar 10, 2017, 21:59 Devon Meunier > wrote: > >> Hi! >> >> Sorry for the noise but could someone invite me to the slack channel? >> >> Thanks, >>

Re: Slack

Same for me please :) Tobi On 13.03.17, 13:30, "Amit Sela" > wrote: Done. Welcome! On Mon, Mar 13, 2017 at 2:29 PM Alexander Gallego > wrote: same for me please. .alex On Fri, Mar

Re: Slack

I'm so well trained, I do it on my phone now! On Mon, Mar 13, 2017, 15:24 Tobias Feldhaus wrote: > Same for me please :) > > Tobi > > > > On 13.03.17, 13:30, "Amit Sela" wrote: > > > > Done. Welcome! > > > > On Mon, Mar 13, 2017 at 2:29 PM

Re: grpc IO?

Thanks Eugene, I thought about this over the weekend and I think the best is for me to spend some time trying to mock up some code to see how grpcIO woulc help us. I propose you give me few weeks and we keep JIRA open. After that I will either close JIRA or propose how API would look like. makes

Re: Slack

added ps, resent as it seems the previous one is blocked, On Mon, Mar 13, 2017 at 1:07 PM, Sunil K Sahu wrote: > Could someone add me to slack channel as well. > > Thanks, > Sunil > > ​ > Sunil Kumar Sahu > ​CS > Dept - Graduate Student > ​BU - ​Watson School of

Re: Slack

I can access the channels now. Thanks ​ Sunil Kumar Sahu ​CS Dept - Graduate Student ​BU - ​Watson School of Engineering On Mon, Mar 13, 2017 at 7:03 PM, Mingmin Xu wrote: > added > > ps, resent as it seems the previous one is blocked, > > On Mon, Mar 13, 2017 at 1:07 PM,

Re: Batch loading for streaming pipelines

Thanks for the reply! We are using these pipelines to read structured log lines from Kafka and storing them in bigquery. .withMaxNumRecords() or .withMaxReadTime() aren't that useful because they do not remember how much they have read in previous run. On Mon, Mar 13, 2017 at 9:42 PM, Kenneth

Re: Batch loading for streaming pipelines

This seems like a good topic for user@ so I've moved it there (dev@ to BCC). You can get a bounded PCollection from KafkaIO via either of .withMaxNumRecords() or .withMaxReadTime(). Whether or not that will meet your use case would depend on more details of what you are computing. Periodic batch

Re: Cannot provide coder

to answer myself: I should have said I am creating the PCollection using Create.of which apparently leads to this getDefaultCoder() implementation:  CoderRegistry.getDefaultCoder(T exampleValue) which doesn't try inspecting the annotation (as opposed CoderRegistry.getDefaultCoder(Class clazz) ).

Re: Slack

Could someone add me to slack channel as well. Thanks, Sunil ​ Sunil Kumar Sahu ​CS Dept - Graduate Student ​BU - ​Watson School of Engineering On Mon, Mar 13, 2017 at 9:28 AM, Amit Sela wrote: > I'm so well trained, I do it on my phone now! > > On Mon, Mar 13, 2017,