Re: Reading all elements of a PCollection after running beam go pipeline

2018-05-04 Thread Henning Rohde
Great! On Fri, May 4, 2018 at 4:37 PM 8 Gianfortoni <8...@tokentransit.com> wrote: > Thanks for the workaround! That should work for me. > > On Fri, May 4, 2018, 1:51 PM Henning Rohde wrote: > >> Hey there, >> >> Until side input is fully supported, you can use GBK with a

Re: Reading all elements of a PCollection after running beam go pipeline

2018-05-04 Thread 8 Gianfortoni
Thanks for the workaround! That should work for me. On Fri, May 4, 2018, 1:51 PM Henning Rohde wrote: > Hey there, > > Until side input is fully supported, you can use GBK with a fixed key to > get all elements in a single bundle (assuming global windowing). That is > how

Re: Reading all elements of a PCollection after running beam go pipeline

2018-05-04 Thread Henning Rohde
Hey there, Until side input is fully supported, you can use GBK with a fixed key to get all elements in a single bundle (assuming global windowing). That is how textio.Write works internally to produce a single file currently:

Reading all elements of a PCollection after running beam go pipeline

2018-05-04 Thread 8 Gianfortoni
Hi dev team, I would like to be able to read the entire results of a PCollection serially after running beam. In other frameworks this is fairly straightforward, but I don't understand how one might do this with the Beam Go SDK. I guess I can read in a file that I write, but I want to be able to