Re: Multimap PCollectionViews' values udpated rather than appended

2018-06-11 Thread Lukasz Cwik
Thanks for the snippet, updated BEAM-4470 with the additional details. On Mon, Jun 11, 2018 at 10:56 AM Carlos Alonso wrote: > Many thanks for your help. Actually, my use case emits the entire map > everytime, so I guess I'm good to go with discarding mode. > > This test reproduces the issue: >

Re: Multimap PCollectionViews' values udpated rather than appended

2018-06-11 Thread Carlos Alonso
Many thanks for your help. Actually, my use case emits the entire map everytime, so I guess I'm good to go with discarding mode. This test reproduces the issue:

Re: Multimap PCollectionViews' values udpated rather than appended

2018-06-04 Thread Lukasz Cwik
Carlos, can you provide a test/code snippet for the bug that shows the issue? On Mon, Jun 4, 2018 at 11:57 AM Lukasz Cwik wrote: > +dev@beam.apache.org > Note that this is likely a bug in the DirectRunner for accumulation mode, > filed: https://issues.apache.org/jira/browse/BEAM-4470 > >

Re: Multimap PCollectionViews' values udpated rather than appended

2018-06-04 Thread Lukasz Cwik
+dev@beam.apache.org Note that this is likely a bug in the DirectRunner for accumulation mode, filed: https://issues.apache.org/jira/browse/BEAM-4470 Discarding mode is meant to always be the latest firing, the issue though is that you need to emit the entire map every time. If you can do this,