Re: Regarding Beam Slack Channel

[Jean-Baptiste Onofré]

Hi,

you should have received the invite.

Welcome aboard !

Regards
JB

On 01/04/2018 12:54 AM, Maria Tjahjadi wrote:

Hi,

Could I join also?

Thanks,
Maria Tjahjadi

On 4 Jan 2018, at 06.15, Lukasz Cwik > wrote:



Invite sent, welcome.

On Wed, Jan 3, 2018 at 3:01 PM, Carlos Alonso > wrote:


Hi, I'd like to be added too, please!

Thanks!

On Tue, Dec 19, 2017 at 3:41 PM Jean-Baptiste Onofré > wrote:

Done,

you should have received an invite.

Regards
JB

On 12/19/2017 03:20 PM, Unais T wrote:
> Hello
>
> Can someone please add me to the Beam slack channel?
>
> Thanks.
>
>

--
Jean-Baptiste Onofré
jbono...@apache.org 
http://blog.nanthrax.net
Talend - http://www.talend.com




--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Re: Regarding Beam Slack Channel

[Maria Tjahjadi]

Hi,

Could I join also?

Thanks,
Maria Tjahjadi

> On 4 Jan 2018, at 06.15, Lukasz Cwik  wrote:
> 
> Invite sent, welcome.
> 
>> On Wed, Jan 3, 2018 at 3:01 PM, Carlos Alonso  wrote:
>> Hi, I'd like to be added too, please!
>> 
>> Thanks!
>> 
>>> On Tue, Dec 19, 2017 at 3:41 PM Jean-Baptiste Onofré  
>>> wrote:
>>> Done,
>>> 
>>> you should have received an invite.
>>> 
>>> Regards
>>> JB
>>> 
>>> On 12/19/2017 03:20 PM, Unais T wrote:
>>> > Hello
>>> >
>>> > Can someone please add me to the Beam slack channel?
>>> >
>>> > Thanks.
>>> >
>>> >
>>> 
>>> --
>>> Jean-Baptiste Onofré
>>> jbono...@apache.org
>>> http://blog.nanthrax.net
>>> Talend - http://www.talend.com
> 

Re: Regarding Beam Slack Channel

[Lukasz Cwik]

Invite sent, welcome.

On Wed, Jan 3, 2018 at 3:01 PM, Carlos Alonso  wrote:

> Hi, I'd like to be added too, please!
>
> Thanks!
>
> On Tue, Dec 19, 2017 at 3:41 PM Jean-Baptiste Onofré 
> wrote:
>
>> Done,
>>
>> you should have received an invite.
>>
>> Regards
>> JB
>>
>> On 12/19/2017 03:20 PM, Unais T wrote:
>> > Hello
>> >
>> > Can someone please add me to the Beam slack channel?
>> >
>> > Thanks.
>> >
>> >
>>
>> --
>> Jean-Baptiste Onofré
>> jbono...@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
>

Data guarantees PubSub to GCS

[Andrew Jones]

Hi,

I'd like to confirm Beams data guarantees when used with Google Cloud PubSub 
and Cloud Storage and running on Dataflow. I can't find any explicit 
documentation on it.

If the Beam job is running successfully, then I believe all data will be 
delivered to GCS at least once. If I stop the job with 'Drain', then any 
inflight data will be processed and saved.

What happens if the Beam job is not running successfully, and maybe throwing 
exceptions? Will the data still be available in PubSub when I cancel (not 
drain) the job? Does a drain work successfully if the data cannot be written to 
GCS because of the exceptions?

Thanks,
Andrew