Re: ElasticSearch with RestHighLevelClient

2017-10-25 Thread Ryan Bobko
Hi Etienne, That was just the hint I needed! Until Beam 2.2 is released, my solution is to keep a handle to the low level client, and close that in the teardown method. This seems to solve the threading issue. ry On Wed, Oct 25, 2017 at 6:09 AM, Etienne Chauchot wrote: >

Re: Infinite retry in streaming - is there a workaround?

2017-10-25 Thread Aleksandr
Hello Derek, There no general solution for failing bundle. Some kind of dataflow errors you can fix using dataflow update feature. Another solution is to catch exceptions in ParDo function. 25. okt 2017 9:42 PM kirjutas kuupƤeval "Griselda Cuevas" : Hi Derek, yes you can use

Re: Infinite retry in streaming - is there a workaround?

2017-10-25 Thread Griselda Cuevas
Hi Derek, yes you can use that mailing list and also the SO channel. Cheers, G > BTW, do you know if there's a Dataflow mailing list for questions like > this? Would dataflow-feedback be the appropriate mailing list? > > Thanks, > > Derek > > On Wed, Oct 25, 2017 at 10:58 AM, Griselda Cuevas

Re: Infinite retry in streaming - is there a workaround?

2017-10-25 Thread Derek Hao Hu
Aha, I just realized this is just a Dataflow behavior not a Beam default behavior. :) Thanks Griselda. I'll post in the SO channel. BTW, do you know if there's a Dataflow mailing list for questions like this? Would dataflow-feedback be the appropriate mailing list? Thanks, Derek On Wed, Oct

Re: Infinite retry in streaming - is there a workaround?

2017-10-25 Thread Griselda Cuevas
Hi Derek - It sounds like this is a Dataflow specific questions so I'd recommend you also reach out through the Dataflow's Stack Overflow channel. I'm also cc'ing Thomas Groh who might be able to help. On 20 October 2017 at

Re: ElasticSearch with RestHighLevelClient

2017-10-25 Thread Etienne Chauchot
Hi, We have used the low level rest client for the ElasticsearchIO despite the fact that there is now the high level client for maintenance reasons. Indeed, the IO production code is common to all Elasticsearch versions because the low level Rest client is compatible with all ES versions.