We are dealing with 6000 messages per second. Of a considerable size ( up to 30M) We need to use the bulk API. Also fail over must work smoothly.
But perhaps that it is all possible. Regards Hans On Tue, Jan 18, 2022, 18:26 Dan <[email protected]> wrote: > Out of curiosity, could you not just use the API directly? It's a > possibility anyway! > > On Tue, 18 Jan 2022 at 17:21, Hans Van Akelyen <[email protected]> > wrote: > >> Hi Hans-Peter, >> >> The Beam API has Elasticsearch support (version 7.9.2) so we could add it. >> I have created a jira case for you to implement these Read and Write >> Transforms [1]. >> >> Feel free to create tickets for any features you would like to have or >> need to make your project successful. >> >> Kind regards, >> Hans >> >> [1] https://issues.apache.org/jira/browse/HOP-3690 >> >
