Hi everyone, (Addendum :) I think that if your performance problem isn't CPU bound, you can try to spawn multiple ESOutputs (it would require some work with partitioning of these message outputs) in config and measure if it helps. I can't verify that because i'm during my office hours (I can't setup heka here), but i'll try to check this later.
On Fri, May 8, 2015 at 4:12 AM, Jarek Śmiejczak <[email protected]> wrote: > Hi Mathieu, > > I've done some tests today (with profiling) and with heka-flood with > profiling and it looks like encoders had big impact on performance (in my > case). > I've tried to change some settings. I noticed performance gain after I've > removed some of "fields" passed to document (especially fields related > decoded json object). > And i think that's the area (encoding&output) you should look into. Have > you tried to use bulk inserts or different encoder? They could be faster. > > Also you could also try to catch Rob/Michael @irc. > > On Thu, May 7, 2015 at 6:15 PM, Mathieu Chouquet-Stringer < > [email protected]> wrote: > >> On Thu, May 07, 2015 at 03:53:55PM +0200, Jarek Śmiejczak wrote: >> > I've meant: https://github.com/mozilla-services/heka/issues/1484 >> > Unfortunately i'm a little busy and i can't verify source of this >> bug. >> > I'll try to debug it later, but probably @trink and @rafrombrc will >> be >> > faster. >> >> Well it's true, I've experienced the "can't send to ElasticSearch >> anymore" after the latter had failed but my performance issue doesn't >> look like the description of the bug because I'm never blocked forever. >> >> -- >> Mathieu Chouquet-Stringer [email protected] >> The sun itself sees not till heaven clears. >> -- William Shakespeare -- >> > > > > -- > jarek@reijutsu:~$ fortune > You have Egyptian flu: you're going to be a mummy. > jarek@reijutsu:~$ fortune > You now have Asian Flu. > -- jarek@reijutsu:~$ fortune You have Egyptian flu: you're going to be a mummy. jarek@reijutsu:~$ fortune You now have Asian Flu.
_______________________________________________ Heka mailing list [email protected] https://mail.mozilla.org/listinfo/heka
