Hi Mathieu, I've done some tests today (with profiling) and with heka-flood with profiling and it looks like encoders had big impact on performance (in my case). I've tried to change some settings. I noticed performance gain after I've removed some of "fields" passed to document (especially fields related decoded json object). And i think that's the area (encoding&output) you should look into. Have you tried to use bulk inserts or different encoder? They could be faster.
Also you could also try to catch Rob/Michael @irc. On Thu, May 7, 2015 at 6:15 PM, Mathieu Chouquet-Stringer <[email protected] > wrote: > On Thu, May 07, 2015 at 03:53:55PM +0200, Jarek Śmiejczak wrote: > > I've meant: https://github.com/mozilla-services/heka/issues/1484 > > Unfortunately i'm a little busy and i can't verify source of this bug. > > I'll try to debug it later, but probably @trink and @rafrombrc will be > > faster. > > Well it's true, I've experienced the "can't send to ElasticSearch > anymore" after the latter had failed but my performance issue doesn't > look like the description of the bug because I'm never blocked forever. > > -- > Mathieu Chouquet-Stringer [email protected] > The sun itself sees not till heaven clears. > -- William Shakespeare -- > -- jarek@reijutsu:~$ fortune You have Egyptian flu: you're going to be a mummy. jarek@reijutsu:~$ fortune You now have Asian Flu.
_______________________________________________ Heka mailing list [email protected] https://mail.mozilla.org/listinfo/heka
