Re: Go block starvation issue

2019-04-13 Thread Chris Nuernberger
Very cool! If you are at the level where using into with http headers is a hotspot then you really are getting pretty good perf already. At the language level have you seen: https://github.com/lacuna/bifurcan/blob/master/doc/comparison.md This may help eek a bit more perf out of some specific s

Re: Go block starvation issue

2019-04-12 Thread Ricardo Mayerhofer
Hi Chris, Thank you very much for the thoughtful answer! We've been profiling CPU usage, most time currently is used in hard to optimize operations such as into (which in turn calls reduce) e.g.: https://github.com/B2W-BIT/restQL-clojure/blob/f473ddb1dcd30704764bf64b7f88eff27391aa76/src/main/re

Re: Go block starvation issue

2019-04-12 Thread Chris Nuernberger
Given the nature of the problem I would wonder why the cpu usage is high. restQL seems to be mostly a passthrough entity completely dependent upon IO so there may be something spinning or a pmap somewhere there should not be. - jstacktrace may offer insight here. If nothing is out of whack in

Go block starvation issue

2019-04-12 Thread Ricardo Mayerhofer
We're investigating a starvation issue in restQL ( https://github.com/B2W-BIT/restQL-http) under heavy load. We make heavy use of core.async, all I/O is non-blocking, we use Aleph as http server and client. The symptom is that it takes a long time for the first line of go routine to execute. e.