On 2018-4-12 11:49 , Ryan Schmidt wrote:
> On Apr 11, 2018, at 20:47, Joshua Root wrote:
>> On 2018-4-12 10:47 , Ryan Schmidt wrote:
>>> The developer of buildbot thinks we may be able to improve buildbot's
>>> performance when there are so many pending builds, by switching to a
>>> postgresql database . I intend to do that, when I have time.
>> If switching databases would help, that would mean we're doing a lot of
>> queries in getNextBuildOnPortBuilder, which would mean
>> request.properties.getProperty involves a query. So that means we should:
>> (a) only do the queries once for each set of build requests, and
>> (b) use Deferred so the main thread isn't waiting for every query to finish.
> These performance problems predate the existence of our
> getNextBuildOnPortBuilder function.
> It smells to me like a missing database index problem. I don't know how to
> determine that though.
This thing may be of use: <https://pypi.python.org/pypi/buildbot-profiler>