Hi Stefan, On Mon, Jun 25, 2012 at 1:33 AM, [email protected] <[email protected]> wrote: >> How will this scale? I will also have spare machines to dedicate to >> this, once I get my new laptop. >> >> I think the idea behind sympy-bot work is that the app-engine server >> would keep track of what needs to be tested and distribute the work so >> that there is no duplication. > > I may be wrong, but I think that Certik actually wants the duplication > so more architectures are tested.
Right. Btw, my first name is Ondrej. :) > > And if we actually do not want duplication, the easiest solution is > just to leave one single computer doing all the tests - the PR number > is low enough for one computer to handle them all even if it is > testing numerous configurations. I do not think it is worth it to make > sympy-bot any smarter. If Travis can do everything that we need, I am certainly ok to only use Travis. They will eventually update the Python to support "-R", so that's not a big deal. Based on our discussions, it seems that we really don't need to test various platforms as long as we use randomized hashing. My intuition tells me that there will be occasions to use sympy-bot, for example right now the "-R" testing, after Travis supports it, maybe some customized testing. It'd be nice if most of the complexity can be managed by the web app, and then the sympy-bot can stay "simple stupid". And I don't think it's that much work, but I don't have time for it at the moment. So I'll leave it as it is for now, I am personally very happy with Travis, and we'll see how it goes. However, I have a big problem with the randomized hashes. Our current status is that we can only pass tests without randomizing the hash. As such, at the moment, this is the only way that we can tell whether some pull request breaks something or not. So before we fix sympy, we should keep our main test runner (Travis) with a definite seed for the hashes. At the moment, your buildbot is running randomized hashes and so it almost always fails. This is useful for fixing sympy to actually work with randomized hashes, but the failures usually have nothing to do with the pull request at hand, and as such when working on a particular pull request (and not on fixing hash bugs), it's not very useful. So our main test running should not use random hashes, so that we can make sure that all tests actually pass on at least some configuration. Ondrej -- You received this message because you are subscribed to the Google Groups "sympy" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/sympy?hl=en.
