Before every release I test all the compute providers I have credentials for. Here is a summary of the live tests results I've run:
rackspace-cloudqueues-us: Tests run: 32, Failures: 0, Errors: 0, Skipped: 0 rackspace-cloudservers-us: Tests run: 145, Failures: 10, Errors: 0, Skipped: 0 cloudsigma2-lvs - Tests run: 50, Failures: 0, Errors: 0, Skipped: 0 digitalocean: Tests run: 53, Failures: 0, Errors: 0, Skipped: 0 enterprisechef: Tests run: 47, Failures: 0, Errors: 0, Skipped: 0 chef11: Tests run: 50, Failures: 0, Errors: 0, Skipped: 0 chef10: Tests run: 50, Failures: 0, Errors: 0, Skipped: 0 joyent provider is out of date and we should consider removing it. hpcloud-compute just launched a new offering with a new version, which is the default for new accounts. I've created an account and I've been able to use the compute service (by manually setting the api version to "2" when creating the context), but many live tests are failing for me due to floating ip and region issues (regions are different for old and new accounts). We should give some love to the new version and try to keep it up to date. I don't have an AWS account so I haven't been able to live test it. I agree with Gaul that we *must* be more serious with the live tests, at least when releasing. On 13 March 2014 18:01, Andrew Gaul <[email protected]> wrote: > The README.md quality section caught my eye in a recent commit. I test > the major blobstore providers before each release but I do not believe > we have good coverage of the compute live tests. Can someone comment on > the state of the world there? > > On Thu, Mar 13, 2014 at 01:27:46PM +0000, [email protected] wrote: >> Repository: jclouds >> Updated Branches: >> refs/heads/master 8dafeacfe -> b444886c5 >> >> >> Updating the features section to match the website >> >> >> Project: http://git-wip-us.apache.org/repos/asf/jclouds/repo >> Commit: http://git-wip-us.apache.org/repos/asf/jclouds/commit/b444886c >> Tree: http://git-wip-us.apache.org/repos/asf/jclouds/tree/b444886c >> Diff: http://git-wip-us.apache.org/repos/asf/jclouds/diff/b444886c >> >> Branch: refs/heads/master >> Commit: b444886c5c2a34f4e751066b38b24b1dcaa3f57c >> Parents: 8dafeac >> Author: Roman C. Coedo <[email protected]> >> Authored: Thu Mar 13 08:53:48 2014 +0100 >> Committer: Ignasi Barrera <[email protected]> >> Committed: Thu Mar 13 14:27:21 2014 +0100 >> >> ---------------------------------------------------------------------- >> README.md | 17 +++++++---------- >> 1 file changed, 7 insertions(+), 10 deletions(-) >> ---------------------------------------------------------------------- >> >> >> http://git-wip-us.apache.org/repos/asf/jclouds/blob/b444886c/README.md >> ---------------------------------------------------------------------- >> diff --git a/README.md b/README.md >> index 96f5248..0e7f40b 100644 >> --- a/README.md >> +++ b/README.md >> >> * QUALITY >> -We test every provider with live scenarios before each release. If it >> doesn't pass, the provider goes into the sandbox. >> - >> +Every provider is tested with live scenarios before each release. If the >> provider doesn't pass, it goes back into the sandbox. > > -- > Andrew Gaul > http://gaul.org/
