Igor, That's exactly what we do right now.
We do the build/install, then clone that installed/upgraded system to create 5 separate upgraded instances, each instance will then run one of the libc, os, util, zfs, or zloop tests. The issue is that we don't really care about the libc, os, or util test results. We already ignore test failures in those suites, but we don't ignore infrastructure failures in those branches. Since we already don't pay attention to the results of those non-ZFS tests, I think we should turn them off, and avoid these false negatives entirely. I had originally thought this automation could be leveraged by the illumos project, in which case those other tests would have been more useful, but that idea hasn't gone anywhere, so running those other tests for the openzfs project is just a waste of time and money (IMO). Cheers. On Tue, Oct 31, 2017 at 8:31 AM, Igor Kozhukhov <[email protected]> wrote: > Hi Prakash, > > i think we can split process to: > - build > - start zfs tests && (optional) start others tests in parallel on another > instance. > > we are more interested in ZFS issues with OpenZFS PRs and others tests > just add additional overhead and time. > if you have resources and time - you can try to configure separate > instance for others tests and run it in parallel with ZFS tests. > > just proposal. > > best regards, > -Igor > > On Oct 31, 2017, at 6:02 PM, Prakash Surya <[email protected]> > wrote: > > Yes, that's due to not being able to create an AWS VM; so it's a problem > with the automation, not the code being tested. > > I've restarted the build, but the prior run passed the build and zfs test > steps, so I consider that successful. > > I may even turn off the non ZFS tests at some point, since I don't think > we get much value from running them for every PR. > > — > You are receiving this because you are subscribed to this thread. > Reply to this email directly, view it on GitHub > <https://github.com/openzfs/openzfs/pull/483#issuecomment-340790791>, or mute > the thread > <https://github.com/notifications/unsubscribe-auth/AOi0Kx0OrJWBW7BaHO1g9SUs7JJhxGrOks5sxzaQgaJpZM4QHz23> > . > > > *openzfs-developer* | Archives > <https://openzfs.topicbox.com/groups/developer/discussions/T1dada2f5266ff7f9-M08329d581c0ac255e0cbd7dc> > | Powered by Topicbox <https://topicbox.com> ------------------------------------------ openzfs-developer Archives: https://openzfs.topicbox.com/groups/developer/discussions/T1dada2f5266ff7f9-M1da862244442614520ad2e94 Powered by Topicbox: https://topicbox.com
