Thanks for your prompt response!

> That's an interesting idea. It is not implemented right now. We have a
similar bug that explores this idea already
https://bugs.launchpad.net/plainbox/+bug/1232029

That bug report looks good. Is plainbox the backend for checkbox? I'm
unfamiliar with it.

> We do that. You should have seen a prompt if you want to 'resume',
'continue' or 'restart' (those are quite confusing) did you see that
after restarting checkbox?

Yes, I did see that box. I clicked "continue", as I deliberately wanted
to skip the suspend tests. It started a microphone test, if I recall
correctly, and then ran the suspend tests again, causing my computer to
crash. I'll upload a log later tonight if I get other things off my
plate first. The bug isn't that the dialog failed to appear, the bug is
that it failed to skip a test that had previously caused my computer to
crash, even though I chose "continue" instead of "rerun last test".

> I don't think we need to upload results before every dangerous test.
We try very hard to save everything on the filesystem before running
each job so that if it crashes you should still be safe.

Yes, but how do you know how many users never even try to run Checkbox
again? Just because the data is saved on disk doesn't mean it will get
uploaded. How do you know how many users give up before completing the
process? My intuition says that a significant proportion do. There's a
vast amount of UX materiel out there that examines form completion rates
on the web. On the web, this stuff is measured, and you would be
surprised how even tiny things put people off from completing a form.

My proposal is simply to start measuring this by uploading every result
as you go along, rather than assuming that the majority of users finish
the process.

Given that users are more likely to finish the process if nothing
crashes, the fact that data isn't being uploaded in increments means
that the received data is skewed towards test passes.

Thinking about, this really is two bugs in one report, so let me know if
I should file each one separately.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1319397

Title:
  checkbox does not recover well from a suspend crash

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/checkbox/+bug/1319397/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to