Re: [OSM-talk] OSM User Testing
SteveC wrote: We need to think of some simple tasks for new users to complete, and we'll put them together over on this wiki page. Add a street? Find a mailing list? Add a point of interest? What should they do? That's up to you. At the risk of stating the really bleeding obvious, there's not an enormous amount of point doing user testing on Potlatch 1 given that development of Potlatch 2 is so far advanced. For example, two lessons you could feasibly take from P1 user testing are what the hell's with this tagging thing?, and why doesn't this map look at all like the one I had a minute ago?, both of which are of course addressed with P2. It might be possible to get some generalised issues from it, of course. But since it would be a shame to waste a promising initiative on things that have already been fixed, it might be worth concentrating on some of the other aspects of the site (like the whole lack-of-documentation what the hell do I do now thing). cheers Richard -- View this message in context: http://gis.638310.n2.nabble.com/OSM-User-Testing-tp5584505p5594367.html Sent from the General Discussion mailing list archive at Nabble.com. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [Talk-us] [OSM-talk] OSM User Testing
Hi Ya'll, There is a mapping party in North Carolina this weekend. We'll have plenty of first time users that will likely be willing to have their experience documented. I am bringing my video camera and will record their experience (if they agree) since I probably won't make the SF event. Best, Thea Clay ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [OSM-talk] OSM User Testing
On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ Steve stevecoast.com ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSM User Testing
On Thu, Sep 30, 2010 at 16:20, SteveC st...@asklater.com wrote: On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ So, a Windows only client: http://www.usertesting.com/popups/ApplicantFAQs.aspx ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSM User Testing
On Sep 30, 2010, at 10:40 AM, Ævar Arnfjörð Bjarmason wrote: On Thu, Sep 30, 2010 at 16:20, SteveC st...@asklater.com wrote: On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ So, a Windows only client: http://www.usertesting.com/popups/ApplicantFAQs.aspx Feel free to suggest something 'better' then. Steve stevecoast.com ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSM User Testing
On Thu, 30 Sep 2010 10:20:18 -0600 SteveC st...@asklater.com wrote: On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ Does anyone know this? Does it perform analysis, or is that post-capture? If it is simply recording being post-processed, the Linux- and Mac users should have their own equivalents. Yours, Morten __ Morten Juhl-Johansen Zölde-Fejér http://writtenandread.net * mor...@writtenandread.net ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [Talk-us] [OSM-talk] OSM User Testing
On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ Steve stevecoast.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] [OSM-talk] OSM User Testing
On Sep 30, 2010, at 10:40 AM, Ævar Arnfjörð Bjarmason wrote: On Thu, Sep 30, 2010 at 16:20, SteveC st...@asklater.com wrote: On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ So, a Windows only client: http://www.usertesting.com/popups/ApplicantFAQs.aspx Feel free to suggest something 'better' then. Steve stevecoast.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] [OSM-talk] OSM User Testing
I think it's great that something is being done on this. Personally I would suggest finding a few volunteers to be tested and sit in a room with them. You don't need a lot of people to find the key issues and I think you get more from seeing them do it in person and having them think out loud rather than using remote screen recording software. I've posted this before but I highly recommend this book on usability testing, Don't make me think, it's a very quick read: http://amzn.to/9A5LTz Just my few cents! On Thu, Sep 30, 2010 at 10:42 AM, SteveC st...@asklater.com wrote: On Sep 30, 2010, at 10:40 AM, Ævar Arnfjörð Bjarmason wrote: On Thu, Sep 30, 2010 at 16:20, SteveC st...@asklater.com wrote: On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ So, a Windows only client: http://www.usertesting.com/popups/ApplicantFAQs.aspx Feel free to suggest something 'better' then. Steve stevecoast.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] [OSM-talk] OSM User Testing
Will see what I can do, though not quite sure if I'll be able to make it to SF or not. But would be happy to find some volunteers and do a few usability tests in Denver before then, and record them so others can see them (in SF or wherever). Obviously would be good to have some scenarios worked out on the wiki before doing that. Incidentally, I summarized what I think are some of the key points from the Don't make me think book (and my general experience) on usability, with some geo-examples, in a recent 5 minute talk at Ignite NoCo (Northern Colorado), in case anyone is interested: http://vimeo.com/15015261 On Thu, Sep 30, 2010 at 10:54 AM, SteveC st...@asklater.com wrote: sounds like you should join us in SF! On Sep 30, 2010, at 10:52 AM, Peter Batty wrote: I think it's great that something is being done on this. Personally I would suggest finding a few volunteers to be tested and sit in a room with them. You don't need a lot of people to find the key issues and I think you get more from seeing them do it in person and having them think out loud rather than using remote screen recording software. I've posted this before but I highly recommend this book on usability testing, Don't make me think, it's a very quick read: http://amzn.to/9A5LTz Just my few cents! On Thu, Sep 30, 2010 at 10:42 AM, SteveC st...@asklater.com wrote: On Sep 30, 2010, at 10:40 AM, Ævar Arnfjörð Bjarmason wrote: On Thu, Sep 30, 2010 at 16:20, SteveC st...@asklater.com wrote: On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ So, a Windows only client: http://www.usertesting.com/popups/ApplicantFAQs.aspx Feel free to suggest something 'better' then. Steve stevecoast.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us Steve stevecoast.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] [OSM-talk] OSM User Testing
Peter, If you are able to do some tests in Denver I would like to help. Leslie From: Peter Batty pe...@ebatty.com To: SteveC st...@asklater.com Cc: OSM-talk Openstreetmap t...@openstreetmap.org; Ævar Arnfjörð Bjarmason ava...@gmail.com; talk...@openstreetmap.orgopenstreetmap Openstreetmap talk-us@openstreetmap.org Sent: Thu, September 30, 2010 1:07:42 PM Subject: Re: [Talk-us] [OSM-talk] OSM User Testing Will see what I can do, though not quite sure if I'll be able to make it to SF or not. But would be happy to find some volunteers and do a few usability tests in Denver before then, and record them so others can see them (in SF or wherever). Obviously would be good to have some scenarios worked out on the wiki before doing that. Incidentally, I summarized what I think are some of the key points from the Don't make me think book (and my general experience) on usability, with some geo-examples, in a recent 5 minute talk at Ignite NoCo (Northern Colorado), in case anyone is interested: http://vimeo.com/15015261 On Thu, Sep 30, 2010 at 10:54 AM, SteveC st...@asklater.com wrote: sounds like you should join us in SF! On Sep 30, 2010, at 10:52 AM, Peter Batty wrote: I think it's great that something is being done on this. Personally I would suggest finding a few volunteers to be tested and sit in a room with them. You don't need a lot of people to find the key issues and I think you get more from seeing them do it in person and having them think out loud rather than using remote screen recording software. I've posted this before but I highly recommend this book on usability testing, Don't make me think, it's a very quick read: http://amzn.to/9A5LTz Just my few cents! On Thu, Sep 30, 2010 at 10:42 AM, SteveC st...@asklater.com wrote: On Sep 30, 2010, at 10:40 AM, Ævar Arnfjörð Bjarmason wrote: On Thu, Sep 30, 2010 at 16:20, SteveC st...@asklater.com wrote: On Sep 29, 2010, at 11:27 AM, Ævar Arnfjörð Bjarmason wrote: On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? I believe it is http://www.usertesting.com/ So, a Windows only client: http://www.usertesting.com/popups/ApplicantFAQs.aspx Feel free to suggest something 'better' then. Steve stevecoast.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us Steve stevecoast.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
[OSM-talk] OSM User Testing
I've written previously about OSM usability studies, and now it's happening. Nate Bolt from the fantabulous Bolt|Peters is going to help OSM run usability tests and we need your help. The timeline looks something like this: This week or next we're going to switch on some javascript on the OSM signup page that invites a percentage of signups to help OSM run a user survey. Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. We need to think of some simple tasks for new users to complete, and we'll put them together over on this wiki page. Add a street? Find a mailing list? Add a point of interest? What should they do? That's up to you. Also, if you're running a mapping party we can give you a super secret link where you can send new users to do the same tasks with screen recording. You mustn't help them on the first go, as that's exactly what we're trying to find out - what goes wrong. Then on December 8th (tentative) at the Bolt|Peters office in San Francisco, OSMers together with the UX wizards will analyze the videos and make some joint suggestions on how to push things forward. Anyone in SF, or can be in SF around then, please drop me a mail.___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSM User Testing
We need to think of some simple tasks for new users to complete, and we'll put them together over on this wiki page. Add a street? This sort of study will be interesting to see. Adding a street today must be daunting for the newbie.Despite the lure of the open road - blank areas where roads from new subdivisions have never been created, I've never seen a new user pop up and add the streets from their own subdivision. But I have seen people pop up and make single corrections to that evil, community-killing TIGER import - corrections such as breaking a through street that was never connected, or aligning a road.People are now aware of missing streets since the navigation apps use OSM; I see many Skobbler reports of missing streets. Hopefully the end result of this study is that we'll understand how to engage the newbies to help contribute.Other than that, the TIGER 2010 data will provide most of the missing streets in the US, and entered by the core users in the US. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] OSM User Testing
On Wed, Sep 29, 2010 at 15:34, SteveC st...@asklater.com wrote: Those people fill out a form and are invited later to use some simple online screen capturing software while asked to do some simple tasks and this is where you come in. What screen capturing software package is it? ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
