Re: [HOT] Validators [was: COVID-19 For The Long Haul]
I wonder if it would be possible to "validate" in real time. Some method that a validator could watch as the mapper did their thing, and make suggestions as they went? Then it becomes both training and validation simultaneously. Obviously it would have to be on a consent basis from the mapper, ie they would have to opt in when they started and a validator would have to be available. Otherwise, it seems like it would be better just to make the correction and maybe have it send a message to the mapper about what got changed.Bryan Sayer Original message From: john whelan Date: 04/24/2020 9:43 AM (GMT-05:00) To: Jean-Marc Liotier Cc: "HOT@OSM (Humanitarian OpenStreetMap Team)" Subject: Re: [HOT] Validators [was: COVID-19 For The Long Haul] What I found when validating HOT tasks was that if I provided feedback that wasn't too negative on the task "ie the african highway wiki suggests that this type of highway should be mapped thus: with a link and reference to the wiki rather than you done it wrong" then the mapper would go on to do far more tiles and do them correctly, but it had to be done very shortly after the mapper had mapped. So I'd sit on a project and immediately validate the tiles as they were done. It took considerable time and effort on my part to do this. I also noticed some validation was done by inexperienced mappers who were invalidating tiles for correctly mapped highways etc. One that comes to mind was project manager who invalidated a tile for a highway that had been correctly mapped in OSM before the project started on the grounds that mapping highways was not part of the project.However what I noticed as Jean-Marc has commented was that much of the mapping problems were from mappers who hadn't completed the tile and their feedback wasn't immediate. Feedback sent to them was basically ignored 99% of the time.A couple of things happened. The task manager changed and I could no longer find the last tile mapped. Response tails off over time. Within the hour 80% response, within a day 50% response, a week 2% response. Validating a tile a week later meant the feedback didn't reach the mapper immediately. Second I'd no idea if the mapper had corrected their problems later or not. So the mapper might get half a dozen messages for tiles they had mapped sometime ago and they had already changed their mapping practices. This is not positive feedback. The second thing was the projects wanted buildings. I'd already noticed that some buildings were being mapped two or three times. Validating a building? Well it takes me 2 or 3 mouse clicks to map one in JOSM with the building tool, building=yes. iD takes more clicks. To correct an incorrect building takes more effort than to map it correctly in the first place. Someone was kind enough to build me a script in JOSM that detects duplicate buildings. I'm not going to validate work when it takes longer to validate than to do it correctly in the first place.Then it gets interesting. The JOSM validation tools have improved. These days I can grab about a tenth of an African country at a time. It takes 16 gigs of memory and JOSM has to be set up correctly but it works. The duplicate building script now will detect duplicate buildings over one tenth of the country not just a tiny tile. JOSM validation and the todo list are very powerful for picking up crossing highways, other errors and doubtful tagging.These days there are more automated approaches to picking up errors in mapping. Both Jean-Marc and myself fix multiple errors by HOT mappers. I must confess that if the error was made four years ago on a HOT project by a mapper who has made four edits and the mapper hasn't mapped for four years I might even correct the error without a changeset comment.I worked with the training group to identify the most common errors, I understand that training for project managers and validators has improved and projects no longer ask new mappers for complex mapping.I understand that validation can help new mappers and get projects completed more quickly but I also understand it takes a lot of time and effort on behalf of the validators to do it right.Cheerio JohnOn Fri, 24 Apr 2020 at 07:06, Jean-Marc Liotier wrote:On 4/24/20 12:26 PM, Russell Deffner wrote: > Especially crucial are our Validators! With so many projects in so > many locations, it will be a monumental task to keep up on validation. > If you have the role, please leave the mapping to the newer > contributors and help us keep our quality up and give instructions to > mappers as soon as possible. What happens when tasks are invalidated ? In theory the errant contributor welcomes constructive feedback, fixes his contribution and mends his ways. How often does that happen in practice ? I almost (there are a few happy exceptions of growing contributors) never receive answers to changeset comments,
Re: [HOT] weeklyOSM #458 2019-04-23-2019-04-29
I am suddenly getting your messages twice. Perchance do you have blsli...@gmail.com in the distribution list twice?Bryan Sayer Original message From: weeklyteam Date: 05/04/2019 1:27 PM (GMT-05:00) To: hot@openstreetmap.org Subject: [HOT] weeklyOSM #458 2019-04-23-2019-04-29 The weekly round-up of OSM news, issue # 458,is now available online in English, giving as always a summary of all things happening in the openstreetmap world: http://www.weeklyosm.eu/en/archives/11987/Enjoy! Did you know that you can also submit messages for the weeklyOSM? Just log in to https://osmbc.openstreetmap.de/login with your OSM account. Read more about how to write a post here: http://www.weeklyosm.eu/this-news-should-be-in-weeklyosm weeklyOSM? who: https://wiki.openstreetmap.org/wiki/WeeklyOSM#Available_Languages where?: https://umap.openstreetmap.fr/en/map/weeklyosm-is-currently-produced-in_56718#2/8.6/108.3___HOT mailing listHOT@openstreetmap.orghttps://lists.openstreetmap.org/listinfo/hot___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot
Re: [HOT] "Combined with satellite data, recently made public, they can now ..."
Interesting. Maybe contact the authors and ask what they are referring to regarding satellite imagery? It might be a generic statement regarding all satellite imagery that is available. Bryan Sayer Original message From: Bjoern Hassler Date: 07/21/2018 8:42 AM (GMT-05:00) To: hot Subject: [HOT] "Combined with satellite data, recently made public, they can now ..." Hello all, this article in the Guardian:https://www.theguardian.com/global-development/2018/jul/16/buzzwords-crazes-broken-aid-system-poverty has this somewhat enigmatic sentence in it: ""Combined with satellite data, recently made public, they can now ..." Any idea what this "satellite data, recently made public" might be? The article doesn't provide a country or context, or what type of data. Any thoughts? Many thanks!Bjoern ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot
Re: [HOT] Why the HOT obsession with low quality buildings in Africa ?
I concur with the points made by Jean-Marc Liotier. As Deming said in the 50's, it is important to build quality into the process, not depend on checks after the fact. Along those lines, I still think that we could have an AI program do a big part of the initial mapping. Bryan Sayer Original message From: Jean-Marc Liotier Date: 07/02/2018 10:58 AM (GMT-05:00) To: AMEGAYIBO Kokou ELolo Cc: t...@openstreetmap.org, hot@openstreetmap.org Subject: Re: [HOT] Why the HOT obsession with low quality buildings in Africa ? On Mon, July 2, 2018 11:55 am, AMEGAYIBO Kokou ELolo wrote: > > The majority of these tasks were created in training workshops on > OpenStreetMap in Bamako, quality control work is done afterwards by the > local community normally. I share your points of view, but for training > workshops it is our best method to channel, control the work of the > newbies and also familiarize them with the use of the Tasking Manager. > I am open to any contribution who can help us improving our approach. I understand the difficulty of getting large numbers of new contributors started with Openstreetmap - mistakes are normal and must be accepted as a cost of growing the project. Nevertheless, I think that there are ways to keep that cost lower. First, and most important, I believe that quality control should not be relegated to "done afterwards" - especially with less proficient contributors who are most likely to make mistakes, and especially if they are enthusiastic (it pains me to see incredible dedication in go to waste). Quality control must be an integral part of the contribution and that must be drilled into new contributors as early as possible. Insist on using the JOSM Validator, have the users look at their own contributions on Osmose... Show them how to be more responsible of their own work ! Or course, having experienced users supervise is valuable but they are a scarce resource and most importantly they risk infantilizing less experienced contributors. Most of my own contributions start with looking at Osmose, seeing a bunch of errors and I start editing there... Quality control is a core skill for everyone, at every level of proficiency. Second, have users. Creating data costs, maintaining it costs... Why are we doing it ? We are doing it for users. How do we judge quality ? I am as fond of the map as an aesthetic object as anyone here but we all agree that we want to put our efforts to good uses - so we judge quality by the fitness of the product for a particular use. If the data has no users, it is dead data. For example, as a user, I am a walker and a cyclist - I enjoy buildings on the map as landmarks to help me navigate... That is my personal way of judging quality - but other users may have other ways: to some users the purpose of having buildings in Openstreetmap may just be "there is a building here and its shape is not that important" - and maybe those users are the majority, who knows ? So, as a producer of data, be aware of how the data is used - that is the key to rational quality control. That remains true if you just chose the buildings as a new contributor training object. Third, make sure that the most recent imagery of decent quality is used. For the specific case of Bamako and at the current time, ESRI World is better than Bing: https://i.imgur.com/w6YBG70.jpg - of course, this is subject to change over time. In understand that, for lack of available properly surveyed geodesic reference points, large numbers of users working with multiple sources of imagery generates its own challenges (I found that particularly frustrating in Dakar's suburbs). ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot
Re: [HOT] Using AI for mapping from images
Fascinating! I figured any AI results would need to be reviewed by humans. Bryan Sayer Original message From: Daniel O'Connor <daniel.ocon...@gmail.com> Date: 04/16/2018 4:07 AM (GMT-05:00) To: Lists <blsli...@gmail.com> Cc: HOT <hot@openstreetmap.org> Subject: Re: [HOT] Using AI for mapping from images Indeed it has, both in general and specific to OSM https://developmentseed.org/blog/2017/01/30/machine-learning-learnings/ https://wiki.openstreetmap.org/wiki/AI-Assisted_Road_Tracing The consensus seems to be 'AI assisted'; rather than '100% AI' is better On Mon, 16 Apr. 2018, 12:37 pm Lists, <blsli...@gmail.com> wrote: I confess that I have not looked closely at the mapping of satellite images, but I have been wondering if it is possible to accomplish much of the mapping using artificial intelligence and deep learning. Has this been looked into? Bryan Sayer ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot
[HOT] Using AI for mapping from images
I confess that I have not looked closely at the mapping of satellite images, but I have been wondering if it is possible to accomplish much of the mapping using artificial intelligence and deep learning. Has this been looked into? Bryan Sayer ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot
[HOT] Immediate 17-month full-time opportunity in international household survey work on gridded sampling
Nice opportunity for someone with mapping and sampling experience. Grid sampling makes heavy use of maps. Bryan Sayer Describes an interesting (and immediate) 17-month full-time job opportunity for someone who has a UK/EU visa and flexibility to travel internationally to come up to speed on gridded sampling techniques and help pilot those methods in realistic settings and to develop & deliver appropriate training materials. Longer lead-in: I am joining some work in an interesting area with Dana Thomson and the GridSample.org team at www.flowminder.org. and we need some help. Household surveys play an important role in health/welfare/program monitoring and evaluation in low- and middle-income countries. The standard design is a multi-stage stratified cluster survey where primary sampling units (PSUs) are selected from a census-based list of enumeration areas (EAs) and the probability of selection is proportional to a measure of estimated EA size. In many cases the information about cluster size is no longer current, so the selection probabilities and therefore the first stage survey weights are "off" and those errors are only partially redeemed later in the survey process. There's some interesting work in building gridded datasets with updated population estimates, which are seeded with census data and updated with more recent data sources, like assessment of night-time lights from satellite imagery and cell-phone activity from de-identified datasets. There is growing interest in identifying survey settings where it makes sense to select PSUs from a gridded population dataset INSTEAD of the census frame (or maybe use one to augment the other). This posting describes an interesting (and immediate) 17-month full-time job opportunity for someone who has a UK/EU visa and flexibility to travel internationally to come up to speed on the gridded sampling techniques and help pilot the methods in realistic settings and to develop & deliver appropriate training materials. If you have detailed questions, please write to dana.r.thom...@gmail.com. We re-titled the position "Survey Practitioner (GridSample Project)" to clarify that the right candidate is not necessarily a specialist in gridded population sampling methods (yet). The right candidate very likely has exclusive experience with traditional cluster surveys. This position is well-supported with extensive opportunity to learn and grow. Personalized mentorship from the GridSample Manager on gridded population sampling methods will be provided, and the Flowminder/WorldPop team provides a rich survey community-of-practice. Gridded population sampling methods are emerging, and as a result, this position is ripe with opportunity for creative problem-solving and input, allowing the candidate to establish themselves as an expert and innovator in this new field. We are interested in candidates who are passionate about social equity. This project was born from the belief that the needs of everyone, including the poorest, must be accurately measured to be effectively addressed. I have heard from a number of qualified candidates who do not hold a UK/EU passport/visa. The UK/EU requirement is because Flowminder Foundation is not yet in a position to sponsor UK visas (we are actively working on this). We strongly encourage interested non-UK/EU candidates to apply because gridded population sampling is a rapidly evolving field, and when new opportunities emerge, we will come back to this pool of candidates. == Role: Survey Practioniter (GridSample Project) Job No: GS0218 Location: Southampton, UK Duration: Fixed term contract (17 months, full time) Start date: 3 April 2018 Salary: £45,180 Reporting to: GridSample Manager == The Flowminder Foundation has an exciting opportunity for a survey practitioner to play a key role in a Gates Foundation-funded gridded population survey evaluation in Nigeria, and develop foundational training materials for the emerging field of gridded population sampling. Flowminder is a unique, startup-like non-profit that develops advanced technological solutions to address humanitarian problems. Our work is an exciting blend of software development, data analytics, academic research, and international development, that takes place in a dynamic and highly collaborative environment. == About GridSample.org Gridded population survey sampling is an emerging method, used most often when census data is outdated or inaccurate. Survey teams also consider gridded population sampling to perform spatial+population sampling and to select sampling areas that are smaller or larger than standard census sampling units. The GridSample R algorithm or web tool have been
Re: [HOT] Centre for Humanitarian Data - Data Fellows
I agree, and the predictive analytics fellowship should have a great opportunity for use of map data combined with other humanitarian data for modelling and prediction. Bryan Sayer Original message From: Tyler RadfordDate: 03/13/2018 7:54 PM (GMT-05:00) To: hot Subject: [HOT] Centre for Humanitarian Data - Data Fellows Hi, it would be wonderful if HOT community members apply: https://centre.humdata.org/data-fellows/ Tyler RadfordExecutive directortyler.radf...@hotosm.org@TylerSRadford Humanitarian OpenStreetMap TeamUsing OpenStreetMap for Humanitarian Response & Economic Developmentweb | twitter | facebook | donate ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot
Re: [HOT] Using a pen tablet for mapping input
Thanks everyone! This is exactly what I wanted to know. I'm thinking that a pen and tablet will be easier for me to control. And I am also trying to get away from Windoze. Bryan Sayer Original message From: Julio Costa Zambelli <julio.co...@openstreetmap.cl> Date: 03/14/2018 9:07 AM (GMT-05:00) To: Lists <blsli...@gmail.com> Cc: hot <hot@openstreetmap.org> Subject: Re: [HOT] Using a pen tablet for mapping input I have been using a Wacom Intuos CTL-490 (probably the cheapest Wacom available, around USD110 here) combined with JOSM and its FastDraw plugin for over a year now. All of this in Ubuntu(Gnome) 16.04. They work great together, specially if you want to map forests, woods, reservoirs, riverbanks and any other large polygon. Take into consideration that you will have to tune the preferences of the FastDraw plugin to balance node density and shape quality. You do not want to make something with an excesive number of nodes but at the same time you want to take advantage of the level of detail that the pen alows you to get. Hope this helps you. Julio Costa Zambelli Fundación OpenStreetMap Chile julio.co...@openstreetmap.cl https://www.openstreetmap.cl/ Cel: +56(9)89981083 On 13 March 2018 at 21:41, Lists <blsli...@gmail.com> wrote: Does anyone know if it is possible to use a pen tablet input device, ideally in ubuntu, to do the mapping for the missing maps? If so, can anyone recommend a specific tablet? Bryan Sayer ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot
Re: [HOT] Using a pen tablet for mapping input
That isn't the type of tablet I am talking about - not an iPad but the type graphic designers use. Bryan Sayer Original message From: john whelan <jwhelan0...@gmail.com> Date: 03/13/2018 8:48 PM (GMT-05:00) To: Lists <blsli...@gmail.com> Cc: HOT <hot@openstreetmap.org> Subject: Re: [HOT] Using a pen tablet for mapping input My feeling is tablets are not ideal unless you use a mouse, a wireless one would work fine. It's a matter of control, I have a Microsoft surface tablet lying around it has the computing power but until I used a wireless mouse with it I had difficulty with the pen. JOSM should run under ubuntu. Cheerio John On 13 March 2018 at 20:41, Lists <blsli...@gmail.com> wrote: Does anyone know if it is possible to use a pen tablet input device, ideally in ubuntu, to do the mapping for the missing maps? If so, can anyone recommend a specific tablet? Bryan Sayer ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot
[HOT] Using a pen tablet for mapping input
Does anyone know if it is possible to use a pen tablet input device, ideally in ubuntu, to do the mapping for the missing maps? If so, can anyone recommend a specific tablet? Bryan Sayer ___ HOT mailing list HOT@openstreetmap.org https://lists.openstreetmap.org/listinfo/hot