Re: [HOT] Validators [was: COVID-19 For The Long Haul]

2020-04-24 Thread Lists


I wonder if it would be possible to "validate" in real time. Some method that a 
validator could watch as the mapper did their thing, and make suggestions as 
they went? Then it becomes both training and validation simultaneously. 
Obviously it would have to be on a consent basis from the mapper, ie they would 
have to opt in when they started and a validator would have to be available. 
Otherwise, it seems like it would be better just to make the correction and 
maybe have it send a message to the mapper about what got changed.Bryan Sayer 

 Original message 
From: john whelan  
Date: 04/24/2020  9:43 AM  (GMT-05:00) 
To: Jean-Marc Liotier  
Cc: "HOT@OSM (Humanitarian OpenStreetMap Team)"  
Subject: Re: [HOT] Validators [was: COVID-19 For The Long Haul] 

What I found when validating HOT tasks was that if I provided feedback that 
wasn't too negative on the task "ie the african highway wiki suggests that this 
type of highway should be mapped thus: with a link and reference to the wiki 
rather than you done it wrong" then the mapper would go on to do far more tiles 
and do them correctly, but it had to be done very shortly after the mapper had 
mapped.  So I'd sit on a project and immediately validate the tiles as they 
were done.  It took considerable time and effort on my part to do this.  I also 
noticed some validation was done by inexperienced mappers who were invalidating 
tiles for correctly mapped highways etc.  One that comes to mind was project 
manager who invalidated a tile for a highway that had been correctly mapped in 
OSM before the project started on the grounds that mapping highways was not 
part of the project.However what I noticed as Jean-Marc has commented was that 
much of the mapping problems were from mappers who hadn't completed the tile 
and their feedback wasn't immediate.  Feedback sent to them was basically 
ignored 99% of the time.A couple of things happened.  The task manager changed 
and I could no longer find the last tile mapped.  Response tails off over time. 
 Within the hour 80% response, within a day 50% response, a week 2% response.  
Validating a tile a week later meant the feedback didn't reach the mapper 
immediately.  Second I'd no idea if the mapper had corrected their problems 
later or not.  So the mapper might get half a dozen messages for tiles they had 
mapped sometime ago and they had already changed their mapping practices.  This 
is not positive feedback.  The second thing was the projects wanted buildings. 
I'd already noticed that some buildings were being mapped two or three times.  
Validating a building? Well it takes me 2 or 3 mouse clicks to map one in JOSM 
with the building tool, building=yes.  iD takes more clicks.  To correct an 
incorrect building takes more effort than to map it correctly in the first 
place.  Someone was kind enough to build me a script in JOSM that detects 
duplicate buildings.  I'm not going to validate work when it takes longer to 
validate than to do it correctly in the first place.Then it gets interesting.  
The JOSM validation tools have improved.  These days I can grab about a tenth 
of an African country at a time.  It takes 16 gigs of memory and JOSM has to be 
set up correctly but it works.  The duplicate building script now will detect 
duplicate buildings over one tenth of the country not just a tiny tile.  JOSM 
validation and the todo list are very powerful for picking up crossing 
highways, other errors and doubtful tagging.These days there are more automated 
approaches to picking up errors in mapping.  Both Jean-Marc and myself fix 
multiple errors by HOT mappers.  I must confess that if the error was made four 
years ago on a HOT project by a mapper who has made four edits and the mapper 
hasn't mapped for four years I might even correct the error without a changeset 
comment.I worked with the training group to identify the most common errors, I 
understand that training for project managers and validators has improved and 
projects no longer ask new mappers for complex mapping.I understand that 
validation can help new mappers and get projects completed more quickly but I 
also understand it takes a lot of time and effort on behalf of the validators 
to do it right.Cheerio JohnOn Fri, 24 Apr 2020 at 07:06, Jean-Marc Liotier 
 wrote:On 4/24/20 12:26 PM, Russell Deffner wrote:
> Especially crucial are our Validators! With so many projects in so 
> many locations, it will be a monumental task to keep up on validation. 
> If you have the role, please leave the mapping to the newer 
> contributors and help us keep our quality up and give instructions to 
> mappers as soon as possible.
What happens when tasks are invalidated ? In theory the errant 
contributor welcomes constructive feedback, fixes his contribution and 
mends his ways. How often does that happen in practice ? I almost (there 
are a few happy exceptions of growing contributors) never receive 
answers to changeset comments, 

Re: [HOT] weeklyOSM #458 2019-04-23-2019-04-29

2019-05-04 Thread Lists


I am suddenly getting your messages twice. Perchance do you have 
blsli...@gmail.com in the distribution list twice?Bryan Sayer 

 Original message 
From: weeklyteam  
Date: 05/04/2019  1:27 PM  (GMT-05:00) 
To: hot@openstreetmap.org 
Subject: [HOT] weeklyOSM #458 2019-04-23-2019-04-29 

The weekly round-up of OSM news, issue # 458,is now available online in 
English, giving as always a summary of all things happening in the 
openstreetmap world: http://www.weeklyosm.eu/en/archives/11987/Enjoy! Did you 
know that you can also submit messages for the weeklyOSM? Just log in to 
https://osmbc.openstreetmap.de/login with your OSM account. Read more about how 
to write a post here: http://www.weeklyosm.eu/this-news-should-be-in-weeklyosm 
weeklyOSM? who: 
https://wiki.openstreetmap.org/wiki/WeeklyOSM#Available_Languages where?: 
https://umap.openstreetmap.fr/en/map/weeklyosm-is-currently-produced-in_56718#2/8.6/108.3___HOT
 mailing listHOT@openstreetmap.orghttps://lists.openstreetmap.org/listinfo/hot___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot


Re: [HOT] "Combined with satellite data, recently made public, they can now ..."

2018-07-21 Thread Lists


Interesting. Maybe contact the authors and ask what they are referring to 
regarding satellite imagery? It might be a generic statement regarding all 
satellite imagery that is available. 
Bryan Sayer 

 Original message 
From: Bjoern Hassler  
Date: 07/21/2018  8:42 AM  (GMT-05:00) 
To: hot  
Subject: [HOT] "Combined with satellite data, recently made public, they 
can now ..." 

Hello all,
this article in the 
Guardian:https://www.theguardian.com/global-development/2018/jul/16/buzzwords-crazes-broken-aid-system-poverty
has this somewhat enigmatic sentence in it: ""Combined with satellite data, 
recently made public, they can now ..."
Any idea what this "satellite data, recently made public" might be? The article 
doesn't provide a country or context, or what type of data.
Any thoughts?
Many thanks!Bjoern
___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot


Re: [HOT] Why the HOT obsession with low quality buildings in Africa ?

2018-07-02 Thread Lists


I concur with the points made by Jean-Marc Liotier. As Deming said in the 50's, 
it is important to build quality into the process, not depend on checks after 
the fact.
Along those lines, I still think that we could have an AI program do a big part 
of the initial mapping.

Bryan Sayer 

 Original message 
From: Jean-Marc Liotier  
Date: 07/02/2018  10:58 AM  (GMT-05:00) 
To: AMEGAYIBO Kokou ELolo  
Cc: t...@openstreetmap.org, hot@openstreetmap.org 
Subject: Re: [HOT] Why the HOT obsession with low quality buildings in
  Africa ? 

On Mon, July 2, 2018 11:55 am, AMEGAYIBO Kokou ELolo wrote:
>
> The majority of these tasks were created in training workshops on
> OpenStreetMap in Bamako, quality control work is done afterwards by the
> local community normally. I share your points of view, but for training
> workshops it is our best method to channel, control the work of the
> newbies and also familiarize them with the use of the Tasking Manager.
> I am open to any contribution who can help us improving our approach.

I understand the difficulty of getting large numbers of new contributors
started with Openstreetmap - mistakes are normal and must be accepted as a
cost of growing the project. Nevertheless, I think that there are ways to
keep that cost lower.

First, and most important, I believe that quality control should not be
relegated to "done afterwards" - especially with less proficient
contributors who are most likely to make mistakes, and especially if they
are enthusiastic (it pains me to see incredible dedication in go to
waste). Quality control must be an integral part of the contribution and
that must be drilled into new contributors as early as possible. Insist on
using the JOSM Validator, have the users look at their own contributions
on Osmose... Show them how to be more responsible of their own work ! Or
course, having experienced users supervise is valuable but they are a
scarce resource and most importantly they risk infantilizing less
experienced contributors. Most of my own contributions start with looking
at Osmose, seeing a bunch of errors and I start editing there... Quality
control is a core skill for everyone, at every level of proficiency.

Second, have users. Creating data costs, maintaining it costs... Why are
we doing it ? We are doing it for users. How do we judge quality ? I am as
fond of the map as an aesthetic object as anyone here but we all agree
that we want to put our efforts to good uses - so we judge quality by the
fitness of the product for a particular use. If the data has no users, it
is dead data.  For example, as a user, I am a walker and a cyclist - I
enjoy buildings on the map as landmarks to help me navigate... That is my
personal way of judging quality - but other users may have other ways: to
some users the purpose of having buildings in Openstreetmap may just be
"there is a building here and its shape is not that important" - and maybe
those users are the majority, who knows ? So, as a producer of data, be
aware of how the data is used - that is the key to rational quality
control. That remains true if you just chose the buildings as a new
contributor training object.

Third, make sure that the most recent imagery of decent quality is used.
For the specific case of Bamako and at the current time, ESRI World is
better than Bing: https://i.imgur.com/w6YBG70.jpg - of course, this is
subject to change over time. In understand that, for lack of available
properly surveyed geodesic reference points, large numbers of users
working with multiple sources of imagery generates its own challenges (I
found that particularly frustrating in Dakar's suburbs).

___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot
___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot


Re: [HOT] Using AI for mapping from images

2018-04-16 Thread Lists


Fascinating! I figured any AI results would need to be reviewed by humans.
Bryan Sayer 

 Original message 
From: Daniel O'Connor <daniel.ocon...@gmail.com> 
Date: 04/16/2018  4:07 AM  (GMT-05:00) 
To: Lists <blsli...@gmail.com> 
Cc: HOT <hot@openstreetmap.org> 
Subject: Re: [HOT] Using AI for mapping from images 

Indeed it has, both in general and specific to OSM
https://developmentseed.org/blog/2017/01/30/machine-learning-learnings/


https://wiki.openstreetmap.org/wiki/AI-Assisted_Road_Tracing

The consensus seems to be 'AI assisted'; rather than '100% AI' is better
On Mon, 16 Apr. 2018, 12:37 pm Lists, <blsli...@gmail.com> wrote:


I confess that I have not looked closely at the mapping of satellite images, 
but I have been wondering if it is possible to accomplish much of the mapping 
using artificial intelligence and deep learning. Has this been looked into?
Bryan Sayer ___

HOT mailing list

HOT@openstreetmap.org

https://lists.openstreetmap.org/listinfo/hot


___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot


[HOT] Using AI for mapping from images

2018-04-15 Thread Lists


I confess that I have not looked closely at the mapping of satellite images, 
but I have been wondering if it is possible to accomplish much of the mapping 
using artificial intelligence and deep learning. Has this been looked into?
Bryan Sayer ___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot


[HOT] Immediate 17-month full-time opportunity in international household survey work on gridded sampling

2018-03-19 Thread Lists


Nice opportunity for someone with mapping and sampling experience. Grid 
sampling makes heavy use of maps.


Bryan Sayer 



Describes an interesting (and immediate) 17-month full-time job opportunity for 
someone who has a UK/EU visa and flexibility to travel internationally to come 
up to speed on gridded sampling techniques and help pilot those methods in 
realistic settings and to develop & deliver appropriate training materials.

Longer lead-in:

I am joining some work in an interesting area with Dana Thomson and the 
GridSample.org team at www.flowminder.org. and we need some help.  

Household surveys play an important role in health/welfare/program monitoring 
and evaluation in low- and middle-income countries.  The standard design is a 
multi-stage stratified cluster survey where primary sampling units (PSUs) are 
selected from a census-based
 list of enumeration areas (EAs) and the probability of selection is 
proportional to a measure of estimated EA size.  In many cases the information 
about cluster size is no longer current, so the selection probabilities and 
therefore the first stage survey weights are "off" and those errors are only 
partially redeemed later in the survey process.

There's some interesting work in building gridded datasets with updated 
population estimates, which are seeded with census data and updated with more 
recent data sources, like assessment of night-time lights from satellite 
imagery and cell-phone activity from de-identified datasets.

There is growing interest in identifying survey settings where it makes sense 
to select PSUs from a gridded population dataset INSTEAD of the census frame 
(or maybe use one to augment the other).  This posting describes an interesting 
(and immediate) 17-month full-time job opportunity for someone who has a UK/EU 
visa and flexibility to
 travel internationally to come up to speed on the gridded sampling techniques 
and help pilot the methods in realistic settings and to develop & deliver 
appropriate training materials.

If you have detailed questions, please write to dana.r.thom...@gmail.com.  


We re-titled the position "Survey Practitioner (GridSample Project)" to clarify 
that the right candidate is not necessarily a specialist in gridded population 
sampling methods (yet). The right candidate very likely has exclusive 
experience with traditional cluster surveys.


This position is well-supported with extensive opportunity to learn and grow. 
Personalized mentorship from the GridSample Manager on gridded population 
sampling methods will be provided, and the Flowminder/WorldPop team provides a 
rich survey community-of-practice.


Gridded population sampling methods are emerging, and as a result, this 
position is ripe with opportunity for creative problem-solving and input, 
allowing the candidate to establish themselves as an expert and innovator in 
this new field.


We are interested in candidates who are passionate about social equity. This 
project was born from the belief that the needs of everyone, including the 
poorest, must be accurately measured to be effectively addressed.


I have heard from a number of qualified candidates who do not hold a UK/EU 
passport/visa. The UK/EU requirement is because Flowminder Foundation is not 
yet in a position to sponsor UK visas (we are actively working on this). We 
strongly encourage interested non-UK/EU candidates to apply because gridded 
population sampling is a rapidly evolving field, and when new opportunities 
emerge, we will come back to this pool of candidates. 

==

Role: Survey Practioniter (GridSample Project)
Job No: GS0218
Location: Southampton, UK
Duration: Fixed term contract (17 months, full time)
Start date: 3 April 2018
Salary: £45,180
Reporting to: GridSample Manager
==
The Flowminder Foundation has an exciting opportunity for a survey practitioner 
to play a key role in a Gates Foundation-funded gridded population survey 
evaluation in Nigeria, and develop foundational training materials for the 
emerging field of gridded population sampling.
Flowminder is a unique, startup-like non-profit that develops advanced 
technological solutions to address humanitarian problems. Our work is an 
exciting blend of software development, data analytics, academic research, and 
international development, that takes place in a dynamic and highly 
collaborative environment.
==
About GridSample.org
Gridded population survey sampling is an emerging method, used most often when 
census data is outdated or inaccurate. Survey teams also consider gridded 
population sampling to perform spatial+population sampling and to select 
sampling areas that are smaller or larger than standard census sampling units. 
The GridSample R algorithm or web tool have been 

Re: [HOT] Centre for Humanitarian Data - Data Fellows

2018-03-14 Thread Lists


I agree, and the predictive analytics fellowship should have a great 
opportunity for use of map data combined with other humanitarian data for 
modelling and prediction.
Bryan Sayer 

 Original message 
From: Tyler Radford  
Date: 03/13/2018  7:54 PM  (GMT-05:00) 
To: hot  
Subject: [HOT] Centre for Humanitarian Data - Data Fellows 

Hi, it would be wonderful if HOT community members apply:
https://centre.humdata.org/data-fellows/


Tyler RadfordExecutive directortyler.radf...@hotosm.org@TylerSRadford
Humanitarian OpenStreetMap TeamUsing OpenStreetMap for Humanitarian Response & 
Economic Developmentweb | twitter | facebook | donate


___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot


Re: [HOT] Using a pen tablet for mapping input

2018-03-14 Thread Lists


Thanks everyone! This is exactly what I wanted to know.  I'm thinking that a 
pen and tablet will be easier for me to control. And I am also trying to get 
away from Windoze.


Bryan Sayer 

 Original message 
From: Julio Costa Zambelli <julio.co...@openstreetmap.cl> 
Date: 03/14/2018  9:07 AM  (GMT-05:00) 
To: Lists <blsli...@gmail.com> 
Cc: hot <hot@openstreetmap.org> 
Subject: Re: [HOT] Using a pen tablet for mapping input 

I have been using a Wacom Intuos CTL-490 (probably the cheapest Wacom 
available, around USD110 here) combined with JOSM and its FastDraw plugin for 
over a year now. All of this in Ubuntu(Gnome) 16.04. 

They work great together, specially if you want to map forests, woods, 
reservoirs, riverbanks and any other large polygon. Take into consideration 
that you will have to tune the preferences of the FastDraw plugin to balance 
node density and shape quality. You do not want to make something with an 
excesive number of nodes but at the same time you want to take advantage of the 
level of detail that the pen alows you to get. 

Hope this helps you.

   

Julio Costa Zambelli
Fundación OpenStreetMap Chile

julio.co...@openstreetmap.cl

https://www.openstreetmap.cl/
Cel: +56(9)89981083

On 13 March 2018 at 21:41, Lists <blsli...@gmail.com> wrote:


Does anyone know if it is possible to use a pen tablet input device, ideally in 
ubuntu, to do the mapping for the missing maps? If so, can anyone recommend a 
specific tablet?


Bryan Sayer 
___

HOT mailing list

HOT@openstreetmap.org

https://lists.openstreetmap.org/listinfo/hot




___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot


Re: [HOT] Using a pen tablet for mapping input

2018-03-13 Thread Lists


That isn't the type of tablet I am talking about - not an iPad but the type 
graphic designers use.


Bryan Sayer 

 Original message 
From: john whelan <jwhelan0...@gmail.com> 
Date: 03/13/2018  8:48 PM  (GMT-05:00) 
To: Lists <blsli...@gmail.com> 
Cc: HOT <hot@openstreetmap.org> 
Subject: Re: [HOT] Using a pen tablet for mapping input 

My feeling is tablets are not ideal unless you use a mouse, a wireless one 
would work fine.  It's a matter of control, I have a Microsoft surface tablet 
lying around it has the computing power but until I used a wireless mouse with 
it I had difficulty with the pen.

JOSM should run under ubuntu.

Cheerio John

On 13 March 2018 at 20:41, Lists <blsli...@gmail.com> wrote:


Does anyone know if it is possible to use a pen tablet input device, ideally in 
ubuntu, to do the mapping for the missing maps? If so, can anyone recommend a 
specific tablet?


Bryan Sayer 
___

HOT mailing list

HOT@openstreetmap.org

https://lists.openstreetmap.org/listinfo/hot




___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot


[HOT] Using a pen tablet for mapping input

2018-03-13 Thread Lists


Does anyone know if it is possible to use a pen tablet input device, ideally in 
ubuntu, to do the mapping for the missing maps? If so, can anyone recommend a 
specific tablet?


Bryan Sayer ___
HOT mailing list
HOT@openstreetmap.org
https://lists.openstreetmap.org/listinfo/hot