Re: [Talk-gb-london] bulk importing london open data to osm

[Nick Allen]

Hi Joe,

Just in case you were wondering if Tom was the only one here.

Welcome, and I look forward to seeing progress.

I think Tom made a very good job of answering you, so I won't interfere and
confuse things.

Regards

Nick (Tallguy)

Nick & Daphne
my phone is responsible for any spelling mistakes!

On Thu, 14 Mar 2019, 13:19 Joseph Leach,  wrote:

> attending the meetup sounds like a very good idea
>
>
> on the bus stop example, corporate data releases can have
> inaccuracies ... at this point i should note that i copied a drinking
> fountain  dataset to sixteen
> amenities  (and added metadata to one in
> bexleyheath), looking back, adding notes rather than features may have
> been better in relation to the need for surveys
>
>
> will now go and check the guys hospital one
>  during lunch
> --
> *From:* Tom Chance 
> *Sent:* 14 March 2019 12:12:47
> *To:* Joseph Leach
> *Cc:* talk-gb-london@openstreetmap.org
> *Subject:* Re: [Talk-gb-london] bulk importing london open data to osm
>
> Hi Joe,
>
> There's further useful guidance on the wiki, inc on the licensing point:
> https://wiki.openstreetmap.org/wiki/Import/Guidelines
>
> There's also a regular pub meet-up where you'll find people more up to
> date and knowledgeable than me! The next is on Thurs 28th:
> https://wiki.openstreetmap.org/wiki/London
>
> One thing they might have thoughts on is how to involve the wider OSM
> London community, for example in checking and cleaning data that can be
> imported, or manually adding data. I recall one import many years ago of
> TfL bus stop data, where we then had to go through removing lots of
> duplicates, and quite often we found that the TfL data was less accurate
> than existing OSM data! So it was worth checking each one with a survey.
>
> Tom
>
> m: 07866 447 075
> w: http://tomchance.org
>
>
> On Wed, 13 Mar 2019 at 15:16, Joseph Leach 
> wrote:
>
> thanks, this is encouraging
>
>
> in relation to charging stations this has already raised questions:
>
>
>
>- the data is sourced via various providers, so licensing will
>likely require several parties to be involved
>- the data includes an attribute relating to taxi/public use which could
>raise issues relating to access
>- the data contains likely duplicates of stations already on osm; looking
>at both tfl and osm data together
>
> 
>  likely
>duplicates can be seen for example along Southwark Street SE1, we can use
>gis to investigate stations based on proximity to those already mapped
>
>
> presumably these questions affect all kinds of open data release, so it
> will be good to get used to dealing with such matters
>
>
> joe
> --
> *From:* Tom Chance 
> *Sent:* 13 March 2019 08:48:51
> *To:* Joseph Leach
> *Cc:* talk-gb-london@openstreetmap.org
> *Subject:* Re: [Talk-gb-london] bulk importing london open data to osm
>
> Hi Joe,
>
> This would be great. Welcome to the list. I used to work at the GLA
> (2009-16) and am glad to see you proposing this.
>
> Others will have a better idea of the process, but I'd think a first step
> would be to create a wiki page and set out the datasets you have,
> indicating for each one any licensing conditions/issues, what fields you'd
> import and a check on the current data already existing.
>
> On the latter point, for example, there are already quite a few charging
> stations mapped (https://overpass-turbo.eu/s/GVx) and we wouldn't want to
> duplicate those with your import. You can either go through them one by
> one, deleting duplicates from your dataset before importing (or merging
> data to add new fields), or stick the dataset up and invite people to
> manually check and copy across each charging station.
>
> Tom
>
>
> m: 07866 447 075
> w: http://tomchance.org
>
>
> On Tue, 12 Mar 2019 at 22:51, Joseph Leach 
> wrote:
>
> hello
>
>
> import guidelines
> 
>  state
> that community buy-in is a pre-requisite for osm bulk data import and as
> part of the gis team at london city hall i would like to seek community
> backing for open data releases
>
>
> as a trial run, i am manually adding eighteen newly founded drinking water
> amenities, but for larger datasets would like to investigate the
> feasibility of bulk imports, for example charging stations
>
>
> joe
>
>
> GREATER LONDON AUTHORITY NOTICE:
> The information in this email may contain confidential or privileged
> materials. For more information see
> https://www.london.gov.uk/about-us/email-notice/
> ___
> Talk-gb-london mailing list
> Talk-gb-london@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-gb-london
>
>

Re: [Talk-gb-london] bulk importing london open data to osm

[Joseph Leach]

attending the meetup sounds like a very good idea


on the bus stop example, corporate data releases can have inaccuracies ... at 
this point i should note that i copied a drinking 
fountain dataset to sixteen 
amenities (and added metadata to one in 
bexleyheath), looking back, adding notes rather than features may have been 
better in relation to the need for surveys


will now go and check the guys hospital 
one during lunch


From: Tom Chance 
Sent: 14 March 2019 12:12:47
To: Joseph Leach
Cc: talk-gb-london@openstreetmap.org
Subject: Re: [Talk-gb-london] bulk importing london open data to osm

Hi Joe,

There's further useful guidance on the wiki, inc on the licensing point: 
https://wiki.openstreetmap.org/wiki/Import/Guidelines

There's also a regular pub meet-up where you'll find people more up to date and 
knowledgeable than me! The next is on Thurs 28th: 
https://wiki.openstreetmap.org/wiki/London

One thing they might have thoughts on is how to involve the wider OSM London 
community, for example in checking and cleaning data that can be imported, or 
manually adding data. I recall one import many years ago of TfL bus stop data, 
where we then had to go through removing lots of duplicates, and quite often we 
found that the TfL data was less accurate than existing OSM data! So it was 
worth checking each one with a survey.

Tom

m: 07866 447 075
w: http://tomchance.org


On Wed, 13 Mar 2019 at 15:16, Joseph Leach 
mailto:joseph.le...@london.gov.uk>> wrote:

thanks, this is encouraging


in relation to charging stations this has already raised questions:


  *   the data is sourced via various providers, so licensing will likely 
require several parties to be involved
  *   the data includes an attribute relating to taxi/public use which could 
raise issues relating to access
  *   the data contains likely duplicates of stations already on osm; looking 
at both tfl and osm data 
together
 likely duplicates can be seen for example along Southwark Street SE1, we can 
use gis to investigate stations based on proximity to those already mapped


presumably these questions affect all kinds of open data release, so it will be 
good to get used to dealing with such matters


joe


From: Tom Chance mailto:t...@acrewoods.net>>
Sent: 13 March 2019 08:48:51
To: Joseph Leach
Cc: talk-gb-london@openstreetmap.org
Subject: Re: [Talk-gb-london] bulk importing london open data to osm

Hi Joe,

This would be great. Welcome to the list. I used to work at the GLA (2009-16) 
and am glad to see you proposing this.

Others will have a better idea of the process, but I'd think a first step would 
be to create a wiki page and set out the datasets you have, indicating for each 
one any licensing conditions/issues, what fields you'd import and a check on 
the current data already existing.

On the latter point, for example, there are already quite a few charging 
stations mapped (https://overpass-turbo.eu/s/GVx) and we wouldn't want to 
duplicate those with your import. You can either go through them one by one, 
deleting duplicates from your dataset before importing (or merging data to add 
new fields), or stick the dataset up and invite people to manually check and 
copy across each charging station.

Tom


m: 07866 447 075
w: http://tomchance.org


On Tue, 12 Mar 2019 at 22:51, Joseph Leach 
mailto:joseph.le...@london.gov.uk>> wrote:

hello


import 
guidelines
 state that community buy-in is a pre-requisite for osm bulk data import and as 
part of the gis team at london city hall i would like to seek community backing 
for open data releases


as a trial run, i am manually adding eighteen newly founded drinking water 
amenities, but for larger datasets would like to investigate the feasibility of 
bulk imports, for example charging stations


joe


GREATER LONDON AUTHORITY NOTICE:
The information in this email may contain confidential or privileged materials. 
For more information see https://www.london.gov.uk/about-us/email-notice/
___
Talk-gb-london mailing list
Talk-gb-london@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-gb-london


This message has been scanned for viruses by the Greater London Authority.

Click 
here
 to report this email as spam.

GREATER LONDON AUTHORITY NOTICE:
The information in this email may contain confidential or privileged materials. 

Re: [Talk-gb-london] bulk importing london open data to osm

[Tom Chance]

Hi Joe,

There's further useful guidance on the wiki, inc on the licensing point:
https://wiki.openstreetmap.org/wiki/Import/Guidelines

There's also a regular pub meet-up where you'll find people more up to date
and knowledgeable than me! The next is on Thurs 28th:
https://wiki.openstreetmap.org/wiki/London

One thing they might have thoughts on is how to involve the wider OSM
London community, for example in checking and cleaning data that can be
imported, or manually adding data. I recall one import many years ago of
TfL bus stop data, where we then had to go through removing lots of
duplicates, and quite often we found that the TfL data was less accurate
than existing OSM data! So it was worth checking each one with a survey.

Tom

m: 07866 447 075
w: http://tomchance.org


On Wed, 13 Mar 2019 at 15:16, Joseph Leach 
wrote:

> thanks, this is encouraging
>
>
> in relation to charging stations this has already raised questions:
>
>
>
>- the data is sourced via various providers, so licensing will
>likely require several parties to be involved
>- the data includes an attribute relating to taxi/public use which could
>raise issues relating to access
>- the data contains likely duplicates of stations already on osm; looking
>at both tfl and osm data together
>
> 
>  likely
>duplicates can be seen for example along Southwark Street SE1, we can use
>gis to investigate stations based on proximity to those already mapped
>
>
> presumably these questions affect all kinds of open data release, so it
> will be good to get used to dealing with such matters
>
>
> joe
> --
> *From:* Tom Chance 
> *Sent:* 13 March 2019 08:48:51
> *To:* Joseph Leach
> *Cc:* talk-gb-london@openstreetmap.org
> *Subject:* Re: [Talk-gb-london] bulk importing london open data to osm
>
> Hi Joe,
>
> This would be great. Welcome to the list. I used to work at the GLA
> (2009-16) and am glad to see you proposing this.
>
> Others will have a better idea of the process, but I'd think a first step
> would be to create a wiki page and set out the datasets you have,
> indicating for each one any licensing conditions/issues, what fields you'd
> import and a check on the current data already existing.
>
> On the latter point, for example, there are already quite a few charging
> stations mapped (https://overpass-turbo.eu/s/GVx) and we wouldn't want to
> duplicate those with your import. You can either go through them one by
> one, deleting duplicates from your dataset before importing (or merging
> data to add new fields), or stick the dataset up and invite people to
> manually check and copy across each charging station.
>
> Tom
>
>
> m: 07866 447 075
> w: http://tomchance.org
>
>
> On Tue, 12 Mar 2019 at 22:51, Joseph Leach 
> wrote:
>
> hello
>
>
> import guidelines
> 
>  state
> that community buy-in is a pre-requisite for osm bulk data import and as
> part of the gis team at london city hall i would like to seek community
> backing for open data releases
>
>
> as a trial run, i am manually adding eighteen newly founded drinking water
> amenities, but for larger datasets would like to investigate the
> feasibility of bulk imports, for example charging stations
>
>
> joe
>
>
> GREATER LONDON AUTHORITY NOTICE:
> The information in this email may contain confidential or privileged
> materials. For more information see
> https://www.london.gov.uk/about-us/email-notice/
> ___
> Talk-gb-london mailing list
> Talk-gb-london@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk-gb-london
>
>
>
> This message has been scanned for viruses by the Greater London Authority.
>
> Click here
> 
> to report this email as spam.
>
> GREATER LONDON AUTHORITY NOTICE:
> The information in this email may contain confidential or privileged
> materials. For more information see
> https://www.london.gov.uk/about-us/email-notice/
>
___
Talk-gb-london mailing list
Talk-gb-london@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-gb-london