Re: [OSM-Talk-ZA] KZN Schools Data
I was speaking to Curtis Burisch off-list, who says that he can probably do this checking automatically on the NGI data. He says that he can not post to the list for some reason, but I am waiting to hear back from him how it goes. Otherwise I will start to undertake that manual check in small batches. I have no idea how long it will take though. I predict ages, so if people are willing to help, maybe we can co-ordinate our efforts. There are in excess of 30 000 records in total, so if we can do it (semi-)automatically, that would obviously be a major bonus. I agree that being able to feed back any errors we turn up would be good, and makes it more likely that we can potentially get access to more data. -- mtb Date: Mon, 10 Feb 2014 18:25:53 +0400 From: Gerhardus Geldenhuis gerhardus.geldenh...@gmail.com Subject: Re: [OSM-Talk-ZA] KZN Schools Data If we can feedback to DoE that would be fantastic. I would rather see a slower but more thorough process. Being able to contribute back to the data source would make for a good future model of contributing data and could encourage more contributions from other sources and government departments. Regards On 10 February 2014 17:39, m...@martinb.za.net wrote: On Mon, Feb 10, 2014 at 11:47 AM, m...@martinb.za.net wrote: Hi all, I came across this the other day: http://www.education.gov.za/EMIS/EMISDownloads/tabid/466/Default.aspx It is spatial data for all the schools in the country. I am not sure whether this can be used or not, but it might be useful nonetheless, especially for rural schools. I am not 100% sure what the guidelines on importing this sort of data are. I informally asked the Department of Basic Education (DoBE) around a year ago if OpenStreetMap may use the dataset. They said we may. I have also been in contact with the DoBE employee who maintains the dataset, he is eager for us to feed back updates/corrections. The position data is unfortunately not reliably accurate for rural schools. Gerhardus and I have a basic repo with some work in it: https://github.com/gjngeldenhuis/osm-za-schools The data can be loaded into QGIS (or similar), but converting the data to OSM format would require work and coordination. (ogr2osm, buffer excluding existing data etc) Regards Grant Hi Grant, I am wondering if this is the source of Google Map's school positions. Most of them appear to be fairly accurate, based on my wanderings in the sticks of KZN and the Transkei. At least, there is usually a school where Google Maps says there is one. Would simply (hahaha) checking on the aerial imagery that there is what looks like a school at places that the data says there is one be enough to constitute fact-checking for the time-being? They are usually quite visible as schools, in my experience. If we can find a sane way of uploading them in small batches of 15 or 20 schools, that sort of checking should be doable, if very time-consuming. But, at the same time, we can feed that back to the DoE. Will look at what you guys have in the github repo. Thanks. mtb ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za -- Gerhardus Geldenhuis -- next part -- An HTML attachment was scrubbed... URL: http://lists.openstreetmap.org/pipermail/talk-za/attachments/20140210/bd891684/attachment-0001.html -- ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za End of Talk-ZA Digest, Vol 163, Issue 2 *** ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za
Re: [OSM-Talk-ZA] KZN Schools Data
Hi all, I have resolved the problem with not being able to post to the list -- thanks Grant for sorting that out for me! I have a local copy of the CD:NGI dataset, and have written software to analyse and display it, and to manipulate POIs. The display UI is pretty much designed to make exactly this task fairly painless -- I can probably zip through more than one record every 5 seconds -- so it'll be about 24 hours of work. Unfortunately I can't open-source this software, as it's my meal ticket, but I'm happy to check the school data in order to give back to the community. Regards Curtis. -Original Message- From: m...@martinb.za.net [mailto:m...@martinb.za.net] Sent: 11 February 2014 14:56 To: talk-za@openstreetmap.org Subject: Re: [OSM-Talk-ZA] KZN Schools Data I was speaking to Curtis Burisch off-list, who says that he can probably do this checking automatically on the NGI data. He says that he can not post to the list for some reason, but I am waiting to hear back from him how it goes. Otherwise I will start to undertake that manual check in small batches. I have no idea how long it will take though. I predict ages, so if people are willing to help, maybe we can co-ordinate our efforts. There are in excess of 30 000 records in total, so if we can do it (semi-)automatically, that would obviously be a major bonus. I agree that being able to feed back any errors we turn up would be good, and makes it more likely that we can potentially get access to more data. -- mtb Date: Mon, 10 Feb 2014 18:25:53 +0400 From: Gerhardus Geldenhuis gerhardus.geldenh...@gmail.com Subject: Re: [OSM-Talk-ZA] KZN Schools Data If we can feedback to DoE that would be fantastic. I would rather see a slower but more thorough process. Being able to contribute back to the data source would make for a good future model of contributing data and could encourage more contributions from other sources and government departments. Regards On 10 February 2014 17:39, m...@martinb.za.net wrote: On Mon, Feb 10, 2014 at 11:47 AM, m...@martinb.za.net wrote: Hi all, I came across this the other day: http://www.education.gov.za/EMIS/EMISDownloads/tabid/466/Default.as px It is spatial data for all the schools in the country. I am not sure whether this can be used or not, but it might be useful nonetheless, especially for rural schools. I am not 100% sure what the guidelines on importing this sort of data are. I informally asked the Department of Basic Education (DoBE) around a year ago if OpenStreetMap may use the dataset. They said we may. I have also been in contact with the DoBE employee who maintains the dataset, he is eager for us to feed back updates/corrections. The position data is unfortunately not reliably accurate for rural schools. Gerhardus and I have a basic repo with some work in it: https://github.com/gjngeldenhuis/osm-za-schools The data can be loaded into QGIS (or similar), but converting the data to OSM format would require work and coordination. (ogr2osm, buffer excluding existing data etc) Regards Grant Hi Grant, I am wondering if this is the source of Google Map's school positions. Most of them appear to be fairly accurate, based on my wanderings in the sticks of KZN and the Transkei. At least, there is usually a school where Google Maps says there is one. Would simply (hahaha) checking on the aerial imagery that there is what looks like a school at places that the data says there is one be enough to constitute fact-checking for the time-being? They are usually quite visible as schools, in my experience. If we can find a sane way of uploading them in small batches of 15 or 20 schools, that sort of checking should be doable, if very time-consuming. But, at the same time, we can feed that back to the DoE. Will look at what you guys have in the github repo. Thanks. mtb ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za -- Gerhardus Geldenhuis -- next part -- An HTML attachment was scrubbed... URL: http://lists.openstreetmap.org/pipermail/talk-za/attachments/20140210 /bd891684/attachment-0001.html -- ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za End of Talk-ZA Digest, Vol 163, Issue 2 *** ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za
[OSM-Talk-ZA] KZN Schools Data
Hi all, I came across this the other day: http://www.education.gov.za/EMIS/EMISDownloads/tabid/466/Default.aspx It is spatial data for all the schools in the country. I am not sure whether this can be used or not, but it might be useful nonetheless, especially for rural schools. I am not 100% sure what the guidelines on importing this sort of data are. The data is in Excel format, but I am converting it to .csv (and probably as shapefiles) for another project. I will upload them somewhere useful later, and post the link, if anyone wants to grab them. mtb ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za
Re: [OSM-Talk-ZA] KZN Schools Data
Under TERMS OF USE at the bottom of the page: --snip-- COPYRIGHT AND TRADEMARK NOTICES: All contents of the Department of Basic Education Web Site are: Copyright: Department of Basic Education 2014 and/or its suppliers. All rights reserved. --snip-- IANAL but AFAIK that means you have no rights whatsoever, you can't even read them, let alone create derived works (eg. CSV) or distribute (via OSM), without getting permission from the copyright holders. It seems like that's not what they intended. Maybe email them and ask? Regards Damjan On Mon, Feb 10, 2014 at 11:47 AM, m...@martinb.za.net wrote: Hi all, I came across this the other day: http://www.education.gov.za/EMIS/EMISDownloads/tabid/466/Default.aspx It is spatial data for all the schools in the country. I am not sure whether this can be used or not, but it might be useful nonetheless, especially for rural schools. I am not 100% sure what the guidelines on importing this sort of data are. The data is in Excel format, but I am converting it to .csv (and probably as shapefiles) for another project. I will upload them somewhere useful later, and post the link, if anyone wants to grab them. mtb ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za
Re: [OSM-Talk-ZA] KZN Schools Data
On 10 February 2014 09:47, m...@martinb.za.net wrote: Hi all, I came across this the other day: http://www.education.gov.za/EMIS/EMISDownloads/tabid/466/Default.aspx It is spatial data for all the schools in the country. I am not sure whether this can be used or not, but it might be useful nonetheless, especially for rural schools. I am not 100% sure what the guidelines on importing this sort of data are. I informally asked the Department of Basic Education (DoBE) around a year ago if OpenStreetMap may use the dataset. They said we may. I have also been in contact with the DoBE employee who maintains the dataset, he is eager for us to feed back updates/corrections. The position data is unfortunately not reliably accurate for rural schools. Gerhardus and I have a basic repo with some work in it: https://github.com/gjngeldenhuis/osm-za-schools The data can be loaded into QGIS (or similar), but converting the data to OSM format would require work and coordination. (ogr2osm, buffer excluding existing data etc) Regards Grant ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za
Re: [OSM-Talk-ZA] KZN Schools Data
When I spoke to the guys in the OKFN mailing list, they said that it would probably be fine to just go ahead and use it, since it was all rather murky. I would prefer to be more sure with something that I try and put into OSM though, rather than just my own project. Under TERMS OF USE at the bottom of the page: --snip-- COPYRIGHT AND TRADEMARK NOTICES: All contents of the Department of Basic Education Web Site are: Copyright: Department of Basic Education 2014 and/or its suppliers. All rights reserved. --snip-- IANAL but AFAIK that means you have no rights whatsoever, you can't even read them, let alone create derived works (eg. CSV) or distribute (via OSM), without getting permission from the copyright holders. It seems like that's not what they intended. Maybe email them and ask? Regards Damjan On Mon, Feb 10, 2014 at 11:47 AM, m...@martinb.za.net wrote: Hi all, I came across this the other day: http://www.education.gov.za/EMIS/EMISDownloads/tabid/466/Default.aspx It is spatial data for all the schools in the country. I am not sure whether this can be used or not, but it might be useful nonetheless, especially for rural schools. I am not 100% sure what the guidelines on importing this sort of data are. The data is in Excel format, but I am converting it to .csv (and probably as shapefiles) for another project. I will upload them somewhere useful later, and post the link, if anyone wants to grab them. mtb ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za
Re: [OSM-Talk-ZA] KZN Schools Data
If we can feedback to DoE that would be fantastic. I would rather see a slower but more thorough process. Being able to contribute back to the data source would make for a good future model of contributing data and could encourage more contributions from other sources and government departments. Regards On 10 February 2014 17:39, m...@martinb.za.net wrote: On Mon, Feb 10, 2014 at 11:47 AM, m...@martinb.za.net wrote: Hi all, I came across this the other day: http://www.education.gov.za/EMIS/EMISDownloads/tabid/466/Default.aspx It is spatial data for all the schools in the country. I am not sure whether this can be used or not, but it might be useful nonetheless, especially for rural schools. I am not 100% sure what the guidelines on importing this sort of data are. I informally asked the Department of Basic Education (DoBE) around a year ago if OpenStreetMap may use the dataset. They said we may. I have also been in contact with the DoBE employee who maintains the dataset, he is eager for us to feed back updates/corrections. The position data is unfortunately not reliably accurate for rural schools. Gerhardus and I have a basic repo with some work in it: https://github.com/gjngeldenhuis/osm-za-schools The data can be loaded into QGIS (or similar), but converting the data to OSM format would require work and coordination. (ogr2osm, buffer excluding existing data etc) Regards Grant Hi Grant, I am wondering if this is the source of Google Map's school positions. Most of them appear to be fairly accurate, based on my wanderings in the sticks of KZN and the Transkei. At least, there is usually a school where Google Maps says there is one. Would simply (hahaha) checking on the aerial imagery that there is what looks like a school at places that the data says there is one be enough to constitute fact-checking for the time-being? They are usually quite visible as schools, in my experience. If we can find a sane way of uploading them in small batches of 15 or 20 schools, that sort of checking should be doable, if very time-consuming. But, at the same time, we can feed that back to the DoE. Will look at what you guys have in the github repo. Thanks. mtb ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za -- Gerhardus Geldenhuis ___ Talk-ZA mailing list Talk-ZA@openstreetmap.org https://lists.openstreetmap.org/listinfo/talk-za
